Display device, remote controller and voice playing method

Abstract

The invention relates to display equipment, a remote controller and a voice playing method, and relates to the technical field of display equipment. The display equipment comprises a first communication device which communicates with a remote controller; the first audio output device performs audio playing; the first controller receives a voice key instruction sent by the remote controller under the condition that the display equipment plays audio and video; analyzing the voice key instruction to obtain a key instruction identifier and voice data; acquiring response data corresponding to the voice data; under the condition that the key instruction identifier is the first key identifier, controlling the first audio output equipment to play response data; and under the condition that the key instruction identifier is a second key identifier, keeping the first audio output device playing the currently played audio, and sending response data to the remote controller so as to play the response data through a second audio output device of the remote controller. By adopting the technical scheme, the privacy leakage of the response data can be avoided, and the influence on the watching experience of other audiences can be reduced.

Description

Technical Field

[0001] This application relates to the technical field of display devices, and in particular, to a display device, a remote control, and a voice playback method. Background Art

[0002] With the rapid development of intelligent voice technology, display devices such as televisions can not only play the audio obtained by themselves, but also respond to the user's voice data and play the response data corresponding to the voice data.

[0003] In the traditional technology, when controlling a television with a voice remote control, the voice remote control responds to the triggering operation of a voice key, collects voice data, encodes the voice data, and then sends it to the television via Bluetooth; the television parses the voice data and responds according to the voice data, and broadcasts the response data corresponding to the voice data.

[0004] However, in the above traditional technology, the privacy information in the response data will be leaked, and the playback of the current content being played on the television will be interrupted, affecting the viewing experience of other viewers. Summary of the Invention

[0005] This application provides a display device, a remote control, and a voice playback method to avoid the leakage of privacy information in response data and reduce the impact on the viewing experience of other viewers.

[0006] In a first aspect, some embodiments provide a display device, including: a first communication device configured to communicate with a remote control; a display configured to display content; a first audio output device configured to play audio; at least one first controller connected to the first communication device and the display, and configured to:

[0007] When the display device plays audio and video, receive a voice key command sent by the remote control; parse the voice key command to obtain a key command identifier and voice data; obtain response data corresponding to the voice data; when the key command identifier is a first key identifier, control the first audio output device to play the response data; when the key command identifier is a second key identifier, keep the first audio output device playing the current playing audio, and send the response data to the remote control to play the response data through a second audio output device of the remote control.

[0008] In some embodiments, when the display device plays audio and video, a voice key command sent by the remote controller is received. By parsing the voice key command, not only the traditional voice data for determining response data can be obtained, but also the key command identifier for determining the audio output device can be determined. Correspondingly, when the key command identifier is the first key identifier, the first audio output device is controlled to play the response data; when the key command identifier is the second key identifier, the response data is sent to the remote controller to play the response data through the second audio output device of the remote controller. Therefore, during the voice interaction process, the selection of the first audio output device in the display device or the second audio output device on the remote controller can be realized according to the user's trigger on the remote controller, improving the flexibility of the voice interaction process; in a scenario where the response data includes privacy data, the user is provided with the option to play the response data with the remote controller, thus avoiding the leakage of privacy data during the playback of the response data. In addition, when the key command identifier is the second key identifier, during the process of playing the response data with the second audio output device of the remote controller, the first audio output device in the display device continues to play the currently playing audio, without interrupting the currently playing audio of the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0009] In a second aspect, some embodiments further provide a remote controller, including: a second communication device configured to communicate with a display device; a second audio output device configured to play audio; at least one voice key; at least one second controller connected to the second audio output device and the at least one voice key, and configured to:

[0010] In response to a trigger operation on the voice key, collect voice data and obtain the key command identifier corresponding to the voice key; encode the voice data and the key command identifier to obtain a voice key command; send the voice key command to the display device so that the display device parses the voice key command to obtain voice data and the key command identifier; receive the response data corresponding to the voice data sent by the display device when the key command identifier is the second key identifier; control the second audio output device to play the response data; wherein, during the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the currently playing audio.

[0011] In some embodiments, in response to the triggering operation of the voice key, the remote controller can not only collect the traditional voice data for determining the response data, but also obtain the key command identifier for determining the audio output device. After sending the voice key command obtained by encoding the voice data and the key command identifier to the display device, the display device can obtain the above-mentioned voice data and determine the above-mentioned key command identifier by parsing the voice key command. Correspondingly, when the key command identifier is the second key identifier, the display device sends the response data corresponding to the voice data to the remote controller. The remote controller receives the response data and plays the response data through the second audio output device of the remote controller. Therefore, during the voice interaction process, the selection of the second audio output device on the remote controller can be realized according to the triggering of different voice keys by the user on the remote controller, improving the flexibility of the voice interaction process; in scenarios where the response data includes privacy data, the user is provided with the option to play the response data by the remote controller, thus avoiding the leakage of privacy data during the playback of the response data. In addition, during the process of playing the response data by the second audio output device of the remote controller, the first audio output device of the display device continues to play the current audio, without interrupting the current audio played by the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0012] In a third aspect, some embodiments further provide a remote controller, including: a second communication device configured to communicate with a display device; a second audio output device configured to play audio; at least one voice key; at least one second controller connected to the second audio output device and the at least one voice key, and configured to:

[0013] In response to the triggering operation of the voice key, collect voice data, and obtain the key command identifier corresponding to the operation mode of the corresponding triggering operation; encode the voice data and the key command identifier to obtain a voice key command; send the voice key command to the display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; receive the response data corresponding to the voice data sent by the display device when the key command identifier is the second key identifier; control the second audio output device to play the response data; wherein, during the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the current played audio.

[0014] In some embodiments, in response to the triggering operation of the voice button, the remote control can not only collect the traditional voice data for determining the response data, but also obtain the button instruction identifier for determining the audio output device. After sending the voice button instruction obtained by encoding the voice data and the button instruction identifier to the display device, the display device can obtain the above-mentioned voice data by parsing the voice button instruction and determine the above-mentioned button instruction identifier. Correspondingly, when the button instruction identifier is the second button identifier, the display device sends the response data corresponding to the voice data to the remote control. The remote control receives the response data and plays the response data through the second audio output device of the remote control. Therefore, during the voice interaction process, different ways for the user to trigger the voice button on the remote control can be used to select the second audio output device on the remote control, improving the flexibility of the voice interaction process; in scenarios where the response data includes private data, the user is provided with the option of playing the response data on the remote control, thereby avoiding the leakage of private data during the playback of the response data. In addition, during the process of playing the response data using the second audio output device of the remote control, the first audio output device of the display device continues to play the current audio, without interrupting the current audio played by the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0015] Fourthly, in some embodiments, a voice playback method is further provided, which is applied to a display device and includes:

[0016] When the display device is playing audio and video, receiving a voice button instruction sent by the remote control; parsing the voice button instruction to obtain a button instruction identifier and voice data; obtaining response data corresponding to the voice data; when the button instruction identifier is the first button identifier, controlling the first audio output device of the display device to play the response data; when the button instruction identifier is the second button identifier, keeping the first audio output device of the display device playing the current playing audio, and sending the response data to the remote control to play the response data through the second audio output device of the remote control.

[0017] Fifthly, in some embodiments, a voice playback method is further provided, which is applied to a remote control and includes:

[0018] In response to a triggering operation on a voice key, collect voice data and obtain a key command identifier corresponding to the voice key; encode the voice data and the key command identifier to obtain a voice key command; send the voice key command to a display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; receive response data corresponding to the voice data sent by the display device when the key command identifier is a second key identifier; control a second audio output device of the remote controller to play the response data; wherein, during the process of the second audio output device playing the response data, a first audio output device in the display device keeps playing the currently playing audio.

[0019] In a sixth aspect, some embodiments further provide a voice playback method applied to a remote controller, including:

[0020] In response to a triggering operation on a voice key, collect voice data and obtain a key command identifier corresponding to the operation mode of the corresponding triggering operation; encode the voice data and the key command identifier to obtain a voice key command; send the voice key command to a display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; receive response data corresponding to the voice data sent by the display device when the key command identifier is a second key identifier; control a second audio output device of the remote controller to play the response data; wherein, during the process of the second audio output device playing the response data, a first audio output device in the display device keeps playing the currently playing audio. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the following will briefly introduce the drawings required to be used in the description of the embodiments of the present application or the related art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0022] Figure 1 It is a schematic diagram of an operation scenario between a display device and a control device provided by some embodiments of the present application;

[0023] Figure 2 It is a schematic diagram of the hardware configuration of a display device provided by some embodiments of the present application;

[0024] Figure 3 It is a schematic diagram of the hardware configuration of a control device provided by some embodiments of the present application;

[0025] Figure 4 It is a schematic diagram of the software configuration of a display device provided by some embodiments of the present application;

[0026] Figure 5Schematic flowchart of a voice playback method provided by some embodiments of the present application;

[0027] Figure 6 Schematic flowchart of the determination steps of the current playback mode provided by some embodiments of the present application;

[0028] Figure 7 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0029] Figure 8A Schematic diagram of the structure of a remote control provided by some embodiments of the present application;

[0030] Figure 8B Schematic diagram of the structure of a remote control provided by some other embodiments of the present application;

[0031] Figure 8C Schematic diagram of the structure of a remote control provided by some other embodiments of the present application;

[0032] Figure 8D Schematic diagram of the structure of a remote control provided by some other embodiments of the present application;

[0033] Figure 8E Schematic diagram of the structure of a remote control provided by some other embodiments of the present application;

[0034] Figure 9 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0035] Figure 10 Schematic flowchart of the voice playback method provided by some embodiments of the present application;

[0036] Figure 11 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0037] Figure 12 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0038] Figure 13 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0039] Figure 14 Schematic flowchart of a voice playback method provided by some other embodiments of the present application;

[0040] Figure 15 Schematic diagram of the structure of a voice playback device provided by some embodiments of the present application;

[0041] Figure 16Schematic structural diagram of a voice playback device provided in some other embodiments of the present application;

[0042] Figure 17 Schematic structural diagram of a voice playback device provided in some other embodiments of the present application. Detailed implementation manners

[0043] Embodiments will be described in detail below, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are merely examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0044] It should be noted that the brief description of terms in the present application is only for facilitating the understanding of the following described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0045] In the embodiments of the present application, the terms "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances. The terms "include" and "have" and any variations thereof are intended to cover but not exclusively include. For example, a product or device including a series of components does not necessarily have to be limited to all the clearly listed components, but may include other components not clearly listed or inherent to these products or devices. The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.

[0046] In the embodiments of the present application, the display device 200 generally refers to a device having a screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0047] Figure 1 Schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote control, a stylus, a handle, etc.

[0048] The mobile terminal 300 can be used as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and the connection communication can be achieved through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0049] As Figure 1 also shown in the figure, the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 is allowed to establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0050] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet protocol television (IPTV), etc.

[0051] Figure 2 For some embodiments of the present application Figure 1 The hardware configuration block diagram of the display device 200 in the figure.

[0052] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0053] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, for collecting an external environmental scene, user attributes, or user interaction gestures, or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0054] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive the image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0055] In some embodiments, the communication device 220 is a component for communicating with external devices or servers 400 according to various communication protocol types. The display device 200 may be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including WiFi functionality. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0056] The communication device 220 can enable the display device 200 to communicate and connect with external devices or servers 400 in a wireless or wired connection manner. Among them, the wired connection can connect the display device 200 with external devices through components such as data lines and interfaces. The wireless connection can connect the display device 200 with external devices through wireless signals or wireless networks. The display device 200 can directly establish a connection relationship with external devices or indirectly establish a connection relationship through gateways, routers, connection devices, etc.

[0057] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and the first interface to the nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0058] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0059] In some embodiments, the user can input a user command on the graphical user interface (Graphical User Interface, GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0060] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200 or an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0061] In some embodiments, the user input interface 280 can be used to receive instructions from user inputs.

[0062] Figure 3 The hardware configuration block diagram of the control device provided in some embodiments of the present application Figure 1 The control device 100 may include: a controller 110, a communication interface 130, a user input / output interface 140, a memory 190, a power supply 180, and an audio output device 150.

[0063] The control device 100 is configured to control the display device 200, and can receive the input operation instructions of the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing the role of an interaction intermediary between the user and the display device 200.

[0064] In some embodiments, the control device 100 may be an intelligent device. For example: the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0065] In some embodiments, such as Figure 1 As shown, after installing the application for controlling the display device 200, the mobile terminal 300 or other intelligent electronic devices can perform functions similar to those of the control device 100.

[0066] The controller 110 includes a processor 112, a RAM (Random Access Memory) 113, a ROM (Read-Only Memory) 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions inside and outside.

[0067] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC (Near Field Communication) module 133, and other near field communication modules.

[0068] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.

[0069] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The communication interface 130 is configured in the control device 100. For example: modules such as WiFi, Bluetooth, and NFC can encode the user input instructions through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol, and send them to the display device 200.

[0070] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0071] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0072] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0073] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0074] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0075] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0076] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Applications can access system resources and obtain system services during execution through the API interface.

[0077] like Figure 4As shown, in the embodiments of the present application, the application framework layer includes a view system, managers, a content provider, etc. Among them, the view system can design and implement the interfaces and interactions of application programs. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The Activity Manager is used to interact with all the activities running in the system; the Location Manager is used to provide access to the system location service for system services or applications; the Package Manager is used to retrieve various information related to the application program packages currently installed on the device; the Notification Manager is used to control the display and clearing of notification messages; the Window Manager is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0078] In some embodiments, the Activity Manager is used to manage the life cycles of various application programs and the general navigation back function, such as controlling the exit, opening, and backward movement of application programs. The Window Manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, shrinking the display window, jittering the display, and distorting the display, etc.

[0079] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime library layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is to achieve.

[0080] In some embodiments, the kernel layer is a functional level between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers, etc.

[0081] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system may be in other forms.

[0082] With the rapid development of intelligent voice technology, the display device can respond to the user's voice data and play the response data corresponding to the voice data. Among them, in the traditional technology, when controlling a TV based on a voice remote control, the voice remote control responds to the triggering operation of the voice button, collects the voice data, encodes the voice data, and then transmits the encoded voice data to the TV. Among them, the transmission can be carried out through Bluetooth or NFC. The TV parses the voice data and responds according to the voice data, and broadcasts the response data corresponding to the voice data. However, in the above traditional technology, the privacy information in the response data will be leaked, and the playback of the current content being played on the TV will be interrupted, affecting the viewing experience of other viewers.

[0083] To overcome the above problems, in some alternative embodiments, refer to Figure 5 , a voice playback method is provided, which is applied to at least one controller 250 in the display device 200. To distinguish it from the controller 110 in the remote control, the controller 250 will be uniformly referred to as the first controller hereinafter. Correspondingly, the voice playback method includes:

[0084] S510, when the display device is playing audio and video, receive the voice button instruction sent by the remote control.

[0085] When the display device 200 is playing audio and video, the remote control can be used to control the display device 200. For example, switch the audio and video content being played, increase or decrease the playback volume of the audio output device 270 in the display device 200 (in order to distinguish it from the audio output device in the remote control, the audio output device 270 in the display device is uniformly referred to as the first audio output device hereinafter). Based on this, the first controller can receive the voice button instruction sent by the remote control.

[0086] Among them, when controlling the display device 200 based on the remote control, the remote control responds to the triggering operation of the voice button, can obtain the button instruction identifier, and collect the voice data. Then, the remote control can encode the button instruction identifier and the voice data, and the instruction signal obtained by encoding is the voice button instruction. The remote control can send the voice button instruction to the display device 200. For example, it can be sent to the display device through Bluetooth or NFC.

[0087] Exemplarily, the remote controller may encode the above key command identifier and voice data using the NEC protocol of PWM (Pulse Width Modulation).

[0088] In some embodiments, the above key command identifier may be a key identifier corresponding to the voice key, or a key identifier corresponding to the operation mode of the trigger operation of the voice key. That is, in response to the trigger operation of the voice key, the remote controller may generate the voice key targeted by the trigger operation, or the key identifier corresponding to the operation mode of the trigger operation, according to the preset correspondence between the voice key and the key identifier, or the preset correspondence between the operation mode of the trigger operation and the key identifier. This identifier is called the key command identifier and is used to indicate the generated data for outputting the above voice data by the remote controller or the display device. And, in response to the trigger operation of the above voice key, the remote controller may activate the voice collection function to collect the audio data existing in the current environment as the voice data. Exemplarily, in response to the trigger operation of the above voice key, the remote controller activates the microphone 141 to collect the audio data existing in the current environment as the voice data through the microphone 141, so that the remote controller obtains the voice data.

[0089] S520, Parse the voice key command to obtain the key command identifier and the voice data.

[0090] Since the voice key command is encoded based on the key command identifier and the voice data, the first controller may parse the voice key command to obtain the key command identifier and the voice data.

[0091] S530, Obtain the response data corresponding to the voice data.

[0092] In an optional embodiment, the first controller may convert the above voice data into text content and respond according to the text content to obtain the response data corresponding to the voice data. Exemplarily, the first controller may perform semantic analysis on the text content to obtain the meaning expressed by the above text content. Thus, the first controller may perform corresponding actions according to the above meaning and use the execution result of the above actions as the response data corresponding to the voice data. For example, if the meaning expressed by the above text content is to provide the information of person A, the first controller may call a search engine to search for the above person A and use the information obtained from the search as the response data corresponding to the voice data.

[0093] In an optional embodiment, the first controller may convert the above-mentioned voice data into text content and send the text content to the server 400; the server 400 responds according to the text content and feeds back the response data corresponding to the voice data to the first controller. Exemplarily, the server 400 may perform semantic analysis on the above-mentioned text content to obtain the meaning expressed by the text content. Thus, the server 400 may execute corresponding actions according to the above-mentioned meaning and use the execution result of the above-mentioned actions as the response data corresponding to the voice data. For example, if the meaning expressed by the above-mentioned text content is to predict an event occurring under specified conditions, the server 400 may input the above-mentioned specified conditions into a pre-trained event prediction model and obtain the event result output by the above-mentioned event prediction model as the response data corresponding to the voice data, and feed it back to the first controller.

[0094] S540, when the key command identifier is the first key identifier, control the first audio output device to play the response data.

[0095] Wherein, the first key identifier is used to indicate that the above-mentioned response data is output by the display device 200. Correspondingly, when the parsed key command identifier is the first key identifier, the first controller may control the first audio output device to play the above-mentioned response data.

[0096] S550, when the key command identifier is the second key identifier, keep the first audio output device playing the currently played audio, and send the response data to the remote control to play the response data through the second audio output device of the remote control.

[0097] Wherein, the second key identifier is used to indicate that the above-mentioned response data is output by the remote control. Correspondingly, when the parsed key command identifier is the second key identifier, in order not to interrupt the display device 250 from playing the currently played audio and video, the first controller keeps the first audio output device playing the currently played audio and sends the above-mentioned response data to the remote control. In this way, after receiving the above-mentioned response data, the remote control can play the above-mentioned response data through the audio output device 150 of the remote control (for the convenience of distinction, the audio output device 150 in the remote control is hereinafter collectively referred to as the second audio output device).

[0098] In the above embodiments, when the display device plays audio and video, a voice key command sent by the remote control is received. By parsing the voice key command, not only can the traditional voice data for determining response data be obtained, but also the key command identifier for determining the audio output device can be determined. Correspondingly, when the key command identifier is the first key identifier, the first audio output device is controlled to play the response data; when the key command identifier is the second key identifier, the response data is sent to the remote control to play the response data through the second audio output device of the remote control. Therefore, during the voice interaction process, the selection of the first audio output device in the display device or the second audio output device on the remote control can be realized according to the user's trigger on the remote control, improving the flexibility of the voice interaction process; in a scenario where the response data includes private data, the user is provided with the option of playing the response data by the remote control, thus avoiding the leakage of private data during the playback of the response data. In addition, when the key command identifier is the second key identifier, during the process of playing the response data by the second audio output device of the remote control, the first audio output device continues to play the currently played audio, without interrupting the currently played audio of the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0099] Based on the technical solution of the above embodiments, in some embodiments, the step of controlling the first audio output device to play the response data when the key command identifier is the first key identifier is refined to differentiate the playback timing of the response data.

[0100] In some embodiments, the step of controlling the first audio output device to play the response data when the key command identifier is the first key identifier may include: when the key command identifier is the first key identifier and the current playback mode is the immediate playback mode, controlling the first audio output device to immediately play the response data.

[0101] When determining that the key command identifier is the first key identifier, the first controller may further determine the current playback mode of the above response data. The current playback mode may include any one of the immediate playback mode and the delayed playback mode, etc. The immediate playback mode is used to indicate that the above response data is played immediately when or after the above response data is obtained; the delayed playback mode is used to indicate that the above response data is not played immediately when or after the above response data is obtained, but is played after a period of time.

[0102] In this way, when the first controller determines that the key command identifier is the first key identifier and the current playback mode is the immediate playback mode, it can control the first audio output device to immediately play the response data, thus meeting the immediate playback requirement.

[0103] In an alternative embodiment, the above current playback mode is preset. In this way, the playback mode identifier of the preset current playback mode is recorded in the display device 200, and the first controller can determine the current playback mode of the response data by reading the above playback mode identifier.

[0104] In an alternative embodiment, the current playback mode is dynamically determined during each interaction between the display device 200 and the remote control.

[0105] Exemplarily, when controlling the display device 200 based on the remote control, in response to the triggering operation of the voice key, the remote control can obtain the playback mode identifier on the basis of obtaining the key command identifier and collecting the voice data, and encode the key command identifier, the voice data, and the playback mode identifier to obtain a voice key command. In this way, when parsing the above voice key command, the first controller can also obtain the playback mode identifier. Thus, the first controller can determine that the current playback mode is the instant playback mode when the playback mode identifier is the first mode identifier.

[0106] In the above embodiment, the first controller can control the first audio output device to immediately play the response data when or after obtaining the above response data, thereby ensuring the timeliness of playing the response data and meeting the user's real-time requirement for the response data.

[0107] In some embodiments, the step of controlling the first audio output device to play the response data when the key command identifier is the first key identifier includes, when the key command identifier is the first key identifier and the current playback mode is the delayed playback mode, controlling the first timer to count, and controlling the first audio output device to play the response data when the accumulated counting duration meets the counting duration threshold.

[0108] When determining that the key command identifier is the first key identifier, the first controller can further determine the current playback mode of the above response data. The delayed playback mode is used to indicate that when or after obtaining the above response data, the above response data is not played immediately, but after a period of time.

[0109] In order to accumulate the elapsed duration so that the above response data can be played when the counting duration threshold is met, when determining that the key command identifier is the first key identifier and the current playback mode is the instant playback mode, the first controller can control the first timer to count.

[0110] Among them, the first timer mentioned above can be a hardware device or a software program. Also, the first timer can perform forward timing. Exemplarily, the first timer can gradually increase the duration starting from 0 until the timing duration meets the duration indicated by the timing duration threshold. For example, it can gradually increase from 0 to 30 minutes. The first timer can also perform countdown timing. Exemplarily, the first timer can gradually decrease the duration starting from the duration indicated by the timing duration threshold until it decreases to 0. For example, it can gradually decrease from 30 minutes to 0. Based on this, the specific type and timing method of the first timer are not limited.

[0111] Among them, as described above, the current playback mode can be set in advance, or the current playback mode can be dynamically determined during each interaction between the display device 200 and the remote control.

[0112] When the cumulative timing duration meets the timing duration threshold, the first controller can control the first audio output device to play the response data. At this time, the response data is played after the duration indicated by the timing duration threshold, rather than immediately for the above response data.

[0113] In an optional embodiment, the timing duration threshold is set in advance. In this way, the display device 200 records the pre-set timing duration threshold, and the first controller can directly read the timing duration threshold to control the first audio output device to play the above response data when the cumulative timing duration meets the pre-set timing duration threshold.

[0114] In an optional embodiment, the timing duration threshold is dynamically determined during each interaction between the display device 200 and the remote control.

[0115] Exemplarily, among the voice data collected by the remote control, there may be voice data related to the timing duration threshold. Thus, when the first controller analyzes the above voice key command, it can obtain the voice data related to the timing duration threshold and determine the timing duration threshold through semantic analysis. For example, when the first controller analyzes the above voice key command and obtains the voice data "play the response data after 30 minutes", the first controller can determine that the timing duration threshold is 30 minutes. Another example is that when the first controller analyzes the above voice key command and obtains the voice data "play the response data at time A", the first controller can determine that the timing duration threshold is the time difference between the current time and time A.

[0116] In the above embodiments, there is a certain time difference between the acquisition and playback of the above response data. Thus, considering that other viewers may have left within the time range corresponding to the above time difference, the privacy information in the response data can be better protected. Also, when playing the above response data, the display device 200 may have stopped playing the currently played audio-video content. Thus, it is also possible to ensure that the first audio output device is not interrupted from playing the currently played audio.

[0117] In some embodiments, in the case where the key command identifier is the first key identifier, the step of controlling the first audio output device to play the response data includes, in the case where the key command identifier is the first key identifier, outputting a playback reminder to the remote control, and in the case of receiving a playback command sent by the remote control in response to the playback reminder, controlling the first audio output device to play the response data.

[0118] In the case where the key command identifier is the first key identifier, the first controller may send a playback reminder to the remote control. For example, the playback reminder may be sent to the remote control via Bluetooth, via WIFI, etc. Among them, the above playback reminder is used to prompt the first controller that the response data of the above voice data has been obtained.

[0119] When receiving the above playback reminder or after receiving it, the remote control may output the above playback reminder. Exemplarily, the remote control may output the above playback reminder in various ways such as lighting up an indicator light, flashing the indicator light, emitting a prompt voice, etc. Exemplarily, the remote control may continuously output the above playback reminder and stop outputting when the output duration reaches the output duration threshold.

[0120] When outputting the above playback reminder or after outputting it, the remote control may respond to the above playback reminder. Among them, in response to a playback operation, such as a trigger operation of a playback button, etc., the remote control may generate a playback command and send the above playback command to the display device 200. For example, the above playback command may be sent to the display device 200 via Bluetooth, via WIFI, etc. In this way, in the case where the first controller receives the playback command sent by the remote control in response to the above playback reminder, it can control the first audio output device to play the above response data.

[0121] In the above embodiments, in the case where the first controller obtains the response data, according to the user's needs, at any moment when the user wishes to play the above response data, by controlling the display device 200 again through the remote control, the playback of the above response data can be realized. In this way, the playback flexibility of the above response data can be increased, and the user experience can be improved.

[0122] In some embodiments, when the key command identifier is the first key identifier, the step of controlling the first audio output device to play the response data includes, when the key command identifier is the first key identifier, controlling the display to output a play reminder, and when receiving a play command sent by the remote control in response to the play reminder, controlling the first audio output device to play the response data.

[0123] When the first controller obtains the response data of the above voice data, the display device 200 can output the above play reminder by itself to prompt that the first controller has obtained the response data. Based on this, when the key command identifier is the first key identifier, the first controller can control the display 260 of the display device 200 to output the above play reminder.

[0124] Exemplarily, the display 260 can output the above play reminder in various ways such as lighting up an indicator light, flashing the indicator light, sending a prompt bullet screen, sending a prompt subtitle bar, etc. Exemplarily, the display 260 can continuously output the above play reminder and stop outputting when the output duration reaches the output duration threshold.

[0125] When the display 260 of the display device 200 outputs the above play reminder or after that, the remote control can respond to the above play reminder. Among them, in response to a play operation, for example, a trigger operation of a play button, etc., the remote control can generate a play command and send the above play command to the display device 200, for example, sending the above play command to the display device 200 via Bluetooth, sending the above play command to the display device 200 via WIFI, etc. In this way, when the first controller receives the play command sent by the remote control in response to the above play reminder, it can control the first audio output device to play the above response data.

[0126] In the above embodiments, when the first controller obtains the response data, according to the user's needs, at any moment when the user hopes to play the above response data, by controlling the display device 200 again through the remote control, the above response data can be played. In this way, the flexibility of playing the above response data can be increased, and the user experience can be improved.

[0127] Based on the technical solutions of the above embodiments, in some embodiments, the steps of keeping the first audio output device playing the current playing audio and sending the response data to the remote control to play the response data through the second audio output device of the remote control when the key command identifier is the second key identifier are refined to differentiate the playing timing of the response data.

[0128] In some embodiments, when the key command identifier is the second key identifier, the steps of maintaining the first audio output device to play the currently playing audio and sending response data to the remote control so that the second audio output device of the remote control plays the response data include, when the key command identifier is the second key identifier and the current playing mode is the instant play mode, maintaining the first audio output device to play the currently playing audio and immediately sending response data to the remote control so that the second audio output device of the remote control plays the response data.

[0129] When determining that the key command identifier is the second key identifier, the first controller may further determine the current playing mode of the above response data. The second key identifier is used to indicate that the above response data is output by the remote control, and the instant play mode is used to indicate that the above response data is played immediately when or after the above response data is obtained. Therefore, when the key command identifier is the second key identifier, the first controller maintains the first audio output device to play the currently playing audio and immediately sends response data to the remote control, for example, sending response data to the remote control via Bluetooth, sending response data to the remote control via WIFI, etc. In this way, when the remote control receives the above response data, the second audio output device of the remote control plays the response data, thereby meeting the instant play requirement. Moreover, during the playing process of the above response data, the first audio output device does not need to interrupt the playing of the currently playing audio due to playing the above response data.

[0130] As mentioned above, the above current playing mode can be set in advance or dynamically determined during each interaction between the display device 200 and the remote control.

[0131] In the above embodiments, the first controller can immediately send the response data to the remote control when or after obtaining the above response data so that the second audio output device of the remote control plays the response data. Thus, the timeliness of the response data playing is ensured, meeting the user's real-time requirement for the response data, and the currently playing audio of the display device is not interrupted, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0132] In some embodiments, when the key command identifier is the second key identifier, the steps of maintaining the first audio output device to play the currently playing audio and sending response data to the remote control so that the response data can be played through the second audio output device of the remote control include, when the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, controlling the first timer to count time, and when the accumulated counting duration meets the counting duration threshold, sending response data to the remote control so that the response data can be played through the second audio output device of the remote control, and maintaining the first audio output device to play the currently playing audio during the process of playing the response data.

[0133] When determining that the key command identifier is the second key identifier, the first controller can further determine the current playback mode of the above-mentioned response data. Among them, the delayed playback mode is used to indicate that when the above-mentioned response data is obtained or after that, the above-mentioned response data is not played immediately, but after a period of time, the above-mentioned response data is played.

[0134] Based on this, in order to accumulate the elapsed duration so that the above-mentioned response data can be played when the counting duration threshold is met, when determining that the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, the first controller can control the first timer to count time.

[0135] Since the second key identifier is used to indicate that the above-mentioned response data is output by the remote control, when the accumulated counting duration meets the counting duration threshold, the first controller sends the above-mentioned response data to the remote control so that the remote control plays the response data through the second audio output device when receiving the above-mentioned response data or after that. During the process of the second audio output device of the remote control playing the response data, the first controller continues to maintain the first audio output device to play the currently playing audio and does not need to interrupt the playing of the currently playing audio due to playing the response data.

[0136] Among them, as mentioned above, the above-mentioned counting duration threshold can be set in advance, or can be dynamically determined during each interaction process between the display device 200 and the remote control.

[0137] In the above embodiments, there is a certain time difference between the acquisition and playback of the above-mentioned response data. Thus, considering that other viewers may have left within the time range corresponding to the above time difference, the privacy information in the response data can be better protected. And when playing the above-mentioned response data, the display device 200 may have stopped playing the currently playing audio and video content. Thus, it can also ensure that the first audio output device does not interrupt the playing of the currently playing audio.

[0138] In some embodiments, when the key command identifier is the second key identifier, the step of maintaining the first audio output device to play the currently playing audio and sending response data to the remote control to play the response data through the second audio output device of the remote control includes, when the key command identifier is the second key identifier, outputting a play reminder to the remote control, and when receiving a play command sent by the remote control in response to the play reminder, sending the response data to the remote control to play the response data through the second audio output device of the remote control, and during the process of playing the response data, maintaining the first audio output device to play the currently playing audio.

[0139] When the key command identifier is the second key identifier, the first controller can send a play reminder to the remote control. For example, send a play reminder to the remote control via Bluetooth, send a play reminder to the remote control via WIFI, etc. Among them, the above play reminder is used to prompt the first controller to obtain the response data of the above voice data.

[0140] When receiving the above play reminder, the remote control can output the above play reminder. Exemplarily, the remote control can output the above play reminder in various ways such as lighting up an indicator light, flashing the indicator light, emitting a prompt voice, etc. Exemplarily, the remote control can continuously output the above play reminder and stop outputting when the output duration reaches the output duration threshold.

[0141] When outputting the above play reminder, the remote control can respond to the above play reminder. Among them, in response to a play operation, such as a trigger operation of a play button, etc., the remote control can generate a play command and send the above play command to the display device 200. For example, send the above play command to the display device 200 via Bluetooth, send the above play command to the display device 200 via WIFI, etc.

[0142] Among them, the second key identifier is used to indicate that the above response data is output by the remote control. Therefore, when the first controller receives the play command sent by the remote control in response to the play reminder, it can send the above response data to the remote control so that the remote control can play the response data through the second audio output device when receiving the above response data. And during the process of playing the response data by the second audio output device of the remote control, the first controller continues to maintain the first audio output device to play the currently playing audio without interrupting the playback of the currently playing audio due to playing the above response data.

[0143] In the above embodiments, when the first controller obtains the response data, according to user requirements, at any moment when the user hopes to play the above response data, the display device 200 can be controlled again through the remote controller to play the above response data. In this way, the flexibility of playing the above response data can be increased, and the user experience can be improved.

[0144] In some embodiments, when the key command identifier is the second key identifier, the steps of keeping the first audio output device playing the currently played audio and sending the response data to the remote controller to play the response data through the second audio output device of the remote controller include, when the key command identifier is the second key identifier, controlling the display to output a playback reminder, and when receiving the playback command sent by the remote controller in response to the playback reminder, sending the response data to the remote controller to play the response data through the second audio output device of the remote controller, and keeping the first audio output device playing the currently played audio during the process of playing the response data.

[0145] When the first controller obtains the response data of the above voice data, the display device 200 can output the above playback reminder by itself to prompt that the first controller has obtained the response data. Based on this, when the key command identifier is the second key identifier, the first controller can control the display 260 of the display device 200 to output the above playback reminder.

[0146] Exemplarily, the display 260 can output the above playback reminder in various ways such as lighting up an indicator light, flashing the indicator light, sending out a prompt barrage, and sending out a prompt subtitle bar. Exemplarily, the display 260 can continuously output the above playback reminder and stop outputting when the output duration reaches the output duration threshold.

[0147] When the display 260 of the display device 200 outputs the above playback reminder or after that, the remote controller can respond to the above playback reminder. Among them, in response to a playback operation, such as a trigger operation of a playback button, the remote controller can generate a playback command and send the above playback command to the display device 200, such as sending the above playback command to the display device 200 by Bluetooth, sending the above playback command to the display device 200 by WI FI, etc.

[0148] Among them, the second button identifier is used to indicate the output of the above response data by the remote controller. Therefore, when the first controller receives the play instruction sent by the remote controller in response to the above play reminder, it can send the above response data to the remote controller, so that when the remote controller receives the above response data, it can play the response data through the second audio output device. During the process of playing the response data by the second audio output device of the remote controller, the first controller continues to keep the first audio output device playing the current playing audio, without interrupting the playing of the current playing audio due to playing the above response data.

[0149] In the above embodiment, when the first controller obtains the response data, according to the user's needs, at any moment when the user hopes to play the above response data, through the remote controller's re-control of the display device 200, the playing of the above response data can be realized. In this way, not only can the audio playback on the remote controller be controlled as needed to avoid the leakage of privacy content in the response data, but also the playback of the current content being played on the display device will not be interrupted. In addition, the playback flexibility of the above response data can be increased, enhancing the user experience.

[0150] Based on the technical solutions of the above embodiments, in some optional embodiments, the step of determining the current playback mode is refined to realize the dynamic determination of the current playback mode.

[0151] See Figure 6 The steps for determining the current playback mode shown include:

[0152] S610, parse the voice button instruction to obtain the playback mode identifier.

[0153] The above current playback mode can be dynamically determined during each interaction between the display device 200 and the remote controller. Among them, when controlling the display device 200 based on the remote controller, in response to the trigger operation of the voice button, the remote controller can obtain the playback mode identifier on the basis of obtaining the button instruction identifier and collecting voice data, and encode the button instruction identifier, voice data, and playback mode identifier to obtain the voice button instruction, and then send the above voice button instruction to the display device 200.

[0154] In this way, after the first controller receives the above voice button instruction and parses the above voice button instruction, it can obtain the above button instruction identifier, voice data, and playback mode identifier. Furthermore, the first controller can determine the current playback mode according to the playback mode identifier.

[0155] In some embodiments, the above playback mode identifier may be an identifier set corresponding to a voice key, or an identifier set corresponding to the operation mode of the triggering operation of the voice key. That is, in response to the triggering operation of the voice key, the first controller may generate the voice key corresponding to the triggering operation, or the mode identifier corresponding to the operation mode of the triggering operation, according to the preset correspondence between the voice key and the mode identifier, or the preset correspondence between the operation mode of the triggering operation and the mode identifier. This identifier is called the playback mode identifier and is used to indicate the generated data for instant or delayed output of the above voice data.

[0156] S620, when the playback mode identifier is the first mode identifier, determine that the current playback mode is the instant playback mode.

[0157] When the above playback mode identifier is the first mode identifier, the first controller may determine that the current playback mode is the instant playback mode.

[0158] S630, when the playback mode identifier is the second mode identifier, determine that the current playback mode is the delayed playback mode.

[0159] When the above playback mode identifier is the second mode identifier, the first controller may determine that the current playback mode is the delayed playback mode.

[0160] In the above embodiments, the current playback mode of the above response data can be dynamically determined, so that the playback of the above response data is more flexible, more in line with user needs, and the user experience is improved.

[0161] To overcome the problems in the above traditional technologies, in some further alternative embodiments, refer to Figure 7 , a voice playback method is provided, which is applied to at least one controller 110 in the remote control. To distinguish it from the controller 250 in the display device 200, the controller 110 will be uniformly referred to as the second controller hereinafter. Correspondingly, the voice playback method includes:

[0162] S710, in response to the triggering operation of the voice key, collect voice data and obtain the key instruction identifier corresponding to the voice key.

[0163] The remote control includes at least one voice key, and different key instruction identifiers can be set corresponding to different voice keys, and different key instruction identifiers are used to indicate the display device 200 or the remote control to play the response data corresponding to the voice data.

[0164] For example, as Figure 8AAs shown in the figure, it is a schematic structural diagram of a remote control. Among them, SOC is the abbreviation of System on Chip (system-level chip). Among them, Button 1 and Button 2 are voice buttons. The button instruction identifier corresponding to Button 1 is the first button identifier, which is used to instruct the display device 200 to play the response data corresponding to the voice data; the button instruction identifier corresponding to Button 2 is the second button identifier, which is used to instruct the remote control to play the response data corresponding to the voice data. Among them, Figure 8A It is only an example of the schematic structural diagram of the remote control, rather than a limitation, and does not limit the presentation method of the button names in the remote control.

[0165] Based on this, in response to the triggering operation on the voice button, the second controller can collect voice data and obtain the button instruction identifier corresponding to the voice button for the above-mentioned triggering operation. Exemplarily, as Figure 8A shown, in response to the triggering operation on Button 1, the second controller can obtain the first button identifier, and in response to the triggering operation on Button 2, the second controller can obtain the second button identifier.

[0166] And, in response to the triggering operation on the above-mentioned voice button, the second controller can start the voice collection function to collect the audio data existing in the current environment as voice data. Exemplarily, in response to the triggering operation on the above-mentioned voice button, the second controller starts the microphone 141 to collect the audio data existing in the current environment as voice data through the microphone 141, so that the second controller obtains the voice data.

[0167] S720, encode the voice data and the button instruction identifier to obtain a voice button instruction.

[0168] After obtaining the above-mentioned voice data and button instruction identifier, the second controller can encode the voice data and the button instruction identifier to obtain a voice button instruction. Exemplarily, the remote control can use the NEC protocol of PWM (Pulse Width Modulation, pulse width modulation circuit), etc. to encode the above-mentioned button instruction identifier and voice data.

[0169] S730, send the voice button instruction to the display device so that the display device can parse the voice button instruction to obtain the voice data and the button instruction identifier.

[0170] After obtaining the above-mentioned voice button instruction, the second controller can send the above-mentioned voice button instruction to the display device 200. For example, send the above-mentioned voice button instruction by Bluetooth, send the above-mentioned voice button instruction by NFC, etc. After receiving the above-mentioned voice button instruction, the display device 200 can parse the above-mentioned voice button instruction to obtain the voice data and the button instruction identifier.

[0171] S740 receives response data corresponding to the voice data sent when the key command identifier is the second key identifier.

[0172] After parsing the above voice data and key command identifier, the display device 200 can obtain the response data corresponding to the above voice data.

[0173] In an optional embodiment, the display device 200 can convert the above voice data into text content, and respond according to the text content to obtain the response data corresponding to the voice data. Exemplarily, the display device 200 can perform semantic analysis on the above text content to obtain the meaning expressed by the above text content. Thus, the display device 200 can perform corresponding actions according to the above meaning, and use the execution result of the above actions as the response data corresponding to the voice data.

[0174] For example, if the meaning expressed by the above text content is to provide information about person A, the display device 200 can call a search engine to search for the above person A, and use the information obtained from the search as the response data corresponding to the voice data.

[0175] In an optional embodiment, the display device 200 can convert the above voice data into text content and send the above text content to the server 400; the server 400 responds according to the text content and feeds back the response data corresponding to the above voice data to the display device 200.

[0176] Exemplarily, the server 400 can perform semantic analysis on the text content to obtain the meaning expressed by the above text content. Thus, the server 400 can perform corresponding actions according to the above meaning, and use the execution result of the above actions as the response data corresponding to the voice data.

[0177] For example, if the meaning expressed by the above text content is to predict an event occurring under specified conditions, the server 400 can input the above specified conditions into a pre-trained event prediction model, and obtain the event result output by the above event prediction model as the response data corresponding to the voice data, and feed it back to the display device 200.

[0178] Wherein, the second key identifier is used to indicate that the above response data is output by the remote control. Therefore, when the display device 200 parses that the key command identifier is the second key identifier, the display device 200 can send the above response data corresponding to the voice data to the second controller. For example, send the above response data via Bluetooth, send the above response data via NFC, etc. In this way, the second controller can receive the response data corresponding to the voice data sent by the display device 200.

[0179] The S750 controls the second audio output device to play the response data.

[0180] During the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the currently played audio.

[0181] When receiving the response data corresponding to the above voice data, the second controller can control the second audio output device to play the above response data. Since the response data is played by the second audio output device of the remote control, the first audio output device in the display device 200 can keep playing the currently played audio, without interrupting the display device 250 from playing the currently played audio and video.

[0182] In the above embodiment, when the remote control responds to the triggering operation of the voice key, it can not only collect the traditional voice data for determining the response data, but also obtain the key command identifier for determining the audio output device. After sending the voice key command obtained by encoding the voice data and the key command identifier to the display device, the display device can obtain the above voice data and determine the above key command identifier by parsing the voice key command. Correspondingly, when the key command identifier is the second key identifier, the display device sends the response data corresponding to the voice data to the remote control. The remote control receives the response data and plays the response data through the second audio output device of the remote control. Therefore, during the voice interaction process, the selection of the second audio output device on the remote control can be realized according to the triggering of different voice keys by the user on the remote control, improving the flexibility of the voice interaction process; in the scenario where the response data includes privacy data, the user is provided with the option of playing the response data by the remote control, thus avoiding the leakage of privacy data during the playback of the response data. In addition, during the process of playing the response data by the second audio output device of the remote control, the first audio output device of the display device continues to play the current audio, without interrupting the current audio played by the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0183] Based on the technical solution of the above embodiment, in some embodiments, the step of controlling the second audio output device to play the response data is refined to differentiate the playback timing of the response data.

[0184] In some embodiments, the step of controlling the second audio output device to play the response data includes controlling the second audio output device to immediately play the response data when the current playback mode is the instant playback mode.

[0185] When receiving the response data corresponding to the voice data, the second controller can further determine the current playback mode of the above response data.

[0186] Among them, the current playback mode may include any one of an instant playback mode, a delayed playback mode, etc. Among them, the instant playback mode is used to indicate that the above response data is played immediately when or after the above response data is obtained; the delayed playback mode is used to indicate that the above response data is not played immediately when or after the above response data is obtained, but after a period of time, the above response data is played again.

[0187] In this way, when the second controller determines that the current playback mode is the instant playback mode, it can control the second audio output device to play the response data immediately. Among them, the above current playback method can be determined in various ways.

[0188] In an alternative embodiment, the above current playback mode is preset. In this way, the remote controller records the playback mode identifier of the preset current playback method, and the second controller can determine the current playback mode of the above response data by reading the above playback mode identifier.

[0189] In an alternative embodiment, the current playback mode is dynamically determined each time the second controller responds to the triggering operation of the voice key.

[0190] Exemplarily, when controlling the display device 200 based on the remote controller, the second controller responds to the triggering operation of the voice key. On the basis of obtaining the key instruction identifier and collecting the voice data, the second controller can also obtain the playback mode identifier. When the playback mode identifier is the first mode identifier, the second controller can determine that the current playback mode is the instant playback mode.

[0191] In the above embodiment, the second controller can control the second audio output device to play the response data immediately when or after the above response data is obtained. Thus, the timeliness of the response data playback is ensured, meeting the user's real-time requirements for the response data.

[0192] In some embodiments, the step of controlling the second audio output device to play the response data includes, when the current playback mode is the delayed playback mode, controlling the second timer to count, and when the accumulated counting duration meets the counting duration threshold, controlling the second audio output device to play the response data.

[0193] Among them, the delayed playback mode is used to indicate that the above response data is not played immediately when or after the above response data is obtained, but after a period of time, the above response data is played again.

[0194] Based on this, in order to accumulate the elapsed time so that the response data can be played when the timing duration threshold is met, when the second controller receives the above-mentioned response data and determines that the current playback mode is the instant playback mode, it can control the second timer to time.

[0195] Among them, the above-mentioned second timer can be a hardware device or a software program. Also, the above-mentioned second timer can perform forward timing. Exemplarily, the first timer can gradually increase the duration from 0 until the timing duration meets the duration indicated by the timing duration threshold. For example, it can gradually increase from 0 to 30 minutes. The above-mentioned second timer can also perform countdown timing. Exemplarily, the second timer can gradually decrease the duration from the duration indicated by the timing duration threshold until it decreases to 0. For example, it can gradually decrease from 30 minutes to 0. Based on this, the specific type and timing method of the second timer are not limited.

[0196] Among them, the current playback mode can be set in advance or dynamically determined each time the second controller responds to the trigger operation of the voice button.

[0197] When the accumulated timing duration meets the timing duration threshold, the second controller can control the second audio output device to play the response data. At this time, the response data is played after the duration indicated by the timing duration threshold has elapsed, rather than immediately for the above-mentioned response data.

[0198] In an optional embodiment, the above-mentioned timing duration threshold is set in advance. In this way, the remote control records the pre-set timing duration threshold, and the second controller can directly read the above-mentioned timing duration threshold to control the second audio output device to play the above-mentioned response data when the accumulated timing duration meets the above-mentioned pre-set timing duration threshold.

[0199] In an optional embodiment, the timing duration threshold is dynamically determined each time the second controller responds to the trigger operation of the voice button.

[0200] Exemplarily, the voice data collected by the second controller can include voice data related to the timing duration threshold. Thus, the second controller can perform semantic analysis on the above-mentioned voice data related to the timing duration threshold to determine the timing duration threshold.

[0201] For example, if the voice data collected by the second controller includes "play the response data after 30 minutes", then the second controller can determine that the timing duration threshold is 30 minutes. Another example, if the voice data collected by the second controller includes "play the response data at time A", then the second controller can determine that the timing duration threshold is the time difference between the current time and time A.

[0202] In the above embodiments, there is a certain time difference between the acquisition and playback of the above response data. Thus, considering that other viewers may have left within the time range corresponding to the above time difference, the privacy information in the response data can be better protected. Also, when playing the above response data, the display device 200 may have stopped playing the currently playing audio-visual content. Thus, it can also ensure that the first audio output device does not interrupt the playback of the currently playing audio.

[0203] In some embodiments, the step of controlling the second audio output device to play the response data includes generating a play instruction in response to a play operation and, in response to the play instruction, controlling the second audio output device to play the response data.

[0204] In the case of receiving the response data corresponding to the above voice data, the second controller does not automatically control the second audio output device to play the above response data. Instead, under a further operation on the remote control, the second controller controls the second audio output device to play the above response data in response to the above further operation. Thus, in the case of obtaining the above response data, the second controller can first generate a play instruction in response to a play operation, such as a trigger operation of a play button, etc. After that, the second controller can control the second audio output device to play the response data in response to the above play instruction.

[0205] In the above embodiments, in the case where the second controller obtains the response data, according to user requirements, at any moment when the user wishes to play the above response data, by responding to the play operation on the remote control, the playback of the above response data can be realized. In this way, not only can the audio playback on the remote control be controlled as needed to avoid the leakage of the private content in the response data, but also the playback of the currently playing content on the display device will not be interrupted. In addition, the playback flexibility of the above response data can be increased, improving the user experience.

[0206] In some alternative embodiments, the voice playback method applied to the second controller may further include the step of sending a play instruction to the display device so that the display device, when the key instruction identifier is the first key identifier, plays the response data through the first audio output device in response to the play instruction.

[0207] Among them, the first button identifier is used to indicate that the display device 200 plays the response data corresponding to the above voice data. Therefore, when the button instruction identifier is parsed as the first button identifier, the display device 200 may not send the above response data to the second controller, but control the display 260 of the display device 200 to output a playback reminder to prompt the first controller that the response data has been obtained. Exemplarily, the display 260 may output the above playback reminder in various ways such as lighting an indicator light, flashing the indicator light, emitting a prompt bullet screen, emitting a prompt subtitle bar, etc. Exemplarily, the display 260 may continuously output the above playback reminder and stop outputting when the output duration reaches the output duration threshold.

[0208] After the display 260 of the display device 200 outputs the above playback reminder, the remote control can respond to the above playback reminder. Among them, in response to a playback operation, such as a trigger operation of a playback button, etc., the remote control can generate a playback instruction and send the above playback instruction to the display device 200, for example, send the playback instruction by Bluetooth, send the playback instruction by NFC, etc. In this way, when the display device 200 receives the above playback instruction, it can respond to the above playback instruction and control the first audio output device to play the above response data.

[0209] In the above embodiment, when the second controller obtains the response data, according to user requirements, at any moment when the user hopes to play the above response data, by re-controlling the display device 200 through the remote control, the playback of the above response data can be realized. In this way, the playback flexibility of the above response data can be increased, and the user experience can be improved.

[0210] In some optional embodiments, the voice playback method applied to the second controller may further include the step of receiving the playback reminder output by the display device when the button instruction identifier is the second button identifier, and in response to the playback reminder, sending a playback instruction to the display device so that the display device sends the response data.

[0211] Among them, the second button identifier is used to indicate that the remote control plays the response data corresponding to the above voice data. Correspondingly, when the display device 200 parses the button instruction identifier as the second button identifier, the display device 200 may send a playback reminder to the second controller. After receiving the above playback reminder, the second controller may control the remote control to output the above playback reminder to prompt the first controller to obtain the response data of the above voice data.

[0212] Exemplarily, the remote control may output the above playback reminder in various ways such as lighting an indicator light, flashing the indicator light, emitting a prompt voice, etc. Exemplarily, the remote control may continuously output the above playback reminder and stop outputting when the output duration reaches the output duration threshold.

[0213] After the control remote controller outputs the above-mentioned playback reminder, the second controller can respond to the above-mentioned playback reminder. Among them, in response to a playback operation, for example, a triggering operation of a playback button, etc., the remote controller can generate a playback instruction and send the above-mentioned playback instruction to the display device 200, for example, send the above-mentioned playback instruction by Bluetooth, send the above-mentioned playback instruction by WI FI, etc. In this way, when the display device 200 receives the above-mentioned playback instruction, it can determine that the second controller hopes to play the above-mentioned response data through the second audio output device. Therefore, the display device 200 can send the above-mentioned response data to the remote controller, for example, send the above-mentioned response data by Bluetooth, send the above-mentioned response data by WIFI, etc.

[0214] In the above-mentioned embodiment, according to the user's needs, at any moment when the user hopes to play the above-mentioned response data, through the remote controller's re-control of the display device 200, the playback of the above-mentioned response data can be realized. In this way, not only can the audio playback on the remote controller be controlled as needed to avoid the leakage of private content in the response data, but also the playback of the current content being played on the display device will not be interrupted. In addition, the playback flexibility of the above-mentioned response data can be increased, and the user experience can be improved.

[0215] Based on the technical solutions of the above-mentioned embodiments, in some optional embodiments, the step of determining the current playback mode is refined to realize the dynamic determination of the current playback mode.

[0216] In some optional embodiments, the voice playback method applied to the second controller may further include steps of obtaining a playback mode identifier corresponding to the voice key or the operation mode of the corresponding triggering operation in response to a triggering operation on the voice key.

[0217] The remote controller includes at least one voice key, and different playback mode identifiers can be set corresponding to different voice keys or different operation modes of the triggering operation, and different playback mode identifiers are used to indicate immediate playback of the response data corresponding to the above-mentioned voice data, or delayed playback of the response data corresponding to the above-mentioned voice data. Among them, for the voice key of the remote controller, the above-mentioned voice key can be triggered by various operation modes, for example, double-click, single-click, long-press, etc.

[0218] Exemplarily, such as Figure 8BThe figure shows a schematic structural diagram of another remote controller. Among them, buttons A - D are voice buttons. The button command identifier corresponding to button A is the first button identifier and the playback mode identifier is the first mode identifier. The button command identifier corresponding to button B is the first button identifier and the playback mode identifier is the second mode identifier. The button command identifier corresponding to button C is the second button identifier and the playback mode identifier is the first mode identifier. The button command identifier corresponding to button D is the second button identifier and the playback mode identifier is the second mode identifier. Among them, the current playback mode corresponding to the first mode identifier is the instant playback mode, and the current playback mode corresponding to the second mode identifier is the delayed playback mode. Among them, Figure 8B This is only an example of the schematic structural diagram of the remote controller, rather than a limitation, and does not limit the presentation method of the button names in the remote controller.

[0219] Exemplarily, continuing as Figure 8A shown, there can be two operation methods for the trigger operation of the voice button: long - press and short - press. Among them, the button command identifier corresponding to button 1 is the first button identifier, and the button command identifier corresponding to button 2 is the second button identifier. Different from the previous example, the playback mode identifier corresponding to the long - press operation method is the first playback mode, and the playback mode identifier corresponding to the short - press operation method is the second playback mode. Then, the button command identifier corresponding to long - pressing button 1 is the first button identifier and the playback mode identifier is the first mode identifier, the button command identifier corresponding to long - pressing button 2 is the second button identifier and the playback mode identifier is the first mode identifier, the button command identifier corresponding to short - pressing button 1 is the first button identifier and the playback mode identifier is the second mode identifier, and the button command identifier corresponding to short - pressing button 2 is the second button identifier and the playback mode identifier is the second mode identifier. Among them, the current playback mode corresponding to the first mode identifier is the instant playback mode, and the current playback mode corresponding to the second mode identifier is the delayed playback mode.

[0220] Based on this, in response to the trigger operation of the voice button, the second controller can obtain the playback mode identifier corresponding to the voice button or the operation method of the trigger operation.

[0221] Correspondingly, in the above - mentioned embodiment, the step of encoding the above - mentioned voice data and button command identifier to obtain the voice button identifier is refined, including encoding the voice data, button command identifier, and playback mode identifier to obtain the voice button command.

[0222] In the above - mentioned embodiment, in response to the trigger operation of the voice button, the second controller can obtain the button command identifier, playback mode identifier, and voice data; the second controller can encode the voice data, button command identifier, and playback mode identifier to obtain the voice button command.

[0223] In the above embodiments, the current playback mode of the above response data can be dynamically determined, so that the playback of the above response data is more flexible, more in line with user needs, and the user experience is improved.

[0224] In some alternative embodiments, the voice playback method applied to the second controller may further include the step of, in response to a triggering operation on a mode key, obtaining a playback mode identifier corresponding to the mode key or the operation mode of the corresponding triggering operation.

[0225] The remote control may further include at least one mode key. Different playback mode identifiers may be set for different mode keys or different operation modes of the triggering operations of the mode keys, and different playback mode identifiers are used to indicate immediate playback of the response data corresponding to the above voice data, or delayed playback of the response data corresponding to the above voice data. Among them, for the mode key of the remote control, the above mode key can be triggered by various operation modes, for example, double-click, single-click, long-press, etc.

[0226] Exemplarily, as Figure 8C shown, it is a schematic structural diagram of another remote control. Among them, Button 1 and Button 2 are voice buttons, and Button 3 and Button 4 are mode buttons. The playback mode identifier corresponding to Button 3 is the first mode identifier, which is used to indicate that the current playback mode is the immediate playback mode. The playback mode identifier corresponding to Button 4 is the second mode identifier, which is used to indicate that the current playback mode is the delayed playback mode. The button command identifier corresponding to Button 1 is the first button identifier, and the button command identifier corresponding to Button 2 is the second button identifier.

[0227] Exemplarily, as Figure 8D shown, it is a schematic structural diagram of yet another remote control. Among them, Button 1 and Button 2 are voice buttons, and Button 5 is a mode button, and there can be two operation modes: long-press and short-press. Among them, the playback mode identifier corresponding to the long-press of Button 5 is the first mode identifier, which is used for the current playback mode to be the immediate playback mode. The playback mode identifier corresponding to the short-press of Button 5 is the second mode identifier, which is used to indicate that the current playback mode is the delayed playback mode. The button command identifier corresponding to Button 1 is the first button identifier, and the button command identifier corresponding to Button 2 is the second button identifier. Among them, Figure 8C and Figure 8D are only examples of the schematic structural diagram of the remote control, rather than limitations, and do not limit the presentation manner of the button names in the remote control.

[0228] Correspondingly, in the above embodiments, the step of encoding the above voice data and button command identifier to obtain a voice button identifier is refined, including encoding the voice data, button command identifier, and playback mode identifier to obtain a voice button command.

[0229] In the above embodiments, in response to a triggering operation on the voice button, the second controller can obtain a button instruction identifier and voice data, and in response to a triggering operation on the mode button, the second controller can obtain a playback mode identifier. Thus, the second controller can encode the voice data, the button instruction identifier, and the playback mode identifier to obtain a voice button instruction. Optionally, the current playback mode of the above response data can be dynamically determined to make the playback of the above response data more flexible, more in line with user needs, and improve the user experience.

[0230] To overcome the problems in the above traditional technologies, in still some other alternative embodiments, refer to Figure 9 , a voice playback method is provided, which is applied to at least one controller 110 in a remote control. To distinguish it from the controller 250 in the display device 200, the controller 110 will be uniformly referred to as the second controller hereinafter. Correspondingly, the voice playback method includes:

[0231] S910, in response to a triggering operation on the voice button, collect voice data, and obtain a button instruction identifier corresponding to the operation mode of the corresponding triggering operation.

[0232] The remote control includes at least one voice button. Different button instruction identifiers can be set corresponding to different operation modes of the triggering operation of the voice button. The different button instruction identifiers are used to instruct the display device 200 or the remote control to play the response data corresponding to the voice data. Among them, for the voice button of the remote control, the voice button can be triggered by various operation modes, for example, double-click, single-click, long-press, etc.

[0233] For example, as Figure 8E shown, it is a schematic structural diagram of a remote control. Among them, the button is a voice button, and there can be two operation modes: single-click and double-click. Among them, the button instruction identifier corresponding to the operation mode of single-clicking the button is the first button identifier, which is used to instruct the device 200 to play the response data corresponding to the voice data; the button instruction identifier corresponding to the operation mode of double-clicking the button is the second button identifier, which is used to instruct the remote control to play the response data corresponding to the voice data. Among them, Figure 8E is only an example of the schematic structural diagram of the remote control, not a limitation, and does not limit the presentation mode of the button names in the remote control.

[0234] Based on this, in response to a triggering operation on the voice button, the second controller can collect voice data and obtain the button instruction identifier corresponding to the operation mode of the above triggering operation. Exemplarily, as Figure 8E shown, in response to a single-click operation on the button, the second controller can obtain the first button identifier, and in response to a double-click operation on the button, the second controller can obtain the second button identifier.

[0235] Moreover, in response to the triggering operation of the above voice key, the second controller can activate the voice acquisition function to acquire the audio data existing in the current environment as voice data. Exemplarily, in response to the triggering operation of the above voice key, the second controller activates the microphone 141 to acquire the audio data existing in the current environment as voice data.

[0236] S920. Encode the voice data and the key command identifier to obtain a voice key command.

[0237] After obtaining the above voice data and key command identifier, the second controller can encode the voice data and the key command identifier to obtain a voice key command. Exemplarily, the remote controller can use the NEC protocol of PWM (Pulse Width Modulation, pulse width modulation circuit), etc. to encode the above key command identifier and voice data.

[0238] S930. Send the voice key command to the display device so that the display device can parse the voice key command to obtain the voice data and the key command identifier.

[0239] After obtaining the above voice key command, the second controller can send the above voice key command to the display device 200. For example, send the above voice key command via Bluetooth, send the above voice key command via NFC, etc. After receiving the above voice key command, the display device 200 can parse the above voice key command to obtain the voice data and the key command identifier.

[0240] S940. Receive the response data corresponding to the voice data sent by the display device when the key command identifier is the second key identifier.

[0241] After parsing and obtaining the above voice data and key command identifier, the display device 200 can obtain the response data corresponding to the above voice data.

[0242] In an optional embodiment, the display device 200 can convert the above voice data into text content and make a response according to the text content to obtain the response data corresponding to the voice data.

[0243] Exemplarily, the display device 200 can perform semantic analysis on the above text content to obtain the meaning expressed by the above text content. Thus, the display device 200 can perform corresponding actions according to the above meaning and use the execution result of the above actions as the response data corresponding to the voice data. For example, if the meaning expressed by the above text content is to provide the information of person A, the display device 200 can call a search engine to search for the above person A and use the information obtained by the search as the response data corresponding to the voice data.

[0244] In an optional embodiment, the display device 200 may convert the above-mentioned voice data into text content and send the above-mentioned text content to the server 400; the server 400 responds according to the text content and feeds back the response data corresponding to the above-mentioned voice data to the display device 200.

[0245] Exemplarily, the server 400 may perform semantic analysis on the text content to obtain the meaning expressed by the above-mentioned text content. Thus, the server 400 may execute corresponding actions according to the above-mentioned meaning and use the execution result of the above-mentioned actions as the response data corresponding to the voice data.

[0246] For example, if the meaning expressed by the above-mentioned text content is to predict an event occurring under specified conditions, the server 400 may input the above-mentioned specified conditions into a pre-trained event prediction model and obtain the event result output by the above-mentioned event prediction model as the response data corresponding to the voice data, and feed it back to the display device 200.

[0247] Among them, the second button identifier is used to indicate the output of the above-mentioned response data by the remote controller. Therefore, when the display device 200 parses that the button instruction identifier is the second button identifier, the display device 200 may send the above-mentioned response data corresponding to the voice data to the second controller. For example, send the above-mentioned response data via Bluetooth, send the above-mentioned response data via NFC, etc. In this way, the second controller may receive the response data corresponding to the voice data sent by the display device 200.

[0248] S950, control the second audio output device to play the response data.

[0249] Among them, during the process of the second audio output device playing the response data, the first audio output device keeps playing the currently playing audio.

[0250] When receiving the response data corresponding to the above-mentioned voice data, the second controller can control the second audio output device to play the above-mentioned response data. And since it is the second audio output device of the remote controller that plays the above-mentioned response data, the first audio output device in the display device 200 can keep playing the currently playing audio and will not interrupt the display device 250 from playing the currently playing audio and video.

[0251] In the above embodiments, in response to the triggering operation of the voice key, the remote controller can not only collect the traditional voice data for determining the response data, but also obtain the key instruction identifier for determining the audio output device. After sending the voice key instruction obtained by encoding the voice data and the key instruction identifier to the display device, the display device can obtain the above voice data and determine the above key instruction identifier by parsing the voice key instruction. Correspondingly, when the key instruction identifier is the second key identifier, the display device sends the response data corresponding to the voice data to the remote controller. The remote controller receives the response data and plays the response data through the second audio output device of the remote controller. Therefore, during the voice interaction process, the selection of the second audio output device on the remote controller can be realized by triggering the voice key in different ways by the user, improving the flexibility of the voice interaction process; in the scenario where the response data includes private data, the user is provided with the option of playing the response data by the remote controller, thus avoiding the leakage of private data during the playback of the response data. In addition, during the process of playing the response data by the second audio output device of the remote controller, the first audio output device of the display device continues to play the current audio, without interrupting the current audio played by the display device, thereby reducing the interference to other viewing users of the display device and improving the viewing experience.

[0252] Based on the technical solutions of the above embodiments, in some embodiments, the steps of controlling the second audio output device to play the response data are refined to differentiate the playback timing of the response data.

[0253] In some embodiments, the steps of controlling the second audio output device to play the response data include, when the current playback mode is the instant playback mode, controlling the second audio output device to immediately play the response data.

[0254] When receiving the response data corresponding to the voice data, the second controller can further determine the current playback mode of the above response data.

[0255] Among them, the current playback mode can include any one of the instant playback mode and the delayed playback mode, etc. Among them, the instant playback mode is used to indicate that the above response data is immediately played when or after the above response data is obtained; the delayed playback mode is used to indicate that the above response data is not immediately played when or after the above response data is obtained, but is played after a period of time.

[0256] In this way, when the second controller determines that the current playback mode is the instant playback mode, it can control the second audio output device to immediately play the response data. Among them, the above current playback method can be determined in various ways.

[0257] In an alternative embodiment, the above-mentioned current playback mode is preset. In this way, the playback mode identifier of the preset current playback mode is recorded in the remote control, and the second controller can determine the current playback mode of the response data by reading the playback mode identifier.

[0258] In an alternative embodiment, the current playback mode is dynamically determined each time the second controller responds to the triggering operation of the voice key.

[0259] Exemplarily, when controlling the display device 200 based on the remote control, in response to the triggering operation of the voice key, the second controller can also obtain the playback mode identifier on the basis of obtaining the key command identifier and collecting the voice data. When the playback mode identifier is the first mode identifier, the second controller can determine that the current playback mode is the instant playback mode.

[0260] In the above embodiment, the second controller can control the second audio output device to immediately play the response data when or after obtaining the response data, thereby ensuring the timeliness of playing the response data and meeting the user's real-time requirement for the response data.

[0261] In some embodiments, the step of controlling the second audio output device to play the response data includes, when the current playback mode is the delayed playback mode, controlling the second timer to count time, and when the cumulative counted time length meets the time length threshold, controlling the second audio output device to play the response data. The delayed playback mode is used to indicate that when or after obtaining the response data, the response data is not immediately played, but after a period of time, the response data is played.

[0262] Based on this, in order to accumulate the elapsed time length so that the response data can be played when the time length threshold is met, when receiving the response data and determining that the current playback mode is the instant playback mode, the second controller can control the second timer to count time.

[0263] Wherein, the second timer can be a hardware device or a software program. And the second timer can count time forward. Exemplarily, the first timer can gradually increase the time length from 0 until the counted time length meets the time length indicated by the time length threshold. For example, it can gradually increase from 0 to 30 minutes. The second timer can also count time backward. Exemplarily, the second timer can gradually decrease the time length from the time length indicated by the time length threshold until it decreases to 0. For example, it can gradually decrease from 30 minutes to 0. Based on this, the specific type and time counting method of the second timer are not limited.

[0264] Among them, the current playback mode can be set in advance, or the current playback mode can be dynamically determined each time the second controller responds to the triggering operation of the voice key.

[0265] When the cumulative timing duration meets the timing duration threshold, the second controller can control the second audio output device to play the response data. At this time, the response data is played after the duration indicated by the timing duration threshold, rather than immediately as in the above response data.

[0266] In an optional embodiment, the above timing duration threshold is set in advance. In this way, the remote control records the preset timing duration threshold, and the second controller can directly read the above timing duration threshold to control the second audio output device to play the above response data when the cumulative timing duration meets the above preset timing duration threshold.

[0267] In an optional embodiment, the timing duration threshold is dynamically determined each time the second controller responds to the triggering operation of the voice key.

[0268] Exemplarily, the voice data collected by the second controller may include voice data related to the timing duration threshold. Thus, the second controller can perform semantic analysis on the above voice data related to the timing duration threshold to determine the timing duration threshold.

[0269] For example, if the voice data collected by the second controller includes "play the response data after 30 minutes", the second controller can determine that the timing duration threshold is 30 minutes. Another example is that if the voice data collected by the second controller includes "play the response data at time A", the second controller can determine that the timing duration threshold is the time difference between the current time and time A.

[0270] In the above embodiment, there is a certain time difference between the acquisition and playback of the above response data. Thus, considering that other viewers may have left within the time range corresponding to the above time difference, the privacy information in the response data can be better protected. And when playing the above response data, the display device 200 may have stopped playing the current playback audio-visual content. Thus, it can also ensure that the first audio output device does not interrupt the playback of the current playback audio.

[0271] In some embodiments, the step of controlling the second audio output device to play the response data includes generating a play instruction in response to a play operation, and controlling the second audio output device to play the response data in response to the play instruction.

[0272] When receiving the response data corresponding to the above voice data, the second controller does not automatically control the second audio output device to play the above response data. Instead, under a further operation on the remote control, the second controller controls the second audio output device to play the above response data in response to the above further operation. Therefore, when obtaining the above response data, the second controller can first generate a play instruction in response to a play operation, for example, a trigger operation of a play button. After that, the second controller can control the second audio output device to play the response data in response to the above play instruction.

[0273] In the above embodiment, when the second controller obtains the response data, according to the user's needs, at any moment when the user wishes to play the above response data, by responding to the play operation on the remote control, the above response data can be played. In this way, not only can the audio playback on the remote control be controlled as needed to avoid the leakage of private content in the response data, but also the playback of the current content being played on the display device will not be interrupted. In addition, the playback flexibility of the above response data can be increased, improving the user experience.

[0274] In some alternative embodiments, the voice playback method applied to the second controller may further include the step of sending a play instruction to the display device, so that when the key instruction identifier is the first key identifier, the display device responds to the play instruction and plays the response data through the first audio output device.

[0275] Among them, the first key identifier is used to indicate that the display device 200 plays the response data corresponding to the above voice data. Therefore, when the parsed key instruction identifier is the first key identifier, the display device 200 may not send the above response data to the second controller, but control the display 260 of the display device 200 to output a play reminder to prompt that the first controller has obtained the response data.

[0276] Exemplarily, the display 260 can output the above play reminder in various ways such as lighting up an indicator light, flashing the indicator light, emitting a reminder bullet screen, emitting a reminder subtitle bar, etc. Exemplarily, the display 260 can continuously output the above play reminder and stop outputting when the output duration reaches the output duration threshold.

[0277] After the display 260 of the display device 200 outputs the above playback reminder, the remote control can respond to the above playback reminder. Among them, in response to a playback operation, for example, a trigger operation of a playback button, etc., the remote control can generate a playback instruction and send the above playback instruction to the display device 200. For example, the playback instruction is sent via Bluetooth, the playback instruction is sent via NFC, etc. In this way, when the display device 200 receives the above playback instruction, it can respond to the above playback instruction and control the first audio output device to play the above response data.

[0278] In the above embodiment, when the second controller obtains the response data, according to user requirements, at any moment when the user hopes to play the above response data, by controlling the display device 200 again through the remote control, the playback of the above response data can be realized. In this way, the playback flexibility of the above response data can be increased, and the user experience can be improved.

[0279] In some optional embodiments, the voice playback method applied to the second controller may further include the steps of receiving a playback reminder output by the display device when the key instruction identifier is the second key identifier, and in response to the playback reminder, sending a playback instruction to the display device so that the display device sends response data.

[0280] Among them, the second key identifier is used to indicate that the remote control plays the response data corresponding to the above voice data. Correspondingly, when the display device 200 parses that the key instruction identifier is the second key identifier, the display device 200 can send a playback reminder to the second controller.

[0281] After receiving the above playback reminder, the second controller can control the remote control to output the above playback reminder, which is used to prompt the first controller to obtain the response data of the above voice data. Exemplarily, the remote control can output the above playback reminder in various ways such as lighting up an indicator light, flashing the indicator light, emitting a prompt voice, etc. Exemplarily, the remote control can continuously output the above playback reminder and stop outputting when the output duration reaches the output duration threshold.

[0282] After the control remote control outputs the above-mentioned playback reminder, the second controller can respond to the above-mentioned playback reminder. Among them, in response to a playback operation, for example, a triggering operation of a playback button, etc., the remote control can generate a playback instruction and send the above-mentioned playback instruction to the display device 200, for example, send the above-mentioned playback instruction via Bluetooth, send the above-mentioned playback instruction via WI FI, etc. In this way, when the display device 200 receives the above-mentioned playback instruction, it can determine that the second controller hopes to play the above-mentioned response data through the second audio output device. Therefore, the display device 200 can send the above-mentioned response data to the remote control, for example, send the above-mentioned response data via Bluetooth, send the above-mentioned response data via WIFI, etc.

[0283] In the above embodiment, according to user needs, at any moment when the user hopes to play the above-mentioned response data, by controlling the display device 200 again through the remote control, the playback of the above-mentioned response data can be realized. In this way, not only can the audio playback on the remote control be controlled as needed to avoid the leakage of private content in the response data, but also the playback of the current content being played on the display device will not be interrupted. In addition, the playback flexibility of the above-mentioned response data can be increased, and the user experience can be improved.

[0284] Based on the technical solutions of the above embodiments, in some optional embodiments, the step of determining the current playback mode is refined to achieve dynamic determination of the current playback mode.

[0285] In some optional embodiments, the voice playback method applied to the second controller may further include the step of obtaining a playback mode identifier corresponding to the voice button or the operation mode of the corresponding triggering operation in response to a triggering operation on the voice button.

[0286] The remote control includes at least one voice button. Different playback mode identifiers can be set for different voice buttons or different operation modes of the triggering operation, and different playback mode identifiers are used to indicate immediate playback of the response data corresponding to the above-mentioned voice data, or delayed playback of the response data corresponding to the above-mentioned voice data. Among them, for the voice button of the remote control, the above-mentioned voice button can be triggered by various operation modes, such as double-click, single-click, long-press, etc.

[0287] Exemplarily, such as Figure 8AAs shown in the figure, it is a schematic structural diagram of a remote control. Among them, buttons 1 and 2 are voice buttons, and there are two operation methods: single click and double click. The button instruction identifier corresponding to the single click operation method is the first button identifier, and the button instruction identifier corresponding to the double click operation method is the second button identifier. The playback mode identifier corresponding to button 1 is the first playback mode, and the playback mode corresponding to button 2 is the second playback mode. Then, the button instruction identifier corresponding to single clicking button 1 is the first button identifier and the playback mode identifier is the first mode identifier; the button instruction identifier corresponding to single clicking button 2 is the first button identifier and the playback mode identifier is the second mode identifier; the button instruction identifier corresponding to double clicking button 1 is the second button identifier and the playback mode identifier is the first mode identifier; the button instruction identifier corresponding to double clicking button 2 is the second button identifier and the playback mode identifier is the second mode identifier. Among them, the current playback mode corresponding to the first mode identifier is the instant playback mode, and the current playback mode corresponding to the second mode identifier is the delayed playback mode.

[0288] Exemplarily, as Figure 8E As shown in the figure, it is a schematic structural diagram of a remote control. Among them, the button is a voice button, and there are four operation methods: single click, double click, long press, and short press. Among them, the button instruction identifier corresponding to the single click operation method is the first button identifier, the button instruction identifier corresponding to the double click operation method is the second button identifier, the playback mode identifier corresponding to the long press operation method is the first playback mode, and the playback mode identifier corresponding to the short press operation method is the second playback mode. Then, the button instruction identifier corresponding to single clicking and long pressing the button is the first button identifier and the playback mode identifier is the first mode identifier; the button instruction identifier corresponding to double clicking and long pressing the button is the second button identifier and the playback mode identifier is the first mode identifier; the button instruction identifier corresponding to single clicking and short pressing the button is the first button identifier and the playback mode identifier is the second mode identifier; the button instruction identifier corresponding to double clicking and short pressing the button is the second button identifier and the playback mode identifier is the second mode identifier. Among them, double clicking and long pressing the button means: slowly pressing the button continuously twice, and double clicking and short pressing the button means: quickly pressing the button continuously twice. Among them, the current playback mode corresponding to the first mode identifier is the instant playback mode, and the current playback mode corresponding to the second mode identifier is the delayed playback mode.

[0289] The above Figures 8A - 8E The speaker in the above is the second audio output device in the remote control.

[0290] Based on this, in response to the triggering operation on the voice button, the second controller can obtain the playback mode identifier corresponding to the operation method of the voice button or the upper triggering operation. Correspondingly, in the above embodiment, the step of encoding the voice data and the button instruction identifier to obtain the voice button identifier is refined, including encoding the voice data, the button instruction identifier, and the playback mode identifier to obtain the voice button instruction.

[0291] In the above embodiments, in response to a triggering operation on the voice button, the second controller can obtain a button instruction identifier, a playback mode identifier, and voice data. Thus, the second controller can encode the voice data, the button instruction identifier, and the playback mode identifier to obtain a voice button instruction. In the above embodiments, the current playback mode of the above response data can be dynamically determined to make the playback of the above response data more flexible, more in line with user needs, and improve the user experience.

[0292] In some alternative embodiments, the voice playback method applied to the second controller may further include the step of, in response to a triggering operation on the mode button, obtaining a playback mode identifier corresponding to the mode button or the operation mode of the corresponding triggering operation.

[0293] The remote control may further include at least one mode button. Different playback mode identifiers may be set for different mode buttons or different operation modes of the triggering operations of the mode buttons, and different playback mode identifiers are used to indicate immediate playback of the response data corresponding to the above voice data, or delayed playback of the response data corresponding to the above voice data. Among them, for the mode button of the remote control, the above mode button can be triggered by various operation modes, such as double-clicking, single-clicking, long-pressing, etc.

[0294] Exemplarily, as Figure 8C shown, is a schematic structural diagram of a remote control. Among them, Button 3 and Button 4 are mode buttons. The playback mode identifier corresponding to Button 3 is the first mode identifier, which is used to indicate that the current playback mode is the immediate playback mode, and the playback mode identifier corresponding to Button 4 is the second mode identifier, which is used to indicate that the current playback mode is the delayed playback mode.

[0295] Exemplarily, as Figure 8D shown, is a schematic structural diagram of a remote control. Among them, Button 5 is a mode button, and there can be two operation modes: long-pressing and short-pressing. Among them, the playback mode identifier corresponding to long-pressing Button 5 is the first mode identifier, which is used for the current playback mode to be the immediate playback mode, and the playback mode identifier corresponding to short-pressing Button 5 is the second mode identifier, which is used to indicate that the current playback mode is the delayed playback mode.

[0296] Exemplarily, Figure 8AAnother implementation method: Button 1 is a voice button, Button 2 is a mode button, and there are two operation methods: single click and double click. The button instruction identifier corresponding to a single click of Button 1 is the first button identifier, the button instruction identifier corresponding to a double click of Button 1 is the second button identifier, the playback mode identifier corresponding to a single click of Button 2 is the first mode identifier, and the playback mode identifier corresponding to a double click of Button 2 is the second mode identifier. Then, when Button 1 is clicked and Button 2 is clicked, the corresponding button instruction identifier is the first button identifier and the playback mode identifier is the first mode identifier; when Button 1 is clicked and Button 2 is double clicked, the corresponding button instruction identifier is the first button identifier and the playback mode identifier is the second mode identifier; when Button 1 is double clicked and Button 2 is clicked, the corresponding button instruction identifier is the second button identifier and the playback mode identifier is the first mode identifier; when Button 1 is double clicked and Button 2 is double clicked, the corresponding button instruction identifier is the second button identifier and the playback mode identifier is the second mode identifier. Among them, the current playback mode corresponding to the first mode identifier is the instant playback mode, and the current playback mode corresponding to the second mode identifier is the delayed playback mode.

[0297] Figure 8D Another implementation method: Button 1 and Button 2 are mode buttons, Button 5 is a voice button, and there are two operation methods: single click and double click for Button 5. The playback mode identifier triggered by Button 1 is the first mode identifier, the playback mode identifier triggered by Button 2 is the second mode identifier, the button instruction identifier corresponding to a single click of Button 5 is the first button identifier, and the button instruction identifier corresponding to a double click of Button 5 is the second button identifier. Then, when Button 1 is triggered and Button 5 is clicked, the corresponding playback mode identifier is the first mode identifier and the button instruction identifier is the first button identifier; when Button 1 is triggered and Button 5 is double clicked, the corresponding playback mode identifier is the first mode identifier and the button instruction identifier is the second button identifier; when Button 2 is triggered and Button 5 is clicked, the corresponding playback mode identifier is the second mode identifier and the button instruction identifier is the first button identifier; when Button 2 is triggered and Button 5 is double clicked, the corresponding playback mode identifier is the second mode identifier and the button instruction identifier is the second button identifier.

[0298] Correspondingly, in the above embodiments, the step of encoding the voice data and the button instruction identifier to obtain the voice button identifier is refined, including encoding the voice data, the button instruction identifier, and the playback mode identifier to obtain the voice button instruction.

[0299] In the above embodiments, in response to a triggering operation on the voice button, the second controller can obtain a button instruction identifier and voice data, and in response to a triggering operation on the mode button, the second controller can obtain a playback mode identifier. Thus, the second controller can encode the voice data, the button instruction identifier, and the playback mode identifier to obtain a voice button instruction. The current playback mode of the above response data can be dynamically determined to make the playback of the above response data more flexible, more in line with user needs, and improve the user experience.

[0300] Based on the technical solutions of the above embodiments, in some alternative embodiments, taking the interaction process between the display device and the remote control as an example, the voice playback process of the above response data will be described.

[0301] In some alternative embodiments, referring to Figure 10 the voice playback process shown, includes:

[0302] S1001, the remote control responds to a triggering operation on the voice button, collects voice data, and obtains a button instruction identifier corresponding to the voice button or the operation mode of the corresponding triggering operation.

[0303] S1002, the remote control encodes the voice data and the button instruction identifier to obtain a voice button instruction.

[0304] S1003, the remote control sends the voice button instruction to the display device.

[0305] S1004, the display device parses the voice button instruction to obtain the button instruction identifier and the voice data.

[0306] S1005, the display device obtains the response data corresponding to the voice data.

[0307] S1006, when the button instruction identifier is the first button identifier, the display device controls the first audio output device to play the response data.

[0308] S1007, when the button instruction identifier is the second button identifier, keep the first audio output device playing the current playing audio.

[0309] S1008, when the button instruction identifier is the second button identifier, the display device sends the response data to the remote control.

[0310] S1009, the remote control plays the response data through the second audio output device.

[0311] In some alternative embodiments, referring to Figure 11 the voice playback process shown, includes:

[0312] S1101. The remote control collects voice data in response to the triggering operation of the voice key, and obtains the key command identifier corresponding to the voice key or the operation mode of the corresponding triggering operation.

[0313] S1102. The remote control encodes the voice data and the key command identifier to obtain a voice key command.

[0314] S1103. The remote control sends the voice key command to the display device.

[0315] S1104. The display device analyzes the voice key command to obtain the key command identifier and the voice data.

[0316] S1105. The display device obtains the response data corresponding to the voice data.

[0317] S1106. When the key command identifier is the first key identifier, the display device controls the first timer to time, and when the accumulated timing duration meets the timing duration threshold, controls the first audio output device to play the response data.

[0318] S1107. When the key command identifier is the second key identifier, the display device controls the first timer to time.

[0319] S1108. When the accumulated timing duration meets the timing duration threshold, the display device sends the response data to the remote control.

[0320] S1109. When the key command identifier is the second key identifier, the remote control plays the response data through the second audio output device.

[0321] S1110. During the process of playing the response data, the display device keeps the first audio output device playing the current playing audio.

[0322] In some alternative embodiments, referring to Figure 12 the voice playback process shown, includes:

[0323] S1201. The remote control collects voice data in response to the triggering operation of the voice key, and obtains the key command identifier corresponding to the voice key or the operation mode of the corresponding triggering operation.

[0324] S1202. The remote control encodes the voice data and the key command identifier to obtain a voice key command.

[0325] S1203. The remote control sends the voice key command to the display device.

[0326] S1204. The display device analyzes the voice key command to obtain the key command identifier and the voice data.

[0327] S1205, the display device acquires response data corresponding to the voice data.

[0328] S1206, when the key command identifier is the first key identifier and the current playback mode is the instant playback mode, the display device controls the first audio output device to immediately play the response data.

[0329] S1207, when the key command identifier is the first key identifier and the current playback mode is the delayed playback mode, the display device controls the first timer to time, and when the cumulative timing duration meets the timing duration threshold, controls the first audio output device to play the response data.

[0330] S1208, when the key command identifier is the second key identifier and the current playback mode is the instant playback mode, the display device keeps the first audio output device playing the current playback audio.

[0331] S1209, when the key command identifier is the second key identifier and the current playback mode is the instant playback mode, the display device immediately sends the response data to the remote control.

[0332] S1210, when the key command identifier is the second key identifier and the current playback mode is the instant playback mode, the remote control plays the response data through the second audio output device.

[0333] S1211, when the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, the display device controls the first timer to time.

[0334] S1212, when the cumulative timing duration meets the timing duration threshold, the display device sends the response data to the remote control.

[0335] S1213, when the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, the remote control plays the response data through the second audio output device.

[0336] S1214, during the process of playing the response data, the display device keeps the first audio output device playing the current playback audio.

[0337] In some alternative embodiments, referring to Figure 13 the voice playback process shown, includes:

[0338] S1301, in response to the triggering operation of the voice key, the remote control collects voice data and obtains the key command identifier corresponding to the operation mode of the voice key or the corresponding triggering operation.

[0339] S1302, the remote control encodes the voice data and the key command identifier to obtain a voice key command.

[0340] S1303. The remote control sends a voice key command to the display device.

[0341] S1304. The display device parses the voice key command to obtain a key command identifier and voice data.

[0342] S1305. The display device obtains response data corresponding to the voice data.

[0343] S1306. When the key command identifier is the first key identifier, the display device controls the display to output a playback reminder.

[0344] S1307. In response to the playback operation, the remote control generates a playback command in response to the playback reminder.

[0345] S1308. The remote control sends the playback command to the display device.

[0346] S1309. When the key command identifier is the first key identifier, the display device controls the first audio output device to play the response data.

[0347] S1310. When the key command identifier is the second key identifier, the display device controls the display to output a playback reminder.

[0348] S1311. In response to the playback operation, the remote control generates a playback command in response to the playback reminder.

[0349] S1312. The remote control sends the playback command to the display device.

[0350] S1313. When the key command identifier is the second key identifier, the display device sends the response data to the remote control.

[0351] S1314. The remote control plays the response data through the second audio output device.

[0352] S1315. During the process of the second audio output device playing the response data, the display device keeps the first audio output device playing the current playback audio.

[0353] In some alternative embodiments, referring to Figure 14 the voice playback process shown, includes:

[0354] S1401. In response to the triggering operation of the voice key, the remote control collects voice data and obtains the key command identifier corresponding to the voice key or the operation method of the corresponding triggering operation.

[0355] S1402. The remote control encodes the voice data and the key command identifier to obtain a voice key command.

[0356] S1403, the remote control sends a voice key command to the display device.

[0357] S1404, the display device analyzes the voice key command to obtain a key command identifier and voice data.

[0358] S1405, the display device obtains response data corresponding to the voice data.

[0359] S1406, when the key command identifier is the first key identifier, the display device sends a playback reminder to the remote control.

[0360] S1407, in response to the playback operation, the remote control generates a playback command in response to the playback reminder.

[0361] S1408, the remote control sends a playback command to the display device.

[0362] S1409, when the key command identifier is the first key identifier, the display device controls the first audio output device to play the response data.

[0363] S1410, when the key command identifier is the second key identifier, the display device sends a playback reminder to the remote control.

[0364] S1411, in response to the playback operation, the remote control generates a playback command in response to the playback reminder.

[0365] S1412, the remote control sends a playback command to the display device.

[0366] S1413, when the key command identifier is the second key identifier, the display device sends the response data to the remote control.

[0367] S1414, the remote control plays the response data through the second audio output device.

[0368] S1415, during the process of playing the response data, the display device keeps the first audio output device playing the current playing audio.

[0369] Based on the same inventive concept, an embodiment of the present application further provides a voice playback device for implementing the above-mentioned voice playback method. The implementation solution provided by the device for solving the problem is similar to the implementation solution described in the above method. Therefore, the specific limitations in one or more embodiments of the following voice playback device can refer to the limitations on the voice playback method in the above text, and will not be repeated here.

[0370] In an exemplary embodiment, as Figure 15As shown, a voice playback device is provided, which is applied to a display device and includes: an instruction receiving module 1510, an instruction parsing module 1520, a data acquisition module 1530, a playback control module 1540, and a data sending module 1550.

[0371] The instruction receiving module 1510 receives a voice key instruction sent by a remote controller when the display device plays audio and video; the instruction parsing module 1520 parses the voice key instruction to obtain a key instruction identifier and voice data; the data acquisition module 1530 acquires response data corresponding to the voice data; the playback control module 1540 controls a first audio output device of the display device to play the response data when the key instruction identifier is a first key identifier; the data sending module 1550 keeps the first audio output device of the display device playing the currently played audio and sends the response data to the remote controller to play the response data through a second audio output device of the remote controller when the key instruction identifier is a second key identifier.

[0372] In some embodiments, the playback control module 1540 is specifically configured to: control the first audio output device to immediately play the response data when the key instruction identifier is a first key identifier and the current playback mode is an immediate playback mode; or control a first timer to count when the key instruction identifier is a first key identifier and the current playback mode is a delayed playback mode, and control the first audio output device to play the response data when the accumulated counting duration meets a counting duration threshold; or output a playback reminder to the remote controller when the key instruction identifier is a first key identifier, and control the first audio output device to play the response data when a playback instruction sent by the remote controller in response to the playback reminder is received; or control the display to output a playback reminder when the key instruction identifier is a first key identifier, and control the first audio output device to play the response data when a playback instruction sent by the remote controller in response to the playback reminder is received.

[0373] In some embodiments, the data sending module 1550 is specifically configured to: when the key command identifier is the second key identifier and the current playback mode is the instant playback mode, keep the first audio output device playing the current playback audio, and immediately send response data to the remote controller to play the response data through the second audio output device of the remote controller; or, when the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, control the first timer to count, and when the accumulated counting duration meets the counting duration threshold, send response data to the remote controller to play the response data through the second audio output device of the remote controller, and keep the first audio output device playing the current playback audio during the process of playing the response data; or, when the key command identifier is the second key identifier, output a playback reminder to the remote controller, and when receiving a playback command sent by the remote controller in response to the playback reminder, send response data to the remote controller to play the response data through the second audio output device of the remote controller, and keep the first audio output device playing the current playback audio during the process of playing the response data; or, when the key command identifier is the second key identifier, control the display to output a playback reminder, and when receiving a playback command sent by the remote controller in response to the playback reminder, send response data to the remote controller to play the response data through the second audio output device of the remote controller, and keep the first audio output device playing the current playback audio during the process of playing the response data.

[0374] In some embodiments, the above voice playback device further includes: a mode determination module, configured to parse the voice key command to obtain a playback mode identifier; when the playback mode identifier is the first mode identifier, determine that the current playback mode is the instant playback mode; when the playback mode identifier is the second mode identifier, determine that the current playback mode is the delayed playback mode.

[0375] In an exemplary embodiment, as Figure 16 shown, there is provided a voice playback device applied to a remote controller, including: a first response module 1610, a first encoding module 1620, a first sending module 1630, a first receiving module 1640, and a first control module 1650.

[0376] The first response module 1610 is configured to collect voice data and obtain a key command identifier corresponding to a voice key in response to a trigger operation on the voice key; the first encoding module 1620 is configured to encode the voice data and the key command identifier to obtain a voice key command; the first sending module 1630 is configured to send the voice key command to a display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; the first receiving module 1640 receives response data corresponding to the voice data sent by the display device when the key command identifier is the second key identifier; the first control module 1650 controls a second audio output device of the remote controller to play the response data. Wherein, during the process of the second audio output device playing the response data, a first audio output device in the display device keeps playing the currently played audio.

[0377] In some embodiments, the first control module 1650 is specifically configured to: control the second audio output device to immediately play the response data when the current play mode is the immediate play mode; or, when the current play mode is the delayed play mode, control a second timer to count, and control the second audio output device to play the response data when the cumulative count duration meets a count duration threshold; or, in response to a play operation, generate a play command, and in response to the play command, control the second audio output device to play the response data.

[0378] In some embodiments, the above voice playback device further includes a first feedback module or a first receiving module. The first feedback module sends a play command to the display device so that the display device, when the key command identifier is the first key identifier, in response to the play command, plays the response data through the first audio output device. The first receiving module receives a play reminder output by the display device when the key command identifier is the second key identifier, and in response to the play reminder, sends a play command to the display device so that the display device sends the response data.

[0379] In some embodiments, the above voice playback device further includes: a first response module, configured to obtain a play mode identifier corresponding to the voice key or the operation mode of the corresponding trigger operation in response to a trigger operation on the voice key; or, in response to a trigger operation on a mode key, obtain a play mode identifier corresponding to the mode key or the operation mode of the corresponding trigger operation. Correspondingly, the first encoding module 1620 is specifically configured to: encode the voice data, the key command identifier, and the play mode identifier to obtain a voice key command.

[0380] In an exemplary embodiment, as Figure 17As shown, a voice playback device is provided, which is applied to a remote controller and includes: a second response module 1710, a second encoding module 1720, a second sending module 1730, a second receiving module 1740, and a second control module 1750.

[0381] The second response module 1710 is configured to collect voice data in response to a trigger operation on a voice key and obtain a key command identifier corresponding to the operation mode of the corresponding trigger operation; the second encoding module 1720 is configured to encode the voice data and the key command identifier to obtain a voice key command; the second sending module 1730 is configured to send the voice key command to a display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; the second receiving module 1740 is configured to receive response data corresponding to the voice data sent by the display device when the key command identifier is a second key identifier; the second control module 1750 is configured to control a second audio output device to play the response data; wherein, during the process of the second audio output device playing the response data, a first audio output device in the display device keeps playing the currently played audio.

[0382] In some embodiments, the second control module 1750 is specifically configured to: control the second audio output device to immediately play the response data when the current playback mode is an immediate playback mode; or, control a second timer to count when the current playback mode is a delayed playback mode, and control the second audio output device to play the response data when the accumulated counting duration meets a counting duration threshold; or, generate a playback command in response to a playback operation, and control the second audio output device to play the response data in response to the playback command.

[0383] In some embodiments, the above voice playback device further includes a second feedback module or a second receiving module. The second feedback module is configured to send a playback command to the display device so that the display device, when the key command identifier is a first key identifier, in response to the playback command, plays the response data through the first audio output device. The second receiving module is configured to receive a playback reminder output by the display device when the key command identifier is a second key identifier, and in response to the playback reminder, send a playback command to the display device so that the display device sends the response data.

[0384] In some embodiments, the above voice playback device further includes: a second response module, configured to obtain a playback mode identifier corresponding to the voice key or the operation mode of the corresponding trigger operation in response to a trigger operation on the voice key; or, obtain a playback mode identifier corresponding to the mode key or the operation mode of the corresponding trigger operation in response to a trigger operation on the mode key; correspondingly, the second control module 1750 is specifically configured to: encode the voice data, the key command identifier, and the playback mode identifier to obtain a voice key command.

[0385] Each module in the above voice playback device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or be stored in the memory of the computer device in software form so that the processor can call and execute the operations corresponding to each of the above modules.

[0386] In an exemplary embodiment, a computer device is provided, which includes a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0387] In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented. In an embodiment, a computer program product is provided, which includes a computer program. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0388] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0389] It can be understood that to implement all or part of the processes in the methods of the above embodiments, it can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above various methods. Among them, any reference to a memory, database, or other medium used in the various embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the various embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., and are not limited thereto. The processors involved in the various embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., and are not limited thereto.

[0390] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as within the scope recorded in the present application.

[0391] The above embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A display device, characterized in that, Including: A first communication device configured to communicate with a remote controller; A display configured to display content; A first audio output device configured to play audio; At least one first controller, connected to the first communication device and the display, and configured to: Receive a voice key command sent by the remote controller when the display device plays audio and video; Parse the voice key command to obtain a key command identifier and voice data; Obtain response data corresponding to the voice data; When the key command identifier is a first key identifier, control the first audio output device to play the response data; When the key command identifier is a second key identifier, keep the first audio output device playing the currently playing audio, and send the response data to the remote controller to play the response data through a second audio output device of the remote controller.

2. The display device according to claim 1, wherein When the first controller executes controlling the first audio output device to play the response data when the key command identifier is a first key identifier, it is configured to: When the key command identifier is a first key identifier and the current playback mode is an instant playback mode, control the first audio output device to immediately play the response data; or, When the key command identifier is a first key identifier and the current playback mode is a delayed playback mode, control a first timer to count, and when the cumulative counting duration meets a counting duration threshold, control the first audio output device to play the response data; Or, When the key command identifier is a first key identifier, output a playback reminder to the remote controller, and when receiving a playback command sent by the remote controller in response to the playback reminder, control the first audio output device to play the response data; Or, When the key command identifier is a first key identifier, control the display to output the playback reminder, and when receiving a playback command sent by the remote controller in response to the playback reminder, control the first audio output device to play the response data.

3. The display device according to claim 1, characterized in that When the first controller executes keeping the first audio output device playing the currently playing audio and sending the response data to the remote controller to play the response data through a second audio output device of the remote controller when the key command identifier is a second key identifier, it is configured to: When the key command identifier is the second key identifier and the current playback mode is an instant playback mode, keep the first audio output device playing the currently playing audio, and immediately send the response data to the remote controller to play the response data through a second audio output device of the remote controller; Or, When the key command identifier is the second key identifier and the current playback mode is the delayed playback mode, control the first timer to count, and when the accumulated counting duration meets the counting duration threshold, send the response data to the remote control to play the response data through the second audio output device of the remote control, and during the process of playing the response data, keep the first audio output device playing the current playback audio; Or, When the key command identifier is the second key identifier, output a playback reminder to the remote control, and when receiving the playback command sent by the remote control in response to the playback reminder, send the response data to the remote control to play the response data through the second audio output device of the remote control, and during the process of playing the response data, keep the first audio output device playing the current playback audio; Or, When the key command identifier is the second key identifier, control the display to output the playback reminder, and when receiving the playback command sent by the remote control in response to the playback reminder, send the response data to the remote control to play the response data through the second audio output device of the remote control, and during the process of playing the response data, keep the first audio output device playing the current playback audio.

4. The display device according to claim 2 or 3, characterized in that, The first controller is further configured to: Parse the voice key command to obtain a playback mode identifier; When the playback mode identifier is the first mode identifier, determine that the current playback mode is the immediate playback mode; When the playback mode identifier is the second mode identifier, determine that the current playback mode is the delayed playback mode.

5. A remote controller, characterized in that, It includes: A second communication device configured to communicate with a display device; A second audio output device configured to perform audio playback; At least one voice key; At least one second controller, connected to the second audio output device and the at least one voice key, is configured to: In response to a trigger operation on the voice key, collect voice data and obtain the key command identifier corresponding to the voice key; Encode the voice data and the key command identifier to obtain a voice key command; Send the voice key command to the display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; Receive the response data corresponding to the voice data sent by the display device when the key command identifier is the second key identifier; Control the second audio output device to play the response data; Wherein, during the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the current playback audio.

6. The remote controller according to claim 5, characterized in that, When the second controller executes the control to play the response data by the second audio output device, it is configured to: When the current playback mode is the immediate playback mode, control the second audio output device to immediately play the response data; or, When the current playback mode is the time-lapse playback mode, control the second timer to count, and when the cumulative counting duration meets the counting duration threshold, control the second audio output device to play the response data; Or, In response to a playback operation, generate a playback instruction, and in response to the playback instruction, control the second audio output device to play the response data.

7. A remote controller, characterized in that, Comprising: A second communication device configured to communicate with a display device; A second audio output device configured to perform audio playback; At least one voice key; At least one second controller, connected to the second audio output device and the at least one voice key, configured to: In response to a trigger operation on the voice key, collect voice data and obtain a key instruction identifier corresponding to the operation mode of the corresponding trigger operation; Encode the voice data and the key instruction identifier to obtain a voice key instruction; Send the voice key instruction to the display device so that the display device parses the voice key instruction to obtain the voice data and the key instruction identifier; Receive the response data corresponding to the voice data sent by the display device when the key instruction identifier is the second key identifier; Control the second audio output device to play the response data; Wherein, during the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the current playback audio.

8. A voice playback method, characterized in that, Applied to a display device, comprising: When the display device plays audio and video, receive a voice key instruction sent by a remote control; Parse the voice key instruction to obtain a key instruction identifier and voice data; Obtain the response data corresponding to the voice data; When the key instruction identifier is the first key identifier, control the first audio output device of the display device to play the response data; When the key instruction identifier is the second key identifier, keep the first audio output device of the display device playing the current playback audio, and send the response data to the remote control to play the response data through the second audio output device of the remote control.

9. A voice playback method, characterized in that, Applied to a remote control, comprising: In response to a trigger operation on a voice key, collect voice data and obtain a key instruction identifier corresponding to the voice key; Encode the voice data and the key instruction identifier to obtain a voice key instruction; Send the voice key instruction to the display device so that the display device parses the voice key instruction to obtain the voice data and the key instruction identifier; Receive the response data corresponding to the voice data sent by the display device when the key instruction identifier is the second key identifier; Control the second audio output device of the remote control to play the response data; Wherein, during the process of the second audio output device playing the response data, the first audio output device in the display device keeps playing the current playback audio.

10. A voice playback method, characterized in that, Applied to a remote control, comprising: In response to a trigger operation on a voice key, collect voice data and obtain a key command identifier corresponding to the operation mode of the corresponding trigger operation; Encode the voice data and the key command identifier to obtain a voice key command; Send the voice key command to a display device so that the display device parses the voice key command to obtain the voice data and the key command identifier; Receive response data corresponding to the voice data sent by the display device when the key command identifier is a second key identifier; Control a second audio output device of the remote control to play the response data; Wherein, during the process of the second audio output device playing the response data, a first audio output device in the display device keeps playing the currently played audio.

Images