Display device and voice pickup method

Abstract

The present application provides an embodiment, which belongs to the voice recognition technology, and provides a display device and a voice pickup method, wherein the display device includes a display; a controller connected to the display, and the controller is configured to: receive first indication information sent by the control device, the first indication information is used to indicate that the voice button of the control device is pressed for the first time; if a voice application is running in the foreground of the display device, send second indication information to the control device, the second indication information is used to instruct the control device to perform voice pickup under the first voice path, and the first voice path is used to carry the indication information of the display device; receive the first voice data picked up under the first voice path sent by the control device. Compared with the prior art, when a voice application is running in the foreground of the display device, the voice pickup can be controlled by the voice application on the display device, thereby avoiding the situation where the software and hardware trigger the voice pickup at the same time and receive invalid voice data.

Description

Technical Field

[0001] The embodiments of the present application relate to speech recognition technology, and more specifically, to a display device and a speech pickup method. Background Art

[0002] With the popularity of smart TVs in users' homes, in order to support voice applications in smart TVs, a voice collector can usually be set on the remote control device to collect the user's voice data and send the voice data to the display device so that the display device can perform voice recognition on the user's voice data.

[0003] In the related art, a physical voice button is usually provided on a remote control device, and when the physical voice button is pressed, voice pickup and voice data transmission can be triggered. At the same time, a voice application on a display device is usually also provided with a software voice button, and when a user clicks the software voice button, the display device can send instruction information to the remote control device to instruct the remote control device to pick up the voice.

[0004] However, since the remote control device needs to support both physical voice buttons and software voice buttons, when the physical voice buttons and software voice buttons are used at the same time, some invalid voice data may be collected, thereby reducing the subsequent voice recognition efficiency. Summary of the invention

[0005] The exemplary embodiments of the present application provide a display device and a voice pickup method to solve the problem in the prior art that software and hardware simultaneously trigger voice pickup and invalid voice data is received.

[0006] In a first aspect, an embodiment of the present application provides a display device, including:

[0007] monitor;

[0008] A controller connected to the display, the controller being configured to:

[0009] Receiving first indication information sent by a control device, where the first indication information is used to indicate that a voice button of the control device is pressed for the first time;

[0010] If a voice application is running in the foreground of the display device, second indication information is sent to the control device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, and the first voice channel is used to carry the indication information of the display device;

[0011] The first voice data picked up in the first voice path and sent by the control device is received.

[0012] In some embodiments of the present application, the controller is further configured to:

[0013] The third indication information is sent to the control device according to the control instruction input by the user, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

[0014] In some embodiments of the present application, the controller is further configured to:

[0015] After the voice button of the control device is pressed for the first time, second voice data picked up in a second voice path sent by the control device is received, and the second voice path is used to carry indication information triggered by the voice button of the control device.

[0016] In some embodiments of the present application, the controller is further configured to:

[0017] If a voice application is running in the foreground of the display device, the second voice data sent by the control device is discarded.

[0018] In some embodiments of the present application, the controller is further configured to:

[0019] If the voice application is not running in the foreground of the display device, fourth indication information is sent to the control device, where the fourth indication information is used to instruct the control device to keep picking up voice in the second voice path.

[0020] In a second aspect, an embodiment of the present application provides a voice pickup method, comprising:

[0021] Receiving first indication information sent by a control device, where the first indication information is used to indicate that a voice button of the control device is pressed for the first time;

[0022] If a voice application is running in the foreground of the display device, second indication information is sent to the control device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, and the first voice channel is used to carry the indication information of the display device;

[0023] The first voice data picked up in the first voice path and sent by the control device is received.

[0024] In some embodiments of the present application, after sending the second indication information to the control device, the method further includes:

[0025] The third indication information is sent to the control device according to the control instruction input by the user, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

[0026] In some embodiments of the present application, the method further includes:

[0027] After the voice button of the control device is pressed for the first time, second voice data picked up in a second voice path sent by the control device is received, and the second voice path is used to carry indication information triggered by the voice button of the control device.

[0028] In some embodiments of the present application, after receiving the second voice data picked up in the second voice path sent by the control device, the method further includes:

[0029] If a voice application is running in the foreground of the display device, the second voice data sent by the control device is discarded.

[0030] In some embodiments of the present application, the method further includes:

[0031] If the voice application is not running in the foreground of the display device, fourth indication information is sent to the control device, where the fourth indication information is used to instruct the control device to keep picking up voice in the second voice path.

[0032] In a third aspect, the present invention further provides a non-transitory computer-readable storage medium storing computer instructions, on which a computer program is stored, and when the computer program is executed by a processor, any possible method in the second aspect is implemented.

[0033] In a fourth aspect, the present invention further provides a computer program product, comprising computer instructions, which, when executed by a processor, implement the communication method described in any one of the second aspects.

[0034] The display device, control device and voice pickup method provided by the embodiment of the present application include a display; a controller connected to the display, the controller being configured to: receive a first indication message sent by the control device, the first indication message is used to indicate that the voice button of the control device is pressed for the first time; if a voice application is running in the foreground of the display device, send a second indication message to the control device, the second indication message is used to instruct the control device to perform voice pickup under a first voice path, the first voice path is used to carry the indication information of the display device; receive the first voice data picked up under the first voice path sent by the control device. Compared with the prior art, when a voice application is running in the foreground of the display device, the voice pickup can be controlled by the voice application on the display device, thereby avoiding the software and hardware triggering the voice pickup at the same time and receiving invalid voice data. This improves the subsequent voice recognition efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0036] Figure 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to some embodiments;

[0037] Figure 2 exemplarily shows a hardware configuration block diagram of a display device according to some embodiments;

[0038] Figure 3 exemplarily shows a hardware configuration block diagram of a control device according to some embodiments;

[0039] Figure 4 exemplarily shows a schematic diagram of software configuration in a display device according to some embodiments;

[0040] Figure 5 exemplarily shows a schematic diagram of an icon control interface display of an application in a display device according to some embodiments;

[0041] Figure 6 exemplarily shows a system architecture diagram of voice pickup according to some embodiments;

[0042] Figure 7a An exemplary layout of voice buttons according to some embodiments is shown;

[0043] Figure 7b Another layout of voice buttons according to some embodiments is exemplarily shown;

[0044] Figure 8 A signaling interaction diagram of a voice pickup method according to some embodiments is exemplarily shown;

[0045] Fig. 9 A schematic diagram exemplarily illustrates a flow chart of another voice pickup method according to some embodiments;

[0046] Fig.10 A schematic diagram showing a structure of a display device according to some embodiments is exemplified;

[0047] Fig.11 A schematic structural diagram of a control device according to some embodiments is exemplarily shown. DETAILED DESCRIPTION

[0048] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0049] Based on the exemplary embodiments described in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the claims attached to this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete implementation method separately.

[0050] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0051] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented in an order other than those given in the diagrams or descriptions of the embodiments of this application.

[0052] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0053] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0054] The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually wirelessly control the electronic device within a short distance. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

[0055] The term "gesture" used in this application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.

[0056] Figure 1 FIG. 2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .

[0057] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., to control the display device 200 wirelessly or in a wired manner. The user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the display device 200. For example, the user may input corresponding control commands through the volume plus and minus keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the display device 200.

[0058] In some embodiments, a mobile terminal, a tablet computer, a computer, a laptop computer, and other smart devices may also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. The application may be configured to provide the user with various controls in an intuitive user interface (UI) on a screen associated with the smart device.

[0059] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and realize connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example, it is possible to establish a control instruction protocol with the mobile terminal 300 and synchronize the remote control keyboard to the mobile terminal 300, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to realize the synchronous display function.

[0060] like Figure 1It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service content such as video on demand and advertising services is provided through the server 400.

[0061] The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, and resolution are not limited. It is understood by those skilled in the art that the display device 200 may be modified in performance and configuration as required.

[0062] In addition to providing a broadcast receiving television function, the display device 200 may also provide an intelligent network television function that provides a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0063] Figure 2 Schematically shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.

[0064] In some embodiments, the display device 200 includes at least one of a controller 250, a tuner and demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

[0065] In some embodiments, the display 275 is a component for receiving the image signal outputted from the first processor and displaying video content and images as well as a menu control interface.

[0066] In some embodiments, the display 275 includes a display screen component for presenting images and a driving component for driving image display.

[0067] In some embodiments, the displayed video content may be from broadcast television content, or may be various broadcast signals received through wired or wireless communication protocols, or may be from various image content sent from a network server via a network communication protocol.

[0068] In some embodiments, the display 275 is used to present a user manipulation UI interface generated in the display device 200 and used to control the display device 200 .

[0069] In some embodiments, depending on the type of display 275, a driving component for driving the display is also included.

[0070] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.

[0071] In some embodiments, the communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the communicator may include at least one of a Wifi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, other network communication protocol chips or a near field communication protocol chip, and an infrared receiver.

[0072] In some embodiments, the display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the content providing device through the communicator 220 .

[0073] In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (eg, an infrared remote controller, etc.).

[0074] In some embodiments, the detector 230 is a signal used by the display device 200 to collect external environment or interact with the outside.

[0075] In some embodiments, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes by collecting ambient light.

[0076] In some embodiments, the detector 230 may also include an image collector, such as a camera, a webcam, etc., which can be used to collect external environment scenes, as well as to collect user attributes or gestures for interacting with the user. It can adaptively change display parameters and recognize user gestures to achieve the function of interacting with the user.

[0077] In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing the ambient temperature.

[0078] In some embodiments, the display device 200 can adaptively adjust the display color temperature of the image. For example, when the temperature is high, the display device 200 can be adjusted to display a cooler color temperature of the image, or when the temperature is low, the display device 200 can be adjusted to display a warmer color temperature of the image.

[0079] In some embodiments, the detector 230 may also be a sound collector, such as a microphone, which can be used to receive the user's voice, for example, including a voice signal of a control instruction of the user to control the display device 200, or collect environmental sounds to identify the type of environmental scene, so that the display device 200 can adaptively adapt to the environmental noise.

[0080] In some embodiments, Figure 2 As shown, the input / output interface 255 is configured to perform data transmission between the controller 250 and other external devices or other controllers 250, such as receiving video signal data and audio signal data, or command instruction data from external devices.

[0081] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more interfaces such as a high-definition multimedia interface HDMI interface, an analog or digital high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. It is also possible that the above multiple interfaces form a composite input / output interface.

[0082] In some embodiments, Figure 2 As shown, the tuner-demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the television channel frequency selected by the user, as well as EPG data signals.

[0083] In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, which can send a control signal based on the user's selection to make the modem respond to the TV signal frequency selected by the user and modulate and demodulate the TV signal carried by the frequency.

[0084] In some embodiments, the broadcast television signal can be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals according to different broadcasting formats of the television signal. Or it can be classified into digital modulation signals, analog modulation signals, etc. according to different modulation types. Or it can be classified into digital signals, analog signals, etc. according to different signal types.

[0085] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the TV audio and video signals modulated and demodulated from the received broadcast TV signals to the main device, and the main device receives the audio and video signals through the first input / output interface.

[0086] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 can perform operations related to the object selected by the user command.

[0087] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object may include, for example, displaying operations such as a page, document, or image connected to the hyperlink, or executing operations corresponding to a program of the icon. User commands for selecting UI objects may be commands inputted through various input devices (e.g., a mouse, a keyboard, a touchpad, etc.) connected to the display device 200, or voice commands corresponding to voices spoken by the user.

[0088] like Figure 2 As shown, the controller 250 includes at least one of a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a video processor 270, an audio processor 280, other processors 253 (for example: a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication bus 256 (Bus). The communication bus connects various components.

[0089] In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.

[0090] In some embodiments, ROM 252 is used to store various system startup instructions.

[0091] In some embodiments, ROM 252 is used to store a basic input / output system, called Basic Input Output System (BIOS), which is used to complete the power-on self-test of the system, the initialization of each functional module in the system, the basic input / output driver of the system, and the booting of the operating system.

[0092] In some embodiments, when a power-on signal is received, the display device 200 starts to power on, and the CPU runs the system startup instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to start or run the operating system. After the operating system is started, the CPU copies the temporary data of various application programs in the memory to the RAM 251, so as to start or run various application programs.

[0093] In some embodiments, the CPU processor 254 is used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video contents.

[0094] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying the picture in the normal mode. The one or more sub-processors are used for an operation in the standby mode and the like.

[0095] In some embodiments, the graphics processor 253 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics, etc. It includes an operator that performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer that renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.

[0096] In some embodiments, the video processor 270 is configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, and obtain a signal that can be directly displayed or played on the display device 200.

[0097] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.

[0098] Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.

[0099] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0100] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display.

[0101] The frame rate conversion module is used to convert the input video frame rate, such as converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by interpolation.

[0102] The display formatting module is used to receive the frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting RGB data signal.

[0103] In some embodiments, the graphics processor 253 can be integrated with the video processor or can be separately configured. When integrated, it can perform processing of graphic signals output to the display. When separately configured, it can perform different functions respectively, such as GPU + FRC (Frame Rate Conversion) architecture.

[0104] In some embodiments, the audio processor 280 is used to receive an external audio signal, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal to obtain a sound signal that can be played in a speaker.

[0105] In some embodiments, the video processor 270 may include one or more chips. The audio processor may also include one or more chips.

[0106] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller into one or more chips.

[0107] In some embodiments, the audio output receives the sound signal output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to the external audio output terminal of the generating device of the external device, such as an external audio interface or a headphone interface, etc., and can also include a short-range communication module in the communication interface, for example, a Bluetooth module for Bluetooth speaker sound output.

[0108] The power supply 290, under the control of the controller 250, uses the power input from the external power supply to provide power supply support for the display device 200. The power supply 290 may include a built-in power supply circuit installed inside the display device 200, or may be an external power supply installed on the display device 200 to provide a power interface for an external power supply in the display device 200.

[0109] The user interface 265 is used to receive a user input signal, and then send the received user input signal to the controller 250. The user input signal may be a remote control signal received by an infrared receiver, and may receive various user control signals through a network communication module.

[0110] In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300 , the user input interface is based on the user input, and the display device 200 responds to the user input through the controller 250 .

[0111] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0112] In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0113] The memory 260 includes storing various software modules for driving the display device 200. For example, the various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0114] The basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.

[0115] For example, the speech recognition module includes a speech analysis module and a speech instruction database module. The display control module is a module for controlling the display to display image content, and can be used to play multimedia image content and UI interface information. The communication module is a module for controlling and communicating data with external devices. The browser module is a module for executing data communication between browsing servers. The service module is a module for providing various services and various applications. At the same time, the memory 260 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effects of focus objects.

[0116] Figure 3 Schematically shows a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0117] The control device 100 is configured to control the display device 200, and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.

[0118] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0119] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other smart electronic device can play a similar function to the control device 100 after installing the application for controlling the display device 200. For example, the user can install the application to realize the function of the physical button of the control device 100 through various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other smart electronic device.

[0120] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0121] The communication interface 130, under the control of the controller 110, realizes the communication of control signals and data signals with the display device 200. For example, the received user input signal is sent to the display device 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0122] The user input / output interface 140 includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can input user commands through voice, touch, gesture, pressing, and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.

[0123] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, it can be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared sending module. For another example, in the case of a radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to a radio frequency control signal modulation protocol, and then sent to the display device 200 by a radio frequency sending terminal.

[0124] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, which can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0125] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0126] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller, and can be a battery and related control circuits.

[0127] In some embodiments, the system may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts the hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0128] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0129] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, camera applications, etc. provided by the operating system; or they may be applications developed by third-party developers, such as hi-view programs, karaoke programs, magic mirror programs, etc. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which are not limited in the embodiments of the present application.

[0130] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Applications can access system resources and obtain system services during execution through the API interface.

[0131] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0132] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening, and backing (including switching the user interface currently displayed in the display window to the parent user interface of the currently displayed user interface), etc.

[0133] In some embodiments, the window manager is used to manage all window programs, such as obtaining the display size, determining whether there is a status bar, locking the screen, capturing the screen, controlling display window changes (for example, shrinking the display window, shaking the display, distorting the display, etc.), etc.

[0134] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0135] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), etc.

[0136] In some embodiments, the core layer further includes a power driver module for performing power management.

[0137] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in Figure 2 or Figure 3 in the first memory or the second memory shown.

[0138] In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives the input operation of the remote control, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into the original input event (including the value of the input operation, the timestamp of the input operation and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and the input operation is a confirmation operation. The control corresponding to the confirmation operation is the control of the magic mirror application icon. The magic mirror application calls the interface of the application framework layer to start the magic mirror application, and then starts the camera driver by calling the kernel layer to realize the capture of static images or videos through the camera.

[0139] In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by a user on the display screen, and the kernel layer can generate a corresponding input event according to the input operation, and report the event to the application framework layer. The activity manager of the application framework layer sets the window mode (such as a multi-window mode) and the window position and size corresponding to the input operation. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

[0140] In some embodiments, Figure 5 As shown in , the application layer includes at least one application that can display a corresponding icon control in the display, such as: a live TV application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, etc.

[0141] In some embodiments, the live TV application can provide live TV through different signal sources. For example, the live TV application can use input from cable TV, wireless broadcast, satellite service, or other types of live TV services to provide TV signals. And, the live TV application can display video of the live TV signal on the display device 200.

[0142] In some embodiments, the video on demand application can provide videos from different storage sources. Unlike the live TV application, the video on demand provides video display from certain storage sources. For example, the video on demand can come from the server side of the cloud storage, from the local hard disk storage containing the stored video programs.

[0143] In some embodiments, the media center application can provide an application for playing various multimedia contents. For example, the media center can be a service provided by a user to access various images or audios through the media center application, which is different from live TV or video on demand.

[0144] In some embodiments, the application center can provide and store various applications. The application can be a game, an application, or some other application related to a computer system or other device but can be run on a smart TV. The application center can obtain these applications from different sources, store them in a local storage, and then run them on the display device 200.

[0145] With the popularity of smart TVs in users' homes, in order to support voice applications in smart TVs, a voice collector can usually be set on the remote control device to collect the user's voice data and send the voice data to the display device so that the display device can perform voice recognition on the user's voice data.

[0146] In the related art, a physical voice button is usually provided on a remote control device, and when the physical voice button is pressed, voice pickup and voice data transmission can be triggered. At the same time, a voice application on a display device is usually also provided with a software voice button, and when a user clicks the software voice button, the display device can send instruction information to the remote control device to instruct the remote control device to pick up the voice.

[0147] However, since the remote control device needs to support both physical voice buttons and software voice buttons, when the physical voice buttons and software voice buttons are used at the same time, some invalid voice data may be collected, thereby reducing the subsequent voice recognition efficiency.

[0148] For example, since the software-based voice button needs to be opened by the user after pressing the physical-based voice button first, when the voice application is opened, if the physical-based voice button is pressed, the control device will directly use the voice path corresponding to the physical-based voice button to directly pick up the voice when asking the display device whether to use the software-based voice button for voice pickup. At this time, the voice data obtained by the control device for a short period of voice pickup is invalid, and will instead cause a decrease in the voice recognition rate.

[0149] To solve the above problems, the embodiments of the present application provide a display device, a control device and a voice pickup method, which determines the voice path of the control device according to whether a voice application is running in the foreground of the display device, thereby avoiding the software and hardware triggering voice pickup at the same time and receiving invalid voice data, thereby improving the efficiency of voice recognition.

[0150] It is understood that the above-mentioned speech recognition technology can be implemented by the display device and control device mentioned in the embodiment of the present application. The following is a detailed description of the technical solution of the embodiment of the present application by taking the display device and control device integrated or installed with the relevant execution code as an example. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0151] Figure 6 FIG. 4 is an exemplary diagram of a system architecture of voice pickup according to some embodiments. Figure 6 As shown, the voice pickup system provided by the embodiment of the present application includes a control device and a display device, and the control device and the display device interact with each other. The control device is used to send information to the display device when the user triggers the voice function, and send the voice data collected during voice pickup to the display device. The display device is used to instruct the control device on the control mode for voice pickup, and recognize the voice data sent by the control device.

[0152] It should be understood that the embodiments of the present application do not limit the type of control device. In some embodiments, the control device may be a remote control of the display device. In other embodiments, the control device may also be a terminal that establishes a connection with the display device, such as a mobile phone, tablet computer, etc.

[0153] Continue to refer Figure 6 The control device may include a voice collector and a controller. The voice collector is used to pick up the user's voice data under the control of the controller.

[0154] It should be understood that the embodiment of the present application does not limit the model of the voice collector, and can be specifically set according to actual conditions. It should be noted that in some embodiments, if the control device is a terminal connected to the display device, the voice collector of the control device can use the original voice collector on the terminal.

[0155] In some embodiments, a voice button may also be provided on the control device so that the user can input voice into the remote control device by pressing the voice button when voice input is required.

[0156] It should be understood that the present application embodiment does not limit the layout of the voice buttons. Figure 7a The following is an exemplary diagram of a layout of voice buttons according to some embodiments. Figure 7a As shown, the voice button can be set on the front of the control device and located below other buttons of the control device so that the user can easily perform the trigger operation. Figure 7b Another layout of voice buttons according to some embodiments is shown as an example. Figure 7bAs shown, the voice button can be set on the side of the control device so that the user can press the voice button more conveniently when holding the control device, thereby reducing the user's operating cost.

[0157] It should be understood that the embodiment of the present application does not limit the type of controller of the control device, and can be specifically set according to actual conditions. In the embodiment of the present application, the controller of the control device sends an indication message to the display device based on the pressing or lifting of the voice button to inform the display device that the user needs to perform a voice recognition operation. After receiving the indication message sent by the display device, the voice channel for voice collection by the voice collector can be controlled to send the voice data collected by the voice collector in the corresponding voice channel to the display device.

[0158] The voice channel for voice pickup may include a first voice channel and a second voice channel. The first voice channel is used to carry the indication information of the display device, and the second voice channel is used to carry the indication information triggered by the voice button of the control device. The control device triggers voice pickup by the indication information of the display device in the first voice channel, and triggers voice pickup by the voice button of the control device in the second voice channel.

[0159] It should be understood that the above-mentioned first voice path is a software voice pickup channel, and the software on the display device sends instruction information to the control device to turn on or off the voice pickup of the control device; the above-mentioned second voice path is a hardware voice pickup channel, and the voice pickup is triggered by a physical button on the control device.

[0160] Continue to refer Figure 6 The display device may include a display and a controller. The controller of the display device instructs the control device to use a voice channel for voice pickup and recognizes the voice data sent by the control device. The display is used to display the interface of the voice application and to display the voice data on the interface of the voice application accordingly after the voice data is recognized.

[0161] It should be understood that the embodiment of the present application does not limit the type of controller of the display device, and it can be specifically configured according to actual conditions.

[0162] In the embodiments of the present application, the controller of the display device can determine the voice channel for voice pickup in a variety of ways. In some embodiments, the controller of the display device can determine the voice channel for voice pickup based on whether a voice application is running in the foreground of the display device. If a voice application is running in the foreground of the display device, the display device can determine that the control device uses the first voice channel for voice pickup, and the voice application directly controls the voice pickup; if the voice application is not running in the foreground of the display device, the display device can determine that the control device uses the second voice channel for voice pickup, and the voice button on the control device directly controls the voice pickup.

[0163] It should be understood that the embodiments of the present application do not limit how to determine whether a voice application is running in the foreground of a display device. In some embodiments, if a voice application is running in the foreground of a display device, an identifier of the voice application may be recorded in the target flag of the display device. If the controller of the display device queries the target flag and finds that there is an identifier of the voice application, it determines that there is a voice application running in the foreground of the display device. If the controller of the display device does not query the target flag and finds that there is an identifier of the voice application, it determines that there is no voice application running in the foreground of the display device.

[0164] In some embodiments, a voice analysis engine is also provided in the controller of the display device, so that after the display device receives voice data sent by the control device, the voice analysis engine can perform voice recognition.

[0165] In an embodiment of the present application, if the controller of the display device determines that the control device uses the first voice channel for voice pickup, second indication information is sent to the control device, and the second indication information is used to instruct the control device to perform voice pickup under the first voice channel. If the controller of the display device determines that the control device uses the second voice channel for voice pickup, fourth indication information is sent to the control device, and the fourth indication information is used to instruct the control device to maintain voice pickup under the second voice channel.

[0166] It should be noted that, for the second voice channel, there are two entry methods in the embodiment of the present application.

[0167] In the first mode, after the voice button of the control device is pressed for the first time, the control device directly uses the second voice channel, and after completing voice pickup, sends the second voice data picked up in the second voice channel to the display device. If the display device subsequently instructs the control device to use the first voice channel, the display device can discard the second voice data picked up by the control device in the second voice channel.

[0168] In the second method, after the voice button of the control device is pressed for the first time, the control device directly uses the second voice channel. If the second indication information is not received before the voice button of the control device is lifted for the first time, the second voice data picked up under the second voice channel is sent to the display device.

[0169] It should be noted that in other embodiments, if the display device does not run a voice application in the foreground, the display device may not send an indication message to the control device. Accordingly, if the control device does not receive the second indication message sent by the display device, the control device continues to be in the second voice channel.

[0170] The voice pickup processes of the first voice channel and the second voice channel are described below respectively.

[0171] It should be understood that the embodiments of the present application do not limit how the control device triggers voice pickup under the first voice path. In some embodiments, the display device can send a third indication message to the control device, and the third indication message is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

[0172] Exemplarily, if the third indication information received by the control device is a start indication, the control device starts voice pickup upon receiving the start indication, and at this time, the control device continuously sends the picked-up voice data to the display device. If the third indication information subsequently received by the control device is an end information, the control device stops voice pickup.

[0173] It should be noted that in the embodiment of the present application, in order to avoid the software and hardware triggering voice pickup at the same time, after receiving the second indication information, the control device needs to detect the first lift or the second press of the voice button to ensure that the control device is not in the second voice path before it starts to enter the first voice path.

[0174] It should be understood that the embodiments of the present application do not limit how the control device triggers voice pickup in the second voice path, and in some embodiments, it can be triggered by long pressing the voice button. For example, when the voice button is pressed, voice pickup is performed and voice data is sent to the display device, and when the voice button is released, voice pickup is stopped.

[0175] The following describes the interaction process between the control device and the display device.

[0176] Figure 8 The signaling interaction diagram of a speech recognition technology according to some embodiments is exemplified. This embodiment relates to the specific process of how a display device indicates the speech path of a control device. Figure 8 As shown, the method includes:

[0177] S301: If it is detected that the voice button of the control device is pressed for the first time, the control device sends first indication information to the display device.

[0178] It should be noted that if it is detected that the voice button of the control device is pressed for the first time, while sending the first indication information to the display device, the second voice channel can be used synchronously to collect the second voice data.

[0179] It should be noted that the embodiments of the present application do not restrict whether the second voice data collected when the voice button is pressed for the first time is sent to the display device. In some embodiments, after the voice button of the control device is pressed for the first time, the control device can directly send the second voice data picked up under the second voice path to the display device. In other embodiments, if the second indication information is not received before the voice button of the control device is lifted for the first time, the second voice data picked up under the second voice path is sent to the display device.

[0180] It should be understood that before the control device sends the first indication information to the display device, the display device needs to establish a Bluetooth connection with the control device. The embodiment of the present application does not limit how to establish the Bluetooth connection. For example, the display device can actively initiate a Bluetooth pairing request and search for an attached pairable Bluetooth device, thereby controlling the device Bluetooth connection.

[0181] S302: If a voice application is running in the foreground of the display device, the display device sends second indication information to the control device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, and the first voice channel is used to carry the indication information of the display device.

[0182] It should be understood that in the embodiment of the present application, the first voice channel is a software voice pickup channel, and the software on the display device sends an instruction message to the control device to turn on or off the voice pickup of the control device. After the control device enters the first voice channel, the voice pickup is no longer triggered based on the control button of the control device.

[0183] The embodiments of the present application do not limit how to determine the voice application running in the foreground of the display device. In some embodiments, the voice application running in the foreground of the display device can be determined by the identifier of the voice application recorded in the target flag of the display device.

[0184] In some embodiments, if the voice application is not running in the foreground of the display device, the second voice data sent by the control device in the second voice path is received.

[0185] S303: Control the device to pick up first voice data in the first voice channel.

[0186] In this step, after the control device receives the second indication information, the indication information of the display device can trigger voice pickup under the first voice channel.

[0187] It should be noted that the embodiments of the present application do not limit when the control device performs voice pickup in the first voice channel. In some embodiments, it can be after the voice button of the control device is pressed for the first time, after the voice button is lifted for the first time, or after the voice button is pressed for the second time.

[0188] It should be noted that the display device may discard the second voice data picked up by the control device in the second voice channel after instructing the control device to pick up voice in the first voice channel.

[0189] The embodiment of the present application does not limit how the display device triggers the voice pickup of the control device under the first voice channel. In some embodiments, after the user triggers the voice button in the software form through the voice application, the display device can send a third indication information to the control device, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice channel. Subsequently, the control device starts or stops picking up the first voice data under the instruction of the third indication information.

[0190] S304: The control device sends the first voice data picked up in the first voice path to the display device.

[0191] In this step, after the control device enters the first voice channel to pick up the first voice data, the first voice data picked up in the first voice channel can be sent to the display device. After receiving the first voice data sent by the control device, the display device sends the first voice data to the voice analysis engine, thereby completing the voice recognition of the first voice data.

[0192] It should be understood that the embodiments of the present application do not limit how the speech analysis engine recognizes speech data, and commonly used speech recognition methods can be collected.

[0193] Based on the above embodiments, a complete voice pickup process is provided below. Fig. 9 A flow chart of another voice pickup method according to some embodiments is exemplarily shown. Fig. 9 As shown, the method includes:

[0194] S401: The display device sends a Bluetooth pairing request to the control device.

[0195] S402: The control device sends successful connection feedback information to the display device.

[0196] S403: The control device sends application start indication information to the display device.

[0197] S404: The display device opens a voice application.

[0198] S405: The display device records the identifier of the voice application in the target flag.

[0199] S406: The control device detects that the voice button of the control device is pressed for the first time.

[0200] S407: The control device sends the second voice data picked up in the second voice path to the display device.

[0201] S408: The control device detects that the voice button of the control device is lifted for the first time.

[0202] S409: The control device sends first instruction information to the display device.

[0203] S410: The display device determines, according to the identifier of the voice application recorded in the target flag, that a voice application is running in the foreground of the display device.

[0204] S411: The display device sends second indication information to the control device.

[0205] S412: The display device picks up first voice data in the first voice channel.

[0206] S413: The control device sends the first voice data picked up in the first voice path to the display device.

[0207] S414: The display device discards the second voice data picked up by the control device in the second voice path.

[0208] The voice pickup method provided in the embodiment of the present application receives first indication information sent by a control device, the first indication information is used to indicate that the voice button of the control device is pressed for the first time; if a voice application is running in the foreground of the display device, a second indication information is sent to the control device, the second indication information is used to instruct the control device to perform voice pickup under a first voice path, and the first voice path is used to carry the indication information of the display device; and the first voice data picked up under the first voice path sent by the control device is received. Compared with the prior art, when a voice application is running in the foreground of the display device, the voice pickup can be controlled by the voice application on the display device, thereby avoiding the software and hardware triggering voice pickup at the same time and receiving invalid voice data. This improves the subsequent voice recognition efficiency.

[0209] Fig.10 The structure diagram of the display device according to some embodiments is exemplarily shown. The display device can be implemented by software, hardware or a combination of both to execute the voice pickup method in the above embodiment. Fig.10 As shown, the display device 500 includes: a display 501 and a controller 502 .

[0210] The controller 502 is a controller connected to the display 501, and the controller 502 is configured as follows:

[0211] receiving first indication information sent by the control device, where the first indication information is used to indicate that a voice button of the control device is pressed for the first time;

[0212] If a voice application is running in the foreground of the display device, second indication information is sent to the control device, where the second indication information is used to instruct the control device to pick up voice in the first voice channel, and the first voice channel is used to carry the indication information of the display device;

[0213] The first voice data picked up in the first voice path and sent by the receiving control device.

[0214] In some embodiments of the present application, the controller 502 is further configured to:

[0215] The third indication information is sent to the control device according to the control instruction input by the user, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

[0216] In some embodiments of the present application, the controller 502 is further configured to:

[0217] After the voice button of the control device is pressed for the first time, second voice data picked up in a second voice channel sent by the control device is received, and the second voice channel is used to carry indication information triggered by the voice button of the control device.

[0218] In some embodiments of the present application, the controller 502 is further configured to:

[0219] If a voice application is running in the foreground of the display device, the second voice data sent by the control device is discarded.

[0220] In some embodiments of the present application, the controller 502 is further configured to:

[0221] If the voice application is not running in the foreground of the display device, fourth indication information is sent to the control device, and the fourth indication information is used to instruct the control device to keep picking up voice in the second voice path.

[0222] The display device provided in the embodiment of the present application can execute the actions of the voice pickup method in the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0223] Fig.11 The schematic diagram of the structure of the control device according to some embodiments is exemplarily shown. The control device can be implemented by software, hardware or a combination of both to execute the voice pickup method in the above embodiment. Fig.11 As shown, the control device 600 includes: a voice collector 601 and a controller 602 .

[0224] The controller 602 is a controller connected to the voice collector 601, and the controller 602 is configured as follows:

[0225] If it is detected that the voice button of the control device is pressed for the first time, sending first indication information to the display device;

[0226] receiving second indication information sent by the display device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, and the first voice channel is used to carry the indication information of the display device;

[0227] The first voice data picked up in the first voice path is sent to the display device.

[0228] In some embodiments of the present application, the controller 602 is further configured to:

[0229] The third indication information sent by the display device is received, where the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

[0230] The first voice data is picked up in the first voice path according to the third indication information.

[0231] In some embodiments of the present application, the controller 602 is further configured to:

[0232] After the voice button of the control device is pressed for the first time, the second voice data picked up in the second voice path is sent to the display device, and the control device triggers voice pickup in the second voice path by the voice button of the control device.

[0233] In some embodiments of the present application, the controller 602 is further configured to:

[0234] If the second indication information is not received before the voice button of the control device is lifted for the first time, the second voice data picked up in the second voice path is sent to the display device.

[0235] The control device provided in the embodiment of the present application can execute the actions of the voice pickup method in the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0236] The embodiment of the present application also provides a program, which, when executed by a processor, is used to execute the voice pickup method provided in the above method embodiment.

[0237] The embodiment of the present application also provides a program product, such as a computer-readable storage medium, in which instructions are stored. When the program product is run on a computer, the computer executes the voice pickup method provided by the above method embodiment.

[0238] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that can be accessed by the computer or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0239] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display device, characterized in that: include: monitor; A controller connected to the display, the controller being configured to: Receiving first indication information sent by a control device, where the first indication information is used to indicate that a voice button of the control device is pressed for the first time; If a voice application is running in the foreground of the display device, second indication information is sent to the control device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, where the first voice channel is used to carry the indication information sent by the display device to the control device; receiving first voice data picked up in the first voice path and sent by the control device; If the voice application is not running in the foreground of the display device, a fourth indication message is sent to the control device, wherein the fourth indication message is used to instruct the control device to keep picking up voice under the second voice channel, and the second voice channel is used to carry the indication information triggered by the voice button of the control device.

2. The display device according to claim 1, characterized in that The controller is also configured to: The third indication information is sent to the control device according to the control instruction input by the user, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

3. The display device according to claim 1 or 2, characterized in that: The controller is also configured to: After the voice button of the control device is pressed for the first time, second voice data picked up in the second voice path and sent by the control device is received.

4. The display device according to claim 3, characterized in that The controller is also configured to: If a voice application is running in the foreground of the display device, the second voice data sent by the control device is discarded.

5. A voice pickup method, characterized in that: The method comprises: Receiving first indication information sent by a control device, where the first indication information is used to indicate that a voice button of the control device is pressed for the first time; If a voice application is running in the foreground of the display device, second indication information is sent to the control device, where the second indication information is used to instruct the control device to pick up voice in a first voice channel, where the first voice channel is used to carry the indication information sent by the display device to the control device; receiving first voice data picked up in the first voice path and sent by the control device; If the voice application is not running in the foreground of the display device, a fourth indication message is sent to the control device, wherein the fourth indication message is used to instruct the control device to keep picking up voice under the second voice channel, and the second voice channel is used to carry the indication information triggered by the voice button of the control device.

6. The method according to claim 5, characterized in that After sending the second indication information to the control device, the method further includes: The third indication information is sent to the control device according to the control instruction input by the user, and the third indication information is used to instruct the control device to start or stop picking up the first voice data under the first voice path.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: After the voice button of the control device is pressed for the first time, second voice data picked up in the second voice path and sent by the control device is received.

8. The method according to claim 7, characterized in that After receiving the second voice data picked up in the second voice path sent by the control device, the method further includes: If a voice application is running in the foreground of the display device, the second voice data sent by the control device is discarded.

Images