Remote control device, display device, and method of controlling intercom

Abstract

The application discloses a kind of remote control equipment, display equipment and the control method of interlude voice, remote control equipment includes: interlude voice receiving module is configured to receive the interlude voice of user input;With interlude voice receiving module connection voice processing module is configured to check interlude voice wake-up word;With voice processing module connection data transmission module is configured to receive the voice data sent by voice processing module and is connected with display equipment communication, and the working state of display equipment is acquired and according to working state control opens or closes the interlude voice mode of remote control equipment.The power consumption of the embodiment of the application is effectively reduced, and the use experience of user is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of remote control. More particularly, it relates to a remote control device, a display device and a method for controlling mid-field voice. BACKGROUND

[0002] With the development of artificial intelligence technology, the interaction mode is also changing. From simple interaction to the joint development of multiple interaction modes, the role of voice interaction is becoming more and more obvious. For example, in the application scenario of a display device, a user can input a voice instruction to a remote control device, the remote control device transmits the voice instruction to the display device, and the display device performs a corresponding subsequent operation in response to the voice instruction input by the user.

[0003] At present, when a user needs to perform voice interaction with a corresponding display device through a remote control device, the user needs to press a voice input button on the remote control device, then input a voice instruction to the remote control device, and then realize the near-field voice interaction between the remote control device and the display device. However, the operation of pressing the button in the near-field voice interaction mode is relatively cumbersome, which affects the user experience. To solve the foregoing problem, a real-time listening mode for user voice input can be used, but this will cause the remote control device to always be in a voice verification state, which makes the power consumption of the remote control device for realizing voice function large, and limits the application popularity of the remote control device. SUMMARY

[0004] To solve the problems set forth in the background, the embodiments of the present application provide a remote control device, a display device and a method for controlling mid-field voice, which effectively reduces the power consumption of the remote control device and improves the user experience.

[0005] In a first aspect, the present application provides a remote control device, comprising:

[0006] A mid-field voice receiving module configured to receive a mid-field voice input by a user;

[0007] A voice processing module connected to the mid-field voice receiving module and configured to verify a mid-field voice wake-up word;

[0008] A data transmission module connected to the voice processing module and configured to receive voice data sent by the voice processing module and communicate with a display device, and to obtain a working state of the display device and control the mid-field voice mode of the remote control device to be turned on or off according to the working state.

[0009] In a second aspect, the present application further provides a display device, comprising:

[0010] A display configured to display an interface;

[0011] a communicator configured to be communicatively connected with a remote control device;

[0012] a controller connected with the communicator and configured to send a mid-field voice control instruction to the remote control device through the communicator according to an operating state of the display device, so as to control to turn on or off a mid-field voice mode of the remote control device.

[0013] In a third aspect, the present application further provides a mid-field voice control method, comprising:

[0014] obtaining an operating state of a display device;

[0015] controlling to turn on or off a mid-field voice mode of a remote control device according to the operating state.

[0016] In a fourth aspect, the present application further provides a mid-field voice control method, comprising:

[0017] generating a mid-field voice control instruction according to an operating state of a display device;

[0018] sending the mid-field voice control instruction to a remote control device, so as to control to turn on or off a mid-field voice mode of the remote control device.

[0019] According to the above technical solution, the present application embodiment sets a remote control device, which comprises a mid-field voice receiving module configured to receive a mid-field voice input by a user; a voice processing module connected with the mid-field voice receiving module and configured to verify a mid-field voice wake-up word; and a data transmission module connected with the voice processing module and configured to obtain a voice and be communicatively connected with a display device, and obtain an operating state of the display device and control to turn on or off a mid-field voice mode of the remote control device according to the operating state. Thus, the present application embodiment can intelligently identify an operating state of a display device through a data transmission module, and realize state synchronization with the display device according to the identified operating state of the display device, adjust a standby mode of a remote control device, control to turn off a mid-field voice mode of the remote control device when the remote control device does not need to verify a mid-field voice wake-up word, so that the remote control device is in a low-power-consumption standby state for a longer time, thereby reducing system power consumption of the remote control device and improving user experience. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, for those skilled in the art, other drawings can also be obtained from these drawings without any creative labor.

[0021] Figure 1 Fig. 1 is a schematic diagram of an operating scenario between a display device and a remote control device according to an exemplary embodiment of the present application.

[0022] Figure 2 A configuration block diagram of a display device according to an exemplary embodiment of the present application is shown;

[0023] Figure 3 A structural schematic diagram of a remote control device according to an exemplary embodiment of the present application is shown;

[0024] Figure 4 A structural schematic diagram of a voice processing module according to an exemplary embodiment of the present application is shown;

[0025] Figure 5 A flow schematic diagram of a method for controlling intermission voice according to an exemplary embodiment of the present application is shown;

[0026] Figure 6 A structural schematic diagram of a power switch module according to an exemplary embodiment of the present application is shown;

[0027] Figure 7 A specific flow schematic diagram of a method for controlling intermission voice according to an exemplary embodiment of the present application is shown;

[0028] Figure 8 A two-end interaction logic schematic diagram of a remote control device and a display device according to an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0029] In order to make the purpose and implementation of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to clearly and completely describe the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only some of the embodiments of the present application, but not all of the embodiments.

[0030] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0031] The terms "first", "second", "third", etc. in the specification and claims and the above-mentioned drawings of the present application are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit the specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0032] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to all the components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0033] Figure 1 Fig. 1 shows a schematic diagram of an operating scenario between a display device and a remote control device according to an exemplary embodiment of the present application. As shown in Fig. 1, a user can operate a display device 200 through a smart device 300 or a remote control device 100. The display device provided by embodiments of the present application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1

[0034] In some embodiments, the remote control device 100 can be a remote controller, and the communication between the remote control device 100 and the display device 200 can include infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, to control the display device 200 through wireless or wired mode. The user can input user instructions through key input, voice input, control panel input, etc. on the remote control device 100, to control the display device 200. The remote control device 100 can receive the input operation instructions of the user, and the remote control device 100 converts the operation instructions into instructions that can be recognized and responded by the display device 200, to play the role of an intermediary between the user and the display device 200.

[0035] In some embodiments, the smart device 300, such as a mobile terminal, a tablet computer, a computer, a notebook computer, etc. can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200.

[0036] In some embodiments, the display device 200 can not receive instructions using the smart device or the control device described above, but can receive user control through touch or gesture, etc.

[0037] In some embodiments, the display device 200 can also be controlled in a manner other than the remote control device 100 and the smart device 300, for example, the user's voice instructions can be directly received by a voice instruction acquisition module configured inside the display device 200, or the user's voice instructions can be received through a voice control device arranged outside the display device 200.

[0038] In some embodiments, the display device 200 also communicates data with a server 400. The display device 200 can be connected through a local area network (LAN), a wireless local area network (WLAN), and other network communication connections. The server 400 can provide various contents and interactions to the display device 200. The server 400 can be a cluster, or multiple clusters, and can include one or more types of servers.

[0039] ​Figure 2 is a configuration block diagram of a display device according to an exemplary embodiment of the present application. As shown, the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a storage, a power supply, and a user interface. Figure 2

[0040] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an n-th interface for input / output.

[0041] The display 260 is configured to display an interface, including a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal originated from an output of the controller, and a component for displaying a video content, an image content, and a menu control interface, and a user control UI interface.

[0042] The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

[0043] The communicator 220 is a component configured to communicate with an external device or a server according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can be communicatively connected with the remote control device 100 or the server 400 through the communicator 220, i.e., to establish a sending and receiving of control signals and data signals.

[0044] The user interface can be configured to receive a control signal of the remote control device 100 (e.g., an infrared remote control device).

[0045] The detector 230 is configured to collect an external environment or a signal for external interaction. For example, the detector 230 includes a light receiver, a sensor configured to collect an ambient light intensity, or an image collector such as a camera configured to collect an external environment scene, a user attribute, or a user interaction gesture, or a sound collector such as a microphone configured to receive an external sound.

[0046] The external device interface 240 can include, but is not limited to, any one or more of a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, and the like. The external device interface 240 can also be a composite input / output interface formed by a plurality of the above interfaces. ​

[0047] The tuner and demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0048] In some embodiments, the controller 250 and the tuner and demodulator 210 can be located in different separate devices, i.e., the tuner and demodulator 210 can also be located in an external device of the main device in which the controller 250 is located, such as an external set-top box, etc.

[0049] The controller 250 controls the operation of the display device and responds to the user's operation by storing various software control programs in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user instruction for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user instruction.

[0050] In some embodiments, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first to n-th interface for input / output, a communication bus, etc.

[0051] The user can input a user instruction through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input instruction through the graphical user interface (GUI). Alternatively, the user can input a user instruction by inputting a specific sound or gesture, and the user input interface receives the user input instruction by recognizing the sound or gesture through a sensor.

[0052] The user interface is a medium interface for interaction and information exchange between an application or an operating system and a user, and it implements conversion between an internal form of information and a form that a user can accept. A commonly used form of the user interface is a graphical user interface (GUI), which is a user interface that displays information in a graphical manner. It can be an icon, a window, a control, etc. displayed on a display screen of an electronic device, and the control can include an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, etc.

[0053] With the rapid development of display devices, remote control devices are rapidly popularized. As a kind of general short-distance wireless control device, the remote control device is used in a large number of terminal devices. With the popularization of the use of the remote control device, its application is more and more widely used. How to better optimize the interaction between the remote control device and the user to facilitate the user to use, and how to improve the user's control experience are the current problems that need to be considered by the remote control device.

[0054] At present, part of the remote control device has a voice function. For example, when the user needs to interact with the display device, such as a television, through the remote control device, the user can press the voice input button on the remote control device, and input a voice instruction to the remote control device at the same time as pressing the voice input button. The remote control device and the display device are short-distance wireless communication connection. The remote control device receives the voice instruction and sends the voice instruction to the corresponding display device. The display device executes the operation corresponding to the voice instruction to complete the near-field voice interaction between the remote control device and the display device.

[0055] In addition, unlike the near-field voice mode, the middle-field voice interaction mode does not require the user to press any key on the remote control device before inputting the voice instruction. The remote control device can be set to recognize a preset middle-field voice wake-up word. When the user inputs the preset middle-field voice wake-up word to the remote control device, the remote control device recognizes the preset middle-field voice wake-up word and starts the middle-field voice function. Similarly, the remote control device and the display device are short-distance wireless communication connection. The remote control device can receive the voice instruction issued by the user and send the voice instruction to the corresponding display device. The display device executes the operation corresponding to the voice instruction to complete the middle-field voice interaction between the remote control device and the display device, so that the user's voice interaction process is more convenient.

[0056] In addition, in the near-field voice mode, the user inputs the voice by pressing the button on the remote control device, and the user is close to the remote control device. In the middle-field voice mode, the user can input the voice without pressing the remote control device, and the remote control device can be located in the area between the user and the display device. In addition, the display device, such as a television, can also realize far-field sound pickup, that is, the display device is provided with a microphone, so that the display device directly listens to the far-field voice input by the user and receives the subsequent far-field voice instruction after judging that an effective wake-up word is heard. The voice input distance corresponding to the middle-field voice mode is defined relative to the voice input distance corresponding to the far-field voice mode. However, in order to realize the foregoing far-field sound pickup process, the display device needs to be provided with a plurality of microphones for far-field sound pickup in the area of the front appearance panel of the display device, such as but not limited to the lower area, which affects the appearance of the display device and affects the user's experience.

[0057] It should be noted that the concept of the mid-field voice control is proposed based on the existing near-field voice control and far-field voice control, and refers to a scenario in which a user does not need to manually press a key of a remote control device, but only needs to speak at a distance from the remote control device to realize voice control.

[0058] The embodiment of the present application realizes the mid-field voice interaction with the user by using the mid-field voice receiving module and the voice processing module at the remote control device end, without pressing any key on the remote control device before the user inputs the voice instruction, and without setting a microphone affecting the appearance of the display device at the display device end, so that the voice interaction with the display device can be realized through the remote control device.

[0059] However, when the remote control device is in the mid-field voice mode, in order to realize the verification of the mid-field voice wake-up word, the remote control device needs to be in the working state all the time, resulting in that the power consumption of the remote control device for realizing the mid-field voice function is large, and the application popularity of the remote control device is limited.

[0060] In order to solve the foregoing technical problems, some embodiments of the present application provide a remote control device. Figure 3 A structure diagram of a remote control device according to an exemplary embodiment of the present application is shown in FIG. 1. Figure 3 As shown in FIG. 1, the remote control device includes a near-field voice receiving module 510, also referred to as a first voice receiving module, configured to receive the near-field voice input by the user, i.e., a first voice, the user inputs the near-field voice by pressing a key on the remote control device; a mid-field voice receiving module 520, also referred to as a second voice receiving module, configured to receive the mid-field voice input by the user, i.e., a second voice, the user does not need to manually press the key, but only needs to speak at a distance from the remote control device; a voice processing module 530, electrically connected with the mid-field voice receiving module 520, configured to verify the mid-field voice wake-up word; and a data transmission module 540, electrically connected with the near-field voice receiving module 510 and the voice processing module 530, respectively, configured to load a voice model and a voice driving firmware to the voice processing module 530, and receive the voice data sent by the voice processing module and the near-field voice receiving module and communicate with a display device.

[0061] In addition, the data transmission module 540 is a functional module for transmitting data information through Bluetooth, and the data transmission module 540 packs the operation key data and sends it to the display device through the HID (Human Interface Device, human-computer interaction device) data channel. The data transmission module 540 can send data to a data receiving module through a certain transmission medium, such as a wired or wireless manner, and the data transmission module 540 needs to have a data transmission or transmission function, but the data transmission module 540 is not limited to a certain specific device, and can be a functional module or a logical data channel.

[0062] In the embodiment of the present application, the data transmission module 540 is preferably a Bluetooth module. In addition, the data transmission module 540 can also be an infrared module. In some embodiments, the remote control device has a mouse, voice, key and infrared functions, and the key control mode of the remote control device includes two working modes of Bluetooth and infrared, one mode can be used alone, or the infrared working mode can be automatically switched when the Bluetooth mode cannot be connected. The display device can receive the data packet sent by the remote control device in real time through the Bluetooth module or the infrared module, and perform data filtering, reorganization and transformation on the data contained in the received data packet according to the indication of the user operation.

[0063] In some embodiments, the remote control device has three voice receiving modules, such as microphone design, the near-field voice receiving module 510 is used to realize the near-field voice function of the remote control device, and the corresponding voice signal output end is connected to the data transmission module 540 in the remote control device, that is, the Bluetooth SOC (System On Chip, System On Chip), the near-field voice function of the remote control device is realized by controlling the remote control device through the data transmission module 540.

[0064] The corresponding voice processing process of the near-field voice function is: after the user presses the key corresponding to the near-field voice on the remote control device, the near-field voice receiving module 510, such as the first microphone, receives the voice instruction input by the user and transmits it to the data transmission module 540, the data transmission module 540 compresses the voice instruction, and sends the compressed voice instruction to the display device through the short-distance wireless communication connection with the display device, the display device decodes and pre-processes the voice instruction, thereby realizing the near-field voice control of the display device by the remote control device.

[0065] The first and second middle-field voice receiving modules, such as the second and third microphones, are used to realize the middle-field voice function of the remote control device, and the corresponding voice signal output end is connected to the voice processing module 530 in the remote control device, that is, the DSP (Digital Signal Processing, Digital Signal Processing) chip, the middle-field voice function of the remote control device is realized by controlling the remote control device through the voice processing module 530.

[0066] The voice processing procedure corresponding to the mid-field voice is as follows: the first mid-field voice receiving module and the second mid-field voice receiving module listen to the voice input by the user in real time and transmit the voice to the voice processing module 530, the voice processing module 530 is configured to determine whether the voice input by the user received contains a valid mid-field voice wake-up word. If the valid mid-field voice wake-up word is contained, the voice processing module 530 transmits the voice instruction input by the user after being woken up to the data transmission module 540, the data transmission module 540 compresses the voice instruction, and then transmits the compressed voice instruction to the display device by using the short-range wireless communication connection with the display device, the display device decodes and performs preset processing on the voice instruction, so that the mid-field voice control of the display device by the remote control device is realized. In addition, the voice processing module 530 can perform noise reduction processing on the received voice data.

[0067] It should be noted that in the present application, two microphones work in the mid-field voice mode, but this is not limited thereto. As long as the voice input by the user can be listened to in real time, one or more than two microphones can be used. Meanwhile, the sound pickup device is not limited to a microphone.

[0068] Figure 4 A structure diagram of a voice processing module according to an exemplary embodiment of the present application is shown. In combination with Figure 3 and Figure 4 The user can control whether the VDD18 port of the voice processing module 530 is powered on or not by operating the mechanical control structure, i.e., the physical switch. When the VDD18 port of the voice processing module 530 is powered on, the voice processing module 530 can work normally, and the mid-field voice receiving module 520 can be powered on and started. In this case, the remote control device is in the mid-field voice mode. When the VDD18 port of the voice processing module 530 cannot be powered on, the voice processing module 530 cannot work, and the mid-field voice receiving module 520 can be powered off and stopped. In this case, the remote control device is in the near-field voice mode in which the voice input is controlled by the key. The voice processing module 530, i.e., the voice wake-up chip, i.e., the DSP, is mainly responsible for the collection of mid-field voice audio data, the noise reduction processing of data, the recognition of a mid-field voice wake-up word or an activation word, and the output of voice to the data transmission module 540. When it is necessary to turn off the mid-field voice function of the remote control device, the voice processing module 530 and the mid-field voice receiving module 520 are controlled to be powered off and cannot work. Compared with the case where only the voice processing module 530 is controlled to be powered off or only the mid-field voice receiving module 520 is controlled to be powered off, the power consumption of the remote control device when the mid-field voice function is turned off can be reduced to the greatest extent.

[0069] In some embodiments, the data transmission module 540, i.e., the Bluetooth SOC, is responsible for loading different voice models and corresponding voice-driven firmware, and sending them to the voice processing module 530 to trigger the voice processing module 530 to perform mid-field voice wake-up word recognition. The data transmission module 540 communicates data with the voice processing module 530 through SPI (Serial Peripheral Interface), and the data transmission module 540 chip obtains voice through SPI and communicates infrared and / or Bluetooth data with the display device, such as infrared keys, Bluetooth keys, etc.

[0070] Figure 5 A flowchart of a mid-field voice control method according to an exemplary embodiment of the present application is shown. In some embodiments, the data transmission module 540 in the remote control device performs the following steps shown in Figure 5

[0071] S601, obtaining the working state of the display device.

[0072] S602, controlling to turn on or off the mid-field voice mode of the remote control device according to the working state.

[0073] In some embodiments, the working state of the display device can be intelligently recognized by the data transmission module 540, and the state synchronization with the display device can be realized according to the recognized working state of the display device, and the standby mode of the remote control device is adjusted, so that the remote control device is controlled to turn off the mid-field voice mode when it is not necessary to perform mid-field voice wake-up word verification, so that the remote control device is in a low-power standby state for more time, thereby reducing the system power consumption of the remote control device and improving the user's use experience.

[0074] In some embodiments, as shown in Figure 3 , the remote control device further comprises a power switch module 550, which is in communication connection with the data transmission module 540 and the voice processing module 530, respectively.

[0075] Figure 6 A structural diagram of a power switch module according to an exemplary embodiment of the present application is shown. In combination with Figure 3 and Figure 6 ​Corresponding to the opening of the middle field voice function, the switch controller SWT1 outputs a low level switch control signal to the control end of the first switch V4 in the power switch module 550 through the switch control end MS, and the first switch V4 is for example but not limited to a transistor. The control end of the first switch V4 is the gate of the transistor, thereby controlling the first switch V4 to be turned on. The first power signal VCC1V8 connected to the left side supplies power to the right side VDD18 power port. The VDD18 power port is configured to supply power to the voice processing module 530, so that the voice processing module 530 is powered on and can control the middle field voice receiving module 520 to be powered on. Referring to the above embodiment, the middle field voice function of the remote control device can be realized.

[0076] When the user needs to turn off the middle field voice function, the physical switch on the remote control device can be operated to control the switch controller SWT1, so that the switch controller SWT1 outputs a high level switch control signal to the control end of the first switch V4 in the power switch module 550 through the switch control end MS, thereby controlling the first switch V4 to be turned off. The first power signal VCC1V8 connected to the left side cannot supply power to the right side VDD18 power port. The voice processing module 530 is powered off and cannot work. The middle field voice receiving module 520 can be powered off. Referring to the above embodiment, the middle field voice function of the remote control device is turned off, the near field voice function can be turned on, the security during use of the remote control device can be improved, the user's personal privacy can be ensured not to be leaked, and the user's use experience can be optimized.

[0077] As shown in Figure 6 The power switch module 550 includes a voltage stabilizing module N14. The software control input end P3.0 of the voltage stabilizing module N14 is connected with the software control output end of the data transmission module 540. When the data transmission module 540 needs to control the remote control device to turn on the middle field voice function, the software control signal output to the software control input end P3.0 of the voltage stabilizing module N14 is adjusted, so that the voltage stabilizing module N14 outputs the first power signal VCC1V8, thereby making the left side of the first switch V4 powered on. When the data transmission module 540 needs to control the remote control device to turn off the middle field voice function, the software control signal output to the software control input end P3.0 of the voltage stabilizing module N14 is adjusted, so that the voltage stabilizing module N14 cannot output the first power signal VCC1V8, thereby making the left side of the first switch V4 unable to be powered on.

[0078] In some embodiments, the data transmission module 540 is configured to control the middle field voice mode of the remote control device to be turned on or turned off, specifically including: controlling the impedance state of the communication interface between the data transmission module 540 and the voice processing module 530, and controlling whether the power switch module 550 supplies power to the voice processing module 530 and the middle field voice receiving module 520, to control the middle field voice mode of the remote control device to be turned on or turned off.

[0079] When the data transmission module 540 determines that the mid-field voice mode of the remote controller needs to be controlled to be closed according to the working state of the display device, the data transmission module 540 can control the impedance state of the SPI interface through which it communicates with the voice processing module 530 to be a high-impedance state, that is, control the data transmission module 540 and the voice processing module 530 to no longer be in communication connection. In addition, in combination with Figure 4 and Figure 6 , the data transmission module 540 adjusts the high and low levels of the P3.0 port output signal, for example, controls the P3.0 port to output a low-level signal, thereby controlling the N14 chip to close the power output, that is, the VCC1V8 port has no power output, so that the VDD18 port has no power output, the voice processing module 530 is powered off, the mid-field voice receiving module 520 is powered off, the mid-field voice function of the remote control device is closed, and the remote control device is in a low-power standby state.

[0080] When the data transmission module 540 determines that the mid-field voice mode of the remote controller needs to be controlled to be opened according to the working state of the display device, the data transmission module 540 can control the impedance state of the SPI interface through which it communicates with the voice processing module 530 to be a low-impedance state, that is, control the data transmission module 540 and the voice processing module 530 to be in normal communication connection. In addition, in combination with Figure 4 and Figure 6 , the data transmission module 540 adjusts the high and low levels of the P3.0 port output signal, for example, controls the P3.0 port to output a low-high level signal, thereby controlling the N14 chip to open the power output, that is, the VCC1V8 port has power output, so that the VDD18 port has power output, the voice processing module 530 is powered on, the mid-field voice receiving module 520 is powered on, and the mid-field voice function of the remote control device is opened.

[0081] Figure 7 A specific flowchart of a mid-field voice control method according to an exemplary embodiment of the application is shown. In some embodiments, the data transmission module 540 in the remote control device performs the following steps shown in Figure 7 .

[0082] S701, acquire the connection state of the remote control device and the display device.

[0083] In some embodiments, the data transmission module 540 is configured to acquire the working state of the display device and control the mid-field voice mode of the remote control device to be opened or closed according to the working state, specifically including: the data transmission module 540 can acquire the wireless connection state of the remote control device and the display device to determine whether the remote control device and the display device are connected or disconnected.

[0084] S702, determine whether the remote control device and the display device are connected; if yes, perform S703; if no, perform S704.

[0085] In some embodiments, the data transmission module 540 is configured to control to turn off the intermission voice mode of the remote control device based on that the remote control device is disconnected with the display device. Based on that the remote control device is connected with the display device, the data transmission module 540 acquires the switch state of the intermission voice mode of the display device.

[0086] It should be noted that, referring to the foregoing embodiments, the user can control whether the voice processing module 530 and the intermission voice receiving module 520 can be powered on or not by operating the physical switch on the remote control device, to realize the hardware switch control of the intermission voice function of the remote control device. In addition, the data transmission module 540 can also adjust the high and low levels of the output signal of the P3.0 port according to the working state of the display device, to realize the software switch control of the intermission voice function. When it is needed to turn on the intermission voice function of the remote control device, both the hardware switch and the software switch need to be turned on, and when either of the hardware switch and the software switch is turned off, the intermission voice function of the remote control device is turned off. Thus, based on that the remote control device is connected with the display device, before the data transmission module 540 acquires the switch state of the intermission voice mode of the display device, the remote control device can inform the display device end of the hardware switch state of the intermission voice function of the remote control device by means of instructions. Based on that the hardware switch of the remote control device is in the state of turning on the intermission voice function, the data transmission module 540 acquires the switch state of the intermission voice mode of the display device, and then performs the control process described in the following embodiments; based on that the hardware switch of the remote control device is in the state of turning off the intermission voice function, the data transmission module 540 no longer acquires the switch state of the intermission voice mode of the display device, and at this time, no matter how the display device end performs the software switch control of the intermission voice, the remote control device is in the state of turning off the intermission voice function.

[0087] S703, acquire the switch state of the intermission voice mode of the display device.

[0088] In some embodiments, when the data transmission module 540 judges that the display device and the remote control device are in the normal connection state, the data transmission module 540 continues to acquire the switch state of the intermission voice mode of the display device.

[0089] S704, control to turn off the intermission voice mode of the remote control device.

[0090] In some embodiments, the data transmission module 540 identifies that the Bluetooth connection between the remote control device and the display device is in a disconnected state, the data transmission module 540 can determine that the display device is in a standby state or in a power-off state, the data transmission module 540 can set the SPI interface for communication with the voice processing module 530 to a high-impedance state, that is, control the data transmission module 540 and the voice processing module 530 are no longer in communication connection, referring to the above embodiment, the data transmission module 540 adjusts the level of the P3.0 port output signal to control the VDD18 port to have no power output, the voice processing module 530 is powered off, the mid-field voice function of the remote control device is closed, and the remote control device is in a low-power standby state.

[0091] Therefore, by intelligently identifying the working state of the display device through the data transmission module 540, and realizing state synchronization with the display device according to the identified working state of the display device, when the display device is in standby or power-off state, the remote control device is adjusted to enter a low-power standby mode, so that the remote control device is in a low-power standby state for more time without needing to perform mid-field voice wake-up word verification, thereby reducing the system power consumption of the remote control device and improving the user's use experience.

[0092] S705, determine whether the display device is turned on the mid-field voice mode; if yes, execute S706; if no, execute S704.

[0093] In some embodiments, after the data transmission module 540 is configured to obtain the connection state of the remote control device and the display device, specifically includes: based on the connection between the remote control device and the display device, obtaining the on-off state of the mid-field voice mode of the display device; based on the display device closing the mid-field voice mode, controlling to close the mid-field voice mode of the remote control device. Based on the display device turning on the mid-field voice mode, obtaining the voice service state of the display device.

[0094] In some embodiments, when the data transmission module 540 determines that the display device closes the mid-field voice mode, the data transmission module 540 can set the SPI interface for communication with the voice processing module 530 to a high-impedance state, that is, control the data transmission module 540 and the voice processing module 530 are no longer in communication connection, referring to the above embodiment, the data transmission module 540 adjusts the level of the P3.0 port output signal to control the VDD18 port to have no power output, the voice processing module 530 is powered off, the mid-field voice function of the remote control device is closed, and the remote control device is in a low-power standby state.

[0095] Thus, the working state of the display device is intelligently identified by the data transmission module 540, and state synchronization with the display device is realized according to the identified working state of the display device. When the display device is closed in the inter-field voice mode, the remote control device is adjusted to enter the low-power standby mode, so that the remote control device is in the low-power standby state for more time without inter-field voice wake-up word verification, thereby reducing the system power consumption of the remote control device and improving the user experience. It should be noted that the user can select to turn on the inter-field voice function of the display device or turn off the inter-field voice function of the display device, for example, by controlling the operation interface of the display device.

[0096] S706, obtaining a voice service state of the display device.

[0097] In some embodiments, after the data transmission module 540 is configured to obtain the on-off state of the inter-field voice mode of the display device, specifically comprising: based on the display device turning on the inter-field voice mode, obtaining the voice service state of the display device; based on the voice service corresponding to the display device being a first voice service, controlling to turn on the inter-field voice mode of the remote control device, the first voice service supporting the inter-field voice function; based on the voice service corresponding to the display device being a second voice service, controlling to turn off the inter-field voice mode of the remote control device, the second voice service not supporting the inter-field voice function.

[0098] In some embodiments, the display device sends different instructions to the remote control device according to its voice service state, so that the data transmission module 540 in the remote control device can obtain the voice service state of the display device.

[0099] S707, based on the voice service corresponding to the display device being a first voice service, controlling to turn on the inter-field voice mode of the remote control device.

[0100] The data transmission module 540 judges that the voice service corresponding to the display device is a first voice service, and the data transmission module 540 can set the SPI interface for communication with the voice processing module 530 to a low resistance state, that is, control the normal communication connection between the data transmission module 540 and the voice processing module 530. Referring to the above embodiment, the data transmission module 540 adjusts the level of the P3.0 port output signal to control the VDD18 port to have a power output, and the voice processing module 530 is powered on, and the inter-field voice function of the remote control device is turned on.

[0101] In some embodiments, the voice service corresponding to the display device is a first voice service, specifically including any of the following cases: the display device is in an Alexa voice mode or a Vidaa voice mode; the Alexa voice mode and the Vidaa voice mode in the display device are switched between each other; the display device is switched from a Google voice mode to an Alexa voice mode or a Vidaa voice mode.

[0102] To clearly introduce the subsequent scenarios of opening and closing the middle field voice function of the remote control device, the voice service corresponding to the display device is introduced here, which includes but is not limited to Alexa voice service, Vidaa voice service and Google voice service. The Alexa voice service is a voice service used by Amazon, the Vidaa voice service is a voice service used by Hisense, and the Google voice service is a voice service used by Google. The Alexa voice service and the Vidaa voice service support the middle field voice function, and the Google voice service does not support the middle field voice function.

[0103] In some embodiments, the scenario of needing to open the middle field voice function of the remote control device, i.e., the middle field voice check function of the remote control device, includes but is not limited to the following:

[0104] For example, when the voice service corresponding to the display device is the Alexa voice service or the Vidaa voice service, or when the Alexa voice mode and the Vidaa voice mode in the display device are switched to each other, the display device sends the current voice model to the remote control device. The data transmission module 540 of the remote control device controls the voice processing module 530 to be powered on through P3.0, and sets the SPI interface for communication with the voice processing module 530 to a low resistance state. The remote control device opens the middle field voice function, i.e., the middle field voice check function.

[0105] For example, when the voice service corresponding to the display device is switched from the Google voice service to the Alexa voice service or the Vidaa voice service, the display device sends the current voice model to the remote control device. The data transmission module 540 of the remote control device controls the voice processing module 530 to be powered on through P3.0, and sets the SPI interface for communication with the voice processing module 530 to a low resistance state. The remote control device opens the middle field voice function, i.e., the middle field voice check function.

[0106] S708, based on the voice service corresponding to the display device being a second voice service.

[0107] In some embodiments, based on the voice service corresponding to the display device being a second voice service, the middle field voice mode of the remote control device is controlled to be closed.

[0108] In some embodiments, the voice service corresponding to the display device is a second voice service, which specifically includes any of the following cases: the display device is in a Google voice mode; the display device is switched from an Alexa voice mode or a Vidaa voice mode to a Google voice mode; the Alexa voice mode and / or the Vidaa voice mode of the display device is disabled.

[0109] In some embodiments, the scenario that requires the mid-field voice function of the remote control device to be closed, i.e., the mid-field voice verification function of the remote control device is closed, for example but not limited to: one case is, for example, when the display device judges that the Alexa voice service or the Vidaa voice service is invalid, the display device sends a mid-field voice function closing instruction to the remote control device, and after the remote control device receives the mid-field voice closing instruction, referring to the above-mentioned embodiments, the P3.0 port of the data transmission module 540 is used to power off the voice processing module 530, and the data transmission module 540 sets the SPI interface for communication with the voice processing module 530 to a high-impedance state, thereby making the smart remote control enter a low-power standby state.

[0110] Another case is, for example, when the Alexa voice service or the Vidaa voice service is switched to the Google voice service, or when the display device is in the Google voice mode, since the Google voice service does not support the mid-field voice function, the display device sends a mid-field voice function closing instruction to the remote control device, and after the remote control device receives the mid-field voice closing instruction, referring to the above-mentioned embodiments, the P3.0 port of the data transmission module 540 is used to power off the voice processing module 530, and the data transmission module 540 sets the SPI interface for communication with the voice processing module 530 to a high-impedance state, thereby making the smart remote control enter a low-power standby state.

[0111] Therefore, by intelligently identifying the working state of the display device through the data transmission module 540, and synchronizing with the state of the display device according to the identified working state of the display device, when the corresponding voice service state of the display device does not require the remote control device to open the mid-field voice function, the remote control device is adjusted to enter a low-power standby mode, so that the remote control device spends more time in a low-power standby state when it does not need to perform mid-field voice wake-up word verification, thereby reducing the system power consumption of the remote control device and improving the user's experience.

[0112] In some embodiments, the display device sending an opening or closing mid-field voice function instruction to the remote control device has a set timing requirement. The display device sends an opening mid-field voice function instruction to the remote control device, for example but not limited to, sending the opening mid-field voice function instruction 10 times in succession, and the interval time for each time sending the opening mid-field voice function instruction is 1 second; the display device sends a closing mid-field voice function instruction to the remote control device, for example but not limited to, sending the closing mid-field voice function instruction 10 times in succession, and the interval time for each time sending the closing mid-field voice function instruction is 1 second. Therefore, by sending the opening or closing mid-field voice function instruction multiple times, it can effectively prevent external environment from interfering with the sending process of the mid-field voice function instruction, prevent the loss of instruction data, and ensure the effectiveness of the mid-field voice function switch.

[0113] In some embodiments, the display device and the remote control device can send heartbeat packets between each other, for example, but not limited to, the display device sends a heartbeat packet to the remote control device every 5 minutes, so that the remote control device can learn the working status of the display device, changes in voice services of the display device, and the like, and then adjust the working status of the remote control device.

[0114] Corresponding to the data transmission module 540 in the remote control device shown in the above embodiments, the controller in the display device is configured to perform: sending a mid-field voice control instruction to the remote control device through the communicator according to the working status of the display device, to control turning on or off the mid-field voice mode of the remote control device.

[0115] In some embodiments, the controller is configured to send a mid-field voice control instruction to the remote control device through the communicator according to the working status of the display device, to control turning on or off the mid-field voice mode of the remote control device, specifically including: based on the remote control device being connected with the display device, adjusting the sent mid-field voice control instruction according to the on-off state of the mid-field voice mode of the display device, to control turning on or off the mid-field voice mode of the remote control device; based on the display device turning off the mid-field voice mode, adjusting the sent mid-field voice control instruction to control turning off the mid-field voice mode of the remote control device.

[0116] In some embodiments, after the controller is configured to adjust the sent mid-field voice control instruction according to the on-off state of the mid-field voice mode of the display device, specifically including: based on the display device turning on the mid-field voice mode, adjusting the sent mid-field voice control instruction according to the voice service state of the display device, to control turning on or off the mid-field voice mode of the remote control device; based on the corresponding voice service of the display device being a first voice service, adjusting the sent mid-field voice control instruction to control turning on the mid-field voice mode of the remote control device; based on the corresponding voice service of the display device being a second voice service, adjusting the sent mid-field voice control instruction to control turning off the mid-field voice mode of the remote control device.

[0117] In some embodiments, the corresponding voice service of the display device is the first voice service, specifically including any of the following cases: the display device is in an Alexa voice mode or a Vidaa voice mode; the Alexa voice mode and the Vidaa voice mode in the display device are switched with each other; the display device is switched from a Google voice mode to the Alexa voice mode or the Vidaa voice mode; the corresponding voice service of the display device is the second voice service, specifically including any of the following cases: the display device is in the Google voice mode; the display device is switched from the Alexa voice mode or the Vidaa voice mode to the Google voice mode; the Alexa voice mode and / or the Vidaa voice mode of the display device is disabled.

[0118] Figure 8Fig. 1 shows a schematic diagram of a two-end interaction logic of a remote control device and a display device according to an exemplary embodiment of the present application. As shown in Fig. 1, the two-end interaction logic of the remote control device and the display device comprises the following steps: Figure 8

[0119] The display device generates a mid-field voice control instruction according to its own working state.

[0120] The display device sends the mid-field voice control instruction to the remote control device.

[0121] The remote control device turns on or off the mid-field voice mode of the remote control device according to the mid-field voice control instruction.

[0122] Thus, the working state of the display device is intelligently recognized by the data transmission module 540, and the state synchronization with the display device is realized according to the recognized working state of the display device. When it is determined that the mid-field voice mode needs to be turned off according to the working state of the display device, the remote control device is adjusted to enter the low-power standby mode, so that the remote control device is in the low-power standby state for more time when it is not necessary to perform the mid-field voice wake-up word verification, thereby reducing the system power consumption of the remote control device and improving the user experience.

[0123] According to the remote control device provided in the above embodiment, the present application further provides a mid-field voice control method. The execution subject of the mid-field voice control method includes but is not limited to the remote control device. The specific implementation of the mid-field voice control method can refer to the description of the remote control device in the above embodiment, especially the embodiment shown in Fig. 1, which will not be repeated here. Figure 5

[0124] According to the display device provided in the above embodiment, the present application further provides a mid-field voice control method. The execution subject of the mid-field voice control method includes but is not limited to the display device. The specific implementation of the mid-field voice control method can refer to the description of the display device in the above embodiment, which will not be repeated here.

[0125] It should be noted that the above embodiment only exemplarily describes the corresponding relationship between the voice service of the display device and the switch of the mid-field voice function of the remote control device, and the specific voice service corresponding to the display device and the corresponding relationship between the voice service and the switch of the mid-field voice function of the remote control device are not specifically limited, and can be set according to actual needs.

[0126] ​​In specific implementation, the present application further provides a computer storage medium, wherein the computer storage medium can store a program, and the program can include part or all steps in each embodiment of the method provided by the embodiments of the present application when executed. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM) or a random access memory (RAM) and the like.

[0127] Those skilled in the art can clearly understand that the technologies in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disc, an optical disc and the like, and includes a plurality of instructions to make a computer device (which can be a personal computer, a server or a network device and the like) execute the method of each embodiment or some parts of the embodiments of the present application.

[0128] It should be noted that the technical solutions described in some embodiments of the present application are applicable to all Bluetooth remote control technical fields with local wake-up function, and are not limited to the application scenarios of the remote control device remotely controlling the display device. In addition, the embodiments of the present application do not limit the specific type of the display device. In addition, the same and similar parts in each embodiment of the present application can be referred to, and the related content will not be described again. Moreover, the present application does not list all possible combination ways, and any combination of technical features in each embodiment of the present application also belongs to the protection scope of the present application.

[0129] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0130] In order to facilitate explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A remote control device, characterized in that, include: The near-field voice receiving module is configured to receive near-field voice input by the user and to acquire the user's near-field voice when a button on the remote control device is pressed. The halftime voice receiving module is configured to receive the user's input halftime voice, and when the halftime voice wake-up word is detected, it acquires the user's halftime voice. A voice processing module, which is connected to the midfield voice receiving module, is configured to verify the midfield voice wake-up word and determine whether the received user input voice contains a valid midfield voice wake-up word. A data transmission module, connected to the voice processing module and the near-field voice receiving module, is configured to receive voice data sent by the voice processing module or the near-field voice receiving module and communicate with the display device, as well as acquire the working status of the display device and control the activation or deactivation of the mid-field voice mode of the remote control device based on the working status; the data transmission module identifies the working status of the display device and synchronizes with the status of the display device based on the identified working status to adjust the standby mode of the remote control device, allowing the remote control device to control the deactivation of the mid-field voice mode when mid-field voice wake-up word verification is not required.

2. The remote control device according to claim 1, characterized in that, The data transmission module is configured to acquire the operating status of the display device and control the activation or deactivation of the remote control device's mid-field voice mode based on the operating status, specifically including: Obtain the connection status between the remote control device and the display device; Based on the disconnection between the remote control device and the display device, the mid-field voice mode of the remote control device is turned off.

3. The remote control device according to claim 2, characterized in that, The data transmission module is configured to acquire the connection status between the remote control device and the display device, specifically including: Based on the connection between the remote control device and the display device, the on / off status of the mid-field voice mode of the display device is obtained; Based on the display device disabling the mid-field voice mode, the mid-field voice mode of the remote control device is also disabled.

4. The remote control device according to claim 3, characterized in that, After the data transmission module is configured to acquire the on / off state of the mid-field voice mode of the display device, it specifically includes: Based on the display device enabling the mid-field voice mode, obtain the voice service status of the display device; Based on the voice service corresponding to the display device being the first voice service, the remote control device is controlled to activate the mid-field voice mode; wherein, the first voice service supports mid-field voice function; Based on the fact that the voice service corresponding to the display device is the second voice service, the midfield voice mode of the remote control device is turned off; wherein, the second voice service does not support the midfield voice function.

5. The remote control device according to any one of claims 1-4, characterized in that, The system further includes a power switch module, which is communicatively connected to both the data transmission module and the voice processing module. The data transmission module is configured to control the activation or deactivation of the remote control device's mid-field voice mode, specifically including: Control the impedance state of the communication interface between the data transmission module and the voice processing module, and control whether the power switch module supplies power to the voice processing module, so as to control the opening or closing of the mid-field voice mode of the remote control device; The power switch module includes a voltage regulator module, a software control input terminal of the voltage regulator module, and a software control output terminal of the data transmission module. When the data transmission module needs to control the remote control device to enable the mid-field voice function, it adjusts the software control signal output to the software control input terminal of the voltage regulator module to make the voltage regulator module output a first power signal, thereby energizing the left side of the first switch. When the data transmission module needs to control the remote control device to disable the mid-field voice function, it adjusts the software control signal output to the software control input terminal of the voltage regulator module to prevent the voltage regulator module from outputting the first power signal, thereby preventing the left side of the first switch from receiving power.

6. A display device, characterized in that, include: The monitor is configured as a display interface; A communicator is configured to communicate with a remote control device; the remote control device includes the remote control device according to any one of claims 1-5. A controller, connected to the communicator, is configured to send a mid-field voice control command to the remote control device via the communicator according to the operating status of the display device, so as to control the activation or deactivation of the mid-field voice mode of the remote control device.

7. The display device according to claim 6, characterized in that, The controller is configured to send a mid-field voice control command to the remote control device via the communicator according to the operating status of the display device, so as to control the activation or deactivation of the mid-field voice mode of the remote control device, specifically including: Based on the connection between the remote control device and the display device, the sent mid-field voice control command is adjusted according to the on / off state of the mid-field voice mode of the display device, so as to control the opening or closing of the mid-field voice mode of the remote control device; Based on the fact that the display device has turned off the midfield voice mode, the midfield voice control command is sent to control the remote control device to turn off the midfield voice mode.

8. The display device according to claim 7, characterized in that, After the controller is configured to adjust the sent mid-field voice control command according to the on / off state of the mid-field voice mode of the display device, it specifically includes: Based on the display device enabling the midfield voice mode, the midfield voice control command sent is adjusted according to the voice service status of the display device to control the activation or deactivation of the midfield voice mode of the remote control device. Based on the fact that the voice service corresponding to the display device is the first voice service, the midfield voice control command is sent to control the activation of the midfield voice mode of the remote control device; Based on the fact that the voice service corresponding to the display device is the second voice service, the midfield voice control command is sent to control the midfield voice mode of the remote control device to be turned off.

9. A method for controlling voice commands during a match, characterized in that, include: Obtain the operating status of the display device; The operating status controls whether the mid-field voice mode of the remote control device is turned on or off; the remote control device includes the remote control device according to any one of claims 1-5.

10. A method for controlling voice commands during a match, characterized in that, include: Generate mid-field voice control commands based on the operating status of the display device; The midfield voice control command is sent to the remote control device to control the activation or deactivation of the midfield voice mode of the remote control device; the remote control device includes the remote control device according to any one of claims 1-5.

Images