Display device and instruction transmission method

Abstract

The invention relates to a display device and an instruction sending method. The method comprises the following steps: under the condition that a plurality of remote control devices are connected in a near field communication mode, in response to a trigger operation of starting a recording device of the remote control device, reading use record data of the remote control device; selecting at least one remote control device from the plurality of remote control devices according to the remote control device usage record data; and sending a starting instruction about the recording device to the selected remote control equipment. By adopting the method, the user operation convenience can be improved, and the battery power loss of the remote control equipment can be saved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device. Background Art

[0002] As display devices continue to update and iterate, some display devices are equipped with remote control devices that allow users to control the display devices through voice control commands. This means that the remote control devices need to support recording functions. Usually, remote control devices are battery-powered, and the recording device is turned off to save power consumption.

[0003] At present, in the related technologies, in order to interact with the display device by voice, the user has to turn on the recording device, which is rather cumbersome. In some related technologies, when the display device is connected to multiple remote control devices, in order to interact with the display device by voice, turning on the recording device also has the problem of large battery power consumption. Summary of the Invention

[0004] The present application provides a display device and a command sending method to solve the problem that the method of turning on the recording device in the related art is relatively cumbersome, thereby improving the convenience of user operation and solving the problem that the method of turning on the recording device in the related art causes large battery power loss, thereby saving the power loss of the remote control device.

[0005] In a first aspect, some embodiments provide a display device comprising: a display, a communication device, and a processor. The display is configured to display a user interface; the communication device is configured to establish a communication connection with a remote control device; and the processor is configured to:

[0006] In the case where multiple remote control devices are connected via near field communication, in response to a trigger operation of turning on a recording device of a remote control device, reading the remote control device usage record data;

[0007] selecting at least one remote control device from the plurality of remote control devices based on the remote control device usage record data;

[0008] Sending an opening instruction of the recording device to the selected remote control device.

[0009] In the embodiment provided by the first aspect, when the display device is connected to multiple remote control devices via near-field communication, in response to a trigger operation of turning on a recording device of a remote control device, the display device reads remote control device usage record data, selects at least one remote control device from the multiple remote control devices based on the remote control device usage record data, and sends an activation instruction about the recording device to the selected remote control device. That is, the display device automatically selects the remote control device to which the activation instruction needs to be sent based on the stored remote control device usage record data, eliminating the need for the user to manually find the remote control device to start recording, thereby improving user operation convenience. At the same time, when the display device is connected to multiple remote control devices via near-field communication, the display device decides to only start recording on one or some remote control devices. Compared with blindly starting all remote control devices to start recording, this can reduce the power consumption of some remote control devices, avoid invalid battery loss, and extend the battery life of the remote control devices.

[0010] In a second aspect, some embodiments further provide a method for sending an instruction, which is applied to the display device according to the first aspect. The method for sending an instruction includes:

[0011] In the case where multiple remote control devices are connected via near field communication, in response to a trigger operation of turning on a recording device of a remote control device, reading the remote control device usage record data;

[0012] selecting at least one remote control device from the plurality of remote control devices based on the remote control device usage record data;

[0013] Sending an opening instruction of the recording device to the selected remote control device.

[0014] In the embodiment provided by the second aspect, when multiple remote control devices are connected via near-field communication, in response to a trigger operation of turning on a recording device of a remote control device, remote control device usage record data is read, at least one remote control device is selected from the multiple remote control devices based on the remote control device usage record data, and an activation instruction for the recording device is sent to the selected remote control device. That is, the remote control device to which the activation instruction needs to be sent is automatically selected based on the stored remote control device usage record data, and the user does not need to manually find the remote control device to start recording, thereby improving user operation convenience. At the same time, by deciding to only start recording on one or some remote control devices, compared to blindly starting all remote control devices to start recording, the power consumption of some remote control devices can be reduced, invalid battery loss can be avoided, and the battery life of the remote control device can be extended. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0016] Figure 1 A schematic diagram of an operation scenario between a display device and a remote control device provided in some embodiments of the present application;

[0017] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0018] Figure 3 A schematic diagram of the hardware configuration of a remote control device provided in some embodiments of the present application;

[0019] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0020] Figure 5 A flowchart of a method for sending instructions according to some embodiments of the present application;

[0021] Figure 6 A timing diagram of the interaction between a remote control device and a display device provided in some embodiments of the present application;

[0022] Figure 7 A timing diagram of the interaction between a remote control device and a display device provided in some other embodiments of the present application;

[0023] Figure 8 A timing diagram of the interaction between a remote control device and a display device provided in some further embodiments of the present application;

[0024] Figure 9 A timing diagram of the interaction between a remote control device and a display device provided in some embodiments of the present application;

[0025] Figure 10 A schematic diagram of the process of selecting a remote control for some embodiments of the present application. DETAILED DESCRIPTION

[0026] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0027] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0028] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0029] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0030] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0031] In the embodiments of the present application, a display device generally refers to a device capable of displaying images and processing data. For example, a display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0032] Figure 1 This is a schematic diagram of an operation scenario between a display device and a remote control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the remote control device 100. For example, the remote control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0033] The mobile terminal 300 can function as a remote control device for user interaction with the display device 200. It can also function as a communication device, establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling communication via a network communication protocol for one-to-one control and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0034] Figure 1As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0035] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0036] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0037] In some embodiments, the display device 200 may include at least one of a tuner 210 , a communication device 220 , a detector 230 , a device interface 240 , a processor 250 , a display 260 , an audio output device 270 , a memory, a power supply, and a user input interface.

[0038] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0039] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving the image display. The display 260 is used to receive an image signal output from the processor 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu control interface, and a user control UI interface. In some embodiments, the display device may further include a touch component connected to the display 260, and the touch component is used to detect a touch action on the display 260 and touch position information of the touch action, and the touch position information can be transmitted to the processor 250 to perform related operations. In some embodiments, the display 260 may be a touch display on which a touch component is installed, and is a display with a touch component.

[0040] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0041] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0042] In some embodiments, the processor 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and may include first to nth interfaces for input / output. The processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The processor 250 controls the overall operation of the display device 200.

[0043] In some embodiments, the processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.

[0044] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0045] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0046] In some embodiments, the user input interface 280 can be used to receive commands from the user. The above-mentioned touch display can be used as a user input interface input interface for receiving operation signals from fingers or stylus and converting them into operation commands.

[0047] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the remote control device. Figure 3 As shown, the remote control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0048] The remote control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interaction intermediary between the user and the display device 200 .

[0049] In some embodiments, the remote control device 100 may be a smart device. For example, the remote control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0050] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the remote control device 100 after installing the application for controlling the display device 200 .

[0051] The controller 110 includes a central processing unit 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the remote control device 100, the communication and cooperation between internal components, and the external and internal data processing functions.

[0052] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0053] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 , and other input interfaces. In some embodiments, the recording device of the remote control device 110 may be the microphone 141 .

[0054] In some embodiments, the remote control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The remote control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0055] The memory 190 is used to store various operating programs, data and applications for driving and controlling the remote control device 100 under the control of the processor. The memory 190 can store various control signal instructions input by the user.

[0056] The power supply 180 is used to provide operating power support for various components of the remote control device 100 under the control of the processor.

[0057] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system may provide a user interface (to control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0058] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized for a specific operating platform, or an independent operating system developed specifically for display devices. The operating system can be divided into different modules or layers based on the functions implemented.

[0059] like Figure 4 As shown, Figure 4 Some embodiments of this application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0060] The application layer mainly includes commonly used applications on the TV and the application framework. Common applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0061] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0062] Native apps can support online or offline, message push or local resource access.

[0063] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by system software to connect various parts of application systems or different applications on the network, enabling resource and function sharing.

[0064] The hardware layer primarily includes the Hardware Abstraction Layer (HAL) interface, hardware, and drivers. The HAL interface serves as a unified interface for all TV chipsets, while the specific logic is implemented by each chip. Drivers primarily include audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, and pressure sensors), and power drivers.

[0065] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0066] In some related technologies, the method for users to activate a recording device for voice interaction with a display device is cumbersome. For example, to interact with a display device by voice, the user typically finds a remote control, manually activates the recording device on the remote control, and then uses the recording device to send voice to the display device to achieve voice interaction with the display device. This method requires the user to manually find the remote control and activate the recording device, which is relatively cumbersome.

[0067] Some related technologies also suffer from significant battery drain when activating recording devices. For example, if a display device is connected to multiple remote control devices, blindly activating recording on all of them results in high power consumption and ineffective battery drain, shortening the battery life of the remote control devices.

[0068] The instruction sending method provided in some embodiments of the present application can be applied to Figure 1In the application environment shown. In some embodiments, when the display device 200 is connected to multiple remote control devices 100 via near field communication, the display device 200 detects a trigger operation to activate the recording device of the remote control device 100. When the trigger operation to activate the recording device of the remote control device 100 is detected, the display device 200 can read the remote control device usage record data in response to the trigger operation. Then, the display device 200 selects at least one remote control device from the multiple remote control devices 100 based on the remote control device usage record data and sends a recording device activation instruction to the selected remote control device. In this way, as long as a trigger operation to activate the recording device of the remote control device 100 is detected (for example, the display device detects a user's touch operation on the activation control on the touch screen of the display device, or the display device detects a user's activation operation on the voice function button of the display device), even if the display device 200 is connected to multiple remote control devices 100, the display device 200 automatically selects the remote control device to which the activation instruction needs to be sent based on the stored remote control device usage record data. It can be seen that during the entire process of starting the recording device, the user does not need to manually find the remote control device to start recording, which improves the convenience of user operation. At the same time, the display device automatically decides to only start recording on one or some remote control devices. Compared with blindly starting all remote control devices to start recording, it can reduce the power consumption of some remote control devices, avoid invalid battery loss, and extend the battery life of the remote control device.

[0069] Figure 5 This is a flow chart of a method for sending instructions as shown in an exemplary embodiment of the present application. Figure 1 In some embodiments, the display device 200 includes a display, a communication device, and a processor, wherein the display is configured to display a user interface; the communication device is configured to establish a communication connection with a remote control device; and the processor is configured to execute a method for sending instructions.

[0070] like Figure 5 As shown, a method for sending an instruction is provided, comprising the following steps S502 to S506.

[0071] Step S502 : When multiple remote control devices are connected via near field communication, in response to a trigger operation of turning on a recording device of a remote control device, remote control device usage record data is read.

[0072] Specifically, when the display device is connected to multiple remote control devices via near field communication, it can detect a trigger operation to activate a recording device of a remote control device, and read remote control device usage record data locally when the trigger operation to activate the recording device of the remote control device is detected.

[0073] Near field communication methods may include Bluetooth, local area network (such as WiFi), ZigBee, etc., and the display device may be connected to multiple remote control devices via near field communication. Each of the multiple remote control devices may be configured with a recording device, and the recording device of the remote control device may be a microphone, etc., and the recording device is used to receive external sounds. The display device is connected to multiple remote control devices via near field communication, which means that the multiple remote control devices are currently in a connected state with the display device, rather than a disconnected state. The number of the multiple remote control devices may be two, three or more, and the embodiments of the present application do not limit this. The device types of the multiple remote control devices may be the same or different. For example, the multiple remote control devices include a Bluetooth remote control and a mobile terminal serving as a remote control device. For another example, the multiple remote control devices include two Bluetooth remote controls and a mobile terminal serving as a remote control device.

[0074] In some embodiments, the multiple remote control devices utilize the same near-field communication method to connect to the display device. Specifically, the multiple remote control devices include a first remote control device and a second remote control device, both of which communicate with the display device via Bluetooth. For example, the multiple remote control devices include two Bluetooth remote controls, both of which are connected to the display device via Bluetooth. With respect to the display device, the two Bluetooth remote controls are in a Bluetooth connection state.

[0075] In some embodiments, the multiple remote control devices are connected to the display device using different near-field communication methods. Specifically, the multiple remote control devices include a first remote control device and a second remote control device, the first remote control device communicates with the display device via a Bluetooth connection, and the second remote control device communicates with the display device via a local area network. For example, the multiple remote control devices include a Bluetooth remote control and a mobile terminal, the Bluetooth remote control is connected to the display device via Bluetooth, and the mobile terminal, as a remote control device, is connected to the display device via a network communication protocol. Optionally, the mobile terminal can install software applications separately with the display device, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication.

[0076] The trigger operation for activating the recording device of the remote control device is detected by the display device. In the embodiment of the present application, the trigger operation for activating the recording device of the remote control device is detected by the display device. That is, the user does not need to manually activate the recording device of the remote control device. Instead, the display device sends a command to activate the recording device to the remote control device, thereby improving user convenience. The trigger operation for activating the recording device of the remote control device can be a touch operation on the display screen, a trigger operation on a function button, etc.

[0077] Remote control device usage history records the historical usage of remote control devices. The display device can store this data locally and retrieve it when a trigger operation is detected to activate the remote control device's recording function. This additional remote control device usage history data serves as a basis for subsequent decision-making, enabling automatic and accurate selection of the remote control device that the user is likely to use in the near future.

[0078] Step S504: selecting at least one remote control device from a plurality of remote control devices according to the remote control device usage record data.

[0079] Specifically, the display device may select at least one remote control device from a plurality of remote control devices based on the remote control device usage record data. The number of remote control devices selected from the plurality of remote control devices based on the remote control device usage record data may be one or two.

[0080] In some embodiments, when selecting at least one remote control device from multiple remote control devices based on remote control device usage record data, the selection of a remote control device may be based on specific indicators according to actual needs. For example, the decision may be made based on various factors such as frequency of use, duration, device attributes, and time to market of each remote control device.

[0081] In some embodiments, the display device may also estimate the probability that each of the multiple currently connected remote control devices may be used by the user based on the remote control device usage record data, and select at least one remote control device from the multiple remote control devices based on the estimated probability.

[0082] Step S506: Send an instruction to start the recording device to the selected remote control device.

[0083] Specifically, the display device may send a command to activate the recording device to the selected remote control device. If one remote control device is selected, the display device may send a command to activate the recording device to the remote control device. If two or more remote control devices are selected, the display device may send a command to activate the recording device to each of the remote control devices.

[0084] That is to say, the display device does not blindly send a recording start command to each of the multiple remote control devices currently connected, but selectively sends a recording start command to some of the remote control devices, avoiding blindly starting the recording devices of all remote control devices. This can reduce the power consumption of some remote control devices, avoid invalid battery power loss, and extend the battery life of the remote control devices.

[0085] In some embodiments, the display device may send a command to activate the recording device to the target remote control device if the read remote control device usage record data indicates that the target remote control device among multiple remote control devices is the most recently used remote control device. In this embodiment, the target remote control device is a remote control device that the user is likely to currently use. The most recently used remote control device is selected as the target remote control device from among the multiple remote control devices currently connected to predict the remote control device that the user is likely to currently use, so that the selected remote control device best meets the user's needs.

[0086] The above-mentioned command sending method, when multiple remote control devices are connected through near-field communication, responds to the trigger operation of turning on the recording device of the remote control device, reads the remote control device usage record data, selects at least one remote control device from the multiple remote control devices based on the remote control device usage record data, and sends a start-up instruction for the recording device to the selected remote control device. That is, the remote control device to which the start-up instruction needs to be sent is automatically selected based on the stored remote control device usage record data, and the user does not need to manually find the remote control device to turn on recording, thereby improving the user's operation convenience. At the same time, by deciding to only turn on one or some remote control devices to turn on recording, compared with blindly turning on all remote control devices to turn on recording, the power consumption of some remote control devices can be reduced, invalid battery power loss can be avoided, and the battery life of the remote control device can be extended.

[0087] In some embodiments, the display device can display the user interface of the application through the display, and the user interface includes a start control of the recording device. The display device detects the trigger operation of the start control, and reads the remote control device usage record data when the trigger operation of the start control is detected.

[0088] In this embodiment, the triggering operation for starting the recording device of the remote control device is a touch operation on the display screen. Specifically, the display device can display the user interface of the application through the display, and the user interface includes a start control for the recording device. When the user needs to turn on the recording device of the remote control device, the user can trigger the start control when the display device displays the user interface including the start control for the recording device. In this way, after the display device detects the triggering operation of the start control in the user interface, it reads the remote control device usage record data to select at least one remote control device from multiple remote control devices based on the remote control device usage record to send a start instruction for the recording device. In this embodiment, the user does not need to find the remote control device. The user only needs to touch the display to automatically turn on the recording device of the remote control device. Compared with the user manually finding the remote control device to turn on the recording device, this operation method is very convenient. Especially for the elderly, touching the display is more convenient than operating a small remote control.

[0089] In some embodiments, a display device is provided with a function button for activating a recording device of a remote control device. The display device can detect a triggering operation (e.g., a rotation operation, a press operation) on the function button and, upon detecting the triggering operation on the function button, read the remote control device usage record data.

[0090] In this embodiment, the triggering operation for activating the recording device of the remote control device is the triggering operation of the function button. Specifically, after detecting the triggering operation of the function button, the display device reads the remote control device usage record data and selects at least one remote control device from the multiple remote control devices based on the remote control device usage record to send the recording device activation instruction. In this embodiment, the user does not need to find the remote control device; the user only needs to press or rotate the function button on the display device to automatically activate the recording device of the remote control device. Compared with the user manually locating the remote control device to activate the recording device, this operation method is very convenient.

[0091] In some embodiments, for each remote control device among multiple remote control devices, when an operation instruction is received from the remote control device through near-field communication, the display device can record the instruction information of the operation instruction of the remote control device in the local remote control device usage record data, and the instruction information includes at least one of the instruction trigger time and the instruction type.

[0092] Specifically, the display device can detect the connection of a remote control device. When a remote control device is connected to the display device, the display device will receive interactive operation instructions sent by the remote control device to the display device. The display device can then record the generated interactive operation instructions, providing a basis for subsequent remote control device selection. These interactive operation instructions include, but are not limited to, voice interaction instructions, key interaction instructions, and control instructions. Optionally, for each generated interactive operation instruction, the display device can record at least one of the following information: the device identifier of the remote control device that generated the interactive operation instruction, the device type of the remote control device that generated the interactive operation instruction, the type of each interactive operation instruction generated, and the time each interactive operation instruction was generated. Based on this information, the display device can generate statistical remote control device usage data, including, but not limited to, at least one of the following: the time each remote control device last used the voice remote control function, the time each key was last used, the frequency of device usage for each remote control device, the device identifier of the remote control device most frequently used within a set time period (e.g., within a day, a week, or a month), the device identifier of the remote control device with the longest usage time within a set time period, the device identifier of the remote control device used earliest within a set time period, and so on.

[0093] In some embodiments, the remote control device can detect its own status data through its own detector, and report the status data to the display device when it is connected to the display device. The display device can receive the status data reported by the remote control device. The detector can be a gravity accelerometer, a gyroscope, a light detector, etc. When the remote control device is picked up or put down, the gravity accelerometer will detect the different gravity accelerations of the remote control device. When the remote control device is moved or used, the gyroscope will detect different posture data of the remote control device. When the remote control device is held, the light detector will detect the different light brightness around the remote control device. The status data may include at least one of gravity acceleration data, posture data, and light brightness. Therefore, the display device can compile statistics of remote control device usage record data based on the reported status data. For example, based on at least one of the changes in gravity acceleration data, changes in posture data, and changes in light sensitivity, determine the most recent usage time of each remote control device, the device usage frequency of each remote control device, the device identification of the remote control device that is used the most times within a set time range (for example, within 1 day, within 1 week, within 1 month), the device identification of the remote control device that is used the longest within the set time range, the device identification of the remote control device that is used earliest within the set time range, and so on.

[0094] In one embodiment, the remote control device is connected to the display device as a human interface device (Human Interface Device) via the Bluetooth protocol. After the remote control device and the display device are connected via the Bluetooth protocol, the external device interface module in the display device used to directly access the human interface device will detect the remote control device and create a HIDraw file about the remote control device under a local specified path (for example, / dev / ). The statistical decision module of the display device can read the HIDraw file under the local specified path. Whenever an interaction occurs between the remote control device and the display device, the HIDraw file will change. The statistical decision module of the display device can read the original data packet corresponding to each interaction operation from the HIDraw file and parse the original data packet to obtain the specific type and specific content of the interaction operation (for example, the operation type is a key operation, and the key operation instruction is "OK"), and record it in correspondence with time. In this way, the remote control device usage record data can be statistically calculated based on the recorded data.

[0095] Figure 6 FIG. 1 is a timing diagram of the interaction between the remote control device and the display device in some embodiments. Figure 6The remote control device interacts with the display device via the Bluetooth protocol, and the display device includes an external device interface module (for example, a HIDraw processing module) and a statistical decision module. First, the remote control device is bound to the display device via the Bluetooth protocol and successfully connected. At this time, the display device will create a HIDraw file about the remote control device under the local specified path. Next, the external device interface module of the display device is used to monitor the new HIDraw file under the local specified path, and the external device interface module is used to read the HIDraw file. Whenever an interactive operation occurs and is recorded in the HIDraw file, the external device interface module is used to read the HIDraw file to pass the interactive operation data of the remote control device to the statistical decision module. The statistical decision module is used to generate remote control device usage record data based on the acquired interactive operation data.

[0096] In one embodiment, a remote control device, acting as an IoT device, connects to a display device via a network protocol. After the remote control device and the display device are connected via the network protocol, each interaction between the remote control device and the display device records the specific type and content of each interaction (e.g., key presses, "OK" key press), and records it with a timestamp. This allows statistical analysis of remote control device usage based on all recorded data. For example, the remote control device can be a mobile terminal, which can connect to the display device via a local area network as an IoT device.

[0097] Figure 7 FIG. 1 is a timing diagram of the interaction between the remote control device and the display device in some embodiments. Figure 7 The remote control device interacts with the display device via a network protocol. The display device includes an external device interface module (e.g., an IoT module), a statistical decision module, and a voice service module. First, the remote control device successfully binds to and connects to the display device using the network protocol. The display device's external device interface module detects the remote device's access and sends interactive operation commands initiated by the remote control device to the statistical decision module. The statistical decision module generates remote control device usage records based on the acquired interactive operation data.

[0098] In some embodiments, the display device may also periodically clear locally stored remote control device usage record data, for example, by promptly deleting interactive operation instruction-related data that exceeds a preset time range to reduce storage space occupied by the display device.

[0099] In some embodiments, after sending a start instruction about the recording device to the selected remote control device, the method also includes: receiving recording data sent by the selected remote control device, the recording data being collected by the recording device after the selected remote control device receives the start instruction and turns on the recording device; performing voice recognition based on the recording data to obtain voice instructions; and displaying a user interface corresponding to the voice instructions through a display.

[0100] In this embodiment, after receiving the power-on command, the remote control device turns on the recording device and collects sound through the recording device, and sends the collected recording data to the display device. The display device receives the recording data sent by the remote control device, performs voice recognition on the recording data, obtains the voice command, and displays the user interface corresponding to the voice command through the display.

[0101] For example, when a user issues a command "open XX TV series", the display device can display the TV series interface through the display, making it convenient for the user to select the episode of interest to play from the TV series interface. Alternatively, the display device can search according to "XX TV series" and directly display the playback interface of "XX TV series" through the display, without the user having to operate through the remote control device, which is very convenient.

[0102] Figure 8 FIG. 1 is a timing diagram of the interaction between the remote control device and the display device in some embodiments. Figure 8 , remote control device A and remote control device B are both connected to the display device, and the display device includes an external device interface module, a statistical decision module, and a voice service module. The interaction process includes the following steps:

[0103] Step S802: The display device detects a triggering operation to start the recording device of the remote control device.

[0104] When the recording devices of the remote control devices A and B are not turned on, the display device can actively detect the trigger operation of turning on the recording devices of the remote control devices, and notify the statistical decision module when the trigger operation of turning on the recording devices of the remote control devices is detected.

[0105] Step S804: The statistical decision module is used to select a remote control device from remote control device A and remote control device B according to the remote control device usage record data.

[0106] Specifically, the statistical decision module is used to select a remote control device from multiple remote control devices according to preset rules based on the remote control device usage record data. For example, the statistical decision module is used to select the remote control device with the most recent recording function or the most recent key operation.

[0107] Step S806: The statistical decision module is used to send an instruction to start the recording device to the selected remote control device.

[0108] If the statistical decision module selects remote control device A, the statistical decision module sends a start instruction for the recording device to remote control device A. If the statistical decision module selects remote control device B, the statistical decision module sends a start instruction for the recording device to remote control device B.

[0109] Step S808: The remote control device that receives the start command turns on the recording device to collect sound.

[0110] If the statistical decision module selects remote control device A, after receiving the start instruction, remote control device A starts the recording device, collects sound, and sends the recorded data to the display device.

[0111] Step S810: The external device interface module of the display device is used to receive recording data sent by the remote control device.

[0112] Step S812: The external device interface module of the display device is used to transmit the recorded data to the voice service module.

[0113] Step S814: The voice service module of the display device is used to perform voice recognition on the recorded data to obtain voice instructions.

[0114] exist Figure 8 In the illustrated embodiment, by adding this remote control device selection process, a remote control device that is most likely to be the one the user wants to use is selected from multiple remote control devices to automatically start recording, thereby improving user operation convenience and saving battery power consumption of other remote control devices.

[0115] Figure 9 FIG. 1 is a timing diagram of the interaction between the remote control device and the display device in some embodiments. Figure 9 , remote control device A and remote control device B are both connected to the display device via Bluetooth protocol. The display device includes an external device interface module, a statistical decision module, and a voice service module. The interaction process includes the following steps:

[0116] Step S902a: The remote control device A is bound to the display device based on the Bluetooth protocol and is successfully connected.

[0117] Step S904a: The external device interface module is used to detect a new HIDraw file.

[0118] Step S906a: The external device interface module is used to read the HIDraw file to transfer the interactive operation data of the remote control device A to the statistical decision module.

[0119] In the case where the interactive operation data is recorded data of voice interaction, the external device interface module is also used to transmit the recorded data sent by the remote control device A to the voice service module, and the voice service module can perform voice recognition on the recorded data to obtain voice instructions.

[0120] Similarly,

[0121] Step S902b: The remote control device B is bound to the display device based on the Bluetooth protocol and is successfully connected.

[0122] Step S904b: The external device interface module is used to detect a new HIDraw file.

[0123] Step S906b: The external device interface module is used to read the HIDraw file to transfer the interactive operation data of the remote control device B to the statistical decision module.

[0124] In the case where the interactive operation data is recorded data of voice interaction, the external device interface module is also used to transmit the recorded data sent by the remote control device B to the voice service module, and the voice service module can perform voice recognition on the recorded data to obtain voice instructions.

[0125] Step S908a: The remote control device A actively turns on the recording device to collect sound and send the recorded data to the display device.

[0126] In step S910a, the external device interface module is used to receive recording data.

[0127] In step S912a, the external device interface module is used to notify the statistical decision module of the current recording operation of the remote control device A, so that the statistical decision module can generate remote control device usage record data.

[0128] In step S914a, the external device interface module is used to transmit the received recording data to the voice service module. The voice service module can perform voice recognition on the recording data to obtain voice instructions.

[0129] Similarly,

[0130] Step S908b: remote control device B actively turns on the recording device, collects sound and sends the recorded data to the display device.

[0131] In step S910b, the external device interface module is used to receive recording data.

[0132] In step S912b, the external device interface module is used to notify the statistical decision module of the current recording operation of the remote control device B, so that the statistical decision module can generate remote control device usage record data.

[0133] In step S914b, the external device interface module is used to transmit the received recording data to the voice service module, and the voice service module can perform voice recognition on the recording data to obtain voice instructions.

[0134] Step S916: The statistical decision module records the acquired interactive operation data to generate remote control device usage record data.

[0135] If the recording device of remote control device A or B is turned off and cannot record, perform the following steps:

[0136] It should be noted that the recording devices of the remote control devices A and B can be turned off actively by the user, or can be turned off automatically after not collecting any sound for a long time.

[0137] Step S918: The display device detects a triggering operation to start the recording device of the remote control device.

[0138] When the recording devices of remote control devices A and B are both off, the display device can actively detect a trigger operation to activate the recording devices of the remote control devices, and upon detecting the trigger operation to activate the recording devices of the remote control devices, notify the statistical decision module. As described above, in some embodiments, the display device can display an application user interface through a display, wherein the user interface includes a control to activate the recording device. When the display device detects a trigger operation on the control, it is deemed to have detected a trigger operation to activate the recording device of the remote control device. In some embodiments, a function button for activating the recording device of the remote control device is provided on the display device, and when a trigger operation (e.g., a rotation operation or a press operation) on the function button is detected, it is deemed to have detected a trigger operation to activate the recording device of the remote control device.

[0139] Step S920: The statistical decision module is used to select a remote control device from remote control device A and remote control device B according to the remote control device usage record data.

[0140] For example, the statistical decision module is used to select the remote control device whose recording function was used most recently, or the remote control device whose key operation was used most recently.

[0141] Step S922: The statistical decision module is used to send an instruction to start the recording device to the selected remote control device.

[0142] If the statistical decision module selects remote control device A, the statistical decision module sends a start instruction for the recording device to remote control device A. If the statistical decision module selects remote control device B, the statistical decision module sends a start instruction for the recording device to remote control device B.

[0143] Step S924: The remote control device that receives the start command turns on the recording device to collect sound.

[0144] If the statistical decision module selects remote control device A, after receiving the start command, remote control device A turns on the recording device, collects sound, and sends the recorded data to the display device. If the statistical decision module selects remote control device B, after receiving the start command, remote control device B turns on the recording device, collects sound, and sends the recorded data to the display device.

[0145] Step S926: The external device interface module of the display device is used to receive the recording data sent by the selected remote control device.

[0146] Step S928: The external device interface module of the display device is used to transmit the recorded data to the voice service module.

[0147] Step S930: The voice service module of the display device is used to perform voice recognition on the recorded data to obtain a voice instruction.

[0148] exist Figure 9 In the illustrated embodiment, by adding statistics on historical usage records of remote control devices, remote control device usage record data is formed, which serves as a basis for selecting a remote control device when multiple remote control devices are connected. This allows the user to select the remote control device most likely to be the one they want to use from the multiple remote control devices and automatically start recording, thereby improving user operation convenience and saving battery power consumption of other remote control devices.

[0149] Based on similar concepts, the following embodiments are also provided:

[0150] In some embodiments, the display device can also read the remote control device usage record data in response to a trigger operation of turning on the image acquisition device of the remote control device when multiple remote control devices are connected via near-field communication; select at least one remote control device from the multiple remote control devices based on the remote control device usage record data; and send a turn-on instruction for the image acquisition device to the selected remote control device.

[0151] The image acquisition device of the remote control device may be a camera. The remote control device usage record data may be generated based on the usage records of the keys of the remote control device, the usage records of the recording device, and the usage records of the image acquisition device.

[0152] In this embodiment, when multiple remote control devices are connected via near-field communication, in response to a trigger operation for turning on the image acquisition device of the remote control device, the remote control device usage record data is read; at least one remote control device is selected from the multiple remote control devices based on the remote control device usage record data; and an activation instruction for the image acquisition device is sent to the selected remote control device. That is, the remote control device to which the activation instruction is to be sent is automatically selected based on the stored remote control device usage record data, and the user does not need to manually find the remote control device to turn on image acquisition, thereby improving user operation convenience. At the same time, by deciding to only start one or some remote control devices to start image acquisition, compared to blindly starting all remote control devices to start image acquisition, the power consumption of some remote control devices can be reduced, invalid battery loss can be avoided, and the battery life of the remote control device can be extended.

[0153] In some embodiments, when the read remote control device usage record data indicates that the target remote control device among the multiple remote control devices is the remote control device used last, an instruction to start the image acquisition device is sent to the target remote control device.

[0154] In some embodiments, a display device receives image data sent by a selected remote control device, where the image data is collected by the image acquisition device after the selected remote control device receives a start-up instruction and turns on the image acquisition device; facial recognition is performed based on the image data to obtain facial features; and when the facial features match the stored target facial features, the target user interface is displayed through the display.

[0155] In this embodiment, after receiving the power-on command, the remote control device turns on the image acquisition device and acquires an image through the image acquisition device, and sends the acquired image to the display device. The display device receives the image sent by the remote control device and performs face recognition. After the face recognition is passed, the target user interface can be displayed.

[0156] For example, if the image captured by the remote control device is a parent user's face, the display device can display a TV series interface on the display. For example, if the image captured by the remote control device is a child user's face, the display device can display an animation interface on the display. This eliminates the need for the user to operate the remote control device, making it very convenient.

[0157] In some embodiments, the display device can also display the user interface of the application through the display, the user interface including the start control of the image acquisition device; detect the trigger operation of the start control; when the trigger operation of the start control is detected, execute the step of reading the remote control device usage record data.

[0158] In this embodiment, the triggering operation for activating the image capture device of the remote control device is a touch operation on the display screen. Specifically, the display device can display an application user interface on the display, which includes a control for activating the image capture device. When the user desires to activate the image capture device of the remote control device, the user can trigger the control while the display device displays the user interface including the control for activating the image capture device. Upon detecting the triggering operation for the control in the user interface, the display device reads the remote control device usage history data and, based on the remote control device usage history, selects at least one remote control device from a plurality of remote control devices to transmit a command for activating the image capture device. In this embodiment, the user does not need to search for the remote control device; instead, the user simply touches the display screen to automatically activate the image capture device. This operation method is very convenient compared to manually locating the remote control device to activate the image capture device. For the elderly, touching the display screen is more convenient than operating a compact remote control.

[0159] In some embodiments, the display device may further detect a triggering operation on a function key for activating an image acquisition device of the remote control device; and when the triggering operation on the function key is detected, the step of reading the remote control device usage record data is executed.

[0160] In this embodiment, the triggering operation for activating the image capture device of the remote control device is a triggering operation on the function button. Specifically, after detecting the triggering operation on the function button, the display device reads the remote control device usage record data and selects at least one remote control device from the plurality of remote control devices based on the remote control device usage record to transmit a command to activate the image capture device. In this embodiment, the user does not need to search for the remote control device; instead, the user simply presses or rotates the function button on the display device to automatically activate the image capture device of the remote control device. This operation method is significantly more convenient than manually locating the remote control device to activate the image capture device.

[0161] Based on similar concepts, the following embodiments are also provided:

[0162] In some embodiments, when multiple remote control handles are connected via near-field communication, in response to a trigger operation of locating the remote control handle, remote control handle usage record data is read; at least one remote control handle is selected from the multiple remote control handles based on the remote control handle usage record data; and a vibration command or sound effect command is sent to the selected remote control handle.

[0163] The remote controller may be a game controller. In this embodiment, the remote controller to which the vibration command or sound effect command is to be sent is automatically selected based on stored remote controller usage record data. This eliminates the need for the user to manually locate the remote controller; the remote controller can be automatically located by its vibration or sound effect, thereby improving user convenience. Furthermore, by deciding to activate vibration or sound effects on only one or some remote controllers, compared to blindly activating all remote controllers for vibration or sound effects, the power consumption of some remote controllers can be reduced, thus avoiding ineffective battery loss and extending the battery life of the remote controllers.

[0164] In some embodiments, the display device can also display the user interface of the application through the display, the user interface including the positioning control of the remote control handle; detect the trigger operation of the positioning control; when the trigger operation of the positioning control is detected, execute the step of reading the remote control handle usage record data.

[0165] In this embodiment, the triggering operation for locating the remote control handle is a touch operation on the display screen. Specifically, the display device can display the user interface of the application through the display, and the user interface includes a positioning control for the remote control handle. When the user needs to find the remote control handle, the user can trigger the positioning control. In this way, after the display device detects the triggering operation of the positioning control in the user interface, it reads the remote control handle usage record data to select at least one remote control handle from multiple remote control handles based on the remote control handle usage record data to send a vibration instruction or sound effect instruction. In this embodiment, the user does not need to find the remote control handle. The user only needs to touch the display to automatically trigger the remote control handle to vibrate or play a sound effect. Compared with the user manually finding the remote control handle, this operation method is very convenient.

[0166] In some embodiments, the display device may further detect a trigger operation on a function key for locating the remote control handle; and when the trigger operation on the function key is detected, the step of reading the remote control handle usage record data is executed.

[0167] In this embodiment, the triggering operation of the remote control handle is the triggering operation of the function button. Specifically, after detecting the triggering operation of the function button, the display device reads the remote control handle usage record data and selects at least one remote control handle from multiple remote control handles based on the remote control handle usage record data to send a vibration command or sound effect command. In this embodiment, the user does not need to find the remote control handle; the user only needs to press or rotate the function button on the display device to automatically trigger the remote control handle to vibrate or play a sound effect, which is very convenient.

[0168] In a specific embodiment, a method for sending an instruction executed by a display device is provided, comprising the following steps:

[0169] 1. The display device is connected to the remote control device via near field communication.

[0170] 2. The remote control device sends key commands to the display device.

[0171] 3. The display device receives the key command, records the triggering time of the key command, and records the device identification of the remote control device, the triggering time of the key command, and the command type accordingly.

[0172] 4. When the user actively turns on the recording device of the remote control device, the remote control device can collect sound and send the recorded data to the display device.

[0173] 5. The display device receives the recorded data and records the triggering time of the recorded data, and records the device identification of the remote control device, the triggering time of the recorded data, and the instruction type accordingly.

[0174] The display device also performs voice recognition on the recorded data.

[0175] 6. The display device generates remote control device usage record data based on the recorded data related to the operation of each remote control device.

[0176] 7. When the display device is connected to multiple remote control devices via near field communication, and the recording devices of the multiple remote control devices are in an off state, the display device detects a trigger operation for turning on the recording devices of the remote control devices.

[0177] 8. When the display device detects a trigger operation of turning on the recording device of the remote control device, the display device reads the remote control device usage record data.

[0178] In some embodiments, a display device displays a user interface of an application through a display, wherein the user interface includes a start control for a recording device; a trigger operation on the start control is detected; and when a trigger operation on the start control is detected, a step of reading the remote control device usage record data is executed.

[0179] In some embodiments, the display device detects a triggering operation on a function key for activating a recording device of the remote control device; and when the triggering operation on the function key is detected, the step of reading the remote control device usage record data is executed.

[0180] 9. The display device selects at least one remote control device from the multiple currently connected remote control devices according to the remote control device usage record data.

[0181] 10. The display device sends a start instruction for the recording device to the selected remote control device.

[0182] 11. The remote control device that receives the start command starts the recording device, collects sound through the recording device, and sends the recorded data to the display device.

[0183] 12. The display device receives the recorded data, performs voice recognition based on the recorded data, and obtains the voice command.

[0184] 13. Displaying a user interface corresponding to the voice command on the display.

[0185] Figure 10 Schematic diagram of selecting a remote control in some embodiments. Figure 10 The user can trigger an operation to activate the recording device through the display device's application. The display device detects the trigger operation, selects a remote control from multiple remote controls based on its local remote control device usage history, and then sends a command to activate the recording device to the selected remote control via the Bluetooth driver. The Bluetooth driver is the program in the display device that enables communication with the remote control.

[0186] In this embodiment, a command sending method is provided, in which a display device automatically selects a remote control device to which an activation command is to be sent based on stored remote control device usage record data, eliminating the need for a user to manually find a remote control device to start recording, thereby improving user convenience. Furthermore, when the display device is connected to multiple remote control devices via near-field communication, the display device can decide to only activate recording on one or some remote control devices. Compared to blindly activating all remote control devices to activate recording, this can reduce the power consumption of some remote control devices, avoid ineffective battery loss, and extend the battery life of the remote control devices.

[0187] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0188] Based on the same inventive concept, embodiments of the present application further provide an instruction sending device for implementing the instruction sending method involved above. The implementation solution provided by this device is similar to the implementation solution described in the above method. Therefore, the specific limitations of one or more instruction sending device embodiments provided below can be referred to the limitations of the instruction sending method above and will not be repeated here.

[0189] Each module in the above-mentioned instruction sending device can be implemented in whole or in part through software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the display device in hardware form, or can be stored in the memory of the display device in software form, so that the processor can call and execute the corresponding operations of each of the above modules.

[0190] In some embodiments, the present application further provides a computer-readable storage medium having a computer program stored thereon, which implements the steps of the above-mentioned animation display method when the computer program is executed by a processor.

[0191] In some embodiments, the present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned animation display method when executed by a processor.

[0192] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processors (GPUs), digital signal processors (DSPs), programmable logic devices (PLCs), artificial intelligence (AI) processors, and the like.

[0193] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0194] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, comprising: A display, a communication device, and a processor, wherein the display is configured to display a user interface; the communication device is configured to establish a communication connection with a remote control device; and the processor is configured to execute: In the case where multiple remote control devices are connected via near field communication, in response to a trigger operation of turning on a recording device of a remote control device, reading the remote control device usage record data; selecting at least one remote control device from the plurality of remote control devices based on the remote control device usage record data; Sending an activation instruction of the recording device to the selected remote control device.

2. The display device according to claim 1, wherein The processor is further configured to perform: When the read remote control device usage record data indicates that a target remote control device among the plurality of remote control devices is the remote control device used last, an instruction to start the recording device is sent to the target remote control device.

3. The display device according to claim 1, wherein The multiple remote control devices include a first remote control device and a second remote control device, both of which communicate with the display device via a Bluetooth connection, or the first remote control device communicates with the display device via a Bluetooth connection, and the second remote control device communicates with the display device via a local area network.

4. The display device according to claim 1, wherein The processor is further configured to perform: For each of the multiple remote control devices, when an operation instruction is received from the remote control device through the near field communication method, instruction information of the operation instruction of the remote control device is recorded in the local remote control device usage record data, and the instruction information includes at least one of an instruction trigger time and an instruction type.

5. The display device according to claim 1, wherein The processor is further configured to perform: receiving recording data sent by the selected remote control device, wherein the recording data is collected by the recording device after the selected remote control device receives the start instruction and starts the recording device; Performing voice recognition based on the recorded data to obtain voice instructions; A user interface corresponding to the voice command is displayed on the display.

6. The display device according to claim 1, wherein The processor is further configured to perform: Displaying a user interface of the application program on the display, wherein the user interface includes a start control of the recording device; detecting a triggering operation on the opening control; In the case where a trigger operation on the start control is detected, the step of reading the remote control device usage record data is performed.

7. The display device according to claim 1, wherein The processor is further configured to perform: detecting a triggering operation of a function button for activating a recording device of a remote control device; When a trigger operation on the function key is detected, the step of reading the remote control device usage record data is performed.

8. The display device according to any one of claims 1 to 7, characterized in that: The processor is further configured to perform: In the case where a plurality of remote control devices are connected via near field communication, in response to a triggering operation of turning on an image acquisition device of a remote control device, reading the remote control device usage record data; selecting at least one remote control device from the plurality of remote control devices based on the remote control device usage record data; Sending a start instruction of the image acquisition device to the selected remote control device.

9. The display device according to claim 8, wherein The processor is further configured to perform: receiving image data sent by the selected remote control device, wherein the image data is acquired by the image acquisition device after the selected remote control device receives the activation instruction and activates the image acquisition device; Performing face recognition based on the image data to obtain facial features; When the facial features match the stored target facial features, a target user interface is displayed via the display.

10. A method for sending an instruction, applied to a display device, wherein the display device includes a display, a communication device, and a processor, wherein: The display is configured to display a user interface; the communication device is configured to establish a communication connection with a remote control device; and the processor is configured to execute the instruction sending method, which includes: In the case where multiple remote control devices are connected via near field communication, in response to a trigger operation of turning on a recording device of a remote control device, reading the remote control device usage record data; selecting at least one remote control device from the plurality of remote control devices based on the remote control device usage record data; Sending an activation instruction of the recording device to the selected remote control device.

Images