Display apparatus and instruction sending method

Abstract

A display apparatus and an instruction sending method are provided. The method includes when the display apparatus is connected with a plurality of remote control devices via a near-field communication mode in response to a trigger operation for activating a recording device of the remote control device, reading usage record data of the plurality of remote control devices; selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices; sending an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.

Description

VI0423P-WO-0009 Docket No. TD250503944P DISPLAY APPARATUS AND INSTRUCTION SENDING METHODCross reference to Related Applications

[0001] The disclosure claims priority of Chinese Patent Application No. 202510088041.9, filed on January 20, 2025 and Chinese Patent Application No. 202510549304.1, filed on April 28, 2025, all of which are hereby incorporated by reference in their entireties.Technical Field

[0002] The disclosure herein relates the technical field of a display apparatus, and in particular to a display apparatus and an instruction sending method.Background

[0003] With the continuous updating and iteration of display apparatuses, some remote control devices equipped with the display apparatuses can support users to control the display apparatuses through voice control commands, which means that the remote control devices need to support a recording function. Usually, remote control devices are powered by batteries, and a recording device is turned off to save power consumption.

[0004] At present, in related technologies, in order to conduct voice interaction with the display apparatus, the operation for users to activate the recording device is relatively cumbersome. In addition, in some related technologies, when the display apparatus is connected to plurality of remote control devices, the operation for activating the recording device for voice interaction with the display apparatus still has the problem of large battery power consumption.Summary

[0005] In a first aspect, embodiments of the disclosure provide a display apparatus, including: a display, a communicating device, and at least one processor. The display is configured to display a user interface. The communicating device is configured to establish a communication connection with a remote control device. The at least one processor is configured to: based on that the display apparatus is connected with a plurality of remote control devices via a near-field communication mode, in response to a trigger operation for activating a recording device of the remote control device, read usage record data of the plurality of remote control devices; select at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices; send an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.

[0006] In a second aspect, the embodiments of the disclosure further provide an instruction sending method, applied to the display apparatus according to the first aspect. The instruction sending method includes: based on that the display apparatus is connected with a plurality of remote control devices via a near-field communication mode, in response to a trigger operation for activating a recording device of the remote control device, reading usage record data of the plurality of remote control devices; selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices; sending an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.VI0423P-WO-0009 Docket No. TD250503944P

[0007] In a third aspect, the embodiments of the disclosure further provide a display apparatus, including: a display configured to display a user interface; and at least one processor connected with the display. The at least one processor is configured to: based on that a target object has selected a target sound output device type, in response to a first volume adjustment instruction, determine a plurality of external sound output devices that are connected with the display apparatus and belong to the target sound output device type; the plurality of external sound output devices including sound output devices of different sub-device types; adjust volume of each external sound output device respectively based on a first volume adjustment parameter indicated by the first volume adjustment instruction to obtain a respective first volume value of each external sound output device.

[0008] In a fourth aspect, the embodiments of the disclosure further provide a volume adjustment method, applied to the display apparatus according to the third aspect. The display apparatus includes a display and at least one processor. The method includes: based on that a target object has selected a target sound output device type, in response to a first volume adjustment instruction, determining a plurality of external sound output devices that are connected with the display apparatus and belong to the target sound output device type; the plurality of external sound output devices including sound output devices of different sub-device types; adjusting volume of each external sound output device respectively based on a first volume adjustment parameter indicated by the first volume adjustment instruction to obtain a respective first volume value of each external sound output device.Brief Description of Figures

[0009] In order to illustrate technical solutions of embodiments of the disclosure more clearly, drawings needing to be used in descriptions of the embodiments or prior art will be introduced below briefly. Apparently, the drawings described below are only some embodiments of the present disclosure, and those ordinarily skilled in the art can further obtain other drawings according to these drawings without inventive efforts.

[0010] FIG. 1 is a schematic diagram of an operation scenario between a display apparatus and a remote control device provided by some embodiments of the disclosure.

[0011] FIG. 2 is a block diagram of a hardware configuration of a display apparatus provided by some embodiments of the disclosure.

[0012] FIG. 3 is a block diagram of a hardware configuration of a remote control device provided by some embodiments of the disclosure.

[0013] FIG. 4 is a schematic diagram of a software configuration of a display apparatus provided by some embodiments of the disclosure.

[0014] FIG. 5 is a schematic flowchart of an instruction sending method provided by some embodiments of the disclosure.

[0015] FIG. 6 is a timing diagram of interaction between a remote control device and a display apparatus provided by some embodiments of the disclosure.

[0016] FIG. 7 is another timing diagram of interaction between a remote control device and a display apparatus provided by some embodiments of the disclosure.

[0017] FIG. 8 is yet another timing diagram of interaction between a remote control device and a display apparatus provided by some embodiments of the disclosure.VI0423P-WO-0009 Docket No. TD250503944P

[0018] FIG. 9 is yet another timing diagram of interaction between a remote control device and a display apparatus provided by some embodiments of the disclosure.

[0019] FIG. 10 is a schematic flowchart of selecting a remote controller provided by some embodiments of the disclosure.

[0020] FIG. 11 is a schematic diagram of a first volume bar provided by some embodiments of the disclosure.

[0021] FIG. 12 is a schematic diagram of a second volume bar provided by some embodiments of the disclosure.

[0022] FIG. 13 is a schematic diagram of a page for selecting a type of a sound output device provided by some embodiments of the disclosure.

[0023] FIG. 14 is an interaction schematic of volume adjustment of a Bluetooth-connected device provided by some embodiments of the disclosure.

[0024] FIG. 15 is an interaction schematic of volume adjustment of a headphone-type device provided by some embodiments of the disclosure.

[0025] FIG. 16 is an interaction schematic of changing a type of a sound output device provided by some embodiments of the disclosure.

[0026] FIG. 17 is a schematic diagram of selecting a single sound output device provided by some embodiments of the disclosure.

[0027] FIG. 18 is an interaction schematic of a disconnection of an external sound output device provided by some embodiments of the disclosure.

[0028] FIG. 19 is an interaction schematic of a connection of a new sound output device provided by some embodiments of the disclosure.

[0029] FIG. 20 is a schematic flowchart of a volume adjustment method provided by some embodiments of the disclosure.Detailed Description

[0030] Embodiments will be described in detail below, examples of which are illustrated in the drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following embodiments do not represent all implementations that are consistent with the disclosure. They are merely examples of systems and methods that are consistent with some aspects of the disclosure as detailed in the claims.

[0031] It should be noted that the brief description of terms in this disclosure is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of the disclosure. Unless otherwise stated, these terms should be understood according to their ordinary and usual meaning.

[0032] Terms “first”, “second”, “third”, etc. in the description and claims of the disclosure and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0033] Terms “include” and “have” and any variations thereof are intended to cover a non-exclusive inclusion. For example, a product or device that includes a series of components is not necessarily limited to all the componentsVI0423P-WO-0009 Docket No. TD250503944P clearly listed, but may include other components that are not clearly listed or are inherent to these products or devices.

[0034] Term “module” refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0035] In the embodiments of the disclosure, the display apparatus 200 generally refers to an apparatus with screen display and data processing capabilities. For example, the display apparatus 200 includes but is not limited to a smart TV, a mobile terminal, computers, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0036] FIG. 1 is a schematic diagram of an operation scenario between a display apparatus and a remote control device provided by some embodiments of the disclosure. As shown in FIG. 1, a user may operate the display apparatus 200 through touch operations, a mobile terminal 300, and a remote control device 100. For example, the remote control device 100 may be a remote controller, a stylus, a handle, etc.

[0037] The mobile terminal 300 may serve as a remote control device for performing human-computer interaction between the user and the display apparatus 200. The mobile terminal 300 may also serve as a communicating device for establishing a communication connection with the display apparatus 200 for data interaction. In some embodiments, the mobile terminal 300 and the display apparatus 200 may have software applications installed, and realize connection and communication through network communication protocols to achieve a purpose of one-to-one control operations and data communication. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display apparatus 200 to realize a synchronous display function.

[0038] As also shown in FIG. 1 , the display apparatus 200 also performs data communication with the server 400 through various communication methods. The display apparatus 200 may be allowed to establish communication connections through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0039] The display apparatus 200 may provide a broadcast receiving TV function, and may additionally provide an intelligent network TV function with computer support functions, including but not limited to a network TV, a smart TV, an Internet Protocol TV (IPTV), etc.

[0040] FIG. 2 is a block diagram of a hardware configuration of the display apparatus 200 in FIG. 1 provided by some embodiments of the disclosure.

[0041] In some embodiments, the display apparatus 200 may include at least one of a tuning demodulator 210, a communicating device 220, a detector 230, a device interface 240, a processor 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0042] In some embodiments, the detector 230 is used to collect signals from the external environment or interactions with the outside. For example, the detector 230 may include an optical receiver, which is a sensor for collecting the intensity of ambient light; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes, or user interaction gestures; or, the detector 230 may include a sound collector, such as a microphone, etc., for receiving external sounds.VI0423P-WO-0009 Docket No. TD250503944P

[0043] In some embodiments, the display 260 may include a display function component for presenting images and a driving component for driving image display. The display 260 is used to receive image signals output from the processor 250 for display. For example, the display 260 may be used to display components of a video content(s), an image content(s), and a menu control interface(s), and display a user control UI interface(s), etc. In some embodiments, the display apparatus may further include a touch component connected with the display 260, and the touch component is used to detect touch actions on the display 260 and touch position information of the touch actions, and the touch position information may be transmitted to the processor 250 to perform related operations. In some embodiments, the display 260 may be a touch display, on which a touch component is installed, and it is a display with a touch component.

[0044] In some embodiments, the communicating device 220 is a component for communicating with external devices or the server 400 according to various types of communication protocols. The display apparatus 200 may be provided with a plurality of communicating devices 220 according to different communication methods it supports. For example, when the display apparatus 200 supports wireless network communication, the display apparatus 200 may be provided with a communicating device 220 including a WiFi function. When the display apparatus 200 supports Bluetooth connection communication, the display apparatus 200 needs to be provided with a communicating device 220 including a Bluetooth function.

[0045] The communicating device 220 can enable the display apparatus 200 to communicate with external devices or the server 400 through a wireless or wired connection. Among them, the wired connection may be a connection of the display apparatus 200 with an external device through a component such as a data line(s) and an interface(s). The wireless connection may be a connection of the display apparatus 200 with an external device through a wireless signal(s) or a wireless network. The display apparatus 200 may directly establish a connection relationship with an external device, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0046] In some embodiments, the processor 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, as well as first to n* interfaces for input / output. The processor 250 controls the work of the display apparatus and responds to user operations through various software control programs stored in the memory. The processor 250 controls the overall operation of the display apparatus 200.

[0047] In some embodiments, the processor 250 and the tuning demodulator 210 may be located in different separate devices, that is, the tuning demodulator 210 may also be in an external device of the main device where the processor 250 is located, such as an external set-top box.

[0048] In some embodiments, a user can input a user command on a Graphical User Interface (GUI) presented on the display 260, and the user input interface receives the user command through the Graphical User Interface (GUI).

[0049] In some embodiments, the audio output device 270 may be a built-in speaker of the display apparatus 200, or an external audio output device of the display apparatus 200. For the external audio output device of the display apparatus 200, the display apparatus 200 may also be provided with an external audio output terminal, and theVI0423P-WO-0009 Docket No. TD250503944P audio output device maybe connected with the display apparatus 200 through the external audio output terminal to output the sound of the display apparatus 200.

[0050] In some embodiments, the user input interface 280 may be used to receive instructions input from the user. The above-mentioned touch display may serve as an input port of a user input interface, which is used to receive operation signals from fingers or a stylus and convert them into operation instructions.

[0051] FIG. 3 is a block diagram of a hardware configuration of the remote control device in FIG. 1 provided by some embodiments of the disclosure. As shown in FIG. 3, the remote control device 100 may include: a controller 110, a communication interface 130, a user input / output interface 140, a memory 190, and a power supply 180.

[0052] The remote control device 100 is configured to control the display apparatus 200, and can receive operation instructions input from the user, and convert the operation instructions into instructions that the display apparatus 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display apparatus 200.

[0053] In some embodiments, the remote control device 100 may be an intelligent device. For example, the remote control device 100 can install various applications for controlling the display apparatus 200 according to user needs.

[0054] In some embodiments, as shown in FIG. 1, the mobile terminal 300 or other intelligent electronic devices has a function similarly to the remote control device 100 after installing an application for controlling the display apparatus 200.

[0055] The controller 110 may include a central processing unit 112, a RAM 113, a ROM 114 , and a communication bus. The controller 110 is used to control the operation and control of the remote control device 100, as well as the communication and cooperation between internal components of the remote control device and the data processing functions between the outside and the inside of the remote control device.

[0056] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near-field communication modules.

[0057] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces. In some embodiments, the recording device of the remote control device 110 may be the microphone 141.

[0058] In some embodiments, the remote control device 100 includes at least one of a communication interface 130 and a user input / output interface 140. The remote control device 100 is configured with the communication interface 130, such as modules for WiFi, Bluetooth, NFC, etc., which can encode user input instructions through the WiFi protocol, Bluetooth protocol, or NFC protocol, and send them to the display apparatus 200.

[0059] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the remote control device 100 under the control of the processor. The memory 190 can store various control signal instructions input from the user.VI0423P-WO-0009 Docket No. TD250503944P

[0060] The power supply 180 is used to provide operating power support for various components of the remote control device 100 under the control of the processor.

[0061] To perform user interaction, in some embodiments, the display apparatus 200 may run an operating system. The operating system is a computer program used to manage and control hardware resources and software resources in the display apparatus 200. The operating system may (control the display apparatus to) provide a user interface, allow the user to interact with the display apparatus 200, and support the operation of various applications.

[0062] It should be noted that the operating system may be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display apparatus. The operating system can be divided into different modules or levels according to the functions implemented.

[0063] As shown in FIG. 4, which is a schematic diagram of a software configuration in the display apparatus in FIG. 1 provided by some embodiments of the disclosure, in some embodiments, the system of the display apparatus 200 may be divided into three layers, i.e., an application layer, a middleware layer, and a hardware layer from top to bottom respectively.

[0064] The application layer mainly includes common applications on the TV and an application framework. The common applications are mainly application developed based on the Browser, such as HyperText Markup Language 5 applications (HTML5 APPs); and native applications (Native APPs).

[0065] The application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the use interfaces for these functions (toolbars, status bars, menus, dialog boxes).

[0066] Native APPs can support online or offline operations, message push, or local resource access.

[0067] The middleware layer includes various middleware such as a TV protocol(s), a multimedia protocol(s), and a system component(s). Middleware can use the basic services (functions) provided by system software to connect various portions of application systems on the network or different applications, achieving the purpose of resource sharing and function sharing.

[0068] The hardware layer mainly includes Hardware Abstraction Layer (HAL) interfaces, hardware, and a driver(s). The HAL interface is a unified interface for connecting all TV chip, and the specific logic is implemented by each chip. The driver(s) mainly includes: an audio driver(s), a display driver(s), a Bluetooth driver(s), a camera driver(s), a WiFi driver(s), a USB driver(s), an HDMI driver(s), a sensor driver(s) (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver(s).

[0069] It should be noted that the above examples are only a simple division of operating system functions and do not limit the specific operating system form of the display apparatus 200 in the embodiments of the disclosure. Depending on factors such as the functions of the display apparatus and the type of operating system, the number of layers and specific layer types included in the operating system can take other forms.

[0070] In some related technologies, in order to conduct voice interaction with the display apparatus, the operation for users to activate the recording device is cumbersome. For example, to perform voice interaction with theVI0423P-WO-0009 Docket No. TD250503944P display apparatus, the usual method is: the user finds a remote control device, manually activates the recording device of the remote control device, and then sends voice to the display apparatus through the recording device to realize voice interaction with the display apparatus. This method requires the user to manually find the remote controller to activate the recording device, which is relatively cumbersome.

[0071] In some related technologies, the operation for activating the recording device also has the problem of large battery power consumption. For example, when the display apparatus is connected with plurality of remote control devices, blindly activating all remote control devices to activate the recording devices leads to high power consumption of the remote control devices and ineffective battery power loss, reducing the battery life of the remote control devices.

[0072] The instruction sending method provided by some embodiments of the disclosure may be applied to an application environment shown in FIG. 1. In some embodiments, when the display apparatus 200 is connected with a plurality of remote control devices 100 via the near-field communication mode, the display apparatus 200 detects a trigger operation for activating a recording device of the plurality of remote control devices 100. When the trigger operation for activating the recording device of the remote control device 100 is detected, the display apparatus responds to the trigger operation to read usage record data of the plurality of remote control devices. Then, the display apparatus 200 selects at least one remote control device from the plurality of remote control devices 100 according to the usage record data of the plurality of remote control devices and sends an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device. In this way, as long as the trigger operation for activating the recording device of the remote control device 100 is detected (for example, the display apparatus detects a touch operation from the user on an activation control on the touch screen of the display apparatus, or the display apparatus detects an activation operation from the user on a voice function button of the display apparatus), even if the display apparatus 200 is connected with the plurality of remote control devices 100, the display apparatus 200 automatically selects the remote control device to which the activation instruction needs to be sent from the plurality of remote control devices according to the stored usage record data of the remote control devices. It can be seen that during the entire process of activating the recording device, there is no need for the user to manually find the remote control device to activate the recording device of the remote control device, which improves the convenience of user operations. At the same time, the display apparatus automatically decides to activate only one or some remote control devices to activate its recording device. Compared with blindly activating all remote control devices to activate their recording device, this can reduce the power consumption of some remote control devices, avoid ineffective battery power loss, and extend the battery life of the remote control devices.

[0073] FIG. 5 is a flowchart of an instruction sending method according to an exemplary embodiment of the disclosure. This method can be executed by the display apparatus 200 in the application environment shown in FIG. 1. In some embodiments, the display apparatus 200 includes: a display, a communicating device, and a processor. The display is configured to display a user interface; the communicating device is configured to establish a communication connection with a remote control device; and the processor is configured to execute an instruction sending method.VI0423P-WO-0009 Docket No. TD250503944P

[0074] As shown in FIG. 5, an instruction sending method is provided, including the following steps S502 to S506.

[0075] Step S502, based on that the display apparatus is connected with a plurality of remote control devices via a near-field communication mode, in response to a trigger operation for activating a recording device of the remote control device, reading usage record data of the plurality of remote control devices.

[0076] Specifically, when the display apparatus is connected with the plurality of remote control devices via the near-field communication mode, it can detect a trigger operation for activating the recording device of the remote control device. When the trigger operation for activating the recording device of the remote control device is detected, the display apparatus reads the usage record data of the remote control device from the local storage.

[0077] The near-field communication mode may include Bluetooth, local area network (such as WiFi), ZigBee, etc. The display apparatus can connect with the plurality of remote control devices via the near-field communication mode. Each of the plurality of remote control devices may be equipped with a recording device, which can be a microphone or the like, and the recording device is used to receive external sounds. The display apparatus being connected with the plurality of remote control devices via the near-field communication mode means that the plurality of remote control devices are currently in a connected state with the display apparatus, not a disconnected state. The number of the plurality of remote control devices may be two, three, or more, which is not limited in the embodiments of the disclosure. The respective device types of the plurality of remote control devices may be the same or different. For example, the plurality of remote control devices include one Bluetooth remote controller and one mobile terminal serving as a remote control device. Another example is that the plurality of remote control devices include two Bluetooth remote controllers and one mobile terminal serving as a remote control device.

[0078] In some embodiments, the plurality of remote control devices use the same near-field communication method to connect with the display apparatus. Specifically, the plurality of remote control devices include a first remote control device and a second remote control device, and both of the first remote control device and the second remote control device communicate with the display apparatus through a Bluetooth connection. For example, the plurality of remote control devices include two Bluetooth remote controllers, both of which are connected with the display apparatus via Bluetooth, and for the display apparatus, the two Bluetooth remote controls are in a Bluetooth-connected state.

[0079] In some embodiments, the plurality of remote control devices use different near-field communication modes to connect to the display apparatus. Specifically, the plurality of remote control devices include a first remote control device and a second remote control device. The first remote control device communicates with the display apparatus through a Bluetooth connection, and the second remote control device communicates with the display apparatus through a local area network. For example, the plurality of remote control devices include a Bluetooth remote controller and a mobile terminal. The Bluetooth remote controller is connected with the display apparatus via Bluetooth, and the mobile terminal, as a remote control device, is connected with the display apparatus through a network communication protocol. Optionally, the mobile terminal and the display apparatus can have software applications installed respectively to achieve connection and communication through network communication protocol, so as to achieve the purposes of one-to-one control operations and data communication.VI0423P-WO-0009 Docket No. TD250503944P

[0080] The trigger operation for activating the recording device of the remote control device is a trigger operation detected by the display apparatus for activating the recording device of the remote control device. In the embodiments of the disclosure, the trigger operation for activating the recording device of the remote control device is detected by the display apparatus. That is, there is no need for the user to manually activate the recording device of the remote control device; instead, the display apparatus sends an activation instruction to the remote control device for activating the recording device of the remote control device, so as to improve the convenience of user operations. The specific form of the trigger operation for activating the recording device of the remote control device may be a touch operation on the display screen, a trigger operation on a function button, etc.

[0081] The usage record data of the remote control device records the historical usage of the remote control device. The display apparatus can store the usage record data of the remote control device locally and read it from the local storage when a trigger operation for activating the recording device of the remote control device is detected. By adding this additional usage record data of the remote control device as the basis for subsequent decisions, it is possible to automatically and accurately select the remote control device that the user is about to use.

[0082] Step S504: selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices.

[0083] Specifically, the display apparatus can select at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices. The number of remote control devices selected from the plurality of remote control devices according to the usage record data of the plurality of remote control devices may be one or two.

[0084] In some embodiments, when selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices, the remote control device may also be selected according to specific indicators according to actual needs. For example, decisions may be made by combining various dimensions such as the usage frequency, duration of use, device attributes, and release time of each remote control device.

[0085] In some embodiments, the display apparatus may also estimate the probability that each of the plurality of remote control devices connected currently may be used by the user according to the usage record data of the plurality of remote control devices, and select at least one remote control device from the plurality of remote control devices according to the estimated probability.

[0086] Step S506: sending an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.

[0087] Specifically, the display apparatus may send an activation instruction to the at least one remote control device that are selected for activating the recording device of the at least one remote control device. If one remote control device is selected, the display apparatus may send the activation instruction to the one remote control device for activating the recording device of the one remote control device. If two or more remote control devices are selected, the display apparatus may send the activation instruction to each of these remote control devices for activating the recording device of each remote control device.VI0423P-WO-0009 Docket No. TD250503944P

[0088] That is, the display apparatus does not blindly send a recording activation instruction to each of the plurality of remote control devices connected currently, but selectively sends the recording activation instruction to some of the plurality of remote control devices. This avoids blindly activating the recording devices of all remote control devices, can reduce the power consumption of some remote control devices, avoids ineffective battery power loss, and extends the battery life of the remote control devices.

[0089] In some embodiments, if the read usage record data of the plurality of remote control devices indicates that a target remote control device among the plurality of remote control devices is a remote control device used last time, the display apparatus sends the activation instruction to the target remote control device for activating the recording device of the target remote control device. In this embodiment, the target remote control is the remote control device that the user is currently likely to use. By selecting the remote control device used last time from the plurality of remote control devices currently in a connected state as the target remote control device, it is possible to predict the remote control device that the user is currently likely to use, making the selected remote control device as consistent as possible with the user's needs.

[0090] In the above instruction sending method, based on that the display apparatus is connected with the plurality of remote control devices via the near-field communication mode, in response to the trigger operation for activating the recording device of the remote control device, the usage record data of the plurality of remote control devices is read, at least one remote control device is selected from the plurality of remote control devices according to the usage record data of the plurality of remote control devices, and an activation instruction for the recording device is sent to the at least one remote control device. That is, the remote control device to which the activation instruction needs to be sent is automatically selected according to the stored usage record data of the remote control device, eliminating the need for the user to manually find the remote control device to activate the recording device, which improves the convenience of user operations. At the same time, by deciding to activate only one or some remote control devices to activate its recording device, compared with blindly activating all remote control devices to activate their recording device, it can reduce the power consumption of some remote control devices, avoid ineffective battery power loss, and extend the battery life of the remote control devices.

[0091] In some embodiments, the display apparatus may display a user interface of an application through the display, and the user interface of the application includes an activation control for activating the recording device. The display apparatus detects a trigger operation on the activation control, and reads the usage record data of the remote control devices when such a trigger operation is detected.

[0092] In this embodiment, the trigger operation for activating the recording device of the remote control device is a touch operation on the display screen. Specifically, the display apparatus can display a user interface of an application through the display, and the user interface of the application includes an activation control for activating the recording device. When the user needs to activate the recording device of the remote control device, they perform a trigger operation on the activation control when the display apparatus displays the user interface of the application including the activation control for activating the recording device. In this way, after the display apparatus detects the trigger operation on the activation control in the user interface of the application, it reads the usage record data of the remote control devices to select at least one remote control device from the plurality ofVI0423P-WO-0009 Docket No. TD250503944P remote control devices according to the usage record data of the remote control devices, and sends an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device. In this embodiment, there is no need for the user to look for the remote control device; the user only needs to touch the display to automatically activate the recording device of the remote control device. Compared with the user manually finding the remote control device to activate the recording device, this operation method is very convenient, especially for the elderly, as touching the display is more convenient than operating a small remote control.

[0093] In some embodiments, the display apparatus is provided with a function button for activating a recording device of a remote control device. The display apparatus can detect a trigger operation on the function button (such as a rotation operation, a pressing operation), and read usage record data of the remote control devices when such a trigger operation is detected.

[0094] In this embodiment, the trigger operation for activating the recording device of the remote control device is a trigger operation on the function button. Specifically, after the display apparatus detects the trigger operation on the function button, it reads the usage record data of the remote control devices to select at least one remote control device from the plurality of remote control devices according to the usage record data of the remote control devices, and sends an activation instruction to the at least one remote control device for activating the recording device of at least one remote control device. In this embodiment, there is no need for the user to look for the remote control device; the user only needs to press or rotate the function button of the display apparatus to automatically activate the recording device of the remote control device, which is very convenient compared with the user manually finding the remote control device to activate the recording device.

[0095] In some embodiments, for each of the plurality of remote control devices, when receiving an operation instruction from the remote control device via the near-field communication mode, the display apparatus can record locally instruction information of the operation instruction of the remote control device in the usage record data of the remote control devices. The instruction information includes at least one of instruction trigger time and an instruction type.

[0096] Specifically, the display apparatus can detect the connection of the remote control device. When a remote control device is connected with the display apparatus, the display apparatus will receive an interactive operation instruction sent by the remote control device for interaction with the display apparatus, so that the generated interactive operation instructions can be recorded, thereby providing a basis for subsequent selection of the remote control device. The interactive operation instruction includes, but is not limited to, a voice interaction instruction, a key interaction instruction, a control instruction, etc. Optionally, for an interactive operation instruction generated each time, the display apparatus can record at least one of the following information: a device identifier of the remote control device that generated the interactive operation instruction, a device type of the remote control device that generated the interactive operation instruction, a type of the interactive operation instruction generated each time, and the time of the interactive operation instruction generated each time. In this way, the display apparatus can count the usage record data of the remote control device based on this information, including but not limited to at least one of the following data: the time when each remote control device last usedVI0423P-WO-0009 Docket No. TD250503944P the voice remote control function, the time when each remote control device last used a key, the device usage frequency of each remote control device, the device identifier of the remote control device used the most frequently within a set time range (such as within 1 day, 1 week, 1 month), the device identifier of the remote control device used for the longest time within a set time range, the device identifier of the remote control device used earliest within a set time range, etc.

[0097] In some embodiments, the remote control device can detect its own state data through its own detector and report the state data to the display apparatus when connected with the display apparatus. The detector may be a gravity accelerometer, a gyroscope, a light detector, etc. When the remote control device is picked up or put down, the gravity accelerometer will detect different gravitational accelerations of the remote control device. When the remote control device is moved or used, the gyroscope will detect different attitude data of the remote control device. When the remote control device is held, the light detector will detect different light intensities around the remote control device. The state data may include at least one of gravitational acceleration data, attitude data, or light intensity. Thus, the display apparatus can count the usage record data of the remote control device based on the reported state data. For example, according to at least one of changes in gravitational acceleration data, changes in attitude data, and changes in light sensitivity, the last use time of each remote control device, the device usage frequency of each remote control device, the device identifier of the remote control device used the most frequently within a set time range (such as within 1 day, 1 week, 1 month), the device identifier of the remote control device used for the longest time within a set time range, the device identifier of the remote control device used earliest within a set time range, etc., are determined.

[0098] In an embodiment, the remote control device is connected with the display apparatus through the Bluetooth protocol as a human-machine interaction device (Human Interface Device). After the remote control device is connected with the display apparatus through the Bluetooth protocol, an external device interface module of the display apparatus for directly accessing the human-machine interaction device will detect the remote control device and create a HIDraw file for the remote control device in a local specified path (such as / dev / ). A statistical decision module of the display apparatus can read the HIDraw file in the local specified path. Every time an interactive operation occurs between the remote control device and the display apparatus, the HIDraw file will change. The statistical decision module of the display apparatus can read an original data packet corresponding to each interactive operation from the HIDraw file and parse the original data packet to obtain a specific type and content of the interactive operation (such as the operation type is a key operation, and the instruction of the key operation is “confirm”), and record it corresponding to the time. In this way, the usage record data of the remote control device can be counted based on the recorded data.

[0099] FIG. 6 is a timing diagram of interaction between a remote control device and a display apparatus in some embodiments. Referring to FIG. 6, the remote control device interacts with the display apparatus via the Bluetooth protocol. The display apparatus includes an external device interface module (which may be, for example, a HIDraw processing module) and a statistical decision module. First, the remote control device is bound to and successfully connected with the display apparatus through the Bluetooth protocol. At this time, the display apparatus will create a HIDraw file for the remote control device in a specified local path. Then, the externalVI0423P-WO-0009 Docket No. TD250503944P device interface module of the display apparatus is used to monitor a new HIDraw file in the specified local path and read the HIDraw file. Whenever an interactive operation occurs and is recorded in the HIDraw file, the external device interface module is used to read the HIDraw file to transmit the interactive operation data of the remote control device to the statistical decision module. The statistical decision module is used to generate the usage record data of the remote control device based on the obtained interactive operation data.

[0100] In an embodiment, the remote control device, as an Internet of Things (loT) device, connects with the display apparatus through a network protocol. After the remote control device is connected with the display apparatus via the network protocol, every time an interaction occurs between the remote control device and the display apparatus, the display apparatus records the specific type and content of each interactive operation (such as a key operation and which key, e.g., “ confirm”) and records it in correspondence with a timestamp. In this way, the usage record data of the remote control device can be counted based on all the recorded data. For example, the remote control device can be a mobile terminal, which can connect with the display apparatus as an loT device via a local area network.

[0101] FIG. 7 is a timing diagram of interactions between a remote control device and a display apparatus in some embodiments. Referring to FIG. 7, the remote control device interacts with the display apparatus through a network protocol. The display apparatus includes an external device interface module (which may be, for example, an loT module), a statistical decision module, and a voice service module. First, the remote control device is bound to and successfully connected with the display apparatus based on the network protocol. At this time, the external device interface module of the display apparatus will monitor the access of the remote control device, and also monitor an interactive operation instruction initiated by the remote control device, and send the interactive operation instruction to the statistical decision module. The statistical decision module generates the usage record data of the remote control device based on the obtained interactive operation data.

[0102] In some embodiments, the display apparatus may also regularly clean up the locally stored usage record data of the remote control devices. For example, data related to interactive operation instructions that exceed a preset time range are deleted in a timely manner to reduce the occupation of the display apparatus's storage space.

[0103] In some embodiments, after sending the activation instruction to the at least one remote control device that is selected for activating the recording device of the at least one remote control device, the method further includes: receiving recording data sent by the at least one remote control device, here the recording data is collected by the at least one remote control device through the recording device of the at least one remote control device after at least one remote control device receives the activation instruction and activates the recording device of at least one remote control device; performing voice recognition on the recording data to obtain a voice instruction; displaying a user interface corresponding to the voice instruction through the display.

[0104] In this embodiment, after receiving the activation instruction, the remote control device activates the recording device, collects sound through the recording device, and sends the collected recording data to the display apparatus. The display apparatus receives the recording data sent by the remote control device, performs voice recognition on the recording data to obtain a voice instruction, and displays a user interface corresponding to the voice instruction through the display.VI0423P-WO-0009 Docket No. TD250503944P

[0105] For example, when the user says "Turn on XX TV drama", the display apparatus can display the TV drama interface through the display, facilitating the user to conveniently select an episode they are interested in from the TV drama interface to play. Alternatively, the display apparatus can directly display the playback interface of "XX TV drama" through the display after searching according to "XX TV drama", without the need for the user to operate via the remote control device, which is very convenient.

[0106] FIG. 8 is a timing diagram of interaction between a remote control device and a display apparatus in some embodiments. Referring to FIG. 8, both remote control device A and remote control device B are in a connected state with the display apparatus. The display apparatus includes an external device interface module, a statistical decision module, and a voice service module. The interaction process includes the following steps.

[0107] Step S802: the display apparatus detects a trigger operation for activating a recording device of a remote control device.

[0108] When recording devices of both remote control devices A and B are not activated, the display apparatus can actively detect a trigger operation for activating the recording device of the remote control device, and notify the statistical decision module when such a trigger operation is detected.

[0109] Step S804: the statistical decision module is configured to select one remote control device from remote control device A and remote control device B according to usage record data of remote control devices.

[0110] Specifically, the statistical decision module is configured to select one remote control device from a plurality of remote control devices according to preset rules in combination with the usage record data of the remote control device. For example, the statistical decision module is configured to select the remote control device that used the recording function most recently or the remote control device that performed a key operation most recently.

[0111] Step S806: the statistical decision module is configured to send an activation instruction to the selected remote control device for activating the recording device of the remote control device.

[0112] If the statistical decision module selects the remote control device A, it sends an activation instruction to the remote control device A for activating the recording device of the remote control device A. If the statistical decision module selects the remote control device B, it sends an activation instruction the recording device to the remote control device B for activating the recording device of the remote control device B.

[0113] Step S808: the remote control device that receives the activation instruction activates the recording device and collects sound.

[0114] If the statistical decision module selects the remote control device A, after receiving the activation instruction, the remote control device A activates its recording device, collects sound, and sends the recording data to the display apparatus.

[0115] Step S810: the external device interface module of the display apparatus is configured to receive the recording data sent by the remote control device.

[0116] Step S812: the external device interface module of the display apparatus is configured to transmit the recording data to the voice service module.VI0423P-WO-0009 Docket No. TD250503944P

[0117] Step S814: the voice service module of the display apparatus is configured to perform voice recognition on the recording data to obtain a voice instruction.

[0118] In the embodiment shown in FIG. 8, by adding such a remote control device selection process, the most likely remote control device that the user wants to use is selected from the plurality of remote control devices to automatically activate the recording function, which improves the convenience of user operations and saves battery power consumption of other remote control devices.

[0119] FIG. 9 is a timing diagram of interaction between a remote control device and a display apparatus in some embodiments. Referring to FIG. 9, both the remote control device A and the remote control device B are connected with the display apparatus via the Bluetooth protocol. The display apparatus includes an external device interface module, a statistical decision module, and a voice service module. The interaction process between the remote control devices and the display apparatus includes the following steps. For the remote control device A, the interaction process includes following steps.

[0120] Step S902a, the remote control device A is bound to and successfully connected with the display apparatus based on the Bluetooth protocol.

[0121] Step S904a, the external device interface module is configured to monitor a new HIDraw file.

[0122] Step S906a, the external device interface module is configured to read the HIDraw file to transmit the interaction operation data of the remote control device A to the statistical decision module.

[0123] Similarly, the interaction process between the remote control device B and the display apparatus includes the following steps.

[0124] Step S902b, the remote control device B is bound to and successfully connected with the display apparatus based on the Bluetooth protocol.

[0125] Step S904b, the external device interface module is configured to monitor a new HIDraw file.

[0126] Step S906b, the external device interface module is configured to read the HIDraw file to transmit the interaction operation data of the remote control device B to the statistical decision module.

[0127] When the interaction operation data is the recording data of voice interaction, the external device interface module is also configured to transmit the recording data sent by the remote control device A and / or the remote control device B to the voice service module, and the voice service module can perform voice recognition on the recording data to obtain a voice instruction.

[0128] The interaction process between the remote control device A and the display apparatus further includes following steps.

[0129] Step S908a, the remote control device A actively activates a recording device, collects sound, and sends the recording data to the display apparatus.

[0130] Step S910a, the external device interface module is configured to receive the recording data.

[0131] Step S912a, the external device interface module is configured to notify the statistical decision module of a current recording operation of remote control device A, so that the statistical decision module can generate usage record data of the remote control device.VI0423P-WO-0009 Docket No. TD250503944P

[0132] Step S914a, the external device interface module is configured to transmit the received recorded data to the voice service module, and the voice service module can perform voice recognition on the recording data to obtain a voice instruction.

[0133] Similarly, the interaction process between the remote control device B and the display apparatus further includes following steps.

[0134] Step S908b, the remote control device B actively activates a recording device, collects sound, and sends the recording data to the display apparatus.

[0135] Step S910b, the external device interface module is configured to receive the recording data.

[0136] Step S912b, the external device interface module is configured to notify the statistical decision module of a current recording operation of the remote control device B, so that the statistical decision module can generate usage record data the remote control device.

[0137] Step S914b, the external device interface module is configured to transmit the received recording data to the voice service module, and the voice service module can perform voice recognition on the recording data to obtain a voice instruction.

[0138] The interaction process between the remote control device and the display apparatus shown in FIG. 9 further includes the following step:step S916, the statistical decision module generates the usage record data of the remote control device based on the acquired interaction operation data.

[0139] When the recording devices of the remote control devices A and B are turned off and cannot record, the following steps are executed.

[0140] Step S918, the display apparatus detects a trigger operation for activating the recording device of the remote control device. It should be noted that the recording devices of the remote control devices A and B may be turned off actively by the user or automatically turned off after no sound is collected for a long time.

[0141] When the recording devices of both remote control devices A and B are turned off, the display apparatus can actively detect a trigger operation for activating the recording device of the remote control device, and notify the statistical decision module when such a trigger operation is detected. As described above, in some embodiments, the display apparatus can display a user interface of an application through the display, and the user interface of the application includes an activation control for activating the recording device. The display apparatus detects a trigger operation on the activation control, which is regarded as detecting a trigger operation for activating the recording device of the remote control device. In some embodiments, the display apparatus is provided with a function button for activating the recording device of the remote control device, and detecting a trigger operation (such as a rotation operation or a pressing operation) on the function button is regarded as detecting a trigger operation for activating the recording device of the remote control device.

[0142] Step S920, The statistical decision module is configured to select a remote control device from the remote control device A and the remote control device B according to the usage record data of the remote control devices.

[0143] For example, the statistical decision module is configured to select the remote control device that used the recording function most recently or the remote control device that performed a key operation most recently.Y1VI0423P-WO-0009 Docket No. TD250503944P

[0144] Step S922: The statistical decision module is configured to send an activation instruction to the selected remote control device for activating the recording device of the remote control device.

[0145] If the statistical decision module selects the remote control device A, it sends an activation instruction to the remote control device A for activating the recording device of the remote control device A. If the statistical decision module selects the remote control device B, it sends an activation instruction to the remote control device B for activating the recording device of the remote control device B.

[0146] Step S924, the remote control device that receives the activation instruction activates the recording device and collects sound.

[0147] If the statistical decision module selects the remote control device A, after receiving the activation instruction, the remote control device A activates its recording device, collects sound, and sends the recording data to the display apparatus. If the statistical decision module selects the remote control device B, after receiving the activation instruction, the remote control device B activates its recording device, collects sound, and sends the recording data to the display apparatus.

[0148] Step S926, the external device interface module of the display apparatus is configured to receive the recording data sent by the selected remote control device.

[0149] Step S928, the external device interface module of the display apparatus is configured to transmit the recording data to the voice service module.

[0150] Step S930, the voice service module of the display apparatus is configured to perform voice recognition on the recording data to obtain a voice instruction.

[0151] In the embodiment shown in FIG. 9, by adding the step of counting the historical usage records of remote control devices to form usage record data of the remote control devices, which serves as the basis for selecting a remote control device when the display apparatus is connected with a plurality of remote control devices, it is convenient to select the most likely remote control device that the user wants to use from the plurality of remote control devices to automatically activate the recording function, which improves the convenience of user operations and saves battery power consumption of other remote control devices.

[0152] Based on a similar concept, the following embodiments are also provided.

[0153] In some embodiments, when a display apparatus is connected with a plurality of remote control devices the via near-field communication mode, it can read the usage record data of the remote control devices in response to a trigger operation for activating an image capture device of the remote control device, select at least one remote control device from the plurality of remote control devices according to the usage record data of the remote control devices, and send an activation instruction for the image capture device to the at least one remote control device.

[0154] The image capture device of the remote control device may be a camera. The usage record data of the remote control device can be generated based on the usage records of the buttons of the remote control device, the usage records of the recording device, and the usage records of the image capture device.

[0155] In this embodiment, when the display apparatus is connected with the plurality of remote control devices via the near-field communication mode, in response to the trigger operation for activating the image captureVI0423P-WO-0009 Docket No. TD250503944P device of the remote control device, the usage record data of the remote control devices is read; at least one remote control device is selected from the plurality of remote control devices according to the usage record data of the remote control devices; and an activation instruction for the image capture device is sent to the at least one remote control device. That is, the remote control device to which the activation instruction needs to be sent is automatically selected according to the stored usage record data of the remote control devices, eliminating the need for the user to manually find the remote control device to activate image capture, which improves the convenience of user operations. At the same time, by deciding to activate only one or some remote control devices to start image capture, compared with blindly activating all remote control devices to start image capture, it can reduce the power consumption of some remote control devices, avoid ineffective battery power loss, and extend the battery life of the remote control devices.

[0156] In some embodiments, based on that the usage record data of the read remote control devices indicates that a target remote control device among the plurality of remote control devices is a remote control device used last time, an activation instruction for the image capture device is sent to the target remote control device.

[0157] In some embodiments, the display apparatus receives image data sent by the at least one remote control device that is selected. The image data is collected by the at least one remote control device through the image capture device of the at least one remote control device after the at least one remote control device receives the activation instruction and activates the image capture device of the at least one remote control device. Then, the display apparatus performs face recognition according to the image data to obtain a facial feature, and displays a target user interface through the display if the facial feature matches a stored target facial feature.

[0158] In this embodiment, after receiving the activation instruction, the remote control device activates the image capture device, captures images through the image capture device, and sends the images to the display apparatus. The display apparatus receives the images sent by the remote control device, performs face recognition, and can display the target user interface through the display after successful face recognition.

[0159] For example, based on that the image captured by the remote control device is a facial image of a parent user, the display apparatus may display a TV drama interface through the display. For example, if the image captured by the remote control device is a facial image of a child user, the display apparatus may display an animation interface through the display. There is no need for the user to operate through the remote control device, which is very convenient.

[0160] In some embodiments, the display apparatus may also display a user interface of an application through the display, here the user interface of the application includes an activation control for activating the image capture device; then, the display apparatus may detect the trigger operation on the activation control, and read the usage record data of the remote control devices when the trigger operation on the activation control is detected.

[0161] In this embodiment, the trigger operation for activating the image capture device of the remote control device is a touch operation on the display screen. Specifically, the display apparatus can display a user interface of an application through the display, and the user interface of the application includes an activation control for activating the image capture device. When the user needs to activate the image capture device of the remote control device, they can perform a trigger operation on the activation control when the display apparatus shows theVI0423P-WO-0009 Docket No. TD250503944P user interface of the application including the activation control for activating the image capture device. In this way, after the display apparatus detects the trigger operation on the activation control in the user interface of the application, it reads the usage record data of the remote control devices to select at least one remote control device from the plurality of remote control devices according to the usage record data of the remote control devices, and sends an activation instruction for activating the image capture device to the at least one remote control device. In this embodiment, there is no need for the user to look for the remote control device; the user only needs to touch the display to automatically activate the image capture device of the remote control device. Compared with the user manually finding the remote control device to activate the image capture device, this operation method is very convenient, especially for the elderly, as touching the display is more convenient than operating a small remote control.

[0162] In some embodiments, the display apparatus can also detect a trigger operation on a function button for activating the image capture device of the remote control device, and read the usage record data of the remote control devices when the trigger operation on the function button is detected.

[0163] In this embodiment, the trigger operation for activating the image capture device of the remote control device is a trigger operation on the function button. Specifically, after the display apparatus detects the trigger operation on the function button, it reads the usage record data of the remote control devices to select at least one remote control device from the plurality of remote control devices according to the usage record data of the remote control devices, and sends an activation instruction for activating the image capture device to the at least one remote control device. In this embodiment, there is no need for the user to look for the remote control device; the user only needs to press or rotate the function button of the display apparatus to automatically activate the image capture device of the remote control device. Compared with the user manually finding the remote control device to activate the image capture device, this operation method is very convenient.

[0164] Based on a similar concept, the following embodiments are also provided.

[0165] In some embodiments, when the display apparatus is connected with a plurality of remote control handles via a near-field communication mode, in response to a trigger operation for locating the remote control handles, the usage record data of the remote control handles is read; at least one remote control handle is selected from the plurality of remote control handles according to the usage record data of the remote control handles; and a vibration instruction or a sound effect instruction is sent to the at least one remote control handle.

[0166] The remote control handle may be a game handle. In this embodiment, the remote control handle to which the vibration instruction or sound effect instruction needs to be sent is automatically selected according to the stored usage record data of the remote control handles. There is no need for the user to manually find the remote control handle, and the remote control handle can be located automatically through the vibration of the remote control handle or the sound effect emitted by the remote control handle, which improves the convenience of user operations. At the same time, by deciding to activate only one or some remote control handles to start vibration or play sound effect, compared with blindly activating all remote control handles to vibrate or play sound effects, it can reduce the power consumption of some remote control handles, avoid ineffective battery power loss, and extend the battery life of the remote control handles.VI0423P-WO-0009 Docket No. TD250503944P

[0167] In some embodiments, the display apparatus may also display a user interface of an application through the display, here the user interface of the application includes a positioning control for locating the remote control handle; the display may detect a trigger operation on the positioning control, and read the usage record data of the remote control handles when the trigger operation on the positioning control is detected.

[0168] In this embodiment, the trigger operation for locating the remote control handle is a touch operation on the display screen. Specifically, the display apparatus can display a user interface of an application through the display, and the user interface of the application includes a positioning control for locating the remote control handle. When the user needs to find the remote control handle, they can perform a trigger operation on the positioning control. In this way, after the display apparatus detects the trigger operation on the positioning control in the user interface of the application, it reads the usage record data of the remote control handles to select at least one remote control handle from the plurality of remote control handles according to the usage record data of the remote control handles, and sends a vibration instruction or a sound effect instruction to the at least one remote control handle. In this embodiment, there is no need for the user to look for the remote control handle; the user only needs to touch the display to automatically trigger the remote control handle to vibrate or play sound effects. Compared with the user manually finding the remote control handle, this operation method is very convenient.

[0169] In some embodiments, the display apparatus may also detect a trigger operation on a function button used to locate the remote control handle, and read the usage record data of the remote control handles when a trigger operation on the function button is detected.

[0170] In this embodiment, the trigger operation for locating the remote control handle is a trigger operation on the function button. Specifically, after the display apparatus detects the trigger operation on the function button, it reads the usage record data of the remote control handles to select at least one remote control handle from the plurality of remote control handles according to the usage record data of the remote control handles, and sends a vibration instruction or a sound effect instruction to the at least one remote control handle. In this embodiment, there is no need for the user to look for the remote control handle; the user only needs to press or rotate the function button of the display apparatus to automatically trigger the remote control handle to vibrate or play sound effects, which is very convenient.

[0171] In a specific embodiment, an instruction sending method executed by a display apparatus is provided, which includes the following steps.

[0172] 1. The display apparatus connects with a remote control device (s) via a near-field communication mode.

[0173] 2. The remote control device sends a key instruction to the display apparatus.

[0174] 3. The display apparatus receives the key instruction, records the trigger time of the key instruction, and records the device identifier of the remote control device, the trigger time of the key instruction, and the instruction type in a corresponding manner.

[0175] 4. When the user actively activates the recording device of the remote control device, the remote control device can collect sound and send the recording data to the display apparatus.VI0423P-WO-0009 Docket No. TD250503944P

[0176] 5. The display apparatus receives the recording data, records the trigger time of the recording data, and records the device identifier of the remote control device, the trigger time of the recording data, and the instruction type in a corresponding manner.

[0177] The display apparatus also performs voice recognition on the recording data.

[0178] 6. The display apparatus generates usage record data of the remote control devices according to the recorded operation-related data of each remote control device.

[0179] 7. Based on that the display apparatus is connected with plurality of remote control devices a via near- field communication mode and recording devices of the plurality of remote control devices are in an off state, the display apparatus detects a trigger operation for activating the recording device of the remote control device.

[0180] 8. Based on that the display apparatus detects the trigger operation for activating the recording device of the remote control device, it reads the usage record data of the remote control device.

[0181] In some embodiments, the display apparatus displays a user interface of an application through the display, and the user interface of the application includes an activation control for activating the recording device; the display apparatus detects a trigger operation on the activation control, and reads the usage record data of the remote control devices when the trigger operation on the activation control is detected.

[0182] In some embodiments, the display apparatus detects a trigger operation on a function button used to activate the recording device of the remote control device, and reads the usage record data of the remote control devices when the trigger operation on the function button is detected.

[0183] 9. The display apparatus selects at least one remote control device from the plurality of remote control devices currently connected with display apparatus according to the usage record data of the remote control devices.

[0184] 10. The display apparatus sends an activation instruction to the at least one remote control device that is selected for activating the recording device of the at least one remote control device.

[0185] 11. The at least one remote control device that receives the activation instruction activates the recording device, collects sound through the recording device, and sends recording data to the display apparatus.

[0186] 12. The display apparatus receives the recording data and performs voice recognition according to the recording data to obtain a voice instruction.

[0187] 13. A user interface corresponding to the voice instruction is displayed through the display.

[0188] FIG. 10 is a schematic flowchart of selecting a remote controller in some embodiments. Referring to FIG.10, a user can trigger a trigger operation for activating the recording device through an application of the display apparatus. The display apparatus detects the trigger operation, selects one remote controller from a plurality of remote controllers according to usage records of the remote control device stored locally, and then sends an activation instruction for activating the recording device to the remote controller that is selected through a Bluetooth driver. The Bluetooth driver is a program in the display apparatus that can communicate with the remote controller.

[0189] In the embodiments, an instruction sending method is provided. The display apparatus automatically selects the remote control device to which the activation instruction needs to be sent according to the stored usageLVI0423P-WO-0009 Docket No. TD250503944P record data of the remote control devices. There is no need for the user to manually find the remote control device to activate the recording function, which improves the convenience of user operations. At the same time, when the display apparatus is connected with a plurality of remote control devices via the near-field communication mode, it decides to activate only one or some of the remote control devices to activate the recording function. Compared with blindly activating all remote control devices to activate the recording function, the power consumption of some remote control devices can be reduced, ineffective battery power loss can be avoided, and the battery life of the remote control devices can be extended.

[0190] It should be understood that although the various steps in the flowcharts involved in the above embodiments are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in the sequence indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least part of other steps or stages in other steps.

[0191] Based on the same inventive concept, the embodiments of the disclosure further provide an instruction sending apparatus for implementing the above-mentioned instruction sending method. The implementation solution for solving the problem provided by the instruction sending apparatus is similar to the implementation solution described in the above method. Therefore, the specific limitations in one or more embodiments of the instruction sending apparatus provided below can refer to the limitations on the instruction sending method above, and will not be repeated here.

[0192] Each module in the above instruction sending apparatus can be fully or partially implemented by software, hardware, or a combination thereof. The above modules can be embedded in or independent of the processor in the display apparatus in the form of hardware, or stored in the memory in the display apparatus in the form of software, so that the processor can call and perform the operations corresponding to the above modules.

[0193] In some embodiments, when using a display apparatus to play a media resource, synchronized sound output is required. The media resource includes a video(s), an audio(s), a TV program(s), etc. The display apparatus have various sound output methods, including but not limited to a built-in speaker of the display apparatus, a wired connection device (e.g., a wired headphones, wired speakers, etc.), and a Bluetooth connection device (such as Bluetooth headphones, Bluetooth speakers, etc.). The Built-in speaker refers to a system-built sound output device of the display apparatus, enabling the display apparatus to produce sound by itself. Both the wired connection device and the Bluetooth connection device are external sound output devices of the display apparatus. Users can adjust the volume of these sound output devices by adjusting volume keys of the remote controller or using voice control.

[0194] However, there are certain limitations on the sound output of the display apparatus currently. For example, it is impossible to adjust the volume of multiple external sound output devices of different types at the same time, such as Bluetooth headphones and Bluetooth speakers. Considering that in practical applications, there may beVI0423P-WO-0009 Docket No. TD250503944P scenarios where multiple external sound output devices of different types need to produce sound. Taking the Bluetooth headphones and the Bluetooth speaker as an example, suppose a user wears the Bluetooth headphones in a room, and the Bluetooth speaker is in the living room. In this scenario, both the user in the room and the user in the living room need to hear the sound from the display apparatus, that is, both the Bluetooth headphones and the Bluetooth speaker need to produce sound. For users, being able to adjust the volume of both the Bluetooth headphones and the Bluetooth speaker at the same time in this scenario is undoubtedly more intelligent and convenient. Of course, multiple sound output devices of different types are not limited to Bluetooth headphones and Bluetooth speakers, and can also be a wired connection device and a Bluetooth device, such as a wired headphone and Bluetooth headphones.

[0195] Based on this, in order to enable the display apparatus to adjust the volume of multiple external sound output devices of different types at the same time, the embodiments of the disclosure provides a display apparatus. Users can pre-select a target sound output device type that needs to produce sound, so that the volume of all external sound output devices belonging to the target sound output device type can be adjusted. The target sound output device type can be a Bluetooth-connected device and a non-Bluetooth-connected device, or a specified sound output device type. If the user selects the Bluetooth-connected device, the volume of a plurality of sound output devices that are connected with the display apparatus via Bluetooth can be adjusted, and the plurality of sound output devices connected with the display apparatus include but not limited to Bluetooth headphones and Bluetooth speakers. If the user selects the non-Bluetooth-connected device, the volume of a plurality of sound output devices that are connected with the display apparatus through a connection method other than Bluetooth, such as a wired connection and a Wi-Fi direct connection, can be adjusted, and the plurality of sound output devices connected with the display apparatus include but not limited to a wired connection device (e.g., a wired headphone, a wired speaker) and a Wi-Fi-connected device. If the user selects the specified sound output device type, the volume of a plurality of sound output devices belonging to the specified sound output device type can be adjusted. For example, if the specified sound output device type is a headphone device type, the volume of all Bluetooth headphones and wired headphones can be adjusted. Of course, the specified sound output device type can be set according to actual conditions, such as a speaker device type, which is not limited in the embodiments of the disclosure. In this way, on the one hand, the intelligence and convenience of volume adjustment are effectively improved. On the other hand, the display apparatus can also connect with more sound output devices, enhancing the diversity of sound output from the display apparatus.

[0196] The embodiments of the disclosure also provide a display apparatus, which includes a display and at least one processor connected with the display.

[0197] The display is configured to display a user interface. The user interface refers to an interface through which the at least one processor of the display apparatus interacts with the user, the user interface includes but not limited to elements such as menus, icons, and buttons. The users can interact with the display apparatus through the user interface.

[0198] In some embodiments, the display is also configured to display a sound output device type selection page, which can be understood as a page used to display a plurality of candidate sound output device types. The usersVI0423P-WO-0009 Docket No. TD250503944P may select the target sound output device type from the plurality of candidate sound output device types through the sound output device type selection page.

[0199] In some embodiments, the display is also configured to display a volume bar. It should be noted that while the display apparatus can adjust the volume of a plurality of sound output devices of different types, it also supports adjusting the volume of a single sound output device. The volume bar displayed when adjusting the volume of the plurality of sound output devices may be different from the volume bar displayed when adjusting the volume of the single sound output device. For example, the volume bar displayed when adjusting the volume of the plurality of sound output devices can only display volume adjustment icons, while the volume bar displayed when adjusting the volume of the single sound output device can display specific volume values.

[0200] The at least one processor connected with the display is configured to: based on that a target object has selected a target sound output device type, in response to a first volume adjustment instruction, determine a plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type; the plurality of external sound output devices include sound output devices of different subdevice types.

[0201] The target object may refer to the user. The target sound output device type may refer to a type of sound output device that needs to produce sound, or the type of a sound output device that the target object (i.e., the user) allows to be used to produce sound, includes but not limited to a Bluetooth-connected device, a non-Bluetooth- connected device, or a specified sound output device type. It can be understood that the volume adjustment performed after the user selects the target sound output device type may be the volume adjustment for all external sound output devices belonging to the target sound output device type. Each sound output device type may have a plurality of matching external sound output devices. The external sound output devices refer to sound output devices externally connected with the display apparatus. Taking a Bluetooth-connected device as an example, the Bluetooth-connected device may be Bluetooth headphones, Bluetooth speakers, or other sound output devices that can connect with the display apparatus via Bluetooth.

[0202] The first volume adjustment instruction is a volume adjustment instruction matching the target sound output device type, or a volume adjustment instruction for all of the external sound output devices belonging to the target sound output device type. The external sound output devices are connected with the display apparatus. The sub-device type refers to the device type of the external sound output device itself. It can be understood that the target sound output device type is a broad category, and each external sound output device belonging to the target sound output device type has its own device type. For example, taking the Bluetooth-connected device as an example, the Bluetooth-connected device includes Bluetooth headphones and Bluetooth speakers. The sub-device type of Bluetooth headphones is a Bluetooth headphone type, and the sub-device type of Bluetooth speakers is a Bluetooth speaker type, which are different. It should be noted that the embodiments are also applicable to volume adjustment of a plurality of external sound output devices with the same sub-device type, such as a plurality of Bluetooth headphones.

[0203] For example, after the user pre-selects the target sound output device type through the sound output device type selection page displayed on the display, if the at least one processor receives the first volumeVI0423P-WO-0009 Docket No. TD250503944P adjustment instruction initiated by the user through the remote controller or the voice control, it can first query device information of each candidate sound output device externally connected with the display apparatus, the device information includes but not limited to device name, device address, device connection status, the sound output device type it belongs to (i.e., the sound output device type to which the candidate sound output device belongs), sub-device type, current device volume (i.e., the current volume value of the candidate sound output device), etc. Then, from these candidate sound output devices, pick out sound output devices whose sound output device type is consistent with the target sound output device type. These sound output devices are the plurality of external sound output devices belonging to the target sound output device type.

[0204] It can be understood that the consistency between the sound output device type to which the candidate sound output device belongs and the target sound output device type may be the consistency of type names or the consistency of type identifiers. For example, if the target sound output device type is “Bluetooth-connected device” and the sound output device type of the candidate sound output device is also “Bluetooth-connected device”, then their type names are considered consistent. Or if the target sound output device type is “Type A” and the sound output device type of the candidate sound output device is also “Type A”, then their type identifiers are considered consistent.

[0205] The volume of each external sound output device is respectively adjusted based on a first volume adjustment parameter indicated by the first volume adjustment instruction, to obtain a first volume value of each external sound output device.

[0206] The first volume adjustment parameter refers to a volume adjustment-related parameter indicated by the first volume adjustment instruction, which may be a volume adjustment step or a volume adjustment value. Of course, in addition to the volume adjustment step or the volume adjustment value, the first volume adjustment parameter may also include other related parameters such as volume adjustment time, a volume adjustment method (e.g., adjustment via the remote controller or the voice control), etc. The volume adjustment step may refer to the minimum unit of volume adjustment (volume increase or volume decrease). For example, if the volume adjustment step is 5, then each time the volume is adjusted, the volume will increase or decrease by 5, i.e., increase or decrease by 5 volume values each time. The volume step may be a fixed value, such as 5, 10, etc. The volume adjustment value is a specific volume value to be adjusted to, such as 30, 40, 50, etc. The first volume value refers to the volume value of each external sound output device after volume adjustment under the first volume adjustment instruction.

[0207] It can be understood that the respective first volume values of external sound output devices may be the same or different. For example, based on that a voice instruction “adjusting volume to 30” directly given by the user, the volume values of all external sound output devices belonging to the target sound output device type will be uniformly adjusted to 30. If the user presses the volume increase key, such as the “+” key, on the remote controller, and assuming the volume adjustment step is 5, then all external sound output devices belonging to the target sound output device type will have their volume increased by 5 based on their respective current device volumes. Currently, if the current device volumes of all external sound output devices are the same, the volume values after increasing or decreasing by the volume adjustment step will also be the same. If the current deviceVI0423P-WO-0009 Docket No. TD250503944P volumes of all external sound output devices are different, the volume values after increasing or decreasing by the volume adjustment step will also be different.

[0208] For example, the at least one processor may parse the first volume adjustment instruction to obtain the volume adjustment step or the volume adjustment value indicated by the first volume adjustment instruction. Then, based on the volume adjustment step or the volume adjustment value, the volume of all external sound output devices belonging to the target sound output device type is adjusted, to obtain the respective volume value of each external sound output device. Specifically, the at least one processor may calculate volume value to which each external sound output device should be adjusted based on the volume adjustment step or the volume adjustment value. If the volume value to which each external sound output device should be adjusted is within a volume adjustment range allowed by the display apparatus, the current device volume of the external sound output device is adjusted to this volume value. If the volume value to which each external sound output device should be adjusted is outside the volume adjustment range allowed by the display apparatus, the current device volume of the external sound output device is adjusted to the maximum volume value allowed to be adjusted by the display apparatus.

[0209] In the embodiments, the target object (i.e., the user) may pre-select the target sound output device type. In this way, when the at least one processor of the display apparatus receives the first volume adjustment instruction, it can determine a plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type. Then, based on a first volume adjustment parameter indicated by the first volume adjustment instruction, the volume of each external sound output device can be adjusted respectively, to obtain the respective first volume value of each external sound output device. Since the plurality of external sound output devices include sound output devices of different sub-device types, the above display apparatus can adjust the volume of the plurality of external sound output devices of different types at the same time. On the one hand, this effectively improves the intelligence of volume adjustment, and users no longer need to adjust the volume of each device one by one, which also improves the convenience of volume adjustment. On the other hand, the display apparatus may also connect with more sound output devices, which is beneficial to enhancing the diversity of sound output from the display apparatus.

[0210] In some embodiments, the at least one processor is further configured to: based on that the target sound output device type is a Bluetooth-connected device, determine the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus via Bluetooth.

[0211] For example, in addition to picking out the plurality of sound output devices belonging to the target sound output device type by judging whether the sound output device type of each candidate sound output device is consistent with the target sound output device type, the at least one processor may also pick out the plurality of sound output devices belonging to the target sound output device type through a connection method between each candidate sound output device and the display apparatus. Based on that the target sound output device type is a Bluetooth-connected device, the at least one processor may obtain the connection method between each candidate sound output device and the display apparatus from device information of each candidate sound output device, and pick out sound output devices with a Bluetooth connection method from candidate sound output devices.1VI0423P-WO-0009 Docket No. TD250503944P

[0212] When the target sound output device type is a non-Bluetooth-connected device, it is determined that the plurality of external sound output devices are a plurality of sound output devices that are connected with the display apparatus through a connection method other than Bluetooth.

[0213] The non-Bluetooth-connected device refers to a sound output device that is connected with the display apparatus through a connection method other than Bluetooth. Other connection methods may include wired connection or Wi-Fi connection. The wired connection refers to connection with the display apparatus through a physical cable, such as wired headphones, wired speakers, etc. The Wi-Fi connection refers to connection with the display apparatus through a Wi-Fi network.

[0214] For example, similar to the Bluetooth-connected device, based on that the target sound output device type is the non-Bluetooth-connected device, the at least one processor may obtain the connection method between each candidate sound output device and the display apparatus from the device information of each candidate sound output device, and pick out the sound output devices with a wired connection or Wi-Fi connection method from the candidate sound output devices.

[0215] When the target sound output device type is the specified sound output device type, it is determined that the plurality of external sound output devices are a plurality of sound output devices that are connected with the display apparatus and belongs to the specified sound output device type.

[0216] The specified sound output device type may be understood as a pre-specified sound type, such as a headphone device, a speaker device, etc. The specified sound output device type is directional. Taking the headphone device as an example, if the user selects a headphone device, the volume of all headphones (including Bluetooth headphones and wired headphones) may be adjusted at the same time.

[0217] For example, when the target sound output device type is the specified sound output device type, the at least one processor may obtain the sound output device type of each candidate sound output device from the device information of each candidate sound output device, and pick out sound output devices whose sound output device type is the specified sound output device type from the candidate sound output devices.

[0218] Optionally, the at least one processor may also pick out sound output devices belonging to the specified sound output device type based on the sub-device type of each candidate sound output device. For example, also taking the headphone device as an example, the at least one processor may obtain the sub-device type of each candidate sound output device, and then take the candidate sound output devices whose sub-device type is headphone type or whose type name contains the field “headphone” as the sound output devices belonging to headphone devices.

[0219] In the embodiments, the external sound output devices may be sound output devices connected with the display apparatus via Bluetooth, sound output devices connected with the display apparatus via the wired connection or Wi-Fi connection, and sound output devices belonging to the specified sound output device type. In this way, the display apparatus can adjust the volume of various types of sound output devices, which not only improves the intelligence of volume adjustment, but also helps the display apparatus connect with more external sound output devices, enhancing the diversity of sound output from the display apparatus.VI0423P-WO-0009 Docket No. TD250503944P

[0220] In some embodiments, the at least one processor is further configured to: based on that the first volume adjustment parameter includes a volume adjustment step, adjust the volume of each external sound output device respectively based on the volume adjustment step to obtain the device volume value of each external sound output device, and take the device volume value as the first volume value.

[0221] The device volume value refers to the volume value to which the external sound output device should be adjusted. For the remote controller, pressing a volume increase button or a volume decrease button once can be considered as increasing or decreasing the volume by volume adjustment step once, respectively. The final volume adjustment step can be determined based on the number of times the button is pressed. For example, if the volume increase button is pressed once, assuming the volume adjustment step is 5, the current device volume needs to be increased by 5; if the volume increase button is pressed twice, corresponding to two volume adjustment steps, the current device volume needs to be increased by 10. Similarly, if the volume decrease button is pressed once, the current device volume needs to be decreased by 5; if the volume decrease button is pressed twice, the current device volume needs to be decreased by 10.

[0222] For the voice control, users may directly say “increase / decrease the volume by one volume adjustment step” or “increase / decrease the volume by two volume adjustment steps”, which can also control the current device volume to increase / decrease by 5 or 10 volume levels. Of course, the users may also give specific volume adjustment steps through a voice command, such as “increase the volume by 3” or “decrease the volume by 2”. That is to say, in a scenario of adjusting the volume through the voice control, the volume adjustment step can be dynamic.

[0223] For example, when the first volume adjustment parameter includes a volume adjustment step, the at least one processor calculates the volume value (i.e., the device volume value) to which each external sound output device needs to be adjusted based on the volume adjustment step and the obtained current volume value of each external sound output device. For instance, if the volume adjustment step is 5 and the current volume value of a certain external sound output device is 10, then in the case of volume increase, the volume value it needs to be adjusted to should be 15; in the case of volume decrease, the volume value it should be adjusted to is 5.

[0224] When the first volume adjustment parameter includes a volume adjustment value, the volume values of the external sound output devices are respectively adjusted to the volume adjustment value, and the volume adjustment value is taken as the first volume value.

[0225] For example, when the first volume adjustment parameter includes a volume adjustment value, the at least one processor can adjust the volume value of each external sound output device belonging to the target sound output device type to this volume adjustment value. That is to say, the device volume value of each external sound output device is the same at this time. For example, if the volume adjustment value is 30, the volume value of each external sound output device will be adjusted to 30, regardless of whether the current device volume value of the external sound output device is greater than or less than 30. As for external sound output devices whose current device volume value is already 30, no adjustment may be made. In this scenario, the user may also feedback the first volume adjustment instruction including a specific volume adjustment value to the display apparatus via the remote controller or voice.VI0423P-WO-0009 Docket No. TD250503944P

[0226] In some embodiments, volume adjustment based on a volume adjustment step and volume adjustment based on a volume adjustment value can be understood as two types of volume adjustment methods. These two volume adjustment methods can be configured in the at least one processor of the display apparatus simultaneously. For example, a user may first trigger a volume adjustment instruction that includes a volume adjustment step, and the at least one processor will perform volume adjustment based on the volume adjustment step. Then, the user may trigger another volume adjustment instruction that includes a volume adjustment value, and the at least one processor will then perform volume adjustment based on the volume adjustment value. Of course, the embodiments of the disclosure do not limit the timing of triggering the volume adjustment instruction that include the volume adjustment step or the volume adjustment value.

[0227] In this embodiment, two volume adjustment methods are introduced: volume adjustment based on a volume adjustment step and volume adjustment based on a volume adjustment value. Both volume adjustment methods can be pre-configured in the at least one processor of the display apparatus, which enriches the volume adjustment methods of the display apparatus and facilitates more convenient volume adjustment for users.

[0228] In some embodiments, the display is further configured to display candidate device identifiers of all candidate sound output devices connected with the display apparatus.

[0229] Here, the candidate sound output devices refer to all external sound output devices connected with the display apparatus, including sound outputs corresponding to the target sound output device type and sound output belonging to sound output device types other than the target sound output device type. The candidate device identifier is an unique identifier of the candidate sound output device, such as a device name, a device model, a device number, etc.

[0230] For example, for all external sound output devices connected with the display apparatus (i.e., all candidate sound output devices), the display will show any one or more of the unique identifier, such as a device name, a device model, and a device number, of each candidate sound output device. The display can be done through display controls, such as a scroll list display control. Of course, other types of display controls can also be used as long as they can display the candidate device identifier of each candidate sound output device, and this embodiment does not impose restrictions on this. In this way, the user can select a target device identifier from among the candidate device identifiers, and the sound output device corresponding to the target device identifier is the sound output device that the user wishes to adjust the volume of individually.

[0231] Therefore, the at least one processor is further configured to: when the target object selects a target device identifier from among the candidate device identifiers, determine the first sound output device that matches the target device identifier from among the candidate sound output devices.

[0232] Here, the target device identifier is the device identifier selected by the target object (i.e., the user) from the candidate device identifiers. The first sound output device is the sound output device that matches the target device identifier.

[0233] For example, when the target object selects a target device identifier from the candidate device identifiers, the at least one processor can, based on the target device identifier, pick out the first sound output device that matches the target device identifier from the candidate sound output devices, and the first sound output device isVI0423P-WO-0009 Docket No. TD250503944P used as a sound output device that requires individual volume adjustment. It can be understood that adjusting the volume individually means only adjusting the volume of the first sound output device without adjusting the volume of other sound output devices.

[0234] In response to a second volume adjustment instruction for the first sound output device, the volume of the first sound output device is adjusted based on a second volume adjustment parameter indicated by the second volume adjustment instruction to obtain a second volume value of the first sound output device.

[0235] Here, the second volume adjustment instruction is a volume adjustment instruction for the first sound output device, used to indicate that the volume of the first sound output device should be adjusted. The second volume adjustment parameter refers to a volume adjustment-related parameter indicated by the second volume adjustment instruction, which can be a volume adjustment step or a volume adjustment value. The meaning of the second volume adjustment parameter is the same as that of the first volume adjustment parameter, and will not be repeated here. The second volume value refers to the volume value of the first sound output device after volume adjustment according to the second volume adjustment instruction.

[0236] For example, after the at least one processor picks out the first sound output device that matches the target device identifier selected by the target object, if it receives a second volume adjustment instruction for this first sound output device, it can parse the second volume adjustment instruction to obtain a corresponding volume adjustment step or a corresponding volume adjustment value. Then, based on the volume adjustment step or the volume adjustment value, the volume of the first sound output device is adjusted to obtain volume value of the first sound output device. It can be understood that adjusting the volume of the first sound output device based on the second volume adjustment parameter is the same as adjusting the volume of each external sound output device based on the first volume adjustment parameter, and will not be repeated here.

[0237] In the embodiment, in addition to being able to adjust the volume of multiple external sound output devices of different types, the display apparatus also supports adjusting the volume of a single external sound output device. That is, the user can independently select the sound output device to be adjusted and then adjust the volume of the selected sound output device individually. This fully meets the user's needs in all aspects, thereby further improving the intelligence of volume adjustment.

[0238] In some embodiments, the at least one processor is further configured to: obtain a target volume value, here the target volume value is either the first volume value or the second volume value, the second volume value is a volume value obtained after adjusting the volume of the first sound output device, the first sound output device is a sound output device selected by the target object from the candidate sound output devices connected with the display apparatus; obtain a volume limit value of the display apparatus, and based on that the target volume value is greater than the volume limit value, update the target volume value to the volume limit value.

[0239] It can be understood that whether adjusting the volume of multiple external sound output devices or a single external sound output device, it is necessary to judge the volume value, that is, to determine whether the volume value to be adjusted to is within the volume adjustment range allowed by the display apparatus, or, whether the volume value to be adjusted to is greater than the maximum volume of the volume adjustment range. For example, if the volume adjustment range allowed by the display apparatus is 0 to 100, then the maximumVI0423P-WO-0009 Docket No. TD250503944P volume is 100. The maximum volume serves as a volume limit value to be compared with the target volume value (i.e., the first volume value or the second volume value).

[0240] For example, when the target volume value is the first volume value, i.e., when the at least one processor is adjusting the volume of the plurality of external sound output devices, the at least one processor will compare the first volume value of each external sound output device with the volume limit value of the display apparatus. If the first volume value is greater than the volume limit value, it means that the volume to which the external sound output device is to be adjusted exceeds the volume adjustment range allowed by the display apparatus. In this case, the first volume value is updated to the volume limit value. For example, if the first volume value is 105 and the volume limit value is 100, since the first volume value is greater than the volume limit value, the first volume value is directly updated to 100, that is, the device volume of the external sound output device is 100. If the first volume value is less than the volume limit value, it means that the volume to which the external sound output device is to be adjusted does not exceed the volume adjustment range allowed by the display apparatus, and the device volume of the external sound output device is determined as the first volume value. For example, if the first volume value is 30 and the volume limit value is 100, and the first volume value is less than the volume limit value, then the device volume of the external sound output device is determined to be 30.

[0241] Similarly, when the target volume value is the second volume value, i.e., when the at least one processor is adjusting the volume of a single external sound output device (i.e., the first sound output device), the at least one processor also needs to compare the second volume value of the first sound output device with the volume limit value of the display apparatus. If the second volume value is greater than the volume limit value, indicating that the volume to which the first sound output device to be adjusted exceeds the volume adjustment range allowed by the display apparatus, the second volume value is updated to the volume limit value, and the device volume of the first sound output device is set to the volume limit value. If the second volume value is less than the volume limit value, indicating that the volume to which the first sound output device to be adjusted does not exceed the volume adjustment range allowed by the display apparatus, and the device volume of the first sound output device is determined as the second volume value.

[0242] In some embodiments, the volume limit value is not limited to the maximum volume of the volume adjustment range allowed by the display apparatus; it may also be determined according to actual scenarios.

[0243] In this embodiment, by comparing the first volume value or the second volume value with the volume limit value of the display apparatus, respectively, and the first or second volume value is updated to the volume limit value when the first or second volume value is greater than the volume limit value. On the one hand, it can avoid sound distortion, noise, and clipping caused by excessively high volume, so as to avoid affect the user's viewing experience. On the other hand, the problems of impaired performance and even malfunction of the sound output device caused by overheating and diaphragm damage due to excessively high volume can be avoided.

[0244] In some embodiments, the display is further configured to: in response to the first volume adjustment instruction, display a first volume bar including volume adjustment icons; in response to the second volume adjustment instruction, display a second volume bar including the second volume value. The second volume adjustment instruction is a volume adjustment instruction for the first sound output device selected by the targetVI0423P-WO-0009 Docket No. TD250503944P object from the candidate sound output devices connected with the display apparatus. The second volume value is the volume value of the first sound output device after volume adjustment.

[0245] It should be noted that this embodiment considers that when adjusting the volume of the plurality of external sound output devices, displaying a volume bar for each external sound output device would result in too many volume bars on the user interface, affecting the user's visual perception and operation. Therefore, in this embodiment, corresponding volume bar display modes are set for the two scenarios: adjusting the volume of a plurality of external sound output devices and adjusting the volume of a single external sound output device.

[0246] As shown in FIG. 11, the volume adjustment icons may include a volume increase icon and a volume decrease icon. FIG. 11 shows a schematic diagram of the first volume bar, which includes the volume adjustment icons “+” and The volume adjustment icons can respond to the first volume adjustment instruction. For example, when the volume is increased, the icon “+” can be highlighted; when the volume is decreased, the icon ’’can be highlighted. FIG. 12 shows a schematic diagram of the second volume bar, which is used for adjusting the volume of the single external sound output device and can display the specific volume value of single external sound output device.

[0247] Optionally, a speaker icon shown in FIG. 11 may also be changed according to actual situations. For example, when adjusting the volume of a Bluetooth-connected device, the speaker icon may be changed to a Bluetooth icon. When adjusting the volume of a non-Bluetooth-connected device, the speaker icon may remain unchanged. When adjusting the volume of a specified sound output device type, such as a headphone device, the speaker icon may be changed to a headphone icon. Of course, corresponding icons and the triggering methods for icon changes may also be determined according to actual needs, and the embodiments do not impose restrictions on this.

[0248] For example, in response to the first volume adjustment instruction, that is, adjusting the volume of the plurality of external sound output devices belonging to the target sound output device type, the display can show the first volume bar including volume adjustment icons, and the specific display form of the volume adjustment icons is not limited in the embodiments. In response to the second volume adjustment instruction, that is, individually adjusting the volume of the first external sound output device selected by the target object, the display can show a volume bar including the second volume value.

[0249] Optionally, when there are few external sound output devices (for example, only two), the display apparatus can also display the volume bars of both two external sound output devices on the user interface, and these volume bars can include the respective volume values of the two external sound output devices. Of course, if there are too many external sound output devices, the first volume bar as shown in FIG. 11 can be displayed.

[0250] In this embodiment, corresponding volume bar display modes are set for the two scenarios of adjusting the volume of the plurality of external sound output devices and adjusting the volume of the single external sound output device. This allows the display of volume bars to adapt to different volume adjustment scenarios, thereby improving the intelligence of the volume bar display and the user experience.

[0251] In some embodiments, the at least one processor is further configured to: if all external sound output devices are disconnected from the display apparatus, set the sound output device type other than the target soundVI0423P-WO-0009 Docket No. TD250503944P output device type as a new target sound output device type; if at least one second sound output device among the external sound output devices remains connected with the display apparatus, control the second sound output device to produce sound.

[0252] Here, the second sound output device refers to a sound output device that remains connected with the display apparatus. It should be noted that in practical applications, there may be cases where external sound output devices are disconnected from the display apparatus. In such cases, if all external sound output devices are disconnected for the display apparatus, to ensure that the display apparatus can produce sound normally, it is necessary to change the target sound output device type, that is, select a sound output device type other than the current target sound output device type as a new target sound output device type, and sound output devices of this sound output device type will continue to produce sound. If at least one sound output device among the external sound output devices remains connected with the display apparatus (i.e., not all external sound output devices are disconnected from the display apparatus), the at least one sound output device can continue to be controlled to produce sound.

[0253] For example, in a scenario where external sound output devices are disconnected: if all external sound output devices are disconnected from the display apparatus, the at least one processor can determine a sound output device type other than the target sound output device type, and set the sound output device type as the new target sound output device type; and sound output devices of this sound output device type will produce sound.

[0254] In some embodiments, the at least one processor is further configured to: determine whether the display apparatus is connected with other sound output devices besides the external sound output devices. If the display apparatus is connected with other sound output devices, the at least one processor obtains a sound output device type to which the other sound output devices belong and set the sound output device type as the new target sound output device type; if the display apparatus is not connected with other sound output devices, control a built-in speaker of the display apparatus to produce sound.

[0255] Here, the other sound output devices refer to external sound output devices connected with the display apparatus except for the aforementioned external sound output devices.

[0256] For example, if all external sound output devices corresponding to the target sound output device type are disconnected from the display apparatus, the at least one processor can further check whether the display apparatus is connected with an external sound output device other than the all external sound output devices. If the display apparatus is connected with the external sound output device other than the all external sound output devices, a sound output device type to which the external sound output device belongs can be directly set as the target sound output device type, and the external sound output device other than the all external sound output devices will produce sound. If the display apparatus is not connected with the external sound output device other than the all external sound output devices, it means there is no external sound output device connected with the display apparatus at this time, and the built-in speaker of the display apparatus will be controlled to produce sound.

[0257] For example, suppose the target sound output device type is a non-Bluetooth-connected device, if all sound output devices connected with the display apparatus via cable or Wi-Fi are disconnected from the display apparatus, the at least one processor will further detect whether there are other external sound output devicesVI0423P-WO-0009 Docket No. TD250503944P connected with the display apparatus. Assuming that the display apparatus is still connected with a Bluetooth speaker; in this case, the sound output device type to which the Bluetooth speaker belongs, i.e., the Bluetooth- connected device, will be set as the target sound output device type, and the Bluetooth speaker will be controlled to produce sound. In this scenario, subsequent volume adjustments are made for the Bluetooth-connected device. If there are no other external sound output devices connected with the display apparatus, the built-in speaker of the display apparatus will be controlled to produce sound.

[0258] If at least one sound output device remains connected with the display apparatus, i.e., there is still at least one external sound output device belonging to the target sound output device type connected with the display apparatus, the at least one external sound output device will continue to be controlled to produce sound. It can be understood that when the plurality of external sound output devices are reduced to one external sound output device, the volume bar can automatically switch from the first volume bar to the second volume bar. Similarly, if multiple external sound output devices remain after some devices are disconnected, the first volume bar will remain unchanged.

[0259] In some embodiments, when a new external sound output device is connected with the display apparatus, the device information of the new external sound output device is recorded. If the new external sound output device belongs to the current target sound output device type, the volume of the new external sound output device will be adjusted synchronously during the next volume adjustment. If the new external sound output device does not belong to the current target sound output device type, volume adjustment for the new external sound output device in the scenario of adjusting the plurality of external sound output devices can only be performed based on that the sound output device selected by the target object is a sound output device type to which the new external sound output device belongs. Of course, the target object can also select the new external sound output device for individual volume adjustment.

[0260] In this embodiment, in the scenario where an external sound output device is disconnected from the display apparatus, it is determined whether all external sound output devices are disconnected from the display apparatus. If all external sound output devices are disconnected from the display apparatus, the target sound output device type is changed; otherwise, other external sound output devices except the disconnected external sound output device are controlled to produce sound, ensuring the normal sound output of the display apparatus.

[0261] In some embodiments, the display is configured to display a sound output device type selection page. The sound output device type selection page includes multiple candidate sound output device types.

[0262] The sound output device type selection page refers to a page for selecting sound output device types. The candidate sound output device types may include a Bluetooth-connected device, a non-Bluetooth-connected device, and a specified sound output device type. In practical applications, the candidate sound output device types may be added or modified according to actual needs, such as setting TV speakers (built-in speakers), Audio Return Channel (ARC), and Sony / Philips Digital Interface Format (SPDIF, digital audio output). Users can select the target sound output device type from these candidate sound output device types.

[0263] The at least one processor is further configured to: in response to a sound output device type selection instruction triggered by the target object on the sound output device type selection page, determine the targetVI0423P-WO-0009 Docket No. TD250503944P sound output device type matching the sound output device type selection instruction from a plurality of candidate sound output device types.

[0264] The sound output device type selection instruction refers to a confirmation instruction for the target object to select the target sound output device type on the sound output device type selection page.

[0265] For example, through the sound output device type selection page, the target object can select one or more sound output device types from the plurality of candidate sound output device types and click a confirmation button or a confirmation control (not shown in the figure). After detecting a confirmation instruction triggered by the target object, the at least one processor can determine the target sound output device type matching the confirmation instruction from the plurality of candidate sound output device types. In this way, during subsequent volume adjustments by the target object, the volume of all external sound output devices belonging to the target sound output device type can be adjusted simultaneously.

[0266] In this embodiment, through the pre-set sound output device type selection page, the target object can select the target sound output device type that is allowed to produce sound or the target sound output device type that the target object wishes to perform volume adjustment on simultaneously from the plurality of candidate sound output device types displayed on the pre-set sound output device type selection page. Thus, upon receiving a volume adjustment instruction, the at least one processor can adjust the volume of all external sound output devices belonging to the target sound output device type simultaneously, improving the intelligence of volume adjustment.

[0267] In a specific embodiment, the display apparatus includes a display and at least one processor. As shown in FIG. 13, the display shows a sound output device type selection page, which displays a Bluetooth-connected device (e.g., Bluetooth Speaker), a non-Bluetooth-connected device, and a specified sound output device type such as a headphone device type (Headphone Only).

[0268] FIG. 14 shows an interaction schematic of volume adjustment of a Bluetooth-connected device. It can be seen that the target sound output device type is first set by the target object (i.e., user), i.e., the target sound output device type in FIG. 13 is selected. The Sound UI in the user interface first receives the target sound output device type and sends an instruction for modifying a sound output device type to the Sound service in the at least of processor, the Sound service modifies the sound output device type, i.e., the current sound output device type is changed to the target sound output device type selected by the target object.

[0269] The Sound UI is a UI module in the front-end interface that can receive the sound output device type selected by the user. The Sound service is a sound service module in the at least one processor that can modify the sound output device type and manage sound output devices other than Bluetooth-connected devices. In addition, the Volume UI can be understood as a UI module in the front-end interface for monitoring volume adjustment instructions, and the Bluetooth service is a module in the at least one processor for managing Bluetooth-connected devices.

[0270] It can be understood that if the Bluetooth-connected device is selected by the target object, volume of a plurality of sound output devices, such as Bluetooth headphones and Bluetooth speakers, connected with the display apparatus via Bluetooth can be adjusted simultaneously. If the non-Bluetooth-connected device is selectedVI0423P-WO-0009 Docket No. TD250503944P by the target object, the volume of a plurality of sound output devices, such as wired headphones and wired speakers, connected with the display apparatus via a wired connection can be adjusted simultaneously. Of course, this requires that the wired headphones or wired speakers are plugged into the display apparatus. If the specified sound output device type, i.e., the headphone device type, is selected by the target object select, the volume of all headphone-type devices, such as Bluetooth headphones and wired headphones, can be adjusted simultaneously.

[0271] In response to the first volume adjustment instruction initiated by the target object via the remote controller or voice, the Volume UI first receives the first volume adjustment instruction and requests the target sound output device type from the Sound service. Assuming the target sound output device type is the Bluetooth- connected device, the Volume UI further requests device information of all Bluetooth devices, such as the current device volume value of the Bluetooth devices, from the Bluetooth service. The Volume UI can calculate the volume value of each Bluetooth device, and send the volume value to the Bluetooth service. The Bluetooth service changes the volume value of each Bluetooth device and returns the changed volume value to the Volume UI. At the same time, the Volume UI can display a first volume bar including volume adjustment icons such as VOL+ / -.

[0272] FIG. 15 shows an interaction schematic of volume adjustment for a headphone-type device. Unlike Bluetooth-connected devices, the Volume UI requests a connection status of wired headphones from the Sound service. If the Sound service feeds back that the display apparatus is connected with the wired headphones, the Volume UI can calculate the volume value of the wired headphones and the volume of Bluetooth headphones simultaneously. If the Sound service feeds back that the display apparatus is not connected with wired headphones, the Volume UI only calculates the volume value of all Bluetooth headphones.

[0273] FIG. 16 shows an interaction schematic of changing a sound output device type. Before setting the target sound output device type, connection of the sound output device is required. Taking a Bluetooth device as an example, the Bluetooth device initiates a connection request to the display apparatus through the Bluetooth UI. The Bluetooth UI can be understood as a UI module in the front-end interface for receiving a Bluetooth connection request. The Bluetooth UI sends the Bluetooth connection request to the Bluetooth service. The Bluetooth service searches for and connects to the Bluetooth device, and feeds back the connected Bluetooth device to the Bluetooth UI. At this time, if the target object does not select the sound output device type as the Bluetooth-connected device, the Volume UI will display an overall device volume bar. That is, the sound is currently producing by the built-in speaker of the display apparatus, and the overall device volume bar can include an overall volume value of the display apparatus. When the target object sets the target sound output device type as the Bluetooth-connected device, the sound output device type is changed to the Bluetooth-connected device. A corresponding volume bar is displayed according to the number of Bluetooth devices connected currently. That is, if there are multiple Bluetooth devices, the first volume bar is displayed; if there is one Bluetooth device, the second volume bar is displayed.

[0274] The display apparatus also supports volume adjustment for a single sound output device. That is, the display displays a candidate device identifier, such as a device name, of each candidate sound output device connected with the display apparatus through a scroll list display control. As shown in FIG. 17, where the left side of FIG. 17 is the scroll list display control and the right side of the FIG. 17 is the specific volume value. The targetVI0423P-WO-0009 Docket No. TD250503944P object can slide the scroll list display control up and down to select a target device name from a plurality of candidate device names (sound output device name 1 , sound output device name 2), and a sound output device corresponding to the target device name is the sound output device requiring individual volume adjustment.

[0275] In some embodiments, the volume adjustment instruction can include volume adjustment parameters, i.e., a volume adjustment step or a volume adjustment value. The art least one processor can adjust the volume of each external sound output device based on the volume adjustment step, or adjust the volume of each external sound output device to the volume adjustment value. During an adjustment process, it is necessary to determine whether a volume value to which each external sound output device is to be adjusted is greater than a volume limit value of the display apparatus; if the volume value to which each external sound output device is to be adjusted is greater than the volume limit value, the volume value to which each external sound output device is to be adjusted is updated to the volume limit value.

[0276] FIG. 18 shows an interaction schematic of a disconnection of an external sound output device. Based on that at least one sound output device among the external sound output devices remains connected with the display apparatus, the Bluetooth service will notify the Volume UI that there is a disconnected device. It can be understood that if a non-Bluetooth-connected external sound output device is disconnected, the Sound service will notify the Volume UI that there is a disconnected device (not shown in the figure). The Volume UI requests device information of the disconnected device from the Bluetooth service or the Sound service, and the Bluetooth service or the Sound service returns the device information of the disconnected device to it. At this time, the sound output device is controlled to produce sound and adjust the volume. If multiple sound output devices remain connected, the first volume bar is displayed; if only one sound output device remains connected, the second volume bar is displayed. If there is only one external sound output device connected with the display apparatus and it is disconnected from the display apparatus, the sound output device type needs to be updated. Specifically, if the one external sound output device is a Bluetooth-connected device, the Bluetooth service notifies the Sound service to modify the sound output device type, and the Sound service will detect whether the display apparatus is still connected with other sound output devices except the one external sound output device. If the display apparatus is still connected with other sound output devices, a sound output device type to which the other sound output devices belong is obtained, and the sound output device type is set as the target sound output device type. If the display apparatus is not connected with other sound output devices, the built-in speaker of the display apparatus is controlled to produce sound. If the external sound output device is a non-Bluetooth-connected device, the Sound service may automatically modify the sound output device type.

[0277] FIG. 19 shows an interaction schematic of a connection of a new sound output device. When a new external sound output device is connected with the display apparatus, the Bluetooth service or the Sound service will notify the Volume UI that the new sound output device is connected with the display apparatus. The Volume UI requests device information from the Bluetooth service or the Sound service, and the Bluetooth service or the Sound service returns the device information of the new external sound output device to the Volume UI. The Volume UI displays the first volume bar or the second volume bar according to the number of external sound output devices currently connected.VI0423P-WO-0009 Docket No. TD250503944P

[0278] In this embodiment, with the above display apparatus, the target object, i.e., the user, can pre-select the target sound output device type. Thus, when the at least one processor of the display apparatus receives the first volume adjustment instruction, it can determine the plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type. Then, based on the first volume adjustment parameter indicated by the first volume adjustment instruction, the volume of each external sound output device is adjusted to obtain the respective first volume value of each external sound output device. Since the plurality of external sound output devices include sound output devices of different sub-device types, the above display apparatus can adjust the volume of the plurality of external sound output devices of different types simultaneously. On the one hand, this effectively improves the intelligence of volume adjustment, and users no longer need to adjust the volume of each device one by one, enhancing the convenience of volume adjustment. On the other hand, the display apparatus can also be connected with more sound output devices, which helps to enrich the sound output diversity of the display apparatus.

[0279] In some embodiments, the disclosure further provides a volume adjustment method applied to the above display apparatus. In this embodiment, as shown in FIG. 20, the volume adjustment method includes the following steps.

[0280] Step S2002, based on that the target object has selected a target sound output device type, in response to a first volume adjustment instruction, determining a plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type; here the plurality of external sound output devices include sound output devices of different sub-device types.

[0281] Step S2004, adjusting volume of each external sound output device based on a first volume adjustment parameter indicated by the first volume adjustment instruction to obtain a respective first volume value of each external sound output device.

[0282] In some embodiments, the determining the plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type includes: when the target sound output device type is a Bluetooth-connected device, determining the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus via Bluetooth; when the target sound output device type is a non-Bluetooth-connected device, determining the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus through a connection method other than Bluetooth; when the target sound output device type is a specified sound output device type, determining the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus and belonging to the specified sound output device type.

[0283] In some embodiments, the first volume adjustment parameter includes a volume adjustment step or a volume adjustment value; the adjusting the volume of each external sound output device based on the first volume adjustment parameter indicated by the first volume adjustment instruction to obtain the respective first volume value of each external sound output device includes: when the first volume adjustment parameter includes the volume adjustment step, adjusting the volume of each external sound output device based on the volume adjustment step to obtain a device volume value of each external sound output device, and using the deviceVI0423P-WO-0009 Docket No. TD250503944P volume value as the first volume value; when the first volume adjustment parameter includes the volume adjustment value, adjusting the volume of each external sound output device to the volume adjustment value, and using the volume adjustment value as the first volume value.

[0284] In some embodiments, the volume adjustment method further includes: displaying candidate device identifiers of candidate sound output devices connected with the display apparatus; when the target object selects a target device identifier from the candidate device identifiers, determining a first sound output device matching the target device identifier from the candidate sound output devices; in response to a second volume adjustment instruction for the first sound output device, adjusting volume of the first sound output device based on a second volume adjustment parameter indicated by the second volume adjustment instruction to obtain a second volume value of the first sound output device.

[0285] In some embodiments, the volume adjustment method further includes: obtaining a target volume value; the target volume value is any one of the first volume value and the second volume value; the second volume value is a volume value obtained after adjusting the volume of the first sound output device; the first sound output device is a sound output device selected by the target object from the candidate sound output devices connected with the display apparatus; obtaining a volume limit value of the display apparatus, and updating the target volume value to the volume limit value when the target volume value is greater than the volume limit value.

[0286] In some embodiments, the volume adjustment method further includes: displaying a first volume bar including a volume adjustment icon in response to the first volume adjustment instruction; displaying a second volume bar including the second volume value in response to the second volume adjustment instruction; here, the second volume adjustment instruction is a volume adjustment instruction for the first sound output device selected by the target object from the candidate sound output devices connected with the display apparatus, and the second volume value is a volume value of the first sound output device after volume adjustment.

[0287] In some embodiments, the volume adjustment method further includes: when all external sound output devices are disconnected from the display apparatus, setting a sound output device type other than the target sound output device type as a new target sound output device type; when there is at least one second sound output device among the external sound output devices remains connected with the display apparatus, controlling the second sound output device to produce sound.

[0288] In some embodiments, setting the sound output device type other than the target sound output device type as the new target sound output device type further includes: determining whether the display apparatus is still connected with other sound output devices except the external sound output devices; if the display apparatus is still connected with other sound output devices except the external sound output devices, obtaining a sound output device type to which the other sound output devices belong and setting the sound output device type as the new target sound output device type; if the display apparatus is not connected with other sound output devices except the external sound output devices, controlling a built-in speaker of the display apparatus to produce sound.

[0289] In some embodiments, the volume adjustment method further includes: displaying a sound output device type selection page, here the sound output device type selection page includes a plurality of candidate sound output device types; in response to a sound output device type selection instruction triggered by the target objectVI0423P-WO-0009 Docket No. TD250503944P on the sound output device type selection page, determining a target sound output device type that matches the sound output device type selection instruction from the plurality of candidate sound output device types.

[0290] In some embodiments, the disclosure further provides a volume adjustment apparatus applied to the above-mentioned display apparatus. In this embodiment, the volume adjustment apparatus includes:an external sound output device determined module, configured to, when a target object has selected a target sound output device type, in response to a first volume adjustment instruction, determine a plurality of external sound output devices connected with the display apparatus and belonging to the target sound output device type; here, the plurality of external sound output devices include sound output devices of different subdevice types; anda volume adjustment module, configured to adjust volume of each external sound output device based on a first volume adjustment parameter indicated by the first volume adjustment instruction, and obtain a respective first volume value of each external sound output device.

[0291] In some embodiments, the external sound output device determined module is further configured to: when the target sound output device type is a Bluetooth-connected device, determine the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus via Bluetooth; when the target sound output device type is a non-Bluetooth-connected device, determine the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus through a connection method other than Bluetooth; when the target sound output device type is a specified sound output device type, determine the plurality of external sound output devices as a plurality of sound output devices connected with the display apparatus and belonging to the specified sound output device type.

[0292] In some embodiments, the first volume adjustment parameter includes a volume adjustment step or a volume adjustment value; the volume adjustment module is further configured to: when the first volume adjustment parameter includes the volume adjustment step, adjust the volume of each external sound output device based on the volume adjustment step to obtain a device volume value of each external sound output device, and use the device volume value as the first volume value; when the first volume adjustment parameter includes the volume adjustment value, adjust the volume of each external sound output device to the volume adjustment value, and use the volume adjustment value as the first volume value.

[0293] In some embodiments, the volume adjustment apparatus is further configured to: display candidate device identifiers of candidate sound output devices connected with the display apparatus; when the target object selects a target device identifier from the candidate device identifiers, determine a first sound output device matching the target device identifier from the candidate sound output devices; in response to a second volume adjustment instruction for the first sound output device, adjust volume of the first sound output device based on a second volume adjustment parameter indicated by the second volume adjustment instruction to obtain a second volume value of the first sound output device.

[0294] In some embodiments, the volume adjustment apparatus is further configured to: obtain a target volume value; the target volume value is any one of the first volume value and the second volume value; the second volume value is a volume value obtained after adjusting the volume of the first sound output device; the firstVI0423P-WO-0009 Docket No. TD250503944P sound output device is a sound output device selected by the target object from the candidate sound output devices connected with the display apparatus; obtain a volume limit value of the display apparatus, and update the target volume value to the volume limit value when the target volume value is greater than the volume limit value.

[0295] In some embodiments, the volume adjustment apparatus is further configured to: display a first volume bar including a volume adjustment icon in response to the first volume adjustment instruction; display a second volume bar including the second volume value in response to the second volume adjustment instruction. The second volume adjustment instruction is a volume adjustment instruction for the first sound output device selected by the target object from the candidate sound output devices connected with the display apparatus; and the second volume value is the volume value of the first sound output device after volume adjustment.

[0296] In some embodiments, the volume adjustment apparatus is further configured to: set a sound output device type other than the target sound output device type as a new target sound output device type when all external sound output devices are disconnected from the display apparatus; when at least one second sound output device among the external sound output devices remains connected with the display apparatus, control the second sound output device to produce sound.

[0297] In some embodiments, the volume adjustment apparatus is further configured to: determine whether the display apparatus is still connected with other sound output devices except the external sound output devices; if the display apparatus is still connected with other sound output devices except the external sound output devices, obtain a sound output device type to which the other sound output devices belong and set the sound output device type as the new target sound output device type; if the display apparatus is not connected with other sound output devices except the external sound output devices, control a built-in speaker of the display apparatus to produce sound.

[0298] In some embodiments, the volume adjustment apparatus is further configured to: display a sound output device type selection page, here the sound output device type selection page includes a plurality of candidate sound output device types; in response to a sound output device type selection instruction triggered by the target object on the sound output device type selection page, determine a target sound output device type that matches the sound output device type selection instruction from the plurality of candidate sound output device types.

[0299] Each module in the above volume adjustment apparatus can be fully or partially implemented by software, hardware, or a combination thereof. The above modules can be embedded in or independent of at least one processor in the computer device in the form of hardware, or stored in the memory of the computer device in the form of software, so that the processor can call and perform the operations corresponding to the above modules.

[0300] The embodiments of the disclosure also provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by at least one processor, the steps of the above instruction sending method or volume adjustment method are implemented.

[0301] The embodiments of the disclosure also provide a computer program product, including a computer program. When the computer program is executed by at least one processor, the steps of the above instruction sending method or volume adjustment method are implemented.VI0423P-WO-0009 Docket No. TD250503944P

[0302] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-transitory computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Any reference to memory, database, or other media in the embodiments provided in the disclosure may include at least one of nonvolatile memory and volatile memory. The non-volatile memory may include a read-only memory (ROM), a magnetic tape, a floppy disk, a flash memory, an optical memory, a high-density embedded non-volatile memory, a resistive random access memory (ReRAM), a magnetoresistive random access memory (MRAM), a ferroelectric random access memory (FRAM), a phase change memory (PCM), a graphene memory, etc. Volatile memory may include a random access memory (RAM) or an external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as a static random access memory (SRAM) or a dynamic random access memory (DRAM). The databases involved in the embodiments provided in the disclosure may include at least one of relational databases and non-relational databases. The non-relational databases may include distributed databases based on blockchains, etc., but are not limited thereto. The processors involved in the embodiments provided in the disclosure may be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, artificial intelligence (Al) processors, etc., but are not limited thereto.

[0303] The technical features of the above embodiments can be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be regarded as the scope of the disclosure.

[0304] The above-described embodiments only express several implementation modes of the disclosure, and their descriptions are specific and detailed, but they should not be construed as limiting the patent scope of the disclosure. It should be noted that for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the disclosure, and these all fall within the protection scope of the disclosure. Therefore, the protection scope of the disclosure should be subject to the appended claims.

Claims

VI0423P-WO-0009 Docket No. TD250503944P What is claimed is:

1. A display apparatus, comprising: a display, a communicating device, and at least one processor; wherein the display is configured to display a user interface;the communicating device is configured to establish a communication connection with at least one remote control device; andthe at least one processor is configured to perform:based on that the display apparatus is connected with a plurality of remote control devices via a near-field communication mode, in response to a trigger operation for activating a recording device of the remote control device, reading usage record data of the plurality of remote control devices;selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices;sending an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.

2. The display apparatus according to claim 1, wherein the at least one processor is further configured to perform:based on that the read usage record data of the plurality of remote control devices indicates that a target remote control device among the plurality of remote control devices is a remote control device used last time, sending the activation instruction to the target remote control device for activating the recording device of the target remote control device.

3. The display apparatus according to claim 1, whereinthe plurality of remote control devices comprises a first remote control device and a second remote control device;both the first remote control device and the second remote control device communicate with the display apparatus via a Bluetooth connection; or,the first remote control device communicates with the display apparatus via a Bluetooth connection, and the second remote control device communicates with the display apparatus via a local area network.

4. The display apparatus according to claim 1, wherein the at least one processor is further configured to perform:for each remote control device among the plurality of remote control devices, based on that the display apparatus receives an operation instruction from the remote control device via the near-field communication mode, recording locally instruction information of the operation instruction of the remote control device in the usage record data of the plurality of remote control devices, wherein the instruction information comprises at least one of instruction trigger time and an instruction type.

5. The display apparatus according to claim 1, wherein the at least one processor is further configured to perform:receiving recording data sent by the at least one remote control device, wherein the recording data is collected by the at least one remote control device through the recording device of the at least one remote control deviceVI0423P-WO-0009 Docket No. TD250503944P after the at least one remote control device receives the activation instruction and activates the recording device of the at least one remote control device;performing voice recognition based on the recording data to obtain a voice instruction;displaying a user interface corresponding to the voice instruction through the display.

6. The display apparatus according to claim 1, wherein the at least one processor is further configured to perform:displaying a user interface of an application through the display, wherein the user interface of the application comprises an activation control for activating the recording device;detecting the trigger operation on the activation control;based on that the trigger operation on the activation control is detected, reading the usage record data of the plurality of remote control devices.

7. The display apparatus according to claim 1, wherein the at least one processor is further configured to perform:detecting the trigger operation on a function button used to activate the recording device of the remote control device;based on that the trigger operation on the function button is detected, reading the usage record data of the plurality of remote control devices.

8. The display apparatus according to any one of claims 1 to 7, wherein the at least one processor is further configured to perform:based on that the display apparatus is connected with the plurality of remote control devices via the near-field communication mode, in response to a trigger operation for activating an image capture device of the remote control device, reading the usage record data of the plurality of remote control devices;selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices;sending an activation instruction to the at least one remote control device for activating the image capture device of the at least one remote control device.

9. The display apparatus according to claim 8, wherein the at least one processor is further configured to perform:receiving image data sent by the at least one remote control device, wherein the image data is collected by the at least one remote control device through the image capture device of the at least one remote control device after the at least one remote control device receives the activation instruction and activates the image capture device of the at least one remote control device;performing face recognition based on the image data to obtain a facial feature;based on that the facial feature matches a stored target facial feature, displaying a target user interface through the display.

10. An instruction sending method, applied to a display apparatus, the display apparatus comprising a display, a communicating device, and at least one processor; whereinVI0423P-WO-0009 Docket No. TD250503944P the display is configured to display a user interface;the communicating device is configured to establish a communication connection with at least one remote control device; andthe at least one processor is configured to execute the instruction sending method, and the instruction sending method comprises:based on that the display apparatus is connected with a plurality of remote control devices via a near-field communication mode, in response to a trigger operation for activating a recording device of the remote control device, reading the usage record data of the plurality of remote control devices;selecting at least one remote control device from the plurality of remote control devices according to the usage record data of the plurality of remote control devices;sending an activation instruction to the at least one remote control device for activating the recording device of the at least one remote control device.

Images