Display device and button switching method

Abstract

This application provides a display device and a button switching method in some embodiments. The method can detect the interface type of the current user interface in response to a button command input based on a third button. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the button command and on point images captured in the user interface. If the interface type is a non-live interface, the button function of the third button is set according to the button function of the first button to perform focus movement in the non-live interface. If the interface type is a live interface, the button function of the third button is set according to the button function of the second button to perform channel switching in the live interface. By detecting the interface type of the user interface, when the interface type is a live interface, the third button can directly control channel switching in the live interface, thus solving the problem that set-top boxes cannot use the display device's remote control to switch channels.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a button switching method. Background Technology

[0002] Display devices are intelligent devices capable of presenting a user interface and supporting user interaction. For example, display devices can integrate computer technology and internet functionality. They can display images and sounds by receiving signals, and can run on an operating system, allowing users to install and uninstall applications such as video players, games, and social media applications. Display devices can connect to online content and services via the internet, such as streaming video, music, news, and social media.

[0003] Display devices can watch online video content via the internet, but for live programs, such as sports events and news broadcasts, users still need a set-top box to receive and watch them. A smart set-top box (STB) receives signals from cable or satellite TV service providers, converts them into a video stream that the smart display device can recognize, transmits the video stream to the smart display device, and plays it on the device's monitor.

[0004] When a smart display device is connected to a set-top box to watch live programs, for user convenience, the remote control of the display device can be paired with the remote control of the set-top box. This allows the user to control the focus and channel switching of the set-top box using the remote control of the display device. However, due to the different button logic of the set-top box remote control, after the set-top box and the display device are paired, the remote control of the display device only includes up and down arrow keys for a simplified design. The up and down arrow keys of the remote control can only be paired with the up and down arrow keys of the set-top box, resulting in some set-top boxes being unable to use the remote control of the display device to switch channels. Summary of the Invention

[0005] This application provides a display device and a button switching method in some embodiments to solve the problem that some set-top boxes cannot switch channels using the remote control of the display device.

[0006] In a first aspect, some embodiments of this application provide a display device, including: a display, a device interface, a communication device, and a controller. The display is configured to display a user interface, the device interface is configured to connect to a set-top box, wherein the set-top box includes a control device, the control device including a first button and a second button; the first button is used to perform focus movement, and the second button is used to perform channel switching; the communication device is configured to establish a communication connection with the control device, and the control device includes a third button.

[0007] The controller is configured to perform the following steps:

[0008] In response to a key input based on the third key, the interface type of the current user interface is detected. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the key input and the point image captured in the user interface.

[0009] If the interface type of the user interface is a non-live interface, the function of the third button is set according to the function of the first button, so that the focus movement in the non-live interface can be performed through the third button.

[0010] If the user interface type is a live streaming interface, the function of the third button is set according to the function of the second button, so that the channel switching of the live streaming interface can be performed through the third button.

[0011] Secondly, some embodiments of this application also provide a button switching method, applied to the display device described in the first aspect, wherein the display device includes a display, a device interface, a communication device, and a controller, and the display device is connected to a set-top box through the device interface; the button switching method includes:

[0012] In response to a key input based on a third key, the interface type of the current user interface is detected. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the key input and the point image captured in the user interface.

[0013] If the interface type of the user interface is a non-live interface, the function of the third button is set according to the function of the first button, so that the focus movement in the non-live interface can be performed through the third button.

[0014] If the user interface type is a live streaming interface, the function of the third button is set according to the function of the second button, so that the channel switching of the live streaming interface can be performed through the third button.

[0015] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a button switching method. The method can detect the interface type of the current user interface in response to a button command input based on a third button. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the button command and on point images captured in the user interface. If the interface type is a non-live interface, the button function of the third button is set according to the button function of the first button to perform focus movement in the non-live interface. If the interface type is a live interface, the button function of the third button is set according to the button function of the second button to perform channel switching in the live interface. This method, by detecting the interface type of the user interface, allows direct control of channel switching in the live interface via the third button when the interface type is a live interface, thus solving the problem that set-top boxes cannot switch channels using the display device's remote control. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0018] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0019] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0020] Figure 4 This is a schematic diagram illustrating the connection between a display device and a set-top box provided in some embodiments of this application;

[0021] Figure 5 This application provides schematic diagrams of set-top box homepage interfaces for some embodiments.

[0022] Figure 6 This application provides schematic diagrams of set-top box channel interfaces for some embodiments.

[0023] Figure 7 A flowchart illustrating a button switching method provided in some embodiments of this application;

[0024] Figure 8A schematic diagram of the location of a first point provided for some embodiments of this application;

[0025] Figure 9 A schematic diagram of a first set of images provided for some embodiments of this application;

[0026] Figure 10 A schematic diagram of a second set of images provided for some embodiments of this application;

[0027] Figure 11 A schematic diagram of a third set of images provided for some embodiments of this application;

[0028] Figure 12 A schematic diagram of the fourth set of images provided for some embodiments of this application;

[0029] Figure 13 Waveform diagram of the first recorded audio provided for some embodiments of this application;

[0030] Figure 14 A flowchart illustrating the verification of the third button provided in some embodiments of this application;

[0031] Figure 15 This is a schematic diagram illustrating the focus movement of a user interface provided in some embodiments of this application. Detailed Implementation

[0032] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0033] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0034] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0035] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0036] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0037] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0038] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0039] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0040] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0041] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0042] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0043] Figure 2 Provided for some embodiments of this application Figure 1Hardware configuration block diagram of display device 200.

[0044] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0045] In some embodiments, detector 230 is used to collect signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver and a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. The image acquisition device can also collect the user interface displayed on display 260. Alternatively, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds. The sound acquisition device can also collect recorded audio.

[0046] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0047] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0048] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0049] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0050] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0051] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0052] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0053] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0054] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0055] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0056] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0057] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0058] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0059] like Figure 3 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0060] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0061] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0062] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0063] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0064] To achieve communication between the display device 200 and the set-top box, other connection methods can also be used. Specific connection methods can include wired connections via the device interface 240, such as Digital Visual Interface (DVI), Video Graphics Array (VGA), or USB; or wireless connections, such as Wi-Fi, Bluetooth, or infrared. Different communication connection methods can employ different information transmission protocols. For example, when using an HDMI interface for connection, the HDMI protocol can be used for data transmission.

[0065] Since the display device 200 does not have the ability to directly receive and decode digital signals, for receiving encrypted cable TV or satellite signals, the set-top box acts as an intermediate device, responsible for receiving, decoding, and converting the encrypted cable TV or satellite signals into a format that the display device 200 can display. To expand the functionality of the display device 200 and enable program viewing, a set-top box can be connected via the device interface 240 to watch live programs, etc., through the display device 200.

[0066] like Figure 4 As shown, the set-top box can be connected to the display device 200 via either an HDMI or VGA interface. Taking the HDMI interface as an example, when the display device 200 is connected to the set-top box via an HDMI interface, the display device 200 can set the current signal source to the HDMI interface. After the set-top box is powered on, it renders the set-top box control homepage according to the set-top box operating system settings and sends the corresponding screen to the display device 200. At this time, since the current signal source of the display device 200 is the HDMI interface, the display device 200 can obtain the screen frames or video streams corresponding to the set-top box control homepage through the HDMI interface and display them on the monitor 260.

[0067] After the set-top box is connected to the display device 200, it receives digital signals or data streams via an antenna, cable TV, or network interface. These digital signals or data streams can originate from cable TV, satellite TV, digital TV, or online video platforms. The received digital signals or data streams are decoded, converting them into recognizable audio and video signals. The decoder inside the set-top box supports various compression formats, such as MPEG-2 and H.264, and can decode different signals. After decoding, the user can select the desired TV channel or application using a remote control or other control device 100. The set-top box will then find the corresponding channel or application and play it based on the user's selection and input.

[0068] During the display of the set-top box user interface, the display device 200 can also acquire control commands input by the user through the control device based on the user's interactive operations. The set-top box responds to the control commands transmitted by the control device and executes the corresponding control actions. For some control commands generated by interactive operations, the set-top box will produce corresponding interface changes when executing the control commands. The changed interface content can be sent to the display device 200 through the digital signals and data streams in the device interface 240, so that the user interface displayed on the display device 200 changes synchronously.

[0069] Users can perform interactive actions such as selection and input through the set-top box's control device. This control device can be a remote control, stylus, gamepad, etc. The display device 200 includes a control device 100, which can also be a remote control, stylus, gamepad, etc. Taking a remote control as an example, where both control device 100 and the control device are remote controls, the set-top box is connected to the display device 200, and the display device 200 displays the user interface. However, the display device 200 and the remote control that comes with the set-top box may use different signal transmission methods, causing the remote control of the display device 200 to be unable to directly control the set-top box, and thus unable to control the user interface displayed on the display device 200.

[0070] For example, after the set-top box is powered on, it will display the set-top box control homepage by default. The set-top box control homepage includes multiple media asset control elements and a focus cursor. The user needs to input focus movement commands using the set-top box's remote control. After the remote control transmits the focus movement commands to the set-top box, the set-top box can respond to the focus movement commands by changing the display position of the focus cursor on the set-top box control homepage. The set-top box can send the focus cursor position change process and the interface content after the focus cursor position change to the display device 200 so that the display device 200 can display it in real time.

[0071] In some embodiments, during the process of displaying the user interface of the set-top box, the display device 200 can also acquire control commands input by the user through the control device 100 based on the user's interactive operations, and send them to the set-top box through the device interface 240. The set-top box responds to the control commands transmitted through the device interface 240 by executing the corresponding control actions. For control commands generated by certain interactive operations, the set-top box will produce corresponding interface changes when executing the control commands. The changed interface content can be sent to the display device 200 through the data stream in the device interface 240, so that the user interface displayed on the display device 200 changes synchronously.

[0072] Taking the remote control that comes with display device 200 to control the set-top box as an example, there may be compatibility issues, leading to response delays and other problems. Therefore, users need to use the remote control that comes with the set-top box to select and input the interface displayed by display device 200, rather than using the remote control that comes with display device 200 to control the interface displayed by display device 200.

[0073] When the user interface displayed on the display device 200 is the control homepage of the set-top box, such as Figure 5 As shown, the control panel can include different tabbed interfaces, and each tabbed interface can include multiple item controls and a focus cursor, such as interactive areas. Figure 6 As shown, when the user interface is a channel interface, the tab interface that controls the homepage is the channel interface. The channel interface includes different types of item controls and focus cursors, such as Channel A, Channel B, etc.

[0074] The remote control that comes with the set-top box has multiple buttons for performing different functions. For example, the navigation keys, namely the up, down, left, and right directional keys, are used to switch focus; for instance, the down directional key can be used to switch focus from channel A to channel B. Another example is the "Channel +" and "Channel -" buttons, used to switch channels, switching from channel A to channel B during live broadcasts. There is also an OK button to confirm the selected focus, and a back button to return to the previous screen.

[0075] The remote control accompanying the display device 200 also has multiple buttons for performing different functions. The same applies to the remote control accompanying the set-top box, so it will not be elaborated upon here. However, for simplified operation, some remote controls accompanying the display device 200 include up, down, left, and right directional keys. The up and down keys are used for focus switching, and the left and right keys are used to adjust the volume or playback progress. Other functions can be accessed via voice or an app.

[0076] When the display device 200 is connected to the set-top box, the learning function of the remote control that comes with the display device 200 is used to bind it with the remote control of the set-top box, so as to simulate the button functions of the remote control that comes with the set-top box.

[0077] In some embodiments, in response to the user inputting the Learn or Set button on the remote control associated with the display device 200, an infrared code of the key to be learned is sent. The set-top box receives the infrared code of the key to be learned. The user inputs a key on the remote control associated with the set-top box that matches the infrared code of the key to be learned. An indicator light on the display device 200 emits an indication, for example, by flashing rapidly, indicating that the key to be learned has been successfully learned.

[0078] After successful learning, the remote control that comes with the display device 200 can directly simulate the button functions of the remote control that comes with the set-top box, such as turning the set-top box on and off, adjusting the volume, etc.

[0079] Because the set-top box's remote control includes "Channel +" and "Channel -" buttons for switching channels, while the display device 200's remote control does not, even after the display device 200's remote control is paired with the set-top box's remote control, it cannot learn the channel switching button functions. Furthermore, due to compatibility issues, channel switching on the set-top box cannot be achieved via voice or an app.

[0080] Due to the simplified design of the remote control accompanying the display device 200, which does not include "Channel +" and "Channel -" buttons, during learning, the up and down arrow keys learn the functions of the up and down arrow keys on the set-top box's remote control, i.e., switching focus. For example, when the user interface displayed on the display device 200 is the set-top box's control homepage, and it is necessary to switch focus to select a channel type or other item controls, the remote control accompanying the display device 200 can perform focus switching using the up and down arrow keys.

[0081] However, when the interface displayed on the display device 200 is switched to a live program, and the remote control that comes with the display device 200 is used to simulate a set-top box remote control, it is impossible to switch channels using the remote control that comes with the display device 200 during a live program because there is no button for learning channel switching.

[0082] To address the issue that some set-top boxes or in certain scenarios cannot be controlled to switch channels via control device 100, some embodiments of this application provide a display device 200. The display device 200 can detect the user interface provided by the set-top box to identify the interface type, and set the remote control buttons of the display device 200 according to different interface types to perform focus movement or channel switching functions, thereby realizing the control of the set-top box.

[0083] The display device 200 may include a display 260, a device interface 240, and a communication device 220. The display 260 is configured to display a user interface, which includes the user interface provided by the set-top box and the user interface provided by the display device 200. The user interface provided by the set-top box includes a live interface and a non-live interface. The live interface requires channel switching to control interface switching, and the non-live interface requires focus movement to control interface switching. For ease of description, in this embodiment, the live interface is defined as a first user interface, and the non-live interface is defined as a second user interface. Therefore, the user interface includes the user interface provided by the display device 200, the first user interface, and the second user interface. The first user interface and the second user interface can be two different tabbed interfaces.

[0084] Device interface 240 is configured to connect to a set-top box, and device interface 240 can send interface data to display device 200 through the set-top box. The set-top box includes a control device, which includes a first button and a second button; the first button is used to perform focus movement, and the second button is used to perform channel switching; after the set-top box is connected to device interface 240, display device 200 displays a first user interface or a second user interface, using the first button to control focus movement of the second user interface, and using the second button to control channel switching of the first user interface.

[0085] There are no restrictions on the type or number of the first and second buttons. For example, there can be two first buttons, including the up and down arrow keys, and there can also be two second buttons, including the "Channel +" and "Channel -" buttons.

[0086] Communication device 220 is configured to establish a communication connection with control device 100. Communication device 220 is capable of receiving wireless signals from control device 100. These wireless signals can be infrared signals, radio frequency signals, or signals transmitted using other wireless transmission methods. Communication device 220 includes a decoder for parsing the received signals into instructions that display device 200 can understand. The parsed instructions are transmitted to the operating system of display device 200, whereby the operating system executes corresponding operations. For example, if the received instruction is "volume up," display device 200 will modify the signal gain of the corresponding audio transmission channel of audio output device 270 to increase the playback volume.

[0087] The control device 100 includes a third button, which can be used to execute the same type of command, such as adjusting the playback progress forward or backward, or moving the focus up or down or left or right. The control commands provided by the third button enable switching of the user interface provided by the display device 200, from one user interface to another, where switching includes focus switching or playback progress switching.

[0088] The type and number of third buttons are not limited. For example, there can be two third buttons, including the up and down arrow keys, or the left and right arrow keys. In this embodiment, the up and down arrow keys are used as the third buttons.

[0089] like Figure 7 As shown, the controller 250 is configured to execute the steps corresponding to the button binding method, including the following:

[0090] S100: In response to a key input based on the third key, detect the interface type of the current user interface.

[0091] The key commands are input via the third key when channel switching or focus movement is required. After the set-top box establishes a connection with the display device 200, it can switch channels and move focus using the remote control that comes with the set-top box. When it is necessary to control the channel switching and focus movement of the set-top box using the remote control that comes with the display device 200, a key command is generated and sent to the set-top box so that the set-top box can receive the key command.

[0092] The set-top box and the display device 200 are two independent devices. After establishing a relationship between the set-top box and the display device 200, the set-top box receives, processes, and decodes media content from different sources, and encodes it into an audio-video signal that the display device 200 can parse. The audio-video signal is transmitted to the display device 200 through the device interface 240, and the display device 200 displays the received audio-video signal and shows the user interface provided by the set-top box. Among them, the user interface is the first user interface or the second user interface.

[0093] The first user interface and the second user interface are controlled by the set-top box. The user interacts with the set-top box through the remote control supporting the set-top box. For example, interactions such as moving the focus or switching channels. The set-top box generates an audio-video signal according to the user's instructions and transmits it to the display device 200. In this process, the display device 200 only receives the audio-video signal and cannot directly control the first user interface or the second user interface, nor can it recognize the specific content of the user interface displayed on the display 260.

[0094] To dynamically adjust the key command of the third button, the interface type of the user interface can be recognized. The interface type includes the first user interface and the second user interface. In some embodiments, the first user interface is a live broadcast interface, and the second user interface is a non-live broadcast interface. The third button can be dynamically matched to a channel switching or focus moving command according to the interface type of the user interface, so as to control the first user interface or the second user interface through the remote control supporting the display device 200.

[0095] To recognize the interface type, it can be obtained by performing feature detection on the recorded audio after the display device 200 responds to the key command and the point image intercepted in the user interface. Among them, channel switching involves the change of the signal source, and the audio output levels of different channels or programs may be different. And due to the factor of loading time, it may cause regular volume changes in the audio data in the recorded audio. Therefore, feature detection can be performed on the recorded audio to identify whether the interface type is a live broadcast interface. Similarly, because the signal sources of different channels or programs are different, the displayed user interfaces are different, and the image capture and acquisition can be carried out in real time. Therefore, feature detection can be performed on the icons, texts, and images in the user interface to identify the user interface type. If one or more of the icon, text, and image contents change, the user interface type may be a live broadcast interface. If none of the icon, text, and image contents change, the user interface type may be a non-live broadcast interface.

[0096] Because the remote control associated with the display device 200 cannot switch channels, when using feature detection to identify the interface type, the function of the third button is matched with the function of the second button by default. In some embodiments, images are captured in the user interface to obtain a first set of images and a second set of images. The features of the first set of images and the second set of images are compared to obtain a first feature detection result. The first set of images consists of point images captured according to a first time interval and a first set of points. The second set of images consists of point images captured according to a first time interval and a first set of points after the first set of images are acquired.

[0097] The first group of points includes multiple first points, for example, such as Figure 8 and Figure 9 As shown, there are four first points in the user interface. Regions 1, 2, 3 and 4, which are formed outward from the four first points, are the point images in the first set of images. Each point image contains the features of the user interface.

[0098] like Figure 10 As shown, after a first time interval, for example, 2 seconds, regions 5, 6, 7 and 8 formed outward from the four first points are the point images in the second set of images. The point images of the first set of images and the point images of the second set of images have the same coverage area. The area of ​​region 1 in the first set of images is the same as that of region 5 at the same location in the second set of images.

[0099] exist Figure 9 and Figure 10 In the diagram, regions 1 and 5, 2 and 6, 3 and 7, and 4 and 8 are point images at the same location. Comparing the features of the first group of images and the second group of images means comparing the features of the point images at the same location in the first group of images and the second group of images. Taking regions 1 and 5 as an example, we compare the features of the point image corresponding to region 1 with the point image corresponding to region 5. For ease of description, the point image corresponding to region 1 is defined as the first point image, and the point image corresponding to region 5 is defined as the second point image.

[0100] The features can be visual features, layout features, etc. Comparing visual features involves comparing the color, brightness, and texture elements of the first and second point images; comparing layout features involves comparing the elements and element proportions of the first and second point images.

[0101] For example, the first image has a predominantly blue color tone and includes a certain texture element, while the second image has a predominantly red color tone and includes another texture element. It is evident that the first and second images have different visual characteristics. Furthermore, the layout features of the first and second images can be compared. In this embodiment, it can be determined whether the characteristics of the images have changed based on visual features and / or layout features.

[0102] When determining whether the features of a point image have changed by combining visual and layout features, if the visual features of the first and second point images are different, and their layout features are also different, then the features of the point image are determined to have changed. If the visual features of the first and second point images are the same, even if their layout features are the same, the features of the point image cannot be determined to have changed.

[0103] When determining whether the features of a point image have changed solely based on visual or layout features, if the layout features of the first and second point images are different, there is no need to detect the visual features of the first and second point images; the feature of the point image is directly determined to have changed. If the layout features of the first and second point images are the same, the visual features of the first and second point images are then detected. If the visual features are different, the feature of the point image is determined to have changed; if the visual features are the same, the feature of the point image is determined to have changed.

[0104] Feature detection is performed on regions 1 and 5, regions 2 and 6, regions 3 and 7, and regions 4 and 8 respectively, generating a first feature detection result. If the first feature detection result indicates a feature change in the first preset number of point images, the third and fourth sets of images are captured in the user interface, and the interface type of the user interface is detected based on the third and fourth sets of images.

[0105] For example, the first and second sets of images each include four first point images. The first preset number can be three. If only the features of regions 3 and 7, and regions 4 and 8 change, then the features of the first preset number of point images remain unchanged, and the interface type of the user interface is marked as a non-live interface. If the features of regions 1 and 5, regions 2 and 6, and regions 3 and 7 all change, the third and fourth sets of images are captured in the user interface.

[0106] The third set of images consists of point images captured according to the first time interval and the second set of points; the fourth set of images consists of point images captured after acquiring the third set of images, according to the first time interval and the second set of points. The third and fourth sets of images are acquired in the same way, by setting points and then capturing the area formed outward from the points. The first, second, third, and fourth sets of images can be acquired using an image acquisition device.

[0107] The second group of points includes multiple second points, such as... Figure 11 As shown, regions A, B, and C are point images in the third group of images, where each point image contains features of the user interface.

[0108] like Figure 12 As shown, after 2 seconds, regions D, E, and F are formed outwards from the four second points, forming the point images in the fourth group of images. The point images in the third and fourth groups of images cover the same area, and region A in the third group of images has the same area as region D at the same location in the fourth group of images. The area of ​​the point images in the third group of images can be the same as or different from that in the first group of images. For ease of description, the regions of the point images in the first and second groups of images are designated as the first cropping region, and the regions of the third and fourth groups of images are designated as the second cropping region.

[0109] For example, regions 1, 2, 3, and 4 are the first intercepted regions, and regions A, B, and C are the second intercepted regions. In some embodiments, the area of ​​the second intercepted region is half the area of ​​the first intercepted region. Reducing the area can decrease the time required for feature comparison.

[0110] The first points corresponding to regions 1, 2, 3, and 4 are sequentially connected to generate a first coverage area, or the first points corresponding to regions 5, 6, 7, and 8 are sequentially connected to generate a first coverage area; the second points corresponding to regions A, B, and C are sequentially connected to generate a second coverage area, or the second points corresponding to regions D, E, and F are sequentially connected to generate a second coverage area. In some embodiments, a first coverage ratio and a second coverage ratio can be calculated, and a third set of images and a fourth set of images can be obtained based on the second coverage ratio.

[0111] Wherein, the first coverage ratio is the ratio of the area of ​​the first coverage region to the total area of ​​the user interface, and the second coverage ratio is the ratio of the area of ​​the second coverage region to the total area of ​​the user interface, wherein the first coverage ratio is greater than the second coverage ratio. For example, the first coverage ratio is 0.8, and the second coverage ratio can be any coverage ratio that is less than 0.8 and greater than 0.

[0112] Taking a second coverage ratio of 0.5 as an example, the features of the third and fourth groups of images are compared to obtain the second feature detection results; in Figure 11 and Figure 12 In the diagram, regions A and D, B and E, and C and F are point images at the same location. Comparing the features of the third and fourth groups of images means comparing the features of the point images at the same location in the third group with those in the fourth group. Taking regions A and D as an example, we compare the features of the point images corresponding to region A and region D. For ease of description, the point image corresponding to region A is defined as the third point image, and the point image corresponding to region D is defined as the fourth point image.

[0113] The feature comparison between the third and fourth point images is the same as that between the first and second point images, and will not be repeated here. After generating the second feature detection result, if the second feature detection result shows that the features of the second preset number of point images have changed, the interface type of the user interface is marked as a live interface; if the second feature detection result shows that the features of the second preset number of point images have not changed, the interface type of the user interface is marked as a non-live interface.

[0114] For example, the third and fourth image groups each include three point images, and the second preset number can be two. If only the characteristics of regions B and E change, it indicates that the characteristics of the second preset number of point images have not changed, and the user interface type is a non-live interface. If the characteristics of regions A and D, and regions B and E all change, the user interface type is a live interface. In other words, when the characteristics of the second preset number of point images change, it means that channel switching can be controlled via the third button.

[0115] In some embodiments, the method for identifying the interface type using recorded audio involves: obtaining the infrared code of the third button; forwarding the infrared code to the set-top box; obtaining the first recorded audio, wherein the first recorded audio is audio data recorded within a second time interval after the infrared code is sent; and if the volume of the first recorded audio changes from a first value to a second value and then back to the first value, the interface type of the user interface is marked as a live streaming interface.

[0116] Infrared codes operate based on the infrared photoelectric effect, transmitting and decoding data via infrared signals between the transmitter and receiver. The infrared code of the third button can be obtained by decoding the infrared signal emitted by the third button. This infrared code can be forwarded to the set-top box via an infrared forwarding service. This service can receive infrared codes from the remote control associated with the display device 200, such as the infrared code of the third button.

[0117] After the infrared code is forwarded, a second time interval, for example, 3 seconds later, is used to generate the first recorded audio. That is, the duration of the first recorded audio is 3 seconds. A dynamic range analyzer can be used to analyze the volume of the audio signal and its changes in real time. Figure 13 As shown, the volume changes from non-zero to a continuous 0, and then back to non-zero, indicating that the set-top box can respond to the channel switching command of the third button, binding the button function of the third button to the function command of the second button.

[0118] When a user initiates the binding of the set-top box, if they want to control the set-top box via control device 100, control device 100 needs to learn the infrared codes corresponding to the buttons on the control device used to control the set-top box. The set-top box will retrieve a list of matching infrared codes from the cloud based on its current location information or the operator information manually selected by the user, and then perform infrared code matching. The infrared code library stores different operation commands, such as infrared remote control commands corresponding to channel switching and volume adjustment.

[0119] In some embodiments, during infrared code library matching, the control device 100 includes a fourth button for muting. The controller 250 retrieves the mute infrared code corresponding to the fourth button based on the set-top box's infrared code library and sends the mute infrared code to the set-top box. Then, it acquires a second recorded audio, which is audio data recorded within a second interval after the mute infrared code is sent. If the volume of the second recorded audio is 0, the mute infrared code is sent to the set-top box again. If the volume of the second recorded audio is not 0, the binding relationship between the control device 100 and the control unit is established. The first and second recorded audio can be acquired using a sound acquisition device.

[0120] The set-top box will send a mute infrared code according to the infrared forwarding service, record the sound of the current display device 200, and analyze the sound volume. If the volume is continuously 0, it will send another mute infrared code and record the sound of the display device 200 again for analysis until the volume is no longer continuously 0, indicating that the control device 100 and the control unit are successfully bound.

[0121] After successful binding, the corresponding set-top box channel list can be obtained from the cloud based on the current infrared code library. In some embodiments, the channel list of the signal source connected to the set-top box can be obtained. Channel information, including channel number and channel name, is obtained through the channel list. Infrared code is sent to the set-top box according to the channel number and the infrared code library. Channel marker image is obtained, which is an image of a preset area of ​​the user interface captured within a second time interval after the infrared code is sent. Channel marker in the channel marker image is identified. If the channel marker is associated with the channel name corresponding to the channel number, the display 260 is controlled to display the video stream sent by the set-top box in the user interface.

[0122] The channel list includes information on available programs, including channel numbers and channel names. The channel number uniquely identifies the channel, while the channel name facilitates user identification. For example, when switching to a specific channel, the system finds the corresponding infrared code based on the channel number and sends an infrared command to the set-top box via the infrared forwarding service to achieve channel switching. For instance, if the channel number is 123, infrared codes 1, 2, and 3 will be sent respectively.

[0123] The channel mark image is the logo of the channel or TV station. The channel mark image is set in the upper left or upper right corner. Correspondingly, the preset area can be a preset size area in the upper left or upper right corner of the user interface. The image of the preset area within the user interface is captured, and the channel mark, i.e. the station logo, can be identified through image recognition technology, such as OCR character recognition or other image matching algorithms.

[0124] To further verify whether the third button can switch channels, such as... Figure 14As shown, in some embodiments, a first channel marker image is acquired (S1401), the first channel marker image being an image obtained by cropping a preset area of ​​the current user interface; in response to a key input based on the third key, a second channel marker image is acquired (S1402), the second channel marker image being an image of the preset area of ​​the current user interface cropped after the key input is sent; a first channel marker is identified from the first channel marker image (S1403), and a second channel marker is identified from the second channel marker image (S1404); the first channel marker and the second channel marker are compared to generate a verification result (S1405); if the verification result is that the first channel marker and the second channel marker are different, a prompt message is generated, and the display 260 is controlled to display the prompt message (S1406), the prompt message indicating that the third key cannot perform the channel switching function; if the prompt message is that the first channel marker and the second channel marker are the same, the display 260 is controlled to display the user interface of the channel corresponding to the second channel marker (S1407).

[0125] For example, by capturing an image of the logo area of ​​the current user interface, the first logo image is obtained as logo A. When the user inputs a key input command using the third key, that is, when the user wants to switch channels using the third key, to adapt to the response time, an image of the logo area of ​​the current user interface is captured to obtain a second logo image. The second logo image may be logo A, in which case the channel switching is unsuccessful, and a prompt message can be displayed, such as "Unable to switch channels, please re-match". The second logo may also be logo B, which is different from logo A. The display device 200 directly displays the channel content corresponding to logo B.

[0126] By analyzing the recorded audio and its features, the display device 200 can determine the interface type of the monitor 260.

[0127] S200: If the interface type of the user interface is a non-live interface, set the button function of the third button according to the button function of the first button, so as to perform focus movement in the non-live interface through the third button.

[0128] The third button on the remote control that comes with the display device 200 does not support switching the set-top box's channels. When the interface type is a non-live interface, the third button is bound to the first button on the remote control that comes with the set-top box. That is, when the interface type is a non-live interface, the user interface can be the first user interface, such as a community interface. Users do not need to switch channels, but only need to move the focus to select the item control. By binding the third button to the first button, the focus of the user interface can be moved by the third button.

[0129] like Figure 15 As shown, the homepage interface is a non-live broadcast interface. When the set-top box is turned on for the first time, the default focus can be on a certain item control. Taking the default focus as the program control as an example, the control command input by the user through the third button is obtained. The set-top box responds to the control command and executes the focus movement control action, which can move the focus up or down. For example, the focus can be moved from the program control to the interactive zone control.

[0130] It is understandable that when the set-top box executes control commands, the user interface will change accordingly based on the focus movement, and the user interface displayed on the display device 200 will change synchronously, displaying the interface content after the change.

[0131] S300: If the interface type of the user interface is a live broadcast interface, set the function of the third button according to the function of the second button, so as to perform channel switching of the live broadcast interface through the third button.

[0132] The third button on the remote control for display device 200 does not support switching channels on the set-top box. When the interface type is a live broadcast, the third button is bound to the second button on the remote control. That is, when the interface type is a live broadcast, the user interface is the second user interface, and the user needs to switch channels during viewing. After the interface type changes from a non-live broadcast to a live broadcast, the function of the third button is unbound from the function of the first button, and the function of the third button is bound to the function of the second button. The function of the second button is channel switching. Therefore, when the function of the third button is bound to the function of the second button, the third button on the remote control for display device 200 can be used to control the channel switching of live broadcast programs on the set-top box.

[0133] When a user inputs a control command via the third button, the set-top box responds by switching channels. For example, based on the channel list, it can switch to the previous channel or the next channel. After switching channels, the user interface changes from one live broadcast interface to another, and the display device 200 changes synchronously to display the other live broadcast interface.

[0134] Based on the above-described display device 200, some embodiments of this application also provide a button switching method, including the following steps:

[0135] In response to a key input based on a third key, the interface type of the current user interface is detected. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the key input and the point image captured in the user interface.

[0136] If the interface type of the user interface is a non-live interface, the function of the third button is set according to the function of the first button, so that the focus movement in the non-live interface can be performed through the third button.

[0137] If the user interface type is a live streaming interface, the function of the third button is set according to the function of the second button, so that the channel switching of the live streaming interface can be performed through the third button.

[0138] As can be seen from the above technical solutions, some embodiments of this application provide a display device 200 and a button switching method. The method can detect the interface type of the current user interface in response to a button command input based on a third button. The interface type is obtained by performing feature detection on the recorded audio of the display device responding to the button command and on point images captured in the user interface. If the interface type is a non-live interface, the button function of the third button is set according to the button function of the first button to perform focus movement in the non-live interface. If the interface type is a live interface, the button function of the third button is set according to the button function of the second button to perform channel switching in the live interface. This method, by detecting the interface type of the user interface, allows direct control of channel switching in the live interface via the third button when the interface type is a live interface, thus solving the problem that the set-top box cannot switch channels using the display device's remote control.

[0139] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0140] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0141] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0142] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The device interface is configured to connect to a set-top box, the set-top box including a control device, the control device including a first button and a second button; the first button is used to perform focus movement, and the second button is used to perform channel switching; A communication device is configured to establish a communication connection with a control device of the display device, the control device including a third button; The controller is configured as follows: When a key input command is received from the user based on the third key, the interface type of the current user interface is detected. The interface type is obtained by performing feature detection on the recorded audio after the display device receives the key input command and the point image captured in the user interface. Specifically, the infrared code of the third key is obtained; the infrared code is forwarded to the set-top box; a first recorded audio is obtained, which is audio data recorded within a second time interval after the infrared code is sent; if the volume of the first recorded audio changes from a first value to a second value and then back to the first value, the interface type of the user interface is marked as a live broadcast interface. If the interface type of the user interface is a non-live interface, the function of the third button is set according to the function of the first button, so that the focus movement in the non-live interface can be performed through the third button. If the user interface type is a live streaming interface, the function of the third button is set according to the function of the second button, so that the channel switching of the live streaming interface can be performed through the third button.

2. The display device according to claim 1, characterized in that, The controller performs the function of detecting the interface type of the current user interface and is also configured to: Images are captured in the user interface to obtain a first set of images and a second set of images. The first set of images consists of point images captured according to a first time interval and a first set of points. The second set of images are point images captured according to the first time interval and the first set of points after acquiring the first set of images; Compare the features of the first group of images and the second group of images to obtain the first feature detection result; If the first feature detection result is a feature change of a first preset number of point images, then a third set of images and a fourth set of images are captured in the user interface, and the interface type of the user interface is detected based on the third set of images and the fourth set of images. The third set of images is a point image captured according to a first time interval and a second set of points; the fourth set of images is a point image captured according to a first time interval and a second set of points after acquiring the third set of images. If the first feature detection result indicates that the features of the first preset number of point images have not changed, the interface type of the user interface is marked as a non-live interface.

3. The display device according to claim 2, characterized in that, The controller is configured to detect the interface type of the user interface based on the third and fourth sets of images, and is also configured to: Compare the features of the third group of images and the fourth group of images to obtain the second feature detection result; If the second feature detection result is a feature change in the second preset number of point images, mark the interface type of the user interface as a live broadcast interface; If the second feature detection result indicates that the features of the second preset number of point images have not changed, the interface type of the user interface is marked as a non-live interface.

4. The display device according to claim 3, characterized in that, The controller is configured to acquire the second feature detection result and is also configured to: Obtain a first cropping region, which is a preset region of the point image in the first group of images and / or the second group of images; A second interception region is set according to the first interception region, and the area of ​​the second interception region is 1 / 2 of the area of ​​the first interception region; The third and fourth sets of images are obtained based on the second cropping region.

5. The display device according to claim 3, characterized in that, The first group of points includes multiple first points, and the second group of points includes multiple second points; The controller is configured to acquire the second feature detection result and is also configured to: Obtain a first coverage area and a second coverage area, wherein the first coverage area is an area formed by sequentially connecting multiple first points, and the second coverage area is an area formed by sequentially connecting multiple second points; Calculate a first coverage ratio and a second coverage ratio. The first coverage ratio is the ratio of the area of ​​the first coverage area to the total area of ​​the user interface, and the second coverage ratio is the ratio of the area of ​​the second coverage area to the total area of ​​the user interface. The first coverage ratio is greater than the second coverage ratio. The third and fourth sets of images are obtained based on the second coverage ratio.

6. The display device according to claim 1, characterized in that, The control device includes a fourth button for performing a mute function; the controller is further configured to: Obtain the infrared code library of the set-top box, retrieve the mute infrared code corresponding to the fourth button in the infrared code library, and send the mute infrared code to the set-top box; Acquire a second audio recording, which is audio data recorded within a second interval after the silent infrared code is sent; If the volume of the second recorded audio is 0, send the mute infrared code to the set-top box again; If the volume of the second recorded audio is not 0, establish a binding relationship between the control device and the control unit.

7. The display device according to claim 6, characterized in that, The controller is also configured to: Get the channel list of the signal source connected to the set-top box; Channel information is obtained from the channel list, and the channel information includes the channel number and the channel name. Infrared codes are sent to the set-top box based on the channel number and the infrared code library. Acquire a channel marker image, wherein the channel marker image is an image of a preset area of ​​the user interface captured within a second time interval after the infrared code is transmitted; Identify the channel markers in the channel marker image; If the channel tag is associated with the channel name corresponding to the channel number, the display is controlled to show the media assets of the video stream sent by the set-top box in the user interface.

8. The display device according to claim 7, characterized in that, The controller is also configured to: Acquire a first channel marker image, which is an image obtained by cropping a preset area of ​​the current user interface; In response to a key input based on the third key, a second channel marker image is acquired, wherein the second channel marker image is an image of a preset area of ​​the current user interface captured after the key input is sent; Identify a first channel marker from the first channel marker image, and identify a second channel marker from the second channel marker image; If the first channel marker is different from the second channel marker, a prompt message is generated, and the display is controlled to show the prompt message, which indicates that the third button cannot perform the channel switching function.

9. A button switching method, characterized in that, A display device according to any one of claims 1-8, the display device comprising a display and a device interface, the display being configured to display a user interface; the device interface being configured to connect to a set-top box, the set-top box comprising a control device, the control device comprising a first button and a second button; the first button being used to perform focus movement, and the second button being used to perform channel switching; comprising: The controller is configured as follows: When a user inputs a key command via the third button of the control device of the display device, the interface type of the current user interface is detected. The interface type is obtained by performing feature detection on the recorded audio after the display device receives the key command and on the point image captured in the user interface. Specifically, the infrared code of the third button is obtained; the infrared code is forwarded to the set-top box; a first recorded audio is obtained, which is audio data recorded within a second time interval after the infrared code is sent; if the volume of the first recorded audio changes from a first value to a second value and then back to the first value, the interface type of the user interface is marked as a live broadcast interface. If the interface type of the user interface is a non-live interface, the function of the third button is set according to the function of the first button, so that the focus movement in the non-live interface can be performed through the third button. If the user interface type is a live streaming interface, the function of the third button is set according to the function of the second button, so that the channel switching of the live streaming interface can be performed through the third button.

Images