Control method, device and system

Abstract

The invention discloses a control method, device and system, and relates to the field of media. The method comprises the following steps: receiving a control signal at home equipment (such as Sink type equipment or Source type equipment) of the remote controller, and determining a processing mode of the control signal according to an interaction target determined by the Sink type equipment. Therefore, whether a user uses the remote controller of the Sink type equipment or the remote controller of the Source type equipment, the Sink type equipment and the Source type equipment can be controlled. The operation complexity of using the system of the Sink type equipment and the Source type equipment by the user is reduced and the user experience is improved only through software logic on the premise that the hardware cost of the system of the Sink type equipment and the Source type equipment is not increased and the operation habit of the user is not changed.

Description

Technical Field

[0001] The present application relates to the field of media, and in particular to a control method, device, and system. Background Art

[0002] Currently, users need to rely on the TV remote control to operate the TV and the set-top box remote control to operate the set-top box. This complicated operation has caused great trouble and inconvenience to the majority of users when using the TV and set-top box. Therefore, how to simplify the control operation of the TV and set-top box is an urgent problem to be solved. Summary of the Invention

[0003] The present application provides a control method, device and system that simplify the control operations of a television and a set-top box without changing the user's operating habits or increasing the hardware cost.

[0004] In a first aspect, a control method is provided, which includes a sink-type device receiving a control signal from a remote control, where the control signal includes a signal of any one of the following buttons: direction, number, confirmation, return, menu, channel up, channel down, or mouse position; when the interaction target is a source (Source), sending the control signal to the source-type device; and when the interaction target is a sink, processing the control signal by itself.

[0005] In a second aspect, a control method is provided, comprising: a sink-type device receiving a control signal from a remote control, the control signal including a signal from a power button or a source button. When the interaction target is a source or sink, the method independently processes the control signal from the power button, and transmits the control signal from the power button to a source-type device. When the interaction target is a source or sink, the method independently processes the control signal from the source button.

[0006] On the third aspect, a control method is provided, which includes a Sink-type device receiving a control signal from a remote control, where the control signal includes a signal of a replay button; when the interaction target is a Source, the control signal is sent to the Source-type device; when the interaction target is a Sink, the control signal is not processed.

[0007] Therefore, users can control both sink and source devices using either a sink or source remote control. Using software logic alone, this approach reduces the operational complexity of sink and source systems, simplifies TV and set-top box control, and enhances the user experience without increasing the hardware cost or changing user operating habits.

[0008] In a possible implementation, sending the control signal to the Source device includes sending the control signal through an interconnection interface between the Sink device and the Source device.

[0009] In another possible implementation, sending the control signal to the Source device includes sending the control signal through an interconnection interface when the Source device supports a key processing capability.

[0010] In another possible implementation, the interconnection interface includes a General Purpose Multimedia Interface (GPMI).

[0011] In another possible implementation, applicable scenarios where the interaction target is the Source include displaying only the Source content, and displaying both the Sink and the Source but the user intends to control the Source.

[0012] In another possible implementation, the applicable scenarios where the interaction target is the Sink include displaying only the Sink content, and displaying both the Sink and the Source but the user's intention is to control the Sink.

[0013] In a fourth aspect, a control method is provided, which includes a Source-type device receiving a control signal from a remote control, where the control signal includes a control signal of any one of the direction, number, confirmation, return, menu, channel up, channel down, or mouse position buttons; when the interaction target is a Source, the control signal is processed by the device itself; when the interaction target is a Sink, the control signal is sent to a Sink-type device.

[0014] In a fifth aspect, a control method is provided, which includes a Source-type device receiving a control signal from a remote control; when the interaction target is Source or Sink and the control signal includes the signal of a power button, the method processes the control signal by itself and sends the control signal to a Sink-type device; when the interaction target is Source or Sink and the control signal includes the signal of a source button, the method sends the control signal to a Sink-type device.

[0015] In the sixth aspect, a control method is provided, which includes a Source-type device receiving a control signal from a remote control, where the control signal includes a signal of a replay button; when the interaction target is a Source, the control signal is processed by itself; when the interaction target is a Sink, the control signal is not processed.

[0016] In a possible implementation, the control signal is processed independently, including processing the control signal independently when the input source of the Sink type device is the current Source type device.

[0017] In another possible implementation, sending the control signal to the Sink device includes sending the control signal through an interconnection interface between the Sink device and the Source device.

[0018] In another possible implementation, sending the control signal to the Sink type device includes sending the control signal through an interconnection interface when the Sink type device supports key processing capability.

[0019] In another possible implementation, the interconnection interface includes GPMI.

[0020] In another possible implementation, the method further includes obtaining an interaction target of a Sink-type device, where the interaction target includes a Sink or a Source.

[0021] Optionally, the method further includes the Source device receiving interaction target information from the Sink device, where the interaction target information is used to indicate the interaction target. The Source device obtains the interaction target information from the Sink device and then selects an appropriate device to process the control signal.

[0022] In another possible implementation, applicable scenarios where the interaction target is the Source include displaying only the Source content, and displaying both the Sink and the Source but the user intends to control the Source.

[0023] In another possible implementation, the applicable scenarios where the interaction target is the Sink include displaying only the Sink content, and displaying both the Sink and the Source but the user's intention is to control the Sink.

[0024] In a seventh aspect, a display device is provided, comprising modules for executing the method of the first to third aspects or any possible design thereof. For example, the display device comprises a communication module and a processing module.

[0025] The communication module is used to receive control signals from the remote control. Control signals include direction, number, confirm, return, menu, channel up, channel down, or any of the following: mouse position. The communication module is also used to send control signals when the interaction target is a source. The processing module is used to process the control signals when the interaction target is a sink.

[0026] Optionally, the communication module is used to receive control signals from the remote control, including signals from either the power or source buttons. The processing module is used to independently process the control signal from the power button when the interaction target is a source or sink. The communication module is also used to send the control signal from the power button when the interaction target is a source or sink. The processing module is also used to independently process the control signal from the source button when the interaction target is a source or sink.

[0027] Optionally, the communication module is used to receive a control signal from the remote control, the control signal including the signal of the replay button; when the interaction target is Source, the control signal is sent; when the interaction target is Sink, the control signal is not processed.

[0028] In an eighth aspect, a source device is provided, the source device comprising modules for executing the method of the fourth to sixth aspects or any possible design thereof. For example, the source device comprises a communication module and a processing module.

[0029] The communication module is used to receive control signals from the remote control. The control signals include signals of any one of the direction, number, confirmation, return, menu, channel up, channel down, or mouse position buttons. The processing module is used to process the control signals by itself when the interaction target is the Source. The communication module is also used to send control signals when the interaction target is the Sink.

[0030] Optionally, a communication module is used to receive a control signal from a remote control; a processing module is used to process the control signal by itself when the interaction target is a Source or a Sink and the control signal includes a signal from a power button; a communication module is used to send a control signal when the interaction target is a Source or a Sink and the control signal includes a signal from a power button; the communication module is also used to send a control signal when the interaction target is a Source or a Sink and the control signal includes a signal from a source button.

[0031] Optionally, a communication module is used to receive control signals from a remote control, the control signals including the signal of a replay button; a processing module is used to process the control signals by itself when the interaction target is a Source; and not process the control signals when the interaction target is a Sink.

[0032] In a ninth aspect, a host device is provided, comprising at least one processor and a memory, wherein the memory is used to store a computer program so that when the computer program is executed by at least one processor, the method described in the first to third aspects or any possible design is implemented.

[0033] In a tenth aspect, a source device is provided, comprising at least one processor and a memory, wherein the memory is used to store a computer program so that when the computer program is executed by at least one processor, the method described in aspects 4 to 6 or any possible design is implemented.

[0034] In an eleventh aspect, a data transmission system is provided, which includes the sink device as described in the ninth aspect and the source device as described in the tenth aspect.

[0035] In the twelfth aspect, a chip is provided, comprising: a processor and a power supply circuit; wherein the power supply circuit is used to supply power to the processor; the processor is used to execute the operating steps of the method in any possible implementation of the first to third aspects, and to execute the operating steps of the method in any possible implementation of the fourth to sixth aspects.

[0036] In a thirteenth aspect, a computer program product is provided, which includes a computer program or instructions. When the computer program product runs on a processor, the processor executes the operating steps of the method in the above aspects or any possible implementation method.

[0037] In a fourteenth aspect, a computer-readable storage medium is provided, comprising: computer software instructions; when the computer software instructions are executed in a computing device, the computing device executes the operating steps of the method in the above aspects or any possible implementation.

[0038] Among them, the technical effects brought about by any implementation method in the fourth to fourteenth aspects can refer to the technical effects brought about by the corresponding implementation methods in the first to third aspects, and will not be repeated here.

[0039] Various possible implementations of any of the above aspects can be combined under the premise that there is no contradiction between the solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of the structure of a data transmission system provided in this application;

[0041] Figure 2 A schematic diagram of the structure of another data transmission system provided by this application;

[0042] Figure 3 A schematic diagram of the structure of the electronic device provided for this application;

[0043] Figure 4 A flow chart of a control method provided in this application;

[0044] Figure 5A schematic diagram of the interface of a Sink device provided in this application;

[0045] Figure 6 A flow chart of another control method provided in this application;

[0046] Figure 7 A flow chart of another control method provided in this application;

[0047] Figure 8 A flow chart of another control method provided in this application;

[0048] Figure 9 A flow chart of another control method provided in this application;

[0049] Figure 10 A flow chart of another control method provided in this application;

[0050] Figure 11 A flow chart of another control method provided in this application;

[0051] Figure 12 A flow chart of another control method provided in this application;

[0052] Figure 13 A schematic structural diagram of a display device provided in this application;

[0053] Figure 14 This is a schematic diagram of the structure of a signal source device provided in this application. DETAILED DESCRIPTION

[0054] To facilitate understanding, the main terms involved in this application are first explained.

[0055] A remote control is a wireless transmitter that remotely controls electronic devices via wireless signals or infrared transmission. For example, remote controls use digital coding technology to encode keystrokes and transmit light waves through infrared diodes. These light waves pass through the electronic device's infrared receiver, converting the infrared signals into electrical signals. A processor decodes the electrical signals and demodulates the corresponding instructions to control the electronic device to complete the desired operation. Examples of electronic devices include televisions and set-top boxes.

[0056] A remote control primarily consists of an integrated circuit board (IC) and buttons that generate various signals. The IC is the core component of the remote, processing keystroke information and generating control signals. The buttons are the user's interface for interacting with the remote, sending corresponding control commands by pressing different buttons.

[0057] Currently, in a TV-set-top box system, both devices are equipped with corresponding remote controls, and control signals sent by the remote controls are only executed by the device to which the remote controls belong. To simplify the operation of the TV-set-top box system with remote controls, the industry has proposed numerous solutions.

[0058] Solution 1: Key learning technology.

[0059] Solution 1 involves opening several buttons on the TV / set-top box remote control to support learning infrared codes from another remote control. However, this method requires a certain learning curve for the user. Essentially, it simply transfers buttons from one device's remote control to another, without simplifying user operations and changing user habits.

[0060] Solution 2: Three-mode remote control technology.

[0061] In Solution 2, the remote control supports different connections with the TV and set-top box (infrared / Bluetooth / Star Flash), and a pair of buttons are added to the remote control. One button is used to control the TV, and the other button is used to control the set-top box. This pair of buttons can be used to switch the remote control to remote TV mode / remote set-top box mode, and other buttons in the TV and set-top box remote controls are reused. However, in this solution, the user always needs to know whether the target control device is the TV or the set-top box, and the usage threshold is high. Therefore, in Solution 2, the hardware cost of the remote control needs to be increased, and the user needs to learn the usage scenarios and methods of the mode switching buttons, which changes the user's operating habits. Although the TV and set-top box remote controls reuse a set of buttons, there is still the problem of inconvenience in user operation.

[0062] Solution 3: Bluetooth interconnection technology.

[0063] In Solution 3, the TV and set-top box are connected via Bluetooth, and the TV / set-top box forwards keystrokes via Bluetooth. The TV and set-top box must first be paired via Bluetooth, a relatively complex process. Furthermore, the current set-top box's Bluetooth module needs to carry certain services, such as Bluetooth remote control. This approach requires an additional Bluetooth module for the set-top box, increasing the system's hardware cost.

[0064] Based on this, in order to solve the problem of complex control operations of televisions and set-top boxes, the present application provides a control method, in which the control signal is received by the device to which the remote control belongs (such as a Sink device or a Source device), and the processing method of the control signal is determined according to the interaction target determined by the Sink device. For example, when a Sink device receives a control signal, if the interaction target is Source, the control signal is sent to the Source device; if the interaction target is Sink, the control signal is processed by itself. For another example, when a Source device receives a control signal, if the interaction target is Source, the control signal is processed by itself; if the interaction target is Sink, the control signal is sent to the Sink device. Therefore, whether the user uses the remote control of a Sink device to operate the buttons or the remote control of a Source device to operate the buttons, the Sink device and the Source device can be controlled. Only through software logic, without increasing the hardware cost of the system of Sink devices and Source devices and without changing the user's operating habits, the operation complexity of the system of users using Sink devices and Source devices is reduced, the control operation of the TV and set-top box is simplified, and the user experience is improved.

[0065] For example, as shown in Table 1, the button classification provided in this application is provided.

[0066] Table 1

[0067]

[0068] In some embodiments, the sink device is connected to the source device via an interconnection interface, which includes any one of a High-Definition Multimedia Interface (HDMI), a display port (DP), a General Purpose Multimedia Interface (GPMI), or other high-speed video interfaces.

[0069] Optionally, the Sink device and the Source device are interconnected by wired or wireless means, for example.

[0070] In this application, a sink device may also be referred to as a sink device, a sink device, or a sink-type device. A source device may also be referred to as a source device, a source device, or a source-type device. Optionally, a GPMI signal generating device is referred to as a source device, and a GPMI signal receiving and displaying device is referred to as a sink device.

[0071] For example, sink devices include monitors, TVs, or smart screens. Source devices include set-top boxes, plug-in set-top boxes, card-type set-top boxes, set-top boxes with screens, smart mid-size screens, or smart speakers.

[0072] Furthermore, the Sink device and / or Source device are each configured with their own interactive device. The interactive device is a remote control. The remote control can be a traditional remote control, a three-mode remote control, a directional remote control, or other types of remote controls. Of course, the interactive device can take a form other than a remote control, such as a handle, a touch device, etc. This application does not limit the form of the interactive device.

[0073] The control method provided in this application is described in detail below with reference to the accompanying drawings.

[0074] Figure 1 This is a structural diagram of a data transmission system provided by this application. The data transmission system includes a Sink device 110 and a Source device 120.

[0075] The sink device 110 and the source device 120 are connected via an interconnection interface. The interconnection interface includes DP, GPMI, or HDMI. Optionally, the interconnection interface does not include Bluetooth.

[0076] Optionally, the Sink device 110 and the Source device 120 are connected via a wired or wireless manner, for example, via a cable.

[0077] The Sink device 110 and the Source device 120 transmit signals via the interconnection interface. For example, the Sink device 110 and the Source device 120 transmit audio and video data or charging signals via the interconnection interface.

[0078] In one example, the sink device 110 is a television, and the source device 120 is a set-top box. The set-top box and the television are connected via a cable, and the set-top box transmits audio and video data to the television via the cable.

[0079] Optionally, the Sink-type device 110 includes interface A, the Source-type device includes interface B, and the connection between the Sink-type device 110 and the Source-type device 120 is specifically a connection between interface A of the Sink-type device 110 and interface B of the Source-type device 120. For example, interface A of the Sink-type device 110 and interface B of the Source-type device 120 are connected via a cable.

[0080] Optionally, the number of Sink devices and the number of Source devices are not limited. For example, the data transmission system includes one Sink device 110 and three Source devices 120.

[0081] The remote control for a sink device directly controls the sink device and indirectly controls the source device through an interconnection interface. For example, a TV remote control directly controls the TV and indirectly controls the set-top box through an interconnection interface.

[0082] The remote control of a source device directly controls the source device and indirectly controls the sink device through the interconnection interface. For example, the remote control of a set-top box directly controls the set-top box and indirectly controls the TV through the interconnection interface.

[0083] For example, Figure 2 This is a schematic diagram of another data transmission system provided by this application. Figure 2 In the example, the Sink device is the TV and the Source device is the set-top box. Figure 2 As shown in (a) of FIG. 1 , the data transmission system includes a TV 210 and set-top boxes 221 to 22n. The TV 210 is connected to each set-top box via an interconnection interface to perform data transmission, such as transmission of audio and video data or transmission of control signals.

[0084] Among them, TV 210 and set-top boxes 221 to 22n include interfaces, and the devices are connected to each other through the interfaces. The interface specifications used for data transmission between devices include, but are not limited to: universal serial bus (USB) interface specifications, HDMI specifications, DP specifications, GPMI specifications, and high-speed serial computer expansion bus (Peripheral Component Interconnect Express, PCI-Express) interface specifications. Accordingly, the interfaces are DP, HDMI, and Type-C interfaces.

[0085] For example, the interface connection between the set-top box and the TV is connected through an HDMI cable, and the interface standard followed is the HDMI interface specification; or, the connection is connected through a GPMI cable, and the interface standard followed is the GPMI interface specification.

[0086] like Figure 2 As shown in (a) of FIG. 1 , the TV 210 and the set-top boxes 221 to 22n communicate with their respective remote controls (referred to as the device's native remote controls, also referred to as the remote controls belonging to the device). The remote controls communicate with their devices, such as via infrared, Bluetooth, StarFlash, or other communication methods.

[0087] Among them, the control signal sent by the user operating the remote control is received by the remote control's home device, and the solution provided by this application is executed, and a suitable device (TV or set-top box) is selected to execute the control signal. Please refer to the description of the following method embodiment for details.

[0088] Through the solution provided by this application, Figure 2 The data transmission system shown in (a) achieves the following control effects.

[0089] The remote controller of the TV 210 directly controls the TV 210 and indirectly controls the set-top boxes 221 to 22n through the interconnection interface.

[0090] The remote controller of the set-top box 221 directly controls the set-top box 221 and indirectly controls the television 210 through the interconnection interface.

[0091] The remote controller of the set-top box 222 directly controls the set-top box 222 and indirectly controls the television 210 through the interconnection interface.

[0092] The remote controller of the set-top box 22n directly controls the set-top box 22n and indirectly controls the television 210 through the interconnection interface.

[0093] For example, Figure 2 (b) shows a control scenario. The TV and set-top box are connected via GPMI. The TV remote control controls the TV and all input source devices on the network (which may have multiple set-top boxes). The set-top box remote control controls the set-top box and the TV.

[0094] The solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0095] On the one hand, the embodiment of the present application provides a structural diagram of an electronic device 30. The electronic device 30 implements Figure 1 The functions of the Sink type device 110 or the Source type device 120 are shown in FIG.

[0096] like Figure 3 As shown, the electronic device 30 includes a processor 310, a bus 320, a memory 330, and a communication interface 340. The processor 310, the memory 330, and the communication interface 340 are connected via the bus 320.

[0097] It should be understood that in this embodiment, the processor 310 is a central processing unit (CPU), but the processor 310 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor is a microprocessor or any conventional processor, etc.

[0098] The processor 310 may also be a graphics processing unit (GPU), a neural network processing unit (NPU), a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the present application.

[0099] The communication interface 340 is used to implement communication between the electronic device 30 and an external device or component.

[0100] The bus 320 includes a path for transmitting information between the above-mentioned components (such as the processor 310 and the memory 330). In addition to the data bus, the bus 320 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, various buses are labeled as bus 320 in the figure. The bus 320 is a peripheral component interconnect express (PCIe) bus, an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a computer express link (CXL), a cache coherent interconnect for accelerators (CCIX), etc. The bus 320 is divided into an address bus, a data bus, a control bus, etc.

[0101] As an example, the electronic device 30 includes multiple processors. The processor is a multi-core (multi-CPU) processor. A processor herein refers to one or more devices, circuits, and / or computing units for processing data (e.g., computer program instructions).

[0102] It is worth mentioning that Figure 3 In the example, an electronic device 30 including a processor 310 and a memory 330 is taken as an example. Here, the processor 310 and the memory 330 are respectively used to indicate a type of device or equipment. In a specific embodiment, the number of each type of device or equipment is determined according to business requirements.

[0103] Memory 330 is a volatile memory pool or a nonvolatile memory pool, or may include both volatile and nonvolatile memories. Nonvolatile memories include read-only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories include random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0104] Exemplarily, the processor 310 receives a control signal from the remote control's home device (e.g., a Sink-type device or a Source-type device) by running or executing a software program and / or module stored in the memory 330, and processes the control signal according to the interaction target determined by the Sink-type device.

[0105] Next, the control process is described with reference to the accompanying drawings. The method is applied to a display system including a Sink device and a Source device, and is used to select a device in the display system to execute the control signal after the Sink device receives the control signal sent by the remote control of the Sink device. For example, the method is applied to Figure 1 or Figure 2 In the data transmission system shown in the figure, a sink device is, for example, a TV. A source device is, for example, a set-top box. Figure 4FIG. 1 is a flow chart of a control method provided by the present application. The method includes the following steps.

[0106] Step 410: The Sink device receives a control signal from a remote controller.

[0107] Sink devices receive control signals from a native remote control. A native remote control is a device's built-in remote control. Signals emitted by the native remote control are received by the device to which it belongs. These control signals are triggered by the user pressing a button on the native remote control. This remote control can be a traditional remote control, a controller, or some other form factor, and is not limited in this application.

[0108] In some examples, a user operates a remote controller of a sink device to control the sink device, and the sink device receives a control signal from the remote controller of the sink device.

[0109] For example, a user operates a common key in a remote controller of a Sink device, and the remote controller of the Sink device sends a control signal of the common key.

[0110] The common buttons include at least one button of direction, number, confirmation, return, menu, channel increase, channel decrease or mouse position.

[0111] The control signal includes a signal of any key among direction, number, confirmation, return, menu, channel up, channel down or mouse position.

[0112] Optionally, the common common buttons do not include the mouse position. The user operates the remote controller of the sink device, and the remote controller of the sink device sends a control signal of the mouse position.

[0113] In a possible implementation, the control signal is a key value corresponding to a button on the remote control. The embodiment of the present application does not limit the specific content of the key value.

[0114] Whether a button's control signal is processed by a sink or source device depends on the interaction target determined by the sink device. An interaction target indicates the user's control (or interaction) intent (or object) within the display system. It can also be referred to as an interaction state or other term, without limitation. An interaction target can be either a sink or a source.

[0115] In scenarios where the user's intention is to control the Source, the interaction target is the Source. In scenarios where the user's intention is to control the Sink, the interaction target is the Sink. The specific user intention is configured based on actual needs and is not limited in this application.

[0116] After determining the interaction target, the device internally records the interaction target (InteractionTarget) to record the current interaction target. Different values of the interaction target represent different interaction targets. For example, configuring InteractionTarget to 0 indicates that the interaction target is a source; configuring InteractionTarget to 1 indicates that the interaction target is a sink.

[0117] For example, in a scenario where only Source content is displayed, the user's intention is to control the Source, and the interaction target is the Source. Figure 5 The following diagram illustrates the Sink device interface in different scenarios. Figure 5 As shown in (a) in the figure, a sink device only displays the source content. For example, a sink device displays the source content in full screen, but not the sink content.

[0118] For example, only the Sink content is displayed (such as Figure 5 As shown in (b) in the figure, the user's intention is to control the sink, and the interaction target is the sink. The sink device displays the content of the sink device in full screen, without displaying the content of the source device.

[0119] For another example, in a scenario where both the Sink and Source are displayed, the user's intention may be to control the Source or the Sink. Therefore, in a scenario where both the Sink and Source are displayed, the interaction target is either the Source or the Sink. In the embodiments of the present application, the specific implementation of determining the interaction target in a scenario where both the Sink and Source are displayed is not limited and is designed based on actual needs.

[0120] Table 2 shows a possible definition of interaction targets.

[0121] Table 2

[0122]

[0123] The contents of Table 2 above are merely examples and do not constitute specific limitations.

[0124] For example, in a scenario where both the Sink and the Source are displayed, the user's control intention is determined based on one or more of the window area (or size, or proportion of the screen area, etc.), whether the Source is full screen, and the attributes of the displayed content, thereby determining the interaction target.

[0125] The following example describes an exemplary implementation of determining the user control intention and then determining the interaction target in a scenario where both the Sink and the Source are displayed, but does not constitute a specific limitation.

[0126] For example, Table 3 shows another definition of an interaction target.

[0127] Table 3

[0128]

[0129] As shown in Table 3, when both the Sink and Source are displayed, and the Source is not full screen, and the ratio of the Source window area to the Sink screen area is greater than or equal to the threshold, the user intention is determined to be controlling the Source, and the interaction target is determined to be the Source. In this scenario, the interface of the Sink device is as follows: Figure 5 As shown in (c) in .

[0130] When both the Sink and Source are displayed, and the Source is not full screen, and the ratio of the Source window area to the Sink screen area is less than or equal to the threshold, the user's intention is determined to be to control the Sink, and the interaction target is determined to be the Sink. In this scenario, the interface of the Sink device is as follows: Figure 5 As shown in (d) in .

[0131] Both the Sink and Source are displayed, and the Source is full screen. The Sink displays prompt information, confirming that the user's intention is to control the Source, and confirming that the interaction target is the Source. In this scenario, the interface of the Sink device is as follows: Figure 5 As shown in (e) in the figure. Among them, prompt information refers to information that is output only as a prompt and does not require user interaction or operation. For example, the prompt information is input source information, or other information, which is not limited in the embodiment of the present application.

[0132] Both the Sink and Source are displayed, and the Source is full screen, while the Sink displays non-prompt information. In this scenario, the interface of the Sink device is as follows: Figure 5 As shown in (f) in .

[0133] The above threshold is configured based on actual needs and is not limited. For example, the threshold is any value less than or equal to 100%. Furthermore, when the ratio of the source window area to the sink screen area is equal to the threshold, the interaction target is determined to be the source or the sink, without limitation.

[0134] Optionally, the Sink device reports the interaction target of the Sink device to the Source device.

[0135] Optionally, the Sink device receives the request message sent by the Source device, and reports the interaction target of the Sink device to the Source device.

[0136] Sink devices or Source devices determine the corresponding processing method based on the capabilities of each device in the system and the current interaction target.

[0137] Step 420: When the interaction target is Source, a control signal is sent to the Source type device.

[0138] Step 430: When the interaction target is Sink, the control signal is processed independently.

[0139] Sink devices determine how to process control signals based on their interaction targets.

[0140] For example, when a Sink device only displays Source content, the Sink device sends a control signal to the Source device.

[0141] For another example, when both the Sink and the Source are displayed and the user intends to control the Source, the Sink type device sends a control signal to the Source type device.

[0142] For another example, when a Sink device only displays the Sink content, it processes the control signal by itself.

[0143] For another example, when both the Sink and Source are displayed and the user's intention is to control the Sink, the Sink type device processes the control signal by itself.

[0144] When a sink device receives a keystroke from a remote controller of another sink device, the processing principle is as shown in Table 4.

[0145] Table 4

[0146]

[0147] Direct forwarding refers to sending control signals to the Source device, while self-processing refers to processing the control signals by itself.

[0148] For example, the control signal is a signal of a direction key, and a Sink-type device moves a selection box or a focus position.

[0149] For another example, the control signal is a channel up or channel down signal, and the Sink device switches channels.

[0150] For another example, the control signal is a signal from a digital key, and a Sink-type device switches channels.

[0151] For another example, the control signal is a confirmation button signal, and the Sink device displays the corresponding content.

[0152] For another example, the control signal is the signal of the return button, and the Sink type device displays the previous level of content.

[0153] For another example, the control signal is the signal of a menu button, and a Sink device displays a menu.

[0154] For another example, the control signal is a signal of a mouse position button, and a Sink device displays the current position of the mouse.

[0155] Optional, compatible with mouse position processing, the directional remote control of the Sink device can directly control the Source device.

[0156] In some embodiments, the Sink device sends a control signal through an interconnection interface between the Sink device and the Source device.

[0157] Optionally, the interconnection interface includes GPMI, and the Sink device sends a control signal to the Source device via GPMI.

[0158] In some embodiments, when a sink device and a source device shake hands via an interconnect interface (e.g., upon powering on or plugging in a cable), the sink device obtains the capabilities of the source device. For example, the sink device receives information about the key processing capabilities supported by the source device. The source device's capabilities include whether it supports key processing capabilities such as direction, number, confirm, return, menu, channel up, channel down, and mouse position.

[0159] Optional, such as Figure 6 As shown, the method further includes step 440. In step 440, the Sink device determines whether the Source device supports key processing capabilities. If the Source device supports key processing capabilities, the control signal is sent through the interconnection interface. If the Source device does not support key processing capabilities, the process ends.

[0160] When a Sink device receives a control signal sent by a remote control of a Sink device, it processes the control signal according to the interaction target of the Sink device. For example, if the interaction target of the Sink device is Sink, the control signal is processed by the device itself; if the interaction target of the Sink device is Source, the control signal is sent. This allows users to control both Sink and Source devices using the remote control of the Sink device. Through software logic alone, without increasing the hardware cost of the system for Sink and Source devices or changing user operating habits, the operational complexity of the system for users using Sink and Source devices is reduced, thereby improving the user experience.

[0161] Figure 7 This is a flow chart of another control method provided by this application. After the Sink device receives the control signal sent by the remote control of the Sink device, the device is selected in the display system to execute the control signal. Figure 4 The difference between the scheme shown is that the control signal includes the signal of any button of the power supply or the signal source, and the sink device determines the processing method of the power button or the sink device-specific button based on the interaction target of the sink device. The method includes the following steps.

[0162] Step 710: The Sink device receives a control signal from a remote controller.

[0163] Step 720: When the interaction target is Source or Sink, the control signal is processed independently.

[0164] For example, the control signal includes a control signal of a power button. When the interaction target is a Source or a Sink, the Sink type device performs a shutdown or startup operation.

[0165] Optionally, the control signal includes a control signal of a power button, and the method further includes step 730. Step 730: When the interaction target is a source or a sink, the control signal is sent to the source type device. The source type device performs a shutdown or startup operation.

[0166] For another example, the control signal includes a control signal of a source button. When the interaction target is Source or Sink, the control signal of the source button is processed independently.

[0167] The relevant information about the control signal and the interaction target being a Source or a Sink is as described in the above embodiment. When a Sink device receives a control signal from a remote controller power button or a source button of a Sink device, the processing principle is as shown in Table 4.

[0168] Therefore, when the control signal includes the control signal of any button in the power or source categories, the user can control both the sink and source categories using the remote control of the sink category device. Through software logic alone, without increasing the hardware cost of the sink and source category systems or changing user operating habits, the user's operating complexity is reduced, thus improving the user experience.

[0169] Figure 8This is a flow chart of another control method provided by this application. After the Sink device receives the control signal sent by the remote control of the Sink device, the device is selected in the display system to execute the control signal. Figure 4 The difference between the scheme shown is that the control signal includes the signal of the playback key, and the sink device determines the processing method of the ordinary key of the source device according to the interaction target of the sink device. The method includes the following steps.

[0170] Step 810: The Sink device receives a control signal from a remote controller.

[0171] Step 820: When the interaction target is Source, a control signal is sent to the Source type device.

[0172] When the interaction target is Sink, the control signal is not processed.

[0173] Optionally, when the interaction target is Sink, the Sink-type device performs a playback operation.

[0174] For example, the control signal includes a control signal of a replay button. When the interaction target is a Source or a Sink, the control signal is sent to a Source type device, and the Source type device performs a replay operation.

[0175] The relevant information about the control signal and the interaction target being a Source or a Sink is as described in the above embodiment. When a Sink device receives a control signal from the playback button of a remote controller of the Sink device, the processing principle is as shown in Table 4.

[0176] Therefore, when the control signal includes the control signal of the playback button, the user can control both the sink and source devices using the remote control of the sink device. Through software logic alone, without increasing the hardware cost of the sink and source device systems or changing user operating habits, the user's operating complexity of the sink and source device systems is reduced, thereby improving the user experience.

[0177] Optionally, a Sink device receives a control signal from a Source device, processes it directly, and does not forward it, thereby avoiding secondary forwarding.

[0178] Figure 9This is a flowchart of another control method provided by this application. After a source device receives a control signal sent by a remote control of the source device, a device in the display system is selected to execute the control signal. The sink device is, for example, a television. The source device is, for example, a set-top box. The method includes the following steps.

[0179] Step 910: The Source device receives a control signal from a remote controller.

[0180] In some examples, a user operates a remote control of a Source device to remotely control the Source device, and the Source device receives a control signal from the remote control of the Source device.

[0181] For example, if a user presses a common button on a Source device's remote control, the Source device's remote control will send a control signal for the common button. This control signal includes a direction, number, confirm, return, menu, channel up, channel down, or mouse position button.

[0182] The Source device determines the current interaction target of the Sink device, that is, the Sink device determines whether the interaction target is Source or Sink.

[0183] Step 920: When the interaction target is Source, the control signal is processed independently.

[0184] Step 930: When the interaction target is Sink, send a control signal to the Sink type device.

[0185] The relevant information about the control signal, the interaction target being the Source, the interaction target being the Sink, and the self-processing of the control signal is as described in the above embodiment.

[0186] Source devices determine how to handle common buttons based on the interaction target of Sink devices.

[0187] When a Source device receives a keystroke from a remote controller of a Source device, the processing principle is as shown in Table 5.

[0188] Table 5

[0189]

[0190] In some embodiments, the Sink device sends a control signal through an interconnection interface between the Sink device and the Source device.

[0191] Optionally, the interconnection interface includes GPMI. The source device sends a control signal to the sink device via GPMI.

[0192] In some embodiments, when a sink device and a source device shake hands via an interconnect interface (e.g., upon powering on or plugging in a cable), the source device acquires the sink device's capabilities. For example, the source device receives information about the sink device's key processing capabilities. The sink device's capabilities include whether it supports key processing capabilities for directions, numbers, confirm, return, menu, channel up, channel down, and mouse position.

[0193] Optionally, the Source device determines whether the Sink device supports key processing capabilities. If the Sink device supports key processing capabilities, it sends a control signal through the interconnection interface.

[0194] Optionally, the Source device obtains interaction target information of the Sink device, where the interaction target is used to indicate a current interaction target. The Source device determines the interaction target based on the interaction target information.

[0195] Optionally, a Sink device reports the interaction target information when the interaction target changes. For example, when the interaction target switches from Source to Sink, or vice versa, the interaction target information is reported. For example, when a Sink device changes state, including but not limited to switching from no source to HDMI1), the Sink device transmits the interaction target information to the Source device, and the Source device obtains the interaction target information and determines the interaction target.

[0196] Optionally, the Source device obtains interaction target information by interacting with the Sink device. For example, the Source device sends a request message to the Sink device, and the Source device obtains interaction target information and determines the interaction target.

[0197] Optionally, the Source device also determines whether the input source of the Sink device is the current Source device, that is, whether the Source information displayed by the Sink device is the information of the current Source device. Figure 10 As shown, the method further includes step 940. Step 940: Determine whether the input source of the Sink device is the current Source device. If the input source of the Sink device is the current Source device, process the control signal independently. If the input source of the Sink device is not the current Source device, the process ends.

[0198] When a Source device receives a control signal from a Source device's remote control, it processes the control signal based on the interaction target of the Sink device. For example, if the interaction target is a Sink, it sends the control signal; if the interaction target is a Source, it processes the control signal independently. This allows users to control both Sink and Source devices using a Sink device's remote control. Using software logic alone, this reduces the operational complexity of using a Sink and Source system, improving the user experience without increasing the hardware cost of the system or changing user operating habits.

[0199] Figure 11 This is a flow chart of another control method provided by this application. After the Source device receives the control signal sent by the remote control of the Source device, the device is selected in the display system to execute the control signal. Figure 9 The difference between the solutions shown is that the control signal includes the signal of any button in the power or signal source category. The source device determines the processing method for the power button or the dedicated button of the sink device based on the interaction target of the sink device. The method includes the following steps.

[0200] Step 1110: The Source device receives a control signal from the remote controller.

[0201] Step 1120: When the interaction target is a Source or a Sink and the control signal includes a power button signal, the control signal is processed independently.

[0202] Step 1130: When the interaction target is Source or Sink and the control signal includes a signal of a source button or a power button, a control signal is sent to a Sink device.

[0203] For example, a control signal includes a power button control signal. When the interaction target is a source or sink, the source device performs a shutdown or power-on operation. The source device sends a control signal to the sink device. The sink device performs a shutdown or power-on operation.

[0204] For another example, the control signal includes a control signal of a source button. When the interaction target is a source or a sink, a source-type device sends a control signal to a sink-type device.

[0205] The relevant information about the control signal and the interaction target being a Source or a Sink is as described in the above embodiment. When a Sink device receives a control signal from the power button or source button of a remote controller of a Sink device, the processing principle is as shown in Table 5.

[0206] Therefore, when the control signal includes the control signal of any button in the power or source categories, the user can control both the sink and source categories using the remote control of the sink category device. Through software logic alone, without increasing the hardware cost of the sink and source category systems or changing user operating habits, the user's operating complexity is reduced, thus improving the user experience.

[0207] Figure 12 This is a flow chart of another control method provided by this application. After the Source device receives the control signal sent by the remote control of the Source device, the device is selected in the display system to execute the control signal. Figure 9 The difference between the scheme shown is that the control signal includes the signal of the playback key, and the source device determines the processing mode of the ordinary key of the source device according to the interaction target of the sink device. The method includes the following steps.

[0208] Step 1210: The Source device receives a control signal from a remote controller.

[0209] Step 1220: When the interaction target is Source, process the control signal independently.

[0210] When the interaction target is Sink, the control signal is not processed.

[0211] Optionally, when the interaction target is Sink, the Sink-type device performs a playback operation.

[0212] For example, the control signal includes a control signal of a replay button. When the interaction target is a Source or a Sink, a Source type device performs a replay operation.

[0213] The relevant information about the control signal and the interaction target being a Source or a Sink is as described in the above embodiment. When a Sink device receives a control signal from the playback button of a remote controller of the Sink device, the processing principle is as shown in Table 5.

[0214] Therefore, when the control signal includes the control signal of the playback button, the user can control both the sink and source devices using the remote control of the sink device. Through software logic alone, without increasing the hardware cost of the sink and source device systems or changing user operating habits, the user's operating complexity of the sink and source device systems is reduced, thereby improving the user experience.

[0215] Optionally, a Source device receives a control signal from a Sink device and processes it directly without forwarding it, thereby avoiding secondary forwarding.

[0216] It is understandable that, in order to implement the functions in the above embodiments, the Sink class device and the Source class device include hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0217] Combined with the above Figures 1 to 12 , describes in detail the control method provided by this embodiment, and will be combined with Figure 13 and Figure 14 , describing the display device and source device provided according to this embodiment.

[0218] Figure 13 Schematic diagram of the structure of possible display devices provided in this embodiment. These display devices can be used to implement the functions of the control method in the above method embodiment, and thus can also achieve the beneficial effects possessed by the above method embodiment. In this embodiment, the display device is as follows Figure 1 or Figure 2 The sink-type device shown may also be a module (such as a chip) applied to a sink-type device.

[0219] like Figure 13 As shown, the display device 1300 includes a communication module 1310 , a processing module 1320 and a storage module 1330 .

[0220] The display device 1300 is used to implement the above Figure 4 、 Figures 6 to 8 The method embodiments shown in FIG. 1 illustrate the functionality of a Sink class device.

[0221] The communication module 1310 is used to receive control signals from the remote control. The control signals include signals of any one of the buttons of direction, number, confirmation, return, menu, channel up, channel down or mouse position. For example, the communication module 1310 is used to execute Figure 4 Step 410.

[0222] The communication module 1310 is also used to send a control signal when the interaction target is Source. Figure 4 Step 420.

[0223] The processing module 1320 is used to process the control signal by itself when the interaction target is Sink. For example, the processing module 1320 is used to execute Figure 4 Step 430.

[0224] Optionally, the communication module 1310 is used to receive a control signal from a remote controller, where the control signal includes a control signal of any button in the power supply or signal source. For example, the communication module 1310 is used to execute Figure 7 Step 710.

[0225] The processing module 1320 is used to process the control signal of any button in the power supply or signal source when the interaction target is Source or Sink. Figure 7 Step 720.

[0226] The communication module 1310 is used to send a power button control signal to the Source type device when the interaction target is Source or Sink. For example, the communication module 1310 is used to execute Figure 7 Step 730.

[0227] Optionally, the communication module 1310 is used to receive a control signal from the remote control, including a control signal of a playback button; when the interaction target is a Source, the control signal is sent; when the interaction target is a Sink, the control signal is not processed. For example, the communication module 1310 is used to execute Figure 8 Step 810 and step 820.

[0228] The storage module 1330 is used to store key information, such as key values.

[0229] Optionally, the display device 1300 further includes a display module 1340 for displaying Source information or Sink information.

[0230] Figure 14Schematic diagram of the structure of possible signal source devices provided in this embodiment. These signal source devices can be used to implement the functions of the control method in the above method embodiment, and thus can also achieve the beneficial effects possessed by the above method embodiment. In this embodiment, the signal source device can be as follows Figure 1 or Figure 2 The Source type device shown may also be a module (such as a chip) applied to a Source type device.

[0231] like Figure 14 As shown, the source device 1400 includes a communication module 1410 , a processing module 1420 , and a storage module 1430 .

[0232] The source device 1400 is used to implement the above Figures 9 to 12 The method shown in the embodiment is the functionality of the Source class device.

[0233] The communication module 1410 is used to receive control signals from the remote control, including control signals of any one of the buttons of direction, number, confirmation, return, menu, channel up, channel down or mouse position. Figure 9 Step 910.

[0234] The processing module 1420 is used to process the control signal by itself when the interaction target is Source. For example, the processing module 1420 is used to execute Figure 9 Step 920.

[0235] The communication module 1410 is also used to send a control signal when the interaction target is Sink. For example, the communication module 1410 is used to execute Figure 9 Step 930.

[0236] Optionally, the communication module 1410 is used to receive a control signal from a remote controller. For example, the communication module 1410 is used to execute Figure 11 Step 1110.

[0237] The processing module 1420 is used to process the control signal by itself when the interaction target is Source or Sink and the control signal includes the control signal of the power button. For example, the processing module 1420 is used to execute Figure 11 Step 1120.

[0238] The communication module 1410 is used to send a control signal when the interaction target is a source or a sink and the control signal includes a signal of a source key. When the interaction target is a source or a sink and the control signal includes a signal of a power key, the communication module 1410 is used to send a control signal to a sink type device. For example, the communication module 1410 is used to execute Figure 11Step 1130.

[0239] Optionally, the communication module 1410 is used to receive a control signal from a remote controller, where the control signal includes a signal of a playback button. For example, the communication module 1410 is used to execute Figure 12 Step 1210.

[0240] The processing module 1420 is used to process the control signal when the interaction target is Source; and not process the control signal when the interaction target is Sink. Figure 12 Step 1220.

[0241] The storage module 1430 is used to store key information.

[0242] It should be understood that the display device 1300 and the source device 1400 of the embodiment of the present application can be implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), and the PLD can be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof. It can also be implemented by software. Figure 4 、 Figures 6 to 12 In the method shown, the display device 1300 and the source device 1400 and their respective modules may also be software modules.

[0243] For a more detailed description of the above communication module, processing module and storage module, please refer to Figure 4 、 Figures 6 to 12 The relevant description in the method embodiment shown is directly obtained and will not be repeated here.

[0244] The electronic device of this embodiment corresponds to the display device 1300 and the source device 1400 in this embodiment, and can correspond to the device that performs the Figure 4 、 Figures 6 to 12 The corresponding subject in any method, and the above and other operations and / or functions of each module in the display device 1300 and the source device 1400 are respectively to achieve Figure 4 、 Figures 6 to 12 For the sake of brevity, the corresponding processes of each method in are not repeated here.

[0245] The method steps in this embodiment can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal device. Of course, the processor and storage medium can also exist as discrete components in a network device or a terminal device.

[0246] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more media that can be integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0247] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0248] Although the present application has been described with reference to specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, the present application is intended to include such modifications and variations as fall within the scope of the claims of the present application and their equivalents.

[0249] In the description of this application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in this application is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In the description of this application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following items (individuals) or similar expressions refers to any combination of these items, including any combination of single items (individuals) or plural items (individuals). For example, at least one of a, b and (or) c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or plural.

[0250] In addition, to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or execution order, and the words "first" and "second" do not necessarily mean different.

[0251] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner to facilitate understanding.

[0252] It will be understood that the “embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, throughout the specification, the various embodiments do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It will be understood that in the various embodiments of the present application, the size of the sequence number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0253] Some optional features in the embodiments of the present application may, in certain scenarios, be implemented independently of other features, such as the solution on which they are currently based, to solve corresponding technical problems and achieve corresponding effects. In certain scenarios, they may also be combined with other features as needed. Accordingly, the devices provided in the embodiments of the present application may also implement these features or functions accordingly, which will not be described in detail here.

[0254] In this application, unless otherwise specified, the same or similar parts between the various embodiments can refer to each other. In the various embodiments of this application, unless otherwise specified and there is no logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other. The technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships. The following implementation methods of this application do not constitute a limitation on the scope of protection of this application.

Claims

1. A control method, characterized in that: include: Receive a control signal from a remote controller, wherein the control signal includes a signal of any one of the following buttons: direction, number, confirm, return, menu, channel up, channel down, or mouse position; When the interaction target is a source, the control signal is sent to the source device; When the interaction target is the sink, the control signal is processed by itself.

2. A control method, characterized in that: include: receiving a control signal from a remote controller, wherein the control signal includes a signal of a playback button; When the interaction target is a source, the control signal is sent to a Source type device.

3. The method according to claim 1 or 2, characterized in that Sending the control signal to the Source device includes: The control signal is sent through the interconnection interface between the Sink type device and the Source type device.

4. The method according to claim 3, characterized in that Sending the control signal to the Source device includes: In the case where the Source type device supports key processing capability, the control signal is sent through the interconnection interface.

5. A control method, characterized in that: include: Receive a control signal from a remote controller, wherein the control signal includes a signal of any one of the following buttons: direction, number, confirm, return, menu, channel up, channel down, or mouse position; When the interaction target is the source, the control signal is processed by the user. When the interaction target is a sink, the control signal is sent to a sink-type device.

6. The method according to claim 5, characterized in that Processing the control signal independently includes: When the input source of the Sink type device is the current Source type device, the control signal is processed by the Sink type device.

7. A control method, characterized in that: include: receiving a control signal from a remote controller, wherein the control signal includes a signal from a source button; When the interaction target is a source Source or a sink Sink, the control signal is sent to the Sink type device.

8. The method according to any one of claims 5 to 7, characterized in that Sending the control signal to the Sink device includes: The control signal is sent through the interconnection interface between the Sink device and the Source device.

9. The method according to claim 8, characterized in that Sending the control signal to the Sink device includes: In the case where the Sink type device supports key processing capability, the control signal is sent through the interconnection interface.

10. The method according to any one of claims 5 to 9, characterized in that The method further comprises: Get the interaction target of the Sink device.

11. The method according to any one of claims 3, 4, 8, or 9, wherein: The interconnection interface includes a general multimedia interface GPMI.

12. A sink device, characterized in that: The sink device includes at least one processor and a memory, wherein the memory is used to store a computer program, so that when the computer program is executed by the at least one processor, the method according to any one of claims 1 to 4 or 11 is implemented.

13. A source device, characterized in that: The source device comprises at least one processor and a memory, wherein the memory is used to store a computer program, so that when the computer program is executed by the at least one processor, the method according to any one of claims 5 to 11 is implemented.

14. A data transmission system, characterized in that: The data transmission system includes the sink device according to claim 12 and the source device according to claim 13, wherein the sink device is configured to execute the operation steps of the method according to any one of claims 1 to 4 or 11, and the source device is configured to execute the method according to any one of claims 5 to 11.

15. A computer program product, characterized in that The computer program product comprises a computer program or instructions, and when the computer program or instructions are executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

16. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions or a program, and when the computer instructions or the program are executed on a computer, the method according to any one of claims 1 to 11 is implemented.

Images