Display device and device anti-control method

Abstract

The invention relates to a display device and a device anti-control method. The display equipment comprises a DP interface which is configured to be connected with external equipment so as to receive audio and video signals sent by the external equipment or send control signals to the external equipment; the display is configured to perform equipment reverse control; the controller is connected with the display and is configured to control the display to display a first type of pages under the condition that the physical channel is a DP channel and audio and video signals exist in the DP channel; wherein the first type of pages are determined based on audio and video signals; obtaining the on-off state of the screen projection switch and the connection state of the display device and the external device; when the switch state is an on state and the connection state is a connection state, reverse control is carried out on the external equipment; and when it is detected that the page displayed by the display is changed from the first type of page to the second type of page, and / or the physical channel is switched to the non-DP channel, reverse control on the external device is stopped. By adopting the method, the rationality of equipment anti-control can be ensured.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for controlling the device. Background Technology

[0002] With the development of display devices, in order to improve the flexibility of display device applications, a method of using display devices to control connected external devices has emerged. In existing device control technologies, control signals can be sent to external devices by calling the DisplayPort (DP) interface, thereby realizing the control of external devices.

[0003] However, in actual reverse control processes, the display device cannot accurately determine when to perform reverse control operations, and after reversing control is enabled, it will continuously send all received control signals to external devices, which may lead to inconsistencies between the device the user wants to control and the actual device being controlled, thus reducing the rationality of device reverse control. Summary of the Invention

[0004] This application provides a display device and a device reverse control method, which can ensure the rationality of device reverse control.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] The DP interface is configured to connect to external devices to receive audio and video signals sent by the external devices, or to send control signals to the external devices.

[0007] The display is configured for reverse control of the device;

[0008] And the controller, connected to the display, is configured as follows:

[0009] When the physical channel is a DP channel and there are audio and video signals in the DP channel, the display is controlled to show the first type of page; wherein, the first type of page is determined based on the audio and video signals;

[0010] Get the on / off status of the screen mirroring switch, and the connection status between the display device and the external device;

[0011] When the switch is in the ON state and the connection state is connected, reverse control can be performed on the external device;

[0012] If the monitor detects that the page displayed on the screen has changed from a first-type page to a second-type page, and / or the physical channel has switched to a non-DP channel, stop controlling the external device.

[0013] The above technical solution, when the physical channel is a DP channel and there are audio and video signals in the DP channel, controls the display to show a first type of page, and obtains the on / off state of the screen projection switch and the connection status between the display device and the external device; when the switch is on and the connection status is connected, it performs reverse control of the external device, and stops the reverse control of the external device when it detects that the page displayed on the display changes from a first type of page to a second type of page, and / or the physical channel switches to a non-DP channel. Using this method, on the one hand, by detecting the on / off state of the screen projection switch and the connection status between the display device and the external device, it determines whether to start the device reverse control operation, ensuring the rationality of the reverse control operation; on the other hand, by combining the page changes on the display and the switching status of the physical channel to determine whether to stop the reverse control operation of the external device, it can accurately locate the device to be controlled by the remote control device from the display device and the external device, making the device reverse control operation adaptable to user needs, thereby improving the rationality of the device reverse control.

[0014] In some embodiments, when the controller performs reverse control of an external device while the switch is in the ON state and the connection state is ON, it is configured to: control the display to show a device selection page while the switch is in the ON state and the connection state is ON; wherein the device selection page includes a return control and at least one device type control; when a selection operation is received on the device type control, reverse control of the external device is performed; when a selection operation is received on the return control, no reverse control of the external device is performed.

[0015] In the above optional implementation, by introducing a device selection page that includes a device type control, when performing device reverse control, the control signal for the display device can be converted into a control signal for the external device by combining the device type of the external device, thereby ensuring the accuracy of device reverse control.

[0016] In some embodiments, after the controller performs reverse control of the external device, it is further configured to: listen for the window focus of the target application; wherein, the first type of page is the page of the target application; and when the target application loses window focus, determine that the page displayed on the monitor changes from the first type of page to the second type of page.

[0017] In the above optional implementation, by using a listening method to monitor the window focus of the target application, changes in window focus can be detected in a timely manner. That is, when the target application loses window focus, it can be determined that the page displayed on the monitor changes from the first type of page to the second type of page, providing a convenient and timely optional method for monitoring the page.

[0018] In some embodiments, the controller is further configured to: detect the controls of the current page displayed on the display when it is detected that the target application has window focus; and determine that the page displayed on the display changes from a first type of page to a second type of page when an interactive control is detected in the current page.

[0019] In the above optional implementation, since the display device can display the first type of page rendered based on the audio and video signals sent by the external device, and can also display the target application's own related pages (such as the target application's settings page), when the window focus of the target application is detected, the presence of interactive controls on the page is further detected. That is, based on the presence of interactive controls on the current page, it is determined whether the page displayed by the monitor has changed from the first type of page to the second type of page, which improves the comprehensiveness of page detection and thus improves the rationality of the reverse control of the external device.

[0020] In some embodiments, when the controller performs detection of controls on the current page displayed on the display, it is configured to: obtain the outermost control of the current page displayed on the display; traverse the child controls under the outermost control, and detect the state of each child control when traversing it;

[0021] The controller is also configured to determine if there is an interactive control on the current page if any child control is in a visible state.

[0022] In the above optional implementation, by traversing each sub-control layer by layer, it is determined whether there is a sub-control in a visible state. If there is a sub-control in a visible state, it is determined that there is an interactive control on the current page, which can ensure the reliability and comprehensiveness of control detection.

[0023] In some embodiments, when the controller controls the display to show a first type of page when the physical channel is a DP channel and there are audio / video signals in the DP channel, it is configured to: listen for the window focus of the target application; detect the physical channel when the window focus of the target application is detected; and control the display to show the first type of page of the target application when the physical channel is detected to be a DP channel and there are audio / video signals in the DP channel.

[0024] In the above optional implementation, by monitoring the presence of the target application's window focus, the physical channel is actively detected after the target application has finished loading, thus avoiding the problem of being unable to continue subsequent reverse control operations due to missing the DP signal callback, thereby improving the reliability of the reverse control operation execution.

[0025] In some embodiments, the controller is further configured to: when the switch is in the off state, control the display to show a configuration page for the screen mirroring switch; wherein the configuration page includes an on control and an off control for the screen mirroring switch; and in response to a trigger operation on the on control, switch the screen mirroring switch to the on state.

[0026] In the above optional implementation, by triggering the activation control when the screen mirroring switch is in the off state, the switch state can be switched to the on state, which can more intuitively show the user the result of the screen mirroring switch adjustment, so as to ensure the accuracy of the screen mirroring switch adjustment.

[0027] In some embodiments, when the controller performs reverse control of an external device, it is configured to: receive key information sent by a remote control device; encode the key information based on the DP protocol to obtain a control signal; and send the control signal to the external device.

[0028] In the above optional implementation, by encoding the key information based on the DP protocol to obtain the control signal to be sent to the external device, the reliability of the control signal transmission can be guaranteed.

[0029] Secondly, some embodiments also provide a device reverse control method applied to a display device, including:

[0030] When the physical channel is a DP channel and there are audio and video signals in the DP channel, the display is controlled to show the first type of page; wherein, the first type of page is determined based on the audio and video signals;

[0031] Get the on / off status of the screen mirroring switch, and the connection status between the display device and the external device;

[0032] When the switch is in the ON state and the connection state is connected, reverse control can be performed on the external device;

[0033] If the monitor detects that the page displayed on the screen has changed from a first-type page to a second-type page, and / or the physical channel has switched to a non-DP channel, stop controlling the external device.

[0034] Thirdly, some embodiments also provide a device reverse control device, configured on a display device, including:

[0035] The display module is used to control the display to display a first type of page when the physical channel is a DP channel and there are audio and video signals in the DP channel; wherein the first type of page is determined based on the audio and video signals.

[0036] The acquisition module is used to acquire the on / off status of the screen projection switch and the connection status between the display device and the external device;

[0037] The reverse control module is used to control external devices when the switch is in the on state and the connection state is connected.

[0038] The stop module is used to stop the reverse control of external devices when the page displayed on the monitor changes from a first type of page to a second type of page, and / or the physical channel switches to a non-DP channel.

[0039] Fourthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by a device reverse control device, causes the device reverse control device to perform the device reverse control method of the second aspect.

[0040] Fifthly, a computer program product is provided, comprising: a computer program that, when run by a device reverse control device, causes the device reverse control device to execute the device reverse control method of the second aspect. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0043] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0044] Figure 3 This is a schematic diagram of the hardware configuration of the control device provided in some embodiments of this application;

[0045] Figure 4 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0046] Figure 5 A schematic flowchart illustrating the device reverse control method provided in some embodiments of this application;

[0047] Figure 6 A schematic diagram of a type selection page provided for some embodiments of this application;

[0048] Figure 7 A schematic diagram illustrating the control detection process provided in some embodiments of this application;

[0049] Figure 8 This application provides schematic diagrams of configuration pages for some embodiments.

[0050] Figure 9 This is a schematic diagram of a configuration page provided for other embodiments of this application;

[0051] Figure 10 This application provides schematic diagrams illustrating keyboard device conversion for some embodiments.

[0052] Figure 11 This is a schematic diagram illustrating the internal execution of device reverse control within a display device, provided in some embodiments of this application.

[0053] Figure 12 This is a schematic diagram illustrating the device reverse control process between devices in some other embodiments of this application;

[0054] Figure 13 This is a structural block diagram of the device reverse control device in some embodiments. Detailed Implementation

[0055] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0056] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0057] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0058] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0059] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0060] In some embodiments, display device 200 generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0061] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch operation, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.

[0062] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0063] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0064] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol Television (IPTV), etc.

[0065] Figure 2 Provided for some embodiments of this application Figure 1 The diagram shows the hardware configuration of the display device 200. In some embodiments, the display device 200 may include at least one of the following: a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0066] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0067] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0068] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 that includes the international wireless Fidelity (WiFi) standard. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 that includes Bluetooth functionality.

[0069] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0070] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0071] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0072] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0073] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0074] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0075] Figure 3 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of the central control device. (Example) Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0076] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0077] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0078] In some embodiments, such as Figure 1As shown, the mobile terminal 300 or other intelligent electronic device, after installing the application that controls the display device 200, can perform functions similar to those of the control device 100. The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as communication and cooperation between internal components and external and internal data processing functions. Under the control of the controller 110, the communication interface 130 realizes communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133. A user input / output interface 140 is provided, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touchpad 142, a sensor 143, and a button 144.

[0079] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200. The memory 190 is used to store various operating programs, data, and applications that drive and control the control device 100 under the control of the controller. The memory 190 can store various control signal commands input by the user. The power supply 180 is used to provide operating power support to the various components of the control device 100 under the control of the controller.

[0080] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources in the display device 200. The operating system can (control the display device) provide a user interface, allowing users to interact with the display device 200 and supporting the running of various applications.

[0081] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0082] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0083] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may run at least one application, which may be a Windows application, system settings application, or clock application included with the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer acts as a processing center, determining the actions of applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0084] like Figure 4 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0085] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0086] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0087] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 4 As shown, hardware drivers can be configured in the kernel layer. The kernel layer can contain at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0088] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0089] With the development of display devices, in order to improve the flexibility of display device applications, a method of using display devices to control connected external devices has emerged. In existing device control technologies, control signals can be sent to external devices by calling the DisplayPort (DP) interface, thereby realizing the control of external devices.

[0090] However, in actual reverse control processes, the display device cannot accurately determine when to perform reverse control operations, and after reversing control is enabled, it will continuously send all received control signals to external devices, which may lead to inconsistencies between the device the user wants to control and the actual device being controlled, thus reducing the rationality of device reverse control.

[0091] Based on this, in some embodiments, a device reverse control method is provided. The device reverse control method is implemented by a display device. In one optional embodiment, taking the application of the device reverse control method to a controller in a display device as an example, the display device includes a DP interface, a display, and a controller. Further, the DP interface is configured to connect to an external device to receive audio / video signals sent by the external device or to send control signals to the external device; the display is configured to perform device reverse control; and the controller is connected to the display.

[0092] like Figure 5 As shown, the specific steps include:

[0093] When the physical channel is a DP channel and there are audio and video signals in the DP channel, the S510 controls the display to show the first type of page.

[0094] The physical channel refers to the signal transmission channel within the display device. For example, it could be the signal transmission channel corresponding to a High-Definition Multimedia Interface (HDMI) or the DisplayPort (DP) channel. The DP channel is a signal transmission channel capable of transmitting audio and video signals and enabling device control functionality.

[0095] For example, an external device can be connected to the display device via a cable using the DP interface integrated on the display device; after being connected to the display device, the external device can send audio and video signals to the display device via the DP interface.

[0096] Correspondingly, the display device can receive audio and video signals sent by external devices via the DP interface. In an optional embodiment, the display device can also send control signals to external devices via the DP interface. The external device here can be a mobile terminal (such as a computer) or other device that can connect to the display device. The so-called first type of page is a page generated based on the audio and video signals sent by the external device; that is, the first type of page is determined based on the audio and video signals.

[0097] In some optional implementations, the controller in the display device can obtain the channel type of the physical channel that is in a connected state based on the connection status of the interface corresponding to each physical channel. Alternatively, the channel type of the physical channel can be determined based on the channel identifier information of the currently connected physical channel in the device connection status. If the current physical channel is determined to be a DP channel, in order to ensure the reliability of device reverse control, the middleware can call the corresponding interface to detect the DP channel, that is, to detect whether there is a signal in the DP channel.

[0098] Furthermore, when the middleware detects a signal in the DP channel, it can send a callback signal back to the controller. This callback signal indicates that there is a signal input at the DP interface. The controller can then determine the presence of audio or video signals in the DP channel based on this callback signal.

[0099] It is understandable that the methods for selecting a DP channel may include, but are not limited to, the user selecting a DP channel by triggering the control corresponding to the DP channel on the display page through the remote control device, the user selecting a DP channel by triggering the shortcut key corresponding to the DP channel on the remote control device, the user selecting a DP channel by voice input, or, after entering an application through a DP channel, returning to the main interface of the DP channel through the back button on the remote control device to select a DP channel, etc.

[0100] Furthermore, once the controller determines that the physical channel is a DP channel and that audio and video signals exist in the DP channel, it can encode and decode the audio and video signals sent by the external device to render the first type of page and display it on the monitor. For example, if the external device can be connected to the display device via a cable using the integrated DP interface, the external device can perform wired screen mirroring to project the audio and video displayed on the external device onto the display device, thereby displaying the first type of page on the monitor.

[0101] S520 obtains the on / off status of the screen mirroring switch and the connection status between the display device and the external device.

[0102] The so-called screen mirroring switch is a switch that controls whether the display device can be remotely controlled. Specifically, when the screen mirroring switch is in the "on" state, it means that a remote control operation can be performed; when the screen mirroring switch is in the "off" state, it means that a remote control operation cannot be performed.

[0103] In one alternative implementation, in order to ensure the reliability of DP reverse control, when the user switches the physical channel to the DP channel, it is necessary to check and ensure that the on / off state of the projection switch and the connection status between the display device and the external device are in the corresponding state that can perform reverse control operations.

[0104] For example, the on / off status of the projection switch can be obtained by querying the display device's configuration information based on the switch's identification information. For instance, if the signal source ID of the current DP channel is 1, the identification information of the projection switch corresponding to that DP channel, "dpcontrol_switch_1", can be used to query the display device's configuration information. If the query result is "on", the switch is in the on state; if the query result is "off", the switch is in the off state.

[0105] Furthermore, the connection status between the display device and external devices can be obtained by querying the device connection field in the display device's configuration information. For example, the device connection field "dpcontrol_connected" can be queried in the configuration information. A query result of "1" indicates a connected status, while a query result of "0" indicates a disconnected status.

[0106] The S530 can control external devices in reverse when the switch is in the ON state and the connection state is ON.

[0107] In one alternative implementation, when the switch is in the ON state and the connection state is ON, it demonstrates that the display device can reverse control of external devices. In this case, control information input from external control devices (such as remote control devices) can be intercepted, and this control information can be converted into control signals for the external devices. Then, by calling the DP interface, the converted control signals are sent to the external devices, thereby achieving reverse control of the external devices.

[0108] For example, if the user triggers the audio pause control on the remote control device when the switch is in the ON state and the connection state is ON, the controller will intercept the audio pause operation and convert it into an audio pause signal for the external device, which will then be sent to the external device to pause audio playback.

[0109] It is worth noting that, to avoid user confusion regarding the device being operated, the remote control icon of the remote control device on the display can be hidden during the process of reverse control of an external device. For example, if the remote control device is pointing at the remote controller, when determining to perform a reverse control operation on the external device, the halo pointing at the remote controller on the display can be hidden, and the corresponding control icon can be displayed on the external device.

[0110] Furthermore, during reverse device control, the display device will not respond to trigger events from the remote control device (such as trigger events for the up, down, left, right buttons, the "OK" button, or button sliding events). However, when reverse device control is not in progress, it can respond to trigger events for the "OK" button (for example, displaying an image after detecting an "OK" button trigger event). Based on this, upon receiving an "OK" button trigger event, it is necessary to determine whether reverse device control is currently in progress. If so, no image is displayed; otherwise, an image is displayed.

[0111] In another alternative implementation, when the switch state is off and / or the connection state is not connected, it proves that the display device cannot control the external device. Based on the abnormal status information in the switch state and connection state, a reverse control abnormality prompt message can be generated, and the display can be controlled to display the reverse control abnormality prompt message.

[0112] S540 stops reverse control of external devices when it detects that the page displayed on the monitor changes from a first type of page to a second type of page, and / or the physical channel switches to a non-DP channel.

[0113] The so-called second type of page refers to any page on the display that is overlaid on the first type of page, excluding the first type of page. For example, this could be a prompt page that pops up during reverse control. The so-called non-DP channel refers to any physical channel other than the DP channel, such as the HDMI channel.

[0114] Understandably, during device reverse control, the display device may automatically show other high-priority second-category pages. This indicates the user needs to prioritize the operations associated with the second-category pages. Therefore, reverse control operations on the external device must cease, and the interactive operations associated with the second-category pages must be executed. For example, during device reverse control, the display device might need to alert the user of a control risk. In this case, a risk warning page can be generated and overlaid on the first-category page. Subsequently, upon detecting that the first-category page has become a risk warning page, the display device will cease reverse control of the external device and perform the corresponding interactive operations on the risk warning page.

[0115] Furthermore, during device reverse control, middleware can detect the switching of physical channels. If the physical channel switches from a DP channel to a non-DP channel, reverse control of the external device can be stopped. For example, if the middleware detects signal transmission characteristics through a non-DP channel, it determines that the physical channel has switched from a DP channel to a non-DP channel. Alternatively, the middleware can send a DP query command; if the query command is not responded to, it determines that the physical channel has switched from a DP channel to a non-DP channel.

[0116] In one alternative implementation, when it is detected that the page displayed on the monitor changes from a first type of page to a second type of page, and the physical channel switches to a non-DP channel, it proves that the user needs to interact with the display device, and the display device loses the channel to send control signals to external devices. Therefore, it is necessary to stop the reverse control of external devices.

[0117] It is worth noting that after stopping the reverse control of external devices, the remote control icon for the remote control device needs to be restored on the display. For example, if the remote control device is pointing towards the remote controller, after stopping the reverse control of external devices, the circle pointing towards the remote controller can be restored on the display.

[0118] Furthermore, in the event that the display switches from a second type of page back to a first type of page, and / or the physical channel switches from a non-DP channel back to a DP channel, in order to ensure the reliability of the device reverse control, the above steps S520-S530 need to be re-executed.

[0119] The aforementioned device reverse control method, when the physical channel is a DP channel and there are audio / video signals in the DP channel, controls the display to show a first type of page, and obtains the on / off status of the screen projection switch and the connection status between the display device and the external device. When the switch is on and the connection status is connected, reverse control is performed on the external device. Reversal control of the external device is stopped when the page displayed on the monitor changes from a first type of page to a second type of page, and / or the physical channel switches to a non-DP channel. This method, on the one hand, ensures the rationality of the reverse control operation by detecting the on / off status of the screen projection switch and the connection status between the display device and the external device; on the other hand, by combining the page changes on the monitor and the physical channel switching to determine whether to stop the reverse control operation, the device to be controlled by the remote control device can be accurately located from the display device and the external device, making the device reverse control operation compatible with user needs and thus improving the rationality of the device reverse control.

[0120] Based on the above embodiments, in some embodiments, step S530 is refined. Specifically, when the switch state is on and the connection state is connected, the display is controlled to show the device selection page; when a selection operation for the device type control is received, the external device is reverse-controlled; when a selection operation for the return control is received, the external device is not reverse-controlled.

[0121] The device selection page is used to select the device type of the external device to be controlled. Furthermore, the device selection page includes a back control and at least one device type control. The back control is used to exit the device selection page, and the device type control corresponds to the system type of the various operating systems deployed on the external device.

[0122] Understandably, since devices operate differently under different operating systems, to ensure the reliability of control over external devices, the device type of the external device can be determined in advance before performing the reverse control operation. Then, based on the device type, the control signals for the display device are converted into control signals for the external device.

[0123] In one optional implementation, when the switch state is determined to be "on" and the connection state is "connected," the display can be controlled to show a device selection page including a return control and a device type control. The user can select the corresponding device type control from the device type controls based on the device type of the external device, and trigger the selection operation of that device type control through an external control device (such as a remote control). Upon receiving the selection operation for the device type control, the controller can convert the control information input by the external control device into a control signal for the external device according to the DP protocol and the device type corresponding to the device type control, and send it to the external device through the DP interface, thereby enabling reverse control of the external device.

[0124] If the device type control desired by the user ID is not available on the user device selection page, or if the user wants to stop reverse device control, a selection operation on the return control can be triggered by an external control device. In this case, after receiving the selection operation on the return control, the controller can return to the default page, such as displaying the device's main page, and no reverse device control will be performed.

[0125] For example, refer to Figure 6 The type selection page shown includes a "Operating System A" control, an "Operating System B" control, and a "Back" control. When operating system A is deployed on external device A', and the switch is detected as "on" and the connection status is "connected," if the user needs to continue reverse control operations, they can trigger a selection operation for the "Operating System A" control via the remote control. At this time, the control information input by the remote control can be converted into control signals adapted to operating system A. Therefore, after external device A' receives the control signals, it can correctly parse the control information input by the remote control to achieve reverse control operations on external device A'. If the user wants to exit the reverse control operation, they can trigger a selection operation for the "Back" control via the remote control.

[0126] In the above embodiments, by introducing a device selection page that includes a device type control, when performing device reverse control, the control signal for the display device can be converted into a control signal for the external device by combining the device type of the external device, thereby ensuring the accuracy of device reverse control.

[0127] Based on the above embodiments, in some embodiments, after controlling the external device, an optional method for monitoring the displayed page is provided, specifically, listening to the window focus of the target application; when the target application loses window focus, determining that the page displayed on the monitor changes from a first type of page to a second type of page.

[0128] The target application can enable wired screen mirroring from an external device to a display device, and it can also enable the display device to control the external device. Furthermore, when enabling wired screen mirroring from an external device to a display device, the target application displays a page rendered based on the audio and video signals transmitted from the external device to the display device; that is, the first type of page is the target application's page.

[0129] In some alternative implementations, during device reverse control, the display shows a first-type page through the target application, and the window focus on the display is on the target application. The controller can intercept control information input from the external control device before it reaches the target application, then convert the control information into control signals for the external device and send the control signals to the external device.

[0130] To ensure the reliability of device control, the presence of page switching events can be determined by monitoring changes in the window's focus position. Specifically, if the controller detects that the target application has lost window focus, it indicates that the page currently displayed on the monitor is not a page from the target application. At this point, it can be determined that the page displayed on the monitor has changed from a first-type page to a second-type page, and the control operation on the external device should be stopped.

[0131] For example, after performing device reverse control, if the window focus changes to the signal source interface / settings interface, and the monitor changes from displaying the first type of page to displaying the signal source interface / settings interface (the second type of page), then the device reverse control operation needs to be stopped.

[0132] In the above optional implementation, by using a listening method to monitor the window focus of the target application, changes in window focus can be detected in a timely manner. That is, when the target application loses window focus, it can be determined that the page displayed on the monitor changes from the first type of page to the second type of page, providing a convenient and timely optional method for monitoring the page.

[0133] It's important to note that determining whether the displayed page changes from a first-type page to a second-type page when the target application loses focus does not mean that the displayed page will not change from a first-type page to a second-type page if the target application has not lost focus. For example, if the target application actively pops up its main page, the displayed page will also change from a first-type page to the main page (second-type page), in which case the target application has not lost focus.

[0134] Therefore, based on the above embodiments, in some embodiments, another optional method for monitoring the displayed page is provided. Specifically, when the window focus of the target application is detected, the controls of the current page displayed on the monitor are detected; when interactive controls are detected in the current page, it is determined that the page displayed on the monitor changes from the first type of page to the second type of page.

[0135] The "current page" refers to the page displayed on the monitor at the current moment. An interactive control is a control that can interact with the user; that is, the user can interact with the interactive control through an external control device (remote control, keyboard, etc.). Examples include, but are not limited to, controls in the menu interface and controls in the recommendation list interface.

[0136] In one alternative implementation, when the target application is detected to have window focus, other second-type pages within the target application may overlap the first-type page. It's worth noting that this occurs because the target application needs to interact with the user to obtain user commands. Therefore, it can be determined whether the page displayed on the screen has changed from a first-type page to a second-type page by detecting the interactive space within the current page.

[0137] Specifically, the page layout of the current page can be monitored through a global layout listener. Then, when an interactive control is detected on the current page, it can be determined that the page displayed on the monitor has changed from the first type of page to the second type of page. At this time, the identification information of the remote control device can be displayed on the current page to prompt the user to operate the interactive control.

[0138] It is worth noting that if a change in the layout of the current page is detected, but it is only a prompt interface, such as the screen display, Dolby logo, crosshair, frame rate floating window, etc., which cannot be interacted with by the user, then the reverse control operation can still be performed.

[0139] In the above embodiments, since the display device can display the first type of page rendered based on the audio and video signals sent by the external device, and can also display the target application's own related pages (such as the target application's settings page), when the window focus of the target application is detected, the device further detects whether there are interactive controls on the page. That is, based on the presence of interactive controls on the current page, it determines whether the page displayed by the monitor has changed from the first type of page to the second type of page, which improves the comprehensiveness of page detection and thus improves the rationality of the reverse control of the external device.

[0140] Based on the above embodiments, in some embodiments, an optional method for control detection is provided, such as... Figure 7 As shown, the specific steps include:

[0141] S701, retrieves the outermost control of the current page displayed on the monitor.

[0142] The outermost control is the topmost control on the page, such as the root layout control.

[0143] Optionally, the page layout file of the current page can be obtained through the debugging tools in the display device; then, the outermost control of the highest level in the current page can be obtained from the page layout file according to the hierarchical relationship between the controls in the page layout file.

[0144] S702 iterates through the child controls under the outermost control and checks the state of each child control when iterating through it.

[0145] In one alternative implementation, to ensure comprehensive control traversal, the child controls under the outermost control can be traversed based on the hierarchical relationship between controls. Then, for each traversed child control, its state can be detected based on the state identification information of that child control in the page layout file.

[0146] Understandably, during the detection of interactive controls, the control being in a visible state is a prerequisite for the control to perform interactive operations. Visibility here means that the control is not completely obscured by other elements, has a valid size, and its transparency meets the visibility requirements. Based on this, the presence of any visible child controls can be determined by checking the visibility status identifiers of each child control in the page layout file.

[0147] For example, if the visible state of a control is marked as "VISIBLE", and the visible state of child control B is also marked as "VISIBLE", then the state of child control B is determined to be visible.

[0148] S703: If any child control is in a visible state, determine that there is an interactive control on the current page.

[0149] In one alternative implementation, after traversing all child controls, the number of child controls in a visible state can be determined. If at least one child control is in a visible state, it is determined that there is an interactive control on the current page.

[0150] In another alternative implementation, in order to improve the efficiency of determining interactive controls, when the first visible child control is encountered, the traversal of subsequent child controls can be stopped, and it can be determined that there are interactive controls on the current page.

[0151] In the above embodiments, by traversing each sub-control layer by layer, it is determined whether there is a sub-control in a visible state. If there is a sub-control in a visible state, it is determined that there is an interactive control on the current page, which can ensure the reliability and comprehensiveness of control detection.

[0152] In related technologies, when performing DP reverse control, the target application used for reverse control in the display device generally starts up quickly, that is, the target application is loaded before the DP signal callback. At this time, the callback signal can be listened to through middleware, and the subsequent DP reverse control operation can be started when the DP channel signal callback is detected.

[0153] However, when the target application starts slowly, the signal callback opportunity of the DP channel has passed before the target application is fully loaded. If the callback signal is still being listened to through the middleware, the subsequent DP reverse control operation cannot continue.

[0154] Based on this, in some embodiments, an optional method for page display is provided, specifically, listening to the window focus of the target application; when the window focus of the target application is detected, detecting the physical channel; when the physical channel is detected to be a DP channel and there are audio and video signals in the DP channel, controlling the display to display the first type of page of the target application.

[0155] In one optional implementation, the presence of focus on the target application's window can be detected. If focus is detected, it indicates that the target application has finished loading. At this point, the physical channel currently used by the display device can be actively detected based on the display device's configuration information to determine the channel type. For example, the channel type can be determined based on the channel identifier information of the currently connected physical channel in the configuration information.

[0156] If the physical channel is detected to be a DP channel and there are audio and video signals in the DP channel, the audio and video signals can be parsed and the parsing result can be rendered as a first-type page. Then, the display can be controlled to show the first-type page in the target application.

[0157] In the above embodiments, by monitoring the presence of focus on the target application's window, physical channel detection is actively performed after the target application has finished loading, avoiding the problem of being unable to continue subsequent reverse control operations due to missing DP signal callbacks, thereby improving the reliability of reverse control operation execution.

[0158] Based on the above embodiments, in some embodiments, an optional method for switching the switch state is provided, specifically, when the switch state is off, the display is controlled to show the configuration page for the screen projection switch; in response to a trigger operation on the enable control, the switch state of the screen projection switch is switched to the enable state.

[0159] The configuration page is where you configure the on / off state of the screen mirroring switch. Furthermore, the configuration page includes controls for turning the screen mirroring switch on and off.

[0160] In one alternative implementation, when the screen mirroring switch is in the off state, a configuration display control can be triggered via a remote control device to control the display to show the configuration page for the screen mirroring switch. For example, as Figure 8 As shown, when the screen mirroring switch is in the off state, the "wired screen mirroring control" can be triggered by the remote control device. At this time, the on control 1 and off control 2 can be displayed.

[0161] Furthermore, the power-on control can be triggered via remote device control, thereby switching the screen mirroring switch from the off state to the on state. For example, as Figure 9 As shown, in response to a trigger operation on the open control, it can be Figure 8 Turn off the selection icon in control 2 and move it to control 1 to switch the screen mirroring switch to the on state.

[0162] After that, you can refer to the above step S530 to perform subsequent equipment reverse control operations.

[0163] In the above embodiments, by triggering the activation control when the screen mirroring switch is in the off state, the switch state of the screen mirroring switch can be switched to the on state, which can more intuitively show the user the result of the screen mirroring switch adjustment, so as to ensure the accuracy of the screen mirroring switch adjustment.

[0164] Based on the above embodiments, in some embodiments, an optional method for reverse control of external devices is provided, specifically, receiving key information sent by a remote control device; encoding the key information based on the DP protocol to obtain a control signal; and sending the control signal to the external device.

[0165] The so-called button information refers to the user's button presses on the remote control device. The so-called DP protocol refers to the transmission protocol that signals must follow when transmitted in the DP channel.

[0166] In one alternative implementation, after receiving button information from the remote control device, the button information can be encoded based on the DP protocol associated with the DP channel to obtain a control signal adapted to the DP channel. Then, the control signal can be sent to an external device via the DP interface.

[0167] Understandably, in order to ensure that button information for display devices can be better converted into button information for external devices, preset data conversion logic can be used to convert the button information for display devices to obtain button information adapted to external devices.

[0168] For example, you can refer to Figure 10 The diagram illustrating keyboard device conversion shows that after the original device node of the light pen (ID1) in the local display device receives light pen data, it can transmit key data through data pass-through. This involves building a simulated light pen device node locally and then transmitting the light pen data to the remote projection device via this simulated node. Alternatively, it can convert the light pen data into absolute coordinate mouse data using a local absolute coordinate mouse simulation node and then send it to the remote projection device. Similarly, after the original device node of the touchpad (ID2) in the local display device receives touch data, it can convert the touch data into swipe-up / swipe-down / swipe-left / swipe-right / click trigger operations using a local trigger operation simulation node and send it to the remote projection device. Finally, after the original device node of the buttons (ID3) in the local display device receives key data, it can convert the key presses into keyboard input information using a local keyboard input simulation node and send it to the remote projection device.

[0169] In the above embodiments, by encoding the key information based on the DP protocol to obtain the control signal to be sent to the external device, the reliability of the control signal transmission can be guaranteed.

[0170] Based on the technical solutions of the above embodiments, the steps for performing device reverse control within the display device are further refined. See [link / reference] Figure 11 As shown, when the hardware bus of the display device detects the presence of a DP insertion, the hardware bus will send an interrupt notification to the kernel driver. At this time, the kernel driver will switch the working mode of the USB controller to device mode (i.e., the display device is now the "controlled device") and report the device status change to the control module through uevent (user space event).

[0171] After receiving the uevent, the control module checks with the reverse control switch menu to see if the reverse control operation has been enabled. If it has, it creates a device (software-level device abstraction) in the system to complete the logical registration of the device. Then, based on this registration, the virtual device module creates a logical device that conforms to the HID (Human-Machine Interface) standard, ultimately enabling remote terminal access for the projection device and paving the way for subsequent data interaction.

[0172] Operational or sensor data generated by TV peripherals (remote control, mouse, keyboard, microphone, sensors, etc.) is first transmitted via the physical layer through the hardware bus. After receiving the data from the hardware bus, the kernel driver performs low-level protocol parsing and preliminary processing, and then forwards the data to the control module. The control module then passes the data to the forwarding module. The core function of the forwarding module is data conversion; that is, since the communication protocols and data formats of the TV peripherals and the projection device may differ (such as button encoding and data encapsulation formats), format adaptation needs to be completed at this stage. The converted data is then transmitted from the virtual device to the projection device, realizing the cross-device transmission of operation commands or sensor information.

[0173] When the DP is physically unplugged, the hardware bus triggers an interrupt again, reporting the device removal event to the kernel driver. Upon receiving the interrupt, the kernel driver switches the USB controller mode to HOST (the TV reverts to its "host" status) and reports the device removal status to the control module via uevent. Upon receiving the uevent, the control module performs a device destruction operation, deregistering the device logically from the system; subsequently, the virtual device destroys the corresponding HID standard device, releasing all device-related resources, and the entire interaction process is completely terminated.

[0174] Based on the technical solutions of the above embodiments, an optional embodiment is provided. In some embodiments, see... Figure 12 The diagram illustrates the device control process between the display device, input device, and external device. The display device and external device are connected via a DP interface. The specific steps include:

[0175] S1201, the display device listens for the window focus of the target application, and detects the physical channel when it detects that the target application has window focus.

[0176] S1202, external devices send audio and video signals to the display device through the DP interface.

[0177] S1203, when the display device detects that the physical channel is a DP channel and there are audio and video signals in the DP channel, it controls the display to display the first type of page of the target application.

[0178] S1204, the display device obtains the on / off state of the screen projection switch and the connection status between the display device and the external device, and receives the button information sent by the remote control device when the switch is on and the connection status is connected.

[0179] The S1205 display device encodes key information based on the DP protocol to obtain control signals and sends these control signals to external devices.

[0180] Optionally, when the switch is in the ON state and the connection state is ON, the display is controlled to show a device selection page; wherein the device selection page includes a return control and at least one device type control; when a selection operation is received on the device type control, the external device is controlled in reverse; when a selection operation is received on the return control, the external device is not controlled in reverse.

[0181] S1206, The display device listens for the focus of the target application's window.

[0182] S1207, when the display device detects that the target application has lost window focus, it determines that the page displayed on the monitor has changed from a first type of page to a second type of page; or, when the display device detects that the target application has window focus, it detects the controls on the current page displayed on the monitor, and if it detects that there are interactive controls on the current page, it determines that the page displayed on the monitor has changed from a first type of page to a second type of page.

[0183] Optionally, obtain the outermost control of the current page displayed on the monitor; traverse the child controls under the outermost control, and check the state of each child control when traversing it; if any child control is in a visible state, determine that there is an interactive control on the current page.

[0184] S1208, when the display device detects that the page displayed on the monitor has changed from a first type of page to a second type of page, it stops controlling the external device.

[0185] The specific processes of S1201-S1208 described above can be found in the description of the above method embodiments. Their implementation principles and technical effects are similar and will not be repeated here.

[0186] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0187] Based on the same inventive concept, this application also provides a device for implementing the device reverse control method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more device reverse control device embodiments provided below can be found in the limitations of the device reverse control method described above, and will not be repeated here.

[0188] In one exemplary embodiment, such as Figure 13 As shown, a device reverse control device 13 is provided, configured in a display device, including: a display module 1310, an acquisition module 1320, a reverse control module 1330, and a stop module 1340, wherein:

[0189] Display module 1310 is used to control the display to display a first type of page when the physical channel is a DP channel and there are audio and video signals in the DP channel; wherein the first type of page is determined based on the audio and video signals;

[0190] The acquisition module 1320 is used to acquire the on / off status of the screen projection switch and the connection status between the display device and the external device;

[0191] The reverse control module 1330 is used to reverse control external devices when the switch is in the on state and the connection state is connected.

[0192] The stop module 1340 is used to stop the reverse control of external devices when it detects that the page displayed on the monitor changes from a first type of page to a second type of page, and / or the physical channel switches to a non-DP channel.

[0193] In one exemplary embodiment, the anti-control module 1330 is specifically used for:

[0194] When the switch is in the ON state and the connection state is ON, the display shows a device selection page; the device selection page includes a return control and at least one device type control; when a selection operation is received on the device type control, the external device is controlled in reverse; when a selection operation is received on the return control, the external device is not controlled in reverse.

[0195] In one exemplary embodiment, the stop module 1340 is specifically used for:

[0196] Listen for the window focus of the target application; where the first type of page is the page of the target application; when the target application loses window focus, determine that the page displayed on the monitor changes from the first type of page to the second type of page.

[0197] In one exemplary embodiment, the stop module 1340 is further configured to:

[0198] When the target application is detected to have window focus, the controls on the current page displayed on the monitor are detected; if interactive controls are detected on the current page, the page displayed on the monitor is changed from the first type of page to the second type of page.

[0199] In one exemplary embodiment, the stop module 1340 is further configured to:

[0200] Get the outermost control of the current page displayed on the monitor; traverse the child controls under the outermost control, and check the state of each child control when it is traversed; if any child control is visible, determine that there is an interactive control on the current page.

[0201] In one exemplary embodiment, the display module 1310 is specifically used for:

[0202] Listen for the window focus of the target application; if the window focus of the target application is detected, detect the physical channel; if the physical channel is detected to be a DP channel and there are audio and video signals in the DP channel, control the display to show the first type of page of the target application.

[0203] In one exemplary embodiment, the anti-control module 1330 is further configured to:

[0204] When the switch is in the off state, the control display shows the configuration page for the screen mirroring switch; the configuration page includes an on control and an off control for the screen mirroring switch; in response to a trigger operation on the on control, the switch state of the screen mirroring switch is switched to the on state.

[0205] In one exemplary embodiment, the anti-control module 1330 is further configured to:

[0206] Receive button information sent by remote control device; encode the button information based on DP protocol to obtain control signal; send control signal to external device.

[0207] Each module in the aforementioned device control system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0208] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0209] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0210] It should be noted that the data involved in this application (including but not limited to button information) are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0211] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0212] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0213] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A display device, characterized in that, include: The DP interface is configured to connect to an external device to receive audio and video signals sent by the external device, or to send control signals to the external device. The display is configured for reverse control of the device; And a controller, connected to the display, configured to: When the physical channel is a DP channel and there are audio and video signals in the DP channel, the display is controlled to show a first type of page; wherein, the first type of page is determined based on the audio and video signals; Obtain the on / off status of the screen mirroring switch, and the connection status between the display device and the external device; When the switch is in the ON state and the connection state is in the OFF state, the external device is controlled in reverse. If the display changes from the first type of page to the second type of page, and / or the physical channel switches to a non-DP channel, the reverse control of the external device is stopped.

2. The display device according to claim 1, characterized in that, When the controller performs reverse control of the external device under the condition that the switch is in the ON state and the connection state is ON, it is configured to: When the switch is in the ON state and the connection state is ON, the display is controlled to show a device selection page; wherein, the device selection page includes a return control and at least one device type control; Upon receiving a selection operation on the device type control, the external device is controlled in reverse. Upon receiving a selection operation for the return control, no reverse control is applied to the external device.

3. The display device according to claim 1, characterized in that, After the controller performs reverse control of the external device, it is further configured to: Listen for the window focus of the target application; wherein, the first type of page is a page of the target application; If the target application is detected to have lost focus on the window, it is determined that the page displayed on the monitor changes from the first type of page to the second type of page.

4. The display device according to claim 3, characterized in that, The controller is also configured to: If the target application is detected to have focus on the window, the controls on the current page displayed on the monitor are detected. If an interactive control is detected on the current page, it is determined that the page displayed on the monitor changes from the first type of page to the second type of page.

5. The display device according to claim 4, characterized in that, When the controller performs detection of controls on the current page displayed on the monitor, it is configured to: Get the outermost control of the current page displayed on the monitor; Iterate through the child controls under the outermost control, and detect the state of each child control when iterating through it; The controller is also configured to: If any child control is in a visible state, it is determined that there is an interactive control on the current page.

6. The display device according to claim 1, characterized in that, When the controller controls the display to show the first type of page in the case that the physical channel is a DP channel and there are audio and video signals in the DP channel, it is configured to: Listen for the window focus of the target application; If the target application is detected to have focus on the window, the physical channel is detected. If the physical channel is detected to be a DP channel and there are audio and video signals in the DP channel, the display is controlled to show the first type of page of the target application.

7. The display device according to any one of claims 1-6, characterized in that, The controller is also configured to: When the switch is in the off state, the display is controlled to show a configuration page for the screen mirroring switch; wherein, the configuration page includes on and off controls for the screen mirroring switch; In response to a trigger operation on the control, the on / off state of the screen projection switch is switched to the on state.

8. The display device according to any one of claims 1-6, characterized in that, When the controller performs reverse control of the external device, it is configured as follows: Receive button information sent by the remote control device; Based on the DP protocol, the key information is encoded to obtain control signals; Send the control signal to the external device.

9. A method for reverse control of equipment, characterized in that, Applied to display devices, including: When the physical channel is a DP channel and there are audio and video signals in the DP channel, the display is controlled to show a first type of page; wherein, the first type of page is determined based on the audio and video signals; Obtain the on / off status of the screen projection switch, and the connection status between the display device and the external device; When the switch is in the ON state and the connection state is in the OFF state, the external device is controlled in reverse. If the display changes from the first type of page to the second type of page, and / or the physical channel switches to a non-DP channel, the reverse control of the external device is stopped.

10. The method according to claim 9, characterized in that, When the switch is in the ON state and the connection state is ON, the reverse control of the external device includes: When the switch is in the ON state and the connection state is ON, the display is controlled to show a device selection page; wherein, the device selection page includes a return control and at least one device type control; Upon receiving a selection operation on the device type control, the external device is controlled in reverse. Upon receiving a selection operation for the return control, no reverse control is applied to the external device.

Images