Display device and dual-system control method

Abstract

The invention provides a display device and a dual-system control method, and the method can respond to a starting instruction of a first system interface when a user interface comprises a second system interface, detect a first display area of the first system interface, and set a first touch mark value for pixel points of the first display area. When the user interface comprises the first system interface, responding to a starting instruction of a second system interface, detecting a second display area of the second system interface, and setting a second touch mark value for pixel points of the second display area. Wherein the first touch mark value is used for representing a display area acted by the touch permission of the first system, and the second touch mark value is used for representing a display area acted by the touch permission of the second system. According to the method, the touch control permission of the dual systems carried on the display equipment can be controlled in a partitioned manner according to the display area of the system interface, so that the coexistence and non-conflict of the touch control permissions of the dual systems are realized, and the convenience and accuracy of user operation are improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a dual-system control method. Background Art

[0002] Display devices refer to terminal devices that can output specific display images, which can be terminal devices such as smart TVs, communication terminals, smart advertising screens, projectors, etc. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] The display device supports dual systems. Two systems can be installed on the display device to form a dual system. For example, an Android system touch display screen is installed with a Windows system to form a dual system, and then the touch operation of the dual system is performed. In order to ensure that the touch permissions of the dual systems coexist and do not conflict with each other, when the touch permissions of the installed dual systems are controlled, the touch permissions of the second system can be turned on and off according to the signal source display channel of the second system and whether the interface of the first system is superimposed on the second system.

[0004] However, in actual use, some scenarios still have the problem of touch permission conflicts. For example, when the sidebars at both ends of the touch display screen of the Android system are expanded, the touch permission of the installed Windows system is turned off. After the sidebar of the Android system is folded into an arrow, the touch permission of the Windows system is turned on, but when the arrow part is clicked at this time, there will be a touch response at the corresponding position of the Windows system. For another example, the on-screen display (OSD) adjustment method of the Android system supports dragging. During the process of dragging the OSD menu, there will be a dragging track at the corresponding position of the Windows system. Although the Android system can detect the pressing action of the OSD menu and then turn off the touch permission of the Windows system, it can block some drag data, but the pressed touch action can still be received by the Windows system. Summary of the invention

[0005] The present application provides a display device and a dual-system control method to solve the problem of conflicting touch permissions in the dual systems.

[0006] In a first aspect, some embodiments of the present application provide a display device, including a display and a first controller. The display is configured to display a user interface, the display is connected to a touch interaction module, and the touch interaction module is used to receive a touch instruction input by a user; the first controller is used to run a first system to control the display to display the first system interface; the first controller is connected to a second controller, and the second controller is used to run a second system to control the display to display the second system interface; the first controller is configured to execute the following program steps:

[0007] When the user interface includes a second system interface, in response to a start-up instruction of the first system interface, detecting a first display area of ​​the first system interface;

[0008] Setting a first touch control mark value for a pixel point in the first display area, wherein the first touch control mark value is used to indicate a display area to which the touch control permission of the first system applies;

[0009] When the user interface includes a first system interface, in response to a start-up instruction of a second system interface, detecting a second display area of ​​the second system interface;

[0010] A second touch mark value is set for the pixel points of the second display area, where the second touch mark value is used to indicate the display area to which the touch permission of the second system applies.

[0011] In a second aspect, the present application further provides a dual-system control method, which is applied to the above-mentioned display device, comprising:

[0012] When the user interface includes a second system interface, in response to a start-up instruction of the first system interface, detecting a first display area of ​​the first system interface;

[0013] Setting a first touch control mark value for a pixel point in the first display area, wherein the first touch control mark value is used to indicate a display area to which the touch control permission of the first system applies;

[0014] When the user interface includes a first system interface, in response to a startup instruction of a second system interface, detecting a second display area of ​​the second system interface, the second system interface being a window interface based on the second system;

[0015] A second touch mark value is set for the pixel points of the second display area, where the second touch mark value is used to indicate the display area to which the touch permission of the second system applies.

[0016] It can be seen from the above technical solutions that the present application provides a display device and a dual-system control method, wherein the method can detect the first display area of ​​the first system interface and set the first touch mark value for the pixel points of the first display area in response to the startup instruction of the first system interface when the second system interface is included in the user interface. When the first system interface is included in the user interface, the second display area of ​​the second system interface can be detected and the second touch mark value can be set for the pixel points of the second display area in response to the startup instruction of the second system interface. The first touch mark value is used to indicate the display area where the touch permission of the first system is applied, and the second touch mark value is used to indicate the display area where the touch permission of the second system is applied. The method can control the touch permission partitions of the dual systems carried on the display device according to the display area of ​​the system interface, so as to realize the coexistence of the touch permissions of the dual systems without conflict, thereby improving the convenience and accuracy of user operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 A schematic diagram of a usage scenario of a display device provided in some embodiments of the present application;

[0019] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0020] Figure 3 A schematic diagram of the connection relationship of external terminal devices provided in some embodiments of the present application;

[0021] Figure 4 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0022] Figure 5 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0023] Figure 6 A hierarchical schematic diagram of a dual system provided for some embodiments of the present application;

[0024] Figure 7 A schematic diagram of an interface for expanding a sidebar in a dual system provided in some embodiments of the present application;

[0025] Figure 8 A schematic diagram of an interface in which the sidebar of a dual system is collapsed into an arrow in some embodiments of the present application;

[0026] Fig. 9 A schematic diagram of an interface for menu dragging in a dual system provided in some embodiments of the present application;

[0027] Fig.10 A schematic diagram of a touch right control flow of a first system interface under a second system provided in some embodiments of the present application;

[0028] Fig.11 A schematic diagram of a first system interface started in a second system provided in some embodiments of the present application;

[0029] Fig.12 A schematic diagram of simultaneously starting multiple first system interfaces in a second system provided in some embodiments of the present application;

[0030] Fig.13 A schematic diagram of a flow chart of executing touch commands provided in some embodiments of the present application;

[0031] Fig.14 A schematic diagram of a touch right control process of a second system interface under a first system provided in some embodiments of the present application;

[0032] Fig.15 A schematic diagram of a second system interface started in a first system provided in some embodiments of the present application;

[0033] Fig.16 A schematic diagram of an interface in which a first system interface and a second system interface overlap in some embodiments of the present application. DETAILED DESCRIPTION

[0034] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0035] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0036] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0037] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0038] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0039] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .

[0040] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0041] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0042] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0043] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0044] In some embodiments, the display device 200 includes at least one of a tuner 210 , a communicator 220 , a detector 230 , a device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a communication device interface 280 .

[0045] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0046] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.

[0047] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0048] In some embodiments, the display device 200 may also support touch interaction, that is, a touch interaction module may be provided on the display device 200, and the touch interaction module may be a built-in module or an external module. For example, in order to implement touch interaction operations, a touch panel (TP) may be provided on the display 260 of the display device 200, and the touch panel may receive touch signals input by fingers, contacts, styluses, etc., and execute touch interaction responses according to a pre-set interaction strategy. Of course, the display device 200 may also be a touch-integrated screen.

[0049] In some embodiments, the communicator 220 is a component for communicating with an external device or server 400 according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0050] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0051] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0052] In some embodiments, the device interface 240 may include, but is not limited to, any one or more of the following interfaces: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0053] For example, in order to enrich the display types of the display device 200, the HDMI interface can connect devices with video and audio input / output functions, and implement the corresponding audio and video output / input functions through the HDMI driver in the hardware layer. The USB interface can connect devices with signal and data transmission functions and interactive functions, and access signals, transmit data, and perform specific interactive actions based on the USB driver in the hardware layer.

[0054] In some embodiments, the display device 200 can support multiple interface accesses and perform corresponding functions according to the specific device type accessed. For example, the display device 200 can be connected to another display or terminal device 500 via an HDMI interface to form display functions such as dual screen, split screen, screen transmission, conference, whiteboard, NFC, etc. The display device 200 can also be connected to the terminal device 500 via a USB interface, and activate the Open Pluggable Specification (OPS) channel to connect the terminal device 500. When the terminal device 500 is connected through the OPS channel, since the display device 200 has an independent operating system (system A), and the terminal device 500 can also have an independent operating system (system B), a dual system mode can be formed.

[0055] In some embodiments, the display device 200 and / or the connected terminal device 500 may both support touch interaction. When the display device 200 and the connected terminal device 500 both support touch interaction operations, a data transmission and conversion module may be provided in the display device 200 to transmit and convert touch data generated during the touch interaction process, so as to achieve channel reverse control, that is, to control the display device 200 through the touch-interactive terminal device 500. For example, Figure 3As shown, a switch module can be set in the touch interaction system, and the TP module with touch function can be connected to the main control system (system A) of the display device 200 through the USB interface, and at the same time, connected to the terminal device 500 (system B), the external host, and the type-c device. In this way, the OPS channel formed by the HDMI interface can transmit display content data, and the touch data can be transmitted through the conversion module and the USB interface.

[0056] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0057] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0058] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0059] In some embodiments, the communication device interface 280 is an interface that can be used to receive control input.

[0060] Figure 4 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 4 As shown, the control device 100 includes a controller 110 , a communication interface 130 , a user input / output interface, a memory 190 , and a power supply 180 .

[0061] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0062] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0063] In some embodiments, Figure 1As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0064] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0065] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0066] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0067] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0068] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0069] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0070] Figure 5 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0071] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.

[0072] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0073] Native apps can support online or offline, message push or local resource access.

[0074] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0075] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0076] The display device 200 can be equipped with two operating systems to form a dual system, for example, a touch screen with an Android system and a Windows system to form a dual system, wherein the touch screen can also be other operating systems, such as Hongmeng system, and the corresponding Windows system can also be other systems different from the touch screen. The installed Windows system can be an OPS module built into the touch screen, or an external computer module connected via a line that supports touch data transmission.

[0077] In some embodiments, Figure 6 As shown, it is a schematic diagram of the hierarchy of the dual system provided by the embodiment of the present application. In the dual system of the display device 200, the hierarchy of the first system is above the hierarchy of the second system. In order to ensure that the touch permissions of the dual systems coexist and do not conflict with each other, when the display device 200 controls the touch permissions of the dual systems, it can control the touch permissions of the second system according to the signal source display channel of the second system and whether the interface of the first system is superimposed on the upper layer of the second system.

[0078] For example, the display device 200 is a touch screen of an Android system, on which a Windows system is mounted to form a dual system. The mounted Windows system is an OPS module inside the touch screen, which is input through an OPS signal source channel and displayed on the touch screen. If the Windows system signal is displayed under the OPS signal source channel and there is no OSD interface coverage of the Android system, the touch permission of the OPS module is turned on, so that the user can perform touch operations on the interface of the Windows system. Otherwise, the touch permission of the OPS module is turned off, and the interface of the upper Android system is touched, thereby solving the problem of dual systems responding to touch at the same time and reducing misoperation.

[0079] That is to say, the method of distributing the touch data of the second system at the bottom layer of the display device 200 is to control the distribution of touch data according to the access of the signal source of the second system and whether the upper layer of the second system superimposes the interface of the first system. When the signal source of the second system is connected to the display device 200, if the upper layer of the second system does not superimpose the interface of the first system, the touch permission of the second system is enabled, and the second system responds to the touch operation of the user in the user interface. If the upper layer of the second system superimposes the interface of the first system, the touch permission of the second system is disabled, and the first system responds to the touch operation of the user in the user interface.

[0080] It can be understood that when the user inputs a touch command through the touch interaction module of the display device 200, the touch interaction module will receive the touch data generated by the touch command, and the touch data will be passed upward in sequence by the hardware layer of the display device 200 to the application layer, and based on the onboard operating system, a touch interaction response will be executed according to a pre-set interaction strategy, and finally the user interface obtained in response to the touch command will be presented to the user.

[0081] For dual systems, that is, the first system and the second system are mounted on the display device 200, and the controller 250 of the display device 200 acts as the first controller to run the first system. The external controller acts as the second controller to run the second system. In order to ensure that the touch permissions of the first system and the second system coexist and do not conflict with each other, it is necessary to set the touch permissions of the first system and the second system. The first system and the second system are mounted on the display device 200, and when the touch data is transmitted upward in sequence by the hardware layer of the display device 200, it will be sent to the first system and the second system through their respective data channels. If you want to close the touch permission of a certain system, just close the data channel corresponding to the system. For example, the touch display screen of the Android system is equipped with the Windows system to form a dual system, and the Windows system mounted is the OPS module inside the touch display screen. When the touch permission of the Windows system is closed, the touch data distribution of the interface channel of the OPS module is closed, so that the touch display screen of the Android system does not send data to the OPS module.

[0082] However, the above dual-system touch control rights control method still has the problem of touch rights conflicts in some scenarios during actual use. Figure 7 , 8 As shown, Figure 7 A schematic diagram of the interface of the expanded sidebar in the dual system provided in the application embodiment, Figure 8 A schematic diagram of the interface in which the sidebars in the dual system are folded into arrows provided in the application embodiment. Take the above-mentioned display device 200 as a touch screen of the Android system, and the dual system formed by the Windows system installed thereon as an example. When the sidebars at both ends of the touch screen are expanded, the touch data distribution of the OPS module inside the touch screen is turned off. After the sidebars at both ends of the touch screen are folded into arrows, the touch data distribution of the OPS module is turned on. At this time, when the user clicks on the arrow part through a specific interactive action, the corresponding position of the Windows system will also have a touch response, resulting in a touch conflict.

[0083] If the arrow on the touch screen of the Android system is folded and changed to a larger OSD menu, the area affected by the touch on the Windows system will be larger.

[0084] For example, Fig. 9As shown, it is a schematic diagram of the interface for menu dragging in the dual system provided in the application embodiment. The on-screen display (OSD) adjustment method of the Android system supports dragging. When the user drags the OSD menu through a specific dragging action, the Windows system will also receive the dragging action, so that there will be a dragging track at the corresponding position of the Windows system during the dragging of the OSD menu. Therefore, the pressing action of the OSD menu can be detected by the Android system, and when the pressing action of the OSD menu being pressed is detected, the touch permission of the Windows system is turned off. This method can block part of the dragging data, but the Windows system can still receive the pressed touch action.

[0085] In order to solve the problem of conflicting touch permissions in dual systems, some embodiments of the present application also provide a dual system control method, which is applied to the display device 200, and is used to control the touch permissions of the dual systems carried on the display device 200, so as to achieve coexistence of touch permissions of the dual systems without conflict. Among them, the display device 200 to which the dual system control method can be applied includes: a display 260, a first controller and a second controller. Among them, the display 260 is configured to display a user interface, the display 260 is connected to a touch interaction module, and the touch interaction module is used to receive touch instructions input by a user. The first controller can be the controller 250 of the display device 200 itself, which is used to run the first system to control the display 260 to display the first system interface. The second controller can be an external controller of the display device 200, the first controller is connected to the second controller, and the second controller is used to run the second system to control the display 260 to display the second system interface; the first controller is configured to execute the above-mentioned dual system control method.

[0086] In order to achieve the coexistence of touch permissions of the dual systems without conflict, the dual system control method provided in the embodiment of the present application includes touch permission control of the first system interface under the second system and touch permission control of the second system interface under the first system. For the touch permission control of the first system interface under the second system, the touch permission of the corresponding area of ​​the second system can be turned off according to the display area of ​​the first system interface at startup. For the touch permission control of the second system interface under the first system, the touch permission of the corresponding area of ​​the second system can be turned on according to the display area of ​​the second system interface at startup.

[0087] Among them, the first system interface is a window interface based on the first system, and the second system interface is a window interface based on the second system. In other words, the touch permissions of the dual systems are controlled in a partitioned manner. When the first system interface is started on the upper layer of the second system, the touch permission of the second system to the display area of ​​the first system interface is turned off. When the second system interface is started on the upper layer of the first system, the touch permission of the second system to the display area of ​​the second system interface is turned on, so that the touch permissions of the dual systems can coexist without conflict.

[0088] In order to enable and disable touch permissions for different display areas, attribute values ​​representing touch permissions may be assigned to pixels in the display area. For a display area representing the effect of the touch permission of the first system, a first touch tag value may be set for pixels in the display area. For a display area representing the effect of the touch permission of the second system, a second touch tag value may be set for pixels in the display area. When a user inputs a touch instruction, the display device 200 may detect the touch position of the touch instruction, and perform the touch operation of the corresponding system according to the attribute value of the touch permission of the area where the touch position is located.

[0089] That is, the first controller of the display device 200 can detect the touch point position of the touch instruction in response to the touch instruction input by the user, and if the pixel point at the touch point position is the first touch mark value, control the first system to execute the touch instruction. If the pixel point at the touch point position is the second touch mark value, send the touch instruction to the second controller so that the second controller controls the second system to execute the touch instruction.

[0090] It is understandable that the first touch mark value and the second touch mark value are not specifically limited in the present embodiment and can be set according to actual needs. For example, the first touch mark value can be represented by the number "0" and the second touch mark value can be represented by the number "1".

[0091] like Fig.10 As shown, Fig.10 This is a schematic diagram of the touch right control process of the first system interface under the second system in an embodiment of the present application, which specifically includes the following contents:

[0092] S101: When the user interface includes a second system interface, in response to a startup instruction of a first system interface, detecting a first display area of ​​the first system interface.

[0093] S102: Setting a first touch mark value for a pixel point in a first display area.

[0094] The first touch control tag value is used to indicate the area scope of the touch control permission of the first system. When the first system interface is started under the second system, the display device 200 can obtain the first display area of ​​the first system interface, set the first touch control tag value for the pixel points of the first display area, indicating that the first display area is the display area of ​​the touch control permission of the first system, so that the first display area can only perform the touch control operation of the first system, and cannot perform the touch control operation of the second system.

[0095] For example, Fig.11 As shown, it is a schematic diagram of the first system interface started under the second system provided in an embodiment of the present application. The display device 200 is a touch display screen of the Android system, on which the Windows system is installed to form a dual system. Under the Windows system, start the first system interface A. Get the first display area corresponding to the first system interface A, traverse the pixels of the first display area, and set the first touch mark value "0" for the pixels of the first display area, indicating that the first display area is a display area where the touch permission of the Android system is applied, so that the first system interface A can only perform touch operations of the Android system, and other display areas not covered by the first system interface A can still perform touch operations of the Windows system.

[0096] In some embodiments, the display device 200 can detect the first interface state of the first system interface. The first interface state includes a full-screen state and a non-full-screen state. If the first interface state is a full-screen state and there is no second system interface on the upper layer of the first system interface, the data channel between the first controller and the second controller is closed so that the first controller cannot send data to the second controller. If the first interface state is a non-full-screen state, the step of detecting the first display area of ​​the first system interface is performed.

[0097] That is, if the window interface started by the first system is full screen and no window interface of the second system is displayed, the touch permission of the second system is disabled. If the window interface started by the first system is not full screen, the display area of ​​the window interface is detected, and only the touch permission of the second system to the display area is disabled.

[0098] For example, the touch screen of the Android system is equipped with a Windows system to form a dual system, and the Windows system is the OPS module inside the touch screen. When the window interface started by the first system is full screen and there is no window interface of the second system displayed, the touch data distribution of the interface channel of the OPS module is directly closed, and no data is sent to the OPS module.

[0099] In some embodiments, there is a situation where multiple first system interfaces are started at the same time. In the above situation, the display device 200 can detect the first display areas of the multiple first system interfaces in response to the start-up instructions of the multiple first system interfaces. Perform a union operation on the multiple first display areas to obtain the union area of ​​all the first display areas. Set the first touch mark value for the pixel points in the union area.

[0100] For example, Fig.12 As shown, it is a schematic diagram of simultaneously starting multiple first system interfaces under the second system provided in an embodiment of the present application. The display device 200 is a touch display screen of the Android system, on which the Windows system is installed to form a dual system. Under the Windows system, the first system interface A and the first system interface B are started at the same time. Among them, the first display area corresponding to the first system interface A is area A, and the first display area corresponding to the first system interface B is area B. The union area of ​​area A and area B is taken, and the pixels of the union area are set to the first touch mark value "0" to indicate that the first display area is the display area of ​​the touch permission of the Android system.

[0101] In some embodiments, since the first system in the display device 200 can support the simultaneous startup of multiple applications, or the startup of multiple interfaces of the same application, in order to facilitate the recording of display areas affected by the touch permissions of different systems, the display device 200 can create a disabled touch linked list for storing disabled areas, that is, display areas affected by the touch permissions of the second system.

[0102] Therefore, the display device 200 can detect the first display area of ​​the first system interface in response to the startup instruction of the first system interface, and add the first display area to the disabled touch control list. It can also remove the first display area from the disabled touch control list in response to the shutdown instruction of the first system interface.

[0103] In order to distinguish the disabled areas of different applications or interfaces, a marking method can be used to mark each application or interface with a unique identifier. Each identifier corresponds to a display area of ​​the first system interface. When the first system interface is exited, the touch disablement of the display area corresponding to the identifier can be canceled, and the display area corresponding to the identifier can be removed from the disabled touch linked list.

[0104] Therefore, the display device 200 can obtain the first identifier of the first system interface. When the first system interface is started, the first display area is marked based on the first identifier, and the first display area marked with the first identifier is added to the disabled touch control list. When the first system interface is closed, the first display area marked with the first identifier is removed from the disabled touch control list.

[0105] like Fig.13As shown, it is a schematic diagram of the process of executing touch instructions provided in an embodiment of the present application. The user can input a touch instruction to the display device 200 through a specific touch interaction action. When the user inputs a touch instruction, the display device 200 can detect the touch point position of the touch instruction in response to the touch instruction input by the user. Then call the disabled touch list, and read the disabled area in the disabled touch list. If the touch point position is within the disabled area, control the first system to execute the touch instruction. If the touch point position is not within the disabled area, send the touch instruction to the second controller so that the second controller controls the second system to execute the touch instruction.

[0106] It can be understood that the present application sets a touch interaction module in the link for transmitting data upward from the hardware layer of the display device 200, so as to judge whether the touch data transmitted from the hardware layer is within the disabled area. If the touch point position in the touch data is within the disabled area, the touch data is not sent to the second system, and the first system responds to the touch data. If the touch point position in the touch data is not within the disabled area, the touch data is not sent to the first system, and the touch data is sent to the second system, and the second system responds to the touch data.

[0107] For example, Fig.12 Take the user interface of for example, in Windows system, start the first system interface A, the first display area corresponding to the first system interface A is the A area, then start the first system interface B, the first display area corresponding to the first system interface B is the B area. Mark the A area as the identifier "A", mark the B area as the identifier "B", and add the A area and the B area marked with the identifier to the disabled touch linked list for storage. When the touch position of the touch command input by the user is Fig.12 When the touch control data is at point p shown in the figure, the display device 200 will detect that point p falls within area B or area A, that is, point p is located in the disabled area, and the touch control data will not be distributed to the Windows system, and only the touch control operation of the Android system will be executed.

[0108] When the first system interface B is exited, the identifier "B" of the first system interface B can be obtained, and the area marked with the identifier "B" in the disabled touch list can be removed from the disabled touch list. At this time, there is still area A in the disabled touch list. When it is detected that the touch position input by the user is point p, the touch control corresponding to area A of the Windows system is still in a disabled state, and the touch control operation of the Android system is still executed.

[0109] If the touch position input by the user is detected as point k, the display device 200 will detect that point k is outside area A, that is, point k is not located in the disabled area, and then distribute the touch data to the Windows system to execute the touch operation of the Windows system.

[0110] like Fig.14 As shown, Fig.14 This is a schematic diagram of the touch right control process of the second system interface under the first system in the embodiment of the present application, which specifically includes the following contents:

[0111] S201: When the user interface includes a first system interface, in response to a startup instruction of a second system interface, detecting a second display area of ​​the second system interface.

[0112] S202: Setting a second touch mark value for a pixel point in a second display area.

[0113] The second touch control mark value is used to indicate the display area where the touch control permission of the second system is applied. When the second system interface is started under the first system, the display device 200 can obtain the second display area of ​​the second system interface, set the second touch control mark value for the pixel points of the second display area, indicating that the second display area is the display area where the touch control permission of the second system is applied, so that the second display area can only perform the touch control operation of the second system, and cannot perform the touch control operation of the first system.

[0114] For example, Fig.15 As shown, it is a schematic diagram of the second system interface started under the first system provided by the embodiment of the present application. The display device 200 is a touch display screen of the Android system, on which the Windows system is installed to form a dual system. The installed Windows system is the OPS module inside the touch display screen. Under the Android system, the whiteboard application is started, and the window interface of the whiteboard application is displayed in full screen. At this time, the touch permission of the OPS module is in a closed state. The OPS module is started in the upper layer of the whiteboard application to perform a windowed display of the second system interface C. The second display area corresponding to the second system interface C is obtained, the pixels of the second display area are traversed, and the second touch mark value "1" is set for the pixels of the second display area, indicating that the second display area is a display area where the touch permission of the Windows system acts, so that the second system interface C can only perform touch operations of the Windows system, and other display areas not covered by the second system interface C can still perform touch operations of the Android system.

[0115] In some embodiments, the display device 200 can detect the second interface state of the second system interface. The second interface state includes a full-screen state and a non-full-screen state. If the second interface state is a full-screen state and the first system interface does not exist in the upper layer of the second system interface, the data channel between the first controller and the second controller is opened so that the first controller can send data to the second controller. If the second interface state is a non-full-screen state, the step of detecting the second display area of ​​the second system interface is performed.

[0116] That is, if the window interface started by the second system is full screen and no window interface of the first system is displayed, the touch permission of the second system is enabled. If the window interface started by the second system is not full screen, the display area of ​​the window interface is detected, and only the touch permission of the second system to the display area is enabled.

[0117] In some embodiments, the dual-system display device 200 has a scene in which the second system is displayed in the form of a window in the first system. Fig.15 The second system interface C shown is a preview window of the second system OPS module displayed in the whiteboard application of the first system of the display device 200. For the preview window, due to the change of the window touch data, it does not support the second system to perform corresponding touch operations.

[0118] Therefore, in order to solve the above problem, when the window display of the started second system is non-full screen, the display device 200 can perform corresponding window data coordinate conversion on the window touch data. When the display device 200 detects that the second interface state of the second system interface is non-full screen state, it obtains the full screen coordinates and maps the full screen coordinates to the window coordinates according to the second display area of ​​the second system interface. Among them, the full screen coordinates are the position coordinates of the window touch data in the full screen state of the second system interface. The window coordinates are the position coordinates of the window touch data in the current non-full screen state of the second system interface.

[0119] Among them, the window touch data is the interface elements in the second system interface used to respond to user touch actions, such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, etc. When the second system interface is displayed in full screen, it can interact with the window touch data corresponding to the touch position according to the touch position in the touch command input by the user. When the second system interface is displayed in a windowed manner, the position coordinates of the window touch data in the full-screen state of the second system interface can be mapped to the position coordinates of the window touch data in the current non-full-screen state, thereby realizing the touch operation of the second system interface in the non-full-screen state.

[0120] In some embodiments, when the first display area of ​​the first system interface overlaps with the second display area of ​​the second system interface, an intersection operation can be performed on the first display area and the second display area to obtain the intersection area. Then, the display levels of the first system interface and the second system interface are compared. If the display level of the first system interface is higher than the display level of the second system interface, a first touch mark value is set for the pixel points in the intersection area.

[0121] For example, Fig.15 Taking the interface shown in the figure as an example, in the Android system, the whiteboard application is started and the window interface of the whiteboard application is displayed in full screen. In the whiteboard application, the OPS module is started and the second system interface C is displayed in a window. Fig.16 As shown, the second display area corresponding to the second system interface C is area C. The position coordinates of the window touch data in the full-screen state of the second system interface C are mapped to the position coordinates of the window touch data in area C to realize the touch operation of the second system interface C when it is not in full-screen state.

[0122] At this time, the first system interface D of the Android system is started on the upper layer of the second system interface C, and the first display area corresponding to the first system interface D is the D area. The display device 200 can perform an intersection operation on the C area and the D area, and take the intersection area of ​​the C area and the D area, that is, Fig.16 The E region shown in the figure sets the first touch flag value for the pixels in the E region, indicating that the E region is a display region for the touch permission of the Android system. Thus, the unobstructed area in the C region can be used for touch operation of the Windows system, and the other areas can be used for touch operation of the Android system.

[0123] In this embodiment, a method combining touchable areas with non-touchable areas is adopted to perform zone control on the touch permissions of the second system, and the display area of ​​the first system above the touch area of ​​the second system is set as a disabled area, so that the touch area that can be operated by the second system is obtained, and the disabled area can be used for touch operations of the first system. In this way, the touch permissions of the two systems coexist without conflict, which improves the convenience and accuracy of user operations.

[0124] Based on the above dual-system control method. In some embodiments of the present application, a display device 200 is also provided, including: a display 260, a first controller and a second controller. Among them, the display 260 is configured to display a user interface; the display 260 is connected to a touch interaction module, and the touch interaction module is used to receive touch instructions input by a user. The first controller can be the controller 250 of the display device 200 itself, which is used to run the first system to control the display 260 to display the first system interface. The second controller can be an external controller of the display device 200, the first controller is connected to the second controller, and the second controller is used to run the second system to control the display 260 to display the second system interface; the first controller is configured to execute the following program steps:

[0125] When the user interface includes the second system interface, in response to a start-up instruction of the first system interface, a first display area of ​​the first system interface is detected.

[0126] A first touch flag value is set for a pixel point in the first display area.

[0127] The first touch mark value is used to indicate the display area of ​​the touch permission of the first system.

[0128] When the user interface includes the first system interface, in response to a start-up instruction of the second system interface, a second display area of ​​the second system interface is detected.

[0129] A second touch flag value is set for the pixel point of the second display area.

[0130] The second touch mark value is used to indicate the display area of ​​the touch permission of the second system.

[0131] It can be seen from the above technical solutions that the display device and dual-system control method provided in the above embodiments, when the second system interface is included in the user interface, responds to the startup instruction of the first system interface, detects the first display area of ​​the first system interface, and sets the first touch mark value for the pixel points of the first display area. When the first system interface is included in the user interface, responds to the startup instruction of the second system interface, detects the second display area of ​​the second system interface, and sets the second touch mark value for the pixel points of the second display area. Among them, the first touch mark value is used to indicate the display area where the touch permission of the first system is applied, and the second touch mark value is used to indicate the display area where the touch permission of the second system is applied. The method can control the touch permission partitions of the dual systems carried on the display device according to the display area of ​​the system interface, realizes the coexistence of the touch permissions of the dual systems without conflict, and improves the convenience and accuracy of user operation.

[0132] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0134] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display configured to display a user interface, the display being connected to a touch interaction module, the touch interaction module being used to receive a touch instruction input by a user; A first controller, wherein the first controller is used to run a first system to control the display to display a first system interface; The first controller is connected to a second controller, and the second controller is used to run a second system to control the display to display a second system interface; The first controller is configured to: When the user interface includes a second system interface, in response to a start-up instruction of the first system interface, detecting a first display area of ​​the first system interface; Setting a first touch control mark value for a pixel point in the first display area, wherein the first touch control mark value is used to indicate a display area to which the touch control permission of the first system applies; When the user interface includes a first system interface, in response to a start-up instruction of a second system interface, detecting a second display area of ​​the second system interface; A second touch mark value is set for the pixel points of the second display area, where the second touch mark value is used to indicate the display area to which the touch permission of the second system applies.

2. The display device according to claim 1, characterized in that The first controller is further configured to: In response to a touch command input by a user, detecting a touch point position of the touch command; If the pixel point at the touch point position is a first touch mark value, controlling the first system to execute the touch instruction; If the pixel point at the touch point position has a second touch mark value, the touch instruction is sent to the second controller, so that the second controller controls the second system to execute the touch instruction.

3. The display device according to claim 1, characterized in that The first controller is further configured to: In response to activation instructions of the plurality of first system interfaces, detecting first display areas of the plurality of first system interfaces; Performing a union operation on a plurality of the first display areas to obtain a union area; A first touch mark value is set for the pixel points in the union area.

4. The display device according to claim 1, characterized in that The first controller is further configured to: Create a disabled touch list; In response to a start-up instruction of the first system interface, adding the first display area to the disabled touch control linked list; In response to a closing instruction of the first system interface, the first display area is removed from the disabled touch control list.

5. The display device according to claim 4, characterized in that The first controller is further configured to: In response to a touch command input by a user, detecting a touch point position of the touch command; Retrieving the disabled touch control linked list, and reading the disabled area of ​​the disabled touch control linked list; If the touch point is located in the disabled area, controlling the first system to execute the touch command; If the touch point is not located in the disabled area, the touch instruction is sent to the second controller so that the second controller controls the second system to execute the touch instruction.

6. The display device according to claim 4, characterized in that The first controller is further configured to: Obtaining a first identifier of the first system interface; When the first system interface is started, marking the first display area based on the first identifier, and adding the first display area marked with the first identifier to the disabled touch control linked list; When the first system interface is closed, the first display area marked with the first identifier is removed from the disabled touch list.

7. The display device according to claim 1, characterized in that The first controller is further configured to: Detecting a first interface state of the first system interface, where the first interface state includes a full-screen state and a non-full-screen state; If the first interface state is in full screen state and the second system interface does not exist on the upper layer of the first system interface, closing the data channel between the first controller and the second controller; If the first interface state is a non-full screen state, a step of detecting a first display area of ​​the first system interface is performed.

8. The display device according to claim 1, characterized in that The first controller is further configured to: Detecting a second interface state of the second system interface, where the second interface state includes a full-screen state and a non-full-screen state; If the second interface state is a non-full-screen state, obtaining full-screen coordinates, where the full-screen coordinates are the position coordinates of the window touch data in the full-screen state of the second system interface; The full-screen coordinates are mapped to window coordinates according to the second display area, and the window coordinates are position coordinates of the window touch data in the current non-full-screen state of the second system interface.

9. The display device according to claim 1, characterized in that: The first controller is further configured to: When the first display area and the second display area overlap, performing an intersection operation on the first display area and the second display area to obtain an intersection area; Comparing the display levels of the first system interface and the second system interface; If the display level of the first system interface is higher than the display level of the second system interface, a first touch mark value is set for the pixel points in the intersection area.

10. A dual system control method, characterized in that: Applied to a display device, the display device comprises a display, a first controller and a second controller; the first controller is used to run a first system to control the display to display a first system interface; The first controller is connected to a second controller, and the second controller is used to run a second system to control the display to display a second system interface; the method includes: When the user interface of the display includes a second system interface, in response to a start-up instruction of the first system interface, detecting a first display area of ​​the first system interface; Setting a first touch control mark value for a pixel point in the first display area, wherein the first touch control mark value is used to indicate a display area to which the touch control permission of the first system applies; When the user interface of the display includes a first system interface, in response to a startup instruction of a second system interface, detecting a second display area of ​​the second system interface, the second system interface being a window interface based on the second system; A second touch mark value is set for the pixel points of the second display area, where the second touch mark value is used to indicate the display area to which the touch permission of the second system applies.

Images