Touch response method and device, display equipment and storage medium

Abstract

A touch response method, apparatus, display device and storage medium, relating to the technical field of touch control, the method being applied to a first display device (20), comprising: acquiring first touch data when both the first display device (20) and a third display device (22) display a first picture, the first picture being a display picture of a second display device (21), and the third display device (22) being a display picture of a third display device (22); the first display device (20) is connected to the second display device (21) and the third display device (22), respectively, and the first touch data is data generated by a touch operation acting on the first display device (20) or the third display device (22) (S110, S510); if the first touch data corresponds to the first screen, transmitting the first touch data to a second display device (21), so that the second display device (21) executes a touch operation corresponding to the first touch data (S120, S550); when the second display device (21) performs a touch operation to update the first screen to the second screen, the currently displayed first screen is updated to the second screen, and the third display device (22) is driven to display the second screen (S130, S560).

Description

Touch response method, device, display device and storage medium Technical Field

[0001] The embodiments of the present application relate to the field of touch control technology, and in particular to a touch response method, apparatus, display device, and storage medium. Background Art

[0002] Controlling multiple display devices (e.g., three or more) to display the same image is a common application scenario in the display field. In this application scenario, one display device sends its own display image to other display devices for display, thereby enabling multiple display devices to display the same image. In this case, the other display devices can be considered to be displaying an external signal source.

[0003] When a display device displays an external signal source, it can also collect touch operations on the display screen (not generated by itself) and respond to the touch operations. In this case, the display device can display the response results of the touch operation, but because it is not the device that generates the display screen, it cannot synchronize the response results to other display devices for display. That is, when three or more display devices are displaying the same screen, the display device that is not displaying the screen generated by itself cannot synchronize the response results of the touch operation to other display devices.

[0004] Summary of the Invention

[0005] Embodiments of the present application provide a touch response method, apparatus, display device, and storage medium to address the technical problem in the related art that, when three or more display devices display the same image, a display device displaying an image that is not generated by itself cannot synchronize the response results of touch operations to other display devices.

[0006] In the first aspect, an embodiment of the present application provides a touch response method, which is applied to a first display device. The first display device here is connected to the second display device and the third display device respectively. Specifically, the touch response method includes: when the first display device and the third display device both display the first screen (the display screen of the second display device), obtaining first touch data, the first touch data being data generated by a touch operation acting on the first display device or the third display device; when the first touch data corresponds to the first screen, sending the first touch data to the second display device so that the second display device performs the touch operation corresponding to the first touch data; thereafter, when the second display device performs a touch operation and updates the first screen to the second screen, updating the currently displayed first screen to the second screen, and driving the third display device to display the second screen.

[0007] It can be seen that in the scenario where the first display device and the third display device synchronously display the screen of the second display device, when the first display device obtains the first touch data corresponding to the touch operation acting on itself or the third display device, the first display device can determine which screen the first touch data corresponds to. When it is determined that the first touch data corresponds to the first screen, the first display device is used as a touch data forwarding device to forward the first touch data to the second display device, so that the second display device responds to the touch operation corresponding to the first touch data and updates its display screen. In addition, the first display device and the third display device synchronously update the display screen to meet the scenario where the first display device and the third display device synchronously display the screen of the second display device. In other words, regardless of whether the user touches the first display device or the third display device, each display device can synchronously display the screen after the touch response.

[0008] Furthermore, in the case of touching the second display device, since the second display device sends its own image to the first display device so that the first and third display devices can display the image synchronously, when the second display device receives the touch and responds, the image after the touch response will also be displayed synchronously on the first and third display devices. Therefore, the touch response method provided by this application can achieve that after touching any display device, each display device will synchronously display the image after the touch response, even in a scenario where three or more devices are displaying at the same time.

[0009] In a second aspect, an embodiment of the present application further provides a touch response device, which is applied to a first display device. The device includes: an acquisition unit, a sending unit, and a processing unit.

[0010] Specifically, the acquisition unit is configured to acquire first touch data when both the first display device and the third display device are displaying a first screen, the first screen being the screen displayed by the second display device, the first display device being connected to the second display device and the third display device, respectively, and the first touch data being data generated by a touch operation applied to the first display device or the third display device. The sending unit is configured to send the first touch data to the second display device when the first touch data corresponds to the first screen, so that the second display device can perform the touch operation corresponding to the first touch data. The processing unit is configured to update the currently displayed first screen to the second screen when the second display device performs a touch operation to update the first screen to the second screen, and to drive the third display device to display the second screen.

[0011] In a third aspect, an embodiment of the present application further provides a display device, including:

[0012] one or more processors;

[0013] a memory for storing one or more programs;

[0014] a display screen, configured to display according to instructions of the processor;

[0015] Multiple data interfaces for transmitting touch data;

[0016] Multiple display interfaces for transmitting display signals corresponding to the display screen;

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the touch response method as described in the first aspect above.

[0018] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium storing a computer program. When the computer program runs on a display device, the display device executes the touch response method as described in the first aspect above.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed on a display device, the display device executes the touch response method described in the first aspect above.

[0020] The beneficial effects of the second to fifth aspects mentioned above can be referred to the analysis of the beneficial effects in the first aspect mentioned above, and will not be repeated here.

[0021] These and other aspects of the embodiments of the present application will be more clearly understood in the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] FIG1 is a schematic diagram of an interactive tablet connection for dual-screen display in the related art;

[0023] FIG2 is a schematic diagram of a touch data processing method in the related art;

[0024] FIG3 is a schematic diagram of another touch data processing method in the related art;

[0025] FIG4 is a schematic diagram of a touch response system provided by an embodiment of the present application;

[0026] FIG5 is a schematic structural diagram of a display device provided by one embodiment of the present application;

[0027] FIG6 is a schematic diagram of a layered architecture of an operating system provided by one embodiment of the present application;

[0028] FIG7 is a flowchart of a touch response method provided by one embodiment of the present application;

[0029] FIG8 is a first schematic diagram of a three-screen display provided by an embodiment of the present application;

[0030] FIG9 is a second schematic diagram of a three-screen display provided by an embodiment of the present application;

[0031] FIG10 is a flowchart of another touch response method provided by one embodiment of the present application;

[0032] FIG11 is a flow chart of transmitting first touch data in a first display device according to one embodiment of the present application;

[0033] FIG12 is a third schematic diagram of a three-screen display provided by an embodiment of the present application;

[0034] FIG13 is a fourth schematic diagram of a three-screen display provided by an embodiment of the present application;

[0035] FIG14 is a fifth schematic diagram of a three-screen display provided by an embodiment of the present application;

[0036] FIG15 is a schematic structural diagram of a touch response device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0037] The present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are intended to explain the present application, not to limit the present application. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present application, not all structures.

[0038] It should be noted that, in this application, relational terms such as first and second are used solely to distinguish one entity, operation, or object from another, and do not necessarily require or imply the existence of any actual relationship or order between these entities, operations, or objects. For example, the terms "first" and "second" in the context of a first display device and a second display device are used solely to distinguish between the two different display devices.

[0039] Existing interactive tablets usually include components such as a touch display module and a whole machine module (including a controller). The touch display module includes a display screen, a touch component, and a backlight component. The display screen is used for displaying images, and generally uses a liquid crystal display device, but other types of display devices can also be used. The touch component is set on the display screen or at the front end of the display screen to collect touch-related data generated by the user's touch operation and send the collected data to the whole machine module for processing. The backlight component is used to provide a backlight source for the display screen.

[0040] In actual use, the screen of the interactive tablet is displayed. When the user touches or is close enough to the content displayed on the display screen (for example, a graphic button) with a touch object such as a finger or a stylus (which can also be recorded as a touch pen, a writing pen, a smart pen, etc.), the touch component of the interactive tablet will collect data related to the touch, and the touch component will convert the touch-related data into coordinate data of the touch point and send it to the whole machine module, or send the touch-related data to the whole machine module and convert it into coordinate data of the touch point by the whole machine module. After the whole machine module obtains the coordinate data of the touch point, it sends it to the corresponding program to implement the corresponding control operation, drive the display screen to change the content, and realize a variety of display and operation effects. At present, for the sake of ease of understanding, touch data is used to represent the various data involved when a touch occurs, that is, the touch-related data collected by the touch component and the coordinate data converted based on the touch-related data are all represented as touch data.

[0041] The whole-machine module is a built-in module of the interactive tablet, which runs a low-performance Android system. The whole-machine module mainly implements the display processing and touch data processing functions of the interactive tablet. The hardware configuration of the whole-machine module is relatively low. In addition to configuring the operating system and basic application software (such as whiteboard writing software and annotation application software), it does not support the installation of other application software. If the interactive tablet needs to implement other functions, it needs to be connected to the main control module and the corresponding functions can be achieved by installing the relevant application software on the main control module. For example: if you need to display files, you need to install the relevant display software on the main control module, and so on.

[0042] More specifically, the whole machine module includes a main control board, which is provided with a main control chip, a power supply circuit of the main control chip and other peripheral circuits, and is also provided with a plurality of communication interfaces for communication, and the plurality of communication interfaces are connected to the main control chip. The plurality of communication interfaces may include a Universal Serial Bus (USB) interface, a High Definition Multimedia Interface (HDMI) interface, a Type-C interface, a Video Graphics Array (VGA) and a touch line port (Touch out port) and one or more thereof. The whole machine module is connected to the main control module via a serial interface, and is communicated with other devices or terminals via interfaces such as a USB interface and an HDMI interface, thereby receiving input signals from different signal sources and forming corresponding signal source channels. For example, the whole machine module is connected to the main control module via a serial interface to form a host channel, so that the media content sent by the host channel can be received and presented, or it is connected to an external device via an HDMI interface to form an HDMI channel, thereby presenting the media data input by the external device.

[0043] The main control module can be a pluggable (OPS, Open Pluggable Specification) module on the interactive tablet. Application software running on the interactive tablet is installed on the main control module. The main control module can run an operating system such as Windows or high-performance Android. For example, the main control module can be a PC module or a high-performance Android module, which can be understood as a computer.

[0044] The interactive tablet at least includes signal source channels such as Android channel, host channel and HDMI channel. These signal source channels are used to receive input signals from different signal sources, so that the interactive tablet can switch between different signal source channels to present media content provided by different signal sources. Among them, the Android channel is the working channel of the whole machine module itself in the interactive tablet, which is used to present the media content of the whole machine module. The signal source connected to the host channel is the host module, so the host channel is used to present the media data input by the host module of the interactive tablet. The HDMI channel is used to present the media data of the signal source connected through the HDMI interface of the interactive tablet. The signal source channel corresponding to the HDMI channel can be understood as an external signal source channel.

[0045] When the interactive flat panel's signal source channel is the Android channel, it indicates that the interactive flat panel is in the entire module's own working channel, used to present the entire module's media content. At this point, when the entire module receives touch data sent by the touch component, the Android system performs compatibility processing on the touch data (through compatibility processing, touch data generated by different types of touch components is processed into a unified format so that the Android system's processing process can recognize and respond), responds to the touch data, and performs the corresponding operation.

[0046] When the signal source channel of the interactive flat panel is the host channel, when the whole machine module receives the touch data sent by the touch component, the Android system in the whole machine module first performs compatibility processing on the touch data. Then, the Android system forwards the touch data generated in the display screen area of ​​the host channel to the host channel for response based on the pre-set display screen area size of the host channel.

[0047] When the interactive tablet's signal source channel is an HDMI channel, the entire module receives touch data sent by the touch component. The Android system in the entire module first performs touch data compatibility processing. Then, based on the pre-set display area of ​​the HDMI channel, the Android system forwards the touch data generated within the HDMI channel's display area to the touch line port (Touch Out port). The external device connected to the touch line port (Touch Out port) responds.

[0048] Based on the above principles, in existing technology, two interactive tablets are often used to display the same screen in scenarios such as teaching, office meetings, and training presentations. As shown in Figure 1, interactive tablet 1 and interactive tablet 2 establish a video signal transmission channel and a touch signal transmission channel. The video signal transmission channel is implemented by connecting the HDMI interface between interactive tablets 1 and 2 via an HDMI cable. The touch signal transmission channel is implemented by connecting the touch cable port between interactive tablets 1 and 2 via a touch cable.

[0049] During the application process, interactive tablet 1 transmits the current display image (which can be the media content of interactive tablet 1's main module or the media content of interactive tablet 1's host module) as a video stream via the video signal transmission channel to interactive tablet 2. The signal source channel currently displayed by interactive tablet 2 is the HDMI channel. Interactive tablet 2 receives the video stream (i.e., media data) sent by interactive tablet 1 through the HDMI interface and displays it. At this point, interactive tablets 1 and 2 display the same image.

[0050] The user can perform touch operations on the screen presented by the interactive tablet 2. At this time, when the whole module of the interactive tablet 2 receives the touch data sent by the touch component (the touch component generates touch data based on the touch operation), the Android system installed in the whole module first performs compatibility processing on the touch data. Then, based on the area size of the display screen of the HDMI channel (i.e., the display screen of the interactive tablet 1), the touch data generated within the display screen area of ​​the HDMI channel is forwarded to the touch line port. After that, the interactive tablet 1 receives the touch data sent by the interactive tablet 2 through the touch signal transmission channel. The interactive tablet 1 sends the touch data to the channel corresponding to the display screen for response. If the display screen is the media content of the whole module of the interactive tablet 1, the whole module responds to the touch data. If the display screen is the media content of the host module of the interactive tablet 1, the whole module sends the touch data to the host module for response. In the process of the interactive tablet 1 responding to the touch data, if the display screen is updated, based on the transmission of the video signal transmission channel, the interactive tablet 2 also synchronously updates the screen of the interactive tablet 1 it displays.

[0051] Similarly, the user can also perform touch operations on the screen presented by the interactive tablet 1. When the whole machine module of the interactive tablet 1 receives the touch data sent by the touch component, the Android system installed in the whole machine module first performs compatibility processing on the touch data. After that, when the displayed screen is the media content of the whole machine module, the whole machine module responds to the touch data operation. When the displayed screen is the media content of the host module, the whole machine module sends the touch data to the host module for response. In the process of the interactive tablet 1 responding to the touch data, when the display screen is updated, based on the transmission of the video signal transmission channel, the interactive tablet 2 also synchronously updates the screen of the interactive tablet 1 it displays.

[0052] In this way, the interactive tablet 1 and the interactive tablet 2 display the same screen, and the user can touch control the screen through the interactive tablet 1 and the interactive tablet 2, and the control response results can be displayed synchronously on the interactive tablet 1 and the interactive tablet 2.

[0053] To facilitate understanding, the processing flow of touch data within the interactive tablet is now described. Figure 2 is a schematic diagram of touch data processing in the related art, which shows a flow chart of touch data within the interactive tablet when a user performs a touch operation in the touch display module of the interactive tablet.

[0054] Figure 2 illustrates the touch display module using a touch frame as an example. The touch frame, also known as an infrared touch frame, is a touch component used in infrared touch. The touch frame is positioned around the display screen and is equipped with infrared emitting devices (e.g., infrared emitting lamps) and infrared receiving devices (e.g., infrared receiving lamps). Each infrared emitting device emits infrared light at a specific frequency, which is received by the corresponding infrared receiving device. At this point, all the infrared light between the infrared emitting device and the infrared receiving device forms an optical network covering the screen. When a user touches the screen with a finger or stylus, or gets close enough to the screen (the distance from the screen is less than the distance between the optical network and the screen), the finger or stylus blocks the infrared light. Based on this blockage of infrared light, the touch frame detects touch data, such as the touch location (usually represented by two-dimensional coordinates), the width and height of the touch, and reports this touch data to the main control chip of the entire module. The touch driver in the Android kernel layer installed in the main control chip receives this touch data and reports it to the touch server. The touch data sent from the touch frame to the main control chip is raw data.

[0055] After the touch service receives the touch data, it reports the touch data to the application installed by the Android system, so that the Android system can respond to the touch data normally. Currently, the application installed by the Android system can be a basic application configured in the whole machine module, or it can be an application installed by the high-performance Android system in the main control module. It is understandable that if it is an application installed by the high-performance Android system in the main control module, then the whole machine module also needs to send the touch data to the main control module. This process can be referred to the above description and will not be repeated here.

[0056] Because the interactive tablet can use an external signal source channel (i.e., a video signal transmission channel), after receiving touch data, the touch service also determines whether the touch data has been forwarded to the touch signal transmission channel. If so, the touch service sends the received touch data to the touch signal transmission channel. The external device corresponding to the touch signal transmission channel responds, that is, the operating system of the external device responds to the touch data. The process of the touch service sending touch data through the touch signal transmission channel can be referred to as the process of the entire device module sending touch data to an external device.

[0057] It can be understood that based on the process shown in Figure 2, regardless of whether the touch data is forwarded to the touch signal transmission channel, the touch service sends the touch data to the application installed on the Android system. In this case, if the touch data is for an external signal source channel, the application installed on the Android system may not respond to the touch data. For example, the touch service sends the touch data to the application used to display the display screen sent by the external signal source channel. After receiving the touch data, the application determines that it will no longer respond, that is, the response result is a discarded response.

[0058] Another optional method, Figure 3 is a schematic diagram of another touch data processing method in the related technology. The difference between Figure 3 and Figure 2 is that in Figure 3, after the touch service receives the touch data, it first determines whether the touch data is directed to the external signal source channel. If so, the touch data is forwarded to the touch signal transmission channel for response; otherwise, the touch data is reported to the application installed in the Android system for response.

[0059] Based on this, the interactive flat panel and the external device connected to the touch signal transmission channel can respond to touch operations applied to the display screen.

[0060] However, with the promotion and use of interactive tablets, the demand for applications in which three or more interactive tablets display the same screen in scenarios such as teaching, office meetings, and training presentations is increasing. Taking three interactive tablets displaying the same screen as an example, there may be multiple video signal transmission channels and multiple touch signal transmission channels between the interactive tablets. Since in related technologies, the interactive tablet can only transmit touch data to an external device through the current touch signal transmission channel, when the interactive tablet has multiple touch signal transmission channels, the interactive tablet cannot determine which touch signal transmission channel the touch data should be transmitted to which external device, that is, it cannot determine which external device should respond to the touch data. In this case, the interactive tablet can only respond to the touch data. However, when the interactive tablet displays a screen that is not generated by itself, the interactive tablet cannot synchronize the response results of the touch operation to other interactive tablets, that is, the screens displayed by the three interactive tablets are no longer synchronized.

[0061] To this end, an embodiment of the present application provides a touch response method, in which a display device can receive and forward display signals, as well as receive and forward touch operations. On this basis, a display device (corresponding to the first display device mentioned in the embodiment of the present application) can receive a display signal sent by another display device (corresponding to the second display device mentioned in the embodiment of the present application) (the display signal is based on the real-time display screen generated by the other display device, i.e., the second display device), display the corresponding screen according to the display signal, and can also forward the display signal to another display device (corresponding to the third display device mentioned in the embodiment of the present application) for display, thereby achieving that each display device displays the same screen. In addition, the current display device (corresponding to the first display device mentioned in the embodiment of the present application) can also forward touch data when a user performs a touch operation on the same screen (which can be an operation performed on the current display device or an operation performed on another display device (corresponding to the third display device mentioned in the embodiment of the present application)) to another display device (corresponding to the second display device mentioned in the embodiment of the present application) that generates the display screen, that is, identifying which display device corresponding to the touch signal transmission channel is the device that generates the screen corresponding to the touch data, and then the other display device responds. At this time, each display device can display the picture corresponding to the response result, thereby solving the technical problem that when three or more display devices display the same picture, the display device displaying a picture not generated by itself cannot synchronize the response results of the touch operation to other display devices.

[0062] The touch response method provided in the embodiment of the present application is applicable to a touch response system. As shown in Figure 4, the touch response system includes a first display device 20, a second display device 21, and a third display device 22. The first display device 20 is connected to the second display device 21 and the third display device 22 respectively. Currently, the image displayed by the second display device 21 can be displayed synchronously in the first display device 20 and the third display device 22, that is, it can be understood that the second display device 21 is an external image source device. In actual applications, the number of third display devices 22 can be at least one, and the embodiment of the present application does not specifically limit this. For ease of understanding and description, Figure 4 and the description of the embodiment of the present application are all explained by taking the first display device 20 connected to a third display device 22 as an example.

[0063] Furthermore, in actual applications, the first display device 20 can also be connected to another image source device different from the second display device 21, such as a fourth display device. In this way, the first display device 20 can display the image of the fourth display device while displaying the image of the second display device 21. Furthermore, the third display device 22 can also display the image of the fourth display device while displaying the image of the second display device 21. That is, the number of currently connected external image source devices can be at least one. For ease of understanding and description, FIG. 4 and the description of the embodiments of the present application are all illustrated using a single external image source device, namely the second display device 20, as an example.

[0064] As shown in Figure 4, when the first display device 20 and the second display device 21 are connected, they include a video signal transmission channel and a touch signal transmission channel. Similarly, when the first display device 20 and the third display device 22 are connected, they include a video signal transmission channel and a touch signal transmission channel. Each of the above-mentioned video signal transmission channels and each of the touch signal transmission channels can be a wired transmission channel or a wireless transmission channel. In the embodiments, wired transmission channels are used as examples.

[0065] The first display device 20 includes at least two interfaces for transmitting video signals. Currently, the interfaces for transmitting video signals are referred to as display interfaces. The display interfaces can be HDMI interfaces, VGA interfaces, USB Type-C interfaces, or DP (DisplayPort) interfaces. The multiple display interfaces in the first display device 20 can be of the same interface type or of different interface types, which is not specifically limited in this embodiment of the present application.

[0066] In one embodiment, the first display device 20 includes multiple display interfaces including at least a first display interface and a second display interface. For example, both the first display interface and the second display interface are HDMI interfaces. The first display interface and the second display interface can be provided on the display screen of the first display device or on the main body of the first display device, and this embodiment is not limited thereto. The first display interface and the second display interface can be unidirectional or bidirectional transmission interfaces.

[0067] Correspondingly, the second display device 21 includes at least one display interface. The display interface in the second display device 21 that is connected to the first display interface is referred to as a third display interface. The third display interface can be provided on the display screen of the second display device or on the main body of the second display device. The third display interface can be a unidirectional transmission interface or a bidirectional transmission interface. After the third display interface and the first display interface are connected via an HDMI transmission cable, a video signal transmission channel is formed between the first display device 20 and the second display device 21, thereby achieving synchronization of the display images of the first display device 20 and the second display device 21 based on the video signal transmission channel.

[0068] Similarly, the third display device 22 includes at least one display interface. The display interface in the third display device 22 that is connected to the second display interface is referred to as the fourth display interface. The fourth display interface can be provided on the display screen of the third display device or on the main body of the third display device. The fourth display interface can be a unidirectional transmission interface or a bidirectional transmission interface. When the fourth display interface and the second display interface are connected via an HDMI transmission cable, a video signal transmission channel is formed between the first display device 20 and the third display device 22. The display images of the first display device 20 and the third display device 22 are then synchronized based on the video signal transmission channel.

[0069] In addition, the first display device 20 also includes at least two interfaces for transmitting touch data. The interface for transmitting touch data is recorded here as a data interface, and the data interface can be understood as a touch line port. In actual applications, the data interface can be a USB interface or other types of interfaces. For ease of understanding, the embodiment of the present application describes the data interface using a USB interface as an example. It should be noted that the data interface currently referred to is the external interface of the first display device 20, that is, the interface exposed to the outside. The interface for transmitting touch data inside the first display device 20 is not currently limited, such as using an On-The-Go (OTG) interface.

[0070] In one embodiment, the first display device 20 includes a plurality of data interfaces including at least a first data interface and a second data interface. The first data interface and the second data interface can be unidirectional transmission interfaces or bidirectional transmission interfaces.

[0071] Correspondingly, the second display device 21 includes at least one data interface. The data interface in the second display device 21 connected to the first data interface is referred to as a third data interface. When the third data interface and the second data interface are connected via a USB transmission cable, a touch signal transmission channel is formed between the first display device 20 and the second display device 21. Touch data is then transmitted between the first display device 20 and the second display device 21 based on the touch signal transmission channel.

[0072] Similarly, the third display device 22 includes at least one data interface. The data interface in the third display device 22 that is connected to the second data interface is referred to as a fourth data interface. When the fourth data interface and the first data interface are connected via a USB transmission cable, a touch signal transmission channel is formed between the first display device 20 and the third display device 22. Touch data is then transmitted between the first and third display devices 20 and 22 based on the touch signal transmission channel.

[0073] At least two of the first display device 20 , the second display device 21 , and the third display device 22 may be integrated into one device, or may be completely independent devices, which is not specifically limited in the embodiment of the present application.

[0074] The first display device 20, the second display device 21, and the third display device 22 can all be electronic devices with display and touch functions. The electronic device can be the aforementioned interactive tablet, or it can be a digital tablet, a laptop computer, a desktop computer, a PDA (Personal Digital Assistant), a mobile phone, a television, a tablet computer, an electronic billboard, etc.

[0075] The display device shown in FIG. 4 may adopt the hardware structure shown in FIG. 5 . The display device will be described in detail below with reference to FIG. 5 .

[0076] 5 , the display device includes a processor 301 , a display screen 302 , a memory 303 , and a communication interface 304 . The processor 301 , the display screen 302 , the memory 303 , and the communication interface 304 are connected via a communication bus 305 .

[0077] The processor 301 may include processing units such as an application processor (AP), a graphics processing unit (GPU), and a central processing unit (CPU). The processor 301 may implement display control of the display device according to the received touch operation.

[0078] The display screen 302 may be a liquid crystal display (LCD), an LED display (LED display), an organic light-emitting diode (OLED) display, or a flexible light-emitting diode (FLED) display. Furthermore, the display screen 302 may be a flat screen or a curved screen, which is not limited in this embodiment of the present application.

[0079] Each display device may be configured with one or more display screens 302. When there are multiple display screens 302, the layout of the multiple display screens is not currently limited. For example, the multiple display screens may be arranged horizontally left and right. In another example, the multiple display screens may be located on the front and back of the display device.

[0080] The display screen 302 includes a display panel and a touch panel. The display panel is used to provide visual output. The touch panel can be a component that supports infrared touch, electromagnetic touch, capacitive touch, or resistive touch. The touch panel can transmit touch data corresponding to the detected touch operation to the processor 301, and the display panel can provide visual output related to the touch operation. Taking an interactive tablet as an example, the display panel can be understood as the display screen used for displaying images in the interactive tablet, and the touch panel can be understood as the touch component used to collect data generated by the user's touch operation.

[0081] Taking infrared touch as an example, the touch panel can be a touch frame. When a user touches the screen with a finger or a stylus (also known as a touch pen, writing pen, smart pen, etc.) or gets close enough to the screen (the distance from the screen is less than the distance between the optical network and the screen), the finger or stylus will block the infrared light it touches. The touch frame can detect the touch position (usually represented by two-dimensional coordinates), the width and height of the touch, and other data based on the blocking of the infrared light. The touch frame can then transmit the detected data to the processor 301.

[0082] Memory 303 can be used to store computer-executable programs for the display device, including instructions. Memory 303 may include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function. The data storage area may store data generated based on the use of the display device.

[0083] The memory 303 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device.

[0084] The communication interface 304 includes a display interface and a data interface.

[0085] Optionally, the display device may further include components such as a camera, an audio device, etc. The embodiment of the present application does not specifically limit the hardware components of the display device.

[0086] Based on the hardware structure diagram of the display device in the embodiment of the present application shown in Figure 5, the software structure block diagram of the display device in the embodiment of the present application is introduced below.

[0087] The display device supports at least one type of operating system, which may be an Android system, a Windows system, a Linux system, an IOS system, etc. Exemplarily, the display device supports the Android system, or supports both the Android system and the Windows system.

[0088] The operating system of the display device can adopt a layered architecture, event-driven architecture, micro-kernel architecture, microservice architecture or cloud architecture. The following uses the Android system with a layered architecture as an example to illustrate the software structure of the display device.

[0089] As shown in Figure 6, the layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some embodiments, the Android system is divided into four layers: application layer, application framework layer, system library layer, and kernel layer, from top to bottom.

[0090] The application layer may include a series of application packages. As shown in FIG6 , the application package may include whiteboard writing software, annotation application software, Bluetooth, music, collaborative assistant and other applications.

[0091] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 6, the application framework layer may include a window manager, resource manager, and view system.

[0092] The window manager manages windowed applications. It can obtain the display size, determine whether a status bar is present, lock the screen, and more. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, and video files. The view system includes visual controls, such as those that display text and images. The view system is used to build applications. The display interface can consist of one or more views. For example, it might include a view that displays text and another that displays images.

[0093] The application layer and application framework layer can run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine can perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0094] The system library can include multiple functional modules. For example: surface manager, media library, touch service, etc. The surface manager is used to manage the display subsystem and provides 2D and 3D layer fusion for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The touch service is a system service of the Android system. The touch service can obtain touch data and determine the subsequent processing logic of the touch data.

[0095] The kernel layer (also known as the Linux kernel layer) is the layer between hardware and software. The kernel layer includes touch drivers, display drivers, camera drivers, audio drivers, sensor drivers, Bluetooth drivers, WIFI drivers, etc.

[0096] In an embodiment, when a display device implements a touch function, a touch driver in the kernel layer acquires touch data collected by the display device's touch panel. Specifically, the touch panel can be connected to a chip running the Android system via USB or other means. At this point, the data collected by the touch panel can be acquired by the touch driver. Subsequently, a touch service in the system library can acquire the touch data from the touch driver and determine the subsequent processing logic for the touch data, such as determining which application should respond to the touch data. The touch service then sends the touch data to the application in the application layer that responds to the touch data, so that the application can respond to the touch data.

[0097] In an embodiment of the present application, when three or more display devices display the same picture, in order to ensure that each display device can control the displayed picture, the display device will have multiple display signal transmission channels and multiple touch signal transmission channels. At this time, the touch service of the display device can also determine whether the touch data needs to be transmitted outward through the touch signal transmission channel, and determine which touch signal transmission channel should be used to transmit the touch data outward.

[0098] Specifically, as shown in Figure 4, the first display device 20 has two video signal transmission channels, and each video signal transmission channel has a corresponding touch signal transmission channel. At this time, the touch service of the first display device 20 can determine which touch signal transmission channel should be selected to transmit touch data. The specific implementation process of the touch service determining which touch signal transmission channel to select to transmit touch data can refer to the relevant description of the touch response method below.

[0099] It should be noted that the first display device 20, the second display device 21 and the third display device 22 can be electronic devices of the same type or different types. Currently, taking the first display device 20 as an interactive tablet as an example, the second display device 21 and the third display device 22 can be interactive tablets or other types of electronic devices.

[0100] When the first display device 20 is an interactive tablet, the layered architecture of the Android system shown in Figure 6 is applicable to both the Android system running on the whole device module and the Android system running on the main control module. In this case, the touch driver and touch service involved in executing the touch response method on the first display device 20 are both located in the Android system running on the whole device module.

[0101] The touch response method provided in the embodiment of the present application is described below in conjunction with the touch response system shown in FIG4 , the hardware structure of the display device shown in FIG5 , and the operating system architecture of the display device shown in FIG6 .

[0102] FIG7 is a flowchart of a touch response method provided by an embodiment of the present application, which is a step flow when the first display device executes the touch response method.

[0103] Referring to FIG7 , the method includes:

[0104] Step 110: When both the first display device and the third display device display the first screen, obtain first touch data, where the first screen is the display screen of the second display device, the first display device is connected to the second display device and the third display device, respectively, and the first touch data is data generated by a touch operation acting on the first display device or the third display device.

[0105] Currently, the second display device is synchronously displaying its own display screen on the first display device and the third display device. In this embodiment, the current display screen of the second display device is recorded as the first screen. The first screen can be the full-screen display screen of the second display device, or a portion of the display screen of the second display device. The first screen can be the running interface of an application installed on the second display device, the desktop of the operating system of the second display device, or the playback interface of a file played on the second display device.

[0106] The second display device transmits a display signal corresponding to the first image to the first display device via a video signal transmission channel between the second display device and the first display device. A display signal refers to a signal used to generate a display image. Based on the display signal, data such as the RGB values ​​of pixels in the display image can be obtained, and the corresponding image can be displayed based on the data. Optionally, the display signal is a video signal. In this case, the second display device obtains a video signal containing the first image by recording the screen, and transmits the video signal to the first display device via the video signal transmission channel.

[0107] In one embodiment, when the second display device transmits a display signal to the first display device, the first display interface is used to receive the display signal corresponding to the first screen sent by the second display device. In this case, the first display interface can be considered as a signal IN interface, which can receive a display signal sent externally. Correspondingly, the third display interface is used to send the display signal corresponding to the first screen externally. In this case, the third display interface can be considered as an OUT signal terminal. It is understandable that in addition to connecting the first display interface and the third display interface through a data transmission line, in some cases, the terminal of the third display interface can also be directly inserted into the first display interface. It is understandable that the format of the display signal needs to adapt to the interface category of the first display interface and the third display interface. For example, when the first display interface and the third display interface are HDMI interfaces, the display signal is an HDMI signal.

[0108] For example, when the second display device detects that a video signal transmission channel has been formed with another display device (currently the first display device), it can transmit the display signal of the current first screen to the other display device. Alternatively, after the second display device forms a video signal transmission channel with the other display device (currently the first display device), the second display device can transmit the display signal of the display screen (currently the first screen) to the other display device after receiving an instruction to send a display signal.

[0109] In the embodiment, the second display device transmits the display signal corresponding to the current first picture in real time as an example for description. In actual application, the second display device may also transmit the display signal corresponding to the changed picture when detecting that the displayed picture has changed.

[0110] The first display device receives a display signal for the first image and drives the display screen based on the display signal to display the first image, thereby displaying the first image on the first display device. At this time, the first display device may consider that the external signal source channel is currently being used, and the image source device corresponding to the external signal source channel is the second display device.

[0111] In one embodiment, when the first display device receives the display signal of the first picture, it also sends the display signal to the third display device so that the third display device also displays the first picture, thereby achieving picture synchronization among the first display device, the second display device, and the third display device.

[0112] Currently, the first display device can receive and forward display signals. When the first display device receives a display signal, if a video signal transmission channel is established with another display device (currently a third display device), the display signal is also sent to the other display device. When the other display device (currently the third display device) receives the display signal sent by the first display device, it can display the corresponding image (currently the first image).

[0113] Optionally, when the first display device sends a display signal to the third display device, it is necessary to first determine that the third display device is not an image source device, that is, the first display device sends a display signal to a non-image source device.

[0114] The first display device sends a display signal corresponding to the first picture to the third display device through a video signal transmission channel between the first display device and the third display device.

[0115] In one embodiment, when the first display device transmits a display signal to the third display device, the second display interface is used to send the display signal corresponding to the first screen to the third display device. In this case, the second display interface can be considered as a signal OUT terminal, which can send display signals outward. Correspondingly, the fourth display interface can be considered as an IN receiving terminal. It is understood that in addition to connecting the second display interface and the fourth display interface through a data transmission line, in some cases, the terminal of the second display interface can also be directly inserted into the fourth display interface.

[0116] Optionally, when there are multiple third display devices, each third display device forms a video signal transmission channel with the first display device. Simultaneously, each third display device can also form a touch signal transmission channel with the first display device. Generally speaking, the number of second display interfaces is equal to the number of first data interfaces to ensure that each third display device can form both a video signal transmission channel and a touch signal transmission channel with the first display device. When a large number of third display devices need to be connected and the first display device does not have sufficient second display interfaces and first data interfaces, the second display interface and first data interface can be expanded using an interface expander.

[0117] It is understood that currently, the first display device receives the display signal sent by the second display device in real time and displays the real-time first image based on the real-time display signal. Simultaneously, the real-time display signal is also transmitted to the third display device, so that the third display device displays the real-time first image. It should be noted that the first display device, the second display device, and the third display device can all display the first image in full screen or in part screen, and there is no current limitation.

[0118] After the first display device, the second display device, and the third display device display the first screen, the user can perform a touch operation on the first screen displayed on the three display devices, and the device that generates the first screen (i.e., the second display device) responds to the user's touch operation on the first screen. When the user performs a touch operation on the first screen displayed on the first display device or the first screen displayed on the third display device, the touch data generated based on the touch operation needs to be transmitted to the second display device for the second display device to respond. In this embodiment, the first display device specifically receives and forwards the touch data.

[0119] Currently, when both the first display device and the third display device are displaying the first image, touch data generated by a touch operation on the first display device or a touch data generated by a touch operation on the third display device is recorded as first touch data. That is, when a touch operation is applied to the first display device, the first touch data is generated by the first display device. When a touch operation is applied to the third display device, the first touch data is generated by the third display device and sent to the first display device.

[0120] The third display device transmits the first touch data via a touch signal transmission channel between the third display device and the first display device. In one embodiment, when the third display device transmits the first touch data to the first display device, the first data interface is used to receive the first touch data. That is, the first data interface of the first display device is used to receive the first touch data from the third display device when the first touch data is data generated by a touch operation acting on the third display device. Correspondingly, the fourth data interface of the third display device is used to send the first touch data to the first display device.

[0121] For example, when the third display device displays the first image, when generating the first touch data, it is necessary to first determine whether the first touch data is for the image transmitted by the current image source device. If so, the first touch data is sent to the corresponding display device (currently the first display device). Otherwise, the third display device responds to the first touch data. The rules for the third display device to determine whether the first touch data is for the image transmitted by the currently used video signal transmission channel (i.e., the external image source device) are not currently limited. For example, refer to the display device's processing rules for touch data in the relevant technology (such as Figure 2 or Figure 3). For another example, the processing rules of the third display device can refer to the processing rules of the first display device in the embodiment.

[0122] It can be understood that the third display device receives display signals through the first display device. The external signal source channel currently in use can be considered the video signal transmission channel between the third display device and the first display device. However, the video signal transmission channel transmits the first image generated by the second display device. In this case, when the third display device determines that the first touch data is for the first image, it sends the first touch data through the touch signal transmission channel between the third display device and the first display device. However, the first touch data is ultimately forwarded to the second display device for response.

[0123] Based on the above content, it can be known that the first touch data obtained by the first display device can be the touch data generated by its own detection or the touch data sent by the third display device. Afterwards, step 120 is executed. Optionally, if the touch operation requires a certain duration, such as the writing time when writing a track, then when the touch operation acts on the third display device, the third display device generates the first touch data in real time, and can determine in real time whether the first touch data is for the screen transmitted by the current image source device, and then when it is determined to be for the screen, the real-time first touch data is sent out. Similarly, when the touch operation acts on the first display device, the first display device generates the first touch data in real time. At this time, the first display device can receive the real-time first touch data and execute step 120.

[0124] It should be noted that in the embodiments of the present application, interaction with the first screen by touch is used as an example. In actual applications, interaction with the first screen can also be performed in other ways. For example, when the display device can be connected to an external device such as a mouse, the first screen can also be controlled by the mouse. In this case, each display device generates corresponding operation data (such as the mouse cursor position and the type of operation (single click, double click, slide, etc.)) based on the mouse input and performs subsequent responses.

[0125] Step 120 : When the first touch data corresponds to the first image, the first touch data is sent to the second display device so that the second display device performs a touch operation corresponding to the first touch data.

[0126] The first touch data corresponds to the first screen, which can be understood as a touch operation corresponding to the first touch data being a touch operation directed to (acting on) the first screen. The first display device determines that the first touch data corresponds to the first screen and sends the first touch data to the second display device. The second display device receives the first touch data and responds to the touch operation corresponding to the first touch data.

[0127] The first display device transmits the first touch data via a touch signal transmission channel between the first display device and the second display device. In one embodiment, when the first display device transmits the first touch data to the second display device, the second data interface is used to externally send the first touch data. That is, the second data interface is used to send the first touch data to the second display device when the first touch data corresponds to the first image. Correspondingly, the third data interface of the second display device is used to receive the first touch data sent by the first display device.

[0128] In one embodiment, the first data interface and the second data interface of the first display device are both USB interfaces. Based on this, the first display device is used as a USB host, and the second and third display devices are used as USB devices. The USB host and USB devices collaborate to enable touch data transmission between the display devices. The USB host is understood as a master device, and the USB device is understood as a slave device. A slave device can accept control from the master device. Currently, when the first display device acts as a master device, it can receive and forward touch data, namely, receive touch data sent by a slave device and determine whether the touch data needs to be transferred to another slave device.

[0129] In one embodiment, the first display device obtains first touch data, first determines whether the first touch data corresponds to the first screen, and if so, sends the first touch data to the second display device that generates the first screen.

[0130] The determination rule for the first display device to determine whether the first touch data corresponds to the first screen can be flexibly set. Currently, only an exemplary description of the determination rule is given.

[0131] Exemplarily, the first display device identifies the reporting device of the first touch data, and the reporting device can be understood as the display device that currently detects the touch operation. Optionally, the touch panels of the display screens in different display devices have different identity information, and the identity information can be the device number of the touch panel or a pre-set identity ID, etc. The identity information is unique. When the touch panel reports the touch data to the touch driver, it also reports the identity information. Afterwards, the identity information is transmitted together with the touch data. At this time, the first display device can determine whether the first touch data is reported by itself or by a third display device based on the identity information corresponding to the first touch data.

[0132] When it is determined that the first touch data is reported by the third display device, the first display device determines that the first touch data is for the currently used signal source channel (that is, the signal source channel corresponding to the display signal sent to the third display device). Since the currently used signal source channel is the video signal transmission channel for transmitting the first picture (that is, the video signal transmission channel between the second display device), the first display device can determine that the first touch data corresponds to the first picture.

[0133] Optionally, there is a situation where multiple image source devices are used at the same time. For example, the first display device displays the images of the second display device and the fourth display device at the same time, and sends the images of the second display device and the fourth display device together to the third display device for display. At this time, in order to distinguish different video signal transmission channels, the identification information of the display device corresponding to the display signal can be transmitted synchronously when the display signal is transmitted, wherein the identification information can be information that can indicate the identity of the device, such as the device identification, device number, etc., and the identification information of different display devices is different. When the display device receives an external image for display, it can synchronously obtain the identification information of the display device corresponding to the external image. Afterwards, after the display device determines the display image targeted by the touch operation, it can transmit the touch data of the touch operation together with the identification information of the display device corresponding to the display image. For example, when the third display device determines that the first touch data corresponds to the first image, it transmits the first touch data and the identification information of the second display device to the first display device. When the first display device parses the identification of the second display device, it determines that the first touch data sent by the third display device corresponds to the first image.

[0134] When it is determined that the first touch data is reported by the first display device, if the image currently displayed on the first display device is the image sent by the image source device, then the first touch data is determined to correspond to the image source device (currently the second display device), i.e., the first touch data is determined to correspond to the first image. Alternatively, if the first display device obtains the touch position in the first touch data and determines that the touch position is within the display area corresponding to the first image, then the first touch data is determined to correspond to the first image. In this case, even if the first display device displays images transmitted by multiple image source devices, it can still distinguish which image source device corresponds to which image the first touch data is directed to.

[0135] Optionally, the operating system of the first display device includes a menu bar (also referred to as a toolbar). The menu bar is a system-level service provided by the operating system. The menu bar includes multiple virtual buttons, each of which can perform a corresponding function. For example, the menu bar includes: a virtual button for switching a foreground application to the background, a virtual button for taking a screenshot, a virtual button for recording the screen, a virtual button for starting an electronic whiteboard, etc. The menu bar can be continuously displayed on the first display device, or the menu bar can be called out or hidden.

[0136] When the first display device displays a menu bar, the menu bar may be superimposed on the first screen. When the touch position in the first touch data is within the display area of ​​the first screen, it may also affect the menu bar superimposed on the first screen. Therefore, the first display device needs to determine whether the first touch data corresponds to the menu bar or the first screen. Optionally, the first display device can determine whether the first touch data is directed to the first screen by identifying the display layer corresponding to the first touch data. It is understood that the content displayed by the display device can be composed of at least one superimposed display layer, each of which can be operated independently. When the first display device displays the menu bar, the menu bar and the first screen have different display layers, and the display layer of the menu bar is at a higher level than the display layer of the first screen. When the first display device receives the first touch data reported by itself, it can determine the display layer information corresponding to the first touch data. The display layer information may include content such as a display layer ID and / or a display layer level. The corresponding display layer can be found based on the display layer information. When the display layer described by the display layer information corresponding to the first touch data is the display layer where the first screen is located, the first touch data is determined to correspond to the first screen. When the display layer described by the display layer information of the first touch data is the display layer where the menu bar is located, the first touch data is determined to correspond to the menu bar. It will be appreciated that if the first display device displays images transmitted by multiple image source devices, each image also has a different display layer, and the display layer information can also be used to distinguish which image source device's image the touch data corresponds to.

[0137] When the first display device does not display the menu bar, the user can call out the menu bar through a touch operation. At this time, the first touch data may also be used to call out the menu bar, so the first display device also needs to determine whether the first touch data corresponds to the first screen or is used to call out the menu bar. In an optional manner, the first display device is pre-set with a trigger condition for calling out the menu bar, such as performing a specific operation in a specific position area of ​​the display screen or performing a specific operation track in the display screen. The first display device receives the first touch data reported by itself and determines whether the first touch data meets the trigger condition for calling out the menu bar. For example, the trigger condition is to perform a specific operation track. At this time, the first display device can obtain the operation track corresponding to the touch operation based on the first touch data, and then determine whether the operation track meets the specific operation track in the trigger condition. If it meets the condition, it is determined that the first touch data is used to call out the menu bar. If it does not meet the condition, it is determined that the first touch data corresponds to the first screen. If the first display device displays images transmitted by multiple image source devices, then when the first display device determines that the operation trajectory corresponding to the first touch data does not meet the specific operation trajectory in the trigger condition, it also needs to determine whether the touch position of the first touch data is within the display area of ​​the first image. If so, it determines that the first touch data corresponds to the first image. In actual applications, the user may also use touch operations to hide the menu bar or instruct the first display device to perform other functions. In this case, the first display device can be set with trigger conditions corresponding to each function and handle it in the same way as described above.

[0138] It is understood that when the first display device determines that the first touch data corresponds to the first screen, it sends the first touch data to the second display device, and then executes step 130. When the first display device determines that it responds to the first touch data (such as calling up a menu bar or operating a menu bar), it does not send the first touch data, and responds to the touch operation corresponding to the first touch data by itself.

[0139] It should be noted that when the touch operation corresponding to the first touch data has a certain duration, the first display device can obtain the first touch data generated in real time, and during the acquisition process, when it is determined that the first touch data corresponds to the first screen, the real-time first touch data is sent to the second display device for response to ensure the timeliness of the response. For example, when the first touch data is used for writing or drawing, the timeliness of the response of writing or drawing can be guaranteed.

[0140] Step 130 : When the second display device performs a touch operation to update the first screen to the second screen, the currently displayed first screen is updated to the second screen, and the third display device is driven to display the second screen.

[0141] For example, the second display device receives the first touch data, can derive a corresponding touch operation based on the first touch data, and respond to the touch operation. Optionally, when receiving the first touch data, the second display device can also first determine whether the first touch data should be responded to by itself or sent to an external image source device. This process is similar to the processing process of the third display device and is not described separately here.

[0142] In one embodiment, an application program that generates the first screen on the second display device responds to a touch operation corresponding to the first touch data. For example, if the touch operation corresponding to the first touch data is a writing operation, the second display device sends the first touch data to the application program that generated the first screen. The application program determines based on the first touch data that the touch operation is for writing and draws a writing trace at a location on the first screen corresponding to the touch location of the first touch data.

[0143] When the second display device responds to the touch operation corresponding to the first touch data, the first screen may change. In this case, the first and third display devices must also synchronously display the changed screens. Currently, when the first screen changes, the changed screen is recorded as the second screen. That is, when the second display device responds to the touch operation corresponding to the first touch data, the first screen is replaced by the second screen.

[0144] Optionally, when the second display device responds to a touch operation corresponding to the first touch data, the screen may change in real time as the touch operation occurs. In this case, the second screen generally refers to each frame when the change occurs and each frame when the change ends. For example, if the touch operation corresponding to the first touch data is a writing operation, then the second screen displayed by the second display device is each frame displayed during the process of drawing the writing trajectory.

[0145] In one embodiment, when the second display device displays the second image, the first display device receives a display signal for the second image. Specifically, the display signal transmitted by the second display device to the first display device changes from a display signal for the first image to a display signal for the second image. It is understood that for the first display device, only the content of the received display signal changes; the image source device does not change.

[0146] The first display device receives the display signal for the second image and displays the second image based on the display signal, replacing the first image with the second image. Simultaneously, the first display device also sends the display signal for the second image to the third display device, which then replaces the first image with the second image based on the display signal. Similarly, for the third display device, only the content of the received display signal changes; the image source device does not change.

[0147] It should be noted that the second display device currently sends the real-time display image to the first display device. The distinction between the first image and the second image is only for a better understanding of the response process of the display device to the touch operation corresponding to the first touch data.

[0148] In actual applications, the second display device can also send the display image to the first display device only when it detects that the display image has changed. At this time, when the display image has not changed, the first display device and the third display device cannot receive the display signal and only display the display image corresponding to the last received display signal.

[0149] It should be noted that currently, display signals and touch data are transmitted using wired video signal transmission channels and touch signal transmission channels. In actual applications, display signals and touch data can also be transmitted using a wireless communication module (such as a WiFi module) in the display device. It is understood that wired transmission can ensure more stable transmission, while wireless transmission can provide greater flexibility in the placement of the display device.

[0150] It should be noted that the first display device and the second display device can also be integrated into one display device. In this case, the operating system corresponding to the first display device is the master system, and the operating system corresponding to the second display device is the slave system. On this basis, when the master system of the display device determines to use the video signal transmission channel of the slave system, it can display the screen of the slave system. In addition, the screen can also be sent to other display devices (currently the third display device for display). When the display device obtains touch data reported by itself or the third display device, it can also determine whether the touch data is for the screen of the slave system, and if it is for the screen of the slave system, the touch data is sent to the slave system for response.

[0151] The touch response method mentioned in the above embodiment is described below as an example. Figure 8 is a first schematic diagram of a three-screen display provided by one embodiment of the present application. Referring to Figure 8, the first display device 20, the second display device 21, and the third display device 22 all display a first screen. The first screen is currently a writing screen and is displayed in full screen on each display device.

[0152] The user writes on the first screen displayed by the third display device 22 using his finger 40. The third display device 22 generates first touch data based on the detected touch operation. Afterwards, when the third display device 22 determines that the first touch data corresponds to the first screen, it sends the first touch data to the first display device 20. The first display device 20 obtains the first touch data, and when it determines that the first touch data corresponds to the first screen, it sends the first touch data to the second display device 21. The second display device 21 receives the first touch data and responds to the touch operation corresponding to the first touch data, i.e., performs a writing operation. At this time, the second display device 21 displays the writing track on the first screen, i.e., the first screen is updated to the second screen. At this time, the first display device and the third display device also update the first screen to the second screen. Figure 9 is a second schematic diagram of a three-screen display provided by an embodiment of the present application. Referring to Figure 9, the user's finger 40 writes on the third display device 22, and the first display device 20, the second display device 21, and the third display device 22 all display the corresponding writing track.

[0153] It can be understood that when the user writes on the first display device 20 , the first display device 20 , the second display device 21 and the third display device 22 also synchronously display the writing trajectory.

[0154] As described above, in the scenario where the first display device and the third display device synchronously display the screen of the second display device, when the first display device obtains the first touch data corresponding to the touch operation acting on itself or the third display device, the first display device can determine which screen the first touch data corresponds to. When it is determined that the first touch data corresponds to the first screen, the first display device is used as a touch data forwarding device to forward the first touch data to the second display device, so that the second display device responds to the first touch data and updates its display screen. In addition, the first display device and the third display device synchronously update the display screen to meet the scenario where the first display device and the third display device synchronously display the screen of the second display device. In other words, regardless of whether the user touches the first display device or the third display device, each display device can synchronously display the screen after the touch response, thereby solving the technical problem in the related art that when three or more display devices display the same screen, the display device displaying a screen that is not generated by itself cannot synchronize the response results of the touch operation to other display devices.

[0155] FIG10 is a flow chart of another touch response method provided by an embodiment of the present application. This touch response method is based on the touch response method shown in FIG7 and exemplarily describes the process of the first display device processing the first touch data. Referring to FIG10 , the touch response method includes:

[0156] Step 510: When both the first display device and the third display device are displaying a first image, first touch data is acquired, where the first image is the image displayed by the second display device, and the first display device is connected to the second display device and the third display device, respectively. The first touch data is data generated by a touch operation on the first display device or the third display device. Execute step 520.

[0157] Step 520: Identify the reporting device of the first touch data. If the reporting device is the third display device, proceed to step 530. If the reporting device is the first display device, proceed to step 540.

[0158] For example, when the first display device acquires the first touch data, it can identify the reporting device of the first touch data. Currently, the reporting device can be the first display device or the third display device.

[0159] In one embodiment, the touch service of the first display device identifies the device that reports the first touch data. Specifically, when a touch operation is performed on the first display device, the touch panel of the first display device detects the touch data and reports the corresponding touch data to the touch driver in the kernel layer. The touch driver then reports the touch data to the touch service. When a touch operation is performed on a third display device, the third display device sends the touch data to the first display device. The touch driver in the kernel layer of the first display device receives the touch data and then reports the touch data to the touch service.

[0160] Optionally, the touch driver of the first display device may first process the touch data (such as performing operations such as packaging), and then report the processed touch data to the touch service.

[0161] After receiving the first touch data reported by the touch driver, the touch service of the first display device identifies the reporting device of the first touch data.

[0162] Optionally, different display devices are distinguished by the identity information of the touch panel. When each display device generates touch data based on the detected touch operation, the identity information of the touch panel is also written into the touch data. Exemplarily, after the first display device obtains the first touch data, it obtains the identity information of the touch panel recorded therein. Afterwards, it is determined whether the identity information is the identity information of its own touch panel. If so, it is determined that the first touch data is reported by the first display device; otherwise, it is determined that the first touch data is sent to the first display device by another display device (currently the third display device).

[0163] It is understandable that when there are multiple third display devices, the first display device can also use the above-mentioned processing rules to identify the reporting device. At this time, although the identity information of the touch panels of each third display device is different, since the touch data of each third display device is responded by the second display device, the first display device does not need to distinguish which third display device reports the touch data.

[0164] Alternatively, after the first display device establishes a touch signal transmission channel with the third display device, the first display device may obtain the identity information of the touch panel of the third display device (e.g., obtaining the identity information through the touch signal transmission channel). After the first display device obtains the first touch data, it obtains the identity information of the touch panel recorded therein. Thereafter, if it is determined that the identity information of the first touch data is consistent with the identity information of the first display device, it is determined that the first touch data was reported by the first display device. If it is determined that the identity information of the first touch data is consistent with the identity information of a third display device, it is determined that the first touch data was sent to the first display device by the third display device.

[0165] Alternatively, different display devices are distinguished by their identification information. This process is similar to distinguishing different display devices by their identification information, except that the touch panel's identification information is replaced with the display device's identification information.

[0166] In actual applications, other methods may be used to determine the reporting device for the first touch data, which is not limited in the embodiment.

[0167] In one embodiment, when the first display device determines that the first touch data is reported by the first display device, step 540 is executed; when the first display device determines that the first touch data is reported by the third display device, step 530 is executed.

[0168] Step 530: If the reporting device is a third display device, then the target information sent by the third display device is obtained. If the target information is identification information of the second display device, then it is determined that the first touch data corresponds to the first screen. Then, step 550 is executed.

[0169] Exemplarily, when the first display device determines that the first touch data is being reported by the third display device, the first display device transmits the first touch data. Currently, the first display device transmits the first touch data via the touch data transmission channel corresponding to the video signal transmission channel currently receiving the display signal. It is understood that the video signal transmission channel currently receiving the display signal corresponds to the second display device, and therefore, the first touch data can be transmitted to the second display device.

[0170] In one embodiment, when the third display device transmits the first touch data, it also transmits target information. The target information is identification information of the display device that generated the image corresponding to the first touch data. Generally speaking, touch data and target information are transmitted together, that is, when the display device receives the touch data, it also receives the target information simultaneously.

[0171] Optionally, when the second display device transmits the display signal for the first screen, it also transmits its own identification information, which can be transmitted via the video signal transmission channel. The first display device forwards the display signal for the first screen and the identification information of the second display device to the third display device. In this case, both the first and third display devices can clearly identify the identification information of the second display device corresponding to the first screen. This means that the identification information of the first screen and the second display device correspond to each other.

[0172] When the third display device determines that the first touch data corresponds to the first screen, it uses the identification information corresponding to the first screen as the target information, and then sends the target information and the first touch data outward through the touch signal transmission channel.

[0173] When the first display device identifies that the reporting device is a third display device, it also obtains the target information sent along with the first touch data. It then identifies the identification information of the display device to which the target information refers. It is understood that when the first display device receives the display signal of the first screen, it simultaneously receives the identification information of the second display device. The first display device can then save this identification information so that, after obtaining the target information, it can identify the identification information that matches the target information. After the first display device determines that the target information is consistent with the identification information of the second display device, it determines that the first touch data is directed to the display screen of the second display device, that is, that the first touch data corresponds to the first screen. Then, step 550 is executed.

[0174] Optionally, when the first display device disconnects the video signal transmission channel from the second display device, the first display device may delete the currently stored identification information of the second display device.

[0175] It is understandable that there is also a situation where the first display device generates a display screen and drives the third display device to display it. At this time, the first display device also sends its own identification information together with the display signal of the generated display screen to the third display device. After the third display device displays the screen, if it receives a touch operation corresponding to the screen, it uses the identification information of the first display device as the target information and sends it to the first display device together with the touch data of the touch operation for the first display device to respond.

[0176] It is understandable that using the identification information of the display device as the target information is only an optional method. In actual applications, other information can also be used as the target information, as long as it is satisfied that the first touch data can be determined to correspond to the first screen through the target information.

[0177] Step 540: If the reporting device is the first display device, determine the operation information corresponding to the first touch data, and if the operation information meets a preset condition, determine that the first touch data corresponds to the first screen. Execute step 550.

[0178] When the first touch data is reported by the first display device, the first display device determines whether it should respond to the corresponding touch operation itself or the display device corresponding to the video signal transmission channel currently receiving the display signal should respond to the corresponding touch operation. Exemplarily, when the touch service of the first display device determines that the first touch data was reported by itself, it determines the operation information corresponding to the first touch data. Operation information is information related to the operation determined during the execution of the touch operation. Currently, operation information includes touch position information, display layer information, and / or touch trajectory information. After obtaining the operation information, it determines whether the operation information meets preset conditions. Preset conditions are pre-set conditions used to identify the display screen targeted by the touch operation. Preset conditions can vary for different display screens in the first display device. Furthermore, the same display screen can have multiple preset conditions, and the operation information required for each preset condition can vary. During application, at least one of the preset conditions can be selected as the currently used preset condition. In this embodiment, the preset condition is taken as the preset condition corresponding to the first screen. If the operation information meets the preset condition corresponding to the first screen, the first display device determines that the first touch data corresponds to the first screen and executes step 550.

[0179] At present, in order to better understand the technical solution, two preset conditions are used as an example to describe how to determine whether the first touch data corresponds to the first screen. At this time, this step may include solution 1 or solution 2:

[0180] Solution 1: The operation information is the touch track information and touch position information corresponding to the first touch data. If the touch position information is within the display area corresponding to the first screen and the touch track information is inconsistent with the preset touch track information, it is determined that the first touch operation corresponds to the first screen.

[0181] Currently, operation information includes touch trajectory information and touch position information. Touch position information refers to the touch position when a touch operation is performed. When the touch panel of the first display device detects a touch operation, the touch position of the touch operation can be obtained. Touch trajectory information can include the trajectory, direction, and / or distance of the touch operation obtained based on the touch position information.

[0182] The touch service of the first display device can obtain touch position information in the first touch data based on the first touch data acquired in real time, and can obtain current touch track information according to the currently received touch position information and the corresponding detection time.

[0183] The first display device compares the touch trajectory information with preset touch trajectory information. The touch operation corresponding to the preset touch trajectory information is used to trigger a specific function executable by the first display device. The specific function can be: calling up a menu bar, hiding a menu bar, etc. Each specific function corresponds to a preset touch trajectory information. Generally speaking, the response priority of the specific function is higher than the response priority of the first screen.

[0184] When the touch track information is consistent with the preset touch track information, it indicates that the touch operation corresponding to the first touch data is used to enable the first display device to perform the corresponding specific function. At this time, the touch service of the first display device determines that the first touch data does not correspond to the first screen.

[0185] When the touch track information is inconsistent with the preset touch track information, it indicates that the touch operation corresponding to the first touch data does not trigger a specific function. At this time, the touch service of the first display device determines that the first touch data corresponds to the first screen.

[0186] In one embodiment, the first display device may display the screens of multiple image source devices, that is, in addition to the first screen, the first display device may also display other screens. Alternatively, when the first display device does not display the first screen in full screen, it may also display part of its own running screen. At this time, the first touch data may also correspond to other screens. Therefore, the touch service of the first display device also determines whether the touch position information is located within the display area corresponding to the first screen. For example, based on the touch position information, the position of the corresponding touch operation in the display screen is determined, and then, it is determined whether the position is within the area of ​​the first screen displayed on the display screen.

[0187] When the touch position information is located within the display area corresponding to the first screen and the touch trajectory information is inconsistent with the preset touch trajectory information, it means that the touch operation corresponding to the first touch data is performed within the display area corresponding to the first screen and does not trigger a specific function with a higher response priority. Therefore, it is determined that the first touch data corresponds to the first screen.

[0188] When the touch position information is not within the display area corresponding to the first screen and the touch trajectory information is inconsistent with the preset touch trajectory information, it means that the touch operation corresponding to the first touch data is not performed within the display area corresponding to the first screen and no specific function with a higher response priority is triggered. At this time, the subsequent response method can be determined based on the display content corresponding to the touch position information. For example, when the display content corresponding to the touch position information is the screen of another image source device, it can be determined that the first touch data corresponds to this screen, that is, the other image source device responds to the corresponding touch operation. For another example, when the display content corresponding to the touch position information is the operating screen generated by the first display device itself, it can be determined that the first touch data corresponds to the operating screen generated by itself, that is, the first display device responds to the corresponding touch operation.

[0189] When the touch track information is consistent with the preset track information, it is determined that the first display device responds to the corresponding touch operation.

[0190] It should be noted that the touch operation corresponding to the preset touch trajectory information requires a shorter operation time, that is, the user can quickly perform the touch operation corresponding to the preset touch trajectory information to avoid the required touch operation time being too long, resulting in the inability to timely determine whether it corresponds to the first screen, thereby affecting the timeliness of the touch operation response.

[0191] Based on the foregoing, it can be seen that the preset conditions for Solution 1 are that the touch trajectory information is inconsistent with the preset touch trajectory information and that the touch position information is located within the display area corresponding to the first screen. It is understood that in actual applications, the operation information can also be other types of information, and accordingly, the preset conditions can also be other content. The embodiments only provide an exemplary description of the operation information and the corresponding preset conditions.

[0192] Solution 2: The operation information is the display layer information corresponding to the first touch data. If the display layer information is the display layer information of the first screen, it is determined that the first touch operation corresponds to the first screen.

[0193] The display layer information refers to the information corresponding to the topmost display layer in the display screen contacted by the touch operation corresponding to the first touch data. Different display layers correspond to different display layer information, that is, the display layer information can be understood as the identity of the display layer. Optionally, the first display device sets the display layer information corresponding to each display layer added to the display screen.

[0194] Currently, if multiple display layers are superimposed during display on the first display device, a touch operation applied to the superimposed display area targets the screen corresponding to the topmost display layer. In this case, the display layer information corresponding to the touch operation is the information for the topmost display layer. Based on this, after the touch service of the first display device obtains the first touch data, it determines the touch location of the first touch data and, in turn, determines the display layer information corresponding to the content displayed at the location corresponding to the touch location on the display screen. This display layer information is the display layer information currently obtained based on the first touch data. Subsequently, if the display layer information is the display layer information for the first screen, it indicates that the corresponding touch operation is applied to the first screen, and therefore, the first touch data is determined to correspond to the first screen. If the display layer information is not the display layer information for the first screen, it is determined that the first touch data does not correspond to the first screen. In this case, if the display layer information of the first touch data is the display layer information corresponding to the screen of another image source device, it is determined that the first touch data corresponds to the screen of the other image source device, meaning that the other image source device responded to the corresponding touch operation. If the display layer information of the first touch data is the display layer information of the running screen generated by the first display device itself, it is determined that the first touch data corresponds to the running screen generated by itself, that is, the first display device responds to the corresponding touch operation.

[0195] Optionally, during the process of acquiring the first touch data, the first display device determines in real time the display layer information corresponding to the current first touch data and performs a judgment to determine whether the real-time first touch data corresponds to the first screen.

[0196] Based on the above content, it can be seen that the preset condition of the second solution is that the display layer information corresponding to the first touch data is the display layer information of the first screen. The operation information is the display layer information.

[0197] It is understood that in actual applications, Solution 1 and Solution 2 can be applied simultaneously. For example, when the first display device determines that the display layer information corresponding to the first touch data is the display layer information of the first screen, it further determines the touch trajectory information corresponding to the first touch data. When the touch trajectory information is inconsistent with the preset trajectory information, it determines that the first touch data corresponds to the first screen. When the touch trajectory information is consistent with the preset trajectory information, it determines that the first touch data is used to trigger a preset function with a higher response level.

[0198] Based on the above content, it can be seen that during the application process, there is a situation where the first display device responds to the first touch data. In this case, one embodiment of the present application further includes: when it is determined that the first display device responds to the touch operation corresponding to the first touch data, responding to the touch operation corresponding to the first touch data.

[0199] Exemplarily, when the touch service of the first display device determines that the first display device is to respond to a touch operation corresponding to the first touch data, the touch service reports the first touch data to an application currently running on the first display device (i.e., an application that needs to respond to the touch operation). The data transmission process during the reporting is not currently limited. After receiving the first touch data, the application responds to the corresponding touch operation.

[0200] In some scenarios, when the first display device responds to touch data, it also displays a third image. The first display device continues to receive the first image from the second display device and sends the first image to the third display device for display. Currently, the image displayed by the first display device after responding to the touch operation corresponding to the first touch data is recorded as the third image.

[0201] Optionally, the first display device may display a third image on top of an already displayed image (e.g., the first image). The display area of ​​the third image on the first display device may or may not overlap with the display area of ​​the first image on the first display device. This embodiment does not specifically limit the display areas of the third image and the already displayed image on the first display device.

[0202] For example, the touch operation corresponding to the first touch data is used to call out a menu bar, and the display position of the menu bar is located in the display area of ​​the first screen. When the first display device responds to the touch operation, a new display layer is added, and this display layer is located above the display layer where the first screen is located. Then, the menu bar is displayed in the newly added display layer to facilitate further operations by the user. In this case, the third screen can be understood as the screen after the menu bar is superimposed on the first screen.

[0203] For another example, the touch operation corresponding to the first touch data is used to write the letter B on the screen of the first display device itself (such as screen A). When the first display device responds to the touch operation, it displays a third screen, which is the screen after the letter B is written on screen A.

[0204] Optionally, when the first display device responds to the touch operation corresponding to the first touch data, the first display device can still continue to receive the display signal corresponding to the first picture, and at the same time, the first display device still transmits the display signal corresponding to the first picture to the third display device for display.

[0205] In some cases, the first touch data obtained by the first display device contains both touch data reported by the first display device and touch data reported by a third display device. In this case, upon receiving the first touch data reported by the first display device and the first touch data reported by the third display device, the touch driver of the first display device packages the two types of first touch data and sends them to the touch service. The touch service can then determine the first touch data reported by the first display device and the first touch data reported by the third display device based on the identity information recorded in the first touch data.

[0206] In one optional approach, the touch service of the first display device extracts the first touch data of the third display device from the received first touch data. Specifically, the touch service reads the first touch data reported by the third display device from an array and places it into a new array, and then performs subsequent processing on the first touch data reported by the third display device. Alternatively, the touch service may obtain the first touch data reported by the first display device and perform subsequent processing on the first touch data reported by the first display device.

[0207] Optionally, when the first display device determines that the first touch data reported by the third display device and the first touch data reported by the first display device are both for the first screen, the two types of first touch data can be sent together to the second display device, so that the second display device responds to the touch operations corresponding to the two types of first touch data respectively. Alternatively, the first display device sends the first touch data of the third display device to the second display device, so that the second display device responds to the touch operations corresponding to the first touch data. In this case, the response priority of the third display device is higher than the response priority of the first display device. Alternatively, the first display device determines the first touch data received first, such as when the first touch data of the first display device is received first, and sends the first touch data of the first display device to the second display device for response. When the first touch data of the third display device is received first, the first touch data of the third display device is sent to the second display device.

[0208] Step 550 : When the first touch data corresponds to the first image, the first touch data is sent to the second display device so that the second display device performs a touch operation corresponding to the first touch data.

[0209] Currently, the touch service of the first display device sends the first touch data to the second display device.

[0210] Step 560: When the second display device performs a touch operation to update the first screen to the second screen, the currently displayed first screen is updated to the second screen, and the third display device is driven to display the second screen.

[0211] The touch response method provided in the aforementioned embodiment is described below by way of example.

[0212] FIG11 is a flow chart of transmitting first touch data in a first display device according to an embodiment of the present application.

[0213] Referring to Figure 11, the first display device is installed with the Android system. The touch driver of the first display device can receive the first touch data sent by the third display device, and can also receive the first touch data reported by the first display device. Afterwards, the touch driver packages the received first touch data and sends it to the touch service. The touch service identifies the reporting device of the first touch data. When the reporting device is the first display device, the touch service determines that the operation information of the first touch data meets the preset conditions, determines that the first touch data corresponds to the first screen, and at this time, sends the first touch data to the second display device. When it is determined that the first touch data does not correspond to the first screen and should respond to the corresponding touch operation by itself, the first touch data is sent to the application (also recorded as application) in the Android system, and the application responds. When the reporting device is the third display device, the touch service determines that the target information of the first touch data is the identification information of the second display device, determines that the first touch data corresponds to the first screen, and at this time, sends the first touch data to the second display device.

[0214] For example, FIG12 is a third schematic diagram of a three-screen display provided in an embodiment of the present application.

[0215] 12 , the first display device 20, the second display device 21, and the third display device 22 all display a first screen. The first screen is currently a writing screen and is displayed full screen on each display device. A user touches the first screen displayed on the first display device 20 with a finger 40.

[0216] When the first display device determines that the first touch data is reported by the first display device and the first touch data corresponds to the first screen, the first touch data is sent to the second display device 21. The second display device 21 obtains the first touch data and responds to the touch operation corresponding to the first touch data. Currently, the touch operation is a writing operation. At this time, the second display device 21 displays the writing trajectory, and the first display device and the third display device also display the writing trajectory based on the display signal of the second display device. Figure 13 is a fourth schematic diagram of a three-screen display provided by an embodiment of the present application. Referring to Figure 13, the user's finger 40 writes in the first display device 20, and the first display device 20, the second display device 21 and the third display device 22 all display the corresponding writing trajectory.

[0217] Alternatively, when the first display device determines that the first touch data is reported by the first display device and does not correspond to the first screen and should be responded to by itself, the first touch data is sent to an application in the Android system. The application determines that the touch operation corresponding to the first touch data is used to call out the menu bar. After responding to the touch operation, the first display device displays the menu bar. Figure 14 is a fifth schematic diagram of a three-screen display provided by an embodiment of the present application. Referring to Figure 14, when the user's finger 40 calls out the menu bar 211 on the first display device 20, the first display device 20 displays the screen in which the menu bar 211 and the first screen are superimposed, and the second display device 21 and the third display device 22 still display the first screen.

[0218] As described above, when both the first display device and the third display device are displaying the first screen of the second display device, when the first display device receives the first touch data, it identifies the reporting device of the first touch data and, if the reporting device is the third display device, determines whether the first touch data is directed to the first screen based on the target information. If the reporting device is the first display device, it determines whether the first touch data is directed to the first screen based on the operation information. That is, the touch data reported by different reporting devices has different processing logic, which can ensure the accuracy of determining whether the first touch data corresponds to the first screen. Furthermore, when the first display device reports the first touch data, there are multiple options for determining whether the first touch data is directed to the first screen, making the determination method more flexible and applicable to different application scenarios. Furthermore, when the first display device responds to the touch operation corresponding to the first touch data, the first display device still drives the third display device to display the first screen, thus ensuring the display synchronization of each display device.

[0219] An embodiment of the present application further provides a touch response device, which is applied to a first display device. FIG15 is a schematic structural diagram of a touch response device provided by an embodiment of the present application. Referring to FIG15 , the touch response device includes: an acquisition unit 601 , a sending unit 602 , and a processing unit 603 .

[0220] Among them, the acquisition unit 601 is used to obtain first touch data when both the first display device and the third display device display the first screen, the first screen is the display screen of the second display device, the first display device is connected to the second display device and the third display device, respectively, and the first touch data is data generated by a touch operation acting on the first display device or the third display device.

[0221] The sending unit 602 is configured to send the first touch data to the second display device when the first touch data corresponds to the first screen, so that the second display device can perform the touch operation corresponding to the first touch data.

[0222] The processing unit 603 is configured to update the currently displayed first screen to the second screen when the second display device performs a touch operation to update the first screen to the second screen, and drive the third display device to display the second screen.

[0223] In one embodiment of the present application, the apparatus further includes: an identification unit, a first determination unit, and a second determination unit.

[0224] The identification unit is configured to identify a reporting device for the first touch data.

[0225] The first determining unit is configured to obtain target information sent by the third display device if the reporting device is the third display device, and determine that the first touch data corresponds to the first screen if the target information is identification information of the second display device.

[0226] The second determining unit is configured to determine operation information corresponding to the first touch data if the reporting device is the first display device, and determine that the first touch data corresponds to the first screen if the operation information satisfies a preset condition.

[0227] In one embodiment of the present application, when the operation information is touch trajectory information and touch position information corresponding to the first touch data, the second determination unit is specifically used to: if the reporting device is a first display device, determine the touch trajectory information and touch position information corresponding to the first touch data; if the touch position information is located in the display area corresponding to the first screen and the touch trajectory information is inconsistent with the preset touch trajectory information, determine that the first touch data corresponds to the first screen.

[0228] Alternatively, the operation information is the display layer information corresponding to the first touch data, and the second determination unit is specifically used to: if the reporting device is the first display device, determine the touch trajectory information and touch position information corresponding to the first touch data; if the display layer information is the display layer information of the first screen, determine that the first touch data corresponds to the first screen.

[0229] In one embodiment of the present application, the touch response apparatus further includes: a response unit, configured to respond to a touch operation when the touch operation corresponding to the first touch data needs to be responded to by the first display device.

[0230] In one embodiment of the present application, the touch response device further includes: an updating unit and a continuous sending unit.

[0231] The updating unit is configured to display a third image in response to a touch operation corresponding to the first touch data.

[0232] The continuous sending unit is used to continuously receive the first picture sent by the second display device, and send the first picture to the third display device for display.

[0233] In one embodiment of the present application, the first display device includes a first data interface and a second data interface, the first data interface is used to receive the first touch data from the third display device when the first touch data is data generated by a touch operation acting on the third display device, and the second data interface is used to send the first touch data to the second display device when the first touch data corresponds to the first screen.

[0234] In one embodiment of the present application, the first data interface and the second data interface are both USB interfaces.

[0235] In one embodiment of the present application, the first display device includes a first display interface and a second display interface, the first display interface is used to receive a display signal corresponding to the first screen sent by the second display device, and the second display interface is used to send a display signal corresponding to the first screen to a third display device.

[0236] A touch response apparatus provided in one embodiment of the present application is included in a first display device and can be used to execute the touch response method in any of the above embodiments, and has corresponding functions and beneficial effects.

[0237] It is worth noting that in the embodiment of the above-mentioned touch response device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the various functional units are only for the convenience of distinguishing each other and are not used to limit the scope of protection of the present invention.

[0238] One embodiment of the present application further provides a display device. A schematic diagram of the structure of the display device can be found in Figure 5 . Currently, the display device shown in Figure 5 may be a first display device. As shown in Figure 5 , the first display device includes a processor 301, a display screen 302, a memory 303, and a communication interface 304. The processor 301, display screen 302, memory 303, and communication interface 304 are connected via a communication bus 305. The number of processors 301 may be one or more, but Figure 5 shows a single processor 301 as an example.

[0239] For the related descriptions of the processor 301 , the display screen 302 , the memory 303 , and the communication interface 304 , reference may be made to the aforementioned descriptions.

[0240] Among them, the communication interface 304 includes multiple display interfaces (including at least a first display interface and a second display interface), and is used to transmit display signals, such as the first display interface is used to receive the display signal corresponding to the first screen sent by the second display device, and the second display interface is used to send the display signal corresponding to the first screen to the third display device.

[0241] The communication interface 304 includes multiple data interfaces (including at least a first data interface and a second data interface), and is used to transmit touch data. For example, the first data interface is used to receive first touch data from a third display device when the first touch data is data generated by a touch operation acting on the third display device, and the second data interface is used to send the first touch data to the second display device when the first touch data corresponds to the first screen.

[0242] The above-mentioned first display device also includes a touch response device, which can be used to execute the touch response method and has corresponding functions and beneficial effects.

[0243] It is understood that the second display device and the third display device may also adopt the structure shown in Figure 5. In some cases, the second display device and the third display device may also be simplified to include a microcontroller unit (MCU) and a display screen, and the corresponding functions are realized by the MCU.

[0244] One embodiment of the present application further provides a touch response system, which includes a first display device, a second display device, and a third display device. The touch response system is also used to execute the touch response method provided in any of the above embodiments, and specifically provides corresponding functions and beneficial effects.

[0245] One embodiment of the present application also provides a storage medium containing computer-executable instructions, which, when executed by a display device (currently a first display device), are used to perform relevant operations in the touch response method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0246] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0247] Therefore, the application can adopt the form of complete hardware embodiment, complete software embodiment, or the embodiment in combination with software and hardware. Moreover, the application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The application is described with reference to the flow chart and / or block diagram of the method, equipment (system) and computer program product according to the embodiment of the application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instruction executed by the processor of the computer or other programmable data processing device produces a device for realizing the function specified in one flow chart flow chart or multiple flow processes and / or one block or multiple blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device that implements the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram. These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram.

[0248] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-permanent storage in a computer-readable medium, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0249] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store signals. Signals can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store signals that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0250] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0251] Note that the above are only preferred embodiments of the present application and the technical principles employed. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present application. The scope of the present application is determined by the scope of the appended claims.

Claims

1. A touch response method, applied to a first display device, wherein: include: When both the first display device and the third display device display a first picture, acquiring first touch data, the first picture is a display picture of the second display device, the first display device is connected to the second display device and the third display device, respectively, and the first touch data is data generated by a touch operation acting on the first display device or the third display device; When the first touch data corresponds to the first picture, sending the first touch data to the second display device so that the second display device performs a touch operation corresponding to the first touch data; When the second display device executes the touch operation to update the first picture to the second picture, the first picture currently displayed is updated to the second picture, and the third display device is driven to display the second picture.

2. The touch response method according to claim 1, wherein: The method further comprises: Identify a reporting device for the first touch data; If the reporting device is the third display device, then acquiring target information sent by the third display device; if the target information is identification information of the second display device, then determining that the first touch data corresponds to the first screen; If the reporting device is the first display device, operation information corresponding to the first touch data is determined; if the operation information meets a preset condition, it is determined that the first touch data corresponds to the first screen.

3. The touch response method according to claim 2, wherein: If the operation information satisfies a preset condition, determining that the first touch data corresponds to the first screen includes: The operation information is touch track information and touch position information corresponding to the first touch data. If the touch position information is located in a display area corresponding to the first screen and the touch track information is inconsistent with preset touch track information, it is determined that the first touch data corresponds to the first screen. or, The operation information is display layer information corresponding to the first touch data. If the display layer information is display layer information of a first picture, it is determined that the first touch data corresponds to the first picture.

4. The touch response method according to any one of claims 1 to 3, wherein: The method further comprises: Determine that the first display device responds to a touch operation corresponding to the first touch control data; Respond to the touch operation.

5. The touch response method according to claim 4, wherein: The method further comprises: In response to the touch operation corresponding to the first touch data, displaying a third picture; The first picture is continuously received from the second display device, and the first picture is sent to the third display device for display.

6. The touch response method according to claim 1, wherein: The first display device includes a first data interface and a second data interface; The first touch data is data generated by a touch operation acting on the third display device, and the acquiring of the first touch data includes: receiving the first touch data from the third display device through the first data interface; The sending the first touch data to the second display device includes: The first touch data is sent to the second display device through the second data interface.

7. The touch response method according to claim 6, wherein: The first data interface and the second data interface are both USB interfaces.

8. The touch response method according to claim 1, wherein: The first display device includes a first display interface and a second display interface, the first display interface is used to receive a display signal corresponding to a first picture sent by the second display device, and the second display interface is used to send a display signal corresponding to the first picture to the third display device.

9. A touch response device, applied to a first display device, wherein: include: an acquisition unit, configured to acquire first touch data when both the first display device and the third display device display a first picture, the first picture being a display picture of the second display device, the first display device being connected to the second display device and the third display device, respectively, and the first touch data being data generated by a touch operation acting on the first display device or the third display device; a sending unit, configured to send the first touch data to the second display device when the first touch data corresponds to the first picture, so that the second display device performs a touch operation corresponding to the first touch data; The processing unit is configured to update the currently displayed first picture to the second picture when the second display device performs the touch operation to update the first picture to the second picture, and drive the third display device to display the second picture.

10. A display device, wherein: include: one or more processors; A memory for storing one or more programs; A display screen, used for displaying according to the instructions of the processor; Multiple data interfaces for transmitting touch data; Multiple display interfaces, used for transmitting display signals corresponding to the display images; When the one or more programs are executed by the one or more processors, the one or more processors implement the touch response method as described in any one of claims 1 to 8.

11. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program runs on a display device, the display device implements the touch response method as described in any one of claims 1 to 8.

Images