Master control display device, controlled display device and reverse screen transmission method

Abstract

The embodiment of the invention provides a master control display device, a controlled display device and a reverse screen transmission method, the master control display device responds to a touch screen operation, displays a first local pattern on a first display interface and generates operation information corresponding to the touch screen operation, and the first local pattern comprises a sub-local pattern generated based on the touch screen operation; controlling the communicator to send the operation information to the controlled display equipment; controlling the communicator to receive image information which is sent by the controlled display equipment and is obtained based on the operation information; deleting at least a part of sub-local patterns contained in the first local pattern based on the image information to obtain remaining sub-local patterns; and displaying a second local pattern on the first display interface, wherein the second local pattern comprises a sub-pattern contained in the image information and the remaining sub-local patterns of the first local pattern. According to the embodiment of the invention, a user feels that the contents displayed on the master control display equipment and the controlled display equipment are synchronous and consistent, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a master display device, a slave display device and a reverse screen transmission method. BACKGROUND

[0002] In remote collaboration, intelligent education, conference systems and other scenarios, it is often necessary to synchronize the picture of a slave display device to a master display device. However, the slave display device usually lacks touch control function or has poor touch control experience, so the master display device becomes a natural choice as an interactive entry for a user to perform real-time drawing through the touch screen of the master display device. During reverse screen transmission, the slave display device may not support touch screen or support touch screen but is inconvenient to operate, and thus drawing operation needs to be performed on the master display device.

[0003] However, the content displayed on the display interface of the master display device and the slave display device will be consistent only after the master display device performs drawing operation, and the slave display device performs drawing, data acquisition and encoding, network transmission data, and decoding and display of the master display device, which takes a long time and causes the user to feel perceptible drawing operation delay, thereby greatly reducing the user experience. SUMMARY

[0004] To solve the above problems, the present application provides a master display device, a slave display device and a reverse screen transmission method, so that the user feels that the content displayed on the first display interface of the master display device and the second display interface of the slave display device is synchronized and consistent, thereby improving the user experience. Specifically:

[0005] The first aspect of the present application provides a master display device, comprising:

[0006] a display configured to display a first display interface;

[0007] a communicator configured to communicate with a slave display device;

[0008] a controller configured to:

[0009] in response to a touch screen operation, display a first local pattern on the first display interface, and generate operation information corresponding to the touch screen operation, the first local pattern containing a sub-local pattern generated based on the touch screen operation;

[0010] control the communicator to send the operation information to the slave display device;

[0011] control the communicator to receive image information obtained based on the operation information and sent by the slave display device;

[0012] delete at least one part of the sub-local patterns contained in the first local pattern based on the image information, to obtain remaining sub-local patterns;

[0013] display a second local pattern in the first display interface, the second local pattern containing the sub-pattern contained in the image information and the remaining sub-local patterns of the first local pattern.

[0014] The above technical solution has the following beneficial effects or advantages: in response to a touch screen operation, a first local pattern is displayed in a first display interface, image information obtained based on operation information is received from a controlled display device, at least one part of the sub-local patterns contained in the first local pattern is deleted based on the image information before the image information is displayed in the first display interface, to obtain remaining sub-local patterns, and a second local pattern is displayed in the first display interface; the above technical solution can make the user see that the second local pattern displayed in the first display interface is synchronized and consistent with the return pattern displayed in the second display interface, so that the user feels the "0 delay" in vision, and deleting at least one part of the sub-local patterns contained in the first local pattern based on the image information before the image information is displayed in the first display interface can avoid the problem of repeated stroke stacking in the first display interface, thereby improving the user experience.

[0015] In some embodiments, the image information includes at least one sub-image information and a timestamp of each sub-image information;

[0016] The controller is further configured to:

[0017] control the communicator to receive the timestamp of the sub-local pattern sent by the controlled display device.

[0018] The above technical solution has the following beneficial effects or advantages: the master display device can determine the timestamp corresponding to each sub-local pattern.

[0019] In some embodiments, the controller performs the operation of deleting the at least one part of the sub-local patterns contained in the first local pattern based on the image information, to obtain the remaining sub-local patterns, and is specifically configured to:

[0020] for each sub-image information, delete the at least one part of the sub-local patterns contained in the first local pattern based on the timestamp of the sub-image information, to obtain the remaining sub-local patterns; the timestamp of each sub-local pattern in the remaining sub-local patterns is later than or equal to the timestamp of the sub-image information.

[0021] The technical scheme has the following beneficial effects or advantages: before displaying the image information on the first display interface, at least one part of the sub-local patterns contained in the first local pattern is deleted based on the image information, and the remaining sub-pattem is obtained, thereby avoiding the problem of stroke stacking, and improving the user experience.

[0022] In some embodiments, the sub-image information includes a feedback pattern.

[0023] The control of the communicator receiving the image information obtained based on the operation information sent by the controlled display device is specifically configured as:

[0024] The image information obtained based on the feedback pattern sent by the controlled display device is received; the feedback pattern includes a sub-feedback pattern generated by the controlled display device based on the operation information; and the sub-feedback pattern corresponds to the sub-local pattern one by one.

[0025] The encoding information obtained based on the image information sent by the controlled display device is received.

[0026] The technical scheme has the following beneficial effects or advantages: through the encoding information, the master display device obtains the pattern rendered based on the operation information.

[0027] In some embodiments, the operation information includes coordinate information and an identifier generated based on the touch screen operation.

[0028] The controller performs control of the communicator sending the operation information to the controlled display device, and is specifically configured as:

[0029] The coordinate information and the identifier are sent to the controlled display device.

[0030] The technical scheme has the following beneficial effects or advantages: through the identifier, the trigger operation corresponding to the identifier and the sub-local pattern can be identified.

[0031] The second aspect of the embodiments of the application provides a controlled display device, which comprises:

[0032] A display configured to display a second display interface;

[0033] A communicator configured to communicate with a master display device;

[0034] A controller configured to:

[0035] Control the communicator to receive operation information sent by the master display device;

[0036] Display a feedback pattern on the second display interface based on the operation information; the feedback pattern includes a sub-feedback pattern generated based on the operation information; and

[0037] recording the return pattern displayed in the second display interface to obtain image information;

[0038] controlling the communicator to send the image information to the master display device.

[0039] The above technical solution has the following beneficial effects or advantages: based on the operation information, the return pattern is displayed in the second display interface, so that the user can feel that the second local pattern displayed in the first display interface is synchronized and consistent with the return pattern displayed in the second display interface, the perceptual delay of the user is reduced, and the user experience is greatly improved.

[0040] In some embodiments, the image information includes at least one sub-image information and a timestamp of each sub-image information;

[0041] The controller is further configured to:

[0042] send the timestamp of the sub-local pattern to the master display device.

[0043] The above technical solution has the following beneficial effects or advantages: before displaying a sub-image information, it can be determined whether the sub-local pattern needs to be deleted through the timestamp of the sub-local pattern, so as to avoid the problem of stroke stacking caused by repeated display of strokes.

[0044] In some embodiments, before the controller controls the communicator to receive the operation information sent by the master display device, the controller is further configured to:

[0045] in response to the reverse screen transmission instruction, open a function for recording the return pattern;

[0046] every other first preset interval, obtain one sub-image information.

[0047] The above technical solution has the following beneficial effects or advantages: a plurality of sub-image information can be obtained, so as to facilitate subsequent encoding of the plurality of sub-image information to obtain encoding information.

[0048] The third aspect of the embodiment of the application provides a reverse screen transmission method, comprising:

[0049] in response to a touch screen operation, displaying a first local pattern in a first display interface, and generating operation information corresponding to the touch screen operation, the first local pattern including a sub-local pattern generated based on the touch screen operation;

[0050] sending the operation information to a controlled display device;

[0051] receiving image information obtained by the controlled display device based on the operation information;

[0052] delete at least one part of the sub-local patterns contained in the first local pattern based on the image information, to obtain remaining sub-local patterns;

[0053] display a second local pattern in the first display interface, wherein the second local pattern contains the sub-pattern contained in the image information and the remaining sub-local patterns of the first local pattern.

[0054] The above technical solution has the following beneficial effects or advantages: in response to a touch screen operation, a first local pattern is displayed in a first display interface, image information obtained based on operation information sent by a controlled display device is received, at least one part of the sub-local patterns contained in the first local pattern is deleted based on the image information before the image information is displayed in the first display interface, to obtain remaining sub-local patterns, and a second local pattern is displayed in the first display interface; the above technical solution can make a user see that the second local pattern displayed in the first display interface and a return pattern displayed in a second display interface are synchronous and consistent, so that the user feels a visual "0 delay", and at least one part of the sub-local patterns contained in the first local pattern is deleted based on the image information before the image information is displayed in the first display interface, which can avoid the problem of repeated stroke stacking in the first display interface, thereby improving the user experience.

[0055] The fourth aspect of the embodiments of the present application provides a reverse screen transmission method, comprising:

[0056] receiving operation information sent by a master display device;

[0057] displaying a return pattern in a second display interface based on the operation information; the return pattern includes a sub-return pattern generated based on the operation information;

[0058] recording the return pattern displayed in the second display interface to obtain image information;

[0059] sending the image information to the master display device.

[0060] The above technical solution has the following beneficial effects or advantages: before a sub-image information is displayed, whether a sub-local pattern needs to be deleted can be determined through a time stamp of the sub-local pattern, to avoid the problem of stroke stacking caused by repeated stroke display. BRIEF DESCRIPTION OF DRAWINGS

[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, the accompanying drawings in the following description only constitute some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0062] Figure 1 A schematic diagram of an operation scenario between a display device and a control device is provided for some embodiments of the present application.

[0063] Figure 2 A schematic diagram of a hardware configuration of a display device is provided for some embodiments of the present application.

[0064] Figure 3 A schematic diagram of a software configuration of a display device is provided for some embodiments of the present application.

[0065] Figure 4 An information interaction timing diagram of a master display device connecting a slave display device is provided for some embodiments of the present application.

[0066] Figure 5 A schematic diagram of a first operation interface is provided for some embodiments of the present application.

[0067] Figure 6 An information interaction timing diagram of a first application and a second application performing reverse screen transmission is provided for some embodiments of the present application.

[0068] Figure 7 A schematic diagram of a second operation interface is provided for some embodiments of the present application.

[0069] Figure 8 A flowchart of a method of drawing a sub-return pattern is provided for some embodiments of the present application.

[0070] Figure 9 A schematic diagram of a first display interface and a second display interface in an interaction process is provided for some embodiments of the present application.

[0071] Figure 10 A schematic diagram of a data flow between a first application and a second application in an interaction process is provided for some embodiments of the present application.

[0072] Figure 11 A flowchart of a reverse screen transmission method performed by a master display device is provided for some embodiments of the present application.

[0073] Figure 12 A flowchart of a reverse screen transmission method performed by a slave display device is provided for some embodiments of the present application. DETAILED DESCRIPTION

[0074] The embodiments will be described in detail below with reference to examples thereof as illustrated in the accompanying drawings. In the following description, same numbers in different drawings represent same or similar elements unless otherwise represented. The implementations described in the following embodiments are not meant to represent all implementations consistent with the present application. Rather, they are merely examples of implementations consistent with some aspects of the present application as detailed in the claims.

[0075] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise stated, these terms should be understood according to their ordinary and customary meanings.

[0076] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0077] The terms "include" and "have" and any variations thereof are intended to cover but not exclusively include, for example, a product or device that includes a series of components, and is not necessarily limited to all components clearly listed, but can include other components that are not clearly listed or inherent to such products or devices.

[0078] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that can perform the functions associated with that element.

[0079] Figure 1 The schematic diagram of the operation scenario between the display device and the control device is provided for some embodiments of the present application. As shown in Figure 1 The user can operate the display device 200 through the touch operation, the mobile terminal 300 and the control device 100, as shown in the middle. Among them, the control device 100 is used to receive the operation instruction input by the user, and convert the operation instruction into the control instruction that can be recognized and responded by the display device 200. For example, the control device 100 can be a remote controller, a touch pen, a handle, etc.

[0080] In some examples, the display device 200 generally refers to a device with picture display and data processing capability. For example, the display device 200 includes but is not limited to a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc., and the type of the display device 200 is not limited by the embodiments of the present application.

[0081] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device, establishing a communication connection with the display device 200 for data exchange. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, establishing a communication connection via a network communication protocol to achieve one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0082] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0083] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. For example, the display device 200 can be connected to the server 400 through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0084] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0085] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0086] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0087] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0088] In some embodiments, the display 260 includes display functional components for presenting a picture, and driving components for driving the image display. The display 260 is configured to receive the image signal output from the controller 250 and display the picture. For example, the display 260 can be configured to display video content, image content, components of a menu operation interface, a user operation UI interface, and the like.

[0089] In some embodiments, the communication device 220 is a component for communicating with the external device or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to the supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth function.

[0090] The communication device 220 can connect the display device 200 with the external device or the server 400 through wireless or wired connection. The wired connection can connect the display device 200 with the external device through data line, interface, and the like. The wireless connection can connect the display device 200 with the external device through wireless signal or wireless network. The display device 200 can directly establish a connection relationship with the external device, or indirectly establish a connection relationship through a gateway, a router, a connection device, and the like.

[0091] In some embodiments, the controller 250 can include at least one of a central processor, a video processor, an audio processor, a graphics processor, a power processor, a first interface to an n-th interface for input / output, and the like. The controller 250 controls the operation of the display device and responds to the user's operation by controlling various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0092] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, i.e., the tuner demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box, and the like.

[0093] In some embodiments, the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0094] In some embodiments, the audio output device 270 can be a native loudspeaker of the display device 200, or an external audio output device connected to the display device 200. In the case of an external audio output device, the display device 200 can further be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 via the external audio output terminal to output sound of the display device 200.

[0095] In some embodiments, the user input interface 280 can be configured to receive instructions from a user input.

[0096] To perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program configured to manage and control hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0097] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0098] The operating system can be divided into different modules or levels according to the functions implemented, for example, as shown in FIG. 2, in some embodiments, the system is divided into four layers, from top to bottom, the application layer (referred to as "application layer" for short), the application framework layer (referred to as "framework layer" for short), the system library layer and the kernel layer. Figure 3

[0099] In some embodiments, the application layer is configured to provide services and interfaces for application programs, so that the display device 200 can run application programs and interact with users based on the application programs. At least one application program can be run in the application layer, which can be a window program, a system setting program or a clock program provided by the operating system, or an application program developed by a third-party developer. In specific implementation, the application programs in the application layer are not limited to the above examples.

[0100] ​The framework layer provides an application programming interface (API) and a programming framework for applications. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center that decides which application in the application layer to act. The application can access resources in the system and obtain services of the system through the API interface in the execution.

[0101] As shown in Figure 3 The application framework layer in the embodiments of the present application includes a view system, managers, a content provider, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing access of system location services to system services or applications; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers and desktop components on the user interface.

[0102] In some embodiments, the activity manager is used to manage the life cycle of each application and the general navigation back function, such as controlling the exit, opening, back, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, intercepting the screen, controlling the display window change, for example, reducing the display window, shaking the display, twisting the display, etc.

[0103] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library included in the system runtime library layer, such as the C / C++ instruction library, to realize the functions of the framework layer.

[0104] In some embodiments, the kernel layer is a functional layer between the hardware and the software of the display device 200. The kernel layer can realize functions such as hardware abstraction, multitasking, memory management, etc. For example, as shown in Figure 3As shown, the kernel layer can be configured with hardware drivers, and the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power supply driver, etc.

[0105] It should be noted that the above examples are only a simple division of the operating system functions, and do not constitute a limitation on the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device, the type of the operating system, and other factors, the number and specific type of the levels included in the operating system can be in other forms.

[0106] In the related art, in the process of reverse screen transmission, due to the fact that the controlled display device can not support touch screen, or support touch screen but inconvenient to operate, etc., it is necessary to perform drawing operation on the master display device. For example, when it is necessary to synchronize the display of the picture on the controlled display device on the master display device, the drawing data of the master display device is transmitted to the controlled display device through a local area network for rendering and display, the picture data of the controlled display device is encoded, and the encoded data is sent to the master display device for display.

[0107] However, the entire process needs to go through the processes of instruction data transmission, drawing execution by the controlled display device, data acquisition and encoding, network transmission data, decoding and display by the master display device, etc. before the content displayed on the display interface of the master display device and the controlled display device is consistent, which is time-consuming and causes perceptible drawing operation delay for the user, thereby greatly reducing the user experience.

[0108] To solve the above technical problems, the embodiments of the present application provide a master display device and a controlled display device. The master display device responds to receiving a drawing instruction to draw a sub-local pattern on a first display interface and generate coordinate information corresponding to a touch screen operation. The coordinate information is sent to the controlled display device. The controlled display device records a return pattern displayed on a second display interface to obtain sub-image information, draws a sub-return pattern on the second display interface based on the coordinate information, encodes the sub-image information to obtain encoded information, and sends the encoded information and a timestamp of the sub-local pattern to the master display device. The master display device deletes the sub-local pattern with a timestamp earlier than the timestamp corresponding to the sub-image information, and then displays the sub-image information on the first display interface.

[0109] Exemplarily, the controlled display device can be a large-screen display device, such as a commercial television or a projector, etc. The master display device can be a small-screen display device, such as a mobile phone, etc.

[0110] It should be noted that the corresponding sub-local patterns and sub-return patterns in the embodiments of the present application are only different in the main body of drawing, and are essentially the same, so that the user can feel that the sub-local patterns and the corresponding sub-return patterns are synchronized and consistent.

[0111] In the embodiments of the present application, the sub-local patterns are drawn in the first display interface, and the slave display device draws the sub-return patterns in the second display interface based on the coordinate information, so that the user can experience the effect that the second local pattern displayed in the first display interface is synchronized and consistent with the return pattern displayed in the second display interface. In addition, before displaying the sub-image information in the first display interface, all sub-local patterns with a time stamp earlier than the time stamp of the sub-image information are cleaned up, so that the problem of overlapping strokes with the sub-image information when displaying the sub-image information in the first display interface can be avoided.

[0112] Figure 4 An information interaction timing diagram of a master display device connecting a slave display device is provided for some embodiments of the present application. The method of the master display device connecting the slave display device provided by the embodiments of the present application will be described in detail below. Figure 4 The method of the master display device connecting the slave display device provided by the embodiments of the present application will be described in detail below. The method of the master display device connecting the slave display device includes the following steps S401 to S410.

[0113] In step S401, the user clicks a first application program on a function page of the master display device.

[0114] In step S402, the first application program is started in response to the operation of the user clicking the first application program.

[0115] The first application program is an application program running on the master display device, which at least has the functions of drawing and displaying. The function page displays a plurality of other application programs running on the master display device.

[0116] It should be noted that the first application program and the second application program involved in the embodiments of the present application are both controlled by the controller.

[0117] In some examples, the first application program finds the slave display device in the same local area network. For example, the first application program discovers the slave display device in the same local area network through the user datagram protocol (UDP) and the digital living network alliance (DLAN).

[0118] In step S403, the user inputs a screen transmission code in the operation interface of the first application program.

[0119] Figure 5Fig. 1 shows a schematic diagram of a first operation interface provided by some embodiments of the present application. The first operation interface is shown in the following Figure 5 The screen transmission code provided by some embodiments of the present application is described in detail.

[0120] In some examples, after the first application is started, the first operation interface is jumped to, and "connecting to the controlled display device" is displayed on the first operation interface, which is used to prompt the user to input the screen transmission code.

[0121] For example, the user clicks the "screen transmission code connection" button in the upper right corner of the first operation interface of the first application, and the first application displays an input position on the first operation interface in response to the operation of the user clicking the "screen transmission code connection" button. The user inputs the screen transmission code in the input position.

[0122] For example, the controlled display device has only one screen transmission code, and the screen transmission code is generally fixed. Therefore, the user only needs to input the same screen transmission code in the input position of the first operation interface each time. For example, the screen transmission code is "SQUQEMIO".

[0123] In step S404, the first application acquires the screen transmission code, parses the screen transmission code, and obtains the IP (Internet Protocol) address and the service port number of the controlled display device.

[0124] The above steps S403 and S404 are only one implementation manner. In some other examples, the user clicks the "two-dimensional code connection" button in the upper left corner of the first operation interface of the first application, scans the two-dimensional code, and the first application decodes the two-dimensional code to obtain the IP and the service port number of the controlled display device.

[0125] In some other examples, the user opens the near field communication (NFC) of the master display device, and approaches the NFC module of the controlled display device. The first application acquires the IP and the service port number of the controlled display device.

[0126] Embodiments of the present application provide various methods for connecting the controlled display device and the master display device, so that the user can select a suitable method according to his own preference, thereby improving the user experience.

[0127] In step S405, the first application calls an interface, and sends a connection request to the second application based on the IP and the service port number of the controlled display device.

[0128] In some examples, the second application is an application running on the controlled display device, which at least has the functions of drawing and displaying.

[0129] In some examples, the first application program acquires identification information of the controlled display device, i.e., an IP and a service port number; connects the controlled display device based on the IP and the service port number; and sends a request for establishing an instruction channel to the controlled display device.

[0130] For example, the interface is an API interface.

[0131] In some examples, the first application program sends a connection request to the second application program through an MQTT (Message Queuing Telemetry Transport) protocol.

[0132] In step S406, the second application program sends first agreement feedback to the first application program, and the first application program and the second application program are successfully connected.

[0133] In some examples, after the first application program and the second application program are successfully connected, an instruction channel is formed between the first application program and the second application program, and the instruction channel is used to transmit instruction data of an interaction process of the first application program and the second application program.

[0134] In some examples, the first application program establishes an instruction channel with the controlled display device in response to receiving first agreement feedback of the controlled display device.

[0135] In step S407, the user clicks disconnect on an operation interface of the first application program.

[0136] In step S408, the first application program sends a disconnect request to the second application program by calling an interface in response to the user's operation of clicking disconnect.

[0137] In some examples, when the user does not need to perform reverse screen transmission, the connection between the first application program and the second application program is disconnected in time by clicking disconnect, so as to stop instruction interaction and data interaction between the first application program and the second application program.

[0138] In step S409, the second application program sends second agreement feedback to the first application program, and the second application program and the second application program are disconnected.

[0139] In step S410, the first application program prompts connection failure on an operation interface.

[0140] Embodiments of the present application can flexibly connect a controlled display device and a master display device and disconnect the master display device and the controlled display device according to user operations, thereby meeting real-time needs of the user. In addition, embodiments of the present application provide multiple connection methods, thereby greatly improving user experience.

[0141] Figure 6 A timing diagram of information interaction between a master display device and a slave display device for reverse screen transmission is provided for some embodiments of the present application. The reverse screen transmission information interaction provided by the embodiments of the present application is described in detail below. Figure 6 The reverse screen transmission information interaction provided by the embodiments of the present application is described in detail below.

[0142] In step S601, the user clicks the reverse screen transmission on the operation interface.

[0143] Figure 7 A schematic diagram of a second operation interface provided for some embodiments of the present application is provided. The reverse screen transmission function provided by the embodiments of the present application is described in detail below. Figure 7 The reverse screen transmission function provided by the embodiments of the present application is described in detail below.

[0144] In some examples, the first application jumps from the first operation interface to the second operation interface in response to the user inputting the screen transmission code, and displays the “reverse screen transmission” button and the “forward screen transmission” button on the second operation interface. When the user needs to start the “reverse screen transmission” function, the “reverse screen transmission” button is clicked.

[0145] In some examples, the first application sends a request for establishing a data channel to the second application, and after receiving the third consent feedback sent by the second application, a data channel is established between the first application and the second application, which is used to transmit data of the first application and the second application in the interaction process. For example, the data channel is a socket channel.

[0146] In step S602, the first application sends a reverse screen transmission instruction to the second application through the instruction channel in response to the user clicking the reverse screen transmission operation, and jumps to the first display interface.

[0147] In step S603, the second application starts recording and encoding, and jumps to the second display interface.

[0148] In some examples, the second application opens a function for recording the return pattern of the second display interface in response to the reverse screen transmission instruction received through the instruction channel; an image information is obtained every other first preset interval. By starting the function for recording the return pattern of the second display interface, the image information including the return pattern of the second display interface can be obtained, and since a certain time is needed to draw the sub-local pattern on the second display interface, an image information needs to be obtained every other first preset interval. The first preset interval is set according to actual needs, and the embodiments of the present application do not limit the first preset interval.

[0149] In step S604, the user performs a touch operation on the first display interface.

[0150] In step S605, the first application displays a first local pattern on the first display interface in response to the touch operation, and generates operation information corresponding to the touch operation.

[0151] The first local pattern includes a sub-local pattern generated based on the touch operation.

[0152] In some examples, the first application generates one sub-local pattern based on each touch operation. The first local pattern includes the sub-local patterns generated based on the touch operations.

[0153] In some examples, the first application sends drawing parameters to the controlled display device through the instruction channel in response to the touch operation, and draws the sub-local pattern on the first display interface based on the drawing parameters.

[0154] For example, the drawing parameters include a brush color, a brush width, and the like. It should be noted that the drawing parameters can be set according to actual needs, and embodiments of the present application will not be limited.

[0155] In some examples, the first application sends motion trajectory data corresponding to the touch operation to the second application. The motion trajectory data can also be represented as operation information.

[0156] According to the embodiments of the present application, the motion trajectory data and the drawing parameters are sent to the second application, so that the second application displays the feedback pattern on the second display interface according to the motion trajectory data and the drawing parameters.

[0157] For example, the operation information includes coordinate information and an identifier obtained based on the touch operation. For each movement of the user's finger, when the user moves the finger or lifts the finger, the first application records the touch point of the finger as a coordinate, thereby obtaining coordinate information including a plurality of coordinates, and generating a unique identifier corresponding to one touch operation, so that the unique touch operation and the sub-local pattern generated based on the touch operation are identified through the identifier. For example, the identifier is a string.

[0158] In step S606, the first application sends the operation information to the second application.

[0159] In some examples, the first application sends the coordinate information and the identifier to the second application.

[0160] In step S607, the second application displays the backhaul pattern on the second display interface based on the operation information.

[0161] The backhaul pattern includes a sub-backhaul pattern generated based on the operation information.

[0162] In some examples, the second application draws one sub-backhaul pattern based on each coordinate information, and the backhaul pattern includes the sub-backhaul patterns drawn based on the coordinate information.

[0163] In step S608, the second application records the backhaul pattern displayed on the second display interface to obtain image information.

[0164] In some examples, the data type of the image information is YUV.

[0165] Figure 8 A flowchart of a method for drawing a sub-backhaul pattern is provided for some embodiments of the present application. As shown in Figure 8 Step S608 includes steps S6081-S6082 as shown below.

[0166] In step S6081, the second application draws a sub-backhaul pattern on the second display interface based on the drawing parameters obtained through the instruction channel.

[0167] In some examples, the second application draws a sub-backhaul pattern based on the drawing parameters obtained through the instruction channel and the coordinate information, and the sub-local pattern corresponding to the coordinate information is consistent, that is, the sub-local pattern displayed on the first display interface and the sub-backhaul pattern displayed on the second display interface are synchronized and consistent, so that the first local pattern displayed on the first display interface and the backhaul pattern displayed on the second interface are synchronized and consistent.

[0168] In step S6082, the second application deletes the coordinate information and the identifier.

[0169] In some examples, after receiving the coordinate information and the identifier, the second application stores the coordinate information and the identifier, and then deletes the coordinate information and the identifier after completing the drawing of the sub-backhaul pattern, thereby saving the storage space of the second application.

[0170] In step S609, the second application encodes the image information to obtain encoded information.

[0171] In some examples, the second application encodes one image information as one encoded information every second preset interval.

[0172] Exemplarily, the second application program encodes each image information into an h.264 data stream every second preset interval to obtain an h.264 data packet, i.e., encoded information. The second preset interval can be set according to actual needs, and embodiments of the present application do not specifically limit the second preset interval. h.264 is a video compression encoding format.

[0173] In some examples, each image information includes at least one sub-image information. In the time dimension, the number of sub-return patterns that the latter sub-image information increases compared with the former sub-image information is determined according to the first preset interval.

[0174] Exemplarily, when the second preset interval is small, each image information includes one sub-image information.

[0175] Exemplarily, when the second preset interval is large, each image information includes a plurality of sub-image information.

[0176] Exemplarily, when the first preset interval is small, the latter sub-image information increases one sub-return pattern compared with the former sub-image information.

[0177] Exemplarily, when the first preset interval is large, the latter sub-image information increases a plurality of sub-return patterns compared with the former sub-image information.

[0178] Exemplarily, the sub-image information can be represented as an image frame, that is, one image frame is obtained by recording the return pattern of the second display interface once.

[0179] In step S610, the second application program sends the encoded information to the first application program.

[0180] In some examples, the second application program sends the identifier and the time stamp corresponding to the identifier to the first application program.

[0181] Exemplarily, the second application program sends the identifier and the time stamp corresponding to the identifier to the first application program through the instruction channel after completing the drawing of one sub-return pattern.

[0182] Exemplarily, a new time stamp is generated every time a sub-image information is obtained. The time stamp of this sub-image information is the time stamp corresponding to the next identifier before the next sub-image information is generated; since one identifier identifies one unique sub-local pattern, the time stamp of this sub-image information is the time stamp of the next sub-local pattern corresponding to the identifier. That is, the time stamp of the next sub-local pattern is represented by the time stamp of this sub-image information.

[0183] For example, the timestamp is a presentation timestamp (PTS). The PTS is generated by an encoder during encoding of the sub-image information after the sub-image information is recorded.

[0184] For example, the second application sends the encoded information to the first application through a data channel.

[0185] For example, the second application sends the h.264 data packet to the first application through a socket channel.

[0186] That is, the identifier and the identifier corresponding timestamp and encoded information are sent to the first application through different channels. Since the identifier and the identifier corresponding timestamp do not need to be encoded, the identifier and the identifier corresponding timestamp are preferentially sent to the first application with the next encoded information.

[0187] In step S611, the first application decodes the encoded information to obtain image information.

[0188] In some examples, after receiving the encoded information, the first application adds the encoded information to the cache of the first application, and decodes the encoded information, i.e., the h.264 data packet, using a decoder to obtain a sub-image information.

[0189] In step S612, the first application deletes at least part of the sub-local patterns contained in the first local pattern based on the image information to obtain remaining sub-local patterns.

[0190] In some examples, before displaying a sub-image information, the first application compares the first local pattern displayed on the first display interface with the sub-image information, deletes a part of the sub-local patterns that are repeated, and obtains remaining sub-local patterns. Then, the first application superimposes and displays the remaining sub-local patterns and the sub-image information on the first display interface, thereby avoiding stroke stacking and improving user experience.

[0191] In some examples, the encoding is performed asynchronously and is relatively time-consuming. The encoding is performed once every second preset interval, and one sub-image information or multiple sub-image information is encoded each time to obtain an encoded information. Therefore, there are multiple different time sequences between the encoding of a sub-image information and the drawing of a sub-local pattern, and the timestamp of the sub-local pattern can be earlier than, later than, or equal to the timestamp of the next sub-image information to be displayed.

[0192] For example, when one encoding information corresponds to multiple sub-image information, the encoding is started before the next sub-return pattern is drawn, the encoding of the first sub-image information is completed before the drawing of the next sub-return pattern is completed, and the encoding of the second sub-image information is started after the drawing of the next sub-return pattern is completed. In this case, the timestamp of the first sub-image information is the timestamp of the sub-local pattern corresponding to the next sub-return pattern.

[0193] For example, when one encoding information corresponds to multiple sub-image information, the encoding is started before the next sub-return pattern is drawn, the encoding of the second sub-image information is completed before the drawing of the next sub-return pattern is completed, and the encoding of the third sub-image information is started after the drawing of the next sub-return pattern is completed. In this case, the timestamp of the second sub-image information is the timestamp of the sub-local pattern corresponding to the next sub-return pattern.

[0194] For example, when one encoding information corresponds to multiple sub-image information, the encoding of the last sub-image information is started before the next sub-return pattern is drawn, the encoding of the last sub-image information is completed before the drawing of the next sub-return pattern is completed, and the encoding of the next encoding information has not started. In this case, the timestamp of the sub-local pattern corresponding to the next sub-return pattern is the timestamp of the last sub-image information.

[0195] For example, when one encoding information corresponds to multiple sub-image information, the last encoding sub-image information corresponding to the last encoding information is obtained before the next sub-return pattern is drawn, the encoding of the next encoding information has not started, and the drawing of the next sub-return pattern is completed. In this case, the timestamp of the sub-local pattern corresponding to the next sub-return pattern is the timestamp of the last encoding sub-image information corresponding to the last encoding information.

[0196] From the above analysis, when one encoding information corresponds to multiple sub-image information, the timestamp of the sub-local pattern can be the same as the timestamp of a certain sub-image information, later than the timestamp of a certain sub-image information, or earlier than the timestamp of a certain sub-image information.

[0197] In some examples, in order to avoid the occurrence of stroke stacking between a sub-image information and a first local pattern when the sub-image information is displayed on a first display interface, at least part of the sub-local patterns in the first local pattern that can be stacked with the sub-image information need to be cleaned up before the sub-image information is displayed on the first display interface. To solve this problem, for each sub-image information, the first application program deletes at least part of the sub-local patterns included in the first local pattern based on the timestamp of the sub-image information to obtain remaining sub-local patterns, and the timestamp of each sub-local pattern in the remaining sub-local patterns is later than or equal to the timestamp of the sub-image information.

[0198] In some examples, some undeleted sub-local patterns are stored in the cache of the first application, and these undeleted sub-local patterns are still displayed on the first display interface. Therefore, in order to avoid stroke stacking, it is necessary to delete some sub-local patterns that are repeated with the next sub-image information displayed.

[0199] For example, the first application searches the cache for a sub-local pattern with a timestamp earlier than the timestamp of the next sub-image information to be displayed. This is because the sub-returned pattern corresponding to the sub-local pattern with a timestamp earlier than the timestamp of the next sub-image information to be displayed has already been included in the next sub-image information to be displayed. Therefore, in order to prevent stroke overlap on the first display interface, the sub-local pattern with a timestamp earlier than the timestamp of the next sub-image information to be displayed needs to be deleted.

[0200] Exemplarily, the sub-return pattern corresponding to the sub-local pattern whose timestamp is equal to the timestamp of the next sub-image information to be displayed is not included in the next sub-image information to be displayed. Therefore, there is no need to delete the sub-local pattern whose timestamp is equal to the timestamp of the next sub-image information to be displayed.

[0201] Exemplarily, the sub-return pattern corresponding to the sub-local pattern whose timestamp is later than the timestamp of the next sub-image information to be displayed is not included in the next sub-image information to be displayed. Therefore, there is no need to delete the sub-local pattern whose timestamp is later than the timestamp of the next sub-image information to be displayed.

[0202] In some examples, the displayed sub-image information and the remaining sub-local patterns are displayed on different layers of the screen, respectively.

[0203] It should be noted that the sub-local patterns involved in the above embodiments whose timestamps are earlier than the timestamps of the sub-image information are all data still stored in the cache of the first application. Sub-local patterns that have been deleted before the sub-image information is displayed do not need to be considered again.

[0204] In step S613, the first application displays the second local pattern on the first display interface.

[0205] In one example, the second local pattern includes sub-image information and a remaining sub-local pattern.

[0206] In some examples, after all sub-image information is displayed, if the user wants to clear the first display interface and the second display interface, the user clicks the "Clear" button on the first display interface. The first application responds to the clear instruction to clear the first local pattern displayed on the first display interface and the identifiers stored in the cache, as well as information such as the timestamp corresponding to the identifier, thereby not only meeting the user's needs but also saving cache space.

[0207] In some examples, the first application sends the instruction for clearing to the second application through the instruction channel, and the second application clears the back transmission pattern displayed on the second display interface, thereby not only meeting the user's demand, but also saving the cache space.

[0208] Embodiments of the present application greatly simplify the user's operation and improve the user's experience by allowing the user to clear the first display interface and the second display interface by clicking the "clear" button.

[0209] Embodiments of the present application display the first local pattern on the first display interface in response to the touch screen operation, display the back transmission pattern on the second display interface based on the operation information, receive the image information obtained based on the operation information sent by the controlled display device, delete at least part of the sub-local patterns contained in the first local pattern based on the image information before displaying the image information on the first display interface, obtain the remaining sub-patterns, and display the second local pattern on the first display interface. The above technical solution can make the user see that the second local pattern displayed on the first display interface is synchronized and consistent with the back transmission pattern displayed on the second display interface, thereby making the user feel the "0 delay" in vision. Before displaying the image information on the first display interface, deleting at least part of the sub-local patterns contained in the first local pattern based on the image information can avoid the problem of repeated stroke stacking on the first display interface, thereby improving the user experience.

[0210] Figure 9 A first display interface and a second display interface in an interactive process are provided for some embodiments of the present application. The first display interface and the second display interface provided by the embodiments of the present application will be described in detail below. Figure 9 The first display interface and the second display interface provided by the embodiments of the present application will be described in detail below.

[0211] In some examples, during the interaction, taking the image information including one sub-image information as an example, the second application program encodes the sub-image information including the sub-returned pattern "pen" to obtain the encoded information. The first application program responds to the touch screen operation to draw the sub-local pattern "paint" on the first display interface and draw the sub-returned pattern "paint" on the second display interface based on the coordinate information. The second application program sends the encoded information to the first application program, and the first application program decodes the encoded information to obtain the sub-image information. Before displaying the sub-image information, all sub-local patterns with a timestamp earlier than the timestamp of the sub-image information are deleted, that is, the sub-image information and the remaining sub-local pattern are displayed on the first display interface, and the returned pattern corresponding to the sub-image information and the remaining sub-local pattern is displayed on the second display interface. In this way, the user feels that the returned pattern displayed on the first display interface and the second local pattern displayed on the second display interface are synchronous and consistent. Compared with the related art, after the user completes the drawing of "paint" through the touch screen of the master display device, the user needs to wait for the drawing data to be transmitted to the slave display device, the slave display device to draw, encode, transmit the encoded information, and the master display device to decode the encoded information before the user can see that the second local pattern displayed on the first display interface is consistent with the returned pattern displayed on the second display interface. This greatly reduces the delay experienced by the user, thereby improving the user's satisfaction.

[0212] Figure 10 A data flow diagram between the first application program and the second application program during the interaction is provided for some embodiments of the present application. The data flow provided by the embodiments of the present application will be described in detail below. Figure 10 The data flow provided by the embodiments of the present application will be described in detail below.

[0213] In some examples, the first application program draws the tthsub-local pattern, the first application program sends the coordinate information and the identifier to the second application program, and the second application program draws the tthsub-returned pattern and sends the tthidentifier and the timestamp corresponding to the tthidentifier to the first application program. t is an integer greater than or equal to 1.

[0214] The second application program records the returned pattern of the second display interface to obtain the pthsub-image information, encodes the pthimage information to obtain the pthencoded information, and includes the pthtimestamp, that is, the timestamp of the pthsub-image information, in the pthencoded information, and sends the pthencoded information to the first application program through the socket channel. p is an integer greater than or equal to 1.

[0215] After the second application program completes the drawing of the tthsub-returned pattern, the second application program sends the tthidentifier and the timestamp corresponding to the tthidentifier to the first application program.

[0216] The first application program records a correspondence relationship between the tth identifier and a timestamp corresponding to the tth identifier.

[0217] The second application program draws the (t+1)th sub-return screen pattern;

[0218] The second application program records the return screen pattern displayed on the second display interface, obtains (p+1)th sub-image information, encodes the (p+1)th sub-image information, obtains (p+1)th encoded information, and includes (p+1)th timestamp in the (p+1)th encoded information, that is, the timestamp of the (p+1)th sub-image information.

[0219] Before the first application program displays the pth sub-image information, when the timestamp corresponding to the tth identifier is later than or equal to the timestamp of the pth sub-image information, the tth sub-local pattern corresponding to the tth identifier is not deleted.

[0220] The second application program draws the (t+2)th sub-return screen pattern;

[0221] The first application program displays the pth sub-image information;

[0222] Before the first application program displays the (p+1)th sub-image information, when the timestamp corresponding to the tth identifier is earlier than the timestamp of the (p+1)th sub-image information, the tth sub-local pattern corresponding to the tth identifier is deleted.

[0223] The first application program displays the (p+1)th sub-image information.

[0224] Embodiments of the present application clean all sub-local patterns with timestamps less than the timestamp of the next sub-image information from the first display interface before the first application program displays the next sub-image information, thereby avoiding the problem of stroke stacking when the first display interface displays the sub-image information, allowing users to feel that the second local pattern displayed on the first display interface and the return screen pattern displayed on the second display interface are synchronized and consistent, allowing users to feel "0 delay", thereby greatly improving user experience.

[0225] Figure 11 A flowchart of a reverse screen transmission method performed by a master display device according to some embodiments of the present application is provided. As shown in Figure 11 The reverse screen transmission method includes steps S1101 to S1105 as shown below.

[0226] In step S1101, in response to a touch screen operation, a first local pattern is displayed on a first display interface, and operation information corresponding to the touch screen operation is generated, and the first local pattern includes a sub-local pattern generated based on the touch screen operation;

[0227] In step S1102, the operation information is sent to the controlled display device;

[0228] In step S1103, the image information obtained based on the operation information sent by the controlled display device is received;

[0229] In step S1104, at least part of the sub-local patterns contained in the first local pattern is deleted based on the image information, and the remaining sub-local patterns are obtained;

[0230] In step S1105, the second local pattern is displayed on the first display interface, and the second local pattern contains the sub-patterns contained in the image information and the remaining sub-local patterns of the first local pattern.

[0231] In some embodiments, the image information includes at least one sub-image information and a timestamp of each sub-image information;

[0232] The method further includes:

[0233] The timestamp of the sub-local pattern sent by the controlled display device is received.

[0234] In some embodiments, deleting at least part of the sub-local patterns contained in the first local pattern based on the image information to obtain the remaining sub-local patterns includes:

[0235] For each sub-image information, at least part of the sub-local patterns contained in the first local pattern is deleted based on the timestamp of the sub-image information to obtain the remaining sub-local patterns; the timestamp of each sub-local pattern in the remaining sub-local patterns is later than or equal to the timestamp of the sub-image information.

[0236] In some embodiments, the sub-image information includes a feedback pattern;

[0237] Receiving the image information obtained based on the operation information sent by the controlled display device includes:

[0238] Receiving the image information obtained based on the feedback pattern sent by the controlled display device; the feedback pattern includes a sub-feedback pattern generated by the controlled display device based on the operation information; the sub-feedback pattern corresponds to the sub-local pattern one by one;

[0239] Receiving the encoding information obtained based on the image information sent by the controlled display device.

[0240] In some embodiments, the operation information includes coordinate information generated based on a touch screen operation and an identifier;

[0241] Sending the operation information to the controlled display device includes:

[0242] Sending the coordinate information and the identifier to the controlled display device.

[0243] Embodiments of the present application display a first local pattern on a first display interface in response to a touch screen operation, receive image information obtained based on operation information sent by a controlled display device, delete at least part of the sub-local patterns contained in the first local pattern based on the image information before displaying the image information on the first display interface, obtain remaining sub-pictures, and display a second local pattern on the first display interface. The above technical solution can make the user see that the second local pattern displayed on the first display interface is synchronized and consistent with the return pattern displayed on the second display interface, so that the user feels the "0 delay" in vision, and deleting at least part of the sub-local patterns contained in the first local pattern based on the image information before displaying the image information on the first display interface can avoid the problem of repeated stroke stacking on the first display interface, thereby improving the user experience.

[0244] Figure 12 A flowchart of a reverse screen transmission method performed by a controlled display device is provided for some embodiments of the present application. As shown in Figure 12 The reverse screen transmission method includes steps S1201 to S1204 as shown below.

[0245] In step S1201, operation information sent by a master display device is received.

[0246] In step S1202, a return pattern is displayed on a second display interface based on the operation information; the return pattern includes sub-return patterns generated based on the operation information.

[0247] In step S1203, the return pattern displayed on the second display interface is recorded to obtain image information.

[0248] In step S1204, the image information is sent to the master display device.

[0249] In some embodiments, the image information includes at least one sub-image information and a timestamp of each sub-image information.

[0250] The method further includes:

[0251] The timestamp of the sub-local pattern is sent to the master display device.

[0252] In some embodiments, before receiving the operation information sent by the master display device, the method further includes:

[0253] In response to a reverse screen transmission instruction, a function for recording the return pattern is opened.

[0254] Every other first preset interval, a sub-image information is obtained.

[0255] Embodiments of the present application can determine whether a sub-local pattern needs to be deleted by the time stamp of the sub-local pattern before displaying the information of a sub-image, so as to avoid the stroke stacking problem caused by repeated display of strokes.

[0256] For the convenience of explanation, the above description has been made in connection with specific embodiments. However, the above description in some embodiments is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Various modifications and variations are possible in light of the above teachings. The embodiments were chosen and described in order to provide the best explanation for the disclosure and to enable others skilled in the art to best use the embodiments.

Claims

1. A main control display device, characterized in that: include: a display configured to display a first display interface; a communicator configured to communicate with a controlled display device; The controller is configured as: In response to a touch screen operation, displaying a first local pattern on the first display interface and generating operation information corresponding to the touch screen operation, wherein the first local pattern includes a sub-local pattern generated based on the touch screen operation; controlling the communicator to send the operation information to the controlled display device; controlling the communicator to receive image information sent by the controlled display device and obtained based on the operation information; deleting at least a portion of sub-local patterns included in the first local pattern based on the image information to obtain remaining sub-local patterns; A second local pattern is displayed on the first display interface, where the second local pattern includes the sub-pattern included in the image information and the remaining sub-local patterns of the first local pattern.

2. The main control display device according to claim 1, characterized in that: The image information includes at least one sub-image information and a timestamp of each sub-image information; The controller is further configured to: The communicator is controlled to receive a timestamp of the sub-local pattern sent by the controlled display device.

3. The main control display device according to claim 2, characterized in that: The controller deletes the at least a portion of the sub-local patterns included in the first local pattern based on the image information to obtain the remaining sub-local patterns, and is specifically configured to: For each sub-image information, at least a portion of the sub-local patterns contained in the first local pattern is deleted based on the timestamp of the sub-image information to obtain the remaining sub-local patterns; the timestamp of each sub-local pattern in the remaining sub-local patterns is later than or equal to the timestamp of the sub-image information.

4. The main control display device according to claim 1, characterized in that: The sub-image information includes a returned pattern; The controlling the communicator to receive the image information sent by the controlled display device and obtained based on the operation information is specifically configured as follows: receiving the image information obtained based on the return pattern sent by the controlled display device; the return pattern includes a sub-return pattern generated by the controlled display device based on the operation information; the sub-return pattern corresponds one-to-one to the sub-local pattern; Receive coding information sent by the controlled display device and obtained based on the image information.

5. The main control display device according to claim 1, characterized in that: The operation information includes coordinate information and an identifier generated based on the touch screen operation; The controller controls the communicator to send the operation information to the controlled display device, and is specifically configured to: The coordinate information and the identifier are sent to the controlled display device.

6. A controlled display device, characterized in that: include: a display configured to display a second display interface; a communicator configured to communicate with a master display device; The controller is configured as: Controlling the communicator to receive operation information sent by the main control display device; Displaying a return pattern on the second display interface based on the operation information; the return pattern includes a sub-return pattern generated based on the operation information; Recording the returned pattern displayed on the second display interface to obtain image information; The communicator is controlled to send the image information to the main control display device.

7. The controlled display device according to claim 6, wherein: The image information includes at least one sub-image information and a timestamp of each sub-image information; The controller is further configured to: The timestamp of the sub-local pattern is sent to the master display device.

8. The controlled display device according to claim 7, wherein: Before the controller controls the communicator to receive the operation information sent by the master display device, the controller is further configured to: In response to the reverse screen transmission instruction, turning on a function for recording the returned pattern; The image information is acquired every first preset interval.

9. A reverse screen transmission method, characterized in that: include: In response to a touch screen operation, displaying a first local pattern on a first display interface and generating operation information corresponding to the touch screen operation, wherein the first local pattern includes a sub-local pattern generated based on the touch screen operation; Sending the operation information to the controlled display device; receiving image information sent by the controlled display device and obtained based on the operation information; deleting at least a portion of sub-local patterns included in the first local pattern based on the image information to obtain remaining sub-local patterns; A second local pattern is displayed on the first display interface, where the second local pattern includes the sub-pattern included in the image information and the remaining sub-local patterns of the first local pattern.

10. A reverse screen transmission method, characterized in that: include: Receive operation information sent by the main control display device; Displaying a return pattern on the second display interface based on the operation information; the return pattern includes a sub-return pattern generated based on the operation information; Recording the returned pattern displayed on the second display interface to obtain image information; The image information is sent to the main control display device.

Images