Display module, image processing method and picture display method

Abstract

The invention provides a display module, an image processing method and a picture display method, and relates to the technical field of display touch control. The display module includes a first display module configured to generate a plurality of display images for a display mode, the plurality of display images including a primary display image and at least one secondary display image, the primary display image being displayed; the at least one second display module is in communication connection with the first display module and is configured to receive the at least one auxiliary display image and display the at least one auxiliary display image; the touch module comprises a touch assembly, the touch assembly covers the first display module and the at least one second display module, and the touch module is configured to determine a target touch track based on received touch operation and send the target touch track to the first display module; wherein the first display module and the at least one second display module are spliced to form the multi-connected-screen display, and the first display module updates a display picture of the multi-connected-screen display based on the target touch track.

Description

Display module, image processing method, and screen display method Technical Field

[0001] The present disclosure relates to the field of display and touch technology, and in particular to a display module, an image processing method, and a screen display method. Background Art

[0002] Multi-display displays, consisting of multiple monitors, are widely used in various fields. For example, they can be used as smart educational blackboards to facilitate various educational scenarios. With the development of display and touch technologies, most multi-display displays have both display and touch functions.

[0003] For example, a touch-enabled multi-screen display can support touch operations for the entire multi-screen display or individual touch operations for each display in the multi-screen display. In order to enrich the use scenarios of touch-enabled multi-screen displays, designing multi-touch displays that can support both overall touch operations and individual touch operations has become an important research topic.

[0004] Summary of the Invention

[0005] The present disclosure provides a display module, an image processing method, and a screen display method.

[0006] According to a first aspect, the present disclosure provides a display module, comprising: a first display module, configured to generate multiple display images for a display mode, the multiple display images including a main display image and at least one sub-display image, and displaying the main display image; at least one second display module, respectively communicatively connected to the first display module, configured to receive at least one sub-display image from the first display module, and display at least one sub-display image; and a touch module, the touch module including a touch component, the touch component covering the first display module and at least one second display module, the touch module being configured to determine a target touch trajectory based on a received touch operation, and send the target touch trajectory to the first display module; wherein the first display module and at least one second display module are spliced ​​to form a multi-screen display, and the first display module updates the display image of the multi-screen display based on the target touch trajectory.

[0007] For example, the first display module is configured as follows: when the display mode is determined to be the first display mode, the initial image is divided into a main display image and at least one sub-display image according to the display properties of the first display module and at least one second display module; when the display mode is determined to be the second display mode, the initial image is converted according to the display properties of the first display module and at least one second display module to obtain a main display image and at least one sub-display image; and the at least one sub-display image is sent to at least one second display module respectively.

[0008] For example, the first display module includes: a main display screen; a first display output interface; at least one second display output interface; a display processing unit, configured to generate a main display image and at least one secondary display image, and send the main display image to the main display screen through the first display output interface, and send at least one secondary display image to at least one second display module through at least one second display output interface.

[0009] For example, the display processing unit includes a frame buffer, and the frame buffer includes a first frame buffer configured to store a main display image; and at least one second frame buffer configured to store at least one subsidiary display image respectively.

[0010] For example, the frame buffer further includes a third frame buffer configured to store an initial image; wherein the display processing unit is further configured to read and process the initial image from the third frame buffer to obtain a main display image and at least one subsidiary display image.

[0011] For example, the first display module further includes: a display input interface; wherein the display processing unit is further configured to receive an initial image from an external device through the display input interface.

[0012] For example, the first display module is configured as follows: when it is determined that the display mode is the first display mode and the initial image comes from the first display module, an updated image is generated according to the target touch trajectory, and the updated image is divided into an updated main display image and at least one updated sub-display image, and the at least one updated sub-display image is sent to at least one second display module respectively; and when it is determined that the display mode is the second display mode and the initial image comes from the first display module, the target display module targeted by the touch operation is determined, an updated image for the target display module is generated according to the target touch trajectory, and the updated image is sent to the target display module, the target display module includes at least one of the first display module and at least one second display module.

[0013] For example, the first display module includes: a first coordinate interface; wherein the display processing unit is further configured to receive a target touch track from the touch module through the first coordinate interface.

[0014] For example, the first display module further includes: a second coordinate interface; wherein the display processing unit is further configured to send the target touch coordinates to the external device through the second coordinate interface when it is determined that the initial image comes from the external device.

[0015] For example, the first display module is further configured to: when it is determined that the display mode is the first display mode and the initial image comes from an external device, send the target touch trajectory to the external device, receive the updated image obtained by the external device based on the target touch trajectory, and divide the updated image into an updated main display image and at least one updated sub-display image, and send the at least one updated sub-display image to at least one second display module respectively; and when it is determined that the display mode is the second display mode and the initial image comes from an external device, determine the target display module targeted by the touch operation, send the target touch trajectory to the external device, receive the updated image obtained by the external device based on the target touch trajectory, and send the updated image to the target display module, the target display module includes at least one of the first display module and at least one second display module.

[0016] For example, the touch module includes: a touch sensing unit, integrated in the first display module and at least one display module, configured to generate touch sensing information based on the sensed touch operation, and a touch processing unit, electrically connected to the touch sensing unit and integrated in the first display module, configured to determine the touch operation based on the touch sensing information, determine the target touch trajectory based on the touch operation, and send the target touch trajectory to the first display module.

[0017] For example, the touch sensing unit includes an infrared emitting unit and an infrared receiving unit; the infrared emitting unit includes: a first infrared emitting subunit, arranged on the first side of the first display module; and at least one second infrared emitting subunit, respectively arranged on the first side of at least the second display module; and the infrared receiving unit includes: a first infrared receiving subunit, arranged on the second side of the first display module opposite to the first side of the first display module; and at least one second infrared receiving subunit, respectively arranged on the second side of the at least one second display module opposite to the first side of the at least one second display module; wherein the first infrared emitting subunit is electrically connected to the at least one second infrared emitting subunit, and the first infrared receiving subunit is electrically connected to the at least one second infrared receiving subunit.

[0018] For example, the touch processing unit includes: an infrared transmitting control port; an infrared receiving control port; and a peripheral device interface; wherein the touch processing unit is also configured to control the infrared transmitting unit to emit infrared light through the infrared transmitting control port, collect the receiving information of the infrared receiving unit through the infrared receiving control port, and send the target touch trajectory to the first display module through the peripheral device interface.

[0019] For example, the touch processing unit is configured to: respond to a first instruction from the first display module, determine the initial touch trajectory of the touch operation according to the touch operation, and the first instruction instructs the touch module to switch to the first display mode; wherein the initial touch trajectory serves as the target touch trajectory, and the touch coordinates included in the initial touch trajectory are determined based on the coordinate system of the multi-screen display.

[0020] For example, the touch processing unit is configured to: respond to a second instruction from the first display module, determine an initial touch trajectory of the touch operation according to the touch operation, and the second instruction instructs the touch module to switch to the second display mode; according to the display properties of the first display module and at least one second display module, convert the initial touch trajectory into a target touch trajectory; wherein, the target touch coordinates included in the target touch trajectory are determined based on the coordinate system of the target display module, and the target display module includes at least one of the first display module and at least one second display module.

[0021] For example, the touch processing unit includes: a first coordinate buffer, configured to store a target touch trajectory based on a coordinate system of a first display module; at least one second coordinate buffer, configured to respectively store a target touch trajectory based on a respective coordinate system of at least one second display module; and a third coordinate buffer, configured to store a target touch trajectory based on a coordinate system of a multi-screen display.

[0022] For example, the first display module includes: a first data packet buffer configured to store a target touch track from a first coordinate buffer; at least one second data packet buffer configured to store a target touch track from at least one second coordinate buffer, respectively; and a third data packet buffer configured to store a target touch track from a third coordinate buffer.

[0023] For example, the touch module is configured as follows: based on the effective operation of the touch operation, a target touch trajectory is determined; wherein, when the display mode is the first display mode, the effective operation includes the touch operation located within the display area of ​​the first display module and the at least one second display module; when the display mode is the second display mode, when it is determined that the length of the touch trajectory of the touch operation located within the display area is not less than the first specified length, the effective operation includes the touch operation located within the display area; when the display mode is the second display mode, when it is determined that the touch operation includes the specified operation, the effective operation includes the touch operation located in the non-display area with a touch trajectory length of the second specified length, the non-display area is the seam area between the first display module and the at least one second display module, and the specified operation includes any one of the following: the operation starting point of the touch operation is located in the non-display area, the operation end point of the touch operation is located in the non-display area, the operation starting point and the operation end point are located in different display areas and the operation trajectory of the touch operation is located in the non-display area.

[0024] For example, the first display module is configured as follows: when it is determined that the display mode is the first display mode, the first display resolution of the first display module and the second display resolution of at least one second display module are determined; according to the ratio between the first display resolution and the second display resolution, the initial image is divided to obtain an initial main display image and at least one initial sub-display image; when it is determined that the resolution of the initial main display image is inconsistent with the first display resolution, the resolution of the initial main display image is converted to the first display resolution to obtain the main display image; and when it is determined that the resolution of at least one initial sub-display image is inconsistent with the second display resolution, the resolution of at least one initial sub-display image is converted to the second display resolution to obtain at least one sub-display image.

[0025] For example, the touch processing unit is configured to determine the initial touch trajectory of the touch operation based on the touch operation, including: when the display mode is determined to be the second display mode, determining the initial touch trajectory based on the coordinate system of the multi-screen display; and converting the initial touch trajectory into a target touch trajectory based on the display properties of the first display module and at least one second display module, including: determining the target display module to which the multiple initial touch coordinates are respectively targeted based on the multiple initial touch coordinates included in the initial touch trajectory; and converting the multiple initial touch coordinates into multiple target touch coordinates based on the coordinate system of the target display module to which the multiple initial touch coordinates are respectively targeted to obtain the target touch trajectory.

[0026] For example, the touch processing unit is configured to determine the target display module targeted by each of the multiple initial touch coordinates based on the multiple initial touch coordinates included in the initial touch trajectory, including: when it is determined that the initial touch coordinates are within the first coordinate range of the coordinate system of the multi-screen display, determining that the target display module targeted by the initial touch coordinates is the first display module; and when it is determined that the initial touch coordinates are within the second coordinate range of the coordinate system of the multi-screen display, determining that the target display module targeted by the initial touch coordinates is the second display module.

[0027] According to a second aspect, the present disclosure provides an image processing method for a multi-screen display, the multi-screen display comprising a first display module, at least one second display module, and a touch module. The image processing method comprises: generating, using the first display module, a plurality of display images for a display mode, the plurality of display images comprising a primary display image and at least one secondary display image; displaying the primary display image using the first display module and displaying the at least one secondary display image using the at least one second display module; determining, using the touch module, a target touch trajectory based on a received touch operation; and updating, using the first display module, the plurality of display images based on the target touch trajectory.

[0028] According to the third aspect, the present disclosure provides a screen display method, which is applied to the display module provided by an embodiment of the present disclosure, including: in response to a received screen display instruction, using a first display module to display a main display image, and using at least one second display module to display at least one secondary display image respectively; and in response to a received touch operation, using the first display module to display an updated main display image, and using at least one second display module to display at least one updated secondary display image respectively, wherein the updated main display image and the at least one updated secondary display image are determined based on the touch operation.

[0029] For example, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, respectively, including: when it is determined that the display mode indicated by the screen display instruction is the first display mode, the initial image is divided into a main display image and at least one sub-display image; and the main display image is displayed using the first display module, and at least one sub-display image is displayed using at least one second display module, respectively.

[0030] For example, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, including: when it is determined that the display mode indicated by the screen display instruction is the second display mode, multiple initial images are converted into a main display image and at least one sub-display image, and the screen contents of the multiple initial images are different from each other; and the main display image is displayed using the first display module, and at least one sub-display image is displayed using at least one second display module.

[0031] For example, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, including: when it is determined that the display mode indicated by the screen display instruction is a first synchronous display mode, the initial image is converted into a main display image and at least one sub-display image, and the screen contents of the main display image and the at least one sub-display image are the same; and the main display image is displayed using the first display module, and at least one sub-display image is displayed using at least one second display module.

[0032] For example, at least one second display module includes multiple second display modules; in response to a received screen display instruction, a main display image is displayed using the first display module, and at least one sub-display image is displayed using at least one second display module, including: when it is determined that the display mode indicated by the screen display instruction is the second synchronous display mode, multiple initial images are converted into a main display image and multiple sub-display images, the display contents of the multiple initial images are different, and the screen contents of the multiple sub-display images are the same; and the main display image is displayed using the first display module, and the multiple sub-display images are displayed using multiple second display modules.

[0033] For example, the at least one second display module includes multiple second display modules. The screen display method further includes: switching the secondary display images in the multiple second display modules in response to the received screen switching instruction, and the screen contents of the multiple secondary display images displayed by the multiple second display modules are different.

[0034] For example, the screen display method further includes: in response to the received screen sharing instruction, using at least one second display module to display the main display image respectively.

[0035] For example, in response to a received touch operation, the first display module is used to display an updated main display image, and at least one second display module is used to display at least one updated sub-display image, including: in a first display mode, according to the touch operation, the main display image and at least one sub-display image are updated to obtain an updated image; and the first display module is used to display an updated main display image, and at least one second display module is used to display at least one updated sub-display image, wherein the updated main display image and the at least one updated sub-display image are obtained by dividing the updated image.

[0036] For example, in response to a received touch operation, an updated main display image is displayed using the first display module, and at least one updated sub-display image is displayed using at least one second display module, respectively, including: in the second display mode, when it is determined that the touch operation is directed to the first display module, the updated main display image is displayed using the first display module, and the updated main display image is obtained by updating the main display image; and in the second display mode, when it is determined that the touch operation is directed to the second display module, the updated sub-display image is displayed using the second display module, and the updated sub-display image is obtained by updating the sub-display image.

[0037] For example, at least one second display module includes multiple second display modules; in response to a received touch operation, the first display module is used to display an updated main display image, and at least one second display module is used to display at least one updated sub-display image, including: in the second display mode, when it is determined that the touch operation is directed to any one of the multiple second display modules, multiple updated sub-display images are displayed using the multiple second display modules, and the display content of the multiple updated sub-display images is the same. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] FIG1 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

[0039] FIG2A is a schematic diagram of a display image in a first display mode according to an embodiment of the present disclosure;

[0040] FIG2B is a schematic diagram of a processed display image in the first display mode according to an embodiment of the present disclosure;

[0041] FIG2C is a schematic diagram of processing a touch operation in the first display mode according to an embodiment of the present disclosure;

[0042] FIG3A is a schematic diagram of a display image in a second display mode according to an embodiment of the present disclosure;

[0043] 3B and 3C are schematic diagrams of processing touch operations in the second display mode according to an embodiment of the present disclosure;

[0044] FIG4 is a schematic structural diagram of a first display module according to an embodiment of the present disclosure;

[0045] FIG5 is a schematic structural diagram of a display processing unit according to an embodiment of the present disclosure;

[0046] FIG6 is a schematic structural diagram of a touch module according to an embodiment of the present disclosure;

[0047] FIG7 is a schematic structural diagram of a touch module according to another embodiment of the present disclosure;

[0048] FIG8 is a schematic structural diagram of a touch processing unit according to an embodiment of the present disclosure;

[0049] FIG9A is a schematic structural diagram of a display module according to another embodiment of the present disclosure;

[0050] 9B-9Q are schematic diagrams of display screens according to an embodiment of the present disclosure;

[0051] FIG10A is a schematic diagram of splicing a display module according to an embodiment of the present disclosure;

[0052] 10B to 10G are schematic diagrams of touch operations according to an embodiment of the present disclosure;

[0053] FIG11 is a flowchart of an image processing method according to an embodiment of the present disclosure;

[0054] FIG12A is a flowchart of a screen display method according to an embodiment of the present disclosure; and

[0055] FIG12B is an application architecture diagram of a method for implementing a screen display according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of them. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure. It should be noted that throughout the drawings, the same elements are represented by the same or similar figure marks. In the following description, some specific embodiments are only for descriptive purposes and should not be understood as any limitation to the present disclosure, but are only examples of the embodiments of the present disclosure. Conventional structures or configurations will be omitted when they may cause confusion in the understanding of the present disclosure. It should be noted that the shapes and sizes of the components in the figures do not reflect the actual size and proportion, but only illustrate the contents of the embodiments of the present disclosure.

[0057] Unless otherwise defined, technical or scientific terms used in the embodiments of the present disclosure shall have the same general meaning as those skilled in the art. The terms "first," "second," and similar terms used in the embodiments of the present disclosure do not denote any order, quantity, or importance, but are merely used to distinguish different components.

[0058] In addition, in the description of the embodiments of the present disclosure, the term "connected" or "connected to" may refer to a direct connection between two components or a connection between two components via one or more other components. In addition, the two components may be connected or coupled via a wired or wireless manner.

[0059] FIG1 is a schematic structural diagram of a display module according to an embodiment of the present disclosure.

[0060] As shown in FIG. 1 , the display module 100 includes a first display module 110 , a plurality of second display modules 120 a and 120 b , and a touch module 130 .

[0061] In the disclosed embodiments, each display module may be a device including a display screen, and each display module may display an image. For example, the first display module 110 and the plurality of second display modules 120a and 120b may each be a display screen. The first display module 110 and the plurality of second display modules 120a and 120b may be spliced ​​together to form a multi-screen display. A multi-screen display is a display comprising multiple display modules, each of which includes a display screen.

[0062] In the disclosed embodiment, when a multi-screen display is used to jointly display an image, the multi-screen display divides the image into multiple sub-images and uses multiple display modules to display each sub-image, thereby splicing the display screens of the multiple display modules to form the image. Specifically, the first display module 110 divides the image into a main display image and two sub-display images. The first display module 110 displays the main display image, and the second display module 120a and the second display module 120b each display the two sub-display images.

[0063] In an embodiment of the present disclosure, when a multi-screen display displays multiple images, the multi-screen display acquires multiple images and uses multiple display modules to display one image respectively, so that each display module can independently display an image. For example, the first display module 110 acquires a main display image and two sub-display images, the first display module 110 displays the main display image, and the second display module 120a and the second display module 120b display two sub-display images respectively. The image content of the multiple images acquired by the multi-screen display can be the same, so that the display screens of the first display module 110 and the multiple second display modules 120a and 120b are the same. The image content of the multiple images acquired by the multi-screen display can also be different, so that the display screens of the first display module 110 and the multiple second display modules 120a and 120b are different.

[0064] It should be noted that in order to distinguish between the data processing process and the screen display process of the display module 100, a distinction is made here between "image" and "screen". The data (and display content data) transmitted in the form of data (such as pixel values) between the first display module 110, the second display modules 120a, 120b and related devices (such as external devices), as well as the data objects processed by the first display module 110 are all referred to as display images (or images). The display content displayed on the display screens of the first display module 110 and the second display modules 120a, 120b, as well as the display content that the user can view through the first display module 110 and the second display modules 120a, 120b are all referred to as display screens (or screens). Therefore, the first display module 110 can obtain a main display image and multiple auxiliary display images, and send the multiple auxiliary display images to the multiple second display modules 120a, 120b respectively. The first display module 110 displays the main display image to form the display screen of the first display module 110. It is understood that the main display image is consistent with the content represented by the display screen of the first display module 110. The multiple second display modules 120a and 120b respectively display their respective auxiliary display images to form their own display screens. It is understood that the multiple auxiliary display images are consistent with the content represented by the display screen of the corresponding second display module.

[0065] In the disclosed embodiment, a multi-screen display and a touch module 130 form a touch screen display. The touch module 130 includes a touch component, which is a component used to determine user gestures received by the multi-screen display screen. For example, the display area of ​​the multi-screen display includes the display area of ​​the first display module 110 and the display areas of the multiple second display modules 120a and 120b. The touch component covers the first display module 110 and the multiple second display modules 120a and 120b and can detect touch operations within the display area of ​​the display module 100.

[0066] For example, the touch component can be integrated into the first display module 110 and the multiple second display modules 120a, 120b, or it can be set on the surface of the first display module 110 and the multiple second display modules 120a, 120b. The touch component provides a touch area for the multi-screen display. The area covered by the touch component on the first display module 110 and the multiple second display modules 120a, 120b is the touch area of ​​the first display module 110 and the multiple second display modules 120a, 120b. When a user performs a touch operation on the screen (within the touch area) of the first display module 110 and the multiple second display modules 120a, 120b, the touch component receives the touch operation.

[0067] For example, the touch module 130 and the first display module 110 may be connected via a wired connection or a wireless connection. The touch module 130 sends the touch command to the first display module 110 via a wired transmission or a wireless transmission.

[0068] A touch operation is a touch gesture performed by a user on the screen of the multi-screen display, for example, a touch gesture may include clicking, touching and holding, double-clicking, dragging, panning, flicking, or dragging and dropping.

[0069] For example, a "click" is a gesture in which a user touches the screen with a finger or a touch tool (e.g., an electronic pen) and then immediately lifts the finger or touch tool from the screen without dragging it on the screen. A "touch and hold" is a gesture in which a user touches the screen with a finger or a touch tool (e.g., an electronic pen) and maintains the touch for more than a critical period (e.g., 2 seconds). That is, the time difference between the time point of touching the screen and the time point of lifting from the screen is longer than the critical period (e.g., 2 seconds). A "double-click" is a gesture in which a user touches the screen twice with a finger, a touch tool, or a stylus. A "drag" is a gesture in which a user touches the screen with a finger or a touch tool and moves the finger or touch tool to another location on the screen while maintaining the touch. When dragging is performed, the object moves, or the translation gesture described below is performed. A "translation" gesture is a gesture in which a user performs a drag without selecting an object. Since translation does not select a specific object, the object does not move on the page, and the page moves on the screen, or a group of objects moves on the page. A "flick" is a gesture in which a user performs a drag with a finger or a touch tool at a critical speed or higher (e.g., 100 pixels per second). Flicking can be distinguished from dragging or panning based on whether the movement speed of the finger or touch tool is equal to or higher than a critical speed (e.g., 100 pixels / second). "Drag and drop" is a gesture in which a user drags an object on the screen to a predetermined location using a finger or touch tool and then lifts the finger or touch tool from the screen.

[0070] In the embodiment of the present disclosure, the number of second display modules 120a and 120b shown in FIG1 is merely exemplary. The number of second display modules may be one or more. For example, the display module 100 may include only the second display module 120a or only the second display module 120b. In the following description, unless otherwise specified, the display module 100 is illustrated as including two second display modules 120a and 120b. However, the number of display modules may be one, three, four, etc., without limitation.

[0071] In the disclosed embodiment, the plurality of second display modules 120a and 120b are respectively communicatively connected to the first display module 110. For example, the first display module 110 and the plurality of second display modules 120a and 120b may be connected via a wired and / or wireless communication link. Based on the communication link, the first display module 110 may send a secondary display image to the plurality of second display modules 120a and 120b. For example, the wired communication link may be a data cable or a wired network. For example, the wireless communication link may be a wireless local area network, a WiFi network, Bluetooth, etc.

[0072] For example, the first display module 110 and the plurality of second display modules 120a, 120b can be spliced ​​horizontally to form a multi-screen display, or they can be spliced ​​vertically to form a multi-screen display. Within the plane of the first display module 110, the horizontal direction is perpendicular to the vertical direction. The display screens of the first display module 110 and the plurality of second display modules 120a, 120b can have the same or different sizes. The display screens of the plurality of second display modules 120a, 120b can have the same or different sizes.

[0073] For example, the first display module 110 can be an 86-inch display, and the multiple second display modules 120a and 120b can be two 63-inch displays. The resolution of the display screen of the first display module 110 is 3840*2160, and the resolution of the display screens of the second display modules 120a and 120b is 2400*2160. The first display module 110 and the two second display modules 120a and 120b are horizontally spliced ​​to obtain a multi-screen display with a resolution of 8640*2160. The two second display modules 120a and 120b are respectively located on the left and right sides of the first display module 110. The first display module 110 can be the main display screen of the multi-screen display, and the two second display modules 120a and 120b can be the two secondary display screens of the multi-screen display.

[0074] For example, resolution refers to the number of pixels that a display can display. For example, a resolution of 3840*2160 means that the display can display 2160 rows of pixels, with each row of pixels containing 3840 pixels.

[0075] In the disclosed embodiment, the first display module 110 generates multiple display images corresponding to the display mode. The multiple display images include a primary display image and at least one secondary display image. The first display module 110 displays the primary display image. The first display module 110 transmits the at least one secondary display image to at least one second display module. The at least one second display module receives the at least one secondary display image from the first display module 110 and displays the at least one secondary display image.

[0076] For example, when at least one second display module includes only the second display module 120a or the second display module 120b, the first display module 110 generates one main display image and one sub-display image corresponding to the display mode. The first display module 110 displays the main display image, and the second display module 120a or the second display module 120b displays the sub-display image. For another example, when at least one second display module 120 includes the second display module 120a and the second display module 120b, the first display module 110 generates one main display image and two sub-display images corresponding to the display mode. The first display module 110 displays the main display image, and the second display module 120a and the second display module 120b each display a sub-display image.

[0077] In the embodiment of the present disclosure, the touch module 130 is disposed on the first display module 110 and at least one second display module 120 a and 120 b.

[0078] For example, the touch module 130 may be an infrared touch module, a capacitive touch module, a capacitive touch module, an electromagnetic touch module, etc. For example, the infrared touch module may be disposed on the frame of the first display module 110 and the at least one second display module 120a, 120b, and the capacitive touch module and the electromagnetic touch module may be integrated within the first display module 110 and the at least one second display module 120a, 120b.

[0079] In the embodiment of the present disclosure, when the touch module 130 is an infrared touch module, the touch module 130 exists in pairs. The touch module 130 can be a pair of signal transmitter and signal receiver, and the signal transmitter and signal receiver can be respectively arranged on two opposite sides of the display module 100. For example, the signal transmitter transmits a signal, and the signal receiver located opposite the signal transmitter receives the signal from the transmitter. When there is no touch operation on the screen of the display module 100, the signal receiver can receive all the signals transmitted by the signal transmitter. When there is a touch operation on the screen of the display module 100, part of the signal transmitted by the signal transmitter will be blocked by the user's finger or touch tool, so the signal transmitter cannot receive all the signals sent by the signal transmitter. According to the signal transmission situation of the signal transmitter and the signal reception situation of the signal receiver, the area where the signal is blocked is determined, so that the operating range of the touch operation can be determined.

[0080] For example, the first display module 110 and at least one second display module 120a, 120b are spliced ​​in the horizontal direction, and the touch module 130 can be set on the horizontal edges of the first display module 110 and at least one second display module 120a, 120b, such as the upper and lower sides of the first display module 110 and at least one second display module 120a, 120b, which enables the touch module 130 to be set on the upper and lower sides of the multi-screen display.

[0081] For another example, the first display module 110 and at least one second display module 120a, 120b are spliced ​​in the vertical direction, and the touch module 130 can be set on the vertical edges of the first display module 110 and at least one second display module 120a, 120b, such as the left and right sides of the first display module 110 and at least one second display module 120a, 120b, which enables the touch module 130 to be set on the left and right sides of the multi-screen display.

[0082] For another example, the touch modules 130 may also be disposed on the upper and lower sides and the left and right sides of the multi-screen display to form touch frames disposed on the four sides of the multi-screen display.

[0083] If the horizontal length of the multi-screen display is too long, the touch modules 130 can be installed only on the upper and lower sides of the multi-screen display. Because the horizontal length of the multi-screen display is too long, the touch modules 130 installed on the left and right sides of the multi-screen display may not be aligned due to the long distance, resulting in touch failure. If the vertical length of the multi-screen display is too long, the touch modules 130 can be installed only on the left and right sides of the multi-screen display. Because the vertical length of the multi-screen display is too long, the touch modules 130 installed on the upper and lower sides of the multi-screen display may not be aligned due to the long distance, resulting in touch failure.

[0084] In the embodiment of the present disclosure, when the touch module 130 is a capacitive touch module, the touch module 130 is integrated into the display module 100. When a user's finger or a touch tool performs a touch operation on the screen of the display module 100, the operating range of the touch operation is determined based on the current changes within the touch module 130.

[0085] In the embodiment of the present disclosure, when the touch module 130 is an electromagnetic touch module, the touch module 130 is integrated into the display module 100. When the electromagnetic pen performs a touch operation on the screen of the display module 100, the operating range of the touch operation is determined according to the change of the magnetic field inside the touch module 130.

[0086] In an embodiment of the present disclosure, the touch module determines a target touch trajectory based on the received touch operation, and sends the target touch trajectory to the first display module 110. For example, the touch operation is a gesture performed by a user's finger or a touch tool on the screen of the multi-screen display, that is, a gesture formed by the user's finger or the touch tool within the touch component. The target touch trajectory can represent the position information of the contact between the user's finger or the touch tool and the screen of the multi-screen display, that is, the position information of the contact area between the user's finger or the touch tool and the screen within the touch component. For example, the target touch trajectory can be the contact position of the user's finger on the screen when the user performs a click gesture. The target touch trajectory can also be the contact position of the user's finger on the screen when the user performs a swiping operation.

[0087] In an embodiment of the present disclosure, the first display module 110 updates the display screen of the multi-screen display based on a target touch trajectory. Based on the instruction corresponding to the target touch trajectory, the first display module 110 updates the current display screen of the multi-screen display and generates an updated image corresponding to the instruction. For example, the updated image may be obtained by processing the initial image, such as by modifying part of the initial image's image content. The updated image may also be a completely different new image from the initial image. For example, if the initial image is the first image stored in the "Album" application, and the user inputs a touch operation to browse all images in the "Album", the updated image may be the second image stored in the "Album" application. The first display module 110 further processes the updated image based on the current display mode of the multi-screen display and the number of second display modules 120a and 120b to obtain an updated primary display image and at least one secondary display image. The first display module 110 displays the updated primary display image, and the at least one secondary display image is displayed by the at least one second display module 120a and 120b, respectively.

[0088] In the embodiment of the present disclosure, the display module 100 is a touch-sensitive multi-screen display. The first display module 110 is used as the main control unit to control the screen display of the first display module 110 and the second display modules 120a and 120b. During the screen display process, the first display module 110 can generate display images that are respectively adapted to the first display module 110 and the second display modules 120a and 120b according to the display mode and the number of display modules included in the multi-screen display. During the touch processing process, the touch module 130 converts the touch operation into a target touch trajectory, and then the first display module 110 updates the current display screen of the multi-screen display based on the target touch trajectory, thereby ensuring the normal operation of the display process and the touch process of the display module 100.

[0089] In the embodiments of the present disclosure, display modes may include a multi-screen joint display mode and a multi-screen independent display mode. The "multi-screen joint display mode" is a display mode in which multiple display modules are used to jointly display an image, wherein each display module displays a portion of the image, and the display screens of the multiple display modules are spliced ​​to form the image. The "multi-screen independent display mode" is a display mode in which multiple display modules are used to separately display multiple images, wherein each display module independently displays one of the multiple images, and the image content of the multiple images may be the same or different.

[0090] The first display module 110 can convert the initial image corresponding to the display mode into an image displayed by each display module according to the display mode and the display properties of each display module. When each display module displays its own image, the corresponding display mode can be realized. In the embodiment of the present disclosure, when it is determined that the display mode is the first display mode, the first display module 110 divides the initial image into a main display image and at least one sub-display image according to the display properties of the first display module 110 and at least one second display module 120a, 120b. When it is determined that the display mode is the second display mode, the first display module 110 converts the initial image according to the display properties of the first display module 110 and at least one second display module 120a, 120b to obtain a main display image and at least one sub-display image. The first display module 110 sends the at least one sub-display image to the at least one second display module 120a, 120b respectively.

[0091] For example, the display attribute may be the resolution of the display module. According to the resolution of the display module, the first display module 110 may process the main display image and the auxiliary display image so that the sizes of the main display image and the auxiliary display image are adapted to the resolution of the display module.

[0092] In an embodiment of the present disclosure, the first display module is configured as 110 to, when determining that the display mode is the first display mode, determine the first display resolution of the first display module 110 and the second display resolution of at least one second display module 120a, 120b; divide the initial image according to the ratio between the first display resolution and the second display resolution to obtain an initial main display image and at least one initial sub-display image; when determining that the resolution of the initial main display image is inconsistent with the first display resolution, convert the resolution of the initial main display image to the first display resolution to obtain the main display image; and when determining that the resolution of at least one initial sub-display image is inconsistent with the second display resolution, convert the resolution of at least one initial sub-display image to the second display resolution to obtain at least one sub-display image.

[0093] For example, if the number of vertical pixels in the resolution of the first display module 110 and the plurality of second display modules 120a and 120b is the same, the initial image can be proportionally divided based on the ratio between the number of horizontal pixels in the resolution of the first display module 110 and the plurality of second display modules 120a and 120b to obtain three initial sub-images. The three initial sub-images include an initial main display image and two initial sub-display images. Based on the resolution of the first display module 110 and the plurality of second display modules 120a and 120b, the three initial sub-images are scaled to obtain a main display image and a plurality of sub-display images. The size of the main display image is consistent with the resolution of the first display module 110. The plurality of sub-display images are consistent with the resolution of the plurality of second display modules 120a and 120b, respectively.

[0094] For example, the first display mode is a multi-screen joint display mode. In the multi-screen joint display mode, the initial image can be a display image. The first display module 110 divides a display image into multiple display sub-images, and multiple display modules respectively display the multiple display sub-images. This enables the multi-screen display to use multiple display modules to jointly display a display image, and the display images of the multiple display modules are spliced ​​to form the display image.

[0095] In multi-screen joint display mode, touch operations received by the touch module 130 are directed to both the first display module 110 and the second display modules 120a and 120b. For example, when a touch operation is performed only on the screen of the first display module 110, the display screen of the first display module 110 and the display screens of the second display modules 120a and 120b are both controlled. When the display screen of the first display module 110 needs to be updated, the display screens of the second display modules 120a and 120b are also updated accordingly.

[0096] For example, the second display mode is a multi-screen independent display mode. In the multi-screen independent display mode, the initial image can be one display image or multiple display images. For example, the first display module 110 can convert one display image into multiple display images, and the multiple display images are displayed separately by multiple display modules, which enables the multi-screen display to utilize multiple display modules to independently display multiple identical display images. For example, the first display module 110 can also convert multiple different display images into multiple display images adapted to multiple display modules, which are displayed separately by multiple display modules, which enables the multi-screen display to utilize multiple display modules to independently display multiple different display images.

[0097] In multi-screen joint display mode, the touch operation received by the touch module 130 may be directed only to at least one of the first display module 110 and the second display modules 120a and 120b. For example, when the touch operation is only on the screen of the first display module 110, the display of the first display module 110 is controlled, and the display of the second display modules 120a and 120b may not be affected. When the display of the first display module 110 needs to be updated, the display of the second display modules 120a and 120b may not be updated. When the touch operation is only on the display area of ​​the first display module 110 and the screen of the second display module 120a, the display of the first display module 110 and the display of the second display module 120a are controlled, and the display of the second display module 120b may not be affected. When the display of the first display module 110 and the display of the second display module 120a need to be updated, the display of the second display module 120b may not be updated. The first display mode is schematically illustrated in conjunction with Figures 2A, 2B, and 2C. The second display mode is schematically illustrated in conjunction with Figures 3A, 3B, and 3C. It should be noted that Figures 2A, 2B, 2C, 3A, 3B, and 3C all correspond to the display module 100 shown in Figure 1, including a first display module and two second display modules. The resolution of the display screen of the first display module 110 is 3840*2160, and the resolution of the display screen of the second display modules 120a and 120b is 2400*2160. The first display module 110 and the two second display modules 120a and 120b are spliced ​​in the horizontal direction, and the resolution of the multi-screen display obtained by splicing the first display module 110 and the two second display modules 120a and 120b is 8640*2160. The two second display modules 120a and 120b are respectively located on the left and right sides of the first display module 110. The first display module 110 can be the main display screen of the multi-screen display, and the two second display modules 120a and 120b are the two sub-display screens of the multi-screen display.

[0098] Figure 2A is a schematic diagram of a display image of the first display mode according to an embodiment of the present disclosure, Figure 2B is a schematic diagram of a processed display image of the first display mode according to an embodiment of the present disclosure, and Figure 2C is a schematic diagram of a processed touch operation of the first display mode according to an embodiment of the present disclosure.

[0099] As shown in FIG. 2A , in the multi-screen joint display mode, the first display module processes the initial image to obtain a main display image 201 , a subsidiary display image 202_1 , and a subsidiary display image 202_2 .

[0100] In an embodiment of the present disclosure, when the resolution of the initial image (e.g., image 20) is not compatible with the resolution of the multi-screen display, the first display module may perform computational processing on image 20 to obtain an image to be divided (e.g., image 21), and then divide image 21. When the resolution of the initial image (e.g., image 21) is compatible with the resolution of the multi-screen display, the first display module directly divides the obtained image 21. For example, when the resolution of the initial image is the same as the resolution of the multi-screen display, it is considered that the resolution of the initial image is compatible with the resolution of the multi-screen display. When the resolution of the initial image is different from the resolution of the multi-screen display, it is considered that the resolution of the initial image is compatible with the resolution of the multi-screen display.

[0101] In the embodiment of the present disclosure, the x direction is the horizontal direction, and the y direction is the vertical direction. The first display module divides the image 21 in the horizontal direction according to the resolution of the multi-screen display to obtain a main display image 201, a sub-display image 202_1, and a sub-display image 202_2. The resolution of the main display image 201 is adapted to the resolution of the first display module, and the resolutions of the sub-display image 202_1 and the sub-display image 202_2 are respectively adapted to the resolutions of their respective corresponding second display modules. With reference to Figure 1, for example, the multiple display images generated by the first display module 110 may include the main display image 201, sub-display image 202_1, and sub-display image 202_2 shown in Figure 2A. The main display image 201, sub-display image 202_1, and sub-display image 202_2 can be obtained by the first display module 110 directly dividing the image 21, or they can be obtained by the first display module 110 converting the image 20 into the image 21 and then dividing the image 21. The resolution of the main display image 201 is the same as that of the first display module 110 , the resolution of the subsidiary display image 202_1 is the same as that of the second display module 120 a , and the resolution of the subsidiary display image 202_2 is the same as that of the second display module 120 b .

[0102] As shown in Figure 2B, the resolution of image 21 is 8640*2160. Image 21 includes 2160 rows of pixels, each row of pixels including 8640 pixels. The first display module divides image 21 into a primary display image 201, a secondary display image 202_1, and a secondary display image 202_2 based on the horizontal pixel ratio of the three display modules (2400:3840:2400). The resolution of primary display image 201 is 3840*2160, and the resolutions of secondary display images 202_1 and 202_2 are 2400*2160.

[0103] In the embodiment of the present disclosure, the first display module can divide the image 21 row by row. For example, the first display module obtains the first row of pixel data L1 of the image 21, which can be the pixel values ​​of 8620 pixels in the first row of the image 21.

[0104] Based on the horizontal pixel ratio of the three display modules (2400:3840:2400), the first row of pixel data L1 is divided into first row of pixel sub-data L1_1, first row of pixel sub-data L1_2, and first row of pixel sub-data L1_3. The first row of pixel sub-data L1_1 includes pixel values ​​of pixels 1 to 2400 of the first row of pixel data L1, the first row of pixel sub-data L1_2 includes pixel values ​​of pixels 2401 to 6240 of the first row of pixel data L1, and the first row of pixel sub-data L1_3 includes pixel values ​​of pixels 6241 to 8460 of the first row of pixel data L1.

[0105] The first row of pixel sub-data L1_1 is the pixel values ​​of the first row of 2400 pixels of the auxiliary display image 202_1 , the first row of pixel sub-data L1_2 is the pixel values ​​of the first row of 3840 pixels of the main display image 201 , and the first row of pixel sub-data L1_3 is the pixel values ​​of the first row of 2400 pixels of the auxiliary display image 202_2 .

[0106] Based on a similar method, the first display module can sequentially divide the pixels of the 2nd to 2160th rows of the image 21 to obtain the main display image 201 , the auxiliary display image 202_1 and the auxiliary display image 202_2 .

[0107] Figure 2C shows the correspondence between the pixel locations of the displayed image in the first display mode and the touch coordinates within the coordinate system of the first display mode. The coordinate system of the first display mode is determined based on the display area of ​​the multi-screen display. The user can perform touch operations in the display area of ​​the multi-screen display, and the display area of ​​the multi-screen display can overlap with the touch area provided by the touch component. The display area of ​​the multi-screen display includes the display area of ​​the first display module and the display area of ​​the second display module, and the touch area of ​​the multi-screen display includes the touch area of ​​the first display module and the touch area of ​​the second display module.

[0108] As shown in Figure 2C, a coordinate system is established with the position of the first pixel in the first row of image 21 as the zero point of the coordinate system, the pixels in the first row as the x-axis, and the pixels in the first column as the y-axis. In the embodiment of the present disclosure, the display screen of the multi-screen display is an image 21 with a resolution of 8640*2160. The position range of 0-8640 pixels in each row of image 21 is mapped to a coordinate range of 0-32767, and the position range of 0-2160 pixels in each column of image 21 is mapped to a coordinate range of 0-32767. Therefore, the x-axis coordinate range of the multi-screen display is 0-32767, and the y-axis coordinate range is 0-32767. The coordinate system of the multi-screen display is a coordinate system established with the first pixel in the first row of the multi-screen display as the origin.

[0109] For example, in the coordinate system of the multi-screen display, the coordinates of the 8640th pixel in the 1st row of image 21 are (32767, 0), and the coordinates of the 1st pixel in the 2160th row of image 21 are (0, 32767).

[0110] With reference to FIG1 , for example, the resolution of the first display module 110 is 3840*2160, and the resolution of the display screens of the second display modules 120a and 120b is 2400*2160. Pixels 1 to 2400 of the first row of image 21 are displayed on the second display module 120a, and the corresponding horizontal coordinates of the second display module 120a range from approximately 0 to 9101. Pixels 2401 to 6240 of the first row of image 21 are displayed on the first display module 110, and the corresponding coordinates of the first display module 110 range from approximately 9102 to 23665. Pixels 6241 to 8640 of the first row of image 21 are displayed on the second display module 120b, and the corresponding horizontal coordinates of the second display module 120b range from approximately 23666 to 32767. The vertical coordinate ranges of the first display module 110 and the second display modules 120a and 120b are both 0 to 32767. Therefore, the coordinate system of the first display mode is the coordinate system of the multi-screen display, which is established based on the touch area of ​​the multi-screen display.

[0111] In an embodiment of the present disclosure, the position range of pixel points is mapped with a coordinate range that is larger than the number of pixel points, which can accurately express the correspondence between touch operations and pixel points. For example, based on the coordinate system provided by the present disclosure, in the x-axis direction, the coordinate interval corresponding to each pixel point is approximately (0, 3.8). In the y-axis direction, the coordinate interval corresponding to each pixel point is approximately (0, 15.2). Only when the touch coordinates can accurately describe the pixel points corresponding to the touch operation can the displayed image be accurately updated based on the touch operation. It should be noted that the present disclosure does not limit the mapping range. For example, the present disclosure can also be based on (0, 2 7)、(0,2 8 ) and (0, 2 9 ) and other ranges to map the position range of the pixel points.

[0112] In an embodiment of the present disclosure, when the display mode of the multi-screen display is the multi-screen joint display mode, the touch module receives a touch operation and determines all touch coordinates included in the touch operation that are determined based on the coordinate system of the multi-screen display, thereby determining the target touch trajectory in the multi-screen joint display mode.

[0113] In an embodiment of the present disclosure, the touch module determines an initial touch trajectory of the touch operation based on the touch operation in response to a first instruction from the first display module, wherein the first instruction instructs the touch module to switch to the first display mode. The initial touch trajectory serves as a target touch trajectory, and the touch coordinates included in the initial touch trajectory are determined based on the coordinate system of the multi-screen display.

[0114] For example, a touch operation is determined by the touch module based on a gesture performed by the user on the screen of the first display module and the screens of multiple second display modules. The user performs an operation on the screen through a finger or a touch tool, and the contact area of ​​the finger or touch tool with the screen forms a touch track, and the operation range of the touch operation is the range of the contact area. The initial touch track is all the coordinate points covered by the contact area in the coordinate system of the multi-screen display. The touch coordinates are the coordinate data of all the coordinate points included in the touch track, and the initial touch track includes the coordinate data of all the coordinate points in the contact area. The coordinate data included in the initial touch track is the coordinate data determined based on the coordinate system of the multi-screen display, and the coordinate data included in the target touch track is the coordinate data determined based on the coordinate system of the first display mode.

[0115] For example, if the touch operation is a click operation, a user's finger or touch tool forms a touch track with the contact area of ​​the screen when performing the click operation. For example, the contact area corresponding to the click operation is a 1cm*1cm screen area. The initial touch track is the coordinate data of all coordinate points within the 1cm*1cm screen area.

[0116] For example, when the display mode is the multi-screen joint display mode, the first display module sends a first instruction to the touch module, and the first instruction instructs the touch module to switch to the multi-screen joint display mode. In the multi-screen joint display mode, the touch operation is directed to the overall display screen of the multi-screen display. Since the coordinate system of the multi-screen joint display mode is the coordinate system of the multi-screen display, the touch module determines the initial touch trajectory of the touch operation based on the coordinate system of the multi-screen display shown in Figure 2C, and sends the initial touch trajectory as the target touch trajectory to the first display module. At this time, the coordinate system corresponding to the touch coordinates included in the target touch trajectory is the coordinate system of the multi-screen display. This enables the first display module to update the overall picture displayed by the multi-screen display based on the touch coordinates determined by the coordinate system of the multi-screen display, thereby realizing overall touch control of the multi-screen display. The overall picture displayed by the multi-screen display includes the pictures displayed by the first display module and multiple second display modules. In the multi-screen joint display mode, the images displayed by the first display module and the multiple second display modules can be updated synchronously based on the touch operation, thereby realizing synchronous touch control of the first display module and the multiple second display modules.

[0117] In the disclosed embodiment, when it is determined that the display mode is the first display mode and the initial image comes from the first display module, the first display module can generate an updated image according to the target touch trajectory, and based on the division method shown in Figure 2B, divide the updated image into an updated main display image and an updated sub-display image, and send the updated sub-display images to the corresponding second display modules respectively.

[0118] For example, the first display module can use a picture from inside the display module as the initial image. For example, an operating system can be installed in the first display module. The first display module can use a picture output by an application running in the display module as the initial image, or a picture stored in the display module as the initial image.

[0119] When it is determined that the initial image comes from inside the display module, the first display module processes the initial image based on the target touch trajectory to obtain an updated image, and divides the updated image into an updated main display image and an updated sub-display image. This allows the first display module and multiple second display modules to respectively display part of the updated image, thereby realizing the joint display of the updated image.

[0120] In the disclosed embodiment, the initial image may also be provided from outside the display module. For example, the first display module is in communication with an external device. For example, the external device may be any electronic device with processing capabilities.

[0121] For example, in a smart classroom, a smartphone can be used as an external device to communicate with the first display module. The connection between the smartphone and the first display module can be wired or wireless. The teacher can use the smartphone to send an image stored on the smartphone as the initial image to the first display module. Alternatively, the teacher can use the smartphone to download an image from the internet and send the downloaded image as the initial image to the first display module. For example, the initial image can be a slide file or an image of homework content.

[0122] The first display module receives an initial image from a smartphone and divides the initial image into a main display image and multiple sub-display images. The first display module displays the main display image, and the multiple second display modules display the multiple sub-display images. The teacher can perform a touch operation on the first display module or the multiple second display modules. The first display module sends the target touch trajectory to the smartphone. The smartphone processes the initial image based on the target touch trajectory to obtain an updated image, and sends the updated image to the first display module. The first display module divides the updated image from the smartphone into an updated main display image and updated sub-display images, allowing the first display module and the multiple second display modules to jointly display new images from an external device.

[0123] For example, when it is determined that the display mode is the first display mode and the initial image comes from an external device, the first display module can send the target touch trajectory to the external device, receive the updated image obtained by the external device based on the target touch trajectory, and based on the division method shown in Figure 2B, divide the updated image into an updated main display image and an updated sub-display image, and send the updated sub-display images to the corresponding second display modules respectively.

[0124] For example, an external device is a device connected to the display module 100 shown in FIG1 . An external device is a device that is independent of the display module 100 and has the ability to independently process data. For example, the external device may be a device that complies with the Open Plugable Specification (OPS), and the OPS device is connected to the display module 100 via an OPS slot. Alternatively, the external device may be a device connected to the display module 100 via a wireless network.

[0125] For example, an external device is connected to the first display module of the display module, and the external device sends an initial image to the first display module. The first display module divides the initial image from the external device so that the first display module and multiple second display modules can jointly display the initial image from the external device. When the first display module obtains a target touch trajectory for the entire image displayed by the multi-screen display, the first display module sends the target touch trajectory to the external device. The external device processes the initial image based on the target touch trajectory to obtain an updated image, and sends the updated image to the first display module. The first display module divides the updated image from the external device to obtain an updated main display image and an updated sub-display image, which allows the first display module and multiple second display modules to jointly display the new image from the external device.

[0126] In an embodiment of the present disclosure, in the first display mode, the touch module determines the target touch trajectory based on the coordinate system of the multi-screen display, so that the first display module can update the overall picture displayed by the multi-screen display based on the target touch trajectory, thereby realizing the overall touch function of the multi-screen display.

[0127] 3A is a schematic diagram of a display image in a second display mode according to an embodiment of the present disclosure, and FIGS. 3B and 3C are schematic diagrams of processing a touch operation in the second display mode according to an embodiment of the present disclosure.

[0128] As shown in FIG3A , in the multi-screen independent display mode, the first display module processes a plurality of initial images to obtain a main display image 301 , a subsidiary display image 302_1 , and a subsidiary display image 302_2 .

[0129] In the embodiment of the present disclosure, if the resolutions of multiple initial images (e.g., image 30_1, image 30_2, and image 30_3) do not match the resolutions of the corresponding display modules, the first display module can perform computational processing on images 30_1, 30_2, and 30_3 to obtain a primary display image 301, a secondary display image 302_1, and a secondary display image 302_2. For example, the computational processing can be image resolution conversion.

[0130] For example, when it is determined that the resolution of image 30_1 is different from the resolution of the second display module 120a, the first display module 110 converts the resolution of image 30_1 to obtain a secondary display image 302_1. Similarly, when it is determined that the resolution of image 30_2 is different from the resolution of the first display module 110, the first display module 110 converts the resolution of image 30_2 to obtain a primary display image 301. When it is determined that the resolution of image 30_3 is different from the resolution of the second display module 120b, the first display module 110 converts the resolution of image 30_3 to obtain a secondary display image 302_2.

[0131] For example, the resolution of the main display image 301 is 3840*2160, and the resolutions of the sub-display image 302_1 and the sub-display image 302_2 are 2400*2160.

[0132] With reference to Figure 1 , for example, the multiple display images generated by the first display module 110 may include the primary display image 301, secondary display image 302_1, and secondary display image 302_2 shown in Figure 3A . The primary display image 301, secondary display image 302_1, and secondary display image 302_2 may be obtained by the first display module 110 through resolution conversion based on image 30_1, image 30_2, and image 30_3. The resolution of the primary display image 301 is the same as that of the first display module 110, the resolution of the secondary display image 302_1 is the same as that of the second display module 120a, and the resolution of the secondary display image 302_2 is the same as that of the second display module 120b. When the resolutions of image 30_1, image 30_2, and image 30_3 are the same as those of the three display modules, the multiple display images generated by the first display module 110 may include image 30_1, image 30_2, and image 30_3.

[0133] Figures 3B and 3C illustrate the correspondence between the pixel positions of the image displayed on the second display module and the touch coordinates in the coordinate system of the second display mode. As shown in Figure 3B, a coordinate system is established with the position of the first pixel in the first row of the image displayed on the multi-screen display as the zero point of the coordinate system, the pixels in the first row as the x-axis, and the pixels in the first column as the y-axis.

[0134] In the disclosed embodiment, in the multi-screen independent display mode, the overall display image of the multi-screen display includes multiple independent display images. The position range of 0-8640 pixels in each row of the overall display image is mapped to a coordinate range of 0-32767, and the position range of 0-2160 pixels in each column of the overall display image is mapped to a coordinate range of 0-32767. Based on the horizontal pixel ratios of the main display image 301 and the auxiliary display images 302_1 and 302_2 shown in Figure 3A, it can be determined that the x-axis coordinate range corresponding to the auxiliary display image 302_1 is 0-9101, the x-axis coordinate range corresponding to the main display image 302 shown in Figure 3B is 9102-23665, and the x-axis coordinate range corresponding to the auxiliary display image 302_2 is 23666-32767.

[0135] For example, similar to the coordinate system shown in FIG2C , the x-axis coordinate range corresponding to the multi-screen display is 0-32767, and the y-axis coordinate range is 0-32767. In conjunction with FIG1 , the x-axis coordinate range corresponding to the second display module 120a corresponding to the secondary display image 302_1 is 0-9101, and the y-axis coordinate range is 0-32767. The x-axis coordinate range corresponding to the first display module 110 is 9102-23665, and the y-axis coordinate range is 0-32767. The x-axis coordinate range corresponding to the second display module 120b corresponding to the secondary display image 302_2 is 23666-32767, and the y-axis coordinate range is 0-32767.

[0136] Figure 3B shows the coordinate range of each display module in the coordinate system of the multi-screen display. Figure 3C shows the independent coordinate system of each display module.

[0137] Within each display module's independent coordinate system, the position range of pixels in each row of each display module can also be mapped to a coordinate range of 0-32767, and the position range of pixels in each column of each display module can be mapped to a coordinate range of 0-32767. For example, the position range of pixels 0-3840 in each row of the first display module can be mapped to a coordinate range of 0-32767, and the position range of pixels 0-2160 in each column of the first display module can be mapped to a coordinate range of 0-32767. Therefore, the x-axis coordinate range for the first display module is 0-32767, and the y-axis coordinate range is 0-32767.

[0138] In an embodiment of the present disclosure, a user can perform touch operations on the display areas of the first display module and the second display module, respectively. The display areas of the first display module and the second display module can overlap with the touch areas provided by the touch components for each of them. The coordinate system of the second display mode is an independent coordinate system for each display module. The independent coordinate system of each display module is established based on the touch area of ​​the display module. For example, the coordinate system of the first display module is established based on the touch area of ​​the first display module, and the coordinate system of the second display module is established based on the touch area of ​​the second display module. When the display mode of the multi-screen display is the multi-screen independent display mode, the touch module receives the touch operation and determines all touch coordinates determined based on the coordinate system of the multi-screen display included in the touch operation, and then determines that all touch coordinates are converted into touch coordinates in the independent coordinate system of each display module according to the respective coordinate systems of each display module, thereby determining the target touch trajectory in the multi-screen independent display mode.

[0139] In an embodiment of the present disclosure, the touch module, in response to a second instruction from the first display module, determines an initial touch trajectory of the touch operation based on the touch operation, wherein the second instruction instructs the touch module to switch to the second display mode; and converts the initial touch trajectory into a target touch trajectory based on the display properties of the first display module and at least one second display module. The target touch coordinates included in the target touch trajectory are determined based on the coordinate system of the target display module, which includes at least one of the first display module and at least one second display module.

[0140] For example, the initial touch trajectory is all coordinate points covered by the contact area between the finger or touch tool and the screen in the coordinate system of the multi-screen display. The coordinate data included in the initial touch trajectory is coordinate data determined based on the coordinate system of the multi-screen display. The coordinate data included in the target touch trajectory is coordinate data determined based on the coordinate system of the second display mode.

[0141] For example, when the display mode of the multi-screen display is the multi-screen independent display mode, the first display module sends a second instruction to the touch module, and the second instruction instructs the touch module to switch to the multi-screen independent display mode. In the multi-screen independent display mode, the touch operation is individually targeted at the display screen of each display module. Since the coordinate system of the multi-screen independent display mode is an independent coordinate system for each display module, the touch module determines the initial touch trajectory of the touch operation based on the coordinate system of the multi-screen display, and then converts the sub-trajectories of the initial touch trajectory located in different display modules into target touch trajectories in the independent coordinate system of the corresponding display module.

[0142] For example, in conjunction with Figure 1, when the initial touch trajectory is located on the screens of the first display module and the second display module 120b, the first display module and the second display module 120b are target display modules. The sub-trajectory of the initial touch trajectory located on the screen of the first display module is converted into a first target touch trajectory within the independent coordinate system of the first display module, and the sub-trajectory of the initial touch trajectory located on the screen of the second display module 120b is converted into a second target touch trajectory within the independent coordinate system of the second display module 120b. At this time, the touch coordinates included in the first target touch trajectory are determined based on the independent coordinate system of the first display module, and the touch coordinates included in the second target touch trajectory are determined based on the independent coordinate system of the second display module 120b. This allows the first display module to separately update the display screen of the corresponding display module based on the target touch trajectory in the independent coordinate system of each display module, thereby realizing independent touch control of each display module.

[0143] A coordinate conversion method for a second display mode is disclosed.

[0144] In an embodiment of the present disclosure, the touch module determining an initial touch trajectory of the touch operation based on the touch operation may include: determining the initial touch trajectory based on the coordinate system of the multi-screen display when the display mode is determined to be the second display mode. The touch module converting the initial touch trajectory into a target touch trajectory based on the display properties of the first display module and at least one second display module may include determining the target display module for each of the multiple initial touch coordinates included in the initial touch trajectory; and converting the multiple initial touch coordinates into multiple target touch coordinates based on the coordinate system of the target display module for each of the multiple initial touch coordinates to obtain the target touch trajectory.

[0145] In the disclosed embodiment, the coordinate system of the multi-screen display is shown in FIG3B . Based on the resolutions of the first and second display modules, the coordinate system of the multi-screen display can be divided, resulting in the coordinate system of the first and second display modules, as shown in FIG3C . In the second display mode, the touch module converts the initial touch coordinates within the coordinate system shown in FIG3B into the target touch coordinates within the coordinate system shown in FIG3B .

[0146] In an embodiment of the present disclosure, the touch module determines the target display module to which each of the multiple initial touch coordinates is directed based on the multiple initial touch coordinates included in the initial touch trajectory, which may include: when it is determined that the initial touch coordinates are within a first coordinate range of the coordinate system of the multi-screen display, determining that the target display module to which the initial touch coordinates are directed is the first display module; and when it is determined that the initial touch coordinates are within a second coordinate range of the coordinate system of the multi-screen display, determining that the target display module to which the initial touch coordinates are directed is the second display module.

[0147] In the embodiment of the present disclosure, the first coordinate range is related to the position of the first display module in the multi-screen display, and the second coordinate range is related to the position of the second display module in the multi-screen display. For example, referring to Figure 1, the two second display modules are located on the left and right sides of the first display module, and the first coordinate range includes the x-axis coordinate range of 9102 to 23665 and the y-axis coordinate range of 0 to 32767 shown in Figure 3B. The second coordinate range includes the x-axis coordinate range of 0 to 9102, the x-axis coordinate range of 23666 to 32767, and the y-axis coordinate range of 0 to 32767 shown in Figure 3B. Among them, when the initial touch coordinates are located in the x-axis coordinate range of 0 to 9102 and the y-axis coordinate range of 0 to 32767 in the second coordinate range, the target display module targeted by the initial touch coordinates is the second display module 120a shown in Figure 1. When the initial touch coordinates are located in the x-axis coordinate range of 23666 to 32767 and the y-axis coordinate range of 0 to 32767 in the second coordinate range, the target display module of the initial touch coordinates is the second display module 120 b shown in FIG. 1 .

[0148] In the embodiment of the present disclosure, the touch coordinates in the coordinate system of the multi-screen display can be recorded as (x, y), the touch coordinates in the independent coordinate system of the second display module 120a can be recorded as (xl, yl), the touch coordinates in the independent coordinate system of the first display module 110 can be recorded as (xm, ym), and the touch coordinates in the independent coordinate system of the second display module 120b can be recorded as (xr, yr).

[0149] For example, the initial touch track includes initial touch coordinates (x, y), and the touch module determines the target display module corresponding to the initial touch coordinates according to the coordinate values ​​of the initial touch coordinates.

[0150] For example, when x≤32767*(2400 / (2400+3840+2400)), the initial touch action can be considered to be directed to the second display module 120a. Based on the conversion formula xl=x / (2400 / (2400+3840+2400)) and yl=y, the target touch coordinates (xl, yl) within the independent coordinate system of the second display module 120a are determined. For example, if the initial touch coordinates are (7000, 200), the target touch coordinates are (25200, 200) based on the above conversion formula.

[0151] For example, when 32767*(2400 / (2400+3840+2400))≤x≤32767*((2400+3840) / (2400+3840+2400)), the initial touch can be considered to be directed to the first display module 110. According to the conversion formula xm=(x-(32767*2400 / (2400+3840+2400))) / (3840 / (2400+3840+2400)) and ym=y, the target touch coordinates (xm, ym) in the independent coordinate system of the first display module 110 are determined. For example, if the initial touch coordinates are (5000, 200), according to the above conversion formula, the target touch coordinates are (13270.63, 200).

[0152] For example, when 32767*((2400+3840) / (2400+3840+2400))≤x, the initial touch operation can be considered to be directed to the second display module 120b. Based on the conversion formula xr=(x0-(32767*(2400+3840) / (2400+3840+2400))) / (2400 / (2400+3840+2400)) and yr=y, the target touch coordinates (xr, yr) in the independent coordinate system of the second display module 120b are determined. For example, if the initial touch coordinates are (30000, 200), according to the above conversion formula, the target touch coordinates are (22805.8, 200).

[0153] In the disclosed embodiment, when it is determined that the display mode is the second display mode and the initial image comes from the first display module, the first display module determines the target display module targeted by the touch operation, the target display module includes at least one of the first display module and at least one second display module, and generates an updated image for the target display module based on the target touch trajectory, and sends the updated image to the target display module.

[0154] For example, the first display module can use multiple images from within the display module as initial images, with each display module displaying a different display screen. The first display module can independently update the screen of each display module based on a touch operation performed on each display module. For example, if a touch operation is performed only on the first display module, the first display module can update only the primary display image displayed by the first display module, while the secondary display image displayed by the second display module remains unchanged.

[0155] In the disclosed embodiment, when it is determined that the display mode is the second display mode and the initial image comes from an external device, the first display module determines the target display module corresponding to the target touch trajectory, sends the target touch trajectory to the external device, receives an updated image obtained by the external device based on the target touch trajectory, and sends the updated image to the target display module.

[0156] For example, the display images of multiple display modules may all come from external devices, all from within the device, or some from external devices and some from within the device. When the display image of the display module corresponding to the target touch trajectory comes from an external device, the first display module sends the touch coordinates included in the target touch trajectory to the external device, which then updates the initial image based on the touch coordinates to obtain an updated image. The external device then sends the updated image to the first display module, which then sends the updated image to the corresponding second display module or displays the updated image on the first display module itself, thereby achieving independent updating of the display modules.

[0157] In an embodiment of the present disclosure, in the second display mode, the touch module can determine a target touch trajectory based on an independent coordinate system of a single display module, so that the first display module can update the display screen of the single display module based on the target touch trajectory, thereby realizing the independent touch function of each display module in the multi-screen display.

[0158] Furthermore, when the initial image originates from within the display module, the first display module processes the initial image. When the initial image originates from an external device, the external device processes the initial image. The processor that processes the initial image based on the target touch trajectory is the same as the source of the initial image, ensuring that accurate image feedback is generated based on the touch operation.

[0159] In an embodiment of the present disclosure, the first display module processes the initial image according to the resolution of each display module to obtain a main display image and a sub-display image, so that the main display image and the sub-display image are each consistent with the resolution of the corresponding display module. The first display module can divide an image so that each display module of the multi-screen display displays a part of the image respectively, thereby realizing multi-screen joint display. The first display module can also process multiple images so that each display module of the multi-screen display displays an image respectively, thereby realizing multi-screen independent display. In the multi-screen joint display mode, the touch module determines the touch coordinates based on the coordinate system of the multi-screen display, so that the first display module can have a joint touch function for the overall display screen of the multi-screen display. In the multi-screen independent display mode, the touch coordinates determined by the touch module are based on the independent coordinate system of a single display module, so that the first display module can have an independent touch function for the display screen of a single display module of the multi-screen display.

[0160] FIG4 is a schematic structural diagram of a first display module according to an embodiment of the present disclosure.

[0161] As shown in FIG4 , the first display module 410 includes a main display screen 411 , a first display output interface 412 , at least one second display output interface 413 , a display processing unit 414 , a first coordinate interface 415 , a second coordinate interface 416 and a display input interface 417 .

[0162] In the embodiment of the present disclosure, the first display output interface 421, the at least one second display output interface 413, the display processing unit 414, the first coordinate interface 415, the second coordinate interface 416, and the display input interface 417 can be integrated into a single chip, such as a system on chip (SOC). The chip can be located in the non-display area of ​​the first display module 410 or in the backplane.

[0163] In the embodiment of the present disclosure, the display processing unit 414 generates a main display image and at least one secondary display image, and sends the main display image to the main display screen 411 through the first display output interface 412, and sends at least one secondary display image to at least one second display module through at least one second display output interface 413.

[0164] For example, the display processing unit 414 may be a microprocessor unit (MPU). The display processing unit 414 may call a display main page of an operating system or call a display image of an application as the initial image.

[0165] In an embodiment of the present disclosure, when the at least one second display module includes two second display modules, the at least one second display output interface 413 includes two second display output interfaces. The two second display output interfaces correspond to the two second display modules, respectively. The second display module may include a secondary display screen and a conversion unit, the secondary display screen being configured to display a secondary display image, and the conversion unit being configured to convert a signal type.

[0166] For example, the first display output interface 421 and the second display output interface 413 may be a High Definition Multimedia Interface (HDMI), a V-by-one Interface (VBOI) for image information transmission, or a DisplayPort (DP).

[0167] For example, when the display format supported by the main display screen 411 of the first display module 410 is VBO (V-by-one Interface), the first display output interface 421 may be a VBO interface. For example, the display processing unit 414 may convert the main display image into a VBO signal based on the VBOI encoding rules, and output the signal to the main display screen 411 via the VBO interface.

[0168] For example, when the display format supported by the secondary display screen of the second display module is HDMI, the second display output interface 413 may be an HDMI interface. For example, the display processing unit 414 may convert the secondary display image into an HDMI signal based on HDMI encoding rules and output the signal to the second display module via the HDMI interface.

[0169] For another example, when the display format supported by the secondary display screen of the second display module is HDMI, the second display output interface 413 may be a VBO interface. For example, the display processing unit 414 may convert the HDMI signal into an HDMI signal based on HDMI encoding rules, and output the signal to the second display module via the HDMI interface. The conversion unit of the second display module converts the HDMI signal into a VBO signal based on VBO encoding rules.

[0170] In the embodiment of the present disclosure, the first display module 410 and the second display module include a driving circuit and a timing controller, etc. The driving circuit and the timing controller are used to drive the first display module and the second display module to display images.

[0171] In the embodiment of the present disclosure, the display processing unit 414 receives an initial image from an external device via the display input interface 417. For example, the display input interface 417 may be an HDMI interface, a DP interface, or a VBO interface. The display processing unit 414 is connected to the external device via the display input interface 417.

[0172] In the embodiment of the present disclosure, the display processing unit 414 receives the target touch track from the touch module through the first coordinate interface 415. When determining that the initial image comes from an external device, the display processing unit 414 sends the target touch coordinates to the external device through the second coordinate interface 416.

[0173] For example, the first coordinate interface 415 and the second coordinate interface 416 may be USB interfaces. For example, the touch module may convert the touch coordinates into USB data packets according to USB encoding rules, and the USB data packets indicate the touch signals received by the touch module. The touch module may send the touch coordinates to the first display module 410 in the form of USB data packets via the first coordinate interface 415. The first display module 410 may send the touch coordinates to an external device in the form of USB data packets via the second coordinate interface 416.

[0174] In multi-screen joint display mode, the touch module can package the target touch track into a USB data packet, which is used to indicate the touch signal for the entire multi-screen display. In multi-screen independent display mode, the touch module can separately package the coordinate data included in the target touch track for different display modules, and package the coordinate data corresponding to each of the multiple display modules into multiple USB data packets. Multiple USB data packets can respectively indicate the touch signals for the display screens of multiple display modules.

[0175] In the disclosed embodiment, the display processing unit 414 of the first display module sends the display image to the corresponding display module via multiple display output interfaces, thereby achieving independent control of the display images of the multiple display modules. The display processing unit 414 may also simultaneously send the display image to multiple display modules via multiple display output interfaces, so that the image display processes of the multiple display modules do not interfere with each other. In addition, the first display module receives USB data packets from the touch module via an independent coordinate interface. Based on the different touch signals indicated by the USB data packets, the multiple display modules can be independently controlled or jointly controlled.

[0176] FIG5 is a schematic structural diagram of a display processing unit according to an embodiment of the present disclosure.

[0177] As shown in FIG5 , the display processing unit 514 includes a plurality of frame buffers, and the plurality of frame buffers are used to store images respectively.

[0178] In an embodiment of the present disclosure, the plurality of frame buffers include a first frame buffer 5141 , at least one second frame buffer 5142 , a third frame buffer 5413 , a first data packet buffer 5144 , at least one second data packet buffer 5145 and a third data packet buffer 5146 .

[0179] In an embodiment of the present disclosure, the first frame buffer 5141, at least one second frame buffer 5142, the third frame buffer 5413, the first data packet buffer 5144, at least one second data packet buffer 5145 and the third data packet buffer 5146 can all be located in the synchronous dynamic random access memory (SDRAM) of the display processing unit 514.

[0180] In the disclosed embodiment, the first frame buffer 5144 stores the primary display image. The at least one second frame buffer 5142 stores at least one secondary display image. The at least one second frame buffer 5142 corresponds one-to-one with the at least one second display module. For example, if the at least one second display module includes two second display modules, the at least one second frame buffer 5142 includes two second frame buffers.

[0181] In the disclosed embodiment, the third frame buffer 5143 stores the initial image. The display processing unit 514 reads and processes the initial image from the third frame buffer 5143 to obtain a primary display image and at least one secondary display image. The display processing unit 514 stores the primary display image in the first frame buffer 5141 and stores the at least one secondary display image in at least one second frame buffer 5142.

[0182] For example, the third frame buffer 5143 may be Frame buffer0, the first frame buffer 5144 may be Frame buffer2, and the at least one second frame buffer 5142 includes Frame buffer1 and Frame buffer3.

[0183] In the multi-screen joint display mode, the display processing unit 514 obtains an initial image (resolution 8640*2160) and stores the initial image in Frame buffer 0. The display processing unit 514 can use the image division method shown in FIG2C to call the first line of pixel data L1 of Frame buffer 0, sequentially store the 1st to 2400th pixels in the first line of pixel data L1 into the 1st to 2400th storage units of the first line of Frame buffer 1, sequentially store the 2401st to 6240th pixels in the first line of pixel data L1 into the 1st to 3840th storage units of the first line of Frame buffer 2, and sequentially store the 6241st to 8460th pixels in the first line of pixel data L1 into the 1st to 2400th storage units of the first line of Frame buffer 3. 1 , after the pixels of rows 2 to 2160 of the initial image are divided, Frame buffer 1 stores the pixel values ​​of the secondary display image displayed by the second display module 120 a , Frame buffer 2 stores the pixel values ​​of the primary display image displayed by the first display module , and Frame buffer 3 stores the pixel values ​​of the secondary display image displayed by the second display module 120 b .

[0184] In the multi-screen independent display mode, the display processing unit 514 obtains multiple initial images. The display processing unit 514 operates on the initial image corresponding to the second display module 120a to obtain a secondary display image (2400*2160), and stores the secondary display image in Frame buffer 1. The display processing unit 514 operates on the initial image corresponding to the first display module to obtain a main display image (3840*2160), and stores the main display image in Frame buffer 2. The display processing unit 514 operates on the initial image corresponding to the second display module 120b to obtain a secondary display image (2400*2160), and stores the secondary display image in Frame buffer 3.

[0185] During the image display process, the display processing unit 514 calls the pixel values ​​of the secondary display image in Frame buffer1 and sends it to the second display module 120a, calls the pixel values ​​of the main display image in Frame buffer2 and sends it to the main display screen of the first display module, and calls the pixel values ​​of the secondary display image in Frame buffer3 and sends it to the second display module 120b.

[0186] By using multiple frame buffers to independently store the display image of each display module, the display image of each display module can be processed independently. For example, each frame buffer only stores the display image of one display module. For example, when the display image of one of the display modules is abnormal, the display processing unit 514 can only call the corresponding frame buffer, which re-encodes the pixel values ​​in the frame buffer and sends it to the corresponding display module. Other display modules are not affected during this process. For example, when the display screen of a certain display module is stuck, blurred, lost or has a blue screen, or when the image data received by the display module is missing, the display processing unit 514 can re-call the pixel values ​​in the corresponding frame buffer.

[0187] When updating the initial image based on the target touch trajectory, the pixel values ​​of the initial image in the third frame buffer 5143 can be directly obtained and processed accordingly. This process affects the current display screen of the display module. Therefore, when an abnormality occurs during the screen update process, the display image of the previous frame can be restored.

[0188] In the embodiment of the present disclosure, the first data packet buffer 5144 stores the target touch track for the main display screen.

[0189] At least one second data packet buffer 5145 stores target touch tracks for the auxiliary display screens respectively, and the third data packet buffer 5146 stores target touch tracks for the entire display screen of the multi-screen display.

[0190] For example, the third data packet buffer 5146 may be USB packet buffer0, the first data packet buffer 5144 may be USB packet buffer2, and the at least one second data packet buffer 5145 includes USB packet buffer1 and USB packet buffer3.

[0191] In multi-screen joint display mode, the user performs a touch operation on the screen of the multi-screen display on the entire display screen of the multi-screen display. The touch module determines a target touch trajectory for the entire display screen of the multi-screen display and sends the touch trajectory to the first display module. The display processing unit 514 stores the touch coordinates (x, y) included in the target touch trajectory in USB packet buffer 0. The display processing unit 514 calls the touch coordinates in USB packet buffer 0 and performs corresponding processing on the initial image based on the touch coordinates to obtain an updated image. The display processing unit 514 stores the updated image in frame buffer 0.

[0192] In the multi-screen independent display mode, the touch operation performed by the user on the screen of the multi-screen display is directed to the display screen of at least one display module of the multi-screen display. The touch module determines the target touch track for the display screen of a single display module from the initial touch track and sends the target touch track to the first display module. When it is determined that the target touch track is directed to the second display module 120a, the display processing unit 514 stores the touch coordinates (xl, yl) included in the target touch track in USB packet buffer 1. The display processing unit 514 calls the touch coordinates of USB packet buffer 1 and performs corresponding processing on the secondary display image stored in Frame buffer 1 based on the touch coordinates to obtain an updated secondary display image. The display processing unit 514 stores the updated secondary display image in Frame buffer 1. Accordingly, when determining that the target touch track is directed at the first display module 110, the display processing unit 514 stores the touch coordinates (xm, ym) included in the target touch track in USB packet buffer 2. The display processing unit 514 accesses the touch coordinates in USB packet buffer 2 and, based on the touch coordinates, processes the secondary display image stored in Frame buffer 2 accordingly to obtain an updated primary display image. The display processing unit 514 stores the updated primary display image in Frame buffer 2. When determining that the target touch track is directed at the second display module 120b, the display processing unit 514 stores the touch coordinates (xr, yr) included in the target touch track in USB packet buffer 3. The display processing unit 514 accesses the touch coordinates in USB packet buffer 3 and, based on the touch coordinates, processes the secondary display image stored in Frame buffer 3 accordingly to obtain an updated secondary display image. The display processing unit 514 stores the updated secondary display image in Frame buffer 3.

[0193] By independently storing the touch coordinates corresponding to each display module using multiple data packet buffers, the display image of each display module can be independently updated. For example, if the display image of one display module experiences an update anomaly, the display processing unit 514 can only call the corresponding data packet buffer, re-update the pixel values ​​in the corresponding frame buffer, and send it to the corresponding display module. During this process, other display modules are not affected.

[0194] FIG6 is a schematic structural diagram of a touch module according to an embodiment of the present disclosure.

[0195] As shown in FIG6 , the touch module 630 includes a touch sensing unit 631 and a touch processing unit 632 . The touch sensing unit 631 is electrically connected to the touch processing unit 632 .

[0196] In the embodiment of the present disclosure, the touch sensing unit 631 is integrated into the first display module and at least one second display module. The touch sensing unit 631 is configured to generate touch sensing information based on a sensed touch operation.

[0197] In the disclosed embodiment, the touch processing unit 632 may be a microcontroller unit (MCU). For example, the touch processing unit 632 may be integrated into the first display module. For example, the touch processing unit 632 may be integrated into a SOC along with the first display output interface 421, at least one second display output interface 413, the display processing unit 414, the first coordinate interface 415, the second coordinate interface 416, and the display input interface 417 as shown in FIG. 4 .

[0198] For example, the touch sensing unit 631 may be an infrared touch sensing unit, and the touch sensing information includes infrared light emission information and infrared light reception information. The touch processing unit 632 determines a touch operation based on the infrared light emission information and the infrared light reception information, determines a target touch trajectory based on the touch operation, and transmits the target touch trajectory to the first display module.

[0199] For example, the touch sensing unit 631 may be a capacitive touch sensing unit, and the touch sensing information includes current change information within the display module. The touch processing unit 632 determines a touch operation based on the current change information, determines a target touch trajectory based on the touch operation, and sends the target touch trajectory to the first display module.

[0200] For example, the touch sensing unit 631 may be an electromagnetic touch sensing unit, and the touch sensing information includes magnetic field change information within the display module. The touch processing unit 632 determines a touch operation based on the magnetic field change information, determines a target touch trajectory based on the touch operation, and sends the target touch trajectory to the first display module.

[0201] FIG7 is a schematic structural diagram of a touch module according to another embodiment of the present disclosure.

[0202] As shown in FIG. 7 , the touch sensing unit 731 includes an infrared emitting unit 7311 and an infrared receiving unit 7312 .

[0203] In the disclosed embodiment, the infrared emitting unit 7311 is disposed on a first side of the multi-screen display, and the infrared receiving unit 7312 is disposed on a second side of the multi-screen display opposite the first side. For example, the first side and the second side can both be horizontal sides of the multi-screen display, i.e., two sides at the top and bottom. Alternatively, the first side and the second side can both be vertical sides of the multi-screen display, i.e., two sides at the left and right.

[0204] In the disclosed embodiment, the infrared emitting unit 7311 and the infrared receiving unit 7312 are positioned opposite each other. The infrared emitting unit 7311 emits infrared light, and the infrared receiving unit 7312 receives infrared light. When a touch operation occurs on the display screen of the display module, the infrared light emitted by the infrared emitting unit 7311 is blocked.

[0205] In some embodiments, the infrared emitting unit 7311 and the infrared receiving unit 7312 can also be relatively arranged on the upper and lower sides and left and right sides of the multi-screen display to form a touch frame arranged on the four sides of the multi-screen display.

[0206] In some embodiments, the infrared emitting unit 7311 and the infrared receiving unit 7312 can be arranged in pairs on the frame of the multi-screen display. The infrared light emitted by the infrared emitting unit 7311 propagates in a straight line, and the corresponding infrared receiving unit 7312 is arranged on the propagation path of the infrared light emitted by the infrared emitting unit 7311. The infrared light emitted by multiple infrared emitting units 7311 covers the entire screen of the multi-screen display, so that the touch operation on the screen of the multi-screen display can be accurately and comprehensively determined based on the transmission and reception status of the infrared emitting unit 7311 and the infrared receiving unit 7312.

[0207] In the embodiment of the present disclosure, the infrared emitting unit 7311 includes a first infrared emitting subunit 7311a and at least one second infrared emitting subunit 7311b. The infrared receiving unit 7312 includes a first infrared receiving subunit 7312a and at least one second infrared receiving subunit 7312b.

[0208] The first infrared emitting subunit 7311a is disposed on a first side of the first display module, and the first infrared receiving subunit 7312a is disposed on a second side of the first display module opposite the first side. At least one second infrared emitting subunit 7311b is disposed on a first side of at least one second display module, and at least one second infrared receiving subunit 7312b is disposed on a second side of at least one second display module opposite the first side.

[0209] In the embodiment of the present disclosure, the first infrared emitting subunit 7311a is electrically connected to at least one second infrared emitting subunit 7311b, and the first infrared receiving subunit 7312a is electrically connected to at least one second infrared receiving subunit 7322. For example, the connection can be made via a pluggable cable located outside the display.

[0210] In the disclosed embodiment, the first infrared emitting subunit 7311a and the first infrared receiving subunit 7312a are disposed oppositely on either side of the first display module to receive touch operations directed to the first display module. When the at least one second display module includes two second display modules, the at least one second infrared emitting subunit 7311b includes two second infrared emitting subunits 7311b, and the at least one second infrared receiving subunit 7312b includes two second infrared receiving subunits 7312b. The second infrared emitting subunit 7311b and the second infrared receiving subunit 7312b are disposed oppositely on either side of the second display module to receive touch operations directed to the second display module.

[0211] In the disclosed embodiment, the infrared emitting unit 7311 and the infrared receiving unit 7312 are modularly designed. The first infrared emitting subunit 7311a, at least one second infrared emitting subunit 7311b, the first infrared receiving subunit 7312a, and at least one second infrared receiving subunit 7312b can each be a separate module. Multiple modules are mounted on the first display module and the second display module, respectively. This modular design facilitates transportation of the display modules and modular assembly of the product.

[0212] FIG8 is a schematic structural diagram of a touch processing unit according to an embodiment of the present disclosure.

[0213] As shown in FIG8 , the touch processing unit 832 includes an infrared transmission control port 8321 , an infrared reception control port 8322 , a peripheral device interface 8323 , a first coordinate buffer 8324 , at least one second coordinate buffer 8325 and a third coordinate buffer 8326 .

[0214] In the embodiment of the present disclosure, the first coordinate buffer 8324 , the at least one second coordinate buffer 8325 , and the third coordinate buffer 8326 may all be located in a random access memory (RAM) of the touch processing unit 832 .

[0215] In the embodiment of the present disclosure, the touch processing unit 832 controls the infrared emitting unit to emit infrared light through the infrared emitting control port 8321, collects the reception information of the infrared receiving unit through the infrared receiving control port 8322, and sends the target touch trajectory to the first display module through the peripheral device interface 8323.

[0216] For example, the touch processing unit 832 transmits a control signal to the infrared emitting unit and the infrared receiving unit via the infrared emitting control port 8321, causing the infrared emitting unit to begin emitting infrared light based on the received control signal and the infrared receiving unit to simultaneously receive the infrared light. The touch processing unit 832 obtains infrared light collection information from the infrared receiving unit via the infrared receiving control port 8322, thereby determining the operating range where a touch operation occurs.

[0217] For example, the peripheral device interface 8323 may be a USB interface. The touch processing unit 832 packages the touch coordinates included in the target touch track into a USB data packet, and sends the USB data packet to the first display module through the peripheral device interface 8323.

[0218] In the embodiment of the present disclosure, the touch processing unit 832 can also receive the first instruction and the second instruction from the first display module through the peripheral device interface 8323, thereby entering the multi-screen joint display mode based on the first instruction or entering the multi-screen independent display mode based on the second instruction.

[0219] In the disclosed embodiment, the first coordinate buffer 8324 stores the target touch trajectory based on the coordinate system of the first display module. At least one second coordinate buffer 8325 stores the target touch trajectory based on the coordinate system of at least one second display module. The third coordinate buffer 8326 stores the target touch trajectory based on the coordinate system of the multi-screen display.

[0220] For example, the third coordinate buffer 8326 may be Touch buffer 0, the first coordinate buffer 8324 may be Touch buffer 2, and the at least one second coordinate buffer 8325 includes Touch buffer 1 and Touch buffer 3.

[0221] In multi-screen joint display mode, the touch processing unit 832 determines a target touch trajectory based on a touch operation on the overall display screen of the multi-screen display, and stores the touch coordinates included in the target touch trajectory into Touch buffer 0. The touch processing unit 832 calls the touch coordinates in Touch buffer 0, converts the touch coordinates into a USB data packet based on USB encoding rules, and outputs it to the first display module through the peripheral device interface 8323.

[0222] In the multi-screen independent display mode, the touch processing unit 832 converts the touch operation on the overall display screen of the multi-screen display into a touch operation on the display screen of a single display module based on the conversion method shown in Figures 3B and 3C. The touch processing unit 832 determines the target touch trajectory based on the touch operation on the display screen of the single display module. In conjunction with Figure 1, when it is determined that the touch operation is directed to the second display module 120a, the touch processing unit 832 stores the touch coordinates included in the corresponding target touch trajectory into Touch buffer 1. When it is determined that the touch operation is directed to the first display module 110, the touch processing unit 832 stores the touch coordinates included in the corresponding target touch trajectory into Touch buffer 2. When it is determined that the touch operation is directed to the second display module 120b, the touch processing unit 832 stores the touch coordinates included in the corresponding target touch trajectory into Touch buffer 3. The touch processing unit 832 calls the touch coordinates of Touch buffer 1 , Touch buffer 2 , and Touch buffer 3 , converts the touch coordinates into USB data packets based on USB encoding rules, and outputs the USB data packets to the first display module through the peripheral device interface 8323 .

[0223] In the disclosed embodiments, to distinguish the display modules corresponding to USB data packets, the USB data can be identified. For example, if a USB data packet includes 64 bytes of data, the first byte, Byte 0, can be used as a Repot ID to identify the USB data packet. Based on different Repot IDs, the display modules corresponding to the USB data packets can be distinguished.

[0224] For example, the touch processing unit 832 retrieves the touch coordinates (xl, yl) of Touch buffer 1, converts the touch coordinates (xl, yl) into a USB data packet based on USB encoding rules, and sets Byte0 to 0x02. For example, the touch processing unit 832 retrieves the touch coordinates (xm, ym) of Touch buffer 2, converts the touch coordinates (xm, ym) into a USB data packet based on USB encoding rules, and sets Byte0 to 0x04. For example, the touch processing unit 832 retrieves the touch coordinates (xr, yr) of Touch buffer 3, converts the touch coordinates (xr, yr) into a USB data packet based on USB encoding rules, and sets Byte0 to 0x06.

[0225] The first display module determines the display module corresponding to the USB data packet by identifying the value of Byte0 in the USB data packet, and stores the touch coordinates included in the USB data packet into the corresponding data packet buffer.

[0226] In the disclosed embodiment, multiple coordinate buffers are used to independently store the touch coordinates corresponding to each display module and assign corresponding identification IDs. This allows the first display module to independently update the display screen of each display module. For example, if the display screen of one display module experiences an update anomaly, the touch processing unit 832 can only call the corresponding coordinate buffer and resend the corresponding touch coordinates to the first display module, while other display modules remain unaffected.

[0227] Figure 9A is a schematic diagram of the structure of a display module according to another embodiment of the present disclosure. Figures 9B-9Q are schematic diagrams of display screens according to an embodiment of the present disclosure.

[0228] As shown in FIG. 9A , the display module 900 includes a first display module 910 , a plurality of second display modules 920 a and 920 b , and a touch module 930 .

[0229] In the embodiment of the present disclosure, the first display module 910, multiple second display modules 920a, 920b and touch module 930 are similar to the first display module 110, multiple second display modules 120a, 120b and touch module 130 mentioned above, and are not repeated here for the sake of simplicity.

[0230] In the embodiment of the present disclosure, the first display module 910 includes a first display output interface 912, at least one second display output interface 913a, 913b, a display processing unit 914, a first coordinate interface 915, a second coordinate interface 916, and a display input interface 917. The display processing unit 914 includes a first frame buffer 9141, at least one second frame buffer 9142, a third frame buffer 9413, a first data packet buffer 9144, at least one second data packet buffer 9145, and a third data packet buffer 9146.

[0231] In the embodiment of the present disclosure, the first display output interface 912, at least one second display output interface 913a, 913b, the display processing unit 914, the first coordinate interface 915, the second coordinate interface 916 and the display input interface 917 are respectively similar to the first display output interface 412, at least one second display output interface 413, the display processing unit 414, the first coordinate interface 415, the second coordinate interface 416 and the display input interface 417 mentioned above, and the first frame buffer 9141, at least one second frame buffer 9142, the third frame buffer 9413, the first data packet buffer 9144, at least one second data packet buffer 9145 and the third data packet buffer 9146 are respectively similar to the first frame buffer 5141, at least one second frame buffer 5142, the third frame buffer 5413, the first data packet buffer 5144, at least one second data packet buffer 5145 and the third data packet buffer 5146 mentioned above, and are not repeated here for the sake of simplicity.

[0232] In the disclosed embodiment, the touch module 930 includes a touch sensing unit 931 and a touch processing unit 932. The touch sensing unit 931 includes an infrared transmitting unit 9311 and an infrared receiving unit 9312. The touch processing unit 932 includes an infrared transmitting control port 9321, an infrared receiving control port 9322, a peripheral device interface 9323, a first coordinate buffer 9324, at least one second coordinate buffer 9325, and a third coordinate buffer 9326.

[0233] In the disclosed embodiment, the touch sensing unit 931 and the touch processing unit 932 are similar to the touch sensing unit 631 and the touch processing unit 632, respectively. The infrared transmitting unit 9311 and the infrared receiving unit 9312 are similar to the infrared transmitting unit 7311 and the infrared receiving unit 7312, respectively. The touch processing unit 932 includes an infrared transmitting control port 9321, an infrared receiving control port 9322, a peripheral device interface 9323, a first coordinate buffer 9324, at least one second coordinate buffer 9325, and a third coordinate buffer 9326, which are similar to the infrared transmitting control port 8321, the infrared receiving control port 8322, the peripheral device interface 8323, the first coordinate buffer 8324, at least one second coordinate buffer 8325, and the third coordinate buffer 8326, respectively. For the sake of brevity, these details are not further described here.

[0234] In the disclosed embodiment, the two second display modules 920a and 920b are communicatively connected to the first display module 910 via the two second display output interfaces 913a and 913b, respectively. The external device 940 is communicatively connected to the first display module 910 via the second coordinate interface 916 and the display input interface 917. For example, the external device 940 is communicatively connected to the display input and output interface 917 via an HDMI cable, and the external device 940 is communicatively connected to the second coordinate interface 916 via a USB cable.

[0235] Based on Figure 9A , the present disclosure schematically illustrates the display and touch processes of display module 900. It should be noted that, for example, display module 900 includes a first display module 910 and two second display modules 920a and 920b. The first display module 910 and the two second display modules 920a and 920b are horizontally spliced, with the two second display modules 920a and 920b located on the left and right sides of the first display module 910, respectively. The resolution of the first display module 910 is 3840*2160, and the resolution of the two second display modules 920a and 920b are both 2400*2160. The overall display resolution of display module 900 is 8640*2160.

[0236] For ease of distinction, the third data packet buffer 9146 can be USB packet buffer 0, the first data packet buffer 9144 can be USB packet buffer 2, and the two second data packet buffers 9145 include USB packet buffer 1 and USB packet buffer 3. The third frame buffer 9143 can be Frame buffer 0, the first frame buffer 9144 can be Frame buffer 2, and the two second frame buffers 9142 include Frame buffer 1 and Frame buffer 3. The third coordinate buffer 9326 can be Touch buffer 0, the first coordinate buffer 9324 can be Touch buffer 2, and the multiple second coordinate buffers 9325 include Touch buffer 1 and Touch buffer 3. The two second display output interfaces include a second display output interface 913a and a second display output interface 913b.

[0237] In the embodiment of the present disclosure, the display processing unit 914 may be installed with an operating system. Based on the operating system, the display processing unit 914 has the ability to call data stored in the system, run applications, process data, send data, and receive data.

[0238] In the disclosed embodiment, an application is running in the first display module 910, and the user can select the display mode of the multi-screen display based on the application. As shown in Figure 9B, the user interface of the application is displayed on the display screen 901 of the first display module 910. The display screen 901 shows the display resolution of the first display module 910 of 3840*2160, and the display screen of the first display module 910 is the main display screen. The display resolution of the second display modules 920a and 920b is 2400*2160, and the display screen of the second display module 920a is the left auxiliary screen, and the display screen of the second display module 920b is the right auxiliary screen.

[0239] The user clicks the "Three Screens in One" button on the screen of the first display module 910 to put the display module 900 into the multi-screen joint display mode. The first display module 910 sends a first instruction to the touch module 930, and the touch module 930 enters the multi-screen joint display mode based on the first instruction.

[0240] The user clicks any button corresponding to "split screen mode" on the screen of the first display module 910, causing the display module 900 to enter the multi-screen independent display mode. The first display module 910 sends a second instruction to the touch module 930, and the touch module 930 enters the multi-screen independent display mode based on the second instruction.

[0241] During the multi-screen joint display mode, the display processing unit 914 can call a configuration file to determine that the resolution of the initial image is 8640*2160. The display processing unit 914 calls an operating system's default display page or calls an application's display image and, after calculation, generates an initial image with a resolution of 8640*2160. As shown in FIG9C , for example, initial image G is the operating system's main menu screen. The display processing unit 914 stores initial image G in Frame buffer 0. The display processing unit 914 calls initial image G (8640*2160) from Frame buffer 0 and, based on the horizontal pixel ratio of the three display modules (2400:3840:2400), divides the initial image (8640*2160) into a first secondary display image D2_1 (2400*2160), a main display image D1 (3840*2160), and a second secondary display image D2_2 (2400*2160).

[0242] The display processing unit 914 stores the first sub-display image D2_1 in Frame buffer 1, the main display image D1 in Frame buffer 2 of SDRAM, and the second sub-display image D2_2 in Frame buffer 3. The display processing unit 914 accesses the first sub-display image D2_1 in Frame buffer 1, converts the first sub-display image D2_1 into an HDMI signal, and sends it to the second display module 920a via the second display output interface 913a. The second display module 920a can convert the HDMI signal into a VBO signal, which is then displayed on the display screen of the second display module 920a. The display processing unit 914 accesses the main display image D1 in Frame buffer 2, converts the main display image D1 into a VBO signal, and outputs it to the display screen of the first display module via the first display output interface 912, where it is displayed on the display screen of the first display module. The display processing unit 914 accesses the second sub-display image D2_2 in Frame buffer 3, converts the second sub-display image D2_2 into an HDMI signal, and sends it to the second display module 920b via the second display output interface 913b. The second display module 920b can convert the HDMI signal into a VBO signal, which is then displayed on the display screen of the second display module 920b.

[0243] Thus, the above display process utilizes multiple display modules to achieve the joint display of the initial image G. The display effect is shown in FIG9D . As shown in FIG9D , the main display image D1 is displayed on the display screen 901 of the first display module 910, the first sub-display image D2_1 is displayed on the display screen 902a of the second display module 920a, and the second sub-display image D2_2 is displayed on the display screen 902b of the second display module 920b.

[0244] During the touch control process in the multi-screen joint display mode, the display processing unit 914 sends a first instruction to the touch module 930 via the first coordinate interface 915. The first instruction instructs the touch module 930 to switch to the multi-screen joint display mode. The touch module 930 receives the first instruction via the peripheral device interface 9323, switches to the multi-screen joint display mode, and determines the target touch trajectory using the entire display screen of the display module 900 as the overall coordinate system.

[0245] As shown in FIG9E , a user clicks on an area of ​​the "File Manager" image in display screen 901 on the screen of the first display module. This click operation is a touch operation on the entire display screen of display module 900 (display screen 901, display screen 902a, and display screen 902b). Touch processing unit 932 determines the touch coordinates (x, y) corresponding to the click operation and stores the touch coordinates (x, y) in Touch buffer 0. Touch processing unit 932 accesses the touch coordinates (x, y) in Touch buffer 0, packages the touch coordinates (x, y) into a USB data packet, and outputs the USB data packet to display processing unit 914 through peripheral device interface 9323.

[0246] The display processing unit 914 receives the USB data packet through the first coordinate interface 915 and stores the touch coordinates (x, y) included in the USB data packet in USB packet buffer 0. The display processing unit 914 retrieves the touch coordinates (x, y) from USB packet buffer 0 and performs image processing based on the touch coordinates (x, y) and the initial image G in Frame buffer 0 to obtain an updated image G', which is then stored in Frame buffer 0. The updated image G' represents the display interface image of the "File Manager" application. The display processing unit 914 then divides the updated image G' using a method similar to the display process. As shown in FIG9F , the updated image G' is divided into a first secondary display image D2_1', a main display image D1', and a second secondary display image D2_2'.

[0247] Thus, the above touch control process realizes integrated touch control of multiple display modules. The display effect is shown in Figure 9G. As shown in Figure 9G, the multi-screen display displays the image updated based on the touch operation. The display screen 901 of the first display module 910 displays the main display image D1', the display screen 902a of the second display module 920a displays the first secondary display image D2_1', and the display screen 902b of the second display module 920b displays the second secondary display image D2_2'.

[0248] During the multi-screen independent display mode, the display processing unit 914 can call a configuration file to determine that the resolution of the first display module 910 is 3840*2160 and the resolution of the two second display modules is 2400*2160. The display processing unit 914 can call three initial images G1, G2, and G3 from three applications A, B, and C, respectively. As shown in Figure 9H, for example, initial image G1 is the display interface image of the "File Manager" application, and the display interface image resolution is configured to be 2400*2160. The display processing unit 914 calculates the initial image G1 from application A to obtain a first secondary display image D4_1 (2400*2160) and stores it in Frame buffer 1. For example, if initial image G2 is the default display interface image of the operating system, and the display interface image resolution is configured to be 3840*2160, the display processing unit 914 calculates the initial image G2 from application B to obtain a main display image D3 (3840*2160) and stores it in Frame buffer 2. For example, the initial image G3 is the display interface image of the "whiteboard" application, and the resolution of the display interface image is configured to be 2400*2160. The display processing unit 914 calculates the initial image G3 from the application C to obtain the second display image D4_2 (2400*2160) and stores it in the Frame buffer3.

[0249] The display processing unit 914 accesses the first display image D4_1 from Frame buffer 1, converts the first display image D4_1 into an HDMI signal, and sends it to the second display module 920a via the second display output interface 913a. The second display module 920a can convert the HDMI signal into a VBO signal, which is then displayed on the display screen of the second display module 920a. The display processing unit 914 accesses the main display image D3 from Frame buffer 2, converts the main display image into a VBO signal, and outputs it to the display screen of the first display module via the first display output interface 912, which is then displayed on the display screen of the first display module. The display processing unit 914 accesses the second display image D4_2 from Frame buffer 3, converts the second display image D4_2 into an HDMI signal, and sends it to the second display module 920b via the second display output interface 913b. The second display module 920b can convert the HDMI signal into a VBO signal, which is then displayed on the display screen of the second display module 920b.

[0250] Thus, the above display process utilizes multiple display modules to independently display multiple initial images. The display effect is shown in Figure 9I . As shown in Figure 9I , the main display image D3 is displayed on the display screen 901 of the first display module 910, the first sub-display image D4_1 is displayed on the display screen 902a of the second display module 920a, and the second sub-display image D4_2 is displayed on the display screen 902b of the second display module 920b.

[0251] During the touch control process in the multi-screen independent display mode, the display processing unit 914 sends a second instruction to the touch module 930 via the first coordinate interface 915. The second instruction instructs the touch module 930 to switch to the multi-screen independent display mode. The touch module 930 receives the second instruction via the peripheral device interface 9323, switches to the multi-screen independent display mode, and determines the target touch trajectory using the single display module as the independent coordinate system.

[0252] As shown in Figure 9J , a user clicks on the area of ​​the "File Manager" image on display screen 901 on the screen of the first display module. This click operation is based on a touch operation on the first display module. Touch processing unit 932 determines the touch coordinates (x, y) within the entire display screen of display module 900 and stores the touch coordinates (x, y) in Touch buffer 0. Touch processing unit 932 accesses the touch coordinates (x, y) in Touch buffer 0 and, based on the coordinate system of the display screen of the single display module, divides the touch coordinates (x, y) into touch coordinates (xl, yl), touch coordinates (xm, ym), and touch coordinates (xr, yr). Touch processing unit 932 stores the touch coordinates (xl, yl) in Touch buffer 1, touch coordinates (xl, yl) in Touch buffer 2, and touch coordinates (xl, yl) in Touch buffer 3. The touch coordinates corresponding to the click operation shown in Figure 9J can be converted into touch coordinates (xm, ym) in the coordinate system of the first display module 910.

[0253] The touch processing unit 932 retrieves the touch coordinates (xl, yl) from Touch buffer 1, packages the touch coordinates (xl, yl) into a USB data packet, sets Byte0 to 0x02, and outputs the USB data packet to the display processing unit 914 through the peripheral device interface 9323. The touch processing unit 932 retrieves the touch coordinates (xm, ym) from Touch buffer 2, packages the touch coordinates (xm, ym) into a USB data packet, sets Byte0 to 0x04, and outputs the USB data packet to the display processing unit 914 through the peripheral device interface 9323. The touch processing unit 932 retrieves the touch coordinates (xr, yr) from Touch buffer 3, packages the touch coordinates (xr, yr) into a USB data packet, sets Byte0 to 0x06, and outputs the USB data packet to the display processing unit 914 through the peripheral device interface 9323.

[0254] The display processing unit 914 receives the USB data packet through the first coordinate interface 915 and identifies the value of Byte 0 in the USB data packet. If Byte 0 = 0x02, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 1. If Byte 0 = 0x04, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 2. If Byte 0 = 0x06, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 3.

[0255] The display processing unit 914 retrieves the touch coordinates (xl, yl) from USB packet buffer 1 and performs image processing based on the touch coordinates (xl, yl) and the initial image in Frame buffer 1 to obtain a first updated secondary display image, which is then stored in Frame buffer 1. The display processing unit 914 retrieves the touch coordinates (xm, ym) from USB packet buffer 2 and performs image processing based on the touch coordinates (xm, ym) and the initial image in Frame buffer 2 to obtain an updated primary display image, which is then stored in Frame buffer 2. The display processing unit 914 retrieves the touch coordinates (xr, yr) from USB packet buffer 3 and performs image processing based on the touch coordinates (xr, yr) and the initial image in Frame buffer 3 to obtain a second updated secondary display image, which is then stored in Frame buffer 3. The display screens of the first display module 910 and the two second display modules 920a and 920b respectively display corresponding updated images, thereby achieving independent update of the display images of the first display module 910 and the two second display modules 920a and 920b.

[0256] In the embodiment of the present disclosure, during the touch process in the multi-screen independent display mode, the touch operation may only involve one of the display modules. For example, the touch operation only involves the first display module. When the touch coordinates (x, y) are converted, only the touch coordinates (xm, ym) are obtained. Therefore, the display processing unit 914 only updates the display screen of the first display module 910 based on the touch coordinates (xm, ym) to obtain the updated image G2'. The updated image G2' is the display interface image of the "File Manager" application. As shown in Figure 9K, the updated image G' is converted into the main display image D3'. The display screens of the second display modules 920a and 920b remain unchanged.

[0257] It should be noted that when there is only one touch coordinate (x, y), converting the touch coordinate (x, y) can only obtain one of the touch coordinates (xl, yl), touch coordinates (xm, ym), and touch coordinates (xr, yr). When there are multiple touch coordinates (x, y), converting the touch coordinate (x, y) can obtain at least one of the touch coordinates (xl, yl), touch coordinates (xm, ym), and touch coordinates (xr, yr).

[0258] The above touch control process realizes independent touch control of multiple display modules. The display effect is shown in Figure 9L. As shown in Figure 9L, the multi-screen display displays the image updated based on the touch operation, and the main display image D3' is displayed on the display screen 901 of the first display module 910.

[0259] When the initial image comes from the external device 940, during the display process of the multi-screen joint display mode, the external device 940 sends the initial image to the first display module 910, and the first display module 910 receives the initial image through the display input interface 917. When the resolution of the initial image is not 8640*2160, the display processing unit 914 calculates the initial image to obtain an initial image with a resolution of 8640*2160, and stores the processed initial image in the frame buffer 0. For example, if the resolution of the initial image sent by the external device 940 is Dx*Dy, the initial image can be enlarged or reduced by the conversion formula Dx0=Dx*8640 / Dx and Dy0=Dy*2160 / Dy=2160. Among them, 8640 / Dx is the horizontal scaling factor, 2160 / Dy is the vertical scaling factor, and the resolution of the scaled initial image is Dx0*Dy0.

[0260] The display processing unit 914 divides and transmits the scaled initial image based on the above method, and uses the first display module 910 and the two second display modules 920a and 920b to jointly display the image from the external device 940.

[0261] During the touch control process in multi-screen independent display mode, after receiving a USB data packet from the touch module 930, the display processing unit 914 stores the USB data packet in USB packet buffer 0 and then sends the USB data packet to the external device 940 via the second coordinate interface 916. After receiving the touch information indicated by the USB data packet, the external device 940 processes the display image to obtain an updated image and sends the updated image to the first display module 910. The first display module 910 receives the updated image via the display input interface 917 and stores it in Frame buffer 0. Based on the above method, the display processing unit 914 divides and transmits the updated image and uses the first display module 910 and the two second display modules 920a and 920b to jointly display the updated image from the external device 940.

[0262] During the display process in the multi-screen independent display mode, the external device 940 sends an initial image to the first display module 910. The first display module 910 receives the initial image via the display input interface 917 and displays it on the display screen of the first display module 910. The display processing unit 914 retrieves two initial images from two applications A and C, respectively, and displays them on the two second display modules 920a and 920b.

[0263] The display processing unit 914 operates on the initial image from application A to obtain a first display image (2400*2160) and stores it in Frame buffer 1. The display processing unit 914 operates on the initial image from the external device 940 to obtain a main display image (3840*2160) and stores it in Frame buffer 2. The display processing unit 914 operates on the initial image from application C to obtain a second display image (2400*2160) and stores it in Frame buffer 3.

[0264] Based on the above method, the display processing unit 914 transmits multiple initial images to the corresponding display modules, and uses the first display module 910 to display the main display image, uses the second display module 920a to display the first sub-display image, and uses the second display module 920b to display the second sub-display image, thereby realizing the independent display of multiple initial images.

[0265] During touch control in multi-screen independent display mode, the display processing unit 914 receives a USB data packet from the touch module 930 and identifies the value of Byte 0 in the USB data packet. If Byte 0 = 0x02, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 1. If Byte 0 = 0x04, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 2. If Byte 0 = 0x06, the display processing unit 914 stores the touch coordinates contained in the USB data packet in USB packet buffer 3.

[0266] The display processing unit 914 sends the USB data packet in the USB packet buffer 2 to the external device 940 through the second coordinate interface 916. After receiving the touch information indicated by the USB data packet, the external device 940 processes the display image to obtain an updated image and sends the updated image to the first display module 910. The first display module 910 receives the updated image through the display input interface 917 and stores the updated image as the updated main display image in the frame buffer 2.

[0267] The display processing unit 914 retrieves the touch coordinates (xl, yl) from USB packet buffer 1 and performs image processing based on the touch coordinates (xl, yl) and the initial image in Frame buffer 1 to obtain a first updated secondary display image, which is then stored in Frame buffer 1. The display processing unit 914 retrieves the touch coordinates (xr, yr) from USB packet buffer 3 and performs image processing based on the touch coordinates (xr, yr) and the initial image in Frame buffer 3 to obtain a second updated secondary display image, which is then stored in Frame buffer 3. The first display module 910 and the two second display modules 920a and 920b each display their respective updated images, thereby independently updating the display images of the first display module 910 and the two second display modules 920a and 920b.

[0268] In some embodiments, the touch module 930 also includes a fourth coordinate buffer 9327. Although a seam region exists between the two display modules where no image is displayed, touch operations can still be received within the seam region and touch feedback can be generated. For example, the seam region includes the non-display area of ​​the display screen of the display module, where no image is displayed. For example, the seam region also includes the frame of the display module. Therefore, the touch module 930 can optimize touch operations in the seam region to improve the accuracy of the touch function.

[0269] For example, when it is determined that the length of the touch track of the touch operation located in the seam area is greater than or equal to a preset length threshold, the touch operation located in the seam area is determined to be a valid operation, so that the touch track length of the touch operation before entering the seam area and the touch track length of the touch operation after leaving the seam area can be combined to determine the instruction indicated by the touch operation.

[0270] For example, when it is determined that the length of the touch track of the touch operation located in the seam area is less than a preset length threshold, the touch operation located in the seam area is determined to be an invalid operation, so that the touch operation located in the seam area can be considered to be an erroneous operation of the user, and the touch operation located in the seam area is ignored. The instruction indicated by the touch operation is determined based on the touch track length of the touch operation before entering the seam area or the touch track length of the touch operation after leaving the seam area.

[0271] For example, the preset length threshold may be the distance that the user's finger swipes within the seam area, and the value of the preset length threshold may be set according to actual needs.

[0272] For example, after receiving a touch operation, the touch module 930 may generate a touch trajectory to be optimized and store the touch trajectory to be optimized in the fourth coordinate buffer 9327. After optimizing the touch operation in the seam area of ​​the touch trajectory to be optimized, the touch module 930 obtains an initial touch trajectory and stores the initial touch trajectory in the third coordinate buffer 9326.

[0273] In the embodiment of the present disclosure, the multi-screen independent display may further include a first synchronous display mode and a second synchronous display mode.

[0274] In the first synchronous display mode, multiple display modules can all display the same display screen. When one display screen is updated, the display screens of all display modules are updated synchronously.

[0275] For example, the first display module 910 converts an initial image into a primary display image and at least one secondary display image based on the display properties of the first display module 910 and at least one second display module 920a, 920b. The primary display image and the at least one secondary display image have the same image content. The first display module 910 sends the at least one secondary display image to the at least one second display module 920a, 920b. The first display module 910 and the at least one second display module 920a, 920b display the same image.

[0276] For example, the first display module 910 can write the two auxiliary display images into Frame buffer 1 and Frame buffer 3 respectively, and write the main display image into Frame buffer 2. This allows the two second display modules 920a and 920b to display the same image as the first display module 910.

[0277] For example, based on the touch coordinates (xm, ym) of the first display module 910, the main display screen is updated to obtain an updated main display screen. After the updated main screen is converted into a resolution, it is written into Frame buffer 1 and Frame buffer 3 respectively, so that the two second display modules 920a and 920b can be updated synchronously with the first display module 910.

[0278] In the second synchronous display mode, the two second display modules can display the same display screen. When the display screen of one second display module is updated, the display screen of the other second display module is updated synchronously.

[0279] For example, the first display module 910 converts multiple initial images into a primary display image and multiple secondary display images, each of which has different display content. The multiple secondary display images are generated based on the same initial image and have the same image content. The first display module 910 sends the multiple secondary display images to the multiple second display modules 920a and 920b, respectively.

[0280] For example, the first display module 910 may write two subsidiary display images obtained based on the same initial image into Frame buffer 1 and Frame buffer 3 respectively, so that the two second display modules 920 a and 920 b can display the same image.

[0281] For example, based on the touch coordinates (xl, yl) for the second display module 920a, the first sub-display screen is updated to obtain a first updated sub-display screen, and the first updated sub-display screen is written to Frame buffer1 and Frame buffer3 at the same time, so that the two second display modules 920a and 920b can be updated synchronously.

[0282] As shown in FIG9M , the user interface of the application is displayed on the display screen 901 of the first display module 910. For example, the user can click the option for the left secondary screen in "Split Screen Mode" and select "Synchronize with Main Screen" from the drop-down menu. Correspondingly, the user can also click the option for the right secondary screen in "Split Screen Mode" and select "Synchronize with Main Screen" from the drop-down menu. In this case, the first display module 910 can store three images with the same screen content and write them to Frame buffer 1, Frame buffer 2, and Frame buffer 3 simultaneously. The two second display modules 920a and 920b display the same screen content synchronously with the first display module 910.

[0283] In the display mode of "synchronous main screen", when the display screen of the first display module 910 is updated based on a touch operation, the display screens of the two second display modules 920a and 920 will also be updated synchronously.

[0284] For example, the user can click on the left secondary screen option in "Split Screen Mode" and select "Synchronize and Expand Secondary Screen" in the drop-down options. Correspondingly, the user can also click on the right secondary screen option in "Split Screen Mode" and select "Synchronize and Expand Secondary Screen" in the drop-down options. In this case, the first display module 910 can store two images with the same screen content in Frame buffer 1 and Frame buffer 3 at the same time, and the two second display modules 920a and 920b can synchronously display the same screen content, but display different screen content from the first display module 910.

[0285] In the display mode of "secondary screen synchronous expansion", when the display screen of the second display module 920a is updated based on the touch operation, the display screen of the second display module 920b will also be updated synchronously.

[0286] For example, the user can click on the left secondary screen option in "Split Screen Mode" and select "Extend Secondary Screen Separately" from the drop-down menu. Correspondingly, the user can also click on the right secondary screen option in "Split Screen Mode" and select "Extend Secondary Screen Separately" from the drop-down menu. In this case, the first display module 910 can store two images with different screen contents in both Frame buffer 1 and Frame buffer 3, and the two second display modules 920a and 920b can display different screen contents, allowing the first display module 910 and the two second display modules 920a and 920b to display different screen contents respectively.

[0287] In the "secondary screen expansion" display mode, only the display screen of a single display module can be updated based on touch operations.

[0288] As shown in Figure 9N, after the user selects "Extend the secondary screen separately", the user can also select an application in the "Select extended application" drop-down menu. The selected application is the image source of the corresponding display module. For example, the user can click the "Whiteboard" selection button to enable the second display module 920a to display the interface image of the "Whiteboard" application. The first display module 910 obtains the initial image from the "Whiteboard" application, processes the initial image to obtain the first secondary display image, and stores the first secondary display image in Frame buffer 1.

[0289] In the disclosed embodiment, in response to a received screen switching instruction, the first display module 910 swaps the secondary display images stored in the plurality of second frame buffers 9142, thereby switching the secondary display images in the plurality of second display modules 920a and 920b. The secondary display images displayed by the plurality of second display modules 920a and 920b have different image contents. For example, after receiving the screen switching instruction, the display processing unit 914 may swap the secondary display images stored in Frame buffer 1 and Frame buffer 3, thereby switching the images between the two second display modules 920a and 920b.

[0290] As shown in Figure 9O, in the display mode of "separate expansion of secondary screen", the user can also click the "one-key swap" button, and the first display module 910 will swap the secondary display images stored in Frame buffer1 and Frame buffer3, thereby realizing the screen switching between the two second display modules 920a and 920b.

[0291] In the embodiment of the present disclosure, in response to a received screen sharing instruction, the first display module 910 stores the main display image stored in the first frame buffer 9141 into at least one second frame buffer 9141, thereby enabling at least one second display module 920a and 920b to display the main display image, respectively. For example, after receiving the screen sharing instruction, the display processing unit 914 may store the main display image stored in Frame buffer 2 into Frame buffer 1 and Frame buffer 3, thereby enabling the two second display modules 920a and 920b to synchronously display the same display image with the first display module 910.

[0292] In an embodiment of the present disclosure, in a multi-screen independent display mode, when it is determined that the touch operation is directed to any one of the multiple second display modules 920a and 920b, the first display module 910 generates multiple updated sub-display images based on the target touch trajectory, and sends the multiple updated sub-display images to the multiple second display modules 920a and 920b respectively, and uses the multiple second display modules 920a and 920b to display multiple updated sub-display screens, and the display content of the multiple updated sub-display screens is the same.

[0293] For example, when the display screens of the two second display modules 920a and 920b are the same, when the display processing unit 914 receives the touch coordinates for one of the second display modules 920a and 920b, it can generate an updated sub-display screen based on the touch coordinates, and store the updated sub-display screen in Frame buffer 1 and Frame buffer 3 at the same time, thereby achieving synchronous update of the display screens of the two second display modules 920a and 920b.

[0294] As shown in Figure 9P, the display content of display screen 902a of the second display module 920a is the same as the display content of display screen 902b of the second display module 920b. The user can perform writing operations on the screen of the second display module 920b. The writing operation can be a touch operation, and the written content generated by the writing operation can be displayed on the display screen 902b in the form of a writing screen T1. In display screen 902b, the interface image of the "File Manager" application is the background image, and the written content generated by the user's writing operation forms a writing screen, which is located above the background image. When the user performs writing operations only on the screen of the second display module 920b, the display screen 902a of the second display module 920a can synchronize the update of the writing screen with the display screen 902b of the second display module 920b. The writing screen T2 is displayed on the display screen 902a of the second display module 920a. The display content of writing screen T1 and writing screen T2 is the same. This allows the display screens of the two second display modules to be updated synchronously. After one of the second display modules receives a touch operation, the two second display modules are used to simultaneously display updated content to the user.

[0295] For example, when the display processing unit 914 receives the touch coordinates for the second display module 920a, it can generate an updated secondary display screen based on the touch coordinates and update the screen of the second display module 920a, while the screen of the other second display module 920a is not updated.

[0296] For example, the display module 900 may support a writing function, and the user may perform a writing operation on the screen of the display module. For example, the writing operation includes the user writing text or drawing on the screen of the display module, and the written content is displayed on the display screen.

[0297] For the two second display modules 920a and 920b that display synchronously, the two second display modules 920a and 920b can synchronously update the display screen and the writing screen, or they can synchronously update only the display screen without synchronously updating the writing screen. For example, the display screen is the background screen, and the writing screen is overlaid on the display screen. For example, the display screen and the writing screen can be understood as two layers, and the writing screen is the upper layer of the display screen.

[0298] For example, when the second display module 920a receives a writing operation, the writing image can be displayed on the second display module 920a with the previous frame of the display image as the background. At this time, the second display module 920b still displays the previous frame of the display image. When the display image of the second display module 920a is updated, the second display module 920b can update the display image synchronously with the second display module 920b.

[0299] As shown in Figure 9Q, the display content of the display screen 902a of the second display module 920a is the same as the display content of the display screen 902b of the second display module 920b. The user can perform writing operations on the screen of the second display module 920b. The writing operation can be a touch operation, and the writing content generated by the writing operation can be displayed on the display screen 902b in the form of a writing screen T. In the display screen 902b, the interface image of the "File Manager" application is the background screen, and the writing content formed by the user's writing operation forms a writing screen, which is located on the upper layer of the background image. When the user performs a writing operation, the display screen 902a of the second display module 920a will not synchronously update the writing screen, which can ensure that the multi-screen display can simultaneously display the writing content and the unobstructed interface image of the "File Manager" application to the user.

[0300] Figure 10A is a schematic diagram of display module splicing according to an embodiment of the present disclosure. Figures 10B to 10G are schematic diagrams of touch operations according to an embodiment of the present disclosure.

[0301] As shown in Figure 10A, area 1001 may be the display area of ​​the first display module, area 1002 may be the display area of ​​the second display module, and area 1003 may be the seam area between the display areas of the first and second display modules, which is a non-display area. Area 1003 only receives touch operations and does not display images. Area 1003 may include the non-display area of ​​the first display module and the non-display area of ​​the second display module.

[0302] In the embodiment of the present disclosure, the touch module determines a target touch track based on a valid operation in the touch operation. After optimizing the touch track to be optimized, the touch module obtains a valid operation of the touch operation, thereby determining the target touch track.

[0303] In an embodiment of the present disclosure, when the display mode is the multi-screen joint mode, the effective operation includes a touch operation within the display area of ​​each of the first display module and the at least one second display module.

[0304] For example, when a finger swipes from area 1003 to area 1001 or area 1002 , the touch module removes the touch track in area 1003 from the touch track to be optimized, and determines the target touch track based on the touch track in area 1001 or area 1002 .

[0305] As shown in Figure 10B, a finger slides from point A in area 1003 toward area 1001. The finger enters area 1001 at point B and leaves the screen at point C in area 1001. Touch track AB is within area 1003, and touch track BC is within area 1001. The touch operation performed within area 1001 is a valid operation. Therefore, after removing touch track AB from touch track AB, touch track BC is determined to be the target touch track.

[0306] Accordingly, when the finger swipes from area 1001 or area 1002 to area 1003 , the touch module removes the touch track in area 1003 from the touch track to be optimized, and determines the target touch track based on the touch track in area 1001 or area 1002 .

[0307] For example, when a finger swipes from area 1001 through area 1003 to area 1002, the touch module removes the touch track in area 1003 from the touch track to be optimized, and determines the target touch track based on the touch tracks in areas 1001 and 1002.

[0308] As shown in Figure 10C, a finger slides from point A in area 1001 toward area 1002. The finger enters area 1003 from point B, passes through area 1003, and then enters area 1002 from point C. The finger swipes within area 1002, entering area 1003 from point D, passing through area 1003, and then entering area 1001 from point E, leaving the screen at point F in area 1001. Touch traces AB and EF are located within area 1001, touch traces BC and DE are located within area 1003, and touch trace CD is located within area 1002. The touch operations performed within areas 1001 and 1002 are valid operations. Therefore, after removing touch traces BC and DE from touch trace AF, touch traces AB, CD, and EF are determined to be target touch traces.

[0309] For example, when a finger touches area 1001 through area 1003 and then to area 1001, the touch module removes the touch track in area 1003 from the touch track to be optimized and determines the target touch track based on the touch track in area 1001.

[0310] As shown in Figure 10D, a finger slides from point A in area 1001 toward area 1002. The finger enters area 1003 from point B, re-enters area 1001 from point C, and leaves the screen at point D in area 1001. Touch traces AB and CD are located within area 1001, while touch trace BC is located within area 1003. The touch operation performed within area 1001 is considered a valid operation. Therefore, after removing touch trace BC from touch trace AD, touch traces AB and CD are determined to be the target touch traces.

[0311] In an embodiment of the present disclosure, when the display mode is a multi-screen independent display mode, when it is determined that the length of the touch track of the touch operation within the display area is not less than a first specified length, the valid operation includes the touch operation within the display area.

[0312] When the display mode is a multi-screen independent display mode, when it is determined that the touch operation includes a specified operation, the valid operation includes a touch operation in the non-display area with a touch track length of a second specified length, and the non-display area is a seam area between the first display module and at least one second display module. The specified operation includes any one of the following: the operation starting point of the touch operation is located in the non-display area, the operation end point of the touch operation is located in the non-display area, the operation starting point and the operation end point are located in different display areas, and the operation track of the touch operation is located in the non-display area.

[0313] For example, the first designated length may be 1 cm, and the second designated length may be 0.5 cm. The present disclosure does not limit the specific values ​​of the first designated length and the second designated length.

[0314] For example, if a finger swipes a distance of at least 1 cm in area 1001 or 1002, the touch module determines a target touch trajectory based on the touch trajectory in area 1001 or 1002. If the finger swipes a distance of less than 1 cm in area 1001 or 1002, the touch operation is considered an accidental touch. The display module ignores the touch operation corresponding to the target touch trajectory.

[0315] As shown in Figure 10E , a finger slides from point A in area 1001 toward point B, leaving touch track AB within area 1001. If the touch module determines that the distance of touch track AB is less than 1 cm, it may consider the finger's touch operation within area 1001 to be an accidental touch and ignore the touch operation. If the touch module determines that the distance of touch track AB is greater than or equal to 1 cm, it may consider touch track AB to be the target touch track.

[0316] For example, the starting point of a touch operation may be located in area 1003, and the end point of the operation may be located in area 1001. When a finger swipes from area 1003 to area 1001, the touch module uses the 0.5 cm touch track within area 1003 and the touch track within area 1001 as the target touch track corresponding to the first display module. Therefore, based on the 0.5 cm touch track within area 1003, it can be determined that the touch operation started from the edge of the first display module.

[0317] For example, the starting point of a touch operation may be located in area 1001, and the end point of the operation may be located in area 1003. When a finger swipes from area 1001 to area 1003, the touch module uses the 0.5 cm touch track within area 1003 and the touch track within area 1001 as the target touch track corresponding to the first display module. Therefore, based on the 0.5 cm touch track within area 1003, it can be determined that the touch operation ended at the edge of the first display module.

[0318] As shown in Figure 10F, a finger slides from point A in area 1003 toward area 1001. The finger enters area 1001 at point B and leaves the screen at point C in area 1001. Touch track AB is within area 1003, and touch track BC is within area 1001. When the touch module determines that the distance of touch track BC is greater than or equal to 1 cm, it considers touch track MB and touch track BC to be target touch tracks.

[0319] The length of touch track MB is 0.5 cm. For example, when the length of touch track AB is greater than or equal to 0.5 cm, point M is determined on touch track AB so that the length of touch track MB is 0.5 cm. When the length of touch track AB is less than 0.5 cm, point M is randomly determined within area 1003 starting from point B so that the length of line segment MB is 0.5 cm.

[0320] It should be noted that the target touch trajectory includes the touch start point and touch end point of the target trajectory. Therefore, the swiping direction of the touch operation can be determined based on the target touch trajectory.

[0321] For example, the starting point of a touch operation may be located in area 1001, the end point of the operation may be located in area 1002, and the operation trajectory of the touch operation may pass through area 1003. For example, when a finger swipes from area 1001 through area 1003 to area 1002, and the swipe distance within area 1002 is not less than 1 cm, the touch module uses the touch trajectory in area 1001 as the target touch trajectory for the first display module, and uses the touch trajectory of 0.5 cm in area 1003 and the touch trajectory of area 1002 as the target touch trajectory for the second display module. Therefore, based on the 0.5 cm in area 1003, it can be determined that the touch operation is from the first display module to the second display module.

[0322] For example, when a finger swipes from area 1001 through area 1003 to area 1002 and the swiping distance in area 1002 is less than 1 cm, the touch module removes the touch tracks in areas 1003 and 1002 from the touch tracks to be optimized, and uses the touch track in area 1001 as the target touch track of the first display module.

[0323] As shown in Figure 10G, a finger slides from point A in area 1001 toward area 1002. The finger enters area 1003 from point B, passes through area 1003, then enters area 1002 from point C, leaving the screen at point D in area 1002. Touch track AB is within area 1001, touch track BC is within area 1003, and touch track CD is within area 1002. When the touch module determines that the distance between touch track BC is greater than or equal to 1 cm, it considers touch track MB and touch track BC to be target touch tracks.

[0324] When the touch module determines that the distances between touch track AB and touch track CD are both greater than or equal to 1 cm, it considers touch track AB, touch track CD, and touch track MC to be target touch tracks. The length of touch track MC is 0.5 cm. It is understandable that in an actual multi-screen display, the width of area 1003, which serves as the seam area, is greater than 0.5 cm.

[0325] When the touch module determines that the touch track AB is greater than or equal to 1 cm and the touch track CD is less than 1 cm, it may consider the finger touch operation in area 1002 to be an accidental touch, ignore the touch track CD and the touch operation BC, and consider the touch track AB to be the target touch track.

[0326] For example, when a finger touches area 1001 through area 1003 to area 1002, and then from area 1003 to area 1001, and the sliding distance in area 1002 is less than 1 cm, the touch module removes the touch tracks in area 1003 and area 1002 from the touch tracks to be optimized, and uses the touch track in area 1001 as the target touch track of the first display module.

[0327] As shown in Figure 10C, a finger slides from point A in area 1001 toward area 1002. The finger enters area 1003 from point B, passes through area 1003, and then enters area 1002 from point C. The finger swipes within area 1002, entering area 1003 from point D, passing through area 1003, and then entering area 1001 from point E, leaving the screen at point F in area 1001. Touch tracks AB and EF are within area 1001, touch tracks BC and DE are within area 1003, and touch track CD is within area 1002.

[0328] When the touch module determines that touch track CD is less than 1 cm, it may consider the finger touch operation in area 1002 to be an accidental touch and ignore touch track CD, touch operation BC, and touch track DE. At this time, when the touch module determines that either touch track AB or touch track EF is greater than or equal to 1 cm, or that the sum of touch track AB and touch track EF is greater than or equal to 1 cm, it considers touch track AB and touch track EF to be the target touch track.

[0329] In the embodiment of the present disclosure, by optimizing the touch track to be optimized collected by the touch module, the accuracy of the target touch track can be improved, thereby improving the accuracy of touch feedback.

[0330] In some embodiments, the display module can also be applied to educational classroom scenarios, smart office scenarios, and smart central control scenarios.

[0331] For example, the display module 100 shown in Figure 1 is detachable. Since the touch module 130 can be modularly designed, touch sub-modules are respectively provided at the borders of the first display module 110 and the second display modules 120a and 120b. The touch sub-module on the first display module 110 may include a first infrared emitting sub-unit and a first infrared receiving sub-unit 7321 as shown in Figure 7. The touch sub-module on the second display modules 120a and 120b may include a second infrared emitting sub-unit 7312 and a second infrared receiving sub-unit 7322 as shown in Figure 7. The first display module 110 can be set on a podium for use by teachers. Multiple second display modules 120a and 120b can be set on students' seats for use by students. The present disclosure does not limit the number of second display modules.

[0332] For example, in the "Synchronize Main Screen" display mode described above, the teacher synchronizes the screen displayed on the first display module to multiple second display modules, and the multiple second display modules display the same screen as the first display module. When the teacher writes on the screen of the first display module, the multiple second display modules can update the writing screen synchronously with the first display module.

[0333] For example, when conducting a classroom test, the teacher can synchronize the test paper screen displayed by the first display module to multiple second display modules based on the display mode of "synchronizing the main screen", or input a screen sharing instruction to share the test paper screen displayed by the first display module to multiple second display modules. After the screen is synchronized, switch from the "synchronizing the main screen" to the display mode of "separate expansion of the secondary screen" described above. In the display mode of "separate expansion of the secondary screen", each student can answer on the screen of their respective second display modules, that is, perform writing operations. At this time, each second display module displays the corresponding writing screen in its respective display screen based on the writing operation it receives, with the test paper screen as the background screen.

[0334] For example, after the test is over, the teacher performs a touch operation on the screen of the first display module to input a screen switching instruction, thereby switching the display screens of the second display modules. For example, the switching can be random, or any two second display modules can be switched to each other. The present disclosure does not limit the switching method. For example, the switching content includes a writing screen, and students can perform classroom test scores on the switched writing screens on their respective second display modules, thereby enabling students to correct each other's test papers.

[0335] For example, when a teacher is explaining the results of a classroom test, the writing screen of one of the second display modules can be synchronized with the display screens of all other second display modules based on the "secondary screen synchronization expansion" display mode described above, so that the teacher can explain the process of a student's answering. For example, the teacher can also perform a writing operation on the screen of the first display module, and multiple second display modules will synchronously display the same writing screen as the first display module, so that the teacher's explanation process can be synchronized to all students.

[0336] For example, after the class is over or in a multi-screen joint display mode, the first display module and multiple second display modules can be spliced ​​to form a multi-screen display, which can be used for joint display.

[0337] FIG11 is a flowchart of an image processing method according to an embodiment of the present disclosure.

[0338] As shown in Figure 11, the image processing method is applied to a multi-screen display, which includes a first display module, at least one second display module, and a touch module. For example, the multi-screen display may include display module 100 and display module 900. The image processing method may include operations S1110 to S1140.

[0339] In operation S1110 , a first display module is used to generate a plurality of display images for a display mode, where the plurality of display images include a main display image and at least one subsidiary display image.

[0340] In operation S1120 , a main display image is displayed using a first display module, and at least one subsidiary display image is displayed using at least one second display module.

[0341] In operation S1130 , the touch module is used to determine a target touch track based on the received touch operation.

[0342] In operation S1140 , a plurality of display images are updated based on the target touch trajectory using the first display module.

[0343] In the embodiment of the present disclosure, operations S1110 to S1140 are similar to the operations performed by the display module 100 and the display module 900 described above, and are not described again herein.

[0344] In an embodiment of the present disclosure, generating multiple display images corresponding to the display mode in operation S1110 includes: when it is determined that the display mode is the first display mode, dividing the initial image into a main display image and at least one sub-display image according to the display properties of the first display module and at least one second display module; when it is determined that the display mode is the second display mode, converting the initial image according to the display properties of the first display module and at least one second display module to obtain a main display image and at least one sub-display image; and sending the at least one sub-display image to at least one second display module respectively.

[0345] In an embodiment of the present disclosure, updating multiple display images based on the target touch trajectory in operation S1140 includes: when it is determined that the display mode is the first display mode and the initial image is from the first display module, generating an updated image according to the target touch trajectory, and dividing the updated image into an updated main display image and at least one updated sub-display image; and when it is determined that the display mode is the second display mode and the initial image is from the first display module, determining the target display module targeted by the touch operation, the target display module including at least one of the first display module and at least one second display module, and generating an updated image for the target display module according to the target touch trajectory.

[0346] In an embodiment of the present disclosure, operation S1140 updates multiple display images based on the target touch trajectory, including: when it is determined that the display mode is the first display mode and the initial image comes from an external device, sending the target touch trajectory to the external device, receiving the updated image obtained by the external device based on the target touch trajectory, and dividing the updated image into an updated main display image and at least one updated sub-display image; and when it is determined that the display mode is the second display mode and the initial image comes from the external device, determining the target display module targeted by the touch operation, the target display module including at least one of the first display module and at least one second display module, sending the target touch trajectory to the external device, and receiving the updated image obtained by the external device based on the target touch trajectory.

[0347] In an embodiment of the present disclosure, determining the target touch trajectory based on the received touch operation in operation S1130 includes: determining the touch operation based on emission information and reception information of infrared light; and determining the target touch trajectory based on the touch operation.

[0348] In an embodiment of the present disclosure, operation S1130 determines the target touch trajectory based on the received touch operation, including: in response to a first instruction from the first display module, determining the initial touch trajectory of the touch operation according to the touch operation, the first instruction instructing the touch module to switch to the first display mode; wherein the initial touch trajectory serves as the target touch trajectory, and the target touch coordinates included in the initial touch trajectory are determined based on the coordinate system of the multi-screen display.

[0349] In an embodiment of the present disclosure, operation S1130 determines a target touch trajectory based on a received touch operation, including: determining an initial touch trajectory of the touch operation according to the touch operation in response to a second instruction from the first display module, the second instruction instructing the touch module to switch to the second display mode; converting the initial touch trajectory into a target touch trajectory according to display properties of the first display module and at least one second display module; wherein the target touch coordinates included in the target touch trajectory are determined based on the coordinate system of the target display module, and the target display module includes at least one of the first display module and the at least one second display module.

[0350] In an embodiment of the present disclosure, operation S1130 determines a target touch trajectory based on a received touch operation, including: determining a target touch trajectory based on a valid operation of the touch operation; wherein, when the display mode is the first display mode, the valid operation includes a touch operation located within the respective display areas of the first display module and the at least one second display module; when the display mode is the second display mode, when it is determined that the length of the touch trajectory of the touch operation located within the display area is not less than the first specified length, the valid operation includes the touch operation located within the display area; when the display mode is the second display mode, when it is determined that the touch operation includes a specified operation, the valid operation includes a touch operation located within the non-display area with a touch trajectory length of the second specified length, the non-display area being the seam area between the first display module and the at least one second display module, and the specified operation includes any of the following: the operation starting point of the touch operation is located in the non-display area, the operation end point of the touch operation is located in the non-display area, the operation starting point and the operation end point are located in different display areas, and the operation trajectory of the touch operation is located in the non-display area.

[0351] FIG12A is a flowchart of a screen display method according to an embodiment of the present disclosure.

[0352] As shown in FIG12A , the multi-screen display includes a first display module, at least one second display module, and a touch module. For example, the multi-screen display may include a full-text display module 100 and a display module 900. The screen display method may include operations S1210 to S1220.

[0353] In operation S1210 , in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one auxiliary display image is displayed using at least one second display module.

[0354] In the embodiment of the present disclosure, the screen display instruction can instruct the multi-screen display to perform multi-screen joint display in the first display mode, or can instruct the multi-screen display to perform multi-screen independent display in the second display mode.

[0355] In operation S1220, in response to the received touch operation, the first display module is used to display an updated main display image, and the at least one second display module is used to display at least one updated subsidiary display image.

[0356] In the embodiment of the present disclosure, updating of the main display image and at least one updated sub-display image are determined based on a touch operation.

[0357] In the embodiment of the present disclosure, operations S1210 to S1220 are similar to the operations performed by the display module 100 and the display module 900 described above, and are not repeated here.

[0358] In an embodiment of the present disclosure, in operation S1210, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, respectively, including: when it is determined that the display mode indicated by the screen display instruction is the first display mode, dividing the initial image into a main display image and at least one sub-display image; and displaying the main display image using the first display module, and displaying at least one sub-display image using at least one second display module, respectively.

[0359] In an embodiment of the present disclosure, in operation S1210, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, respectively, including: when it is determined that the display mode indicated by the screen display instruction is the second display mode, converting multiple initial images into a main display image and at least one sub-display image, respectively, and the image contents of the multiple initial images are different; and displaying the main display image using the first display module, and displaying at least one sub-display image using at least one second display module, respectively.

[0360] In an embodiment of the present disclosure, in operation S1210, in response to a received screen display instruction, a main display image is displayed using a first display module, and at least one sub-display image is displayed using at least one second display module, respectively, including: when it is determined that the display mode indicated by the screen display instruction is a first synchronous display mode, the initial image is converted into a main display image and at least one sub-display image, respectively, and the screen contents of the main display image and the at least one sub-display image are the same; and the main display image is displayed using the first display module, and at least one sub-display image is displayed using at least one second display module, respectively.

[0361] In an embodiment of the present disclosure, the at least one second display module includes a plurality of second display modules. Operation S1210, in response to a received screen display instruction, displays a primary display image using the first display module and displays at least one secondary display image using the at least one second display module, including: upon determining that the display mode indicated by the screen display instruction is the second synchronous display mode, converting a plurality of initial images into a primary display image and a plurality of secondary display images, wherein the display contents of the plurality of initial images are different and the screen contents of the plurality of secondary display images are the same; and displaying the primary display image using the first display module and displaying the plurality of secondary display images using the plurality of second display modules.

[0362] In an embodiment of the present disclosure, the at least one second display module includes a plurality of second display modules. The screen display method further includes switching the secondary display images in the plurality of second display modules in response to a received screen switching instruction, wherein the screen contents of the plurality of secondary display images displayed by the plurality of second display modules are different.

[0363] In the embodiment of the present disclosure, the screen display method further includes: in response to the received screen sharing instruction, using at least one second display module to display the main display image respectively.

[0364] In an embodiment of the present disclosure, in operation S1220, in response to a received touch operation, an updated main display image is displayed using the first display module, and at least one updated sub-display image is displayed using at least one second display module, respectively, including: in a first display mode, the main display image and at least one sub-display image are updated according to the touch operation to obtain an updated image; and the updated main display image is displayed using the first display module, and at least one updated sub-display image is displayed using at least one second display module, respectively, the updated main display image and the at least one updated sub-display image are obtained by dividing the updated image.

[0365] In an embodiment of the present disclosure, in operation S1220, in response to the received touch operation, the first display module is used to display an updated main display image, and at least one updated sub-display image is displayed respectively using at least one second display module, including: in the second display mode, when it is determined that the touch operation is directed to the first display module, the first display module is used to display the updated main display image, and the updated main display image is obtained by updating the main display image; and in the second display mode, when it is determined that the touch operation is directed to the second display module, the second display module is used to display the updated sub-display image, and the updated sub-display image is obtained by updating the sub-display image.

[0366] In an embodiment of the present disclosure, the at least one second display module includes a plurality of second display modules. In operation S1220, in response to the received touch operation, displaying an updated main display image using the first display module and displaying at least one updated secondary display image using the at least one second display module, respectively, includes: in the second display mode, if it is determined that the touch operation is directed to any one of the plurality of second display modules, displaying a plurality of updated secondary display images using the plurality of second display modules, wherein the display content of the plurality of updated secondary display images is the same.

[0367] FIG12B is an application architecture diagram of a method for implementing a screen display according to an embodiment of the present disclosure.

[0368] As shown in Figure 12B, the application architecture 1200 for implementing the screen display method includes four layers, namely, the application layer 1201, the application framework layer 1202, the system interface layer 1203 and the operating system layer 1204 from top to bottom. The application layer 1201, the application framework layer 1202, the system interface layer 1203 and the operating system layer 1204 communicate with each other through software interfaces.

[0369] In the disclosed embodiment, the application layer 1201 may be an application program for controlling the display mode as described above. For example, when a user inputs a touch operation, the application layer 1201 receives the touch operation and determines the instruction corresponding to the touch operation. For example, the touch operation is a user clicking a "Sync Home Screen" button, which generates an instruction instructing the first display module and the touch module to enter a multi-screen joint display mode.

[0370] In an embodiment of the present disclosure, the application framework layer 1202 may include a display control component, a content providing component, a notification component, and the like.

[0371] For example, the display control component can control the first display module and multiple second display modules to display images based on a multi-screen joint display mode, and can control the first display module to divide the initial image and the updated image, and control the first display module to send the divided multiple secondary display images and multiple updated secondary display images to the second display modules. The display control component can also control the first display module to display the main display image and update the main display image, and control the multiple second display modules to display multiple secondary display images and update the secondary display images.

[0372] For example, the content provider component may include multiple applications or be linked to multiple applications, thereby obtaining images from multiple applications and enabling the display module to display the images. For example, the application package may include a gallery application, a document application, a browser application, a video application, a game application, a system settings application, a shopping application, a news application, an instant messaging application, a camera application, a memo application, a computer application, etc.

[0373] For example, the notification component can control the first display module to send a first instruction and a second instruction to the touch module. The first display module can control the touch module to send the first instruction, causing the touch module to enter a multi-screen joint display mode based on the first instruction, and causing the touch module to determine a touch trajectory based on a coordinate system range corresponding to the multi-screen joint display mode. The first display module can control the touch module to send a second instruction, causing the touch module to enter a multi-screen independent display mode based on the second instruction, and causing the touch module to determine a touch trajectory based on a coordinate system range corresponding to the multi-screen independent display mode.

[0374] In the disclosed embodiment, the system interface layer 1203 provides multiple interfaces. For example, the system interface layer 1203 includes a first coordinate interface 915, a first display coordinate interface 912, a second coordinate interface 916, a display input interface 917, a second display coordinate interface 912a, a second display coordinate interface 912b, a peripheral device interface 9323, an infrared transmission control port 9321, and an infrared reception control port 9322, as shown in FIG9A . The functions of each interface are similar to those described above and will not be repeated here for the sake of brevity.

[0375] In the embodiment of the present disclosure, the operating system layer 1204 may include an Android operating system. The operating system layer 1204 may provide resource management, memory management, device management, etc., and provide a foundation such as threads and processes for the operation of applications.

[0376] It can be understood that the architecture diagram shown in Figure 12B is only an example. The application architecture for implementing the screen display method can have more or fewer software modules, or combine certain software modules, or split certain software modules, etc., and the embodiments of the present disclosure do not limit this.

[0377] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0378] Those skilled in the art will appreciate that various combinations and / or combinations of features described in the various embodiments and / or claims of this disclosure may be made, even if such combinations or combinations are not explicitly described in this disclosure. In particular, various combinations and / or combinations of features described in the various embodiments and / or claims of this disclosure may be made, without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0379] The embodiments of the present disclosure are described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be used in combination to advantage. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A display module, comprising: A first display module configured to generate a plurality of display images for a display mode, the plurality of display images including a main display image and at least one sub-display image, and display the main display image; At least one second display module communicatively connected to the first display module respectively, configured to receive the at least one sub-display image from the first display module, and display the at least one sub-display image; And A touch control module, the touch control module including a touch component, the touch component covering the first display module and the at least one second display module, the touch control module being configured to determine a target touch trajectory based on a received touch operation, and send the target touch trajectory to the first display module; Wherein, the first display module and the at least one second display module are spliced to form a multi-screen display, and the first display module updates a display screen of the multi-screen display based on the target touch trajectory.

2. The display module according to claim 1, wherein, The first display module is configured to: In a case where it is determined that the display mode is a first display mode, divide an initial image into the main display image and the at least one sub-display image according to display attributes of the first display module and the at least one second display module; In a case where it is determined that the display mode is a second display mode, convert the initial image according to display attributes of the first display module and the at least one second display module to obtain the main display image and the at least one sub-display image; And Send the at least one sub-display image to the at least one second display module respectively.

3. The display module according to claim 1 or 2, wherein, The first display module includes: A main display screen; A first display output interface; At least one second display output interface; A display processing unit configured to generate the main display image and the at least one sub-display image, and send the main display image to the main display screen through the first display output interface, and send the at least one sub-display image to the at least one second display module through the at least one second display output interface respectively.

4. The display module according to claim 3, wherein, The display processing unit includes a frame buffer, and the frame buffer: A first frame buffer configured to store the main display image; And At least one second frame buffer configured to store the at least one sub-display image respectively.

5. The display module according to claim 4, wherein, The frame buffer further includes: A third frame buffer configured to store an initial image; Wherein, the display processing unit is further configured to read and process the initial image from the third frame buffer to obtain the main display image and the at least one sub-display image.

6. The display module according to claim 3, wherein, The first display module further includes: A display input interface; Wherein, the display processing unit is further configured to receive an initial image from an external device through the display input interface.

7. The display module according to claim 2, wherein, The first display module is configured to: When it is determined that the display mode is the first display mode and the initial image comes from the first display module, an updated image is generated according to the target touch trajectory, and the updated image is divided into the updated main display image and the at least one updated sub-display image, and the at least one updated sub-display image is sent to the at least one second display module respectively; And When it is determined that the display mode is the second display mode and the initial image comes from the first display module, determine the target display module for the touch operation, generate an updated image for the target display module according to the target touch trajectory, and send the updated image to the target display module, where the target display module includes at least one of the first display module and the at least one second display module.

8. The display module according to claim 3, wherein, The first display module includes: A first coordinate interface; Wherein, the display processing unit is further configured to receive the target touch trajectory from the touch control module through the first coordinate interface.

9. The display module according to claim 8, wherein, The first display module further includes: A second coordinate interface; Wherein, the display processing unit is further configured to send the target touch coordinates to the external device through the second coordinate interface when it is determined that the initial image comes from an external device.

10. The display module according to claim 2, wherein, The first display module is further configured to: When it is determined that the display mode is the first display mode and the initial image comes from an external device, send the target touch trajectory to the external device, receive the updated image obtained by the external device based on the target touch trajectory, and divide the updated image into the updated main display image and the at least one updated sub-display image, and send the at least one updated sub-display image to the at least one second display module respectively; And When it is determined that the display mode is the second display mode and the initial image comes from the external device, determine the target display module for the touch operation, send the target touch trajectory to the external device, receive the updated image obtained by the external device based on the target touch trajectory, and send the updated image to the target display module, where the target display module includes at least one of the first display module and the at least one second display module.

11. The display module according to claim 1 or 2, wherein, The touch control module includes: A touch sensing unit integrated in the first display module and the at least one second display module, configured to generate touch sensing information based on the sensed touch operation; A touch processing unit electrically connected to the touch sensing unit and integrated in the first display module, configured to determine the touch operation based on the touch sensing information, determine the target touch trajectory based on the touch operation, and send the target touch trajectory to the first display module.

12. The display module according to claim 11, wherein, The touch sensing unit includes an infrared emission unit and an infrared reception unit; The infrared emission unit includes: A first infrared emission sub-unit disposed on the first side of the first display module; and At least one second infrared emission sub-unit respectively disposed on the first side of the at least second display module; And The infrared receiving unit includes: A first infrared receiving subunit, disposed on a second side of the first display module opposite to a first side of the first display module; and At least one second infrared receiving subunit, respectively disposed on second sides of the at least one second display module opposite to first sides of the at least one second display module; Wherein, the first infrared transmitting subunit is electrically connected to the at least one second infrared transmitting subunit, and the first infrared receiving subunit is electrically connected to the at least one second infrared receiving subunit.

13. The display module according to claim 12, wherein, The touch processing unit includes: An infrared emission control port; An infrared reception control port; and A peripheral device interface; Wherein, the touch processing unit is further configured to control the infrared emitting unit to emit infrared light through the infrared emission control port, collect reception information of the infrared receiving unit through the infrared reception control port, and send the target touch trajectory to the first display module through the peripheral device interface.

14. The display module according to claim 11, wherein, The touch processing unit is configured to: In response to a first instruction from the first display module, determine an initial touch trajectory of the touch operation according to the touch operation, the first instruction indicating that the touch module switches to a first display mode; Wherein, the initial touch trajectory serves as the target touch trajectory, and touch coordinates included in the initial touch trajectory are determined based on the coordinate system of the multi-screen display.

15. The display module according to claim 11, wherein, The touch processing unit is configured to: In response to a second instruction from the first display module, determine an initial touch trajectory of the touch operation according to the touch operation, the second instruction indicating that the touch module switches to a second display mode; Convert the initial touch trajectory into the target touch trajectory according to display attributes of the first display module and the at least one second display module; Wherein, target touch coordinates included in the target touch trajectory are determined based on the coordinate system of a target display module, and the target display module includes at least one of the first display module and the at least one second display module.

16. The display module according to claim 11, wherein, The touch processing unit includes: A first coordinate buffer, configured to store a target touch trajectory based on the coordinate system of the first display module; At least one second coordinate buffer, configured to respectively store target touch trajectories based on the respective coordinate systems of the at least one second display module; and A third coordinate buffer, configured to store a target touch trajectory based on the coordinate system of the multi-screen display.

17. The display module according to claim 16, wherein, The first display module includes: A first data packet buffer, configured to store a target touch trajectory from the first coordinate buffer; At least one second data packet buffer, configured to respectively store target touch trajectories from the at least one second coordinate buffer; and A third data packet buffer, configured to store a target touch trajectory from the third coordinate buffer.

18. The display module according to claim 1, wherein, The touch module is configured to: Determine a target touch trajectory based on a valid operation of the touch operation; Wherein, when the display mode is the first display mode, the valid operations include touch operations within the display areas of the first display module and each of the at least one second display module; When the display mode is the second display mode, in the case where it is determined that the length of the touch trajectory of the touch operation within the display area is not less than a first specified length, the valid operations include touch operations within the display area; When the display mode is the second display mode, in the case where it is determined that the touch operation includes a specified operation, the valid operations include touch operations with a touch trajectory length of a second specified length within a non-display area, where the non-display area is the seam area between the first display module and the at least one second display module, and the specified operation includes any one of the following: the starting point of the touch operation is within the non-display area, the ending point of the touch operation is within the non-display area, the starting point and the ending point are in different display areas and the touch trajectory of the touch operation is within the non-display area.

19. The display module according to claim 2, wherein, The first display module is configured to: In the case where it is determined that the display mode is the first display mode, determine the first display resolution of the first display module and the second display resolution of the at least one second display module; According to the ratio between the first display resolution and the second display resolution, divide the initial image to obtain an initial main display image and at least one initial secondary display image; In the case where it is determined that the resolution of the initial main display image is inconsistent with the first display resolution, convert the resolution of the initial main display image to the first display resolution to obtain the main display image; and In the case where it is determined that the resolution of the at least one initial secondary display image is inconsistent with the second display resolution, convert the resolution of the at least one initial secondary display image to the second display resolution to obtain the at least one secondary display image.

20. The display module according to claim 15, wherein, The touch processing unit is configured to determine the initial touch trajectory of the touch operation according to the touch operation, including: In the case where it is determined that the display mode is the second display mode, determine the initial touch trajectory based on the coordinate system of the multi-screen display; and The touch processing unit is configured to convert the initial touch trajectory into the target touch trajectory according to the display attributes of the first display module and the at least one second display module, including: Determine the target display module corresponding to each of the multiple initial touch coordinates according to the multiple initial touch coordinates included in the initial touch trajectory; and Based on the coordinate systems of the target display modules corresponding to the multiple initial touch coordinates, convert the multiple initial touch coordinates into multiple target touch coordinates to obtain the target touch trajectory.

21. The display module according to claim 20, wherein, The touch processing unit is configured to determine the target display module corresponding to each of the multiple initial touch coordinates according to the multiple initial touch coordinates included in the initial touch trajectory, including: In the case where it is determined that the initial touch coordinates are within the first coordinate range of the coordinate system of the multi-screen display, determining that the target display module corresponding to the initial touch coordinates is the first display module; and In the case where it is determined that the initial touch coordinates are within the second coordinate range of the coordinate system of the multi-screen display, determining that the target display module corresponding to the initial touch coordinates is the second display module.

22. An image processing method, applied to a multi-screen display, the multi-screen display including a first display module, at least one second display module, and a touch control module, includes: Generating, by the first display module, a plurality of display images for a display mode, the plurality of display images including a main display image and at least one sub-display image; Displaying, by the first display module, the main display image, and displaying, by the at least one second display module, the at least one sub-display image; Determining, by the touch control module, a target touch trajectory based on a received touch operation; And Updating, by the first display module, the plurality of display images based on the target touch trajectory.

23. A screen display method, applied to the display module according to any one of claims 1-21, includes: In response to a received screen display instruction, displaying, by the first display module, a main display image, and respectively displaying, by the at least one second display module, at least one sub-display image; And In response to a received touch operation, displaying, by the first display module, an updated main display image, and respectively displaying, by the at least one second display module, at least one updated sub-display image, the updated main display image and the at least one updated sub-display image being determined based on the touch operation.

24. The method according to claim 23, wherein, The step of, in response to a received screen display instruction, displaying, by the first display module, a main display image, and respectively displaying, by the at least one second display module, at least one sub-display image, includes: In the case where it is determined that the display mode indicated by the screen display instruction is the first display mode, dividing an initial image into the main display image and the at least one sub-display image; and Displaying, by the first display module, the main display image, and respectively displaying, by the at least one second display module, the at least one sub-display image.

25. The method according to claim 23, wherein, The step of, in response to a received screen display instruction, displaying, by the first display module, a main display image, and respectively displaying, by the at least one second display module, at least one sub-display image, includes: In the case where it is determined that the display mode indicated by the screen display instruction is the second display mode, respectively converting a plurality of initial images into the main display image and the at least one sub-display image, the image contents of the plurality of initial images being different from each other; and Displaying, by the first display module, the main display image, and respectively displaying, by the at least one second display module, the at least one sub-display image.

26. The method according to claim 23, wherein, The step of, in response to a received screen display instruction, displaying, by the first display module, a main display image, and respectively displaying, by the at least one second display module, at least one sub-display image, includes: When it is determined that the display mode indicated by the screen display instruction is the first synchronous display mode, the initial image is respectively converted into the main display image and the at least one sub-display image, and the image contents of the main display image and the at least one sub-display image are the same; and The main display image is displayed by using the first display module, and the at least one sub-display image is respectively displayed by using the at least one second display module.

27. The method according to claim 23, wherein, The at least one second display module includes a plurality of second display modules; the step of, in response to the received screen display instruction, using the first display module to display the main display image and using the at least one second display module to respectively display the at least one sub-display image includes: When it is determined that the display mode indicated by the screen display instruction is the second synchronous display mode, a plurality of initial images are respectively converted into the main display image and the plurality of sub-display images, the display contents of the plurality of initial images are different, and the image contents of the plurality of sub-display images are the same; and The main display image is displayed by using the first display module, and the plurality of sub-display images are respectively displayed by using the plurality of second display modules.

28. The method according to claim 23, wherein, The at least one second display module includes a plurality of second display modules; the method further includes: In response to the received screen switching instruction, the sub-display images in the plurality of second display modules are switched, and the image contents of the plurality of sub-display images displayed by the plurality of second display modules are different.

29. The method according to claim 23, further includes: In response to the received screen sharing instruction, the main display image is respectively displayed by using the at least one second display module.

30. The method according to claim 23, wherein, The step of, in response to the received touch operation, using the first display module to display the updated main display image and using the at least one second display module to respectively display the at least one updated sub-display image includes: In the first display mode, according to the touch operation, the main display image and the at least one sub-display image are updated to obtain an updated image; and The updated main display image is displayed by using the first display module, and the at least one updated sub-display image is respectively displayed by using the at least one second display module, and the updated main display image and the at least one updated sub-display image are obtained by dividing the updated image.

31. The method according to claim 23, wherein The step of, in response to the received touch operation, using the first display module to display the updated main display image and using the at least one second display module to respectively display the at least one updated sub-display image includes: In the second display mode, when it is determined that the touch operation is directed to the first display module, the updated main display image is displayed by using the first display module, and the updated main display image is obtained by updating the main display image; and In the second display mode, when it is determined that the touch operation is directed to the second display module, the updated sub-display image is displayed by using the second display module, and the updated sub-display image is obtained by updating the sub-display image.

32. The method according to claim 23, wherein The at least one second display module includes a plurality of second display modules; in response to a received touch operation, using the first display module to display an updated main display image, and using the at least one second display module to respectively display at least one updated sub-display image, including: In the second display mode, when it is determined that the touch operation is directed to any one of the plurality of second display modules, using the plurality of second display modules to display a plurality of updated sub-display images, and the display contents of the plurality of updated sub-display images are the same.

Images