Display method and display system

Abstract

The invention discloses a display method and a display system, the display method is applied to the display system, the display system comprises a virtual display screen and a plurality of physical screens, each physical screen comprises a physical touch screen and a physical display screen, and each physical touch screen and each physical display screen have corresponding display areas on the virtual display screen. The display method comprises the steps that according to a target triggering operation of a user on a target physical touch screen, a target triggering position, a target triggering event and a target display screen are determined, and the target display screen is a target physical display screen or a virtual display screen of a target display area; and responding to the target trigger event through the target display screen. According to the display method, the target trigger position, the target trigger event and the target display screen are determined according to the target trigger operation, and the target display screen is controlled to display a picture. The problem that the physical display screen and the virtual display screen respond to the trigger event at the same time so as to respond to the display content at the same time to cause mutual interference of pictures can be effectively avoided.

Description

Technical Field

[0001] The present application relates to the field of screen display technology, and in particular to a display method and a display system. Background Art

[0002] With the rapid development of screen display technology, multi-screen linkage has become an important way to improve user experience. In order to better realize multi-screen linkage, each physical screen is usually configured with a corresponding virtual display screen, and multi-screen linkage is realized through the cooperation of the virtual display screen and the physical screen. Because the physical screen usually includes a physical touch screen and a physical display screen. In the prior art, for the multi-screen linkage scenario, the trigger event generated on the physical touch screen is sent to the physical display screen and the virtual display screen to control the display screen of the physical screen. Therefore, the content displayed on the physical screen is a superposition of the virtual display screen content and the physical display screen content. The virtual display screen and the physical display screen receive and respond to the trigger event at the same time, which easily leads to the display content responding at the same time, causing related interference, affecting the normal display of the content displayed on the physical screen. Summary of the invention

[0003] The purpose of the present application is to solve the problem in the prior art that the virtual display screen and the physical display screen simultaneously receive and respond to trigger events, resulting in the display content responding simultaneously and causing related interference, thereby affecting the normal display of the physical screen display content.

[0004] To solve the above technical problems, the embodiments of the present application disclose a display method and a display system. The display method is applied to a display system, the display system includes a virtual display screen and multiple physical screens, each physical screen includes a physical touch screen and a physical display screen, and each physical touch screen and physical display screen has a corresponding display area on the virtual display screen, and the display method includes: according to the target trigger operation of the user on the target physical touch screen included in the target physical screen, determining the target trigger position of the target physical touch screen corresponding to the target trigger operation, and determining the target trigger event corresponding to the target trigger operation; determining the target display screen corresponding to the target trigger event, the target display screen is the target physical display screen corresponding to the target physical touch screen or the target display area corresponding to the target physical touch screen on the virtual display screen; responding to the target trigger event through the target display screen.

[0005] When the display system uses the above method for display, the display system determines the target trigger position and the target trigger event according to the received target trigger operation, thereby determining the target display screen, which is the target display screen on the target physical display screen or the target display area on the virtual display screen. The display system sends display information to the target display screen to control the target display screen to display the screen corresponding to the target trigger operation. That is, in this display method, the display system only selects one of the target display areas on the physical display screen and the virtual display screen for display, thereby effectively avoiding the problem of the physical display screen and the virtual display screen receiving the display information at the same time, so that the virtual display screen and the physical display screen respond to the display screen at the same time, causing the screen to interfere with each other.

[0006] In a possible implementation of the display method of the present application, when there is a target physical screen, determining a target display screen corresponding to a target trigger event includes:

[0007] According to the target trigger position, determining that the target trigger position corresponds to a target physical position of a target physical display screen included in the target physical screen;

[0008] Determine, according to the target physical position, a target area of ​​the target physical display screen corresponding to the target physical position;

[0009] According to the correspondence between the target area and the preset area and the display areas of the physical display screen and the virtual display screen, the target display screen corresponding to the target triggering event is determined.

[0010] When the above method is used to determine the target display screen in the display system, the target physical position is determined based on the target trigger position to determine that the target physical position corresponds to the target area of ​​the target physical display screen, thereby determining the corresponding target display screen, making the determined target display screen more accurate.

[0011] In a possible implementation of the display method of the present application, the target physical display screen includes a first area and a second area, the first area corresponds to the target physical display screen, and the second area corresponds to the target display area on the virtual display screen, and the target display screen corresponding to the target trigger event is determined according to the correspondence between the target area and the preset area and the display area of ​​the physical display screen and the virtual display screen, including:

[0012] When the target area is the first area, the target display screen is the target physical display screen;

[0013] When the target area is the second area, the target display screen is the target display area on the virtual display screen.

[0014] In a possible implementation of the display method of the present application, responding to a target triggering event through a target display screen includes:

[0015] Determine a target response position of the target trigger position on the target display screen according to a correspondence between the target trigger position and a preset position of the physical touch screen and the target display screen;

[0016] Respond to target trigger events based on target response positions via the target display.

[0017] When the display system adopts the above method for display, determining the target response position based on the target trigger position can accurately determine the target response position on the target display screen, so that the response position is more accurate when the physical screen is displayed.

[0018] According to another specific embodiment of the present application, a display method disclosed in the embodiment of the present application, when the target display screen is a target display area on a virtual display screen, a target response position of the target trigger position on the target display screen is determined according to the target trigger position and a preset position correspondence relationship between the physical touch screen and the target display screen, including obtaining the target response position by the following formula:

[0019]

[0020] Among them, E vout is the ordinate corresponding to the target response position, E Tin is the coordinate corresponding to the target trigger position, E Tmax is the maximum value of the target physical touch screen coordinates, E Tmin is the minimum value of the target physical touch screen coordinates, E vmax is the maximum value of the target display area coordinates, E vmin The minimum coordinate value of the target display area.

[0021] When the display system uses the above method for display, the accurate response position on the virtual display screen is calculated based on the above formula, so that the target response position corresponding to the target trigger position is consistent with the actual response position.

[0022] In a possible implementation of the display method of the present application, when there are multiple target physical screens, the target display screen is multiple target display areas corresponding to the multiple target physical screens on the virtual display screen;

[0023] The target triggering event is determined in the following way;

[0024] In response to receiving multiple trigger operations of the user on the corresponding physical touch screen included in the multiple physical screens, the trigger position of each trigger operation corresponding to the corresponding physical touch screen is determined, and the target trigger events corresponding to the multiple trigger operations are determined according to the multiple trigger positions corresponding to the multiple trigger operations.

[0025] In a possible implementation of the display method of the present application, in the direction perpendicular to the physical screen, the projection position of the physical touch screen included in the physical screen is the same as the projection position of the corresponding physical display screen, and the size of the physical touch screen is consistent with the size of the corresponding display area on the corresponding physical display screen and the virtual display screen.

[0026] When the display system uses the above method to display, the size of the physical touch screen is consistent with the size of the corresponding physical display screen and virtual display screen, that is, the coordinate conversion between the physical touch screen and the corresponding physical display screen and virtual display screen is more accurate. Further, the corresponding target response position is calculated based on the target trigger position, which is more accurate. At the same time, it can effectively solve the problem of inconsistency between the expected response position and the actual response position on the target display screen.

[0027] In a possible implementation of the display method of the present application, when the target trigger operation includes multiple trigger positions, the initial trigger position is used as the target trigger position.

[0028] When the display system adopts the above method for display, the initial trigger position is used as the target trigger position to determine the target display screen based on the initial trigger position. This can effectively solve the problem of the target display screen changing due to cross-zone sliding during the target trigger operation and erroneous triggering operations in non-target trigger areas, causing the screen displayed on the target display screen to jump.

[0029] In a possible implementation of the display method of the present application, when there is a target physical screen, the target trigger event is determined in the following manner:

[0030] In response to receiving multiple trigger operations of the user on the touch screen included in the physical screen, it is determined that the multiple trigger operations correspond to multiple trigger positions of the touch screen, and target trigger events corresponding to the multiple trigger operations are determined according to the multiple trigger positions.

[0031] The embodiment of the present application further discloses a display system, which includes: a processor, a memory connected to the processor in communication, and a virtual display screen and a plurality of physical screens, each of which includes a physical touch screen and a physical display screen, and each of which has a corresponding display area on the virtual display screen;

[0032] Memory stores computer-executable instructions;

[0033] The processor executes the computer-executable instructions stored in the memory, so that the display system implements the display method as described in any one of the above embodiments.

[0034] When the above-mentioned display system is used to display images, the display system only selects one of the physical display screen and the virtual display screen for display, thereby effectively avoiding the problem of the physical display screen and the virtual display screen receiving display information at the same time, causing the virtual display screen and the physical display screen to respond to the display images at the same time, resulting in mutual interference of the images. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A schematic diagram showing the superposition of a picture of a physical display screen and a picture of a virtual display screen;

[0036] Figure 2 A schematic diagram of a physical display screen and a virtual display screen displaying images simultaneously after a touch operation is performed on a physical touch screen;

[0037] Figure 3 A schematic diagram of sliding from a physical display screen window to a virtual display screen window when performing a sliding touch operation on a physical touch screen;

[0038] Figure 4 A schematic diagram showing that a touch position on a physical touch screen is inconsistent with a response position on a virtual display screen;

[0039] Figure 5 A schematic diagram of the virtual display screen receiving different operation instructions and displaying screens when a user operates multiple physical touch screens at the same time;

[0040] Figure 6 A method flow chart of a display method provided by an embodiment of the present application;

[0041] Figure 7 A flow chart of a method for determining a target display screen corresponding to a target trigger event provided in an embodiment of the present application;

[0042] Figure 8 A schematic diagram of a physical screen and a virtual display screen of a display system when a picture is displayed based on a display method provided in an embodiment of the present application;

[0043] Fig. 9 A schematic diagram of a target response position on a target display screen when performing different target triggering operations on a target physical touch screen based on a display method provided in an embodiment of the present application;

[0044] Fig.10 A schematic diagram of a flow chart of enabling multiple target physical screens to perform operations together based on a display method when there are multiple target physical screens provided in an embodiment of the present application;

[0045] Fig.11 A flowchart of another display method provided in an embodiment of the present application;

[0046] Fig.12A flowchart of another display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] Taking a vehicle including two physical screens as an example, for example, Figure 1-Figure 5 As shown, two physical screens are respectively a first physical screen 1 and a second physical screen 2. The first physical screen 1 includes a first physical display screen P1 and a first physical touch screen T1. The second physical screen 2 includes a second physical display screen P2 and a second physical touch screen T2. ​​The display area corresponding to the first physical touch screen T1 on the virtual display screen is the first display area V1, and the display area corresponding to the second physical touch screen T2 on the virtual display screen is the second display area V2. Figure 1-Figure 5 In the diagram, the screen displayed in the first display area V1 and the screen displayed in the second display area V2 are mapped to different areas of the same canvas. Further, the area corresponding to the status bar and the navigation bar on the first physical display screen P1 is area A1, and the area corresponding to the status bar and the navigation bar on the second physical display screen P2 is area A2.

[0048] refer to Figure 1 , Figure 1 This is a schematic diagram of the superposition of the images on the physical display screen and the virtual display screen. When multiple screens are linked, the content displayed on the first physical screen 1 is the superposition of the image displayed in the corresponding first display area V1 and the image displayed on the first physical display screen P1 in the first physical screen 1. When multiple screens are linked, the images are synchronously mapped to multiple physical screens in the cockpit on the software virtual display screen, so that multiple physical screens can display the images synchronously. However, the current multi-screen linkage is prone to the following problems.

[0049] refer to Figure 2 , Figure 2 A schematic diagram of the physical display screen and the virtual display screen displaying the picture at the same time after the physical touch screen performs a touch operation. On the one hand, during the multi-screen linkage operation, a click operation is performed on the superimposed area of ​​the first physical display screen P1 and the corresponding first display area V1 based on the first physical screen T1, so as to pass the touch event generated on the first physical touch screen T1 to the corresponding first physical display screen P1 for application response, and pass the touch event generated on the first physical touch screen T1 to the corresponding first display area V1 for application response, so that the first physical display screen P1 and the first display area V1 display the picture. However, when the first physical display screen P1 and the first display area V1 simultaneously receive the touch event sent by the first physical touch screen T1, it is easy for the first display area V1 and the first physical display screen P1 to display the picture at the same time, causing the displayed pictures to interfere with each other.

[0050] refer to Figure 3 , Figure 3A schematic diagram of sliding from a physical display window to a virtual display window when performing a sliding touch operation on a physical touch screen. On the second aspect, since the picture displayed on the physical screen is a superposition of the picture displayed on the virtual display screen and the picture displayed on the physical display screen. When the first physical touch screen T1 dispatches a touch event, if the trigger events corresponding to each area are dispatched to the corresponding first physical display screen P1 or the first display area V1 according to the area where the picture is displayed on the first display area V1 corresponding to the first physical display screen P1 and the area where the picture is displayed on the first physical display screen P1, it is easy to cause the first physical display screen P1 and the first display area V1 to respond to the trigger event in sequence when the trigger event slides across areas, thereby causing the screen to jump. For example, if Figure 3 As shown, when sliding from the physical display screen navigation bar to the transparent area, the first physical display screen P1 will respond and then the first display area V1 will respond, causing the displayed image to jump.

[0051] refer to Figure 4 , Figure 4 A schematic diagram showing the inconsistency between the touch position on the physical touch screen and the response position on the virtual display screen. In the third aspect, only the boundary of the first display area V1 is aligned with the boundary of the first physical touch screen T1 in the first physical screen. Therefore, when calculating the response position corresponding to the touch event on the first display area V1, when converting the coordinates of the response position on the virtual display screen according to the boundary alignment ratio to respond to the touch event, the problem of inconsistency between the expected response position of the touch event and the actual response position of the touch event will appear visually.

[0052] refer to Figure 5 , Figure 5 A schematic diagram of the virtual display screen receiving different operation instructions and displaying the screen when the user operates multiple physical touch screens at the same time. Fourthly, when multiple screens are linked, the two physical touch screens correspond to different virtual display screens respectively, and the touch events triggered by different physical touch screens are independently input. If the first physical touch screen T1 and the second physical touch screen T2 are operated at the same time, the first display area V1 and the second display area V2 will receive different operation instructions at the same time, which may easily lead to unexpected screen responses by the user. For example, the screen displayed in the first display area V1 and the screen displayed in the second display area V2 slide toward the middle at the same time, resulting in overlapping display of the screens displayed in the first display area V1 and the second display area V2.

[0053] Based on the above, it can be seen that in the existing display system, there is no effective solution to the problems of receiving display information, area allocation of display screens, and screen response during multi-screen display on physical and virtual display screens, which affects the display content of the physical screen in the display system.

[0054] In order to solve the above technical problems, the present application proposes a display method and a display system. In the display method, based on the user's trigger operation on the physical touch screen, the corresponding position of the trigger operation on the physical display screen and the trigger event corresponding to the trigger operation are determined, so that the target display screen can be determined, and each physical touch screen corresponds one-to-one to the corresponding virtual display screen.

[0055] refer to Figure 6 , Figure 6 A method flow chart of a display method provided in an embodiment of the present application. The embodiment of the present application discloses a display method, which is applied to a display system.

[0056] The display system includes a virtual display screen and a plurality of physical screens, each of the physical screens includes a physical touch screen and a physical display screen, and each of the physical touch screen and the physical display screen has a corresponding display area on the virtual display screen, and the display method includes:

[0057] Step S1: according to a target trigger operation performed by a user on a target physical touch screen included in a target physical screen, determining a target trigger position of the target physical touch screen corresponding to the target trigger operation, and determining a target trigger event corresponding to the target trigger operation.

[0058] Step S2: determining a target display screen corresponding to a target triggering event, where the target display screen is a target physical display screen corresponding to a target physical touch screen or a target display area corresponding to the target physical touch screen on a virtual display screen.

[0059] Step S3: Responding to the target triggering event via the target display screen.

[0060] When the display system uses the above method for display, the display system determines the target trigger position and the target trigger event according to the received target trigger operation, thereby determining the target display screen, which is the target display screen or the target display area on the virtual display screen. The display system sends display information to the target display screen to control the target display screen to display the screen corresponding to the target trigger operation. That is, in this display method, the display system only selects one of the target display areas on the physical display screen and the virtual display screen for display, thereby effectively avoiding the problem of the physical display screen and the virtual display screen receiving the display information at the same time, so that the virtual display screen and the physical display screen respond to display the screen at the same time, causing the screen to interfere with each other.

[0061] The display system used in the display method of the embodiment of the present application includes a virtual display screen and multiple physical screens, and the multiple physical screens all include a physical display screen and a physical touch screen. In the specific process of the display system executing the display method of the embodiment of the present application, a display management module is provided in the display system, and the display management module monitors each physical screen and the window of the display area corresponding to each physical screen on the virtual display screen. When it is detected that a user performs an operation on the physical touch screen in the physical screen, the physical screen is used as the target physical screen, the operation performed by the user is used as the target trigger operation, and the physical touch screen in the target physical screen is used as the target physical touch screen. The target physical touch screen sends the target trigger operation information to the display management module, and the display management module determines the corresponding target trigger event according to the target trigger operation of the user on the target physical touch screen, and determines the target trigger position corresponding to the target trigger operation on the target physical touch screen. The target trigger position can be the coordinates of the target trigger position on the physical touch screen, that is, the target touch coordinates.

[0062] If the target trigger position is the coordinate of the target trigger position on the physical touch screen, the coordinate range of the physical touch screen needs to be pre-set in the display system.

[0063] After determining the target trigger position, the display screen corresponding to the target trigger position can be determined and used as the target display screen. After determining the target display screen, the display system sends the received target trigger operation information to the target display screen, thereby controlling the target display screen to display the target picture.

[0064] Among them, in the display system, the number of target display screens is determined based on the target trigger events of the users. Multiple users can generate multiple target trigger events on multiple target physical touch screens at the same time to control multiple target display screens to display the above multiple target trigger events respectively; multiple users can generate one target trigger event on multiple target physical touch screens to control the target display screens to display the target trigger event; one user can generate multiple target trigger events on multiple target physical touch screens at the same time to control multiple target display screens to display the above multiple target trigger events respectively; one user can generate multiple target trigger positions on one target physical touch screen to generate one target trigger event.

[0065] refer to Figure 7 , Figure 7 A flow chart of a method for determining a target display screen corresponding to a target trigger event provided in an embodiment of the present application. In another specific implementation of the display method of the present application, when there is a target physical screen, determining a target display screen corresponding to a target trigger event includes:

[0066] Step S21: According to the target trigger position, determine that the target trigger position corresponds to the target physical position of the target physical display screen included in the target physical screen.

[0067] Step S22: determining, according to the target physical position, a target area of ​​the target physical display screen corresponding to the target physical position.

[0068] Step S23: determining the target display screen corresponding to the target triggering event according to the correspondence between the target area and the preset area and the display areas of the physical display screen and the virtual display screen.

[0069] In another embodiment of the display method of the present application, when there is only one target physical display screen in the display system, the specific method for determining the target display screen corresponding to the target trigger event includes: determining the target physical position on the physical display screen corresponding to the target physical touch screen according to the target trigger position, which can be based on the coordinate range size of the physical display screen preset by the display system and the coordinate range size of the physical touch screen, reading the target touch coordinates corresponding to the target trigger position, and calculating the target physical coordinates corresponding to the target physical position on the corresponding target physical screen based on the target touch coordinates and formula (1).

[0070]

[0071] In formula (1), E pout is the target physical coordinate, E Tin is the coordinate corresponding to the target trigger position, E Tmax is the maximum value of the target physical touch screen coordinates, E Tmin is the minimum value of the target physical touch screen coordinates, E pmax is the maximum value of the target physical display screen coordinates, E pmin The minimum value of the target physical display coordinate.

[0072] Among them, based on formula (1), the horizontal coordinate and the vertical coordinate in the target physical coordinate can be calculated simultaneously, that is, when the horizontal coordinate in the target physical coordinate is calculated, all the corresponding parameters E in formula (1) are the corresponding horizontal coordinates; when the vertical coordinate in the target physical coordinate is calculated, all the corresponding parameters E in formula (1) are the corresponding vertical coordinates.

[0073] Alternatively, the target physical position may be determined based on a conversion relationship between the sizes of the target physical display screen and the target physical touch screen that is pre-set in the display system.

[0074] When the display system displays a picture, since the virtual display screen needs to be displayed by mapping the picture to be displayed on the physical display screen, before determining the target display screen based on the target physical position, it is necessary to determine the target area where the target physical position is located on the target physical display screen.

[0075] Furthermore, based on the correspondence between the target area and a preset area on the physical display screen and the physical display screen and the virtual display screen, a target display screen corresponding to the target area is determined.

[0076] The method for determining the target physical position based on the target trigger position includes but is not limited to the method for calculating the coordinates corresponding to the target physical position based on the coordinates corresponding to the target trigger position and formula (1).

[0077] In another specific implementation of the display method of the present application, the target physical display screen includes a first area and a second area, the first area corresponds to the target physical display screen, and the second area corresponds to the target display area on the virtual display screen. Then, according to the correspondence between the target area and the preset area and the physical display screen and the virtual display screen display area, the target display screen corresponding to the target trigger event is determined, including: when the target area is the first area, the target display screen is the target physical display screen; when the target area is the second area, the target display screen is the target display area on the virtual display screen.

[0078] In the above embodiment, it is described that the target display screen corresponding to the target area is determined based on the correspondence between the target area and the preset area on the physical display screen and the display area of ​​the physical display screen and the virtual display screen. Further, in the display method, when the display system responds to the target trigger operation of the user on the target physical touch screen, the display system monitors the area division of the current target physical display screen and sets the relationship between the area on the corresponding physical display screen and the display area of ​​the physical display screen and the virtual display screen.

[0079] In the embodiment of the present application, the display system divides the area on the target physical display screen into a first area and a second area based on the monitored results. The display system sets the correspondence between the first area and the target physical display screen, that is, the target physical display screen displays the picture when the area where the target physical position is located is the first area; the display system sets the correspondence between the second area and the target display area on the virtual display screen, that is, the target display area on the virtual display screen displays the picture when the area where the target physical position is located is the second area.

[0080] In addition, the setting of the area size of the first area and the second area is determined by the system based on the current actual situation. In a target trigger event, the division of the first area and the second area is unchanged. In different trigger events, the division of the first area and the second area may be different. Among them, when the target display screen is the target display area on the virtual display screen, the corresponding target physical display screen only displays the status bar and navigation bar on the target physical display screen, and the remaining area is a transparent area to display the screen displayed by the target display area on the virtual display screen below the target physical screen.

[0081] In another specific implementation of the display method of the present application, responding to a target triggering event through a target display screen includes:

[0082] Determine a target response position of the target trigger position on the target display screen according to a correspondence between the target trigger position and a preset position of the physical touch screen and the target display screen;

[0083] Respond to target trigger events based on target response positions via the target display.

[0084] In another specific implementation of the display method of the present application, when the target display screen responds to a target trigger event, the target response position on the target display screen corresponding to the target physical position is determined based on the target display screen and the target physical position on the target physical display screen.

[0085] When the target display screen is a target physical display screen, the target physical position is the target response position on the target physical display screen.

[0086] When the target display screen is a target display area on a virtual display screen, the target response position corresponding to the target trigger position on the target display area on the virtual display screen is determined according to the target trigger position and the preset position correspondence between the target physical touch screen and the target virtual display screen.

[0087] In another specific implementation of the display method of the present application, when the target display screen is a target display area on a virtual display screen, the target response position of the target trigger position on the target display screen is determined according to the target trigger position and the preset position correspondence relationship between the physical touch screen and the target display screen, including obtaining the target response position by the following formula:

[0088]

[0089] Among them, E vout is the ordinate corresponding to the target response position, E Tin is the coordinate corresponding to the target trigger position, E Tmax is the maximum value of the target physical touch screen coordinates, E Tminis the minimum value of the target physical touch screen coordinates, E vmax is the maximum value of the target display area coordinates, E vmin The minimum coordinate value of the target display area.

[0090] In another specific embodiment of the display method of the present application, when the target display screen is a target display area on a virtual display screen, the response position of the target trigger position on the target display area can be determined based on the correspondence between the target trigger position and the target display area. The correspondence between the target trigger position and the target display area includes: Formula (2).

[0091] Based on formula (2) and the coordinates of the target trigger position obtained based on the coordinate range of the target physical touch screen, the coordinates of the target response position on the target display area corresponding to the target trigger position can be calculated, thereby determining the response position on the target display area. The display management module sends display information to the virtual display screen to control the display screen of the target display area. Among them, the display information includes: the coordinates of the target response position. Based on formula (2), the horizontal coordinate and the vertical coordinate of the target response position can be calculated simultaneously, that is, when calculating the horizontal coordinate of the target response position, all the parameters E in the corresponding formula (2) are the corresponding horizontal coordinates; when calculating the vertical coordinate of the target response position, all the parameters E in the corresponding formula (2) are the corresponding vertical coordinates.

[0092] In another specific implementation of the display method of the present application, when there are multiple target physical screens, the target display screen is multiple target display areas corresponding to the multiple target physical screens on the virtual display screen.

[0093] The target trigger event is determined by:

[0094] In response to receiving multiple trigger operations of the user on the corresponding physical touch screen included in the multiple physical screens, the trigger position of each trigger operation corresponding to the corresponding physical touch screen is determined, and the target trigger events corresponding to the multiple trigger operations are determined according to the multiple trigger positions corresponding to the multiple trigger operations.

[0095] In another specific implementation of the display method of the present application, when there are multiple target physical screens in the display system and multiple users perform multi-screen linkage operations based on the multiple target physical screens, the multiple users perform trigger operations on the target physical touch screens in the multiple target physical screens respectively. There are corresponding trigger positions on the corresponding multiple target physical touch screens. Based on the corresponding multiple trigger positions on the multiple target physical screens, the target trigger events corresponding to the multiple trigger positions are determined.

[0096] When the corresponding target trigger event is determined based on multiple trigger positions, the multiple trigger positions are combined into one target trigger position, and the target trigger event is determined based on the target trigger position.

[0097] And when multiple screens are linked, the target display screen is a plurality of target display areas on the virtual display screen. At this time, the multiple target display areas on the virtual display screen are spliced ​​together into one display area to display the corresponding target screen. After determining the target trigger event, multiple response positions of the multiple target display areas on the virtual display screen are determined based on the multiple target trigger positions. The target response position is synthesized based on the multiple response positions, and the display system sends display information to the virtual display screen to control the synthesized display area on the virtual display screen to respond at the target response position to display the screen. And the virtual display screen maps the display screen to the target physical display screen among the multiple target physical screens to display the screen.

[0098] In another specific implementation of the display method of the present application, in the direction perpendicular to the physical screen, the projection position of the physical touch screen included in the physical screen is the same as the projection position of the corresponding physical display screen, and the size of the physical touch screen is consistent with the size of the corresponding display area on the corresponding physical display screen and the virtual display screen.

[0099] In another specific implementation of the display method of the present application, when setting the size of the physical screen, it can be set so that the projection position of the physical touch screen in the physical screen is the same as the projection position of the physical display screen in the physical screen, and the physical touch screen and the physical display screen are the same size. Further, the size of the physical touch screen is the same as the size of the corresponding display area on the virtual display screen. This can effectively prevent the problem of visual inconsistency between the touch position on the physical touch screen and the response position on the physical display screen or the virtual display screen due to the different sizes of the corresponding display areas on the physical touch screen and the physical display screen and the virtual display screen after the touch position is converted to the response position, thereby affecting the user's perception of use.

[0100] refer to Figure 8 , Figure 8 A schematic diagram of a physical screen and a virtual display screen of a display system when displaying images based on a display method provided in an embodiment of the present application. Figure 8 In the description, the number of target physical screens in the display system is two as an example. Figure 8 The physical screen shown includes: a first physical screen 1 and a second physical screen 2, Figure 8 The virtual display screen shown includes a first display area V1 and a second display area V2; the first physical screen 1 includes: a first physical touch screen T1 and a first physical display screen P1; the second physical screen 2 includes: a second physical touch screen T2 and a second physical display screen P2. Figure 8It can be seen from the embodiment shown that in this display method, the size of the first physical display screen P1 and the corresponding first display area V1 on the virtual display screen are set to be the same, and the size of the second physical display screen P2 and the corresponding second display area V2 on the virtual display screen are set to be the same. And because the first physical touch screen T1 and the first physical display screen P1 have the same size, and the second physical touch screen T2 and the second physical display screen P2 have the same size, the problem of visual inconsistency between the target touch position and the target response position caused by the coordinate conversion process can be effectively avoided.

[0101] In another specific implementation of the display method of the present application, when the target trigger operation includes multiple trigger positions, the initial trigger position is used as the target trigger position.

[0102] In another possible implementation of the display method of the present application, when the target trigger operation includes multiple trigger positions, during the process of the user completing a complete target trigger operation on the target physical touch screen, the display management module needs to be configured so that the target display screen corresponding to the target trigger operation remains unchanged. That is, when the target trigger operation includes multiple trigger positions, the state machine corresponding to the target display screen corresponding to the initial trigger position is determined. The target response coordinates corresponding to the remaining trigger positions in the target trigger operation are still imported into the state machine corresponding to the target display screen corresponding to the initial trigger position until a target trigger operation is completed.

[0103] When the target trigger operation includes multiple trigger positions, the multiple trigger positions may be located in different areas on the target physical display screen, so the initial trigger position can be used as the target trigger position. That is, the target trigger event and the target display screen are determined based on the initial trigger position, which can effectively avoid the problem of the target display screen being changed due to an operation error in the target trigger operation process and an erroneous trigger operation in a non-target trigger area, causing the screen displayed on the target display screen to jump.

[0104] In another specific implementation of the display method of the present application, when there is a target physical screen, the target trigger event is determined in the following manner:

[0105] In response to receiving multiple trigger operations of the user on the touch screen included in the physical screen, it is determined that the multiple trigger operations correspond to multiple trigger positions of the touch screen, and target trigger events corresponding to the multiple trigger operations are determined according to the multiple trigger positions.

[0106] In another specific implementation of the display method of the present application, when there is only one target physical screen in the display system and there are multiple trigger operations on the target physical touch screen in the target physical screen, the display system responds to the received multiple trigger operations. Based on the multiple trigger operations, multiple trigger positions on the corresponding touch screen are determined. Based on the multiple trigger operations, target trigger events corresponding to the multiple trigger operations are determined, and the corresponding target display screen is determined based on the target trigger event.

[0107] Furthermore, with regard to the related introduction of the display system displaying the screen based on the above-mentioned display method, the embodiment of the present application is explained by taking the display system of a vehicle displaying the screen based on the above-mentioned display method as an example.

[0108] A display management module is provided in the display system of the vehicle, and the display management module monitors all physical screen windows and virtual display screen windows in the display system. The display management module controls the physical display screen to display the picture in the corresponding area according to the current status of multiple physical screen windows and virtual display screen windows, or dynamically maps the picture displayed on the virtual display screen to the corresponding area on the physical display screen in the corresponding physical screen for picture display.

[0109] In addition, the display system sets a corresponding state machine for trigger event synthesis and distribution for each physical screen; when the display management module detects the user's target trigger operation on the target physical touch screen, it sends the target trigger operation to the state machine, and the state machine synthesizes the target trigger event according to the window area on the target physical touch screen corresponding to the target trigger operation and the state of the state machine and distributes it to the corresponding target display screen to display the screen application. The specific method is as follows:

[0110] A display management module is deployed in the display system, and the display management module interacts with multiple physical screens in the display system, the display areas corresponding to the multiple physical screens on the virtual display screen, and the drivers of each physical screen and the virtual display screen. The display management module monitors the display window changes of each physical screen and the virtual display screen, and the input of touch operations on the physical touch screen in the physical screen.

[0111] In a multi-screen linkage scenario, the display management module pre-sets a corresponding touch mapping table in the display system for the size parameters of each physical touch screen among the multiple physical screens in the display system, the size parameters of each physical display screen and the display area corresponding to each physical display screen on the virtual display screen, and the relative position, wherein the size parameter of each physical touch screen is the input range of the touch operation on each physical touch screen, the size parameter of each physical display screen is the range of the display area of ​​each physical display screen for displaying the picture, and the size parameters of the display areas of multiple virtual display screens are the range of the picture displayed in the display area of ​​each virtual display screen.

[0112] refer to Figure 8 For example, the touch mapping table used in the embodiment of a virtual display screen including two target physical screens and two corresponding target display areas is used as an example for description, and the two target physical screens include: a first physical screen 1 and a second physical screen 2. For example, the touch mapping table may be as shown in Table 1 below.

[0113] Table 1

[0114]

[0115]

[0116] The number of the first physical touch screen T1 and the number of the target display screen in the first physical screen 1, the number plate of the target display screen is the number of the first physical display screen T1 or the number of the first display area V1 corresponding to the first physical screen 1 on the virtual display screen, the coordinate range of the target trigger operation area on the horizontal axis that can be input on the first physical touch screen T1, Xt1min~Xt1max, Xt1min=0, Xt1max=2499, the coordinate range of the target trigger operation area on the vertical axis that can be input on the first physical touch screen T1: Yt1min~Yt1max, Yt1min=0, Yt1max=1499, the first physical display screen P 1 The coordinate range of the displayable screen area on the horizontal axis is: Xp1min~Xp1max, Xp1min=0, Xp1max=2499, the coordinate range of the displayable screen area on the vertical axis of the first physical display screen P1 is: Yp1min~Yp1max, Yp1min=0, Yp1max=1499, the coordinate range of the first display area V1 on the horizontal axis is: Xv1min~Xv1max, Xv1min=0, Xv1max=2499, the coordinate range of the first display area V1 on the vertical axis is: Yv1min~Yv1max, Yv1min=0, Yv1max=1499.

[0117] The number of the second physical touch screen T2 in the second physical screen 2 and the number of the target display screen, the number plate of the target display screen is the number of the second physical display screen T2 or the number of the second display area V2 corresponding to the second physical screen 2 on the virtual display screen, the coordinate range of the target trigger operation area on the horizontal axis that can be input on the second physical touch screen T2: Xt2min~Xt2max, Xt2min=0, Xt2max=2499, the coordinate range of the target trigger operation area on the vertical axis that can be input on the second physical touch screen: Yt2min~Yt2max, Yt2min=0, Yt2max=1499, the second physical display screen P2 can The coordinate range of the display screen area on the horizontal axis is: Xp2min~Xp2max, Xp2min=0, Xp2max=2499, the coordinate range of the display screen area of ​​the second physical display screen P2 on the vertical axis is: Yp2min~Yp2max, Yp2min=0, Yp2max=1499, the coordinate range of the second display area V2 on the horizontal axis is: Xv2min~Xv2max, Xv2min=2600, Xv2max=5099, and the coordinate range of the second display area V2 on the vertical axis is: Yv2min~Yv2max, Yv2min=0, Yv2max=1499.

[0118] In the display system, the display management module sets multiple state machines for managing multiple physical screens and a state machine for managing virtual display screens. The state machine manages the user's pressing, moving and lifting actions in a complete touch operation and the synthesis of single-finger events or multi-finger events on the physical screen.

[0119] When determining a corresponding trigger event based on a user's target trigger operation on a target physical touch screen among multiple target physical screens, the corresponding state machine generates a corresponding target trigger event based on all information of the target trigger operation, and then determines the target display screen based on the target trigger event.

[0120] The state machine is used to generate all the target trigger operation information of the trigger event, including: target trigger action type (trigger action types include: press, move and lift), target display number, target trigger action finger number, finger number, and specific information set of the finger on the target touch screen.

[0121] Taking two target physical screens and target trigger operations on both target physical screens as an example, all information of the target trigger operation is explained. The two target physical screens include: the first physical screen 1 and the second physical screen 2. The finger that performs the trigger operation on the first physical touch screen of the first physical screen 1 at T1 is the first finger 11; the finger that performs the trigger operation on the second physical touch screen of the second physical screen 2 at T2 is the second finger 12. The two target trigger operations include: the first trigger operation and the second trigger operation. The trigger operation performed on the first physical touch screen T1 is the first trigger operation, and the trigger operation performed on the second physical touch screen T2 is the second trigger operation. :

[0122] For example, the first trigger operation information corresponding to the first trigger operation may include: the target trigger action type on the first physical touch screen T1: press; the target display screen number corresponding to the target trigger operation on the first physical touch screen T1: V1; the number of the first finger performing the target trigger action on the first physical touch screen T1: 11; the specific information set of the first finger 11 on the first physical touch screen T1; further, the specific information set of the first finger 11 on the first physical touch screen T1 may include: the first finger number: 11; the number of the first physical touch screen: T1; the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [100,100].

[0123] For example, the second trigger operation information corresponding to the second trigger operation may include: the target trigger action type on the second physical touch screen T2: press; the target display screen number corresponding to the target trigger operation on the second physical touch screen T2: V2; the number of the second finger performing the target trigger action on the second physical touch screen T2: 12; the specific information set of the second finger 12 on the second physical touch screen T2; further, the specific information set of the second finger 12 on the second physical touch screen T2 may include: the second finger number: 12; the number of the second physical touch screen: T2; the coordinates of the target response position of the target display screen after the current target trigger position of the second finger 12 is converted: [200,100].

[0124] Among the multiple state machines set in the display system, the state machine corresponding to the physical screen can only receive touch events input on the corresponding physical touch screen, and the state machine corresponding to the virtual display screen can receive touch events input on all physical touch screens.

[0125] When the display management module detects that a target trigger operation is generated on the target physical touch screen, the target trigger position corresponding to the target trigger operation is determined. Based on the target trigger position and the coordinate conversion formula between the physical touch screen size and the physical display screen size, that is, formula (1), the target physical position corresponding to the target trigger position is obtained. The corresponding target display screen is determined based on the target physical position.

[0126] If the corresponding target display screen is determined to be a physical display screen, the target physical position is used as the target response position. The display system imports the coordinate data of the target physical position into the state machine corresponding to the target physical display screen, and the state machine corresponding to the target physical display screen controls the display of the target virtual display screen based on the coordinate data of the target response position.

[0127] If it is determined that the corresponding target display screen is the target display area on the virtual display screen, the target virtual position corresponding to the target trigger position is obtained based on the target trigger position and the coordinate conversion formula of the size of the physical touch screen and the size of the target display area on the virtual display screen, that is, formula (2), and the target virtual position is used as the target response position. The coordinate data of the target virtual position is imported into the state machine corresponding to the virtual display screen, and the state machine corresponding to the virtual display screen controls the display of the target display area on the virtual display screen based on the coordinate data of the target virtual position.

[0128] In addition, in the combined display scenario of multiple screen linkage, the target display screen is a display area synthesized by multiple target display areas corresponding to multiple target physical screens on the virtual display screen. The target physical display screen in the target physical screen only retains the status bar and navigation bar for normal display, and the rest of the area is transparent to reveal the window screen of the display area on the virtual display screen below the target physical screen.

[0129] After the display management module detects a first finger press event on a target physical touch screen, that is, after the display management module receives a target trigger operation on the target physical touch screen, the display management module determines the target trigger position corresponding to the target trigger operation based on the touch mapping table. The display management module calculates the target physical position on the target physical display screen based on the target trigger position and formula (1). The target display screen is determined based on the target area where the target physical position is located on the target physical display screen, and the relationship between the target area and the target physical display screen and the target display area on the virtual display screen.

[0130] refer to Fig. 9 , Fig. 9 A schematic diagram of a target response position on a target display screen when performing different target trigger operations on a target physical touch screen based on a display method provided in an embodiment of the present application. Fig. 9 In the example, the target physical display screen is the first physical display screen P1, the target physical touch screen is the first physical touch screen T1, and the target display area on the virtual display screen is the first display area V1. The target area is the first area on the target physical display screen, that is, Fig. 9 When the non-transparent window area in the target physical display is displayed, the target physical display screen displays the image to be displayed on the target physical display screen. The target area is the second area on the target physical display screen, that is, Fig. 9When the transparent window area in the target display area is displayed, the target physical display screen displays the image to be displayed in the target display area on the virtual display screen.

[0131] refer to Fig.10 , Fig.10 A flow chart of a method for making multiple target physical screens perform operations together based on a display method when there are multiple target physical screens provided in an embodiment of the present application. When a display system includes multiple target physical screens, and multiple target physical touch screens in the multiple target physical screens have target trigger operations at the same time, the target display screen is a plurality of target display areas on a virtual display screen. The multiple target physical screens include a first physical screen 1 and a second physical screen 2, and the multiple target display areas include a first display area V1 and a second display area V2; the first physical screen 1 includes: a first physical touch screen T1 and a first physical display screen P1; the second physical screen includes: a second physical touch screen T2 and a second physical display screen P2. The state machine of the virtual display screen receives multiple trigger operations in sequence based on the trigger time sequence of the multiple target trigger operations, and records the number of the finger that touches the multiple trigger operations and the number of the corresponding target physical touch screen. Determine multiple target trigger positions corresponding to the multiple target trigger operations; based on the multiple target trigger positions, determine multiple virtual positions corresponding to the multiple target trigger positions on the multiple target display areas of the virtual display screen, and synthesize the multiple virtual positions into target response positions to control the virtual display screen to respond at the target response positions.

[0132] refer to Fig.10 For example, the embodiment of the present application takes a dual-screen two-finger zoom operation event as an example for explanation, the dual screen includes: a first physical screen 1 and a second physical screen 2, the two fingers include: a first finger 11 and a second finger 12, the finger that triggers the operation on the first physical touch screen T1 of the first physical screen 1 is the first finger 11, and the finger that triggers the operation on the second physical touch screen T2 of the second physical screen 2 is the second finger 12. The specific display method flow of the dual-screen two-finger zoom operation is as follows:

[0133] The first finger 11 performs a first trigger operation on the first physical touch screen T1.

[0134] At this time, the trigger information in the display system includes: the action type of the first trigger operation: press, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, and the specific information set of the finger on the target touch screen. Further, the specific information set of the finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, and the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1300,1300].

[0135] The second finger 12 performs a second trigger operation on the second physical touch screen T2.

[0136] At this time, the trigger information in the display system includes: the action type of the first trigger operation: press, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, the action type of the second trigger operation: press, the target display screen number corresponding to the second trigger operation: V2, the number of the second finger: 12, and the specific information set of the finger on the target touch screen. Further, the specific information set of the finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1300, 1300], the second finger number: 12, the number of the second physical touch screen: T2, and the coordinates of the target response position of the target display screen after the current target trigger position of the second finger 12 is converted: [3500, 1300].

[0137] The position of the first finger 11 on the first physical touch screen T1 moves 300 pixels to the right.

[0138] At this time, the trigger information in the display system includes: the action type of the first trigger operation: move, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, the action type of the second trigger operation: press, the target display screen number corresponding to the second trigger operation: V2, the number of the second finger: 12, and the specific information set of the current finger on the target touch screen. Further, the specific information set of the current finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1600,1300], the second finger number: 12, the number of the second physical touch screen: T2, and the coordinates of the target response position of the target display screen after the current target trigger position of the second finger 12 is converted: [3500,1300].

[0139] The position of the second finger 12 on the second physical touch screen T2 moves 300 pixels to the left.

[0140] At this time, the trigger information in the display system includes: the action type of the first trigger operation: press, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, the action type of the second trigger operation: move, the target display screen number corresponding to the second trigger operation: V2, the number of the second finger: 12, and the specific information set of the current finger on the target touch screen. Further, the specific information set of the current finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1600,1300], the second finger number: 12, the number of the second physical touch screen: T2, and the coordinates of the target response position of the target display screen after the current target trigger position of the second finger 12 is converted: [3200,1300].

[0141] The second finger 12 is lifted from the second physical touch screen T2.

[0142] At this time, the trigger information in the display system includes: the action type of the first trigger operation: press, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, the action type of the second trigger operation: lift, the target display screen number corresponding to the target trigger operation on the second physical touch screen T2: V2, the number of the second finger: 12, and the specific information set of the current finger on the target touch screen. Further, the specific information set of the current finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1600, 1300], the second finger number: 12, the number of the second physical touch screen: T2, and the coordinates of the target response position of the target display screen after the current target trigger position of the second finger 12 is converted: [3200, 1300].

[0143] The first finger 11 is lifted from the first physical touch screen T1.

[0144] At this time, the trigger information in the display system includes: the action type of the first trigger operation: lift, the target display screen number corresponding to the first trigger operation: V1, the number of the first finger: 11, and the specific information set of the current finger on the target touch screen. Further, the specific information set of the current finger on the target touch screen includes: the first finger number: 11, the number of the first physical touch screen: T1, and the coordinates of the target response position of the target display screen after the current target trigger position of the first finger 11 is converted: [1600,1300].

[0145] After completing the above steps, the display system controls the virtual display screen to display the picture.

[0146] After executing the above multi-screen linkage display operation, the display system controls multiple target physical screens and virtual display screens to exit the multi-screen linkage state. The display system enters the split-screen display state. At this time, the transparent areas on each target physical display screen become non-transparent areas. That is, the physical display screen image is completely covered on the upper layer of the virtual display screen image. Among them, after the display system enters the split-screen state, after the display system receives the target trigger operation, the target display screens corresponding to all target trigger operations are the target physical display screens.

[0147] refer to Fig.11 , Fig.11 A flowchart of another display method provided in an embodiment of the present application. Further, for the specific process of the display system displaying a screen based on the above display method, the embodiment of the present application takes the display system of a vehicle displaying based on the above display method as an example for explanation.

[0148] Step S11: the display management module included in the display system monitors the touch operation on the physical touch screen among the multiple physical screens in real time;

[0149] Step S12: when a target touch operation is detected on the target physical touch screen, the display management module receives the target touch operation information;

[0150] Step S13: the display management module calculates the target physical coordinates on the corresponding target physical display screen based on the target trigger position coordinates;

[0151] Step S14: the display management module determines whether the target trigger position is the initial trigger position on the target physical touch screen;

[0152] If yes, go to step S15; if no, go to step S16;

[0153] Step S15: The display management module determines whether the target physical coordinates corresponding to the target trigger position are in the second area on the target physical display screen; if so, execute step S17; if not, execute step S18;

[0154] Step S16: The display management module determines whether the state machine for processing the target trigger position on the target physical touch screen is a state machine for the virtual display screen; if so, execute step S17; if not, execute step S18;

[0155] Step S17: the display management module calculates the corresponding target response position on the target display area in the virtual display screen based on the target trigger position;

[0156] Step S19: the display management module controls the target display area on the virtual display screen to respond to the target trigger event based on the corresponding target response position on the target display area. At this time, the physical display screen only displays the status bar and navigation bar on the target physical display screen, and the rest of the area is a transparent area;

[0157] Step S18: the display management module controls the target physical display screen to respond to the target trigger event based on the target physical position. At this time, the areas on the target physical display screen are all non-transparent areas.

[0158] Step S20: the display management module synthesizes the display images of the target display area on the current virtual display screen and the target physical display screen, so that the target physical display screen displays the image.

[0159] refer to Fig.12 , Fig.12 A flowchart of another display method provided for an embodiment of the present application. The specific process of the display system controlling the display based on the above display method also includes: after a target touch operation is generated on the target physical touch screen, the target physical touch screen generates target touch operation information and sends the target touch information to the display management module; and after the display management module synthesizes the display screen of the current target virtual display screen and the target physical display screen, the display management module controls the target physical display screen to display the screen.

[0160] The embodiment of the present application also discloses a display system, which includes: a processor, a memory connected to the processor for communication, and a virtual display screen and multiple physical screens, each physical screen includes a physical touch screen and a physical display screen, and each physical touch screen and physical display screen has a corresponding display area on the virtual display screen.

[0161] The memory stores computer-executable instructions.

[0162] The processor executes the computer-executable instructions stored in the memory, so that the display system implements the display method as described in any one of the above embodiments.

[0163] The embodiment of the present application further discloses a display system, the display system comprising: a processor, a memory, a virtual display screen and a plurality of physical screens. The display system is used to display a picture based on the display method of each of the above embodiments. Therefore, for the beneficial effect of the display system displaying a picture based on the above display method, reference can be made to the beneficial effect of the display method of each of the above embodiments, and no further description is given here.

[0164] It should be noted that, in addition to the implementation methods of the present application described in the above-mentioned specific embodiments, those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. Although the description of the present application is introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to the embodiment. On the contrary, the purpose of introducing the invention in conjunction with the implementation method is to cover other options or modifications that may be extended based on the claims of the present application. In order to provide an in-depth understanding of the present application, the above description contains many specific details, and the present application may also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present application, some specific details will be omitted in the description. It should be noted that, in the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0165] It should be noted that in this specification, similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0166] In the description of the embodiments of the present application, it should be noted that the terms "upper", "lower", "inner", "bottom", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, or are the orientations or positional relationships in which the inventive product is usually placed when used. They are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application.

[0167] The terms “first”, “second”, etc. are only used for distinguishing descriptions and should not be understood as indicating or implying relative importance.

[0168] In the description of the embodiments of the present application, it should also be noted that, unless otherwise clearly specified and limited, the term "setting" should be understood in a broad sense. For ordinary technicians in this field, the specific meanings of the above terms in the embodiments of the present application can be understood in specific circumstances.

[0169] Although the present application has been illustrated and described by referring to certain preferred embodiments of the present application, it should be understood by those skilled in the art that the above contents are further detailed descriptions of the present application in combination with specific embodiments, and it cannot be determined that the specific implementation of the present application is limited to these descriptions. Those skilled in the art may make various changes in form and details, including making several simple deductions or substitutions, without departing from the spirit and scope of the present application.

Claims

1. A display method, characterized in that: Applied to a display system, the display system includes a virtual display screen and multiple physical screens, each of the physical screens includes a physical touch screen and a physical display screen, each of the physical touch screen and the physical display screen has a corresponding display area on the virtual display screen, and the display method includes: According to a target trigger operation performed by a user on a target physical touch screen included in the target physical screen, determining a target trigger position of the target physical touch screen corresponding to the target trigger operation, and determining a target trigger event corresponding to the target trigger operation; Determine a target display screen corresponding to the target trigger event, where the target display screen is a target physical display screen corresponding to the target physical touch screen or a target display area corresponding to the target physical touch screen on the virtual display screen; The target triggering event is responded to via the target display screen.

2. The display method according to claim 1, characterized in that: In the case that there is one target physical screen, determining a target display screen corresponding to the target trigger event includes: According to the target trigger position, determining that the target trigger position corresponds to a target physical position of a target physical display screen included in the target physical screen; Determine, according to the target physical position, a target area of ​​the target physical display screen corresponding to the target physical position; According to the correspondence between the target area and the preset area and the display area of ​​the physical display screen and the virtual display screen, the target display screen corresponding to the target triggering event is determined.

3. The display method according to claim 2, characterized in that: The target physical display screen includes a first area and a second area, the first area corresponds to the target physical display screen, and the second area corresponds to a target display area on the virtual display screen, and the target display screen corresponding to the target trigger event is determined according to the correspondence between the target area and the preset area and the display areas of the physical display screen and the virtual display screen, including: When the target area is the first area, the target display screen is the target physical display screen; When the target area is the second area, the target display screen is a target display area on the virtual display screen.

4. The display method according to any one of claims 1 to 3, characterized in that: Responding to the target triggering event through the target display screen includes: Determining a target response position of the target trigger position on the target display screen according to the target trigger position and a preset positional correspondence between the physical touch screen and the target display screen; The target trigger event is responded to by the target display screen according to the target response position.

5. The display method according to claim 4, characterized in that: In the case where the target display screen is a target display area on the virtual display screen, determining a target response position of the target trigger position on the target display screen according to the target trigger position and a preset position correspondence between the physical touch screen and the target display screen includes obtaining the target response position by the following formula: Among them, E vout is the ordinate corresponding to the target response position, E Tin is the coordinate corresponding to the target trigger position, E Tmax is the maximum value of the target physical touch screen coordinates, E Tmin is the minimum value of the target physical touch screen coordinates, E vmax is the maximum value of the target display area coordinates, E vmin The minimum coordinate value of the target display area.

6. The display method according to claim 1, characterized in that: In the case where there are multiple target physical screens, the target display screen is a plurality of target display areas corresponding to the multiple target physical screens on the virtual display screen; The target trigger event is determined in the following manner; In response to receiving multiple trigger operations from a user on a corresponding physical touch screen included in multiple physical screens, determine the trigger position of each trigger operation corresponding to the corresponding physical touch screen, and determine the target trigger events corresponding to the multiple trigger operations based on the multiple trigger positions corresponding to the multiple trigger operations.

7. The display method according to claim 1, characterized in that: In the direction perpendicular to the physical screen, the projection position of the physical touch screen included in the physical screen is the same as the projection position of the corresponding physical display screen, and the size of the physical touch screen is consistent with the size of the corresponding display area on the corresponding physical display screen and the virtual display screen.

8. The display method according to claim 1, characterized in that: In the case where the target trigger operation includes multiple trigger positions, an initial trigger position is used as the target trigger position.

9. The display method according to claim 1, characterized in that: In the case where there is one target physical screen, the target trigger event is determined in the following manner: In response to receiving multiple trigger operations of a user on a touch screen included in the physical screen, it is determined that the multiple trigger operations correspond to multiple trigger positions of the touch screen, and target trigger events corresponding to the multiple trigger operations are determined according to the multiple trigger positions.

10. A display system, characterized in that: The display system includes: a processor, a memory connected to the processor in communication, a virtual display screen and a plurality of physical screens, each of the physical screens includes a physical touch screen and a physical display screen, and each of the physical touch screen and the physical display screen has a corresponding display area on the virtual display screen; Memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory so that the display system implements the display method according to any one of claims 1 to 9.

Images