A touch control method, related device and system for multi-screen linkage display

Abstract

The present application discloses a touch control method, related device and system for multi-screen linkage display, which realizes multi-screen linkage display touch control by performing touch control operation on three-dimensional space content, thereby reducing costs. The method comprises: determining the coordinates of the two-dimensional touch point on the target screen according to the touch body, the two-dimensional touch point coordinates and the virtual mapping grid of the target screen can determine the virtual touch coordinates corresponding to the two-dimensional touch point coordinates, and then obtaining a connection line through the viewpoint coordinates and the virtual touch coordinates, the connection line and the position information of the virtual object in the virtual space can determine the touch position acting on the virtual object, and finally, according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each of the multiple screens, controlling the linkage display of the virtual object on the multiple screens.

Description

Technical Field

[0001] The present application relates to the field of screen touch technology, and in particular to a touch method, related device and system for multi-screen linkage display. Background Art

[0002] Screen touch technology has been developed for many years. This technology is usually used in smart terminal devices with touch screens, such as computers, mobile phones, and TVs. Touch screens are usually divided into capacitive touch screens, infrared touch screens, radar touch screens, depth camera touch screens, etc. In some entertainment and technology scenarios, it is necessary to display content through multiple screens with different orientations. At present, touch technology can generally only perform touch operations on screens with the same orientation, and it is difficult to achieve cross-screen touch and linkage display of the same content on multiple screens with different orientations.

[0003] One solution is to install a three-dimensional spatial positioning system in the scene where the screen is located. Based on this system, Open CASCADE (OCC) technology is used to implement ray detection in three-dimensional space, and based on ray detection, users in the scene can touch the content across screens and display the content in multiple screens in linkage. However, the three-dimensional spatial positioning system that OCC technology relies on costs hundreds of thousands of yuan, which is expensive. How to meet the needs of accurate cross-screen touch and linkage display of content on multiple screens in different orientations at a lower cost is a technical problem that needs to be solved urgently in the current field. Summary of the invention

[0004] Based on the above problems, the present application provides a touch method, related devices and system for multi-screen linkage display, which can meet the needs of precise cross-screen touch and linkage display of content on multiple screens in different orientations at a low cost.

[0005] The embodiments of the present application disclose the following technical solutions:

[0006] In a first aspect, the present application provides a touch control method for multi-screen linkage display, which is applied to a control device, wherein the control device corresponds to a plurality of screens arranged in the same scene, the plurality of screens are used to linkage display virtual objects in a virtual space, and the plurality of screens respectively have their own virtual mapping grids corresponding to the virtual space; the plurality of screens include a target screen; the method includes:

[0007] Determining the two-dimensional touch point coordinates on the target screen according to the touch body;

[0008] Obtaining virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen;

[0009] Obtaining a connection line according to the viewpoint coordinates and the virtual touch coordinates;

[0010] Determining a touch position on the virtual object according to the connection line and the position information of the virtual object in the virtual space;

[0011] According to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens, the virtual object is controlled to be displayed in linkage on the multiple screens.

[0012] Optionally, each of the multiple screens is configured with a touch radar; and determining the two-dimensional touch point coordinates on the target screen according to the touch body includes:

[0013] Obtaining the position information of the touch object by detecting with a touch radar configured for the target screen;

[0014] By utilizing the position association between the touch radar and the target screen, the position information of the touch object is converted into the coordinate system of the target screen to obtain the two-dimensional coordinates of the touch point on the target screen.

[0015] Optionally, controlling the linkage display of the virtual object on the multiple screens according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens includes:

[0016] generating rendering instructions for the multiple screens according to the touch positions, the preset response modes corresponding to the touch positions, and the virtual mapping grids of the respective screens of the multiple screens;

[0017] Sending a rendering instruction corresponding to each of the multiple screens to a rendering server corresponding to each of the multiple screens;

[0018] Rendering a display effect of a virtual object using a rendering server corresponding to each of the multiple screens;

[0019] The display effects rendered by the corresponding rendering servers are respectively displayed through the multiple screens.

[0020] Optionally, the touch control method further comprises: constructing a virtual mapping grid in which each screen of the multiple screens corresponds to the same virtual space according to the shapes, positions and orientations of the multiple screens.

[0021] Optionally, the above touch method also includes: obtaining the viewpoint coordinates through a positioning device in the wearable device; and establishing a communication connection between the wearable device and the control device.

[0022] Optionally, the multiple screens include at least two of the following:

[0023] Front, Back, Left, Right or Top.

[0024] A second aspect of the present application provides a control device for multi-screen linkage display, the device corresponding to multiple screens set in the same scene, the multiple screens are used to link and display virtual objects in a virtual space, the multiple screens respectively have their own virtual mapping grids corresponding to the virtual space; the multiple screens include a target screen; the device includes:

[0025] A two-dimensional touch coordinate determination module, used to determine the two-dimensional touch point coordinates on the target screen according to the touch body;

[0026] A virtual touch coordinate acquisition module, used for acquiring virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen;

[0027] A connection acquisition module, used to obtain a connection according to the viewpoint coordinates and the virtual touch coordinates;

[0028] A touch position determination module, used to determine a touch position acting on the virtual object according to the connection line and the position information of the virtual object in the virtual space;

[0029] The display control module is used to control the linkage display of the virtual object on the multiple screens according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each screen in the multiple screens.

[0030] The third aspect of the present application provides a touch control system for multi-screen linkage display, comprising: a control device and a plurality of screens; the plurality of screens are arranged in the same scene; the plurality of screens respectively have a virtual mapping grid corresponding to a virtual space; the plurality of screens include a target screen; the plurality of screens are used to linkage display virtual objects in the virtual space;

[0031] The control device is used to determine the coordinates of the two-dimensional touch point on the target screen according to the touch body; obtain the virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; obtain a connecting line according to the viewpoint coordinates and the virtual touch coordinates; determine the touch position acting on the virtual object according to the connecting line and the position information of the virtual object in the virtual space; control the multiple screens to display according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each of the multiple screens;

[0032] The multiple screens are used to display the virtual objects in a linked manner under the control of the control device.

[0033] Optionally, the touch control system further comprises: a touch control radar configured for each of the multiple screens; the touch control radar is communicatively connected with the control device;

[0034] The touch radar of the target screen is used to detect and obtain the position information of the touch body; the position information of the touch body is converted into the coordinate system of the target screen by associating the touch radar with the position of the target screen, the two-dimensional touch point coordinates on the target screen are obtained, and the two-dimensional touch point coordinates are sent to the control device;

[0035] or,

[0036] The touch radar of the target screen is used to detect and obtain the position information of the touch body, and send the position information of the touch body to the control device;

[0037] The control device is specifically used to convert the position information of the touch object into the coordinate system of the target screen by utilizing the position association between the touch radar and the target screen, so as to obtain the two-dimensional touch point coordinates on the target screen.

[0038] Optionally, the touch control system further includes: a rendering server corresponding to each of the multiple screens; each screen is connected to the corresponding rendering server; the rendering server is communicatively connected to the control device;

[0039] The control device is specifically configured to generate rendering instructions for the multiple screens according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each of the multiple screens; and send the rendering instructions corresponding to each of the multiple screens to the rendering server corresponding to each of the multiple screens;

[0040] The rendering server is used to render the display effect of the virtual object according to the rendering instruction received from the control device, generate rendering data; and send the rendering data to the corresponding screen;

[0041] Each screen among the multiple screens is specifically used to display the display effect of the virtual object according to the received rendering data.

[0042] Optionally, the touch control system further includes a network switch, and the network switch is communicatively connected to the control device, the touch control radar and the rendering server.

[0043] Compared with the prior art, this application has the following beneficial effects:

[0044] The touch control method for multi-screen linkage display provided in the embodiment of the present application is applied to a control device, and the control device corresponds to multiple screens set in the same scene. These screens can be oriented in different directions, for example, in four directions of front, back, left, and right, respectively, for linkage display of virtual objects in the virtual space, and the multiple screens respectively have their own virtual mapping grids corresponding to the virtual space. Taking the target screen among the multiple screens as an example, the method first determines the two-dimensional touch point coordinates on the target screen according to the touch body; then obtains the virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; then obtains the connection line according to the viewpoint coordinates and the virtual touch coordinates; then determines the touch position acting on the virtual object according to the connection line and the position information of the virtual object in the virtual space; finally, according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen among the multiple screens, the linkage display of the virtual objects on the multiple screens is controlled. The touch position acting on the virtual object is determined according to the connection line between the viewpoint coordinates and the virtual touch coordinates, which ensures the accurate response of the touch operation. In addition, the present application can build the association of multiple screens in the virtual space through the virtual mapping grids of the respective screens, ensuring the linkage display effect of multiple screens, and even if the orientations are different, the images of virtual objects at different angles can be viewed on each screen. Determining the coordinates of the two-dimensional touch point on the target screen according to the touch body can be achieved through many relatively low-cost methods, such as touch radar, and the rest of the operations can be automated, and there is no need to rely on the OCC technology that relies on the high-cost three-dimensional spatial positioning system, so compared with the previous methods, the cost is greatly reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0046] Figure 1 A flow chart of a touch control method for multi-screen linkage display provided in an embodiment of the present application;

[0047] Figure 2a A structural block diagram of a touch control system for multi-screen linkage display provided in an embodiment of the present application;

[0048] Figure 2b A structural block diagram of another touch control system for multi-screen linkage display provided in an embodiment of the present application;

[0049] Figure 3 A schematic diagram of a multi-screen linkage display touch control system provided in an embodiment of the present application;

[0050] Figure 4 A schematic diagram of a line formed by a viewpoint and a virtual touch coordinate provided in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of a viewpoint and screen position provided in an embodiment of the present application;

[0052] Figure 6 A schematic diagram of a manipulation provided in an embodiment of the present application;

[0053] Figure 7 A schematic diagram of the structure of a control device for multi-screen linkage display provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] As described above, the current technical solution cannot achieve multi-screen linkage display control. If three-dimensional space ray detection is used for interaction, a three-dimensional space positioning system needs to be installed, which is very expensive.

[0055] In view of the above problems, the inventor has conducted research and proposed the technical solution of the present application, which can effectively achieve the effect of multi-screen linkage control and greatly save costs.

[0056] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] Method Embodiment

[0058] First, several drawings involved in this application are introduced. Figure 1 A flow chart of a touch control method for multi-screen linkage display provided in an embodiment of the present application; Figure 2a and Figure 2b A structural block diagram of two touch control systems for multi-screen linkage display provided in the embodiments of the present application; Figure 3 A schematic diagram of a touch control system for multi-screen linkage display provided in an embodiment of the present application. Figure 1 The method in can be applied to the system shown in FIG2 .

[0059] To facilitate understanding, first Figure 2a The structure of is described below. Figure 2aThe structure of the touch control system for multi-screen linkage display shown may include: a control device and multiple screens; the multiple screens are set in the same scene; the multiple screens respectively have their own virtual mapping grids corresponding to the virtual space; the multiple screens include a target screen; the multiple screens are used to link and display virtual objects in the virtual space. Among them, the control device is used to determine the two-dimensional touch point coordinates on the target screen according to the touch body; obtain the virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; obtain a connecting line according to the viewpoint coordinates and the virtual touch coordinates; determine the touch position acting on the virtual object according to the connecting line and the position information of the virtual object in the virtual space; control the multiple screens to display according to the touch position, the preset response method corresponding to the touch position and the virtual mapping grid of each of the multiple screens. The multiple screens in the system are used to link and display the virtual objects under the control of the control device.

[0060] See also Figure 1 , which is a flow chart of a touch control method for multi-screen linkage display provided by an embodiment of the present application, the method comprising:

[0061] S101: Determine the two-dimensional touch point coordinates on the target screen according to the touch body.

[0062] Each screen is equipped with a touch radar, such as Figure 3 As shown in the schematic diagram of the touch control system for multi-screen linkage display, the position information of the two-dimensional touch point on the screen can be obtained by touch radar detection, and the position information of the touch object is converted into the coordinate system of the target screen according to the position association between the touch radar and the target screen, so as to obtain the two-dimensional coordinates of the touch point.

[0063] like Figure 2b As shown, the touch radar is located in the lower right corner of each screen. The touch radar and the target screen are not in the same coordinate system, so conversion is required based on position association. For example, the origin of the coordinate system where the touch radar is located is at the (1, 1) position of the coordinate system where the target screen is located. When the touch radar detects the position information (x, y) of the touch point, after conversion, the coordinates of the touch point in the coordinate system where the target screen is located are (x+1, y+1), that is, the two-dimensional touch point coordinates on the target screen are (x+1, y+1).

[0064] Because the detection area of ​​the touch radar is limited, the radar and the screen can be installed closer to each other to cover the entire screen. Here, as an example, we can choose to install it in the lower right corner of the screen during specific implementation. In addition, it can also be installed at the top, bottom, left edge, right edge, lower left corner of the screen, etc. There is no specific limitation on the installation position here.

[0065] S102: Obtain virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen.

[0066] There are countless virtual planes in the virtual space. Each screen has a corresponding virtual plane in the virtual space, that is, a virtual mapping grid. The two-dimensional coordinates of the touch point obtained are the coordinates on the screen. In order to save costs, Figure 4 It can be seen that the line needs to intersect with the virtual object after extension, so we need to convert the two-dimensional coordinates of the touch point on the screen into virtual touch coordinates on the virtual mapping grid, so as to achieve the connection involved in S103 and the intersection with the virtual object in S104.

[0067] S103: Obtaining a connection line according to the viewpoint coordinates and the virtual touch coordinates.

[0068] Figure 4 is a schematic diagram of a line formed by a viewpoint and a virtual touch coordinate. The step S103 can be Figure 4 For reference, the viewpoint coordinates are the positions observed by the human eye. The coordinates can be input manually or obtained through a positioning device in the wearable device. The wearable device and the control device are then connected in communication. This makes it more convenient for users to change different viewpoints without having to re-enter the viewpoint coordinates each time the viewpoint is changed. The virtual touch coordinates have been obtained in step S102. A straight line is determined based on the two points. We can connect the viewpoint coordinates and the virtual touch coordinates to obtain a connecting line. The connecting line is a straight line that can be extended infinitely.

[0069] S104: Determine a touch position on the virtual object according to the connection line and the position information of the virtual object in the virtual space.

[0070] refer to Figure 4 After the line is extended, it will intersect with the surface of the virtual object. The intersection is the touch position acting on the virtual object. This touch position can be obtained through mathematical and geometric calculations.

[0071] S105: controlling linkage display of the virtual object on the multiple screens according to the touch position, a preset response mode corresponding to the touch position, and a virtual mapping grid of each of the multiple screens.

[0072] As mentioned in S102, each screen has a corresponding virtual mapping grid (i.e., virtual plane), which is used to associate the screen with the virtual space, so that the screen can display virtual objects and accurately display the relevant response of the touch position. The preset response mode can be set according to actual needs, such as color change, enlargement, display of other content, rotation, etc.

[0073] This application can build the association of multiple screens in the virtual space through the virtual mapping grids of each screen, ensuring the linkage display effect of multiple screens. Even if the orientations are different, the images of virtual objects at different angles can be viewed on each screen. Determining the coordinates of the two-dimensional touch point on the target screen according to the touch body can be achieved through many relatively low-cost methods, such as touch radar, and the rest of the operations can be automated, and there is no need to rely on the OCC technology that relies on the high-cost three-dimensional spatial positioning system. Therefore, compared with the previous methods, the cost is greatly reduced.

[0074] System Example

[0075] In the above Figure 2a The system structure shown in the figure is introduced. The following provides another system structure. Figure 2b The touch control system with multi-screen linkage display shown includes:

[0076] Multiple screens, including a target screen. The multiple screens each have a virtual mapping grid corresponding to the virtual space. The multiple screens are arranged in the same scene. For example, the multiple screens can surround a pillar. The multiple screens are used to display virtual objects in the virtual space in a linked manner.

[0077] The system configures touch radars for multiple screens one by one. The touch radars are connected to the control device. Taking the touch radar of the target screen as an example, it is used to detect and obtain the position information of the touch body; by using the position association between the touch radar and the target screen, the position information of the touch body is converted into the coordinate system of the target screen, the two-dimensional touch point coordinates on the target screen are obtained, and the two-dimensional touch point coordinates are sent to the control device. Figure 2b The four screens shown are respectively configured with touch radars L1, L2, L3 and L4.

[0078] The control device is specifically used to generate rendering instructions for the multiple screens based on the touch position, the preset response method corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens; and send the rendering instructions corresponding to each screen in the multiple screens to the rendering server corresponding to each screen in the multiple screens.

[0079] The rendering server is used to render the display effect of the virtual object according to the rendering instruction received from the control device, generate rendering data, and send the rendering data to the corresponding screen. In the embodiment of the present application, one rendering server can be set to connect to multiple screens, or multiple rendering servers corresponding to the number of screens can be set.

[0080] Each screen among the multiple screens is specifically used to display the display effect of the virtual object according to the received rendering data.

[0081] The network switch is connected to the control device, the touch radar and the rendering server. In the embodiment of the present application, the control device can communicate with the touch radar through the network switch to receive the coordinates of the two-dimensional touch point. The control device can communicate with the rendering server through the network switch to achieve control.

[0082] As an optional implementation, the model of the control device is HP-Z4. There is no limit on the number of rendering servers. Multiple screens can share one rendering server, or each screen can be equipped with a rendering server. The model of the rendering server is HP-Z8, and the graphics card is RTX2070. Figure 2a and Figure 2b Four screens are shown in the figure. In actual operation, there is no limit on the number of screens. The model of the screen is HP-24F4K. The rendering server is connected to the screen through the DP interface of the graphics card for output. The touch radar can use Silan RPLIDAR S1. The network switch is connected to the control device, touch radar, and rendering server.

[0083] Figure 5 is a schematic diagram of a viewpoint and screen position, wherein there are four screens, namely, a front screen, a rear screen, a left screen, and a right screen. The plurality of screens need to include at least two of the screens. For the convenience of description, only the front screen and the rear screen are selected as examples. Figure 6 , the viewpoint coordinates are (-2.0m, 2.0m, 1.65m), the touch point coordinates on the front screen are (0.0m, 0.016m, 0.2m), and the touch point coordinates on the back screen are (0.4m, 0.184m, 0.4m). If the front screen is touched, the corresponding line is a straight line passing through (-2m, 2.0m, 1.65m) and (0.0m, 0.16m, 0.2m) and intersecting the virtual object. The same is true for the back screen. Therefore, no matter which screen we use to manipulate the three-dimensional virtual object, our touch position can be accurately identified. This method can achieve precise manipulation of three-dimensional virtual objects on different screens. This method can ignore the size, direction, angle, shape, resolution, number of screens installed, and can be performed on multiple screens at the same time.

[0084] After a touch operation is performed on a three-dimensional virtual object, the three-dimensional virtual object will undergo corresponding changes, such as movement, rotation, etc. At this time, the rendering instructions generated will also change accordingly. The rendering instructions are transmitted to the rendering servers corresponding to each screen through the network switch. After each screen receives the rendering data from the rendering server, it displays the virtual object. In this way, we can see the corresponding changes of the virtual object on each screen.

[0085] Device Embodiment

[0086] An embodiment of the present application provides a control device for multi-screen linkage display. Figure 7 FIG. 1 is a schematic diagram of the structure of the control device for the multi-screen linkage display. Figure 7 As shown, the two-dimensional touch coordinate determination module 701 is used to determine the two-dimensional touch point coordinates on the target screen according to the touch body.

[0087] The virtual touch coordinates acquisition module 702 is used to obtain virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen.

[0088] The connection line acquisition module 703 is used to obtain the connection line according to the viewpoint coordinates and the virtual touch coordinates.

[0089] The touch position determination module 704 is used to determine the touch position acting on the virtual object according to the connection line and the position information of the virtual object in the virtual space.

[0090] The display control module 705 is used to control the linkage display of the virtual object on the multiple screens according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each screen in the multiple screens.

[0091] Optionally, each of the multiple screens is configured with a touch radar; the two-dimensional touch coordinate determination module 701 includes:

[0092] A position information acquisition unit, configured to obtain the position information of the touch object by detecting the touch radar configured for the target screen;

[0093] The two-dimensional touch coordinate acquisition unit is used to convert the position information of the touch object into the coordinate system of the target screen by using the position association between the touch radar and the target screen, so as to obtain the two-dimensional touch point coordinates on the target screen.

[0094] Optionally, the display control module 705 includes:

[0095] an instruction generating unit, configured to generate rendering instructions for the multiple screens according to the touch position, a preset response mode corresponding to the touch position, and a virtual mapping grid of each of the multiple screens;

[0096] An instruction sending unit, used for sending a rendering instruction corresponding to each of the multiple screens to a rendering server corresponding to each of the multiple screens;

[0097] A rendering control unit, configured to render a display effect of a virtual object using a rendering server corresponding to each of the plurality of screens;

[0098] A display control unit is used to display the display effects rendered by the corresponding rendering servers through the multiple screens respectively.

[0099] Optionally, the control device for multi-screen linkage display further includes:

[0100] The mapping grid construction module is used to construct a virtual mapping grid corresponding to the same virtual space for each screen in the multiple screens according to the shapes, positions and orientations of the multiple screens.

[0101] Optionally, the control device for multi-screen linkage display further includes:

[0102] The viewpoint coordinate acquisition module is used to obtain the viewpoint coordinates through the positioning device in the wearable device; the wearable device is communicatively connected with the control device.

[0103] It should be noted that each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components indicated as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0104] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A touch control method for multi-screen linkage display, characterized in that: Applied to a control device, the control device corresponds to a plurality of screens arranged in the same scene, the plurality of screens are used to display virtual objects in a virtual space in a linked manner, and the plurality of screens respectively have a virtual mapping grid corresponding to the virtual space; The plurality of screens include a target screen; The plurality of screens are each configured with a touch radar; the method comprising: Obtaining the position information of the touch object by detecting with a touch radar configured for the target screen; By using the position association between the touch radar and the target screen, the position information of the touch object is converted into the coordinate system of the target screen to obtain the two-dimensional touch point coordinates on the target screen; and the virtual touch coordinates corresponding to the two-dimensional touch point coordinates are obtained according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; Obtaining a connection line according to the viewpoint coordinates and the virtual touch coordinates; Determining a touch position on the virtual object according to the connection line and the position information of the virtual object in the virtual space; According to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens, the virtual object is controlled to be displayed in linkage on the multiple screens.

2. The method according to claim 1, characterized in that The controlling the linkage display of the virtual object on the multiple screens according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens includes: generating rendering instructions for the multiple screens according to the touch positions, the preset response modes corresponding to the touch positions, and the virtual mapping grids of the respective screens of the multiple screens; Sending a rendering instruction corresponding to each of the multiple screens to a rendering server corresponding to each of the multiple screens; Rendering a display effect of a virtual object using a rendering server corresponding to each of the multiple screens; The display effects rendered by the corresponding rendering servers are respectively displayed through the multiple screens.

3. The method according to claim 1, characterized in that Also includes: According to the shapes, positions and orientations of the multiple screens, a virtual mapping grid is constructed in which each screen in the multiple screens corresponds to the same virtual space.

4. The method according to claim 1, characterized in that Also includes: The viewpoint coordinates are obtained through a positioning device in the wearable device; and the wearable device is communicatively connected with the control device.

5. The method according to claim 1, characterized in that The multiple screens include at least two of the following: Front, Back, Left, Right or Top.

6. A control device for multi-screen linkage display, characterized in that: The device corresponds to a plurality of screens arranged in the same scene, the plurality of screens are used to display virtual objects in a virtual space in a linked manner, and the plurality of screens respectively have a virtual mapping grid corresponding to the virtual space; The plurality of screens include a target screen; The plurality of screens are each configured with a touch radar; the device comprises: A two-dimensional touch coordinate determination module, used to convert the position information of the touch object into the coordinate system of the target screen by using the position association between the touch radar and the target screen, and obtain the two-dimensional touch point coordinates on the target screen; A virtual touch coordinate acquisition module, used for acquiring virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; A connection acquisition module, used to obtain a connection according to the viewpoint coordinates and the virtual touch coordinates; A touch position determination module, used to determine a touch position acting on the virtual object according to the connection line and the position information of the virtual object in the virtual space; The display control module is used to control the linkage display of the virtual object on the multiple screens according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each screen in the multiple screens.

7. A touch control system with multi-screen linkage display, characterized in that: include: A control device, a plurality of screens, and touch radars configured for each of the plurality of screens; The touch radar is communicatively connected with the control device; The multiple screens are arranged in the same scene; The multiple screens each have a virtual mapping grid corresponding to the virtual space; the multiple screens include a target screen; the multiple screens are used to display virtual objects in the virtual space in a linked manner; The touch radar of the target screen is used to detect and obtain the position information of the touch body; the position information of the touch body is converted into the coordinate system of the target screen by associating the touch radar with the position of the target screen, the two-dimensional touch point coordinates on the target screen are obtained, and the two-dimensional touch point coordinates are sent to the control device; The control device is used to obtain virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; obtain a connection line according to the viewpoint coordinates and the virtual touch coordinates; determine the touch position acting on the virtual object according to the connection line and the position information of the virtual object in the virtual space; and control the multiple screens to display according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each of the multiple screens; The multiple screens are used to display the virtual objects in a linked manner under the control of the control device; Alternatively, the touch radar of the target screen is used to detect and obtain the position information of the touch body, and send the position information of the touch body to the control device; The control device is used to convert the position information of the touch body into the coordinate system of the target screen by using the position association between the touch radar and the target screen, and obtain the two-dimensional touch point coordinates on the target screen; obtain the virtual touch coordinates corresponding to the two-dimensional touch point coordinates according to the two-dimensional touch point coordinates and the virtual mapping grid of the target screen; obtain a connecting line according to the viewpoint coordinates and the virtual touch coordinates; determine the touch position acting on the virtual object according to the connecting line and the position information of the virtual object in the virtual space; control the multiple screens to display according to the touch position, the preset response mode corresponding to the touch position and the virtual mapping grid of each of the multiple screens; The multiple screens are used to display the virtual objects in a linked manner under the control of the control device.

8. The system according to claim 7, characterized in that Also includes: A rendering server corresponding to each of the multiple screens; each screen is connected to a corresponding rendering server; the rendering server is communicatively connected to the control device; The control device is specifically configured to generate rendering instructions for the multiple screens according to the touch position, the preset response mode corresponding to the touch position, and the virtual mapping grid of each screen in the multiple screens; Sending a rendering instruction corresponding to each of the multiple screens to a rendering server corresponding to each of the multiple screens; The rendering server is used to render the display effect of the virtual object according to the rendering instruction received from the control device, generate rendering data; and send the rendering data to the corresponding screen; Each screen among the multiple screens is specifically used to display the display effect of the virtual object according to the received rendering data.

9. The system according to claim 8, characterized in that It also includes a network switch, which is communicatively connected with the control device, the touch radar and the rendering server.

Images