An interactive three-dimensional display system and method
By using a pre-set multi-screen splicing model and gesture interaction technology, the system calculates the user's real-time distance and minimum observation distance, solving the problem of visual misalignment in 3D display, improving the continuity and comfort of the user experience, and providing a more natural interaction method.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2026-03-10
AI Technical Summary
Existing 3D display technologies have limitations in terms of stereoscopic field of view and imaging space, which leads to visual dislocation and discomfort when users observe 3D content from specific angles and distances.
A pre-set multi-screen splicing model is adopted, and the user's real-time distance and shortest viewing distance are calculated through gesture interaction technology. The content on the display module is adjusted to ensure the best visual effect, including gesture recognition using Leap Motion Controller and server-side calculation optimization.
It improves the viewing continuity and comfort of 3D displays, provides a more natural and intuitive interactive experience, and enhances the system's flexibility and interactive range.
Smart Images

Figure CN119336157B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the fields of 3D display and human-computer interaction technology, and in particular to an interactive 3D display system and method that can be used in a data security exchange and sharing platform. Background Technology
[0002] With the development of computer graphics and display technology, 3D display technology has shown broad application potential in many fields. Especially in professional fields such as education, medicine, architectural design, gaming and entertainment, and military simulation, 3D display technology provides an immersive and intuitive way to display and interact with complex 3D data and environments.
[0003] In the field of 3D display technology, although existing stereoscopic display technology, light field display technology, and virtual reality (VR) / augmented reality (AR) technology have made some progress, they still have limitations in terms of stereoscopic field of view and imaging space, which means that users can only observe 3D content within a specific angle and distance. When the display screen is replaced or the parameters are adjusted, users may experience visual disorientation due to changes in angle, thereby reducing the continuity and comfort of viewing. Summary of the Invention
[0004] This application provides an interactive three-dimensional display system. To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general description, nor is it intended to identify key / important components or describe the scope of protection of these embodiments. Its sole purpose is to present some concepts in a simple form as a prelude to the detailed description that follows.
[0005] In a first aspect, embodiments of this application provide an interactive three-dimensional display system, the system comprising:
[0006] Server, display module, and interactive device; among which...
[0007] The display module consists of multiple displays, with the angle between any two displays being a preset angle. The server communicates with both the display module and the interactive device.
[0008] An interactive device used to send interaction requests to a server based on the user's gestures;
[0009] The server receives interaction requests sent by the interactive device and adjusts the content displayed on the display module based on the interaction requests and the preset multi-screen splicing model; the preset multi-screen splicing model is used to calculate the target viewing distance required by the user to obtain the best visual effect.
[0010] Optionally, the interaction request may carry the user's spatial location information;
[0011] Based on the interactive request and the preset multi-screen splicing model, adjust the content displayed on the display module, including:
[0012] Calculate the real-time distance between the user and the display module based on the user's spatial location information;
[0013] Obtain the screen parameters of the display module;
[0014] Calculate the shortest viewing distance based on screen parameters and a preset multi-screen splicing model;
[0015] Adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0016] Optional screen parameters include the screen width, maximum outward imaging angle, and inter-screen angle; there are 3 displays.
[0017] Based on screen parameters and a preset multi-screen splicing model, the shortest viewing distance is calculated, including:
[0018] Input the screen width, maximum outward imaging angle, and inter-screen angle into the preset multi-screen splicing model;
[0019] Output the shortest viewing distance corresponding to the screen parameters; among which, the calculation formula included in the preset multi-screen splicing model is:
[0020]
[0021] Among them, L t,min For the shortest observation distance, L s,min Θ is the minimum distance required for a user to observe a stereoscopic effect on a single screen, Θ is the maximum outward imaging angle, and Φ is the angle between screens.
[0022] Optionally, based on the real-time distance and the shortest observation distance, the content displayed on the display module can be adjusted, including:
[0023] Compare the real-time distance with the shortest observation distance;
[0024] When the real-time distance is less than or equal to the shortest observation distance, the imaging space of the content displayed on the control display module remains unchanged; or,
[0025] When the real-time distance is greater than the minimum observation distance, the imaging space of the content displayed on the control display module changes based on the user's gestures.
[0026] Optionally, the server configuration parameters include CPU - Intel 12th generation i7-12700, GPU - RTX 4080, memory - 32GB, multiple displays including three X-real holographic displays, the interactive device uses a Leap Motion Controller device to realize gesture interaction, and the content displayed on the display module is three-dimensional content, which can be static or dynamic content.
[0027] Optionally, the holographic display screen is 12 cm × 16 cm in size and the angle between adjacent holographic display screens is 26 degrees. The static or dynamic content is implemented based on a mainstream game engine, namely Unity3D.
[0028] Optionally, based on the user's spatial location information, the real-time distance between the user and the display module is calculated, including:
[0029] The user's spatial location information is converted from the local coordinate system to the spatial coordinate system under the display module to obtain the converted coordinate information;
[0030] Calculate the Euclidean distance between the transformed coordinates and the center point of the display module;
[0031] Use Euclidean distance as the real-time distance between the user and the display module.
[0032] Optionally, based on the user's gesture, an interaction request is sent to the server, including:
[0033] Real-time capture of user gesture images;
[0034] By analyzing the gesture images, gesture identifiers representing user gesture information can be obtained;
[0035] Determine the user's spatial location in the local coordinate system to obtain the user's spatial location information;
[0036] Construct an interaction request based on gesture identifiers and the user's spatial location information;
[0037] Send an interaction request to the server.
[0038] Secondly, an interactive 3D display method, applied on a server-side, includes the following:
[0039] Receive interaction requests sent by the interactive device, which carry the user's spatial location information;
[0040] Calculate the real-time distance between the user and the display module based on the user's spatial location information;
[0041] Obtain the screen parameters of the display module;
[0042] Calculate the shortest viewing distance based on screen parameters and a preset multi-screen splicing model;
[0043] Adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0044] Optional screen parameters include the screen width, maximum outward imaging angle, and inter-screen angle; there are 3 displays.
[0045] Based on screen parameters and a preset multi-screen splicing model, the shortest viewing distance is calculated, including:
[0046] Input the screen width, maximum outward imaging angle, and inter-screen angle into the preset multi-screen splicing model;
[0047] Output the shortest viewing distance; the calculation formula included in the preset multi-screen splicing model is as follows:
[0048]
[0049] Among them, L t,min For the shortest observation distance, L s,min Θ is the minimum distance required for a user to observe a stereoscopic effect on a single screen, Θ is the maximum outward imaging angle, and Φ is the angle between screens.
[0050] In this application, on the one hand, a preset multi-screen splicing model is provided. This model is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thus improving the continuity and comfort of viewing. On the other hand, this application adapts to the user's viewing space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interactive experience, with greater flexibility and a wider range of interaction.
[0051] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description
[0052] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0053] Figure 1 This is a schematic diagram of the system structure of an interactive three-dimensional display system provided in an embodiment of this application;
[0054] Figure 2This is a schematic diagram illustrating the calculation process from multi-screen imaging space to user observation space provided in an embodiment of this application;
[0055] Figure 3 This is a flowchart illustrating an interactive three-dimensional display method provided in an embodiment of this application;
[0056] Figure 4 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application;
[0057] Figure 5 This is a schematic diagram of the structure of an interactive three-dimensional display device provided in an embodiment of this application;
[0058] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0059] The following description and accompanying drawings fully illustrate specific embodiments of this application to enable those skilled in the art to practice them.
[0060] It should be understood that the described embodiments are merely some, not all, of the embodiments in this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.
[0061] In the following description, when referring to the accompanying drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of systems and methods consistent with some aspects of this application as detailed in the appended claims.
[0062] In the description of this application, it should be understood that the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0063] This application provides a preset multi-screen splicing model, which is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thereby improving the continuity and comfort of viewing. The following is a detailed description using exemplary embodiments.
[0064] Please see Figure 1 , Figure 1 This is a schematic diagram of the system structure of an interactive 3D display system provided in an embodiment of this application. The system includes a server, a display module, and an interactive device. The display module is composed of multiple displays, and the angle between any two displays is a preset angle. The server is communicatively connected to both the display module and the interactive device. The interactive device is used to send an interaction request to the server based on the user's gestures. The server receives the interaction request sent by the interactive device and adjusts the content displayed on the display module based on the interaction request and a preset multi-screen splicing model. The preset multi-screen splicing model is used to calculate the target viewing distance required by the user to obtain the best visual effect.
[0065] User gestures are the way users communicate with the display module through hand movements. These gestures can be simple (such as waving or pointing) or complex (such as specific hand shapes or movement sequences) and are recognized by the system as interaction commands. Interaction requests are requests generated by user gestures; these requests are recognized by the system and converted into specific operation commands to trigger or control functions in the display system. Interaction devices are devices used to capture user gestures, such as LeapMotion Controllers or other types of gesture recognition sensors. They can detect and interpret user hand movements and convert these movements into electrical signals sent to the server. Adjusting the displayed content involves the system adjusting the content on the display module in real time based on the user's interaction requests and the multi-screen splicing model to adapt to the user's viewing needs and provide the best visual experience. The target viewing distance refers to the specific distance the user should maintain from the display screen to obtain the best visual effect. This distance is calculated by the multi-screen splicing model to ensure that the user can see a complete, visually undistorted 3D image at this distance.
[0066] In this application, on the one hand, a preset multi-screen splicing model is provided. This model is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thus improving the continuity and comfort of viewing. On the other hand, this application adapts to the user's viewing space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interactive experience, with greater flexibility and a wider range of interaction.
[0067] The interaction request carries the user's spatial location information.
[0068] In some embodiments of this application, the specific process of adjusting the content displayed on the display module based on the interaction request and the preset multi-screen splicing model includes: calculating the real-time distance of the user relative to the display module according to the user's spatial location information; obtaining the screen parameters of the display module; calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; and adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0069] The user's spatial location information refers to data about the user's specific location in three-dimensional space obtained by the system through the interactive device. Real-time distance is calculated by the system based on the user's spatial location information, determining the current distance between the user and the display module. This distance is updated in real time to reflect the user's movement. The display module's screen parameters include technical specifications such as screen size, resolution, viewing angle, and brightness. These parameters directly affect the display effect and user experience.
[0070] In this embodiment, the system ensures an optimal viewing experience for users in various positions. Real-time distance monitoring allows the system to accurately perceive changes in the user's position, while the calculation of the shortest viewing distance provides clear viewing guidance. By combining screen parameters and a multi-screen splicing model, the system can intelligently adjust image content, adapting to the user's real-time position whether zooming in, zooming out, or changing the viewing angle. This method significantly improves the flexibility and adaptability of the interactive 3D display system, optimizes the user's viewing experience, reduces visual discomfort caused by positional changes, and makes users more comfortable and immersive when enjoying 3D content.
[0071] The screen parameters include the screen width, maximum outward imaging angle, and the angle between screens. There are three screens.
[0072] In some embodiments of this application, the specific process of calculating the shortest observation distance based on screen parameters and a preset multi-screen splicing model includes: inputting the screen width, maximum outward imaging angle, and inter-screen angle of the display into the preset multi-screen splicing model; outputting the shortest observation distance corresponding to the screen parameters; wherein, the calculation formula included in the preset multi-screen splicing model is:
[0073]
[0074] Among them, L t,min For the shortest observation distance, L s,min The minimum distance required for a user to observe a stereoscopic effect on a single screen is given by Θ, where Θ is the maximum outward imaging angle and Φ is the angle between screens. The calculation process from the multi-screen imaging space to the user's observation space is as follows: Figure 2 As shown, the two vertically arranged solid lines represent the display screen, and the arc represents the single-screen viewing space.
[0075] In some embodiments of this application, the specific process of adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance includes: comparing the size between the real-time distance and the shortest observation distance; when the real-time distance is less than or equal to the shortest observation distance, controlling the imaging space of the content displayed on the display module to remain unchanged; or, when the real-time distance is greater than the shortest observation distance, controlling the imaging space of the content displayed on the display module to change based on the user's gesture.
[0076] Specifically, the server's configuration parameters include a CPU of Intel 12th generation i7-12700, a GPU of RTX 4080, 32GB of memory, multiple displays including three X-real holographic displays, and an interactive device using a Leap Motion Controller to achieve gesture interaction. The content displayed on the display module is three-dimensional, which can be static or dynamic.
[0077] Specifically, the holographic display screen measures 12 cm x 16 cm, with an angle of 26 degrees between adjacent holographic displays. Static or dynamic content is implemented using a mainstream game engine, namely Unity3D.
[0078] In some embodiments of this application, the specific process of calculating the real-time distance of the user relative to the display module based on the user's spatial location information includes: converting the user's spatial location information from the local coordinate system to the spatial coordinate system under the display module to obtain the converted coordinate information; calculating the Euclidean distance between the converted coordinate information and the center point of the display module; and using the Euclidean distance as the real-time distance of the user relative to the display module.
[0079] In some embodiments of this application, the specific process of sending an interaction request to the server based on the user's gesture includes: real-time acquisition of the user's gesture image; analysis of the gesture image to obtain a gesture identifier representing the user's gesture information; determination of the user's spatial position in the local coordinate system to obtain the user's spatial position information; construction of an interaction request based on the gesture identifier and the user's spatial position information; and sending the interaction request to the server.
[0080] Gesture images refer to visual images of a user's hand movements captured by a camera or sensor. Gesture identifiers are identifying information representing specific gestures obtained by analyzing gesture images; this information characterizes the user's hand gestures. The local coordinate system is a reference coordinate system defined in the interactive system to determine the user's or object's position in space. Spatial location information refers to the user's specific location data determined in the local coordinate system; this data can be two-dimensional or three-dimensional coordinate points.
[0081] In this embodiment, by real-time acquisition and intelligent analysis of user gesture images, the system can accurately capture and recognize user gestures, converting them into specific gesture identifiers. Combined with the user's spatial location information in the local coordinate system, the system can construct accurate interaction requests that reflect the user's intent and location status. By sending these interaction requests to the server, this application achieves an efficient and intuitive interaction method, enabling users to communicate and control the system through natural gestures. This interaction method not only improves the naturalness and intuitiveness of the user experience but also enhances the system's response speed and the accuracy of the interaction.
[0082] Please see Figure 3 This is a flowchart illustrating an interactive 3D display method provided in this application, applied to a server. For example... Figure 3 As shown, the detection method in this application embodiment may include the following steps:
[0083] S101, Receive an interaction request sent by the interactive device, the interaction request carrying the user's spatial location information;
[0084] S102, calculate the real-time distance between the user and the display module based on the user's spatial location information;
[0085] S103, Obtain the screen parameters of the display module;
[0086] S104, calculates the shortest viewing distance based on screen parameters and a preset multi-screen splicing model;
[0087] The screen parameters include the screen width, maximum outward imaging angle, and the angle between screens. There are three screens.
[0088] In this embodiment, calculating the shortest viewing distance based on screen parameters and a preset multi-screen splicing model specifically includes: inputting the screen width, maximum outward imaging angle, and inter-screen angle of the display into the preset multi-screen splicing model; and outputting the shortest viewing distance; wherein the preset multi-screen splicing model includes the following calculation formula:
[0089]
[0090] Among them, L t,min For the shortest observation distance, L s,min Θ is the minimum distance required for a user to observe a stereoscopic effect on a single screen, Θ is the maximum outward imaging angle, and Φ is the angle between screens.
[0091] S105 adjusts the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0092] For example Figure 4 As shown, Figure 4 This is a scenario diagram of an application scenario provided by this application. The scenario diagram includes a system composed of a server, an interactive device, and a display module. The display module includes a left screen, a middle screen, and a right screen, which can display static content and dynamic content.
[0093] In this application, on the one hand, a preset multi-screen splicing model is provided. This model is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thus improving the continuity and comfort of viewing. On the other hand, this application adapts to the user's viewing space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interactive experience, with greater flexibility and a wider range of interaction.
[0094] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.
[0095] Please see Figure 5 This illustration shows a schematic diagram of an interactive three-dimensional display device provided in an exemplary embodiment of this application. The interactive three-dimensional display device can be implemented as all or part of an electronic device through software, hardware, or a combination of both. The device 1 includes a receiving module 10, a first calculation module 20, an acquisition module 30, a second calculation module 40, and an adjustment module 50.
[0096] The receiving module 10 is used to receive an interaction request sent by the interactive device, the interaction request carrying the user's spatial location information;
[0097] The first calculation module 20 is used to calculate the real-time distance between the user and the display module based on the user's spatial location information.
[0098] Module 30 is used to acquire the screen parameters of the display module;
[0099] The second calculation module 40 is used to calculate the shortest observation distance based on the screen parameters and the preset multi-screen splicing model.
[0100] Adjustment module 50 is used to adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0101] It should be noted that the interactive 3D display device provided in the above embodiments is only illustrated by the division of the above functional modules when executing the interactive 3D display method. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the interactive 3D display device and the interactive 3D display method embodiments provided in the above embodiments belong to the same concept, and the implementation process is detailed in the method embodiments, which will not be repeated here.
[0102] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0103] In this application, on the one hand, a preset multi-screen splicing model is provided. This model is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thus improving the continuity and comfort of viewing. On the other hand, this application adapts to the user's viewing space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interactive experience, with greater flexibility and a wider range of interaction.
[0104] This application also provides a computer-readable medium having program instructions stored thereon, which, when executed by a processor, implement the interactive three-dimensional display method provided in the above-described method embodiments.
[0105] This application also provides a computer program product containing instructions that, when run on a computer, causes the computer to execute the interactive three-dimensional display methods of the various method embodiments described above.
[0106] Please see Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 6 As shown, the electronic device 1000 may include: at least one processor 1001, at least one network interface 1004, a user interface 1003, a memory 1005, and at least one communication bus 1002.
[0107] The communication bus 1002 is used to realize the connection and communication between these components.
[0108] The user interface 1003 may include a display screen and a camera. Optionally, the user interface 1003 may also include a standard wired interface and a wireless interface.
[0109] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface).
[0110] The processor 1001 may include one or more processing cores. The processor 1001 connects to various parts within the electronic device 1000 using various interfaces and lines. It executes various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 1005, and by calling data stored in the memory 1005. Optionally, the processor 1001 may be implemented using at least one hardware form selected from Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1001 may integrate one or more of the following: a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and a modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed on the screen; and the modem handles wireless communication. It is understood that the modem may also be implemented as a separate chip, without being integrated into the processor 1001.
[0111] The memory 1005 may include random access memory (RAM) or read-only memory. Optionally, the memory 1005 may include a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-described method embodiments, etc.; the data storage area may store data involved in the above-described method embodiments, etc. Optionally, the memory 1005 may also be at least one storage system located remotely from the aforementioned processor 1001. Figure 6 As shown, the memory 1005, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and an interactive 3D display application.
[0112] exist Figure 6 In the illustrated electronic device 1000, the user interface 1003 is mainly used to provide an input interface for the user and to acquire user input data; while the processor 1001 can be used to call the interactive 3D display application stored in the memory 1005 and specifically perform the following operations:
[0113] Receive interaction requests sent by the interactive device, which carry the user's spatial location information;
[0114] Calculate the real-time distance between the user and the display module based on the user's spatial location information;
[0115] Obtain the screen parameters of the display module;
[0116] Calculate the shortest viewing distance based on screen parameters and a preset multi-screen splicing model;
[0117] Adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.
[0118] In one embodiment, when the processor 1001 calculates the shortest viewing distance based on screen parameters and a preset multi-screen splicing model, it specifically performs the following operations:
[0119] Input the screen width, maximum outward imaging angle, and inter-screen angle into the preset multi-screen splicing model;
[0120] Output the shortest viewing distance; the calculation formula included in the preset multi-screen splicing model is as follows:
[0121]
[0122] Among them, L t,min For the shortest observation distance, L s,min Θ is the minimum distance required for a user to observe a stereoscopic effect on a single screen, Θ is the maximum outward imaging angle, and Φ is the angle between screens.
[0123] In this application, on the one hand, a preset multi-screen splicing model is provided. This model is used to calculate the target viewing distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target viewing distance required for the best visual effect can be recalculated through this model as the basic parameter for content adjustment, so that the user will not experience visual misalignment due to changes in angle, thus improving the continuity and comfort of viewing. On the other hand, this application adapts to the user's viewing space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interactive experience, with greater flexibility and a wider range of interaction.
[0124] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The interactive 3D display program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the embodiments of the above methods. The storage medium for the interactive 3D display program can be a magnetic disk, optical disk, read-only memory, or random access memory, etc.
[0125] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.
[0126] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The interactive 3D display program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the embodiments of the above methods. The storage medium for the interactive 3D display can be a magnetic disk, optical disk, read-only memory, or random access memory, etc.
[0127] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.
Claims
1. An interactive three-dimensional display system, characterized by The system comprises: a server, a display module and an interactive device; wherein the display module is composed of multiple display screens, and the included angle between any two display screens is a preset angle, the server is in communication connection with the display module and the interactive device respectively; wherein the interactive device is used for sending an interactive request to the server according to the user's gesture; the server receives the interactive request sent by the interactive device, and adjusts the content displayed on the display module based on the interactive request and a preset multi-screen splicing model; the preset multi-screen splicing model is used to calculate the target observation distance required by the user to obtain the best visual effect, so as to ensure that the user can see the complete three-dimensional image without visual misplacement at the distance; the interactive request carries the spatial position information of the user; the adjustment of the content displayed on the display module based on the interactive request and the preset multi-screen splicing model comprises: calculating the real-time distance of the user relative to the display module according to the spatial position information of the user; obtaining the screen parameters of the display module; calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance; the screen parameters include the screen width, the maximum outward imaging angle and the screen angle of the display screen, and the display screen is three; calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model comprises: inputting the screen width, the maximum outward imaging angle and the screen angle of the display screen into the preset multi-screen splicing model; outputting the shortest observation distance corresponding to the screen parameters; wherein the preset multi-screen splicing model contains the following calculation formula: wherein, is the shortest observation distance, is the minimum distance on a single screen to satisfy the user's observation of stereoscopic effects, is the maximum outward imaging angle, is the inter-screen angle.
2. The system of claim 1, wherein, adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance comprises: comparing the size between the real-time distance and the shortest observation distance; in the case that the real-time distance is less than or equal to the shortest observation distance, controlling the imaging space of the content displayed on the display module to be unchanged; or in the case that the real-time distance is greater than the shortest observation distance, controlling the imaging space of the content displayed on the display module to change based on the user's gesture.
3. The system of claim 1, wherein, The configuration parameters of the server include CPU-Intel 12 generation i7-12700, GPU-RTX 4080, memory-32GB, the multiple display screens include three X-real holographic display screens, the interactive device uses Leap Motion Controller device to realize gesture interaction, the content displayed on the display module is three-dimensional content, the three-dimensional content is static content or dynamic content; the size of the holographic display screen is 12 cm x 16 cm, and the included angle between adjacent holographic display screens is 26 degrees, the static content or dynamic content is realized based on a mainstream game engine, and the mainstream game engine is Unity3D.
4. The system of claim 1, wherein, The method comprises the following steps: Converting the spatial position information of the user from a local coordinate system to a spatial coordinate system under the display module to obtain converted coordinate information; Calculating the Euclidean distance between the converted coordinate information and the center point of the display module; Taking the Euclidean distance as the real-time distance of the user relative to the display module.
5. The system of claim 1, wherein, The method comprises the following steps: Real-time collection of gesture images of the user; Analysis of the gesture images to obtain gesture identification of the user's gesture information; Determination of the spatial position of the user in the local coordinate system to obtain the spatial position information of the user; Construction of an interaction request according to the gesture identification and the spatial position information of the user; Sending the interaction request to the server.
6. An interactive three-dimensional display method implemented using the system of any of claims 1-5, wherein, The method comprises the following steps: Receiving an interaction request sent by the interaction device, the interaction request carrying the spatial position information of the user; Calculating the real-time distance of the user relative to the display module according to the spatial position information of the user; Obtaining screen parameters of the display module; Calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; adjust, based on the real-time distance and the shortest observation distance, content displayed on the display module.
Citation Information
Patent Citations
Network-based distributed synchronous rendering system and method
CN106600672A
Display screen adjusting method and device, computer equipment and storage medium
CN113835660A