Interactive three-dimensional display system and method

By introducing the preset multi -screen splicing model and gesture interactive technology in the three -dimensional display system, the limitation of the three -dimensional field of view and imaging space in the three -dimensional display technology is solved, and the best visual experience of users at different angles and distances is achieved. , And improve the coherence and comfort of viewing.

CN119336157AActive Publication Date: 2025-01-21PEKING UNIV
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411272324.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-11
Publication Date
2025-01-21
Estimated Expiration
2044-09-11

AI Technical Summary

Technical Problem

The existing three-dimensional display technology has limitations in stereoscopic field angle and imaging space, which leads to users being able to observe three-dimensional content within a specific viewing angle and distance. The display screen replacement or parameter adjustment may cause visual misalignment, reducing the coherence of viewing. and comfort.

Method used

Provides an interactive three -dimensional display system, including server, display module and interactive device. Calculate the target observation distance required by the user to obtain the best visual effects through the preset multi -screen stitching model, and adjust the content on the display module in real time according to the user's space location information and gesture interactive requests to ensure the best visual experience.

Benefits of technology

Through the preset multi -screen splicing model and gesture interactive technology, the problem of visual dislocation caused by changes caused by the user changes, improved the coherent and comfort of the viewing, and provided a more natural and intuitive interactive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119336157A_ABST
    Figure CN119336157A_ABST
Patent Text Reader

Abstract

The invention discloses an interactive three-dimensional display system and method. The system comprises a server, a display module and an interaction device, the server is in communication connection with the display module and the interaction device. The interaction device is used for sending an interaction request to the server according to the gesture of the user; the server receives the interaction request sent by the interaction device, and adjusts the content displayed on the display module based on the interaction request and a preset multi-screen splicing model; the preset multi-screen splicing model is used for calculating a target observation distance required by the user for obtaining the optimal visual effect. The preset multi-screen splicing model is provided, the model is used for calculating the target observation distance needed by the user for obtaining the optimal visual effect, and therefore after the display screens are replaced or parameters are adjusted, the target observation distance needed by the optimal visual effect can be recalculated through the model to serve as basic parameters of content adjustment, and the user experience is improved. Therefore, the visual dislocation of the user caused by the angle change is avoided, and the watching continuity and comfort are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of three-dimensional display and human-computer interaction, and in particular to an interactive three-dimensional display system and method, which can be used for a data security exchange and sharing platform. Background Art

[0002] With the development of computer graphics and display technology, 3D display technology has shown a wide range of application potential in many fields. Especially in professional fields such as education, medical treatment, architectural design, game entertainment and military simulation, 3D display technology provides an immersive and intuitive way to display and interact with complex 3D data and environments.

[0003] In the related technologies, in the field of three-dimensional display technology, although the existing stereoscopic display technology, light field display technology and virtual reality (VR) / augmented reality (AR) technology have made certain progress, there are limitations in the stereoscopic field of view and imaging space, which means that users can only observe three-dimensional content within a specific viewing angle and distance. When the display screen is replaced or the parameters are adjusted, users may experience visual dislocation caused by the change in angle, which reduces the continuity and comfort of viewing. Summary of the invention

[0004] The present application provides an interactive three-dimensional display system. In order to have a basic understanding of some aspects of the disclosed embodiments, a simple summary is given below. This summary is not a general review, nor is it intended to identify key / important components or describe the scope of protection of these embodiments. Its only purpose is to present some concepts in a simple form as a preface to the detailed description that follows.

[0005] In a first aspect, an embodiment of the present application provides an interactive three-dimensional display system, the system comprising:

[0006] Server, display module and interactive device; wherein,

[0007] The display module is composed of multiple display screens and the angle between any two display screens is a preset angle. The server is respectively connected to the display module and the interactive device for communication; wherein,

[0008] An interaction device, used for sending an interaction request to a server according to a user's gesture;

[0009] The server receives an interaction request sent by the interaction device, and adjusts the content displayed on the display module based on the interaction request and a preset multi-screen splicing model; the preset multi-screen splicing model is used to calculate the target observation distance required by the user to obtain the best visual effect.

[0010] Optionally, the interaction request carries the user's spatial location information;

[0011] Based on the interactive request and the preset multi-screen splicing model, adjust the content displayed on the display module, including:

[0012] Calculate the real-time distance of the user relative to the display module according to the user's spatial position information;

[0013] Get the screen parameters of the display module;

[0014] Calculate the shortest viewing distance based on screen parameters and the preset multi-screen splicing model;

[0015] Adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.

[0016] Optionally, the screen parameters include the screen width, the maximum outward imaging angle, and the angle between screens of the display screen, and there are three display screens;

[0017] Calculate the shortest viewing distance based on screen parameters and the preset multi-screen splicing model, including:

[0018] Input the screen width, maximum outward imaging angle and the angle between screens of the display screen into the preset multi-screen splicing model;

[0019] Output the shortest viewing distance corresponding to the screen parameters; the calculation formula included in the preset multi-screen splicing model is:

[0020]

[0021] Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for users to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

[0022] Optionally, based on the real-time distance and the shortest viewing distance, adjust the content displayed on the display module, including:

[0023] Compare the real-time distance with the shortest observed distance;

[0024] When the real-time distance is less than or equal to the shortest observation distance, the imaging space of the content displayed on the control display module remains unchanged; or,

[0025] In a case where the real-time distance is greater than the shortest observation distance, the imaging space of the content displayed on the display module is controlled to change based on the user's gesture.

[0026] Optionally, the configuration parameters of the server include CPU-Intel 12th generation i7-12700, GPU-RTX 4080, memory-32GB, multiple display screens include three X-real holographic display screens, the interactive device uses the Leap Motion Controller device to realize gesture interaction, and the content displayed on the display module is three-dimensional content, and the three-dimensional content is static content or dynamic content.

[0027] Optionally, the size of the holographic display screen is 12 cm × 16 cm and the angle between adjacent holographic display screens is 26 degrees. The static content or dynamic content is implemented based on a mainstream game engine, which is Unity3D.

[0028] Optionally, calculating the real-time distance of the user relative to the display module according to the spatial position information of the user includes:

[0029] The user's spatial position information is converted from the local coordinate system to the spatial coordinate system under the display module to obtain the converted coordinate information;

[0030] Calculate the Euclidean distance between the converted coordinate information and the center point of the display module;

[0031] The Euclidean distance is taken as the real-time distance of the user relative to the display module.

[0032] Optionally, according to the user's gesture, an interaction request is sent to the server, including:

[0033] Collect user's gesture images in real time;

[0034] Analyze the gesture image to obtain the gesture identifier representing the gesture information of the user;

[0035] Determine the spatial position of the user in the local coordinate system and obtain the spatial position information of the user;

[0036] Construct an interaction request based on the gesture identifier and the user's spatial location information;

[0037] Send an interaction request to the server.

[0038] In a second aspect, an interactive three-dimensional display method is applied to a server, and the method includes:

[0039] receiving an interaction request sent by an interaction device, the interaction request carrying spatial location information of the user;

[0040] Calculate the real-time distance of the user relative to the display module according to the user's spatial position information;

[0041] Get the screen parameters of the display module;

[0042] Calculate the shortest viewing distance based on screen parameters and the preset multi-screen splicing model;

[0043] The content displayed on the display module is adjusted based on the real-time distance and the shortest observation distance.

[0044] Optionally, the screen parameters include the screen width, the maximum outward imaging angle, and the angle between screens of the display screen, and there are three display screens;

[0045] Calculate the shortest viewing distance based on screen parameters and the preset multi-screen splicing model, including:

[0046] Input the screen width, maximum outward imaging angle and the angle between screens of the display screen into the preset multi-screen splicing model;

[0047] Output the shortest observation distance; the calculation formula included in the preset multi-screen splicing model is:

[0048]

[0049] Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for users to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

[0050] In the embodiments of the present application, on the one hand, the present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required by the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target observation distance required for the best visual effect can be recalculated through the model as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the continuity and comfort of viewing. On the other hand, the present application adapts to the user's observation space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interaction experience, with greater flexibility and a wider range of interaction.

[0051] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0053] Figure 1 is a schematic diagram of the system structure of an interactive three-dimensional display system provided in an embodiment of the present application;

[0054] Figure 2It is a schematic diagram of a calculation process from a multi-screen imaging space to a user observation space provided in an embodiment of the present application;

[0055] Figure 3 It is a flowchart of an interactive three-dimensional display method provided in an embodiment of the present application;

[0056] Figure 4 It is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0057] Figure 5 is a structural schematic diagram of an interactive three-dimensional display device provided in an embodiment of the present application;

[0058] Figure 6 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following description and the accompanying drawings sufficiently illustrate specific embodiments of the present application to enable those skilled in the art to practice them.

[0060] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0061] When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are only examples of systems and methods consistent with some aspects of the present application as detailed in the attached claims.

[0062] In the description of the present application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0063] The present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required for the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the model can be used to recalculate the target observation distance required for the best visual effect as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the viewing continuity and comfort. An exemplary embodiment is used below to explain in detail.

[0064] See also Figure 1 , Figure 1 This is a system structure diagram of an interactive three-dimensional display system provided in an embodiment of the present application, the system comprising a server, a display module and an interaction device; wherein the display module is composed of a plurality of display screens and the angle between any two display screens is a preset angle, and the server is respectively communicated with the display module and the interaction device; wherein the interaction device is used to send an interaction request to the server according to the user's gesture; the server receives the interaction request sent by the interaction device, and adjusts the content displayed on the display module based on the interaction request and a preset multi-screen splicing model; the preset multi-screen splicing model is used to calculate the target observation distance required for the user to obtain the best visual effect.

[0065] Among them, the user's gesture is the way the user communicates with the display module through hand movements. These gestures can be simple (such as waving, pointing) or complex (such as a specific hand shape or sequence of movements), and are recognized by the system as interaction instructions. Interaction requests refer to requests generated by user gestures, which are recognized by the system and converted into specific operation instructions for triggering or controlling functions in the display system. The interaction device is a device for capturing user gestures, such as Leap Motion Controller or other types of gesture recognition sensors, which can detect and interpret the user's hand movements and convert these movements into electrical signals and send them to the server. Adjusting the display content is based on the user's interaction request and the multi-screen splicing model. The system will adjust the content on the display module in real time to adapt to the user's observation needs and provide the best visual experience. The target viewing distance refers to the specific distance that the user should maintain from the display screen in order to obtain the best visual effect. This distance is calculated by the multi-screen splicing model to ensure that the user can see a complete three-dimensional image without visual dislocation at this distance.

[0066] In the embodiments of the present application, on the one hand, the present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required by the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target observation distance required for the best visual effect can be recalculated through the model as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the continuity and comfort of viewing. On the other hand, the present application adapts to the user's observation space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interaction experience, with greater flexibility and a wider range of interaction.

[0067] The interaction request carries the user's spatial location information.

[0068] In some embodiments of the present application, the specific process of adjusting the content displayed on the display module based on the interactive request and the preset multi-screen splicing model includes: calculating the real-time distance of the user relative to the display module according to the user's spatial position information; obtaining the screen parameters of the display module; calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; and adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance.

[0069] The user's spatial location information refers to the data about the user's specific location in three-dimensional space obtained by the system through the interactive device. The real-time distance is the current distance between the user and the display module calculated by the system based on the user's spatial location information. This distance is updated in real time to reflect the user's movement. The screen parameters of the display module include technical specifications such as screen size, resolution, viewing angle, brightness, etc. These parameters have a direct impact on the display effect and user experience.

[0070] In the embodiments of the present application, the present application can ensure that users can get the best viewing experience at different positions. Real-time distance monitoring enables the system to accurately perceive changes in the user's position, and the calculation of the shortest viewing distance provides users with clear viewing guidance. Combining screen parameters and multi-screen splicing models, the system can intelligently adjust image content, whether zooming in, zooming out, or changing the viewing angle, to adapt to the user's real-time position. This method significantly improves the flexibility and adaptability of the interactive three-dimensional display system, optimizes the user's viewing experience, reduces visual discomfort caused by position changes, and makes users more comfortable and immersed when enjoying three-dimensional content.

[0071] Among them, the screen parameters include the screen width, maximum outward imaging angle and the angle between screens, and there are three display screens.

[0072] In some embodiments of the present application, according to the screen parameters and the preset multi-screen splicing model, the specific process of calculating the shortest observation distance includes: inputting the screen width, the maximum outward imaging angle and the angle between the screens of the display screen into the preset multi-screen splicing model; outputting the shortest observation distance corresponding to the screen parameters; wherein the calculation formula included in the preset multi-screen splicing model is:

[0073]

[0074] Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen that satisfies the user's observation of the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens. The calculation process of the multi-screen imaging space to the user observation space of this calculation formula is as follows: Figure 2 As shown, the two vertically arranged solid lines are display screens, and the arc is a single-screen observation space.

[0075] In some embodiments of the present application, the specific process of adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance includes: comparing the real-time distance and the shortest observation distance; when the real-time distance is less than or equal to the shortest observation distance, controlling the imaging space of the content displayed on the display module to remain unchanged; or, when the real-time distance is greater than the shortest observation distance, controlling the imaging space of the content displayed on the display module to change based on the user's gesture.

[0076] Specifically, the server's configuration parameters include CPU-Intel 12th generation i7-12700, GPU-RTX 4080, memory-32GB, multiple display screens including three X-real holographic display screens, the interactive device uses the Leap Motion Controller to realize gesture interaction, and the content displayed on the display module is three-dimensional content, which can be static content or dynamic content.

[0077] Specifically, the size of the holographic display screen is 12 cm × 16 cm and the angle between adjacent holographic display screens is 26 degrees. Static content or dynamic content is implemented based on a mainstream game engine, which is Unity3D.

[0078] In some embodiments of the present application, the specific process of calculating the real-time distance of the user relative to the display module based on the user's spatial position information includes: converting the user's spatial position information from the local coordinate system to the spatial coordinate system under the display module to obtain the converted coordinate information; calculating the Euclidean distance between the converted coordinate information and the center point of the display module; and using the Euclidean distance as the real-time distance of the user relative to the display module.

[0079] In some embodiments of the present application, the specific process of sending an interaction request to a server based on a user's gesture includes: acquiring the user's gesture image in real time; analyzing the gesture image to obtain a gesture identifier that represents the user's gesture information; determining the user's spatial position in the local coordinate system to obtain the user's spatial position information; constructing an interaction request based on the gesture identifier and the user's spatial position information; and sending the interaction request to the server.

[0080] Among them, gesture images refer to visual images of user hand movements captured by cameras or sensors. Gesture identifiers are identification information representing specific gestures obtained by analyzing gesture images, which can characterize user gestures. Local coordinate system refers to a reference coordinate system defined in an interactive system to determine the position of a user or object in space. Spatial position information refers to the specific position data of a user determined in the local coordinate system, which can be two-dimensional or three-dimensional coordinate points.

[0081] In an embodiment of the present application, by collecting the user's gesture image in real time and performing intelligent analysis, the user's gesture movements can be accurately captured and recognized and converted into specific gesture identifiers. Combined with the user's spatial position information in the local coordinate system, the system can construct accurate interaction requests that reflect the user's intentions and position status. By sending interaction requests to the server, the present application can implement an efficient and intuitive interaction method that enables users to communicate and control the system through natural gestures. This interaction method not only improves the naturalness and intuitiveness of the user experience, but also enhances the system's response speed and the accuracy of the interaction.

[0082] See also Figure 3 , which is a flow chart of an interactive three-dimensional display method provided in the embodiment of the present application, and is applied to the server. Figure 3 As shown, the detection method of the embodiment of the present application may include the following steps:

[0083] S101, receiving an interaction request sent by an interaction device, where the interaction request carries spatial location information of a user;

[0084] S102, calculating the real-time distance of the user relative to the display module according to the spatial position information of the user;

[0085] S103, obtaining screen parameters of the display module;

[0086] S104, calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model;

[0087] Among them, the screen parameters include the screen width, maximum outward imaging angle and the angle between screens, and there are three display screens.

[0088] In the embodiment of the present application, according to the screen parameters and the preset multi-screen splicing model, calculating the shortest observation distance specifically includes: inputting the screen width, the maximum outward imaging angle and the angle between the screens of the display screen into the preset multi-screen splicing model; outputting the shortest observation distance; wherein the calculation formula included in the preset multi-screen splicing model is:

[0089]

[0090] Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for users to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

[0091] S105, adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance.

[0092] For example Figure 4 As shown, Figure 4 This is a scenario diagram of an application scenario provided by the present application, which includes a system composed of a server, an interactive device and a display module. The display module includes a left screen, a middle screen and a right screen, and static content and dynamic content can be displayed on the screen.

[0093] In the embodiments of the present application, on the one hand, the present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required by the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target observation distance required for the best visual effect can be recalculated through the model as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the continuity and comfort of viewing. On the other hand, the present application adapts to the user's observation space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interaction experience, with greater flexibility and a wider range of interaction.

[0094] The following are device embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0095] See also Figure 5 , which shows a schematic diagram of the structure of an interactive three-dimensional display device provided by an exemplary embodiment of the present application. The interactive three-dimensional display device can be implemented as all or part of an electronic device through software, hardware or a combination of both. The device 1 includes a receiving module 10, a first calculation module 20, an acquisition module 30, a second calculation module 40, and an adjustment module 50.

[0096] The receiving module 10 is used to receive an interaction request sent by the interaction device, where the interaction request carries the user's spatial location information;

[0097] A first calculation module 20, used to calculate the real-time distance of the user relative to the display module according to the spatial position information of the user;

[0098] An acquisition module 30, used to acquire screen parameters of a display module;

[0099] A second calculation module 40, used to calculate the shortest observation distance according to the screen parameters and the preset multi-screen splicing model;

[0100] The adjustment module 50 is used to adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.

[0101] It should be noted that the interactive three-dimensional display device provided in the above embodiment only uses the division of the above functional modules as an example when executing the interactive three-dimensional display method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the interactive three-dimensional display device provided in the above embodiment and the interactive three-dimensional display method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0102] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0103] In the embodiments of the present application, on the one hand, the present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required by the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target observation distance required for the best visual effect can be recalculated through the model as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the continuity and comfort of viewing. On the other hand, the present application adapts to the user's observation space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interaction experience, with greater flexibility and a wider range of interaction.

[0104] The present application also provides a computer-readable medium having program instructions stored thereon, and when the program instructions are executed by a processor, the interactive three-dimensional display method provided by the above-mentioned various method embodiments is implemented.

[0105] The present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the interactive three-dimensional display method of each of the above method embodiments.

[0106] See also Figure 6 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 6 As shown, the electronic device 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0107] The communication bus 1002 is used to realize the connection and communication between these components.

[0108] The user interface 1003 may include a display screen (Display) and a camera (Camera), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.

[0109] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0110] Among them, the processor 1001 may include one or more processing cores. The processor 1001 uses various interfaces and lines to connect various parts within the entire electronic device 1000, and executes various functions and processes data of the electronic device 1000 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1005, and calling data stored in the memory 1005. Optionally, the processor 1001 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1001 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1001, and it can be implemented separately through a chip.

[0111] Among them, the memory 1005 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may also be optionally at least one storage system located away from the aforementioned processor 1001. As Figure 6 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an interactive three-dimensional display application.

[0112] exist Figure 6 In the electronic device 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 1001 can be used to call the interactive three-dimensional display application stored in the memory 1005 and specifically perform the following operations:

[0113] receiving an interaction request sent by an interaction device, the interaction request carrying spatial location information of the user;

[0114] Calculate the real-time distance of the user relative to the display module according to the user's spatial position information;

[0115] Get the screen parameters of the display module;

[0116] Calculate the shortest viewing distance based on screen parameters and the preset multi-screen splicing model;

[0117] Adjust the content displayed on the display module based on the real-time distance and the shortest observation distance.

[0118] In one embodiment, when the processor 1001 calculates the shortest viewing distance according to the screen parameters and the preset multi-screen splicing model, the processor 1001 specifically performs the following operations:

[0119] Input the screen width, maximum outward imaging angle and the angle between screens of the display screen into the preset multi-screen splicing model;

[0120] Output the shortest observation distance; the calculation formula included in the preset multi-screen splicing model is:

[0121]

[0122] Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for users to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

[0123] In the embodiments of the present application, on the one hand, the present application provides a preset multi-screen splicing model, which is used to calculate the target observation distance required by the user to obtain the best visual effect. Therefore, when the display screen is replaced or the parameters are adjusted, the target observation distance required for the best visual effect can be recalculated through the model as the basic parameter for content adjustment, so that the user will not suffer from visual dislocation due to angle changes, thereby improving the continuity and comfort of viewing. On the other hand, the present application adapts to the user's observation space and interaction space through gesture interaction technology. Compared with traditional interaction methods such as mouse, keyboard, and touch screen, gesture interaction provides a more natural and intuitive interaction experience, with greater flexibility and a wider range of interaction.

[0124] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the interactive three-dimensional display program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium of the interactive three-dimensional display program can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0125] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

[0126] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the interactive three-dimensional display program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium of the interactive three-dimensional display can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0127] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. An interactive three-dimensional display system, characterized in that: The system comprises: Server, display module and interactive device; wherein, The display module is composed of a plurality of display screens and the angle between any two display screens is a preset angle, and the server is respectively connected to the display module and the interactive device for communication; wherein, The interaction device is used to send an interaction request to the server according to the user's gesture; The server receives an interaction request sent by the interaction device, and adjusts the content displayed on the display module based on the interaction request and a preset multi-screen splicing model; the preset multi-screen splicing model is used to calculate the target observation distance required by the user to obtain the best visual effect.

2. The system according to claim 1, characterized in that The interaction request carries the spatial location information of the user; The adjusting the content displayed on the display module based on the interaction request and the preset multi-screen splicing model includes: Calculating the real-time distance of the user relative to the display module according to the spatial position information of the user; Obtaining screen parameters of the display module; Calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; Based on the real-time distance and the shortest observation distance, the content displayed on the display module is adjusted.

3. The system according to claim 2, characterized in that The screen parameters include the screen width, the maximum outward imaging angle and the angle between the screens of the display screen, and there are three display screens; The calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model includes: Inputting the screen width, maximum outward imaging angle and the angle between screens of the display screen into the preset multi-screen splicing model; Output the shortest observation distance corresponding to the screen parameters; wherein the calculation formula included in the preset multi-screen splicing model is: Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for the user to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

4. The system according to claim 2, characterized in that The adjusting the content displayed on the display module based on the real-time distance and the shortest observation distance includes: Comparing the real-time distance with the shortest observation distance; When the real-time distance is less than or equal to the shortest observation distance, the imaging space of the content displayed on the display module is controlled to remain unchanged; or, In a case where the real-time distance is greater than the shortest observation distance, the imaging space of the content displayed on the display module is controlled to change based on the user's gesture.

5. The system according to claim 1, characterized in that The configuration parameters of the server include CPU-Intel 12th generation i7-12700, GPU-RTX 4080, memory-32GB, the multiple display screens include three X-real holographic display screens, the interactive device uses a Leap Motion Controller device to realize gesture interaction, and the content displayed on the display module is three-dimensional content, which is static content or dynamic content.

6. The system according to claim 5, characterized in that The size of the holographic display screen is 12 cm×16 cm and the angle between adjacent holographic display screens is 26 degrees. The static content or dynamic content is implemented based on a mainstream game engine, which is Unity3D.

7. The system according to claim 2, characterized in that The calculating, according to the spatial position information of the user, the real-time distance of the user relative to the display module comprises: Converting the spatial position information of the user from the local coordinate system to the spatial coordinate system under the display module to obtain converted coordinate information; Calculating the Euclidean distance between the converted coordinate information and the center point of the display module; The Euclidean distance is used as the real-time distance of the user relative to the display module.

8. The system according to claim 1, characterized in that The sending of the interaction request to the server according to the user's gesture includes: Collecting gesture images of the user in real time; Analyze the gesture image to obtain a gesture identifier representing the gesture information of the user; Determine the spatial position of the user in the local coordinate system to obtain the spatial position information of the user; Constructing an interaction request according to the gesture identifier and the spatial position information of the user; The interaction request is sent to the server.

9. An interactive three-dimensional display method, characterized in that: Applied to the server, the method includes: receiving an interaction request sent by the interaction device, wherein the interaction request carries the spatial location information of the user; Calculating the real-time distance of the user relative to the display module according to the spatial position information of the user; Obtaining screen parameters of the display module; Calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model; Based on the real-time distance and the shortest observation distance, the content displayed on the display module is adjusted.

10. The method according to claim 9, characterized in that The screen parameters include the screen width, the maximum outward imaging angle and the angle between the screens of the display screen, and there are three display screens; The calculating the shortest observation distance according to the screen parameters and the preset multi-screen splicing model includes: Inputting the screen width, maximum outward imaging angle and the angle between screens of the display screen into the preset multi-screen splicing model; Output the shortest observation distance; wherein the calculation formula included in the preset multi-screen splicing model is: Among them, L t,min is the shortest observation distance, L s,min is the minimum distance on a single screen for the user to observe the stereoscopic effect, Θ is the maximum outward imaging angle, and Φ is the angle between screens.

Citation Information

Patent Citations

  • Multi-screen display process and system

    CN101183301A

  • Network-based distributed synchronous rendering system and method

    CN106600672A

  • Multi-screen spliced sign data interaction method

    CN108255455A

  • Display screen adjusting method and device, computer equipment and storage medium

    CN113835660A

  • Three-dimensional image formation and color correction system and method

    US20180088889A1