Immersive information display interaction system and method
By using dynamic adjustment of robotic arms and display units in the immersive information display system, combined with three-dimensional modeling and user interaction processing, the problem of limited amplitude and form of information content is solved, and a more flexible and rich interactive display effect is achieved.
Patent Information
- Application Number
- CN202411579970.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-07
- Publication Date
- 2025-01-03
AI Technical Summary
The existing immersive information display methods include limited scope, limited display form, and lack of interaction.
Using an immersive information display interactive system including the main body appearance base, acousto-optical and electrical player, display unit, robotic arm, display controller and interactive components, combining three-dimensional modeling and user through position and angle adjustment of the robotic arm and display unit. Interactive information processing to realize dynamic and interactive information display.
It provides a more flexible, rich and interactive information display method, and can adjust the display content in real time according to the user's actions and intentions, add dimensions and details of information display, and improve user experience and information communication effect.
Smart Images

Figure CN119252156A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of information display, and in particular to an immersive information display interactive system and method. Background Art
[0002] With the popularization of traditional information video display solutions, more and more information display solutions are widely used in creating product experience, promoting entertainment features, promoting science education, etc. General immersive information display solutions usually use a whole large screen or segmented screen projection to project fixed video content onto the screen or curtain, providing users with a wide range of audio and video sensory stimulation and bringing real effects.
[0003] In actual use, there are some insurmountable problems due to the limitation of the display form: 1. The scope of information content is limited. Since the video content is large, it usually only provides users with a one-time sense of vision in the experience area. The complete content needs to be displayed in a very short time, and the length of the information content is severely limited; 2. The form of information display is limited. Due to the limitation of the display method, the information form is usually limited to fixed video and audio content, lacking information content that improves the dimension of real experience; 3. Lack of interactive methods. Traditional information display methods lack interaction, and users can only receive information passively. In a social environment with explosive information volume, the amount of information that can actually be received is very small, and even less is remembered.
[0004] Therefore, there is an urgent need to develop an immersive information display and interactive method to overcome the problems of limited information content, limited display form and lack of interaction in the above displays. Summary of the invention
[0005] The technical problem to be solved by the present invention is the problem that the existing display forms have limited display information content, limited display forms, and lack of interaction.
[0006] In order to solve the above technical problems, according to one aspect of the present invention, an immersive information display interactive system is provided, which includes: a main body appearance base, including a base and a basic fixing part, which is used to support the internal and external structure of the overall appearance scenery and is used for fixing the basic part of the mechanical arm; an audio-visual player, which is used to play the sound information of traditional information display and provide lighting effects; a display unit, which is a screen or a curtain, and has multiple display units, which are used to support the visual experience of information display and display the video or image information to be displayed; a mechanical arm, which has two ends, one end is fixedly connected to the main body appearance base, and the other end is connected to the display unit, which serves as a physical support device for the display unit, so that the display unit can achieve changes in position and angle within the required range; it can receive the display controller to send out The display unit is adjusted according to the position and angle change command, and the display unit is adjusted to the specified position and angle in the manner specified by the command; the display controller is used to decompose the content to be displayed and transmit it to each display unit and the mechanical arm unit, and is used to display the content to be displayed on each screen respectively, and move each screen to the specified position in a specified manner; the interactive component is used to receive or detect user instructions and transmit them to the information server, and the interactive component processes commands including body gesture capture and touch gestures; the information server is connected to the display controller and the interactive component, and is used to store the information content that needs to be played and displayed in real time, and processes the information content in real time according to the user interaction of the interactive component, and the output result information is transmitted to the display unit through the display controller for feedback of interactive information.
[0007] According to an embodiment of the present invention, an immersive information display interaction system may adopt an immersive information display interaction method comprising the following steps: step S1, the information server performs three-dimensional modeling on the preloaded large model, renders the content to be displayed and transmits the user perspective data to the display controller; step S2, the display controller transmits the content to be displayed to multiple display units respectively for displaying the large-screen content, and adjusts the display unit to a specified position and angle through a robotic arm unit according to real-time changes in the user's perspective, giving the user the best visual experience; step S3, by capturing the user's position, line of sight state and angle, as well as the user's gesture information, the user's actions are converted into perspective changes and focus changes, and transmitted to the information server to achieve interactive information display.
[0008] According to an embodiment of the present invention, if the interactive component detects that the user's position changes outside the area, the information can be interpreted as a change in the user's perspective, and new display content can be rendered based on the change in perspective. The display unit can be moved and rotated by the robotic arm to display the rotated model information in a manner that follows the user's perspective.
[0009] According to an embodiment of the present invention, if the interactive component detects that the user's position changes within the display area, the information can be interpreted as the user's position change and viewing angle change, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit remains consistent with the user's direction, and the display content of each display unit is independently rendered according to this logic. Finally, the independent display units are moved and rotated by the robotic arm, and the user is given immersive display content through each independent display unit.
[0010] According to an embodiment of the present invention, if the interactive component detects a user's posture change or gesture change information, the information server can interpret the meaning the user wants to express; the user's expression of meaning includes: being interested in an area, expecting a detailed introduction, or quickly swiping over the current information; rendering the information the user expects in real time in a targeted manner, zooming in, reducing, and moving the model, and transmitting it to the display controller for actual display.
[0011] According to an embodiment of the present invention, the movement and positioning of the display unit can be achieved by a multi-degree-of-freedom robotic arm combined with a motion control algorithm; by including inverse kinematics, path planning, PID control and sensor feedback, the robotic arm can accurately control the position and angle of the screen or display unit in three-dimensional space.
[0012] According to an embodiment of the present invention, the robotic arm can be realized by including multi-degree-of-freedom design, servo motor control, kinematic algorithm, sensor feedback, path planning and posture control; enabling the robotic arm to accurately control the position and direction of the screen or display unit in three-dimensional space, providing flexible and stable display effects.
[0013] According to another aspect of the present invention, an immersive information display interaction method is provided, and the method is implemented based on an immersive information display interaction system including a main appearance base, an audio-visual player, a display unit, a robotic arm, a display controller, an interactive component, and an information server, and the method includes the following steps: Step S1, the information server renders the content to be displayed and transmits the user perspective data to the display controller by performing three-dimensional modeling on the preloaded large model; Step S2, the display controller transmits the content to be displayed to each display unit respectively for displaying the large-screen content, and adjusts the display unit to a specified position and angle through the robotic arm unit according to real-time changes in the user's perspective, giving the user an optimal visual experience; Step S3, by capturing the user's position, line of sight state and angle, as well as the user's gesture information, the user's actions are converted into perspective changes and focus changes, and transmitted to the information server, thereby realizing interactive information display.
[0014] According to an embodiment of the present invention, the immersive information display interaction method may also include: step S4, if the interactive component detects that the user's position changes outside the area, the information is interpreted as a change in the user's perspective, and new display content is rendered through the change in perspective, and the display unit is moved and rotated by the robotic arm, and the rotated model information is displayed in a manner following the user's perspective; step S5; if the interactive component detects that the user's position changes within the display area, the information is interpreted as a change in the user's position and perspective, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit is consistent with the user direction, and the display content of each display unit is independently rendered according to this logic, and finally each independent display unit is moved and rotated by the robotic arm, and immersive display content is provided to the user through each independent display unit.
[0015] According to an embodiment of the present invention, the immersive information display interaction method may also include: step S6, if the user's posture change or gesture change information is detected, the information server is used to interpret the meaning that the user wants to express; the user's expression of meaning includes: interest in an area, expectation of a detailed introduction, or a quick swipe across the current information; targeted real-time rendering of the information the user expects to obtain, zooming in, reducing, and moving the model, and transmitting it to the display controller for actual display.
[0016] Compared with the prior art, the technical solution provided by the embodiments of the present invention can at least achieve the following beneficial effects:
[0017] The immersive information display interactive system and method provided by the present invention can capture the user's actions and intentions through interactive components, providing flexibility in user interaction. The display unit can move to a designated position to display designated content through the user's interactive actions, and can provide more flexible information display methods such as position following, perspective following, and focus following.
[0018] The immersive information display interactive system and method provided by the present invention can display information more flexibly, and users can obtain more and richer detailed content through interactive design, which provides the possibility of designing more comprehensive promotional content.
[0019] The immersive information display interactive system and method provided by the present invention supports real-time rendering of large models through an information server, and provides more display information display dimensions, such as local zooming in and out of structural content, hierarchical progressive display, and viewing angle changes.
[0020] The immersive information display interactive system and method provided by the present invention can display predetermined content in more ways through the linkage design of multiple display units, such as large-screen splicing, single-screen mobile expansion display, multi-screen tracking of multiple target split display, mobile following, etc., and can assemble more information content display scenes according to actual needs.
[0021] The immersive information display interactive system and method provided by the present invention are interactive. Through human-computer interaction design, including but not limited to position detection, posture detection, and gesture detection, user input information is captured in real time and transmitted to an information server, and user input is processed in real time, providing the possibility of real-time interaction with users.
[0022] The immersive information display interactive system and method provided by the present invention are rich in features. A logical computing unit is added to the information server side, and the real-time information content is processed in a set manner according to the real-time input commands of the user. Due to the interactive design, richer information details can be displayed to the actual user to a greater extent, providing a better display effect for the information presenter.
[0023] The immersive information display interactive system and method provided by the present invention are flexible, and through the matching design of real-time rendering and active display, allow information content to be displayed in more dimensions, providing richer information display.
[0024] The immersive information display interactive system and method provided by the present invention have market potential. With the update and iteration of more products on the market, quickly displaying more and richer information to users has become a rigid demand, which will inevitably lead to demand growth. The market where the products of the present invention are launched has great development potential and commercial value.
[0025] The present invention provides an immersive information display interactive solution, which introduces stronger interactivity, richer information and more flexible display to the traditional information display method, and meets the diverse needs of information display. With the further evolution of technology and the expansion of the market, the present invention is expected to be widely used and promoted around the world. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present invention, but are not intended to limit the present invention.
[0027] Figure 1 is a structural diagram showing an immersive information display interactive system according to an embodiment of the present invention;
[0028] Figure 2 is a flow chart showing an immersive information display interaction method according to an embodiment of the present invention;
[0029] Figure 3 It is a schematic diagram showing an implementation of an immersive information display interaction method according to an embodiment of the present invention. DETAILED DESCRIPTION
[0030] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0031] Unless otherwise defined, the technical or scientific terms used herein shall have the common meanings understood by persons with ordinary skills in the field to which the present invention belongs. The words "first", "second" and similar words used in the patent application specification and claims of the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one" or "a" do not indicate a quantity limitation, but indicate the existence of at least one.
[0032] Figure 1 is a structural diagram showing an immersive information display interactive system according to an embodiment of the present invention;
[0033] like Figure 1 As shown, the immersive information display and interactive system includes: a main appearance base, an audio-visual player, a display unit, a robotic arm, a display controller, an interactive component, and an information server.
[0034] The main appearance base, including the base and basic fixings, is used to support the internal and external structures of the overall appearance scenery and is used to fix the robot arm foundation. The main appearance base is used to support the entire immersive information display scenery, and provides stable support through a fixed base or other fixed forms to adapt to different usage environments. The base is made of high-strength material or high-toughness material, with good flexibility, durability and good support, ensuring stable support in various environments.
[0035] The audio-visual player is used to play the sound information of traditional information display and provide lighting effects; the real-time audio and sound-light effect information sent from the information server plays the audio in real time and completes the synchronous playback of light and electronic special effects.
[0036] The display unit is a screen or curtain with multiple display units, which is used to support the visual experience of information display and display the video or image information to be displayed; receive the display content to be played from the information server, divide the specific content into specific display units, and control the mechanical arm unit in real time to adjust the position and rotation angle of the display unit according to the user's perspective change. Multiple display units are installed on the main appearance base through multiple mechanical arms, and are used to use multiple sub-screens to display large blocks of display content to users.
[0037] The mechanical arm is a movable fixed part. The mechanical arm has two ends, one end is fixedly connected to the main body appearance base, and the other end is connected to the display unit. As a physical support device of the display unit, it can receive real-time signals to move the display unit to a specified state according to a specified trajectory within a specified time, so that the display unit can achieve position and angle changes within the required range; it can adjust the display unit according to the position and angle change commands sent by the display controller, and adjust the display unit to the specified position and angle according to the command specified method;
[0038] The display controller is used to decompose the content to be displayed and transmit it to each display unit and the robotic arm unit, so as to display the content to be displayed on each screen respectively and move each screen to a specified position in a specified manner; the display controller receives the display content to be played from the information server, divides the specific content into specific display units, and controls the robotic arm unit in real time to adjust the position and rotation angle of the display unit according to the changes in the user's viewing angle.
[0039] The interactive component is used to receive or detect user instructions and pass them to the information server. The interactive component processes commands including body gesture capture and touch gestures. It is a real-time user interaction module, which is used to capture the user's position, eye gaze, gesture movements in real time, and transmit specific instructions to the information server in real time to complete real-time action feedback.
[0040] The information server supports audio and video playback, and has logical operations and real-time rendering capabilities for large models. It can control audio, video and special effects playback and display in real time, complete timeline synchronization, and process interactive logic in real time, and process changes in display information in real time according to the interactive logic; the information server is connected to the display controller and the interactive component, and is used to store the information content required for playback and real-time display, and processes the information content in real time according to the user interaction of the interactive component, and the output result information is transmitted to the display unit through the display controller for feedback of interactive information.
[0041] The immersive information display interactive system provided by the present invention provides more flexible information display, and users can obtain more and richer detailed content through interactive design, which provides the possibility of designing more comprehensive promotional content.
[0042] According to one or some embodiments of the present invention, the immersive information display interaction system adopts an immersive information display interaction method comprising the following steps:
[0043] Step S1: The information server performs three-dimensional modeling on the preloaded large model, renders the content to be displayed and transmits the user perspective data to the display controller;
[0044] Step S2: The display controller transmits the content to be displayed to multiple display units respectively for displaying the large-screen content, and adjusts the display unit to a specified position and angle through the mechanical arm unit according to the real-time change of the user's viewing angle to give the user the best visual experience;
[0045] Step S3: By capturing the user's position, sight state and angle, and the user's gesture information, the user's actions are converted into changes in viewing angle and focus, and transmitted to the information server to achieve interactive information display.
[0046] The immersive information display interactive system provided by the present invention can display predetermined content in more ways through the linkage design of multiple display units, such as large-screen splicing, single-screen mobile expansion display, multi-screen tracking of multiple target split display, mobile following, etc., and can assemble more information content display scenes according to actual needs.
[0047] According to one or some embodiments of the present invention, if the interactive component detects that the user's position changes outside the area, the information is interpreted as a change in the user's perspective, new display content is rendered based on the change in perspective, and the display unit is moved and rotated by a robotic arm to display the rotated model information in a manner that follows the user's perspective.
[0048] According to one or some embodiments of the present invention, if the interactive component detects that the user's position changes within the display area, the information is interpreted as a change in the user's position and viewing angle, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit remains consistent with the user's direction, and the display content of each display unit is independently rendered according to this logic. Finally, the independent display units are moved and rotated by the robotic arm, and the user is given immersive display content through each independent display unit.
[0049] According to one or some embodiments of the present invention, if the interactive component detects a user's posture change or gesture change information, the information server interprets the meaning the user wants to express; the user's expression of meaning includes: interest in an area, expectation of a detailed introduction, or quick swiping of the current information; targeted real-time rendering of the information the user expects to obtain, zooming in, reducing, and moving the model, and transmitting it to the display controller for actual display.
[0050] The immersive information display interactive system provided by the present invention is interactive. Through human-computer interaction design, including but not limited to position detection, posture detection, and gesture detection, user input information is captured in real time and transmitted to an information server, and user input is processed in real time, providing the possibility of real-time interaction with users.
[0051] According to one or some embodiments of the present invention, the movement and positioning of the display unit is achieved by a multi-degree-of-freedom robotic arm combined with a motion control algorithm; by including inverse kinematics, path planning, PID control and sensor feedback, the robotic arm can accurately control the position and angle of the screen or display unit in three-dimensional space.
[0052] According to one or some embodiments of the present invention, the robot arm is implemented by including multi-degree-of-freedom design, servo motor control, kinematic algorithm, sensor feedback, path planning and posture control; the robot arm can accurately control the position and direction of the screen or display unit in three-dimensional space, providing a flexible and stable display effect. It supports robot arms of multiple brands and models such as FANUC, KUKA, ABB, Yaskawa, etc.
[0053] The immersive information display interactive system provided by the present invention can capture the user's actions and intentions through interactive components, providing flexibility in user interaction. The display unit can move to a designated position to display designated content through the user's interactive actions, and can provide more flexible information display methods such as position following, perspective following, and focus following.
[0054] Figure 2 is a flow chart showing an immersive information display interaction method according to an embodiment of the present invention; Figure 3 It is a schematic diagram showing an implementation of an immersive information display interaction method according to an embodiment of the present invention.
[0055] like Figure 2 and Figure 3 As shown, the immersive information display interactive method includes the following steps:
[0056] Step S1: The information server performs 3D modeling on the preloaded large model, renders the content to be displayed and transmits the user's perspective data to the display controller.
[0057] Step S2: The display controller transmits the content to be displayed to each display unit for displaying the large-screen content, and adjusts the display unit to a specified position and angle through the mechanical arm unit according to the real-time change of the user's viewing angle, so as to give the user the best visual experience;
[0058] Step S3: By capturing the user's position, sight state and angle, and the user's gesture information, the user's actions are converted into perspective changes and focus changes, which are transmitted to the information server to achieve interactive information display.
[0059] According to one or some embodiments of the present invention, the immersive information display interaction method further includes:
[0060] Step S4: If the interactive component detects that the user's position changes outside the area, the information is interpreted as a change in the user's perspective, and new display content is rendered according to the change in perspective. The display unit is moved and rotated by the mechanical arm to display the rotated model information in a manner that follows the user's perspective.
[0061] Step S5: If the interactive component detects that the user's position changes in the display area, the information is interpreted as the user's position change and viewing angle change, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit is consistent with the user's direction, and the display content of each display unit is independently rendered according to this logic. Finally, the independent display units are moved and rotated by the robotic arm, and the user is given immersive display content through each independent display unit.
[0062] The immersive information display interactive system and method provided by the present invention supports real-time rendering of large models through an information server, and provides more display information display dimensions, such as local zooming in and out of structural content, hierarchical progressive display, and viewing angle changes.
[0063] According to one or some embodiments of the present invention, the immersive information display interaction method further includes:
[0064] Step S6: If a change in the user's posture or gesture is detected, the information server interprets the meaning the user wants to express; the user's expression includes: interest in an area, expectation of a detailed introduction, or rapid swiping of the current information; targeted real-time rendering of the information the user expects to obtain, zooming in, reducing, and moving the model, and transmitting it to the display controller for actual display.
[0065] The immersive information display interactive system and method provided by the present invention are rich and flexible. A logical computing unit is added to the information server side to process the real-time information content in a set manner according to the user's real-time input command. Due to the interactive design, richer information details can be displayed to the actual user to a greater extent, providing a better display effect for the information presenter; through the combination design of real-time rendering and active display, it is allowed to display information content in more dimensions, providing richer information display.
[0066] The immersive information display interactive system and method provided by the present invention have market potential. With the update and iteration of more products on the market, it has become a rigid demand to quickly display more and richer information to users, which will inevitably lead to demand growth. The market where the products of the present invention are launched has great development potential and commercial value. The present invention provides an immersive information display interactive solution, which introduces stronger interactivity, richer information and more flexible display to the traditional information display method, and meets the diversified needs of information display. With the further evolution of technology and the expansion of the market, the present invention is expected to be widely used and promoted worldwide.
[0067] The above description is merely an exemplary embodiment of the present invention and is not intended to limit the protection scope of the present invention. The protection scope of the present invention is determined by the appended claims.
Claims
1. An immersive information display interactive system, comprising: The main appearance base, including the base and basic fixings, is used to support the internal and external structures of the overall appearance scenery and to fix the basic structure of the robotic arm; Audio-visual player, used to play the audio information of traditional information display and provide lighting effects; The display unit is a screen or a curtain, and there are multiple display units, which are used to support the visual experience of information display and display the video or image information to be displayed; A mechanical arm, wherein the mechanical arm has two ends, one end of which is fixedly connected to the main body appearance base, and the other end of which is connected to the display unit, and serves as a physical support device for the display unit, so that the display unit can achieve position and angle changes within the required range; the display unit can be adjusted according to the position and angle change command received from the display controller, and the display unit is adjusted to a specified position and angle according to the command specified method; A display controller is used to decompose and transmit the content to be displayed to each display unit and the mechanical arm unit, so as to display the content to be displayed on each screen respectively and move each screen to a specified position in a specified manner; An interactive component, used to receive or detect user instructions and transmit them to the information server, wherein the interactive component processes commands including body gesture capture and touch gestures; The information server is connected to the display controller and the interactive component, and is used to store the information content required to be played and displayed in real time, and to process the information content in real time according to the user interaction of the interactive component. The output result information is transmitted to the display unit through the display controller for feedback of interactive information.
2. The immersive information display interactive system according to claim 1, wherein: The immersive information display interaction system adopts an immersive information display interaction method comprising the following steps: Step S1: The information server performs three-dimensional modeling on the preloaded large model, renders the content to be displayed and transmits the user perspective data to the display controller; Step S2: The display controller transmits the content to be displayed to multiple display units respectively for displaying the large-screen content, and adjusts the display unit to a specified position and angle through the mechanical arm unit according to the real-time change of the user's viewing angle to give the user the best visual experience; Step S3: By capturing the user's position, sight state and angle, and the user's gesture information, the user's actions are converted into changes in viewing angle and focus, and transmitted to the information server to achieve interactive information display.
3. The immersive information display interactive system according to claim 2, wherein: If the interactive component detects that the user's position changes outside the area, it interprets the information as a change in the user's perspective, renders new display content based on the perspective change, and moves and rotates the display unit through the robotic arm to display the rotated model information in a manner that follows the user's perspective.
4. The immersive information display interactive system according to claim 2, wherein: If the interactive component detects that the user's position changes in the display area, it interprets the information as a change in the user's position and viewing angle, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit remains consistent with the user's direction. The display content of each display unit is rendered independently according to this logic, and finally the independent display units are moved and rotated by the robotic arm to provide the user with immersive display content through each independent display unit.
5. The immersive information display interactive system according to claim 2, wherein: If the interactive component detects a change in the user's posture or gesture, the information server interprets what the user wants to express; the user's expression includes: interest in an area, expectation of a detailed introduction, or quick swiping of the current information; targeted real-time rendering of the information the user expects, zooming in, out, and moving the model, and transmitting it to the display controller for actual display.
6. The immersive information display interactive system according to claim 1, wherein: The movement and positioning of the display unit are achieved by a multi-degree-of-freedom robotic arm combined with a motion control algorithm; through inverse kinematics, path planning, PID control and sensor feedback, the robotic arm can accurately control the position and angle of the screen or display unit in three-dimensional space.
7. The immersive information display interactive system according to claim 1, wherein: The robotic arm is realized by multi-degree-of-freedom design, servo motor control, kinematic algorithm, sensor feedback, path planning and posture control, which enables the robotic arm to accurately control the position and direction of the screen or display unit in three-dimensional space, providing flexible and stable display effects.
8. An immersive information display interactive method, the method is implemented based on an immersive information display interactive system including a main body appearance base, an audio-visual player, a display unit, a mechanical arm, a display controller, an interactive component, and an information server, the method comprising the following steps: Step S1: The information server performs three-dimensional modeling on the preloaded large model, renders the content to be displayed and transmits the user perspective data to the display controller; Step S2: The display controller transmits the content to be displayed to each display unit for displaying the large-screen content, and adjusts the display unit to a specified position and angle through the mechanical arm unit according to the real-time change of the user's viewing angle, so as to give the user the best visual experience; Step S3: By capturing the user's position, sight state and angle, and the user's gesture information, the user's actions are converted into perspective changes and focus changes, which are transmitted to the information server to achieve interactive information display.
9. The immersive information display interaction method according to claim 8, further comprising: Step S4: If the interactive component detects that the user's position changes outside the area, the information is interpreted as a change in the user's perspective, and new display content is rendered according to the change in perspective. The display unit is moved and rotated by the mechanical arm to display the rotated model information in a manner that follows the user's perspective. Step S5; If the interactive component detects that the user's position changes in the display area, the information is interpreted as a change in the user's position and viewing angle, ensuring that a certain physical distance is maintained between each display unit and the user, and that the normal of each screen unit remains consistent with the user's direction. The display content of each display unit is rendered independently according to this logic, and finally the independent display units are moved and rotated by the robotic arm to provide the user with immersive display content through each independent display unit.
10. The immersive information display interaction method according to claim 9, further comprising: Step S6: If a posture change or gesture change information of the user is detected, the information server is used to interpret the meaning that the user wants to express; The meanings expressed by users include: being interested in an area, expecting a detailed introduction, or quickly swiping past the current information; The information that the user expects is rendered in real time in a targeted manner, the model is zoomed in, out, and moved, and then transmitted to the display controller for actual display.
