Virtual scene display system and method based on rotating mechanism

Abstract

The invention discloses a virtual scene display system and method based on a rotating mechanism, and the system comprises a projection subsystem which comprises the rotating mechanism and at least one projector, and the projector is fixed on the rotating mechanism and is used for adjusting the projection direction of the projector in real time; the camera subsystem is used for capturing the action and head direction information of the experiencer in real time; and the rendering and calculating subsystem is respectively connected with the camera subsystem and the projection subsystem and is used for adjusting the projection direction of the projector according to the captured action and head direction information and rendering a projection picture in real time. According to the method, the angular resolution of the picture needing to be rendered can be reduced, so that the calculation pressure of a rendering system is reduced, the number of required projectors can be reduced to a certain extent, and the system cost is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual scene display, and particularly to a virtual scene display system and method based on a rotating mechanism. Background Art

[0002] With the continuous development of virtual reality (VR) technology, immersive virtual scene display systems are increasingly widely used in fields such as education, scientific research, industrial design, and entertainment. Traditional immersive virtual scene display systems, such as CAVE (Cave Automatic Virtual Environment), project images onto multiple walls and the ground through multiple projectors or multiple LED panels to provide an all-round immersive experience for experiencers. However, the following problems exist in the prior art: High computing power requirement: In order to cover multiple walls and the ground, the graphics rendering device needs to output multiple images simultaneously, which poses extremely high requirements for rendering computing power.

[0003] Resource waste: Although the images cover multiple walls, the experiencer's line of sight can only see a small part of the images at each moment, resulting in waste of most of the image resources.

[0004] Verginess problem: Although the CAVE system has certain advantages over head-mounted VR devices (HMDs) in reducing verginess, in some cases, the experiencer may still feel discomfort due to image delay or image mismatch.

[0005] In order to solve the above problems, the prior art requires a new type of immersive virtual scene display system that can reduce system costs, reduce computing power requirements, and improve resource utilization and user experience at the same time. Therefore, the present invention proposes a virtual scene display system and method based on a rotating mechanism. Summary of the Invention

[0006] The object of the present invention is to provide a virtual scene display system and method based on a rotating mechanism for the defects of the prior art.

[0007] To achieve the above object, the present invention adopts the following technical solutions: A virtual scene display system based on a rotating mechanism, comprising: A projection subsystem, comprising a rotating mechanism and at least one projector, the projector being fixed on the rotating mechanism and used for adjusting the projection direction of the projector in real time; A camera subsystem, used for capturing the actions and head direction information of the experiencer in real time; A rendering and computing subsystem, respectively connected to the camera subsystem and the projection subsystem, used for adjusting the projection direction of the projector according to the captured actions and head direction information, and rendering the projection image in real time.

[0008] Furthermore, the rotation mechanism includes a motor with an encoder, a reduction assembly, a rotating shaft, and a support frame; The reduction assembly is respectively connected to the motor and the rotating shaft. The support frame is sleeved on the rotating shaft, and the projector is installed on the support frame, so that the motor drives the reduction assembly to rotate, and then the reduction assembly drives the rotating shaft, the support frame, and the projector to rotate.

[0009] Furthermore, the range covered by the projection of the projector is at least 200° of the wall surface and at least 3 / 4 of the floor area.

[0010] Furthermore, the camera subsystem includes multiple cameras, which are distributed above the four sides of the room, and the multiple cameras capture the actions and head direction information of the experiencer in real time.

[0011] Furthermore, the rendering and computing subsystem includes: A processing unit for processing the action and head direction information captured by the camera subsystem; A rendering unit for rendering the projection screen in real time according to the processing result.

[0012] Furthermore, the processing unit also includes converting the encoder readings of the motor into the projection direction.

[0013] Furthermore, the rendering unit also includes taking images of the virtual scene using a virtual camera to generate the projection screen.

[0014] Furthermore, the projection direction of the projector is adjusted in real time by the motor according to the head direction information of the experiencer.

[0015] Furthermore, the real-time adjustment according to the head direction information of the experiencer is specifically as follows: capturing the binocular coordinates of the experiencer, calculating the perpendicular direction of the line connecting the two eyes, determining the horizontal line-of-sight direction, and controlling the rotation of the motor to make the projection direction of the projector consistent with the horizontal line-of-sight direction.

[0016] Correspondingly, a virtual scene display method based on the rotation mechanism is also provided, including: S1. The camera subsystem captures the actions and head direction information of the experiencer in real time; S2. The rendering and computing subsystem calculates the horizontal line-of-sight direction of the experiencer according to the actions and head direction information captured by the camera subsystem; S3. In the projection subsystem, the rotation angle of the projector is adjusted in real time according to the calculated horizontal line-of-sight direction, so that the projection direction of the projector covers the field of view of the experiencer; S4. The rendering and computing subsystem renders the projection screen of the current perspective in real time according to the line-of-sight direction and actions of the experiencer; S5. The projection subsystem projects the projection image generated by the rendering and computing subsystem in real time.

[0017] Compared with the prior art, the present invention has the following beneficial effects: 1. Reduce hardware costs: By dynamically adjusting the projection direction of the projector through the rotating mechanism, the number of projectors required by the traditional CAVE system is reduced, thereby reducing hardware costs. The reduction in the number of projectors also reduces the complexity and maintenance costs of the system.

[0018] 2. Reduce rendering calculation pressure: Since the projection direction of the projector always covers the experiencer's field of view, the system only needs to render the image within the experiencer's current field of view, reducing the angular resolution and amount of calculation that needs to be processed. This dynamic adjustment method significantly reduces the performance requirements of the rendering device and improves the operating efficiency of the system.

[0019] 3. Enhanced immersion: By adjusting the projection direction and image content of the projector in real time, the experiencer can always see the correct virtual scene, which enhances the immersion. Compared with the traditional CAVE system, the experiencer can see his own movements, and the focus distance is farther, which reduces the feeling of dizziness and improves the user experience.

[0020] 4. Improve the flexibility of the system: The number and arrangement of projectors can be adjusted according to the size of the room to adapt to exhibition spaces of different sizes and shapes. The modular design of the system makes it easy to expand and upgrade to meet the needs of different application scenarios.

[0021] 5. Real-time interaction capability: The camera subsystem captures the user's movements and head direction information in real time, and combined with the rendering and computing subsystems, it realizes real-time interaction between the virtual scene and the user. The user can interact with the elements in the virtual scene through gestures and movements, which improves the interactivity and fun of the system.

[0022] 6. High synchronization and stability: The high-precision reading and low-latency communication of the motor rotary encoder ensures high synchronization between the virtual scene and the physical scene. Even if there is a certain delay in the motion capture algorithm, the system can still ensure the accuracy and stability of the picture through the coordination of the encoder reading and the rendering algorithm.

[0023] 7. Reduce dizziness: Compared with traditional head-mounted VR devices, the CAVE system allows users to see their own movements, and the visual focus is farther away, reducing dizziness. The design of dynamically adjusting the projection direction further optimizes the visual experience and improves comfort.

[0024] 8. Strong adaptability: The system is applicable to cylindrical rooms, but its core design concept can be extended to immersive display spaces of other shapes. The modular design of the projection subsystem and the camera subsystem enables it to flexibly adapt to different application scenarios.

[0025] 9. Power consumption reduction: Due to the reduction in the number of projectors and the amount of rendering calculations, the overall power consumption of the system is significantly reduced, meeting the requirements of energy conservation and environmental protection. This design is particularly suitable for immersive display systems that need to run for a long time. Brief Description of the Drawings

[0026] Figure 1 is a structural diagram of a virtual scene display system based on a rotating mechanism provided by Embodiment 1; Figure 2 is a schematic diagram of a virtual scene display system based on a rotating mechanism provided by Embodiment 1; Figure 3 is a structural diagram of the rotating mechanism provided by Embodiment 1; Figure 4 is a schematic diagram of the ground coverage range of the projector provided by Embodiment 1; Figure 5 is a top view of the generated image provided by Embodiment 2; Figure 6 is a side view of the generated image provided by Embodiment 2. Detailed Embodiments

[0027] The following illustrates the embodiments of the present invention through specific examples. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0028] The purpose of the present invention is to provide a virtual scene display system and method based on a rotating mechanism in view of the defects of the prior art.

[0029] Embodiment 1

[0030] This embodiment provides a virtual scene display system based on a rotating mechanism, as Figure 1 - Figure 2 shown, including: A projection subsystem 11, including a rotating mechanism and at least one projector, the projector is fixed on the rotating mechanism and is used to adjust the projection direction of the projector in real time; A camera subsystem 12, used to capture the actions and head direction information of the experiencer in real time; The rendering and computing subsystem 13, which is respectively connected to the camera subsystem 12 and the projection subsystem 11, is used to adjust the projection direction of the projector according to the captured action and head direction information, and to render the projection image in real time.

[0031] This embodiment is used in a cylindrical room 100. The inner wall of the room is painted with gray projection paint to achieve a better picture effect. The system includes a projection subsystem 11 directly above the center of the room, a camera subsystem 12 fixed above the four sides of the room, and a rendering and computing subsystem 13 located outside the room.

[0032] In the projection subsystem 11, it includes a rotating mechanism and at least one projector. The projector is fixed on the rotating mechanism, which is used to adjust the projection direction of the projector in real time and project the rendered image onto the wall and floor of the room in real time.

[0033] The rotating mechanism includes a motor 1 with an encoder, a reduction component 2, a rotating shaft 3, and a support frame 4.

[0034] The motor 1 with an encoder provides precise angle control and high-precision feedback for the rotation of the projector, significantly improving the response speed, stability, and user experience of the system. Its low-latency communication and adaptive design enable the system to be flexibly applied to various immersive display scenarios, while reducing errors and energy consumption.

[0035] The reduction component 2 can reduce the motor speed, increase the torque, and provide precise control, significantly improving the stability and accuracy of the system.

[0036] The reduction component 2 adopted in this embodiment uses belt drive to achieve speed reduction and torque increase. Its specific structural composition includes a driving wheel, a driven wheel, and a belt. The driving wheel is installed on the output shaft of the motor 1 and is usually fixed by key connection to ensure synchronous rotation with the output shaft of the motor 1; the driven wheel is sleeved on the rotating shaft 3 and is fixed by key connection to ensure synchronous rotation with the rotating shaft 3; both ends of the belt are respectively connected to the driving wheel and the driven wheel, and the power is transmitted through friction or tooth engagement. At the same time, by using driving wheels and driven wheels with different diameters, the speed reduction and torque increase are realized.

[0037] The support frame 4 can be a radial support frame. It is sleeved outside the rotating shaft 3 and is fixedly connected to the rotating shaft 3 by means of threads or the like. The radial support frame extends from the center to the periphery, forming multiple support arms. The end of each support arm is fixedly installed with a projector 5 by means of threads or the like, ensuring that the projectors 5 are distributed around the rotating shaft 3 to provide stable support.

[0038] Such as Figure 3As shown in the figure, this embodiment takes 4 projectors 5 as an example for illustration. The rotating mechanism fixes the 4 projectors 5 directly above the center of the room. The motor 1 with an encoder controls the rotation angle of the entire rotating mechanism. The rotating shaft 3 and the motor 1 are both fixed in the center of the room ceiling. The base of the motor 1 remains fixed, and the rotating shaft 3 can rotate freely. Four projectors 5 are fixed below the rotating shaft 3 through a fixed connection structure. When the motor 1 rotates, the motor 1 drives the reduction component 2 to rotate, the reduction component 2 drives the rotating shaft 3 to rotate, and the rotating shaft 3 drives the support frame 4 to rotate. As a result, the projectors 5 installed on the support frame 4 rotate around the center of the room along with the rotating shaft 3, and the projectors 5 project the virtual scene images generated by the rendering and computing subsystem 13 onto the walls and floor of the room in real time.

[0039] Through the collaborative work of multiple projectors 6, it is ensured that the images of the virtual scene can cover the field of view of the experiencer, creating an immersive experience. Two of the four projectors 5 in this embodiment are placed horizontally, mainly responsible for projecting images onto the curved wall to ensure that at least 200° of the curved wall range is covered; the other two projectors 5 are placed obliquely, mainly responsible for projecting images onto the ground to ensure that at least 3 / 4 of the ground area is covered. The ground coverage range is as Figure 4 shown. Figure 4 In the figure, blue and yellow respectively represent the images of the left projector and the right projector.

[0040] It should be noted that the number of projectors is not necessarily 4 and can be adjusted according to the size of the room. However, the principle of covering the images remains the same as above. This embodiment can cover the room with a smaller number of projectors 5, while the prior art requires at least 6 projectors to cover the room, that is, at least one projector needs to be installed on each side of the room. This embodiment can reduce the hardware cost, and the reduction in the number of projectors also reduces the system complexity and maintenance cost.

[0041] In the camera subsystem 12, it is used to capture the actions and head direction information of the experiencer in real time.

[0042] The camera subsystem 12 includes multiple physical cameras 6. This embodiment takes 4 cameras as an example for illustration, but is not limited thereto. The 4 cameras 6 are evenly distributed above the four sides of the room. The horizontal viewing angle of the cameras 6 is not less than 90°. The cameras 6 are arranged obliquely downward, facing the center position of the room, so as to be able to capture the whole body of a person standing in the center of the room.

[0043] Four cameras 6 capture the actions and head direction information of the experiencer in real time through a multi-camera motion capture algorithm (such as a skeleton tracking algorithm), including the coordinates of both eyes (3D positions of the left and right eyes), the coordinates and angles of the hand and foot joints, etc. The cameras 6 transmit the captured data information to the rendering and computing subsystem 13. This information is used on the one hand to adjust the rotation angle of the projection subsystem 11 in real time, and on the other hand can be used for the experiencer to interact with the elements in the virtual scene through gestures and actions.

[0044] It should be noted that the cameras 6 can be commercial motion capture cameras, which have supporting algorithms and optimization strategies (including but not limited to using the method of infrared light source + filter to exclude the influence of visible light in the scene). The selection of the cameras 6 can be determined according to the actual situation, and this embodiment does not make too many limitations.

[0045] In the rendering and computing subsystem 13, it is respectively connected to the camera subsystem 12 and the projection subsystem 11, and is used to adjust the projection direction of the projector according to the captured action and head direction information, and render the projection screen in real time.

[0046] The rendering and computing subsystem 13 includes a processing unit and a rendering unit.

[0047] The processing unit is used to process the action and head direction information captured by the camera subsystem; The processing unit receives the data corresponding to the action and head direction information captured by the cameras 6, processes the received data, calculates the head direction of the experiencer, and controls the rotation angle of the projector 5 in the projection subsystem 11. Specifically: When the system is running, the experiencer is at the center position of the room and is allowed to move freely within a small range. The room coordinate system is located at the center of the room floor. Multiple cameras 6 obtain the action and head direction information of the experiencer. The processing unit calculates the coordinates of the experiencer's both eyes in the room, denoted as p l and p r , which respectively represent the 3D coordinates of the left and right eyes, and extract the horizontal coordinate components (x l , y l ), (x r , y r ), calculate the perpendicular direction of the line connecting the two, determine the direction of the experiencer's horizontal line of sight; then according to the horizontal line of sight direction, calculate the angle that the projector 5 needs to rotate, and transmit this angle information to the motor 1 of the rotation mechanism.

[0048] Since the speed at which the motor 1 drives the projector 5 to rotate is slower than the speed at which the human head rotates, and there is a delay in the motion capture system, in order to ensure the correctness of the image, the processing module in this embodiment converts the reading of the motor 1 rotary encoder into the current projection direction of the projection subsystem 11. The motor 1 feeds back the current rotation angle in real time through the encoder, and the processing module transmits the calculation result of the sight direction to the motor 1. The motor 1 adjusts the rotation angle according to the instruction, and the projector 5 rotates around the center of the room following the rotation axis 3 to ensure that the projection image always covers the field of view of the experiencer, so that the output image is consistent with the current projection direction of the projection subsystem 11. From the experiencer's point of view, the relationship between the elements in the virtual scene and the room wall has not changed. Since the motor 1 encoder has a high precision and the communication delay with the rendering and computing subsystem 13 is extremely low, the above-mentioned real-time image adjustment function can ensure a high degree of synchronization between the virtual scene and the physical scene; and then dynamically adjust the projection direction of the projector 5 according to the instructions of the processing module.

[0049] The rendering unit is used to render the projection image in real time according to the processing result.

[0050] In this embodiment, the image of the virtual scene is captured by a virtual camera, and Unity or UE or DirectX etc. can be used to render the virtual scene to generate a projection image matching the physical scene, specifically: The virtual camera adjusts its image-taking direction according to the current angle of the rotating mechanism (provided by the motor encoder). The virtual camera captures the virtual scene and generates a picture that matches the walls and floor of the physical room. The image of the virtual camera is cropped, deformed, and fused to meet the output requirements of the physical projector.

[0051] When the image data from the virtual camera is received, the image of the virtual camera is processed using deformation, splicing and fusion algorithms to ensure that the output picture matches the geometric shape of the physical room, and the processed image is transmitted to the projector 5 in the projection subsystem 11. The projector 5 adjusts the projection direction according to the rotation angle of the rotating mechanism. The projector 5 receives the image output by the rendering module and projects it onto the wall and floor of the room; the layout and number of the projectors 5 are adjusted according to the size of the room and the coverage.

[0052] A novel CAVE system based on a rotating mechanism provided in this embodiment fixes the projectors that project onto the wall on a rotating mechanism driven by a motor. By capturing the facing direction of the experiencer's head, the angle of the rotating mechanism is adjusted in real time, and at the same time, the projected image is adjusted so that the projected image can always cover the field of view of the experiencer, and the image seen by the experiencer always maintains projective correctness. Using this novel system can reduce the angular resolution of the images that need to be rendered, thereby reducing the computational pressure on the rendering system, and to a certain extent, can reduce the number of projectors required and lower the system cost.

[0053] Embodiment 2

[0054] The difference between the virtual scene display system based on a rotating mechanism provided in this embodiment and Embodiment 1 lies in: This embodiment uses 3 virtual cameras to capture and render virtual scenes. The specific settings are as follows: 1. Two horizontal virtual cameras: These two virtual cameras are responsible for capturing images of the curved wall in the virtual scene. Their viewing angles and resolutions match the size of the curved wall in the physical room, ensuring that at least 200° of the curved wall range is covered.

[0055] One vertically downward virtual camera: This virtual camera is responsible for capturing images of the ground in the virtual scene. Its viewing angle and resolution match the size of the ground in the physical room, ensuring that at least 3 / 4 of the ground area is covered.

[0056] 2. Image processing flow of the virtual camera: The images generated by the virtual camera need to go through a series of processes to ensure that the final images projected onto the walls and the ground of the physical room are correct. The specific process is as follows: Cropping: The images generated by the virtual camera may contain parts that exceed the range of the physical room. To ensure that the projected images only cover the walls and the ground of the physical room, the system crops the images generated by the virtual camera and removes the parts that exceed the range of the physical room.

[0057] Deformation: Since the wall of the physical room is curved while the images generated by the virtual camera are planar, the images need to be deformed so that they can be correctly mapped onto the curved wall.

[0058] Fusion: To ensure seamless stitching of the images projected by multiple projectors at the boundaries, the system performs a fusion process on the cropped and deformed images to eliminate ghosting or inconsistencies at the boundaries.

[0059] 3. The processed images are finally output to physical projectors: Horizontal projectors: Two horizontal projectors are responsible for projecting the cropped and deformed images of the horizontal virtual camera onto the curved wall.

[0060] Oblique projectors: Two oblique projectors are responsible for projecting the cropped and distorted vertically downward virtual camera images onto the ground.

[0061] 4. As Figure 5 shown in the top view of the generated image, and as Figure 6 shown in the side view of the generated image.

[0062] Figure 5 The green square in [[ ]] is the vertically downward virtual camera in the virtual scene, and the image (dashed box) it generates exactly covers the size of the physical room floor. During the debugging phase, the system will crop and distort this image, filling the part outside the physical room range (circle) with black to obtain the final image output to the oblique projectors.

[0063] Figure 6 The green square in [[ ]] is the horizontal virtual camera in the virtual scene, and the image it generates is cropped and distorted and then output to the horizontal projector to ensure that it covers the range of the arc-shaped wall.

[0064] 5. System integration and real-time adjustment: System integration: The projection subsystem, camera subsystem, rendering and computing subsystem work together to form a complete immersive virtual scene display system.

[0065] Real-time adjustment: The multi-camera motion capture system is used to capture the head direction and actions of the experiencer in real time, and the rotation angle and projection screen of the dynamic projector are adjusted to ensure that the experiencer always sees the correct virtual scene.

[0066] Through the above design, this system can provide a high-quality immersive virtual scene experience while reducing the rendering calculation pressure and the number of projectors.

[0067] Embodiment 3

[0068] This embodiment provides a virtual scene display method based on a rotating mechanism, including: S1. The camera subsystem captures the actions and head direction information of the experiencer in real time; S2. The rendering and computing subsystem calculates the horizontal line-of-sight direction of the experiencer according to the actions and head direction information captured by the camera subsystem; S3. In the projection subsystem, the rotation angle of the projector is adjusted in real time according to the calculated horizontal line-of-sight direction, so that the projection direction of the projector covers the field of view range of the experiencer; S4. The rendering and computing subsystem renders the projection screen of the current perspective in real time according to the line-of-sight direction and actions of the experiencer; S5. The projection subsystem projects the projection screen generated by the rendering and computing subsystem in real time.

[0069] It should be noted that a virtual scene display method based on a rotating mechanism provided in this embodiment is similar to that in Embodiment 1, and will not be elaborated here.

[0070] Note that the above are only the preferred embodiments of the present invention and the technical principles applied. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, re-adjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments. Without departing from the concept of the present invention, more other equivalent embodiments can be included, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A virtual scene display system based on a rotating mechanism, characterized in that: include: A projection subsystem, comprising a rotating mechanism and at least one projector, wherein the projector is fixed to the rotating mechanism and is used to adjust the projection direction of the projector in real time; The camera subsystem is used to capture the user's movements and head orientation information in real time; The rendering and computing subsystems are connected to the camera subsystem and the projection subsystem respectively, and are used to adjust the projection direction of the projector according to the captured motion and head direction information, and render the projection picture in real time.

2. A virtual scene display system based on a rotating mechanism according to claim 1, characterized in that: The rotating mechanism includes a motor with an encoder, a reduction assembly, a rotating shaft, and a supporting frame; The reduction assembly is connected to the motor and the rotating shaft respectively, the support frame is sleeved on the rotating shaft, and the projector is installed on the support frame, so that the motor drives the reduction assembly to rotate, and then the reduction assembly drives the rotating shaft, the support frame, and the projector to rotate.

3. The virtual scene display system based on a rotating mechanism according to claim 1, characterized in that: The projection coverage of the projector is at least 200° of the wall and at least 3 / 4 of the ground area.

4. The virtual scene display system based on a rotating mechanism according to claim 1, characterized in that: The camera subsystem includes multiple cameras, which are distributed above the four sides of the room. The multiple cameras capture the movement and head direction information of the experiencer in real time.

5. The virtual scene display system based on the rotating mechanism according to claim 4 is characterized in that: The rendering and computing subsystem includes: a processing unit for processing motion and head orientation information captured by the camera subsystem; The rendering unit is used to render the projection image in real time according to the processing result.

6. The virtual scene display system based on the rotating mechanism according to claim 5, characterized in that: The processing unit also includes converting the encoder reading of the motor into a projection direction.

7. The virtual scene display system based on a rotating mechanism according to claim 5, characterized in that: The rendering unit also includes using a virtual camera to capture an image of the virtual scene to generate a projection picture.

8. The virtual scene display system based on a rotating mechanism according to claim 2, characterized in that: The projection direction of the projector is adjusted in real time by a motor according to the head direction information of the experiencer.

9. The virtual scene display system based on the rotating mechanism according to claim 8, characterized in that: The real-time adjustment according to the head direction information of the experiencer is specifically as follows: capturing the coordinates of the experiencer's eyes, calculating the direction of the vertical line connecting the eyes, determining the horizontal line of sight, and controlling the motor to rotate so that the projection direction of the projector is consistent with the horizontal line of sight.

10. A display method of a virtual scene display system based on a rotating mechanism according to any one of claims 1 to 9, characterized in that: include: S1. The camera subsystem captures the user's movements and head direction information in real time; S2. The rendering and computing subsystem calculates the user's horizontal sight direction based on the motion and head direction information captured by the camera subsystem; S3. The projection subsystem adjusts the rotation angle of the projector in real time according to the calculated horizontal line of sight direction, so that the projection direction of the projector covers the field of vision of the experiencer; S4. The rendering and computing subsystem renders the projection image of the current perspective in real time according to the viewer's sight direction and movement; S5. The projection subsystem projects the projection image generated by the rendering and computing subsystem in real time.

Images