A naked eye 3D immersive experience device

Abstract

The present invention provides a naked-eye 3D immersive experience device, which includes: a naked-eye 3D playback module for acquiring a naked-eye 3D picture; the naked-eye 3D picture is a pre-created video file or a video file acquired in real time by an image acquisition device; a naked-eye 3D display terminal connected to the naked-eye 3D playback module; the 3D display terminal includes a plurality of naked-eye 3D display components arranged in a surround manner, and the plurality of naked-eye 3D display components are controlled by the naked-eye 3D playback module to collaboratively display the naked-eye 3D picture. The naked-eye 3D immersive experience device of the present invention can replace traditional equipment such as VR helmets to create a surround naked-eye 3D immersive experience scene.

Description

Technical Field

[0001] The present invention relates to the field of naked-eye 3D technology, and in particular to a naked-eye 3D immersive experience device. Background Art

[0002] Virtual reality technology is an important direction of simulation technology. It is also a cross-cutting technology frontier discipline and research field that integrates simulation technology with computer graphics, human-computer interface technology, multimedia technology, sensor technology, network technology and other technologies. Virtual reality technology mainly includes simulated environment, perception, natural skills and sensor equipment. At present, users can perceive 3D environment through VR headsets, but VR headsets are bulky as a whole, which will cause discomfort to users during wearing, thus affecting the user experience. Summary of the invention

[0003] In view of the above problems, the present invention is proposed to provide a naked-eye 3D immersive experience device that overcomes the above problems or at least partially solves the above problems.

[0004] The present invention provides a naked-eye 3D immersive experience device, comprising:

[0005] A naked-eye 3D playback module is used to obtain a naked-eye 3D picture; the naked-eye 3D picture is a pre-created video file or a video file acquired in real time by an image acquisition device;

[0006] The naked-eye 3D display terminal is connected to the naked-eye 3D playback module; the 3D display terminal includes a plurality of naked-eye 3D display components arranged in a surrounding manner, and the plurality of naked-eye 3D display components are controlled by the naked-eye 3D playback module to collaboratively display the naked-eye 3D images.

[0007] Optionally, an eye tracking module is also included;

[0008] The eye tracking module is connected to the naked-eye 3D playback module, and is used to collect eye position information of a user of the naked-eye 3D immersive experience device in real time, and transmit the eye position information to the naked-eye 3D playback module;

[0009] The naked-eye 3D playback module is also used to adjust the naked-eye 3D picture displayed in real time by the naked-eye 3D display terminal according to the eye position information collected by the eye tracking module, so that the naked-eye 3D picture adapts to the eye position of the user.

[0010] Optionally, the plurality of naked-eye 3D display components are distributed in the horizontal direction and the vertical direction;

[0011] The naked-eye 3D display terminal forms a horizontal viewing angle of not less than 80° in the horizontal direction and a vertical viewing angle of not less than 20° in the vertical direction.

[0012] Optionally, the naked-eye 3D display terminal includes at least two naked-eye 3D display components arranged in a horizontal direction, and at least one naked-eye 3D display component arranged in a vertical direction.

[0013] Optionally, the eye tracking module is arranged within a range where the horizontal field of view angle of the naked-eye 3D display terminal is not less than 20°.

[0014] Optionally, the naked-eye 3D immersive experience device further includes a gesture tracking module;

[0015] The gesture tracking module is used to collect the hand position information and / or motion information of the user in real time;

[0016] The naked-eye 3D playback module is also used to adjust the naked-eye 3D image in real time according to the hand position information and / or action information collected by the gesture tracking module.

[0017] Optionally, the gesture tracking module is used to detect hand position information of the user's hand corresponding to the deployment space of the naked-eye 3D immersive experience device; track gesture action information of the user's hand in the deployment space according to the hand position information, and transmit the gesture action information to the naked-eye 3D playback module;

[0018] The naked-eye 3D playback module is further configured to adjust at least a portion of the naked-eye 3D image according to the gesture action information.

[0019] Optionally, the naked-eye 3D display terminal is further used to be controlled by the naked-eye 3D playback module to display a virtual controller, and detect gesture action information generated by the user's hand based on the virtual controller.

[0020] Optionally, the tracking module is connected to the naked-eye 3D display terminal via a USB interface, a Type-c interface and / or an HDMI interface.

[0021] Optionally, it is characterized in that the naked-eye 3D display terminal includes an LCD screen, an OLED screen, a LED screen, a micro LED screen, a mini LED screen or a projection display screen.

[0022] This embodiment provides a naked-eye 3D immersive experience device that creates a surround naked-eye 3D immersive experience scene by arranging multiple naked-eye 3D display components around a user object, thereby replacing traditional VR helmets and other equipment. When users experience naked-eye 3D images, there is no need to wear bulky helmets, which also solves the comfort problem caused by VR helmets.

[0023] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below.

[0024] Based on the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings, those skilled in the art will become more aware of the above and other objects, advantages and features of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0026] Figure 1 A schematic diagram of the structure of a naked-eye 3D immersive experience device according to an embodiment of the present invention is shown;

[0027] Figure 2 A schematic diagram of a multi-sided display terminal according to an embodiment of the present invention is shown;

[0028] Figure 3 A schematic diagram of a multi-sided display terminal according to another embodiment of the present invention is shown;

[0029] Figure 4 A schematic diagram of a ring-shaped display terminal according to an embodiment of the present invention is shown;

[0030] Figure 5 A schematic diagram of a spherical display terminal according to an embodiment of the present invention is shown;

[0031] Figure 6 A schematic diagram of an optimal viewing position according to an embodiment of the present invention is shown;

[0032] Figures 7A-7B A schematic diagram of a left-eye image and a right-eye image according to an embodiment of the present invention is shown;

[0033] Among them, 10 is a naked eye 3D playback module, 20 is a naked eye 3D display terminal, 21 is a naked eye 3D display component, 30 is an eye tracking module, and 40 is a gesture tracking module. DETAILED DESCRIPTION

[0034] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0035] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0036] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0037] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0038] The embodiment of the present invention provides a naked eye 3D immersive experience device, see Figure 1It can be seen that the naked eye 3D immersive experience device of this embodiment may include: a naked eye 3D playback module 10 and a naked eye 3D display terminal 20 connected to the naked eye 3D playback module 10. Among them, the naked eye 3D playback module 10 is used to obtain a naked eye 3D picture. The naked eye 3D playback module 10 is actually equivalent to the main processor of the naked eye 3D immersive experience device. The naked eye 3D playback module 10 realizes the playback control of the naked eye 3D picture and the processing of the naked eye 3D picture.

[0039] The naked-eye 3D picture acquired by the naked-eye 3D playback module 10 is a pre-created video file or a video file acquired in real time by an image acquisition device. Among them, the pre-created video file can be a video file obtained by pre-recording or editing, and the video file can be pre-stored in the naked-eye 3D playback module 10, and the naked-eye 3D playback module 10 can directly obtain it for playback. Alternatively, the video file can be stored in a cloud server, and the naked-eye 3D playback module 10 can be connected to the cloud server via a communication module to obtain the video file to be played from the cloud server. Among them, the communication module can be a component of the naked-eye 3D immersive experience device, and the naked-eye 3D immersive experience device can use the communication component to establish a communication connection with the cloud server or other smart devices, and the connection method can include: Bluetooth, WiFi, 4G, 5G and other methods.

[0040] In addition to the above, the naked-eye 3D picture obtained by the naked-eye 3D playback module 10 can also be a video file collected in real time by an image acquisition device, such as a video stream file collected in real time by other devices when communicating with other devices, or a video stream file collected in real time by a camera.

[0041] The 3D display terminal of this embodiment is a display terminal including an LCD screen, an OLED screen, a LED screen, a micro LED screen, a miniLed screen or a projection display. Optionally, the 3D display terminal can be a multilateral display terminal, a multilateral display terminal, a ring-shaped display terminal, or a spherical display terminal.

[0042] The 3D display terminal may include a plurality of naked-eye 3D display components 21 arranged in a surrounding manner, and the plurality of naked-eye 3D display components 21 are controlled by the naked-eye 3D playback module 10 to collaboratively display the naked-eye 3D picture. A plurality of naked-eye 3D display components form a polygonal display terminal, a ring-shaped display terminal or a spherical display terminal. Among them, each naked-eye 3D display component 21 uses a cylindrical grating, a dot grating, and a slit grating to realize the display of the naked-eye 3D picture, or uses holographic technology to realize the display of the naked-eye 3D picture. This embodiment provides a naked-eye 3D immersive experience device by setting a plurality of naked-eye 3D display components 21 around the user object to create a surround naked-eye 3D immersive experience scene, replacing traditional VR helmets and other equipment. When the user experiences the naked-eye 3D picture, there is no need to wear a bulky helmet, which also solves the comfort problem brought by the VR helmet.

[0043] In this embodiment, the plurality of naked-eye 3D display components 21 are distributed in the horizontal direction and the vertical direction, and the naked-eye 3D display terminal 20 forms a horizontal field of view of not less than 80° in the horizontal direction and a vertical field of view of not less than 20° in the vertical direction. Optionally, the naked-eye 3D display terminal 20 includes at least two naked-eye 3D display components 21 arranged in the horizontal direction, and at least one naked-eye 3D display component 21 arranged in the vertical direction.

[0044] As described above, the naked-eye 3D display terminal 20 can be a multilateral display terminal, a ring display terminal or a spherical display terminal. Among them, the multilateral display terminal, that is, the multiple naked-eye 3D display components 21 in the naked-eye 3D display terminal 20, constitute a plurality of spliced ​​display areas as a whole, and the multiple naked-eye 3D display components 21 can be provided with fixing parts (such as buckles), and each naked-eye 3D display component 21 can be fixedly connected by the buckle. Alternatively, the naked-eye 3D immersive experience device can also be provided with an integrated bracket, and each naked-eye 3D display component 21 can be installed on the integrated bracket to form the naked-eye 3D display terminal 20.

[0045] Figure 1 The naked-eye 3D display terminal 20 in the form of a multi-sided display terminal is shown. The naked-eye 3D display terminal 20 of this embodiment may include six naked-eye 3D display components 21, wherein three naked-eye 3D display components 21 are arranged in the horizontal direction and two naked-eye 3D display components 21 are arranged in the vertical direction. Figure 1In the figure, angle α is the horizontal field of view angle, angle β is the vertical field of view angle, angle α is greater than or equal to 80°, and angle β is greater than or equal to 20°. The naked eye 3D display terminal 20 includes a driving system board for driving each naked eye 3D display component 21 to work, and the naked eye 3D playback module 10 can be installed on the driving system board. The driving system board is installed on any 3D naked eye display component and connected to each naked eye 3D display component.

[0046] Figure 2-3 A schematic diagram of a naked-eye 3D display terminal 20 according to an embodiment is shown. Figure 2 In the naked-eye 3D display terminal 20 shown, the angle between the two naked-eye 3D display components 21 is γ. The normal lines L1 and L2 of the screen centers of the two naked-eye 3D display components 21 converge at a point O. Point O can also be the center of a circle formed by connecting the edge intersections of the naked-eye 3D display components 21 in sequence. The object can get the best immersive experience and naked-eye 3D effect experience by watching 3D content at the center of the circle. The radius of the circle is determined based on the optimal viewing distance of the naked-eye 3D display of the component, and the relationship between the two is: optimal viewing distance / radius = sin(angle between adjacent components / 2). That is, Figures 2-3 The point O in the figure is the best viewing position, and the distance H between the point O and the screen center of each naked-eye 3D display component 21 is the best viewing distance. Figure 2 The distance A in is the length of any naked-eye 3D display assembly 21. The optimal viewing position can be determined by satisfying the relationship between the adjacent angle γ, the length A of the multi-sided display terminal, and the optimal viewing distance H: tanγ=2H / A.

[0047] Figure 4 The naked-eye 3D display terminal 20 in the form of a ring display terminal is shown. Figure 4 In the naked-eye 3D display terminal 20 shown in FIG. 1 , each naked-eye 3D display component 21 forms a curved display area. Figure 5 It shows that in the naked-eye 3D display terminal 20 in the form of a spherical display terminal, each naked-eye 3D display component 21 can form a spherical display area. The naked-eye 3D display terminal 20 of the annular display terminal and the naked-eye 3D display terminal 20 of the spherical display terminal also have a center of a circle or a center of a sphere, and the corresponding radius or spherical diameter length is equal to the naked-eye 3D optimal viewing distance of the naked-eye 3D display terminal 20. The 3D optimal viewing distance is related to the immersive feeling and the horizontal field of view. The optimal viewing distance is controlled at 1 to 5 meters, preferably 2 to 3 meters, while satisfying the horizontal field of view of not less than 80 degrees in the horizontal direction and the vertical field of view of not less than 20 degrees in the vertical direction. The annular display terminal and the spherical display terminal are also spliced ​​by a plurality of small curved display terminals. A plurality of small modules are spliced ​​according to the selected viewing distance to meet the field of view requirements.

[0048] In practical applications, combined with Figure 6 Regardless of the Figure 1 to Figure 5 For any one of the naked-eye 3D display terminals 20 , the horizontal field angle α of the naked-eye 3D immersive experience device is greater than or equal to 80°, and the optimal viewing distance H can be set using the above description.

[0049] In this embodiment, if Figure 1 to Figure 5 The naked-eye 3D immersive experience device may further include an eye tracking module 30, which is connected to the naked-eye 3D playback module 10 and is used to collect eye position information of the user of the naked-eye 3D immersive experience device in real time, and transmit the eye position to the naked-eye 3D playback module 10. The naked-eye 3D playback module 10 is also used to adjust the naked-eye 3D picture displayed in real time by the naked-eye 3D display terminal 20 according to the eye position information collected by the eye tracking module 30, so that the naked-eye 3D picture adapts to the eye position of the user.

[0050] Optionally, the eye tracking module 30 is arranged within a range of not less than 20° of the horizontal field of view of the naked eye 3D display terminal 20. In this embodiment, the eye tracking module 30 is arranged within a range of not less than 20° of the horizontal field of view to track the eye position information and viewing direction of the user in real time, and feed the position information back to the display terminal playback system, so as to adjust the naked eye 3D display content in time.

[0051] The tracking module is connected to the naked-eye 3D display terminal 20 via a USB interface, a Type-c interface and / or an HDMI interface. The eye tracking module 30 can be an infrared sensing device or an image acquisition device. Correspondingly, the naked-eye 3D playback module 10 can be installed on the driving system board in the naked-eye 3D display terminal 20, and the driver corresponding to the eye tracking module 30 is docked on the naked-eye 3D playback module 10. The naked-eye 3D playback module 10 is integrated with a core naked-eye 3D interlacing algorithm package, which judges and displays the corresponding naked-eye 3D picture in real time based on the eye position information fed back by the eye tracking module, and then uses the naked-eye 3D interlacing algorithm package to adjust the naked-eye 3D picture.

[0052] In this embodiment, the naked eye 3D interlacing algorithm toolkit may be a naked eye 3D interlacing algorithm SDK toolkit, which may be integrated in a controller of the naked eye 3D display 10. The naked eye 3D interlacing algorithm SDK toolkit may interlace a video content in a left-right format or a top-bottom format into a matching naked eye 3D image in real time based on the 3D design scheme of the naked eye 3D display 10, so that the naked eye 3D interlaced image adapts to the eye positions of the user. When a person's eyes look in different directions, there will be slight changes in the eyes, and these changes will produce extractable features. The eye tracking module 30 in this embodiment may extract these features by image capture or scanning, thereby tracking the changes in the eyes in real time. The eye tracking module 30 in this embodiment may be an infrared device or an image acquisition device.

[0053] like Figures 7A-7B As shown, the naked eye 3D interlacing algorithm is based on the pixel points in the display module to display the left eye image L and the right eye image R respectively. When the eye tracking module 30 confirms the eye position information of the user, such as Figure 5 As shown, the interlaced algorithm processes the pixel display Figures 7A-7B The left eye image L and the left eye image R are projected by the naked eye 3D display terminal 20. At this time, the left and right eye images projected by the naked eye 3D display terminal 20 are consistent with the position of the human eye, and the user can experience the correct 3D image. When the eye tracking module 30 confirms the eye position information of the user, Figure 7B As shown, the position of the left and right eyes of the object changes, and the interlacing algorithm processes the pixel display image synchronously. Figure 7B The content shown is then projected to the left and right eyes of the user through the naked-eye 3D display terminal 20, and the user experiences the correct 3D image again.

[0054] In this embodiment, continue to see Figure 1 to Figure 5, the naked eye 3D playback module 10 can make the content displayed in front have a better stereoscopic effect according to the position corresponding to the eyeball of the user. In practical applications, the quality of the stereoscopic effect is reflected in parameters such as clarity and depth of field. When the naked eye 3D playback module 10 adjusts the naked eye 3D picture, it can be done through the following two points: the first point is the starting stage, the naked eye 3D playback module 10 is based on the initial eyeball viewing position, that is, the central key image area of ​​the full-frame image is displayed in front, and this image has the best depth of field, stereoscopic sense and clarity; the second point is to adjust the clarity of the surrounding images appropriately, and make real-time adjustments according to each naked eye 3D display component 21, or make real-time adjustments to each display unit (such as each pixel block or a pixel group formed by a combination of multiple pixel blocks) in each naked eye 3D display component 21. Then, as the field of view angle gradually increases, the stereoscopic effect gradually decreases, matching the human eye's correct recognition and sensitivity to images within a smaller field of view angle, thereby enhancing the user's sense of immersion and visual presence. At the same time, by reducing the optimal 3D content playback, the data processing of the naked-eye 3D playback system is reduced, thereby improving the playback smoothness.

[0055] In actual applications, the naked-eye 3D playback module 10 can not only control the naked-eye 3D display terminal 20 to play full-screen naked-eye 3D content, but also play 2D plane display content to achieve compatibility between 2D and 3D displays. The played 3D content or 2D content can be a whole picture, can be separate pictures, can be a picture-in-picture, etc., and the embodiments of the present invention are not limited to this.

[0056] The naked-eye 3D immersive experience device of this embodiment may further include a gesture tracking module 40; the gesture tracking module 40 is used to collect hand position information and / or motion information of the user in real time; the naked-eye 3D playback module 10 is also used to adjust the naked-eye 3D image in real time according to the hand position information and / or motion information collected by the gesture tracking module 40.

[0057] The driver program corresponding to the gesture tracking module 40 can also be connected to the naked-eye 3D playback module 10. The naked-eye 3D playback module 10 is equipped with a core naked-eye 3D interlacing algorithm package. Based on the eye position information fed back by the eye tracking module 30, the corresponding naked-eye 3D picture is judged and displayed in real time. Based on the hand position information and movement information fed back by the gesture tracking module 40, the corresponding display content is judged and adjusted in real time. For example, when the gesture slides from left to right, the display content is adjusted from left to right, etc.

[0058] In this embodiment, the gesture tracking module 40 is used to detect the hand position information of the user's hand corresponding to the deployment space of the naked-eye 3D immersive experience device; track the gesture action information of the user's hand in the deployment space according to the hand position information, and transmit the gesture action information to the naked-eye 3D playback module 10. The naked-eye 3D playback module 10 is also used to adjust at least a part of the naked-eye 3D picture according to the gesture action information.

[0059] That is, the gesture tracking module 40 can collect the hand position information and gesture action information of the user, which can specifically include:

[0060] S1, capturing continuous image frame information corresponding to the hand of the subject;

[0061] S2, gesture detection and segmentation as well as gesture analysis are performed based on continuous image frame information; gesture segmentation methods mainly include gesture segmentation based on monocular vision and gesture segmentation based on stereo vision. When analyzing gestures, the shape features or motion trajectories of gestures can be obtained. The main methods of gesture analysis are as follows: edge contour extraction method, centroid finger and other multi-feature combination method, and finger joint tracking method.

[0062] S3, after static gesture recognition is performed according to the gesture analysis structure, dynamic gesture recognition is performed. Gesture recognition is the process of classifying the trajectory (or point) in the model parameter space into a subset in the space, which includes static gesture recognition and dynamic gesture recognition. Dynamic gesture recognition can eventually be converted into static gesture recognition. From the perspective of the technical implementation of gesture recognition, common gesture recognition methods mainly include: template matching method, neural network method and hidden Markov model method.

[0063] For example, the gesture tracking module 40 can first capture the hand position information of the user, which is the initial point, and then capture the corresponding action information, including but not limited to reaching forward, retracting, left, right, grabbing, up, down, etc., and feed the action information back to the naked-eye 3D playback module 10. The naked-eye 3D playback module 10 adjusts the naked-eye 3D display content in real time based on the information, and realizes corresponding adjustments to the whole or part of the image, thereby realizing the interaction between the content and the user.

[0064] Optionally, the naked-eye 3D display terminal 20 is also used to be controlled by the naked-eye 3D playback module 10 to display a virtual controller, and detect the gesture information generated by the user's hand based on the virtual controller. For example, the naked-eye 3D image displays a sphere in front of the user, suspended in the air, and the hand can use the sphere to perform corresponding changes such as front, back, left, right, and zoom in and out.

[0065] The eye tracking module 30 and the gesture tracking module 40 of this embodiment can be installed in a hidden layout. The hardware parts of the eye tracking module and the gesture tracking module 40 are mainly camera modules. The hidden layout can be realized through the under-screen camera technology so that it does not interfere with the displayed content. In this embodiment, by setting the eye tracking module 30 in the naked-eye 3D immersive experience device, the naked-eye 3D picture played by the naked-eye 3D display terminal 20 can be adaptively adjusted in real time according to the position of the user, so that the picture seen by the user has a three-dimensional sense and immersive sense. By setting the gesture tracking module 40, the interaction between the user and the naked-eye 3D immersive experience device can be realized, the user's sense of participation can be increased, and the user's experience can be effectively improved.

[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that within the spirit and principles of the present invention, the technical solutions described in the aforementioned embodiments can still be modified, or some or all of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate from the protection scope of the present invention.

Claims

1. A naked-eye 3D immersive experience device, characterized in that: include: A naked-eye 3D playback module is used to obtain a naked-eye 3D picture; the naked-eye 3D picture is a pre-created video file or a video file acquired in real time by an image acquisition device; A naked-eye 3D display terminal is connected to the naked-eye 3D playback module; the 3D display terminal includes a plurality of naked-eye 3D display components arranged in a surrounding manner, and the plurality of naked-eye 3D display components are controlled by the naked-eye 3D playback module to collaboratively display the naked-eye 3D picture; An eye tracking module, connected to the naked-eye 3D playback module, for collecting eye position information of a user of the naked-eye 3D immersive experience device in real time, and transmitting the eye position information to the naked-eye 3D playback module; A gesture tracking module, used for collecting hand position information and / or motion information of the user in real time; The naked-eye 3D playback module is further used to adjust the naked-eye 3D picture displayed in real time by the naked-eye 3D display terminal according to the eye position information collected by the eye tracking module, so that the naked-eye 3D picture adapts to the eye position of the user; The naked-eye 3D playback module is further used to adjust the naked-eye 3D picture in real time according to the hand position information and / or action information collected by the gesture tracking module; The plurality of naked-eye 3D display components are distributed in the horizontal direction and the vertical direction; the naked-eye 3D display terminal forms a horizontal viewing angle of not less than 80° in the horizontal direction and a vertical viewing angle of not less than 20° in the vertical direction; The eye tracking module is arranged within a range where the horizontal field of view of the naked eye 3D display terminal is not less than 20°; the naked eye 3D playback module adjusts the naked eye 3D picture including: the naked eye 3D playback module displays the central key image area of ​​the full-frame image directly in front based on the initial eye viewing position; Then, each naked-eye 3D display component is adjusted in real time, or each display unit in each naked-eye 3D display component is adjusted in real time; The gesture tracking module is used to detect the hand position information of the user's hand in the deployment space of the naked-eye 3D immersive experience device; track the gesture action information of the user's hand in the deployment space according to the hand position information, and transmit the gesture action information to the naked-eye 3D playback module; the naked-eye 3D playback module is also used to adjust at least a part of the naked-eye 3D picture according to the gesture action information; The naked-eye 3D display terminal is also used to be controlled by the naked-eye 3D playback module to display a virtual controller, and detect gesture information generated by the user's hand based on the virtual controller; the naked-eye 3D display terminal includes at least two naked-eye 3D display components arranged in a horizontal direction, and at least one naked-eye 3D display component arranged in a vertical direction; The naked-eye 3D playback module makes the content displayed in front have a better stereoscopic effect according to the position corresponding to the eyeball of the user through the following two points. When the naked-eye 3D playback module adjusts the naked-eye 3D picture, the first point is that the naked-eye 3D playback module displays the central key image area of ​​the full-frame image in front based on the initial eyeball viewing position. This image has the best depth of field, stereoscopic sense and clarity; the second point is to reduce the clarity of the surrounding images, and make real-time adjustments to each display unit in each naked-eye 3D display component. As the field of view angle gradually increases, the stereoscopic effect gradually decreases, matching the correct recognition and sensitivity of the human eye to the image within a smaller field of view angle.

2. The naked eye 3D immersive experience device according to claim 1, characterized in that: The tracking module is connected to the naked-eye 3D display terminal via a USB interface, a Type-c interface and / or an HDMI interface.

3. The naked eye 3D immersive experience device according to any one of claims 1-2, characterized in that: The naked-eye 3D display terminal includes an LCD screen, an OLED screen, a LED screen, a micro LED screen, a mini LED screen or a projection display screen.

Images