Display system and vehicle

Abstract

The invention discloses a display system and a vehicle. The display system comprises a display assembly and a light control assembly. The display assembly is used for displaying multi-view image information of a target object. The light control assembly is used for transmitting light corresponding to the image information of each visual angle of the display assembly to different preset visual areas, and the visual angles are in one-to-one correspondence with the preset visual areas. Therefore, the display system can form images of different visual angles in the air so as to form a suspended three-dimensional image corresponding to the target object in the air. Meanwhile, the visual angle corresponding to the image formed in each preset visual area is the same as the visual angle when the real target object is seen in the preset visual area, so that the image effect seen when the target object image is seen in each visual angle is the same as the image effect seen when the real target object is seen in the visual angle; therefore, it is ensured that the image suspended in the air has real 3D information, the display effect of the target object image is good, and then it is ensured that a user can obtain more real man-machine visual interaction experience.

Description

Technical Field

[0001] The present application relates to the field of three-dimensional display technology, and more specifically, to a display system and a vehicle. Background Art

[0002] With the rise of intelligent driving, the smart cockpit has become a key focus for automakers in creating a differentiated automotive experience amidst fierce market competition. As a key manifestation of cockpit intelligence, the smart cockpit can provide users with a deeply personalized and enhanced experience. However, most smart cockpit systems currently offer only basic voice interaction capabilities. Humans receive 70% of their information through vision, making visual perception essential in our daily lives. Therefore, improving the display quality of smart cockpit systems to ensure a more realistic and immersive human-machine visual interaction experience has become a pressing issue. Summary of the Invention

[0003] Embodiments of the present application provide a display system and a vehicle.

[0004] The display system of the embodiment of the present application includes a display component and a light control component. The display component is used to display multi-perspective image information of the target object; the light control component is used to propagate the light corresponding to the image information of each perspective of the display component to different preset viewing areas, and the perspectives correspond one-to-one to the preset viewing areas.

[0005] In some embodiments, the light control component includes a first light control component, which corresponds to the light-emitting surface of the display component. The first light control component is used to refract the light corresponding to the image information of each viewing angle of the display component to the corresponding preset position so as to propagate to the corresponding preset viewing area.

[0006] In some embodiments, the first light control element includes a cylindrical lens grating or a microlens array.

[0007] In some embodiments, when the first light-controlling member is a cylindrical lens grating, the first light-controlling member is arranged at an angle to the sub-pixels of the display component.

[0008] In some embodiments, the angle between the first light-control member and the sub-pixel of the display component is in the range of [30°, 80°].

[0009] In some embodiments, the light control assembly further includes a second light control member and a third light control member, the second light control member is arranged corresponding to the first light control member, and the third light control member is arranged corresponding to the second light control member, and the second light control member is used to reflect the light at the preset position to the third light control member, and transmit the light reflected by the third light control member to propagate the light to the preset visual area.

[0010] In some embodiments, the first light control member, the second light control member, and the third light control member are in a triangular structure.

[0011] In some embodiments, the second light control member includes a transflective film, and the third light control member includes a retroreflective film.

[0012] In some embodiments, the light control assembly further includes a rotating member installed between the second light control member and the third light control member to control an angle between the second light control member and the third light control member.

[0013] In some embodiments, the display system further includes a gaze tracking component, and the angle is determined based on an output result of the gaze tracking component, wherein the gaze tracking component includes an eye tracking component and / or a face tracking component.

[0014] In some embodiments, the multi-view image information is generated based on an image generation algorithm, an image of the target object captured by a preset camera array, a type of the first light control element, and an arrangement of sub-pixels of the display assembly.

[0015] In some embodiments, the optical axes of the plurality of cameras of the camera array are aligned with a point to generate a zero plane.

[0016] In some embodiments, the parameters of the image generation algorithm are adjustable parameters, and the camera array is an adjustable camera array, so as to change the image formed in the preset viewing area and / or change the position of the preset viewing area.

[0017] In some embodiments, the display system further includes a gaze tracking component, and the specific parameters of the image generation algorithm and / or the camera array are determined based on the output results of the gaze tracking component, and the gaze tracking component includes a human eye tracking component and / or a human face tracking component.

[0018] In some embodiments, the display assembly includes a display element, the display element is used to display the multi-view image information, and a light-emitting surface of the display element corresponds to the light-control assembly.

[0019] In some embodiments, the display assembly further includes a backlight component, the display element is located between the backlight component and the light control assembly, and the backlight component is used to provide light source for the display element.

[0020] In some embodiments, each of the images has a corresponding viewing angle label, and the multi-view image information is generated based on images corresponding to each viewing angle after the order of the viewing angle labels is reversed.

[0021] In some embodiments, the number of the preset viewing zones ranges from [8, 56].

[0022] The vehicle according to the embodiment of the present application includes the display system described in any one of the above embodiments.

[0023] In some embodiments, the display system is mounted on the front of the vehicle and generates images inside the vehicle.

[0024] In some embodiments, the vehicle further includes a head-up display device, wherein the head-up display device and the display system are both installed on the front of the vehicle, and the display system is closer to the steering wheel of the vehicle than the head-up display device.

[0025] In some embodiments, the vehicle includes a seat, and the display system is mounted on a back side of the seat.

[0026] The display system and vehicle of the embodiment of the present application, the display component and the light control component, the display component can display multi-perspective image information, and the light control component can propagate the light corresponding to the image information of each perspective displayed by the display component to different preset viewing areas, so as to generate a target object image of the corresponding perspective in each preset viewing area. Therefore, the display system can form images of different perspectives in the air to form a suspended three-dimensional image corresponding to the target object in the air. At the same time, the perspective corresponding to the image formed in each preset viewing area is the same as the perspective when the real target object is seen in the preset viewing area, so that the image effect seen when viewing the target object image at each perspective is the same as the image effect seen when viewing the real target object at the perspective, thereby ensuring that the suspended three-dimensional image has real 3D information, so that the display effect of the suspended three-dimensional image is better, and thus ensuring that the user can obtain a more realistic and immersive human-computer visual interaction experience.

[0027] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0029] Figure 1 It is a schematic diagram of a scene of a display system in the prior art;

[0030] Figure 2 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0031] Figure 3 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0032] Figure 4 is a schematic structural diagram of a display system according to certain embodiments of the present application;

[0033] Figure 5 is a schematic diagram of the working principle of the third light control element of the display system in certain embodiments of the present application;

[0034] Figure 6 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0035] Figure 7 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0036] Figure 8 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0037] Figure 9 is a schematic diagram of a scene of a display system according to certain embodiments of the present application;

[0038] Figure 10 is a schematic diagram of a vehicle scenario in certain embodiments of the present application;

[0039] Figure 11 It is a schematic diagram of a vehicle scene in certain embodiments of the present application. DETAILED DESCRIPTION

[0040] The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and should not be understood as limiting the embodiments of the present application.

[0041] With the rise of intelligent driving, the intelligent cockpit has become a key driver for automakers to create a differentiated automotive experience amidst fierce market competition. As a key manifestation of intelligent cockpits, the Car Genie can provide users with a deeply personalized and enhanced experience.

[0042] However, most current in-car assistants only offer basic voice interaction capabilities. Humans receive 70% of their information from vision, making visual perception essential in our daily lives. Therefore, improving the display quality of in-car assistants to ensure a more realistic and immersive human-machine visual interaction experience has become a pressing issue.

[0043] The car-machine wizard with visual interaction function is usually displayed in the form of 2D images on the central control screen. This does not provide the driver with a more immersive and vivid driving experience, and the frequent turning of the head can easily distract the driver.

[0044] Media-free air suspension imaging is an advanced display technology that can form suspended images in the air without any physical screen. Figure 1 This technology, based on the fundamental principles of light field manipulation using micro-nanostructures, precisely controls the incidence, refraction, and reflection of light through a passive optical waveguide array device—a negative refractive flat lens—to refocus divergent light in mid-air, forming a real image without the need for any medium. However, this technology does not achieve true naked-eye 3D holographic imaging; it merely reconstructs the 2D image of the image module in mid-air through a light field. Furthermore, the position of the reconstructed aerial image is fixed by the system structure, making it difficult to adjust accordingly based on changes in the observer's position.

[0045] To solve the above problems, please refer to Figure 2 and Figure 3 An embodiment of the present application provides a display system 100, which includes a display component 10 and a light control component 20. The display component 10 is used to display multi-perspective image information of a target object; the light control component 20 is used to propagate light corresponding to image information of each perspective of the display component 10 to different preset viewing areas, and the viewing angles correspond to the preset viewing areas one by one.

[0046] Specifically, the target object is the object that the display system 100 desires to display, such as a vehicle-mounted smart device or another image that the user desires to view. The target object model can be constructed using 3D modeling software such as 3D Max, Blender, or C4D. In one embodiment, a large number of images and video sources containing multi-view image information can be preferentially synthesized and stored in the vehicle-mounted storage system. These images can then be played back through the display assembly 10 based on passenger needs.

[0047] Multi-view image information can display information about an object or scene observed from different perspectives, thereby providing a visual effect similar to a 3D experience.

[0048] Please combine Figure 3 The visual zone, or viewpoint area, is defined as the viewpoint, where the observer's position is defined as a point. The area visible to the observer at this viewpoint is the visual zone. When the observer observes the target object from the viewpoint, the angle between the line connecting the observer and the target object and the observer's line of sight (or the observer's front direction) is generally referred to as the viewing angle. The number of preset visual zones and the position of each preset visual zone relative to the display system 100 can be set based on the display requirements of the display system 100. It will be understood that each preset visual zone has a corresponding viewing angle.

[0049] The display assembly 10 is a component capable of displaying images. For example, the display assembly 10 includes a display screen capable of displaying multi-view image information of a target object. The light control assembly 20 is capable of regulating the light emitted by the light source to achieve the purpose of changing the direction, intensity, and properties of the light. The light control assembly 20 can transmit the light emitted from various areas of the display assembly 10 to a predetermined viewing area.

[0050] Therefore, the parameters of the light control component 20 can be adjusted according to the multi-perspective image information displayed by the display component 10 and the position of the preset viewing area corresponding to each perspective in the multi-perspective image information, or the generation process of the multi-perspective image information can be controlled according to the parameters of the light control component 20 and the preset viewing area corresponding to each perspective, so that the light emitted by the image corresponding to each perspective can reach the preset viewing area corresponding to the perspective after being propagated through the light control component 20, and the light is converged in the preset viewing area to form the target object image. It can be understood that the viewing angle corresponding to the target object image located in a certain preset viewing area corresponds to the viewing angle corresponding to the preset viewing area.

[0051] In this way, the display system 100 can form a corresponding target object image (a two-dimensional image) in each preset viewing zone in the air, thereby forming a floating three-dimensional image of the target object in the air. The image effect seen when viewing the target object image in each preset viewing zone is the same as the image effect seen when viewing the real target object in that viewing zone, thereby ensuring that the image floating in the air has realistic 3D information. Therefore, when the user views the floating three-dimensional image, the left and right eyes can receive different images, allowing the user to observe the three-dimensional effect of the target object, ensuring that the user can obtain a more realistic and immersive human-computer visual interaction experience.

[0052] The display system 100 of the embodiment of the present application includes a display component 10 and a light control component 20. The display component 10 is capable of displaying multi-perspective image information, and the light control component 20 is capable of propagating the light corresponding to the image information of each perspective displayed by the display component 10 to different preset viewing areas, respectively, so as to generate a target object image of the corresponding perspective in each preset viewing area. Therefore, the display system 100 can form images of different perspectives in the air to form a suspended three-dimensional image corresponding to the target object in the air. At the same time, the perspective corresponding to the image formed in each preset viewing area is the same as the perspective when the real target object is seen in the preset viewing area, so that the image effect seen when viewing the target object image at each perspective is the same as the image effect seen when viewing the real target object at the perspective, thereby ensuring that the suspended three-dimensional image has real 3D information, so that the display effect of the suspended three-dimensional image is better, and thus ensuring that the user can obtain a more realistic and immersive human-computer visual interaction experience.

[0053] See also Figure 2 and Figure 3In some embodiments, the display component 10 includes a display element 11 , which is used to display multi-viewing image information. The light-emitting surface of the display element 11 corresponds to the light-control component 20 .

[0054] Specifically, the display element 11 is composed of many tiny pixels, each of which contains three sub-pixels: red, green, and blue (some display elements 11 also contain an alpha channel for transparency). By controlling the brightness and color combination of each sub-pixel, the display element 11 can display various images. For example, the display element 11 is a liquid crystal display or an LED display.

[0055] Therefore, pixels in different areas of the display element 11 can emit light corresponding to multi-view image information to display multi-view image information of the target object. At the same time, the light-emitting surface of the display element 11 aligns with the light-control assembly 20, ensuring that light emitted from different areas of the display element 11 can enter the light-control assembly 20 and be transmitted by the light-control assembly 20 to the corresponding preset viewing zones, thereby ensuring that the display system 100 can form images of the corresponding perspectives in each preset viewing zone.

[0056] See also Figure 2 In some embodiments, the display assembly 10 further includes a backlight component 12 , and the display element 11 is located between the backlight component 12 and the light control component 20 . The backlight component 12 is used to provide light source to the display element 11 .

[0057] Specifically, the display element 11 is typically provided with a corresponding backlight module, which primarily provides the necessary light source to ensure clear viewing of the image on the display element 11. However, since the display system 100 of the present application ultimately forms an image in mid-air, increasing the brightness of the display element 11 can improve the clarity of the image formed in mid-air.

[0058] Therefore, an additional backlight component 12 can be set on the side of the display component 11 away from the light control component 20. The backlight component 12 is used to provide light to the display component 11 to further enhance the display brightness of the display component 11, thereby improving the clarity of the image formed by the display system 100 in the air.

[0059] See also Figure 3 In some embodiments, the light control component 20 includes a first light control component 21, which corresponds to the light-emitting surface of the display component 10. The first light control component 21 is used to refract the light corresponding to the image information of each viewing angle of the display component 10 to the corresponding preset position so as to be projected onto the corresponding preset viewing area.

[0060] Specifically, the first light control element 21 can capture the light emitted from different areas of the display component 10, forming an image in the air that can be seen at a specific perspective, so as to simulate the propagation and interaction of light of the target object in space, and convert the multi-perspective image information into images corresponding to each perspective in the air, that is, convert the multi-perspective image information into a three-dimensional image.

[0061] The first light control member 21 corresponds to the light-emitting surface of the display component 10. For example, the display component 10 is placed below the first light control member 21 and is bonded using alignment bonding technology so that the first light control member 21 can receive the light emitted by the display component 10. At the same time, the first light control member 21 can be used to refract the light emitted by the display component 10, so as to refract the light corresponding to the image information of each perspective of the display component 10 to the corresponding preset positions, thereby realizing the light field reconstruction of the target object. Here, the light field refers to the collection of light rays in any direction emitted around any point in space of the target object. Therefore, the first light control member 21 and the display component 10 can actually form a light field screen that can restore the light field of the object.

[0062] After refraction by the first light control member 21, an image of the target object corresponding to the viewing angle can be formed at the preset position. Therefore, after refraction by the first light control member 21 alone, the display system 100 can actually generate a suspended three-dimensional image with a three-dimensional effect. Therefore, the light control component 20 can only be provided with the first light control member 21, and the preset position is the preset viewing area. Alternatively, the image formed after refraction by the first light control member 21 is actually located near the display component 10. If an image is now formed in an area farther away from the display component 10, other light control members can be additionally provided so that the image formed after refraction by the first light control member 21 can undergo multiple refractions or reflections, thereby forming an image of the target object in an area farther away from the display component 10. This area farther away from the display component 10 is the preset viewing area, and the preset position is the middle position between the light emitted from the display component 10 and the preset viewing area. At this time, the parameters of the first light control element 21 and other light control elements need to be set accordingly so that the viewing angles corresponding to the preset position and the preset viewing area are the same, ensuring that the light corresponding to an image at a certain viewing angle passes through the first light control element 21 to reach the preset position, and then passes through other light control elements to reach the preset viewing area and form an image. The viewing angle corresponding to the preset viewing area finally reached is the same as the viewing angle corresponding to the image.

[0063] In one embodiment, the first light control element 21 comprises a cylindrical lens grating. Due to its unique structure, consisting of numerous small cylindrical lenses with identical structural parameters and performance arranged in parallel, the cylindrical lens grating precisely refracts and controls light. This allows multiple images of the same scene taken from different angles to be recorded as stripes on the same image. When viewed, the same cylindrical stereo grating allows the user to see two distinct images of the same scene. This difference creates a parallax-like depth image in the user's mind, achieving a naked-eye 3D display effect.

[0064] In another embodiment, the first light-control element 21 comprises a microlens array. By capturing and displaying light fields, the microlens array simulates the propagation and interaction of light in space, enabling viewers to perceive the true depth of objects and a three-dimensional effect. Each microlens captures light in a specific direction and processes it to form an image visible from a specific viewing angle, thereby achieving multi-viewpoint display and a three-dimensional effect.

[0065] The parameters of the first light control element 21 can be determined according to the required display effect. Taking the cylindrical lens grating and the micro lens array as an example, the depth of field z0 of a 3D object can be expressed by the following formula:

[0066] z0=z s / (W p / W i +1)

[0067] z s The shortest distance between the human eye and the screen, W i is the pitch width of the lens, W p It is the ratio between the width of the viewing area Ws and the number of viewpoints N.

[0068] The number of viewpoints N will be determined by the collected viewing angle image and the specifications and model parameters of the display unit 11. For example, the number of viewpoints N can be set to 8 to 56 based on the actual sub-pixel size, 3D depth of field, viewing angle size, resolution and other performance parameters of the display unit 11, that is, the value range of the number of preset viewing zones is [8, 56]. If the number of preset viewing zones is too large, the depth of field and resolution will be lost, but the final 3D effect will be more realistic. If the number of preset viewing zones is too small, the depth of field and resolution will be less lost, but dizziness will occur after watching for a long time. Therefore, it is necessary to determine the number of preset viewing zones within the range of [8, 56] in combination with various performance parameters to ensure the final display effect. At the same time, the viewpoint area range and the optimal viewing distance are determined by the type and pitch parameters of the first light control unit 21.

[0069] In some embodiments, by adjusting the pitch W of the first light control element 21, such as the cylindrical lens grating and the micro lens array, iThe design of the distance g from the display element 11 can realize the design of the 3D viewing angle α of the target object, which can be expressed by the following formula:

[0070] α=2artan(W i / 2g)

[0071] Generally, to maximize the 3D depth of field, g is designed to be equal to the focal length f of the lens. When the light-control element 101 is a cylindrical lens grating, compared to a microlens array, it lacks vertical parallax but can significantly improve its viewing angle, 3D depth of field, and resolution.

[0072] In this way, the first light control element 21 can accurately control the direction of light at each pixel of the display element 11, reconstructing the 3D light field of the target object and its image position, so as to form a three-dimensional image of the target object in the air.

[0073] See also Figure 2 and Figure 4 In some embodiments, when the first light control member 21 is a cylindrical lens grating, the first light control member 21 is arranged at an angle to the sub-pixels of the display component 10 .

[0074] Specifically, the sub-pixels of the display element 11 include RGB pixels, and the positions of the RGB pixels are different. After the cylindrical lens grating is combined with the display element 11, these pixels will be stretched and magnified, thereby forming colorful light patterns, namely moiré patterns.

[0075] In the case where the first light control member 21 is a cylindrical lens grating, when the cylindrical lens grating is tilted with respect to the display member 11, that is, when the first light control member 21 and the sub-pixels of the display member 11 are arranged at an angle, the direction of the light emitted by the display member 11 can be changed. After the action of the cylindrical lens grating, the light emitted by each area of ​​the display member 11 will overlap or compound, so that the light displayed in a certain area is not only the light emitted by the sub-pixels of the display member 11 corresponding to the area, so that the light displayed in each area is mixed light, thereby eliminating moiré patterns. Among them, the first light control member 21 and the sub-pixels of the display member 11 are arranged at an angle, which means that the first light control member 21 and the short sides of the sub-pixels of the display member 11 are arranged at an angle, such as Figure 4 . In some embodiments, the angle between the grating and the sub-pixel is in the range of [30°, 80°], for example, 30°, 41°, 53°, 57°, 67°, 71°, 78° or 80°. Preferably, the angle is 71°. If the angle is too small, the effect of eliminating moiré may be poor. If the angle is too large, the displayed image may be fragmented. Therefore, the value of the angle needs to be selected within [30°, 80°] to ensure that the moiré can be effectively eliminated and the image display effect is better.

[0076] At the same time, a single grating in a cylindrical lens grating spans several pixels, resulting in a certain loss of resolution in that spanning direction. If the grating is parallel to the pixels, the resolution loss only applies to that spanning direction. If the cylindrical lens grating is tilted relative to the sub-pixels of the display element 11, the optical path changes, increasing the resolution loss in that direction and correspondingly reducing the resolution loss in that spanning direction. This mitigates the resolution loss in a single direction and improves the 3D display effect.

[0077] Thus, when the first light control element 21 is a cylindrical lens grating, the tilted arrangement of the first light control element 21 and the display element 11 can eliminate moiré patterns and alleviate the loss of single-direction resolution, thereby improving the 3D display effect.

[0078] Furthermore, when the first light control element 21 is a microlens array, moiré patterns may also occur on the display element 11. However, the microlens array is circular, and the moiré pattern can be eliminated by changing the image acquisition and encoding methods without tilting the microlens array.

[0079] See also Figure 2 In some embodiments, the light control assembly 20 further includes a second light control member 22 and a third light control member 23. The second light control member 22 is arranged corresponding to the first light control member 21, and the third light control member 23 is arranged corresponding to the second light control member 22. The second light control member 22 is used to reflect light at a preset position to the third light control member 23, and transmit the light reflected by the third light control member 23 to propagate the light to a preset visual area.

[0080] Specifically, the first light control element 21 can form a three-dimensional image of a target object near the display element 11. In this case, the second and third light control elements 22, 23 can be added to project the image generated by the first light control element 21 to a more distant area. This allows the user to see the image of the target object even when the display assembly 10 is not visible, thereby improving the user experience. In fact, the first light control element 21 and the display assembly 10 can form a light field screen. The second and third light control elements 22, 23 can be used to propagate the light field generated by the light field screen to a more distant area, thereby forming a suspended three-dimensional image in the more distant area.

[0081] The second light control member 22 is disposed correspondingly to the first light control member 21, and the third light control member 23 is disposed correspondingly to the second light control member 22. For example, the first light control member 21, the second light control member 22, and the third light control member 23 form a triangular structure to ensure that light can be accurately transmitted between the light control members. For example, there is an acute angle between the first light control member 21 and the second light control member 22, an acute angle between the second light control member 22 and the third light control member 23, and a right angle between the third light control member 23 and the first light control member 21.

[0082] The second light control element 22 has both transmission and reflection functions. Therefore, the light generated by the first light control element 21 at the preset position can be transmitted to the second light control element 22, which can then reflect the light to the third light control element 23. At the same time, a portion of the light will also be transmitted through the second light control element 22 to other locations, but this portion of light can be understood as stray light and does not affect the final imaging in the preset viewing area. After receiving the light, the third light control element 23 will reflect the light back to the second light control element 22. At this time, the second light control element 22 can transmit the light reflected by the third light control element 23 to propagate the light to the preset viewing area and form an image corresponding to the preset viewing area. At this time, the second light control element 22 can also reflect the light reflected by the third light control element 23, but this portion of light can also be understood as stray light and does not affect the final imaging in the preset viewing area.

[0083] In one embodiment, the second light control member 22 includes a semi-transparent and semi-reflective film, and the third light control member 23 includes a retroreflective film. The semi-transparent and semi-reflective film is a special optical film that has the ability to reflect and transmit light at the same time. When the light emitted by the display element 11 is irradiated on the semi-transparent and semi-reflective film, part of the light will be reflected to the retroreflective film, while the other part of the light may continue to propagate through the film. The retroreflective film is an optical film that can perform directional reflection according to the angle of the incident light. It is composed of a plurality of micro three-sided right-angle prisms arranged, and these microprisms have three mutually perpendicular reflective surfaces. When light is irradiated on the retroreflective film, it will be mirror-reflected once on each of these reflective surfaces, and then return in a direction parallel to the incident light. Please combine Figure 5 , Figure 5 This is the working principle of retroreflective film. You can see that the incident angle and the exit angle of the retroreflective film are consistent. This reflective property enables the retroreflective film to maintain the directionality of light and reconstruct 3D images in space.

[0084] Compared to existing negative refractive index flat lenses, the transflective and retroreflective films have a simpler structure and are easier to manufacture. They eliminate the need for the conventional double-layer structure of two sets of mirrored surfaces stacked orthogonally, and do not increase the overall imaging system size. Furthermore, the light control assembly 20 uses the retroreflective film to generate images, eliminating the need for an optical axis. Therefore, the 3D image formed in the preset viewing area has a 1:1 size ratio with the image formed at the preset position, eliminating the need for distortion correction.

[0085] In this way, the present application reconstructs a 3D light field of a real object in front of and behind the display element 11 through the first light control element 21. The 3D object light field information formed in front of and behind the display element 11 can be projected through the second light control element 22 and the third light control element 23, and ultimately form a corresponding 3D image in the air without a medium.

[0086] In other embodiments, the light control component 20 may include a negative refractive plane lens, which may replace the second light control member 22 and the third light control member 23. That is, the light control component 20 includes a first light control member 21 and a negative refractive plane lens. The negative refractive plane lens can also transmit light from a preset position to a preset viewing area. However, the negative refractive plane lens has an optical axis, and the size of the 3D image formed in the preset viewing area and the image formed at the preset position will change, and the ratio is not 1:1. In this case, additional distortion correction of the image is required. Therefore, although the light control component 20 can also use a negative refractive plane lens, preferably, the light control component 20 can use a semi-transparent and semi-reflective film and a retroreflective film to transmit light from the preset position to the preset viewing area.

[0087] See also Figure 2 In some embodiments, the light control assembly 20 further includes a rotating member installed between the second light control member 22 and the third light control member 23 to control the angle between the second light control member 22 and the third light control member 23 .

[0088] Specifically, there is a certain angle between the second light control member 22 and the third light control member 23. The size of the angle can change the light path between the second light control member 22 and the third light control member 23, thereby changing the position where the light finally converges in the air, that is, changing the position of the preset viewing area in the air. When the user is in the preset viewing area, the display effect of the aerial image is better when the user views it. For example, Figure 6 The comparison diagrams before and after the angle between the second light control element 22 and the third light control element 23 is changed show that the position of the image changes before and after the angle is changed.

[0089] Therefore, a rotating member can be set between the second light control member 22 and the third light control member 23, for example, a rotating connecting rod can be set to control the angle between the second light control member 22 and the third light control member 23, so as to facilitate changing the position of the preset viewing area in the air based on the user's actual position, ensuring that the preset viewing area matches the user's actual viewing area, which is beneficial to improving the user's viewing experience.

[0090] See also Figure 2 In some embodiments, the display system 100 further includes a gaze tracking component (not shown), and the angle is determined based on an output result of the gaze tracking component, which includes an eye tracking component and / or a face tracking component.

[0091] Specifically, the display system 100 also includes a gaze tracking component, which includes an eye tracking component and / or a face tracking component. The eye tracking component focuses on tracking the movement of the eyeball, including the rotation of the eyeball, the position change of the pupil, etc. It can capture the position information of the eyeball in real time and then analyze the direction of the user's gaze. The face tracking component is used to track the position and posture changes of the face in real time in a video or image sequence. Other components can detect key feature points of the face, such as eyes, nose, mouth, etc., and update the position information of these feature points in real time. It can be understood that the position of the user's gaze can be determined based on the gaze tracking component.

[0092] The position of the user's line of sight can be determined based on the output results of the line of sight tracking component, and then the angle can be adjusted according to the position of the user's line of sight to adjust the specific position of the preset field of view in the air, ensuring that the position of the preset field of view matches the user's real field of view, thereby achieving active adjustment to ensure that the position of the aerial image is always within the user's line of sight.

[0093] See also Figure 2 and Figure 7 In some embodiments, the multi-view image information is generated based on an image generation algorithm, an image of a target object captured by a preset camera array, a type of the first light control element 21 , and an arrangement of sub-pixels of the display component 10 .

[0094] Specifically, a camera array is an array of multiple cameras, each positioned at different angles relative to a target object, resulting in images captured by the multiple cameras having different perspectives. The perspective can be adjusted by adjusting the spacing between adjacent cameras. Therefore, a camera array can be used to capture images of a target object, obtaining image information from multiple perspectives. Since the target object is typically a virtual model, the camera array can be a virtual or simulated camera array, eliminating the need for a real camera array to capture the target object, thereby reducing costs. Of course, the camera array can also be a real camera array, without limitation.

[0095] Based on the type of first light-control element 21 selected and the sub-pixel arrangement (i.e., RGB arrangement) of the display element 11, a specific image generation algorithm is used to combine N perspective images into a single interwoven image containing 3D multi-perspective information, i.e., multi-perspective image information. The image generation algorithm can be based on existing optical rendering technology, and the algorithm parameters are adaptively adjusted based on the parameters of the first light-control element 21 and the display element 11.

[0096] It should be noted that the specific form of the camera array matches the type of the first light control element 21. When the first light control element 21 is a microlens array, a camera array with N*N cameras is required. When the first light control element 21 is a cylindrical lens grating, a camera array with N cameras is required.

[0097] In this way, multi-perspective image information that can contain 3D multi-perspective information of the target object can be accurately generated based on the images of multiple perspectives of the target object captured by the preset camera array, the type of the first light control element 21 and the arrangement of the sub-pixels of the display element 11 of the display component 10.

[0098] See also Figure 7 In some embodiments, the optical axes of the multiple cameras of the camera array are compared to a point and generate a zero plane.

[0099] Specifically, the zero plane is a plane formed by the intersection of the optical axes of multiple cameras at one point. As a common reference plane, the zero plane helps to unify the shooting angles of each camera. When performing image stitching, three-dimensional reconstruction and other processing, the zero plane can be used as a reference plane to make the processing process more accurate and efficient. At the same time, the existence of the zero plane helps to reduce image distortion caused by differences in camera perspectives. When performing image fusion, using the zero plane as a reference can better fuse images at different angles, thereby improving the overall image quality. In addition, the image acquisition of the camera array is convergent, which can achieve 3D depth of field effects both on and off the screen, without the need to crop the image, and the viewing angle can be adjusted by adjusting the distance between adjacent cameras.

[0100] See also Figure 2 In some embodiments, the parameters of the image generation algorithm are adjustable parameters, and the camera array is an adjustable camera array to facilitate changing the image formed in the preset viewing area and / or changing the position of the preset viewing area.

[0101] Specifically, the parameters of the image generation algorithm are adjustable parameters. During the image generation process, the algorithm is responsible for processing and converting the raw data (such as light signals or digital signals) to generate the final image. Therefore, the parameters of the image generation algorithm affect the multi-view image information that is ultimately generated. For example, if the adjusted algorithm introduces image geometric transformations (such as translation, rotation, scaling, etc.), the position, size, and shape of the resulting image on the image plane may change. This change directly affects the positional relationship between the image and the zero plane. Moreover, changes to the algorithm may also involve adjustments to the projection method. For example, in three-dimensional graphics rendering, changing the projection matrix or observation parameters will cause the position and size of the rendered image on the two-dimensional image plane to change. This change also affects the positional relationship between the image and the zero plane.

[0102] At the same time, the camera array is an adjustable camera array, that is, the arrangement of the camera array and the parameters of the camera itself are adjustable, so that the corresponding image acquisition method when the camera array acquires images is adjustable, thereby changing the multi-view image information finally generated.

[0103] Therefore, the multi-view image information can be changed by adjusting the parameters of the image generation algorithm and / or adjusting the camera arrangement of the camera array, for example, changing the size, angle and height of the target object in the multi-view image information. It is understandable that when the image of the multi-view image information changes, the image formed in the preset viewing area will also change. For example Figure 8 Schematic diagram for adjusting the height and angle of a suspended three-dimensional image.

[0104] Meanwhile, the image plane refers to the position of the 3D image perceived by the observer in space, that is, the spatial location where the image appears to be "floating" or "located." It is understood that the 3D image perceived by the user will differ when the image plane is closer to or farther away from the user. Adjusting the parameters of the camera matrix or changing the image generation algorithm affects the focusing of light on the image plane, thereby changing the position and size of the resulting image. This adjustment effectively changes the position of the image plane relative to the lens system and the object. In other words, adjusting the parameters of the image generation algorithm and / or the camera array's acquisition method can change the image position of light after passing through the first light control element 21, i.e., the preset position, thereby changing the position of the preset viewing area. This can be understood as adjusting the parameters of the image generation algorithm and / or the camera array's acquisition method to adjust the imaging position of the light field screen. Furthermore, adjusting the preset position can change the depth of field of the image. For example, moving the preset position forward may increase the clarity of the foreground, while moving the preset position backward may increase the clarity of the background.

[0105] like Figure 9 . Figure 9 The two little people in the left picture can represent the imaging on the two image planes. The vertical bar in the middle is the display element 11, and the surface of the display element 11 is the zero plane. By adjusting the parameters of the image generation algorithm and / or adjusting the acquisition method of the camera array, the imaging of the first light control element 21 before and after the zero plane can be adjusted, that is, the 3D stereoscopic effect and depth of field of the image can be regulated, and the specific position of the preset position can be changed. After the preset position is changed, the position of the preset viewing area will also change, so this operation can be equivalent to the adjustment of the image plane. In this way, by adjusting the preset position, the 3D stereoscopic effect and depth of field of the image can be regulated, and the distance between the 3D image reconstructed in the air and the relative position of the passenger can be adjusted.

[0106] In the prior art, to achieve similar control over the projection position of a suspended three-dimensional image, a mechanical movement module must be added to the display element 11. This not only significantly increases the size of the display system 100, but also increases its complexity and maintenance costs. Furthermore, it is difficult to achieve the precise control of the image position achieved by the 3D light field reconstruction method employed in the present application (i.e., by changing the relative position of the zero plane and the target object to alter the light field reconstructed by the first light control element 21). Therefore, the image reconstructed in the present application not only possesses realistic 3D information, but also allows for adjustment of the image plane without mechanically moving the display screen.

[0107] In this way, the image formed in the preset viewing area can be changed by adjusting the image generation algorithm or adjusting the camera array, which are the underlying processing methods, and / or the position of the preset viewing area can be changed, so as to project a suspended three-dimensional image in the air that best matches the position of the observer's eyes without changing the optical structure, and ensure that the imaging effect of the suspended three-dimensional image meets user needs.

[0108] See also Figure 2 In some embodiments, the display system 100 further includes a gaze tracking component, and specific parameters of the image generation algorithm and / or the camera array are determined based on the output results of the gaze tracking component, and the gaze tracking component includes a human eye tracking component and / or a human face tracking component.

[0109] Specifically, the current position of the user's line of sight can be determined through the output results of the line of sight tracking component, and then the specific parameters of the image generation algorithm and / or the camera array can be adjusted based on the current position of the user's line of sight to adjust the imaging position of the display system 100 in the air, that is, adjust the specific position of the preset field of view, so as to ensure that the three-dimensional image of the target object is always within the user's line of sight observation range.

[0110] In summary, existing aerial levitation technologies are unable to adjust the image suspended in the air due to the fixed optical structure. This means that when the observer is not in the optimal position to observe the suspended image, the suspended image projected into the air will not be visible. To address the above problems, the display system 100 of the present application can controllably adjust the distance, height, and angle of the aerial image of the target object by adjusting the angle between the second light control member 22 and the third light control member 23, adjusting the parameters of the image generation algorithm, and adjusting the parameters of the camera array. The imaging effect will not be limited by the distance relationship between the viewer and the display system 100, allowing the user to obtain a more realistic and immersive human-computer visual interaction experience. At the same time, the display system 100 can also be combined with human eye / face tracking to achieve active adjustment to ensure that the position of the aerial image is always within the user's line of sight. At the same time, combining these three adjustment methods can further expand the effective viewing area of ​​the display system 100.

[0111] See also Figure 2 In some embodiments, each image has a corresponding viewing angle label, and multi-view image information is generated based on images corresponding to each viewing angle after the order of the viewing angle labels is reversed.

[0112] Specifically, while the display system 100 of the present application can project 3D objects at different locations on the display element 11 to different locations in the air, their depth is reversed. Based on the plane of the display element 11, the 3D virtual image, which should be deep inside the display element 11, is projected closer to the human eye than the real image on the screen. This results in noticeable distortion of depth information.

[0113] Each image has a corresponding viewpoint number. The images corresponding to each viewpoint can be sorted along a fixed direction based on a certain position as the origin. For example, the image numbering sequence from left to right is: 1, 2, ..., N. Then, taking into account the opposite motion parallax of 3D objects located before and after the zero plane, the numbering sequence of the 1-N viewpoints can be transposed by a computer to resolve the problem of depth information confusion. For example, the images corresponding to each viewpoint can be sorted from left to right. In this case, the image numbering sequence from left to right is: 1, 2, ..., N. The sorting is then reversed. In this case, the image numbering sequence from left to right is: N, N-1, ..., 1. Then, using a normal image generation algorithm, such as a light field rendering algorithm, the reversed images are synthesized into an interlaced image (i.e., multi-viewpoint image information). The regenerated multi-viewpoint image information is displayed using the display element 11 to correct the depth reversal caused by the aerial projection of the retroreflective film, so that the 3D image suspended in the air has a correct three-dimensional effect.

[0114] It should be noted that when the first light control element 21 is a microlens array, the integrated light field 3D display technology route involved itself has a 3D depth flip problem. The depth can be directly flipped twice by using the aerial projection of the retroreflective film and the semi-transparent and semi-reflective film, without the need to generate multi-perspective image information based on the image information corresponding to each viewpoint after sorting and flipping.

[0115] In this way, the images of each perspective can be labeled based on the order of the corresponding perspectives to generate perspective labels. Then, they are sorted from smallest to largest based on the labels. When generating multi-perspective image information, the order of the perspective labels is reversed to change the order of the images corresponding to each perspective. Multi-perspective image information is then generated based on the images with the updated order, thereby resolving the issue of depth information confusion and ensuring the final imaging effect of the display system 100.

[0116] See also Figure 10, the vehicle 1000 of the embodiment of the present application includes the display system 100 of any of the above-mentioned embodiments.

[0117] Specifically, the display system 100 may be installed in the vehicle 1000 to provide images where the user requires, thereby satisfying the user's needs.

[0118] In one embodiment, the display system 100 is mounted on the front of the vehicle and projects images within the vehicle 100, allowing front passengers, particularly the driver, to observe the floating 3D image displayed by the display system 100. This facilitates the driver's access to information, such as navigation, based on the floating 3D image. For example, the display system 100 is mounted near the dashboard of the vehicle, allowing the driver to observe the floating 3D image while driving.

[0119] Please combine Figure 10 In another embodiment, the vehicle 1000 further includes a head-up display (HUD) 200. The head-up display 200 and the display system 100 are both mounted on the front of the vehicle, and the display system 100 is closer to the steering wheel of the vehicle 1000 than the head-up display 200. The head-up display 200 is a driver-centric, blind-operated, multi-functional instrument panel that can project important driving information such as speed and navigation onto the windshield in front of the driver or in front of the driver's field of vision. The core technical principle of HUD is to transmit the vehicle instrument panel, central control data or vehicle driving data and vehicle condition information to the projection unit through the control processing unit to form an image, which is then projected onto a specific display screen in front of the driver's line of sight through necessary optical reflection or refraction.

[0120] In this case, the display system 100 is positioned closer to the steering wheel of the vehicle 1000 than the head-up display 200. By utilizing two aerial image adjustment methods, the 3D image of the Car Genie can be projected at a position optimal for the driver's eyes. Furthermore, eye tracking or facial tracking technology can be incorporated to actively adjust the projected 3D Car Genie image position, ensuring the driver's field of view remains within the visible area of ​​the aerial image. Combined with in-vehicle voice commands, this assists the driver with road navigation and warnings.

[0121] Please combine Figure 11 In another embodiment, the vehicle 1000 includes a seat 300, and the display system 100 is installed on the back of the seat 300. For example, the display system 100 is installed on the back of the front seat of the vehicle 1000, so that passengers in the back seat can use the display system 100 for entertainment and contactless human-computer interaction in the air.

[0122] In existing technologies, when the front-row seats change position, the position of the image projected in the air by the entire air suspension system will also be affected, which will make it difficult for rear passengers to observe the ideal suspended 3D image. However, the present application provides multiple adjustment mechanisms for the air suspension image (such as adjusting the angle between the second light control member 22 and the third light control member 23, adjusting the parameters of the image generation algorithm, and adjusting the parameters of the camera array), which can solve the problems caused by the above-mentioned problems and construct a 3D car spirit with continuous depth of field changes. While having a more vivid and three-dimensional image, the multi-viewpoint 3D display technology can also avoid the convergence conflict problem of auxiliary 3D display technologies such as VR, relieve visual fatigue, and prevent passengers from motion sickness.

[0123] In this way, the display system 100 of the present application can be applied to driver-assisted driving navigation, as well as entertainment games for rear passengers, direct air interaction without physical contact, and other aspects.

[0124] The display system 100 of the vehicle 1000 of the embodiment of the present application includes a display component 10 and a light control component 20. The display component 10 is capable of displaying multi-perspective image information, and the light control component 20 is capable of propagating the light corresponding to the image information of each perspective displayed by the display component 10 to different preset viewing areas, so as to generate a target object image of the corresponding perspective in each preset viewing area. Therefore, the display system 100 can form images of different perspectives in the air to form a suspended three-dimensional image corresponding to the target object in the air. At the same time, the perspective corresponding to the image formed in each preset viewing area is the same as the perspective when the real target object is seen in the preset viewing area, so that the image effect seen when viewing the target object image at each perspective is the same as the image effect seen when viewing the real target object at the perspective, thereby ensuring that the image suspended in the air has real 3D information, so that the display effect of the target object image is better, and thus ensuring that the user can obtain a more realistic and immersive human-computer visual interaction experience.

[0125] In the description of this specification, the reference terms "certain embodiments", "in an example", "exemplarily", etc. mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are mutually inconsistent.

[0126] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0127] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A display system, characterized in that: include: A display component, wherein the display component is used to display multi-view image information of the target object; A light control component is used to propagate light corresponding to image information of each viewing angle of the display component to different preset viewing areas, wherein the viewing angles correspond to the preset viewing areas in a one-to-one manner.

2. The display system according to claim 1, wherein: The light control component includes a first light control component, which corresponds to the light-emitting surface of the display component. The first light control component is used to refract the light corresponding to the image information of each viewing angle of the display component to the corresponding preset position so as to propagate to the corresponding preset viewing area.

3. The display system according to claim 2, wherein: The first light control element includes a cylindrical lens grating or a micro lens array.

4. The display system according to claim 3, wherein: In the case where the first light-controlling member is a cylindrical lens grating, the first light-controlling member is arranged at an angle to the sub-pixels of the display component.

5. The display system according to claim 4, wherein: The included angle between the first light-controlling member and the sub-pixel of the display component ranges from [30° to 80°].

6. The display system according to claim 2, wherein: The light control component also includes a second light control member and a third light control member. The second light control member is arranged corresponding to the first light control member, and the third light control member is arranged corresponding to the second light control member. The second light control member is used to reflect the light at the preset position to the third light control member, and transmit the light reflected by the third light control member to propagate the light to the preset visual area.

7. The display system according to claim 6, characterized in that The first light-controlling member, the second light-controlling member and the third light-controlling member are in a triangular structure.

8. The display system according to claim 6, wherein: The second light control member includes a semi-transmissive and semi-reflective film, and the third light control member includes a retro-reflective film.

9. The display system according to claim 6, wherein: The light control assembly further includes a rotating member installed between the second light control member and the third light control member to control an angle between the second light control member and the third light control member.

10. The display system according to claim 9, wherein: The display system further includes a gaze tracking component, and the angle is determined according to an output result of the gaze tracking component. The gaze tracking component includes an eye tracking component and / or a face tracking component.

11. The display system according to claim 2, wherein: The multi-view image information is generated based on an image generation algorithm, an image of the target object captured by a preset camera array, a type of the first light control element, and an arrangement of sub-pixels of the display component.

12. The display system according to claim 11, wherein: The optical axes of the plurality of cameras of the camera array are compared to a point and a zero plane is generated.

13. The display system according to claim 11, wherein: The parameters of the image generation algorithm are adjustable parameters, and the camera array is an adjustable camera array, so as to change the image formed in the preset viewing area and / or change the position of the preset viewing area.

14. The display system according to claim 13, wherein: The display system also includes a gaze tracking component, and the specific parameters of the image generation algorithm and / or the camera array are determined based on the output results of the gaze tracking component. The gaze tracking component includes a human eye tracking component and / or a human face tracking component.

15. The display system according to claim 1, wherein: The display component includes a display element, which is used to display the multi-viewing angle image information. The light-emitting surface of the display element corresponds to the light-control component.

16. The display system according to claim 15, wherein: The display component further includes a backlight component. The display component is located between the backlight component and the light control component. The backlight component is used to provide light source for the display component.

17. The display system according to claim 1, wherein: Each of the images has a corresponding viewing angle label, and the multi-view image information is generated based on images corresponding to each viewing angle after the order of the viewing angle labels is reversed.

18. The display system according to claim 1, wherein: The number of preset viewing areas ranges from [8, 56].

19. A vehicle, characterized in that: include: The display system according to any one of claims 1 to 18.

20. The vehicle according to claim 19, characterized in that The display system is installed on the front of the vehicle and forms an image inside the vehicle.

21. The vehicle according to claim 20, characterized in that The vehicle further includes a head-up display device. The head-up display device and the display system are both installed on the front of the vehicle, and the display system is closer to the steering wheel of the vehicle than the head-up display device.

22. The vehicle according to claim 20, characterized in that The vehicle includes a seat, and the display system is installed on the back of the seat.

Images