Autostereoscopic head-up display system

By integrating a concave mirror with an autostereoscopic screen featuring a corrected lenticular network pitch, the system overcomes limitations of current autostereoscopic screens, achieving large-scale image projection with deep depth of field and realistic binocular vision.

WO2025131910A1PCT designated stage expired Publication Date: 2025-06-26ALIOSCOPY
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/085618
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-21
Filing Date
2024-12-11
Publication Date
2025-06-26

AI Technical Summary

Technical Problem

Current autostereoscopic screens face challenges in projecting large images with a deep depth of field, limited by the size and weight of glass components, and struggle to maintain orthostereoscopic proportions and binocular vision realism.

Method used

The system employs a convergent optical component, such as a concave mirror, in conjunction with a specially designed autostereoscopic screen, where the screen's lenticular network is adjusted to correct the pitch, allowing for a large depth of field and binocular vision similar to reality.

Benefits of technology

This configuration enables the projection of large images with a depth of field up to 100 meters, providing unmatched relief amplitude and maintaining orthostereoscopic proportions, suitable for augmented reality applications and automotive use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024085618_26062025_PF_FP_ABST
    Figure EP2024085618_26062025_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a system for the dematerialised projection of an autostereoscopic image intended for an observer whose eyes are positioned within a predetermined three-dimensional space, referred to as an eye box, the system comprising: an optical device comprising at least one convergent optical component arranged with respect to the eye box so as to be able to direct the light rays it receives towards the eye box; and an autostereoscopic screen arranged with respect to the optical device such that the light rays that it emits can reach the convergent optical component, the autostereoscopic screen comprising a matrix of pixels and a lens array positioned on top of the matrix, the array having a pitch P determined from a known pitch P' of a screen intended to be observed in direct vision.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] DESCRIPTION

[0002] AUTOSTEREOSCOPIC HEAD-UP DISPLAY SYSTEM

[0003] Technical field of the invention

[0004] The invention relates to an autostereoscopic system, of the head-up display type, allowing at least one observer positioned in front of the display system to observe an aerial and dematerialized projection of an autostereoscopic image.

[0005] Technological background

[0006] Autostereoscopy is a technique for displaying three-dimensional images without requiring the viewer to wear special glasses. This technique is known, in particular, from patent documents WO2006 / 024764, WO2014 / 041504, WO2013 / 140363, WO2014 / 016768, WO2019207235 and WO2022175052 in the name of the applicant.

[0007] Generally speaking, an autostereoscopic image consists of a plurality of bands of elementary images nested according to a predetermined mixing scheme, corresponding to views of the same object or the same scene from different points of view. A selector device, typically consisting of a network of cylindrical lenticules or a parallax barrier, is arranged in front of the display screen so as to allow the projection of a pair of elementary images corresponding to two different points of view of the scene, respectively towards the two eyes of the observer, which creates an impression of relief in the brain of the observer.

[0008] Autostereoscopic displays typically result from the addition of a glass optical component to the surface of an LCD panel. The size, thickness, and weight of the glass are proportional to the size of the display. In practice, manufacturing and mounting a lenticular array on a display larger than 2 m is so challenging that manufacturers rarely offer larger solutions.

[0009] Furthermore, it is very rarely possible to display content whose total depth exceeds the diagonal of the screen, sharply and without ghosting. The content must therefore be designed to limit its volume. As a result, multi-camera systems, whether physical hardware for shooting or software cameras, are often associated with geometric parameterization models, which correlate the stereoscopic base and the focal length, in order to control the distance at which the most distant backgrounds are located in a scene. The largest autostereoscopic screens available can display a scene with a maximum depth of 3 m.

[0010] The inventors sought to overcome the limitations of current autostereoscopic screens to propose a solution allowing the projection of large images with a very large depth of field.

[0011] Objectives of the invention

[0012] The invention thus aims to provide an autostereoscopic system which makes it possible to project large images (for example 4 meters wide) with a very large depth of field (for example 100 meters deep).

[0013] The invention also aims to provide an autostereoscopic system which allows an observer to benefit from binocular vision close to reality.

[0014] The invention also aims to provide such a system which makes it possible to display content which can maintain orthostereoscopic proportions.

[0015] The invention also aims to provide, in at least one embodiment, such a system which allows consistency of the proportions of the autostereoscopic image projected by the system with the proportions of the real elements of the environment close to the system.

[0016] The invention also aims to provide, in at least one embodiment, such a system which can be used for augmented reality applications.

[0017] The invention also aims to provide, in at least one embodiment, a compact autostereoscopic system, which can for example be used for automotive applications.

[0018] The invention also aims to provide a versatile system which can be used in different configurations for various applications.

[0019] Statement of the invention

[0020] To do this, the invention relates to a system for the dematerialized projection of an autostereoscopic image intended for an observer whose eyes are positioned within a predetermined three-dimensional space, called an eye box, having a predetermined width L, at least greater than the average interpupillary distance of an observer and preferably greater than the average width of a human being's head.

[0021] The system according to the invention is characterized in that it comprises: an optical device comprising at least one convergent optical component with behavior identical to a concave mirror of radius of curvature R and focal length F, said optical device being arranged relative to said eye box so as to be able to direct the light rays that it receives towards a viewing window observable from said eye box, an autostereoscopic screen arranged relative to said optical device so that the light rays that it emits can reach said viewing window, after reflection on said convergent optical component, and having traveled a distance d less than F, said autostereoscopic screen further comprising: o a matrix of pixels of N rows and M columns, each pixel being composed of a plurality of sub-pixels of different colors, o a lenticular network surmounting said matrix and having a pitch P determined from a pitch P',said nominal pitch, of an autostereoscopic screen, said nominal screen, having usage characteristics identical to those of the system screen and intended to be observed in direct vision at a distance corresponding to the usage distance of said system screen, by the formula P=P'.( l+C / (S. j) where C is the number of parts of viewpoints visible simultaneously from said usage distance inside said eye box, when said nominal screen of pitch P' is arranged in said projection system in place of said screen, and S is the number of different viewpoints of the image addressed by each pixel of said pixel matrix,

[0022] The system according to the invention thus allows an observer placing his eyes within a predetermined three-dimensional space, called an eye box, to perceive a large-scale image, from a smaller-scale autostereoscopic screen (for example a 5.5-inch (13.97 cm) or 13.3-inch (33.782 cm) screen), and whose image has a large depth of field.

[0023] The observer benefits from a relief amplitude unmatched by the autostereoscopic screens of the prior art and from a large-sized image whereas the autostereoscopic screen, which he does not perceive directly, may be of reduced size.

[0024] To achieve this result, the invention uses a specific autostereoscopic screen, arranged in relation to the optical device, in such a way that its reflection appears very enlarged behind the converging optical component, or behind a front or semi-transparent plane mirror allowing an angle return of the screen's reflection.

[0025] The viewing window observable from said eye box and through which the observer observes the scene in relief may be physically delimited by the converging optical component or be formed by the reflection of the converging optical component in a front-facing mirror or a semi-transparent mirror inclined facing the observer and the converging optical component, preferably at an angle close to 45°.

[0026] Furthermore, the autostereoscopic screen is separated from the converging optical component (which behaves identically to a concave mirror of radius R and focal length F) by a distance d less than the focal length F of the optical component. When the distance from the screen to the optical component is strictly less than its focal length (equal to R / 2 where R denotes the radius of the mirror), it thus acts as a magnifying mirror. The screen is then reflected behind the optical component, in a more or less enlarged way depending on its distance.

[0027] The system according to the invention thus implements a specific autostereoscopic screen specially designed for this sole purpose, to allow observation of the dematerialized reflection of an autostereoscopic image reflected by a converging optical component. Such a converging optical component is for example a concave mirror or a holographic optic. Throughout the following, the terminology of concave mirror is mainly used to facilitate reading, but it is understood that this concave mirror can be replaced by a holographic optic without modifying the technical effects of the invention.

[0028] In particular, an autostereoscopic screen designed for direct observation is not suitable for use within a device implementing a reflection of the screen on a concave mirror.

[0029] Indeed, such a screen dematerialization device must make it possible to find in the main lobe of the screen all the targeted characteristics: number of viewpoints, flat tint distance and distribution of viewpoints on the screen pixel matrix.

[0030] The flat tone distance, which results from the moiré theory, refers to the distance from the screen from which it is possible to observe only one of the multiple viewpoints of the image over the entire screen surface (regardless of the number of viewpoints in the image). This distance is unique for each autostereoscopic screen model.

[0031] At the flat tint distance, an observer can see successively, with a single eye, the series of viewpoints used, which is repeated across the entire width of the screen. Each of the series thus observed corresponds to a lobe. Care must be taken to ensure that both eyes of the observer are in the same lobe.

[0032] For example, we want the screen to be observed at the preferred distance of 1 m (in other words, the screen has a flat tint distance of 1 m). We consider that the average distance between the two eyes of the observer is 6.5 cm. We want a succession of viewpoints every 3.25 cm of movement parallel to the plane of the screen at the flat tint distance. With 10 viewpoints, the lobe is 3.25 cm X 10, or 32.5 cm, this is the central lobe 0. After which, the series of 10 viewpoints reappears in the same order on each side of the main lobe. This forms the two lobes -1 and +1. And so on, moving further and further away from lobe 0 in continuity and right / left symmetry. Lobes -2 and +2 etc.

[0033] Practice shows that a concave mirror alters all of these characteristics so that an autostereoscopic screen designed for direct vision is little or not suitable for use in a device implementing a concave mirror.

[0034] The deformations induced by the concave mirror require the introduction of new rules for defining the parameters of the lenticular network, different from those of a network in direct vision. In order for the immaterial double reflected from the screen to have the desired autostereoscopic properties, it is necessary to modify the characteristics of the lenticular network of the screen. The presence of a concave mirror transforms all the parameters described previously. To maintain the desired characteristics, the pitch of the network must be increased compared to the pitch of an equivalent screen that would be observed directly without reflection by a concave mirror. The inventors have succeeded in determining the level of correction of the pitch to be made to allow this observation reflected in a concave mirror.

[0035] This increase in the pitch is obtained according to the invention from the pitch P' of an autostereoscopic screen, called a nominal screen, having usage characteristics identical to those of the system screen (i.e., same flat tint distance, same number of viewpoints, same focal length, etc.) and intended to be observed in direct vision at a distance corresponding to the usage distance of said system screen, by the formula P=P' .( I +C / (S. )) where C is the number of parts of viewpoints visible simultaneously from said usage distance (flat tint distance) inside the eye box, when said nominal screen of pitch P' is arranged in said projection system in place of said screen, S is the number of different viewpoints of the image addressed by a pixel of the pixel matrix and M the horizontal resolution of the pixel matrix.

[0036] For example, for sub-pixel addressing from a pixel matrix where each pixel has 3 sub-pixels of different colors, then S is equal to 3. Thus, the pitch P is obtained by the formula P=P' .(1+C / 3.M). If the same matrix is ​​used for whole-pixel addressing, then S is equal to 1 and the pitch P is obtained by the formula P=P' .(I+C / A7).

[0037] Throughout the following and to facilitate reading, we consider sub-pixel addressing and a matrix in which each pixel is formed of 3 sub-pixels, it being understood that the technical teachings provided apply mutatis mutandis to full pixel addressing and / or to matrices comprising a number of sub-pixels distinct from 3.

[0038] If a color pattern displayed on a nominal autostereoscopic screen (whose usage parameters are identical to those of the system) is reflected in a concave mirror, the reflected image of this color pattern, in return, presents at the initially chosen flat tint a number of color bars corresponding to a projected pitch having gained several lenses for the entire network compared to the screen.

[0039] For example, for a 10-viewpoint screen, if the observer perceives, at any distance from the screen, 10 color bars (assuming the screen displays one color per viewpoint), this means that he has deviated from the flat tint distance to the point that the projected pitch has increased or decreased by 10 sub-pixels, that is, by the pitch of one lens. If the observer perceives 20 color bars, it is because the projected pitch has increased or decreased by 20 sub-pixels, that is, by two lenses. If the screen displays a single color, it is because the observer is precisely at the flat tint distance.

[0040] To the extent that it is possible to know (by manufacturing) very exactly the pitch of the lenticular network of a nominal screen, for example to 100 emeto within a micron, it becomes possible to correct the effect of the concave mirror on the optical path which connects the surface of the real screen to the user's eyes via the real dematerialized conjugated image, by machining a new lenticular network with the corrected pitch.

[0041] We see that this amounts to creating a flat tint in direct vision outside the projection device at a very long distance from the screen. This therefore amounts to increasing the pitch of the lenticular network compared to use in direct vision.

[0042] If a nominal 10-point screen placed in the projection device allows 12 color bars to be viewed at the desired flat tint distance of 1 m for example (assuming the screen displays 10 distinct colors, each color corresponding to a point-of-view), and since the pitch of a lens corresponds to 10 colors in direct vision, 12 color bars in reflection in the concave mirror represent 12 / 10 emes of the pitch of the lenses. It is necessary to increase the pitch of the lenticular network by this value to adapt it to the device according to the invention and to divide it by the total number of lenses to calculate the exact incidence on the pitch which will be applied to the machining of the lenticular network of the screen intended to be arranged in the projection device.

[0043] This makes it possible to obtain a system whose dematerialized autostereoscopic image reflected by the mirror makes it possible to find all the characteristics expected in the central lobe.

[0044] For the first time, it becomes possible to simply determine the pitch correction to be made to a nominal autostereoscopic screen, for its integration into a device implementing a converging optical component such as a concave mirror, by knowing the pitch of the nominal screen and by determining the number of parts of viewpoints visible simultaneously from said usage distance inside said eye box, when this screen is housed in the device according to the invention.

[0045] It therefore becomes possible for the first time to use an autostereoscopic screen in association with a concave mirror.

[0046] As seen previously, this determination of the number of parts of viewpoints visible simultaneously can be facilitated by displaying a color chart on the screen, which makes it possible to count, from said eye box corresponding to the distance of use of the screen, the number of color bands visible simultaneously.

[0047] Advantageously and according to the invention, said lenticular network of said autostereoscopic screen forms a plurality of zones in front of the screen, called lobes, in which all the different viewpoints of the image follow one another at a preferred distance from the screen, called flat tint distance, corresponding to the distance at which each eye of the observer perceives only one viewpoint among all the viewpoints of the image over the entire surface of the screen and said network is perfectly focused in the central lobe so as to avoid any overlapping of viewpoints only in the central lobe.

[0048] In this advantageous variant, the lenticular array is perfectly focused in the central lobe. The notion of a perfectly focused array in the central lobe means that there is no overlap of viewpoints in the central lobe.

[0049] Indeed, it is known that an autostereoscopic screen is characterized in particular by its separating power, that is to say by its capacity to limit or eliminate the overlap between points of view, generating ghosts and double images. The LCD screens that are used to design autostereoscopic screens are generally not designed by the original manufacturers with the perspective of subsequently accommodating a lenticular network on their surface. The structure of their panel, made up of pixels and sub-pixels of colors, can have very varied shapes. Each detail of a pixel, its geometry, its topology, that of its sub-pixels as well as the black mask which surrounds them is magnified when it crosses the optical axis of the lenses forming the micro-lenticular network placed on its surface. Contagions can occur and generate mixtures between neighboring points of view or luminous inhomogeneities.The final optical quality of a screen therefore depends on its resolving power.

[0050] Furthermore, optical components do not have uniform optical properties at all angles of incidence of the observer's gaze, due to variations in their front and side focus. Optically speaking, the lobes follow one another but do not exactly resemble each other. In general, autostereoscopic screen designers favor the two secondary lobes adjacent to the central lobe, so as to optimize two lobes rather than just one. The focal length of the central lobe (No. 0) is a little shorter, those of the middle lobes No. -1 and No. +1 are perfect, while those of the lobes No. -2 and No. +2 are a little longer. The overlap between viewpoints resulting from these local focus variations does not allow the ideal focal length to be obtained from all angles. In the case of the present invention, it was decided to optimize the central lobe only and to ensure that its focal length is perfect, to the detriment of the other lobes.

[0051] The system according to the invention introduces a constraint on the placement of the observer's eyes in order to optimize the resolving power of the screen and offer an experience of unparalleled relief and depth.

[0052] Used in flat tint and viewed from the front, the resolving power of a lenticular array perfectly focused in the central lobe is optimal and allows for exceptional depths of field without ghosting.

[0053] The virtual image of the autostereoscopic screen of a system according to the invention, more or less enlarged, is visible in the central lobe but not from the side in the secondary lobes.

[0054] The depth of field made possible under these conditions makes it possible to overturn the rules of composition of relief scenes which are usually imposed in autostereoscopy.

[0055] The virtual image perceived through the "porthole" formed by the concave mirror can even reproduce the proportions of the surrounding real physical space. The orthoscopy between the real and the virtual is of quality.

[0056] Under these conditions and in an augmented reality configuration with a semi-transparent plane mirror, it becomes possible to project virtual objects into physical space on the scale of the real world, at depths unimaginable until now.

[0057] The relief performance of the system is very favorable: a small disparity results in the perception of a very large volume.

[0058] While the same relief scene with little disparity in the most opposite planes of the image gives a modest sensation of volume on a small screen seen up close, it delivers a considerable depth of field and perfectly superimposable on the real world, without effort or fatigue, when the virtual image of this same screen is enlarged and moved back thanks to its reflection in the concave mirror.

[0059] Whether the concave mirror is viewed directly or by reflection in a front-facing plane mirror, a semi-transparent mirror, or even a vehicle's windshield, the size of the window through and beyond which the viewer can observe the scene is limited by the physical size of the concave mirror. Consequently, it is not advisable to use mirrors that are too small. A 30 cm wide mirror placed at a distance of approximately 1 m seems to be a minimum size for perceiving a scene in relief by binocular vision, whether in augmented reality in combination with a semi-transparent mirror or in direct vision.

[0060] Preferably, the lenticular array is further configured so that the successive viewpoints of the projected central lobe cover the width L of the eye box. Thus, no lobe passage is observable in the eye box.

[0061] Different configurations are possible to benefit from the advantages of a system according to the invention.

[0062] Thus and according to a first embodiment, said converging optical component and said autostereoscopic screen extend horizontally and are arranged on the same vertical axis, said optical device further comprising a semi-transparent mirror having a reflective surface oriented towards said eye box and towards said converging optical component, said semi-transparent mirror being inclined at an angle of 45° relative to the optical axis of said converging optical component which extends vertically, and arranged between said screen and said converging optical component.

[0063] Thus and according to this embodiment, the screen and the converging optical component (concave mirror or holographic optics) face each other and are each arranged on the same axis which corresponds to the optical axis of the converging optical component. A second semi-transparent mirror is arranged at 45° between the converging optical component and the autostereoscopic screen, with the semi-reflecting front face oriented towards the converging optical component and turned towards the eye box.

[0064] Thus, the light emitted by the screen passes through the semi-transparent mirror on the non-reflecting side. The light is then reflected by the concave mirror and this reflection is in turn reflected at 45° by the reflective front face of the semi-transparent mirror. It should be noted that some light is lost each time it passes through the semi-transparent mirror. Therefore, it is preferable to have a very bright screen to compensate for these successive line light losses, which are equivalent to 75% of the original light from the screen.

[0065] Seen through the semi-transparent mirror, virtual images are superimposed on the real world and can produce an illusion of augmented reality.

[0066] If the system is placed in front of a black background, the reflectivity of the mirror is much better, the relief image is much brighter and more contrasted, but augmented reality is no longer possible.

[0067] This configuration has a drawback resulting from the "on-axis" architecture of the system and which results in the fact that the reflection of the observer's face can interfere with the relief image. When the observer himself is illuminated, the light he reflects follows the same optical path in reverse. It is reflected on the reflective surface of the semi-transparent mirror at 45° in front of him, is partly returned to the concave mirror, then conjugated with the reflection of the screen and returns to the eyes of the spectator. When he stands at a distance less than the focal length of the concave mirror, he then perceives the greatly enlarged parasitic reflection of his face in the background of the scene. If he stands exactly at the focal length of the mirror, the reflection of his face is sent to infinity and is no longer perceptible. On the other hand, if he moves back, the inverted reflection of his face in reduced size again interferes with the relief scene.

[0068] For some use cases, and particularly when ambient light is controlled, this system is nevertheless of very practical interest because it allows easy adjustment of all the parameters of the relief scene so that they coincide with the real environment. In addition, since the screen and the concave mirror are centered on the axis, this architecture minimizes the spherical deformations inherent in the use of a concave mirror used off-axis.

[0069] According to a second embodiment, said converging optical component and said autostereoscopic screen extend vertically, facing each other, vertically offset from each other, and arranged relative to the eye box such that the eye box is located behind and above the autostereoscopic screen, said converging optical component whose optical axis extends horizontally being arranged facing the eye box.

[0070] This second configuration eliminates the parasitic reflections of the observer observable with the first configuration. In addition, this second configuration preserves the initial brightness of the screen but does not allow use in augmented reality.

[0071] The screen and the concave mirror are arranged horizontally in a line, one behind the other. The screen has its back to the viewer and the concave mirror faces him.

[0072] The user positions himself behind the screen and looks at the concave mirror located behind it, a little higher than the screen. The "eye box" is located above the screen.

[0073] The system operates "off-axis." The concave mirror is oriented so that its central horizontal axis cuts the space into two superimposed volumes. The screen, facing the mirror, occupies the lower volume. It is tilted so that its reflection in the concave mirror is upright and allows the user to see a perfectly vertical, enlarged virtual image.

[0074] It is possible to further offset the system to enlarge the "eye box." The screen can be lowered a little further and reoriented relative to the concave mirror. This results in greater distortions of the imaged scene. When using a concave mirror with a longer focal length, these distortions remain acceptable.

[0075] The viewer looks at the enlarged reflection of the screen through the concave mirror's "window" and ignores the physical screen.

[0076] Thanks to this "off-axis" architecture, unwanted reflections are eliminated. Even when the user is illuminated, the light it reflects takes the opposite optical path and ends up on the screen, which reflects almost nothing back.

[0077] According to a third embodiment, said optical device further comprises a semi-transparent mirror arranged on the optical axis of said converging optical component, having a reflecting surface oriented towards said eye box and towards the converging optical component, said semi-transparent mirror being inclined at an angle of 45° relative to the optical axis of said converging optical component which extends vertically, said screen being arranged relative to the eye box such that the eye box is located at the rear of said screen which faces said semi-transparent mirror, and vertically offset relative to the reflection of the converging optical component in said semi-transparent mirror.

[0078] This third configuration allows for the elimination of unwanted reflections, while offering the possibility of projecting relief content in augmented reality.

[0079] Thus, as in the second configuration, the screen is arranged with its back to the eye box and slightly inclined upwards relative to the vertical.

[0080] Instead of facing it, the concave mirror is here placed flat in front of the screen.

[0081] A semi-transparent plane mirror inclined at 45° is arranged above the concave mirror, with its reflective face facing this mirror and the screen. It forms, by reflection, a virtual image of the concave mirror at the same place where it is physically located in the second configuration.

[0082] The screen is reflected in the virtual image of the concave mirror under the same conditions as before, but this time in augmented reality.

[0083] The viewer sees the environment through the semi-transparent mirror tilted at 45°, on which the objects on a black background displayed in relief on the screen are superimposed.

[0084] As in the first configuration, this is at the expense of the original brightness of the screen, divided here by a factor of 4. Not only is the reflection of the concave mirror in the semi-transparent mirror at 45° attenuated by a factor of 2, but the light emitted by the screen also passes through this same mirror, which absorbs half of it.

[0085] It is therefore preferable to use a screen 4 times brighter to achieve a light intensity comparable to that of a screen seen live.

[0086] According to a fourth embodiment, said converging optical component and said autostereoscopic screen extend opposite each other, horizontally offset from each other, and inclined relative to the horizontal, said optical device further comprising a semi-transparent mirror having a reflective surface oriented towards said eye box and towards said converging optical component, said semi-transparent mirror being inclined at an angle of 45° relative to the vertical and arranged so that the light rays from the screen can reach the converging optical component without passing through the semi-transparent mirror.

[0087] This fourth configuration allows use in augmented reality while limiting the reduction in brightness.

[0088] This is an "off-axis" variant of the first embodiment. Thus, the semi-transparent plane mirror remains essential for generating an augmented reality experience but it is no longer aligned with the screen, so as to prevent the light from the screen from passing through the plane mirror before being reflected in the concave mirror.

[0089] The screen is shifted from the plane mirror after slightly tilting the concave mirror / plane mirror pair forward. The screen is shifted forward until it no longer overhangs the plane mirror. It is then tilted backward so that it remains facing the concave mirror and parallel to it. The rear of the screen is roughly aligned with the front of the concave mirror.

[0090] The orthogonal projection of the center of the screen onto the concave mirror is no longer at its center. We are therefore in the conditions of an "off-axis" projection. Just as in the second and third embodiments, this avoids contaminating the screen reflection with the parasitic reflection of the viewer's face.

[0091] The light from the screen no longer passes through the plane mirror before being reflected in the concave mirror and is therefore no longer attenuated.

[0092] The enlarged and receding reflection of the screen in the concave mirror is reflected back towards the semi-transparent plane mirror, forming an angle close to 45° with respect to the vertical. Facing the plane mirror, the user sees this enlarged reflection through the virtual window formed by the reflection of the concave mirror. Its brightness has indeed been reduced this time, but the total loss is now only 50%, not 75%.

[0093] The perceived distance and size of the projected screen from this virtual window depends on the distance between the screen and the concave mirror. For example, as a 13.3-inch screen is moved away from the concave mirror, its projection can be compared to a 32-inch screen seen from 2 m, a 55-inch screen seen from 3 m, a 65-inch screen seen from 4 m, or a 5 m wide screen seen from 12 m.

[0094] The off-axis reflection of the screen in the concave mirror, however, causes a geometric distortion of the content, similar to a slight bean-shaped distortion. It is difficult to identify and not very noticeable in most use cases. If necessary, it would be possible to make minor corrections to the images to compensate for this distortion.

[0095] Since the light from the screen completely escapes the flat mirror and no longer needs to pass through it, it is no longer essential to use a semi-transparent mirror to reflect the concave mirror. A 100% front-facing mirror can be used if augmented reality is not the desired effect and to maintain full screen brightness. The space behind the semi-transparent mirror can also be blacked out to enhance contrasts and accentuate its reflectivity.

[0096] According to a variant of this fourth embodiment, the system further comprises a stereoscopic camera arranged behind the semi-transparent mirror facing said eye box so as to be able to film said observer, said semi-transparent mirror having a black rear face so that the camera is not visible to the observer.

[0097] In this variant, a stereoscopic camera is placed behind the semi-transparent plane mirror, facing the user. The back of the mirror around the lens is completely blacked out, so that no light can pass through it. The user therefore does not see the camera filming him from the front.

[0098] The shooting axis is adjusted to match the observer's gaze axis. This makes it possible to film in stereoscopy without worrying about "false gaze", because without their knowledge, the user is always looking straight at the camera. In doing so, their interlocutor has the impression of being looked at in the eyes and vice versa. A tracking camera can be placed at the lower edge of the plane mirror, facing the user. Pupil detection makes it possible to dynamically adjust the content displayed by the autostereoscopic screen.

[0099] According to a fifth embodiment and for an automotive, railway or aeronautical application, said optical device further comprises a windshield inclined relative to a vertical axis towards said eye box and a semi-transparent mirror arranged under the windshield and having a reflective surface oriented towards said windshield, and said converging optical component extends vertically under the windshield and said autostereoscopic screen extends horizontally facing the semi-transparent mirror.

[0100] This configuration makes it possible to form an augmented reality device for a vehicle that can overlay information on the road.

[0101] The proposed configuration is a variant of the third embodiment to obtain an augmented reality effect without parasitic reflection.

[0102] The screen is fixed horizontally, for example under the dashboard, face down.

[0103] The concave mirror is placed vertically in line with the front edge of the screen, with the reflective face facing backwards.

[0104] The plane mirror is inclined at 45°, with the reflective side facing upwards. It starts at the bottom of the concave mirror and rises towards the rear of the opening in the dashboard.

[0105] The light rays emitted by the screen are first reflected by the 45° mirror towards the concave mirror, which in turn reflects them a second time into the 45° mirror. Thanks to this angle deflection, the rays return upwards and pass through the dashboard through an opening made there. They then meet the windshield, which finally reflects them towards the driver's eyes. The driver then sees an enlarged three-dimensional image in front of the windshield. The driver's driving position defines the position of the eye box, from which the other parameters are determined.

[0106] List of figures Other aims, characteristics and advantages of the invention will appear on reading the following description given solely for non-limiting purposes and which refers to the appended figures in which:

[0107] - figure 1 is a schematic view of a projection system according to a first embodiment of the invention,

[0108] - figure 2 is a schematic view of a projection system according to a second embodiment of the invention,

[0109] - figure 3 is a schematic view of a projection system according to a third embodiment of the invention,

[0110] - figure 4 is a schematic view of a projection system according to a fourth embodiment of the invention,

[0111] - figure 5 is a schematic view of a projection system according to a fifth embodiment of the invention,

[0112] - Figure 6 is a schematic view of an autostereoscopic screen of a projection system according to one embodiment of the invention.

[0113] Detailed description of an embodiment of the invention

[0114] In the figures, scales and proportions are not strictly respected, for the purposes of illustration and clarity.

[0115] Identical, similar or analogous elements are designated by the same references in all figures.

[0116] Regardless of the embodiment, the autostereoscopic projection system according to the invention comprises an optical device comprising at least one concave mirror 30 having a radius of curvature R and a focal length F. This optical device is arranged relative to a predetermined three-dimensional space (eye box 50) which defines the space within which the observer must place his eyes to perceive the autostereoscopic image projected by the system according to the invention, so as to be able to direct the light rays that he receives towards a viewing window observable from the eye box. As indicated previously, according to another embodiment, the concave mirror can be replaced by a holographic optic which then forms the convergent optical component.

[0117] According to the embodiment of figures 1, 3, 4 and 5, the optical device further comprises a semi-transparent mirror 20.

[0118] The system according to the invention also comprises, whatever the embodiment, an autostereoscopic screen 10 arranged relative to the optical device so that the light rays which it emits can reach the concave mirror 30, either directly or after reflection on the semi-transparent mirror 20.

[0119] The autostereoscopic screen 10 is separated from the concave mirror 30 by a distance d less than F.

[0120] The screen 10 further comprises a matrix 10a of pixels arranged in rows and columns, each pixel being composed of a plurality of sub-pixels of different colors each assigned to a viewpoint of the image.

[0121] The screen also comprises a lenticular network 10b which surmounts the matrix and each lens of which is inclined at a non-zero angle relative to the direction of the columns of the matrix. This aspect of the invention is known and is not shown in the figures. It is also possible to have a vertical network.

[0122] The lenticular network of the screen 10 also has the particularity of being perfectly focused in the central lobe so as to avoid any overlapping of points of view only in the central lobe.

[0123] In particular, the autostereoscopic screen comprises a matrix of pixels arranged in rows and columns, each pixel being composed of a plurality of sub-pixels of different colors each assigned to a viewpoint of the autostereoscopic image to be displayed and a lenticular network which surmounts the matrix. Each lens is inclined, in the embodiment of the figures, by a non-zero angle relative to the direction of the columns of the matrix (for example 18°). As indicated previously, however, nothing prevents the use of a vertical network. As indicated previously, nothing prevents the use of pixel addressing of the viewpoints of the image. Throughout the following, it is considered that S is equal to 3 for sub-pixel addressing of pixels each formed of three sub-pixels of different colors.

[0124] Figure 6 schematically illustrates an autostereoscopic screen 10 comprising a matrix of pixels 10a arranged in rows and columns, each pixel being composed of a plurality of sub-pixels of different colors each assigned to a viewpoint of the autostereoscopic image to be displayed. The screen also comprises a lenticular network 10b which surmounts the matrix 10a.

[0125] The pitch P of the screen network is determined from the pitch P', called the nominal pitch, of an autostereoscopic screen, called the nominal screen, having usage characteristics identical to those of the system screen and intended to be observed in direct vision at a distance corresponding to the usage distance of the system screen, by the formula P=P'.(1+C / (SM)) where C is the number of parts of viewpoints visible simultaneously from the usage distance inside the eye box, when said nominal screen of pitch P' is arranged in said projection system in place of said screen, S is the number of viewpoints addressed by each pixel of the pixel matrix and M the horizontal resolution of the matrix.

[0126] For example, if we consider a 13.3 inch (33.782 cm) screen with 10 viewpoints and a resolution of 3840 x 2160. This screen is placed at a distance of 700 mm from the concave mirror in rectangular format of 350 mm by 250 mm, whose focal length is 750 mm and the radius of curvature is 1500 mm. Once placed in the system, the observer sees from the eye box 12 color bars (assuming that one color per viewpoint is displayed on the screen). The pitch of a lens corresponding to 10 colors in direct vision, 12 color bars in reflection in the concave mirror represent the 12 / 10 emes of the lentil step.

[0127] Since we display one image viewpoint per subpixel, the number of lenses in the screen array considered is equal to (3840 pixels x 3) / 10, i.e. 1152 lenses.

[0128] The total step correction is therefore equal to 12 / 10 = 1.2 lenses.

[0129] This corresponds to a correction per lens equal to 1.2 / 1152 = 0.00104.

[0130] In other words, the pitch of the lenses must therefore be increased by 0.1%.

[0131] If the known pitch P' of a lens is 0.240 mm, the necessary pitch correction amounts to adding 0.00024 mm per lens. Although this value of 0.24 microns seems relatively small, its impact is actually considerable for optimal observation of the autostereoscopic image reflected by the concave mirror. This correction is decisive for being able to operate an autostereoscopic screen in reflection in a concave mirror.

[0132] According to one embodiment, a screen with 14 viewpoints is used in steps of 2, which makes it possible to obtain a lobe of 45.5 cm, sufficient to occupy the entire width of the "eye box". The exceptional resolving power obtained in the central lobe makes it possible to very comfortably see scenes in relief extending continuously from 1 m to 100 m in depth. Within the limits of a lateral displacement of about twenty cm on either side of the center of the "eye box", the 14 viewpoints also offer a horizontal parallax in accordance with reality. When one moves away from the flat tint distance, they also allow the images to recompose themselves in accordance with physiological expectations. These properties are very useful for giving the user a certain latitude of positioning. However, the quality of the sensations is so exceptional at the flat tint that it is intuitive to place oneself there spontaneously.

[0133] According to one embodiment, the concave mirror has a radius of 1.5 m and a focal length of 0.75 m. The distance d between the screen 10 and the concave mirror 20 is fixed at 0.8 m.

[0134] The various components of the system according to the invention (concave mirror, autostereoscopic screen and semi-transparent mirror) can be housed in a housing not shown in the figures or arranged relative to each other in a dedicated observation space corresponding to the intended use. The observation area can depend on the intended use. Thus, in the embodiment of Figure 5 intended for automotive use, the eye box 50 is determined by the position of the driver in the motor vehicle in which the system according to the invention is installed.

[0135] In Figure 1, the system comprises a concave mirror 30 and an autostereoscopic screen 10 extending horizontally and arranged on the same vertical axis represented by a dotted line. In addition, the system comprises a semi-transparent mirror 20 having a reflective surface oriented towards the eye box 50 and towards the concave mirror 30, inclined at an angle of 45° relative to the optical axis of the concave mirror and arranged between the screen 10 and the concave mirror 30.

[0136] As indicated previously, according to this embodiment, the light emitted by the screen 10 passes through the semi-transparent mirror 20 on the non-reflecting side. The light is then reflected by the concave mirror 20 and this reflection is in turn reflected at 45° by the reflective front face of the semi-transparent mirror 20. The viewer whose eyes are placed in the eye box 50 can thus perceive the image reflected by the semi-transparent mirror 20.

[0137] According to one embodiment, the screen is a 13.3-inch 4K screen and the concave mirror is a mirror with a focal length of 75 cm, open at F / 2 and sufficiently wide (37.5 cm for example).

[0138] In Figure 2, the system comprises a concave mirror 30 and an autostereoscopic screen 10 which each extend vertically, facing each other. They are further vertically offset from each other, and arranged relative to the eye box 50 such that the eye box is located behind and above the autostereoscopic screen 10. The concave mirror 30 is arranged facing the eye box 50.

[0139] The concave mirror is oriented so that its median horizontal axis, represented in Figure 2 by a dotted line, cuts the space into two superimposed volumes. The screen 10 turned towards the mirror 30, occupies the lower volume. It can be slightly inclined so that its reflection in the concave mirror 30 is straightened and allows the user to see a perfectly vertical enlarged virtual image.

[0140] In Figure 3, the system comprises a semi-transparent mirror 20 arranged on the optical axis of the concave mirror 30 and which has a reflective surface oriented towards the eye box 50 and towards the concave mirror 30.

[0141] This semi-transparent mirror 20 is inclined at an angle of 45° relative to the optical axis of the concave mirror, represented in the figure by a vertical dotted line. The screen 10 is arranged relative to the eye box 50 in such a way that the eye box is located at the rear of the screen which faces the semi-transparent mirror 20. Furthermore, the screen 10 is vertically offset relative to the reflection of the concave mirror 30 in the semi-transparent mirror 20.

[0142] As previously indicated, this embodiment makes it possible to eliminate parasitic reflections while offering the possibility of projecting relief content in augmented reality.

[0143] In Figure 4, the system comprises a concave mirror 30 and an autostereoscopic screen 10 which extend opposite each other, horizontally offset from each other, and inclined relative to the horizontal.

[0144] The system further comprises a semi-transparent mirror 20 having a reflective surface oriented towards the eye box 50 and towards the concave mirror 30. The semi-transparent mirror 20 is inclined at an angle of 45° relative to the vertical and arranged so that the light rays from the screen can reach the concave mirror without passing through the semi-transparent mirror.

[0145] As previously indicated, this embodiment allows use in augmented reality while limiting the reduction in brightness.

[0146] It is also possible, as illustrated in Figure 4, to have an opaque mask 60 behind the semi-transparent mirror to enhance contrasts and accentuate reflectivity. Of course, with this variant, augmented reality is not possible.

[0147] The system of Figure 5 further comprises a windshield 40 inclined relative to a vertical axis, for example at an angle of 37°, towards the eye box 50 and a semi-transparent mirror 20 arranged under the windshield 40 and having a reflective surface oriented towards the windshield 40. Furthermore, the concave mirror 30 extends vertically under the windshield 40 and the autostereoscopic screen 10 extends horizontally facing the semi-transparent mirror 20.

[0148] When used in a motor vehicle, the screen 10 is fixed horizontally under the dashboard of the vehicle, facing downwards.

[0149] The plane mirror is inclined at 45°, with the reflective side facing upwards. It starts at the bottom of the concave mirror and rises towards the rear of the opening in the dashboard.

[0150] This embodiment thus makes it possible to form an augmented reality device for a vehicle which can superimpose information on the road.

[0151] The light rays emitted by the screen 10 are reflected a first time by the 45° mirror towards the concave mirror 30, which in turn reflects them a second time in the 45° mirror. Thanks to this angle return, the rays go back upwards and pass through the dashboard through the opening which has been arranged therein. They then meet the windshield 40, which finally reflects them towards the driver's eyes arranged in the eye box 50. The driver then sees an enlarged three-dimensional image in front of the windshield 40

Claims

CLAIMS 1. System for dematerialized projection of an autostereoscopic image intended for an observer whose eyes are positioned within a predetermined three-dimensional space, called an eye box (50), having a predetermined width L, at least greater than the average inter-pupillary distance of an observer and preferably greater than the average width of a human head, said system being characterized in that it comprises: an optical device comprising at least one converging optical component (30) with behavior identical to a concave mirror having a radius of curvature R and a focal length F, said optical device being arranged relative to said eye box (50) so as to be able to direct the light rays that it receives towards a viewing window observable from said eye box,an autostereoscopic screen (10) arranged relative to said optical device so that the light rays it emits can reach said viewing window, after reflection on said converging optical component (30), and having traveled a distance d less than F, said autostereoscopic screen (10) further comprising: o a pixel matrix of N rows and M columns, each pixel being composed of a plurality of sub-pixels of different colors, o a lenticular network surmounting said pixel matrix, and having a pitch P determined from a pitch P called nominal pitch, of an autostereoscopic screen, called nominal screen, having usage characteristics identical to those of the screen of the system and intended to be observed in direct vision at a distance corresponding to the usage distance of said screen of the system, by the formula P=P' .(l+C / (SJVf)) where C is the number of parts of visible viewpoints, simultaneously from said usage distance inside said eye box, when said nominal screen of pitch P' is arranged in said projection system in place of said screen, and S is the number of different viewpoints addressed by each pixel of said matrix.

2. System according to claim 1, characterized in that said lenticular network of said autostereoscopic screen (10) forms a plurality of zones in front of the screen, called lobes, in which all the different viewpoints of the image follow one another at a preferred distance from the screen, called flat tint distance, corresponding to the distance at which each eye of the observer perceives only one viewpoint among all the viewpoints of the image over the entire surface of the screen and in that said network is perfectly focused in the central lobe so as to avoid any overlapping of viewpoints only in the central lobe.

3. System according to one of claims 1 or 2, characterized in that said converging optical component (30) and said autostereoscopic screen (10) extend horizontally and are arranged on the same vertical axis, said optical device further comprising a semi-transparent mirror (20) having a reflecting surface oriented towards said eye box and towards said converging optical component (30), said semi-transparent mirror (20) being inclined at an angle of 45° relative to the optical axis of said converging optical component which extends vertically, and arranged between said screen and said converging optical component.

4. System according to one of claims 1 or 2, characterized in that said converging optical component (30) and said autostereoscopic screen (10) extend vertically, facing one another, vertically offset from one another, and arranged relative to the eye box in such a way that the eye box is located behind and above the autostereoscopic screen, said converging optical component whose optical axis extends horizontally being arranged facing the eye box.

5. System according to one of claims 1 or 2, characterized in that said optical device further comprises a semi-transparent mirror (20) arranged on the optical axis of said converging optical component (30), having a reflective surface oriented towards said eye box and towards the converging optical component (30), said semi-transparent mirror (20) being inclined at an angle of 45° relative to the optical axis of said converging optical component (30) which extends vertically, said screen (10) being arranged relative to the eye box in such a way that the eye box is located at the rear of said screen (10) which faces said semi-transparent mirror, and vertically offset relative to the reflection of the converging optical component in said semi-transparent mirror.

6. System according to one of claims 1 or 2, characterized in that said converging optical component (30) and said autostereoscopic screen (10) extend opposite one another, horizontally offset from one another, and inclined with respect to the horizontal, said optical device further comprising a semi-transparent mirror (20) having a reflecting surface oriented towards said eye box and towards said converging optical component, said semi-transparent mirror being inclined at an angle of 45° with respect to the vertical and arranged so that the light rays from the screen can reach the converging optical component without passing through the semi-transparent mirror.

7. System according to claim 6, characterized in that it further comprises a stereoscopic camera arranged behind the semi-transparent mirror (20) facing said eye box so as to be able to film said observer, said semi-transparent mirror having a black rear face so that the camera is not visible to the observer.

8. System according to one of claims 1 or 2, characterized in that said optical device further comprises a windshield (40) inclined relative to a vertical axis towards said eye box and a semi-transparent mirror (20) arranged under the windshield and having a reflective surface oriented towards said windshield, and in that said converging optical component (30) extends vertically under the windshield and said autostereoscopic screen (10) extends horizontally facing the semi-transparent mirror.

9. System according to one of the preceding claims, characterized in that said autostereoscopic screen (10) is a 5.5 inch (13.97 cm) or 13.3 inches (33.782 cm).

10. System according to one of claims 1 to 9, characterized in that said convergent optical component (30) is a concave mirror or holographic optics.

Citation Information

Patent Citations

  • Method for displaying an autostereoscopic image having n viewpoints

    WO2006024764A1

  • Method for displaying an autostereoscopic image

    WO2013140363A2

  • Method for autostereoscopic display on a screen having the larger size thereof in the vertical direction

    WO2014016768A1

  • Display screen, in particular for autostereoscopy

    WO2014041504A1

  • System and method for displaying an auto-stereoscopic image with n view points on a mobile display screen

    WO2019207235A1