Three-dimensional display device and method

Abstract

A three-dimensional (3D) display apparatus and method are disclosed. A 3D display device includes: an optical layer including a plurality of optical elements; a projector configured to scan light onto the optical layer; and a processor configured to control a timing at which the projector scans the light onto the optical layer, and generate a 3D image in the viewing space based on the timing at which the light is scanned onto the optical layer.

Description

[0001] This application is a divisional application of the patent application with application number 201911258806.X and invention name “Three-dimensional display device and method” submitted to the State Intellectual Property Office on December 10, 2019. Technical Field

[0002] Methods and apparatuses consistent with example embodiments relate to an apparatus and method for displaying a three-dimensional (3D) image. Background Art

[0003] A head-up display (HUD) system can generate a virtual image in front of the driver and display information in the virtual image, thereby providing a variety of information to the user. For example, the information provided to the driver may include navigation information and instrument panel information (such as vehicle speed, fuel level, and engine revolutions per minute (RPM)). The driver can more easily identify the information displayed in front without diverting his or her sight during driving, thereby improving driving safety. In addition to navigation information and instrument panel information, the HUD system can also use augmented reality (AR) to provide the driver with, for example, lane indicators, construction indicators, accident indicators, and pedestrian detection indicators to assist driving when the field of view is not so clear. Summary of the Invention

[0004] One or more example embodiments may address at least the above problems and / or disadvantages and other disadvantages not described above. Also, an example embodiment is not required to overcome the disadvantages described above, and an example embodiment may not overcome any of the problems described above.

[0005] According to one aspect of the present disclosure, a three-dimensional (3D) display device is provided, comprising: an optical layer comprising a plurality of optical elements; a projector configured to scan light onto the optical layer; and a processor configured to control a timing in which the projector scans light onto the optical layer, and generate a 3D image in a viewing space based on the timing in which the light is scanned onto the optical layer.

[0006] The processor may be further configured to generate a 3D image based on virtual scanned pixels, wherein the virtual scanned pixels are implemented by light scanned according to the time sequence.

[0007] The processor may be further configured to generate a 3D image by controlling the color of the light based on a timing in which the light is scanned onto the optical layer.

[0008] The processor may be further configured to generate a 3D image by controlling a plurality of light sources generating light based on values of scanned pixels corresponding to a timing at which light is scanned onto the optical layer.

[0009] The processor may be further configured to generate a 3D image based on the direction of the light according to the corresponding positional relationship between the plurality of optical elements and the virtual scanning pixels.

[0010] The optical layer may also be configured to refract or reflect light of a first wavelength and transmit light of a second wavelength different from the first wavelength.

[0011] The optical parameters of the optical layer may be determined based on the position of the projector and the position of the viewing space.

[0012] The optical layer may be disposed on or inside the windshield of the vehicle.

[0013] The optical layer may include a holographic optical element (HOE) lens array.

[0014] The HOE lens array may be recorded based on the position of the projector and the position of the viewing space to provide a 3D image in the viewing space.

[0015] The optical layer may include a lens array coated with an optical coating, wherein the optical coating has a transmittance that varies based on the wavelength of visible light.

[0016] The projector may include at least one laser scanning module configured to scan a laser beam onto the optical layer.

[0017] The at least one laser scanning module may include: a plurality of laser light sources configured to output laser beams corresponding to a plurality of colors; a beam combiner configured to synthesize the outputs of the plurality of laser light sources into a single integrated beam; and a scanning mirror configured to control the direction of the single integrated beam to scan the single integrated beam onto the optical layer.

[0018] The 3D image may include an integrated image forming a plurality of viewing zones by integrating element images including 3D information of the target object.

[0019] The 3D display device may further include an immersion layer disposed on the optical layer, wherein the immersion layer and the optical layer have the same refractive index.

[0020] The 3D display apparatus may further include a compensation lens disposed between the projector and the optical layer, wherein the compensation lens is configured to correct image distortion.

[0021] According to another aspect of the present disclosure, a three-dimensional (3D) display method is provided, comprising: obtaining information related to a timing at which light is scanned by a projector onto an optical layer; controlling the timing at which the projector scans the light onto the optical layer; and generating a 3D image in a viewing space based on the timing at which the light is scanned onto the optical layer.

[0022] A 3D image is generated based on virtual scanned pixels, wherein the virtual scanned pixels are realized by light scanned according to the time sequence.

[0023] The generating of the 3D image may include controlling a color of the light based on a timing in which the light is scanned onto the optical layer.

[0024] The generating of the 3D image may include controlling a plurality of light sources generating light based on values of scanned pixels corresponding to a timing at which light is scanned onto the optical layer.

[0025] A 3D image may be generated based on the direction of light according to a corresponding positional relationship between a plurality of optical elements included in the optical layer and the virtual scanning pixels.

[0026] The optical layer may be configured to refract or reflect light of a first wavelength and transmit light of a second wavelength different from the first wavelength.

[0027] The optical parameters of the optical layer may be determined based on the position of the projector and the position of the viewing space.

[0028] The optical layer may be disposed on or inside the windshield of the vehicle.

[0029] The optical layer may include a holographic optical element (HOE) lens array.

[0030] The HOE lens array may be recorded based on the position of the projector and the position of the viewing space to provide a 3D image in the viewing space.

[0031] The optical layer may include a lens array coated with an optical coating, wherein the optical coating has a transmittance that changes based on the wavelength of visible light.

[0032] The projector may include at least one laser scanning module configured to scan a laser beam onto the optical layer.

[0033] The laser scanning module may include: a plurality of laser light sources configured to output laser beams corresponding to a plurality of colors; a beam combiner configured to synthesize the outputs of the plurality of laser light sources into a single integrated beam; and a scanning mirror configured to control the direction of the integrated beam to scan the integrated beam onto the optical layer.

[0034] The 3D image may include an integrated image forming a plurality of viewing zones by integrating element images including 3D information of the target object.

[0035] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing instructions is provided, wherein when the instructions are executed by a processor, the processor is caused to perform the 3D display method.

[0036] According to another aspect of the present disclosure, a three-dimensional (3D) display device is provided, including: a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions to: obtain first timing information associated with a first wavelength of light; obtain second timing information associated with a second wavelength of light; control a projector to scan light having a first wavelength onto an optical layer during a first timing time period based on the first timing information and to scan light having a second wavelength onto the optical layer during a second timing time period based on the second timing information; and generate a 3D image in a viewing space based on the light scanned by the projector.

[0037] The 3D display device may further include: a projector including: a scanning mirror configured to control the direction of light; and a laser scanning module configured to output light through the scanning mirror, wherein the laser scanning module is further configured to scan the light in a vertical direction or a horizontal direction.

[0038] The 3D display device may further include: an optical layer including: a first optical element configured to refract or reflect light of a first wavelength and transmit light of a second wavelength different from the first wavelength; and a second optical element configured to refract or reflect light of the second wavelength and transmit light of the first wavelength. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The above and / or other aspects will become more apparent by describing certain example embodiments with reference to the accompanying drawings, in which:

[0040] Figure 1 A three-dimensional (3D) display device according to an example embodiment is shown;

[0041] Figure 2 illustrates a distribution of light beams output from a 3D display device according to example embodiments;

[0042] Figure 3 A method of implementing scanning pixels corresponding to red, green, and blue (RGB) sub-pixels of a panel according to an example embodiment is shown;

[0043] Figure 4A A general multi-view image generation method is shown;

[0044] Figure 4B A multi-view image generating method according to an example embodiment is shown;

[0045] Figure 5A and Figure 5B A method of realizing white (W) pixels using scanning pixels is shown;

[0046] Figure 6 shows the structure of a laser scanning module according to an example embodiment;

[0047] Figure 7A A method of manufacturing a holographic optical element (HOE) lens array according to example embodiments is shown;

[0048] Figure 7B A method of implementing an HOE lens array according to example embodiments is shown;

[0049] Figure 8 shows a 3D display device including a compensation lens according to example embodiments;

[0050] Figure 9 A 3D display device including an immersion layer according to example embodiments is shown;

[0051] Figure 10 shows a cylindrical display device using a 3D display device according to example embodiments;

[0052] Figure 11A and Figure 11B A method of implementing a 3D image using integrated imaging according to an example embodiment is shown;

[0053] Figure 12 A 3D display method according to an example embodiment is shown; and

[0054] Figure 13 A structure of a 3D display device according to an example embodiment is shown. DETAILED DESCRIPTION

[0055] Reference will now be made in detail to example embodiments, which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. The example embodiments are described below to explain the present disclosure by referring to the drawings.

[0056] The following structural or functional description is only used to describe example embodiments, and the scope of the example embodiments is not limited to the description provided in this disclosure. A person skilled in the art may make various changes and modifications to one or more of the example embodiments.

[0057] Although the terms "first" or "second" are used to explain various components, the components are not limited to these terms. These terms should only be used to distinguish one component from another. For example, a "first" component may be referred to as a "second" component, or similarly, a "second" component may be referred to as a "first" component within the scope of the rights of the concept according to the present disclosure.

[0058] It will be understood that when a component is referred to as being "connected to" another component, the component may be directly connected or coupled to the other component, or intervening components may be present. Furthermore, it should be noted that if a component is described in this disclosure as being "directly connected" or "directly coupled" to another component, no other components may exist between them. Similarly, expressions such as "between" and "immediately between" and "adjacent to" and "immediately adjacent to" may also be interpreted as described above.

[0059] Unless the context clearly indicates otherwise, as used herein, the singular is intended to include the plural. It should be further understood that when the terms "comprise" and / or "include" are used in this disclosure, they specify the presence of the recited features, integers, steps, operations, elements, components, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or combinations thereof.

[0060] Unless otherwise defined herein, all terms used herein (including technical or scientific terms) have the same meaning as commonly understood by those skilled in the art. Unless otherwise defined herein, terms defined in general dictionaries should be interpreted as having a meaning that matches the contextual meaning in the relevant art and should not be interpreted as an ideal or overly formal meaning.

[0061] Figure 1 A three-dimensional (3D) display apparatus according to example embodiments is illustrated.

[0062] Reference Figure 1 , showing the configuration of the 3D display device 100.

[0063] The 3D display device 100 is a device that implements the 3D image 140 and can implement the 3D image 140 by, for example, providing different images to the left and right eyes of a user. Binocular disparity can allow a user to experience a 3D effect.

[0064] Typically, a panel and a parallax separation device are required to achieve a 3D image. For example, a 3D display device can provide a 3D image by placing a parallax separation device (e.g., a parallax barrier or a lenticular lens) on the front surface of the panel and placing appropriate view images on the pixels of the panel. The lenticular lens can use the property of light being refracted when passing through the lens to control the direction of a light beam propagating into a 3D space, and the parallax barrier can control the direction of a light beam propagating into a 3D space by selectively transmitting light through slits.

[0065] The 3D display device 100 may generate the 3D image 140 using a method of scanning light to the optical layer 120 without using a display panel. As an example, Figure 1A head-up display (HUD) system using the 3D display device 100 is shown. Hereinafter, for ease of description, an example of a HUD system will be described. However, the exemplary embodiment of the 3D display device 100 is not limited to a HUD system and can be applied in various ways to all kinds of display devices (such as TVs, digital information displays (DIDs), monitors, and mobile devices).

[0066] The 3D display device 100 may include a projector 110 and an optical layer 120. The projector 110 may scan light to the optical layer 120. The optical layer 120 may include a plurality of optical elements. The optical element may be the smallest unit for generating a multi-view image. The light output from the optical element may be gathered at a certain distance in the viewing space. According to example embodiments, the distance may be a predetermined distance. The optical element may also be referred to as a 3D pixel. The 3D pixel may refract or reflect only light of a specific wavelength and transmit light of wavelengths other than the specific wavelength. According to example embodiments, the specific wavelength may be a predetermined wavelength. Depending on the embodiment, the specific wavelength may be a range of wavelengths.

[0067] In order to refract or reflect only light of a predetermined wavelength and transmit light of wavelengths other than the predetermined wavelength, the optical layer 120 may include a lens array coated with an optical coating having a transmittance that changes based on the wavelength of visible light. For example, a dichroic mirror coating that selectively increases reflectivity for a predetermined wavelength and increases transmittance for other wavelengths may be applied to the surface of a lens array of a general optical lens.

[0068] The parameters of the optical layer 120 may be determined based on the position of the projector and the position of the predetermined viewing space. For example, the refractive index of the optical element included in the optical layer 120 may be determined based on the position of the projector and the position of the predetermined viewing space. Figure 7A A method of determining the parameters of the optical layer 120 is described in detail.

[0069] Projector 110 may scan light of a predetermined wavelength toward optical layer 120. A single 3D pixel may output light in a predetermined direction, wherein projector 110 scans the light toward the single 3D pixel. Depending on the embodiment, projector 110 may scan the light within a predetermined time. The light output from the 3D pixel may form a view image. 3D display device 100 may use multiple 3D pixels to represent a point in 3D space.

[0070] The 3D display device 100 can render the image to be generated on the optical layer 120. Here, "rendering" may be an operation that determines or generates a two-dimensional (2D) image to be displayed on the optical layer 120 to provide the user with a 3D image 140. For example, "rendering" may be an operation that generates a 2D image to be displayed on the optical layer 120 attached to the inner surface of the windshield 130, the front window of the vehicle, or inserted into the windshield 130 to provide the 3D image 140 in a specific viewing space of the user. The specific viewing space may be a predetermined viewing space for the user. Image information may be data related to the image generated on the optical layer 120. For example, the image information may include data related to the size and color of the image generated on the optical layer 120.

[0071] According to an exemplary embodiment, the "rendering" operation may be performed by a processor included in the 3D display device 100. Here, the processor may be implemented as a hardware module, a software module, or various combinations thereof. The processor may control image information based on the timing of light scanning the optical layer to provide a 3D image in a predetermined viewing space. The predetermined viewing space may refer to a space in which the user can continuously observe the 3D image at or near the user's eyes even when the user moves left and right.

[0072] The 3D image 140 may include a multi-view image and an integrated image. For example, multi-view imaging may realize a 3D image by providing images corresponding to two different viewpoints among a plurality of viewpoints to the user's eyes. For example, the user may watch an image corresponding to a first viewpoint with the left eye and an image corresponding to a second viewpoint with the right eye, thereby experiencing a 3D effect from the corresponding 2D images. Integrated imaging may realize a 3D image by storing 3D information of a target object in the form of an element image using a lens array including a plurality of element lenses and integrating the element images stored by the lens array. Figure 11A and Figure 11B Integrated imaging is further described.

[0073] Figure 2 Illustrations show distribution of light beams output from a 3D display apparatus according to example embodiments.

[0074] Reference Figure 2 , the projector may scan light to the optical layer 220. The projector may include at least one laser scanning module 210 configured to scan laser light to the optical layer 220. The light scanned by the projector may include a laser beam scanned by the laser scanning module 210. A single laser scanning module may operate as a single projector, or at least two laser scanning modules may operate as a single projector.

[0075] The laser scanning module 210 may be a device configured to output a light beam through a scanning mirror 211, wherein the scanning mirror 211 can be directional controlled using a reflector. The laser scanning module may output a light beam after light beams respectively outputted from a plurality of laser light sources are combined through a semi-transmissive optical device. According to an example embodiment, the plurality of laser light sources may be configured to output laser beams corresponding to a plurality of colors. For example, the plurality of laser light sources may be a red laser light source, a green laser light source, and a blue laser light source. Figure 6 The laser scanning module 210 is further described.

[0076] The laser scanning module 210 can scan lines in a second direction (e.g., one line in the transverse direction at a time) by rotating the scanning mirror 211 while moving the laser beam in a first direction (e.g., from the top downward) toward the optical layer 220. The laser scanning module 210 can generate a 2D image on the optical layer 220 by scanning the laser beam. The scanning mirror of the laser scanning module 210 can rotate at predetermined intervals to scan the laser beam to the optical layer 220.

[0077] The plurality of light beams 230 may be determined in a 3D space based on the 2D image displayed on the optical layer 220. For example, the plurality of light beams generated in the 3D space may be changed based on the image information of the 2D image displayed on the optical layer 220. In order to output light beams with different information (e.g., different colors) to different positions of the optical layer 220 in response to the rotation of the scanning mirror, the image information and the scanning interval of the scanning mirror may be synchronized. For example, information related to the laser beam may be sequentially changed based on the image information and the scanning interval.

[0078] The optical layer 220 may include a plurality of optical elements 221 and 222. Scanning pixels may be achieved by changing the light beams to be scanned to the plurality of optical elements based on the timing of laser scanning, and a 3D image may be generated based on the scanned pixels. The scanned pixels may not be real pixels, but virtual pixels serving as pixels implemented by the laser. The laser beam may be scanned and may maintain a linear form in the optical layer 220. Therefore, by switching the laser beam at predetermined time intervals based on image information, respective light beams to be scanned to the plurality of optical elements 221 and 222 included in the optical layer 220 may be generated, and scanning pixels may be achieved by the light beams. For example, when the laser beam 215 is moved from top to bottom by rotating the scanning mirror 211, the first scanned pixel corresponding to the optical element 221 may be achieved by the laser beam 215, and the second scanned pixel corresponding to the optical element 222 may be achieved by the laser beam 216.

[0079] The propagation direction of the light beam output from the optical element can be determined based on the direction of the light beam according to the corresponding positional relationship between the optical element and the scanning pixel, so that a 3D space point can be represented.

[0080] Figure 3 A method of implementing scanning pixels corresponding to red, green, and blue (RGB) sub-pixels of a panel according to example embodiments is illustrated.

[0081] Reference Figure 3 , a 3D display device can control image information by controlling the color of light based on the timing in which light is scanned to the optical layer.

[0082] As described above, in order to separate a spatial 3D image, a 3D display apparatus may set a parallax separation device (e.g., a parallax barrier or a lenticular lens) on the front surface of a panel and may set appropriate view images on pixels of the panel, thereby providing a 3D image.

[0083] A typical RGB panel 310 may have a pixel structure in which a red (R) sub-pixel 311, a green (G) sub-pixel 312, and a blue (B) sub-pixel 313 are included in a single pixel. A 3D display device can use scanned pixels instead of the pixels of a real panel to provide 3D images. Specifically, scanning pixels can be achieved by controlling the RGB laser light source at a scanning timing corresponding to the position of the RGB sub-pixels based on image information.

[0084] For example, a red (R) scanning pixel may be formed by outputting only the red (R) laser beam 320 and not outputting (but blocking) the green (G) laser beam 330 and the blue (B) laser beam 340 at a scanning timing corresponding to the position of the R sub-pixel of the RGB panel 310. The green (G) scanning pixel and the blue (B) scanning pixel may be formed based on the same principle based on the positions of the G sub-pixel and the B sub-pixel.

[0085] Furthermore, by simultaneously controlling the on / off switching of the RGB laser light sources at predetermined time intervals based on image information, the brightness of the beam can be adjusted by modulating the output laser beam of each laser light source based on image information. A 3D image can be produced by controlling the multiple light sources generating light based on the values of the scanned pixels corresponding to the timing of light being scanned onto the optical layer.

[0086] Figure 4A A general multi-view image generation method is shown. Figure 4B A multi-view image generating method according to an exemplary embodiment is shown. Figure 4B Before describing the multi-view image generation method, we will refer to Figure 4A Briefly describe a general multi-view display using panels.

[0087] Figure 4AThe figure shows the direction in which light beams output from multiple pixels included in panel 400 propagate into a 3D space when a typical multi-view display is used to implement autostereoscopic 3D display. Light beams generated from the pixels of panel 400 can be uniformly propagated toward the user in a predetermined direction via a lenticular lens attached to the front surface of panel 400. When left and right images from different viewpoints are applied to pixels that generate light beams to be incident on the user's left and right eyes, the user can perceive a 3D image. Each pixel may include multiple sub-pixels. For example, a single pixel may include RGB sub-pixels.

[0088] Figure 4B 4 shows directions in which light beams output from scanning pixels corresponding to RGB sub-pixels of a panel propagate in a 3D space using a projector instead of using the panel 400 when a 3D display device according to an example embodiment is used.

[0089] The 3D display device may include a projector and an optical layer. The optical layer may correspond to a lenticular lens of a typical multi-view 3D display device, wherein the optical layer may output light scanned from the projector as light beams containing different information in multiple directions. Although the 3D display device does not include the panel 400, the 3D display device may generate scanned pixels corresponding to RGB sub-pixels by scanning light through the optical layer via the projector.

[0090] For example, scanning pixels can be generated by switching the RGB laser light source at predetermined time intervals based on image information at a scanning timing corresponding to the position of the RGB sub-pixels. Figure 4A When the positions of the sub-pixels of the panel are adjusted, a 3D image can be implemented in a manner similar to that of a general multi-view based 3D display device.

[0091] Figure 5A and Figure 5B A method of realizing white (W) pixels using scanning pixels is shown. Figure 5A In the first example 510 shown in FIG, the 3D display device can realize W scanning pixels by controlling the switching of the RGB laser light source based on the timing of the scanned pixel unit, and at the same time express the gray level of the light beam by modulation. Figure 5B In the second example 520 shown in FIG, the 3D display device can implement W scanning pixels by controlling the switching of the RGB laser light source based on the timing of scanning the sub-pixel units in the pixels.

[0092] In another example, Figure 3 As shown in , W scanning pixels can be achieved by controlling the brightness of each sub-pixel to be the same without simultaneously controlling the switches of the sub-pixels in the scanning pixels.

[0093] Figure 6A structure of a laser scanning module according to example embodiments is shown.

[0094] Reference Figure 6 The laser scanning module 600 may include a red (R) laser light source 612, a green (G) laser light source 611, a blue (B) laser light source 613, condensers C1, C2 and C3, beam combiners 621 and 622, at least one reflective mirror 630 and a scanning mirror 640, wherein the red (R) laser light source 612 is configured to output a red laser beam, the green (G) laser light source 611 is configured to output a green laser beam, the blue (B) laser light source 613 is configured to output a blue laser beam, the condensers C1, C2 and C3 are configured to respectively collect light output from the R laser light source, the G laser light source and the B laser light source, the beam combiners 621 and 622 are configured to synthesize the outputs of multiple laser light sources into a single integrated light beam, the at least one reflective mirror 630 is configured to control the path of the light beam, and the scanning mirror 640 is configured to control the direction of the integrated light beam to scan the integrated light beam to the optical layer.

[0095] Beam combiners 621 and 622 may include dichroic mirrors 621a and 622a, wherein dichroic mirrors 621a and 622a are configured to reflect only light of a predetermined wavelength generated by the R, G, and B laser diodes and concentrated by the condenser, and to transmit light of other wavelengths. For example, dichroic mirror 621a may have a characteristic of reflecting only a red laser beam, and dichroic mirror 622a may have a characteristic of reflecting only a blue laser beam. A green light beam may pass through dichroic mirrors 621a and 622a, and a red light beam may pass through dichroic mirror 622a. Thus, dichroic mirrors 621a and 622a can be used to combine the outputs of the RGB laser light sources into a single integrated beam.

[0096] Scanning mirror 640 can be manufactured using micro-electromechanical system (MEMS) technology and generates a 2D image by scanning a laser beam focused on a single point onto the optical layer using two drive axes. The 2D image can be realized as a collection of multiple horizontal lines, where the positions of the multiple horizontal lines are different in the vertical direction.

[0097] Laser scanning module 600 is simple to construct and easily miniaturized, allowing it to be used as a handheld projector. Furthermore, by increasing the scanning angle of scanning mirror 640, the field of view can be easily increased. For example, due to limited space in a vehicle dashboard, installing a large HUD system can be difficult in practice. When a HUD system is configured using laser scanning module 600, a 3D HUD image with a wide field of view can be provided to the driver.

[0098] Figure 7A A method of manufacturing a holographic optical element (HOE) lens array according to example embodiments is illustrated.

[0099] Reference Figure 7A , the optical layer may include an HOE lens array. The HOE may have a narrow wavelength bandwidth and be used as an optical device only in a predetermined wavelength region. The HOE lens array may be manufactured using a general optical lens array 710 and a photopolymer 720. Taking into account the position of the projector and the position of the predetermined viewing space, the HOE lens array may be recorded, for example, on a photopolymer. Recording the HOE lens array may be determining optical parameters of a plurality of optical elements included in the HOE lens array used as the optical layer. For example, the refractive index of the optical element included in the optical layer 120 or 220 may be determined taking into account the position of the projector and the position of the predetermined viewing space.

[0100] The HOE lens array can be recorded using a reference beam and a signal beam, wherein the reference beam is incident from the position of the projector toward the general optical lens array 710 and the photopolymer 720 at a predetermined divergence angle α, and the signal beam travels horizontally toward a predetermined viewing space in a state where the general optical lens array 710 and the photopolymer 720 overlap. Figure 7A The general optical lens array 710 is shown to be arranged in a vertical direction, but the general optical lens array 710 can also be manufactured in a horizontal direction or in both vertical and horizontal directions.

[0101] Figure 7B A method of implementing an HOE lens array according to example embodiments is shown.

[0102] Reference Figure 7B , the HOE lens array 730 can be manufactured to refract or reflect only light of a predetermined wavelength and transmit light of wavelengths other than the predetermined wavelength, thereby serving as a parallax separation device (e.g., a parallax barrier or a lenticular lens). Figure 7A The HOE lens array 730 manufactured by the described method can respond only to RGB laser beams and transmit light of other wavelengths.

[0103] When the projector 740 is disposed at the same position as that used for recording and light is scanned to the HOE lens array 730 at a predetermined divergence angle α, a user may observe a 3D image at a position of a predetermined viewing space 750 .

[0104] Figure 8 A 3D display apparatus including a compensation lens according to example embodiments is illustrated.

[0105] Reference Figure 8 , shows a HUD system using the 3D display device 100. The 3D display device 100 may further include a compensation lens 850.

[0106] The compensation lens 850 may be an image distortion correction device. According to example embodiments, by additionally providing the compensation lens 850 between the projector 110 and the optical layer 120 to correct image distortion, a burden on the optical layer 120 may be reduced.

[0107] In another example embodiment, when manufacturing an HOE lens array, a plurality of HOE layers may be provided such that one layer may function as a lens array and another layer may perform a function of correcting image distortion.

[0108] Figure 9 A 3D display device including an immersion layer according to example embodiments is illustrated.

[0109] The optical layer 910 may refract or reflect only light of a predetermined wavelength and transmit light of wavelengths other than the predetermined wavelength. For example, the optical layer 910 may utilize wavelength selectivity to respond only to a laser beam scanned by a projector without affecting the transmittance of external light, thereby removing the visibility of external light.

[0110] Reference Figure 9 To remove the visibility of external light, an immersion layer 920 may be applied to the optical layer 910. According to example embodiments, the immersion layer 920 may include an optical coating that selectively increases reflectivity for wavelengths of light scanned by the projector and increases transmittance for other wavelengths. The immersion layer 920 and the optical layer 910 may have the same refractive index. For example, the refractive index n1 of the optical layer 910 may be the same as the refractive index n2 of the immersion layer 920. Using the immersion layer 920 having the same refractive index as the optical layer 910 can prevent distortion of an object observed through the optical layer 910.

[0111] Figure 10 A cylindrical display device using a 3D display device according to an exemplary embodiment is shown. Figures 1 to 9 The description provided can also be applied to Figure 10 , so for the sake of brevity, repeated descriptions will be omitted.

[0112] Reference Figure 10 , a cylindrical display device 1000 using a 3D display device may include a projector 1010 and an optical layer 1020. The optical layer 1020 may have a cylindrical side shape. Hereinafter, for ease of description, a cylindrical display device will be described. However, examples of 3D display devices are not limited to cylindrical display devices and may be applied in various shapes.

[0113] The projector 1010 may scan light to the optical layer 1020 through 360-degree rotation. In order to allow the user to view within the eye range 1030, the cylindrical display device 1000 may use a plurality of optical elements 1021 and 1022 to represent a point in 3D space.

[0114] Figure 11A and Figure 11B A method of implementing a 3D image using integrated imaging according to example embodiments is illustrated.

[0115] Reference Figure 11A and Figure 11B , a stereoscopic image display device based on general integrated imaging may include Figure 11A The image pickup device 1100 shown in FIG. Figure 11B According to example embodiments, the image pickup device 1100 may convert 3D information of the 3D object 1120 into a whole element image using a capture device 1140 such as a camera and a first lens array 1130, and the image pickup device 1100 may store the element image in the capture device 1140.

[0116] According to example embodiments, the display 1150 may include a display panel 1160 and a second lens array 1170 , and present the entire element image displayed on the display panel 1160 in the form of a stereoscopic image 1180 in a predetermined viewing space 1190 .

[0117] According to general integrated imaging, multiple viewing zones with different viewpoints can be formed. A 3D image display device based on integrated imaging can use a microlens array as an optical array. When a microlens array is used, the light beam output from the optical array can be controlled to separate the left image and the right image in the viewing space.

[0118] In order for a 3D display device to generate a 3D image according to integrated imaging, an HOE lens array may be recorded in consideration of the position of a projector and the position of a predetermined viewing space so that the HOE lens array may function as a microlens array.

[0119] According to an example embodiment, Figures 1 to 10 The descriptions and features of one or more example embodiments in may also be applied to Figure 11A and Figure 11B , so for the sake of brevity, repeated descriptions will be omitted. For example, when a 3D image is realized according to integrated imaging, as Figure 2 The scanned pixels shown in FIG can output an image corresponding to the direction angle assigned to the corresponding pixel. The direction angle is the angle at which the light beam is projected from the scanned pixel. By projecting the output image to the corresponding scanned pixel at a predetermined direction angle, a 3D image can be realized.

[0120] Figure 12 A 3D display method according to example embodiments is illustrated.

[0121] Operation 1210 and operation 1220 can be performed by Figure 1The 3D display device 100 is executed. The 3D display device 100 can be implemented using one or more hardware modules, one or more software modules, or various combinations thereof.

[0122] In operation 1210, the 3D display device 100 may obtain information related to the timing of scanning light onto the optical layer to provide a 3D image in a predetermined viewing space. For example, in operation 1210, the 3D display device may obtain information about a first timing, a second timing, and a third timing, wherein red (R) scanning pixels may be formed at the first timing, green (G) scanning pixels may be formed at the second timing, and blue (B) scanning pixels may be formed at the third timing.

[0123] In operation 1220, the 3D display device 100 may control the image information generated on the optical layer based on information related to the timing of light scanning. According to an exemplary embodiment, during a first timing, the 3D display device may output only a red (R) laser beam to the position of the R subpixel of the RGB panel 310, while suppressing the output of the green (G) laser beam and the blue (B) laser beam. For example, the 3D display device may block the green (G) laser beam 330 and the blue (B) laser beam 340 at the first timing. Based on the same principles described for the red (R) scanning pixel and based on the positions of the G subpixel and the B subpixel, the green (G) scanning pixel may be formed at the second timing, and the blue (B) scanning pixel may be formed at the third timing.

[0124] Figure 13 The structure of a 3D display device 1300 according to an exemplary embodiment is shown. The 3D display device 1300 may include a processor 1330, a memory 1350, and a communication interface 1370, all of which are connected to and in communication with each other via a bus 1305. According to an exemplary embodiment, a "rendering" operation may be performed by the processor 1330. The processor 1330 may control image information based on the timing of light scanning onto the optical layer to provide a 3D image in a predetermined viewing space. The predetermined viewing space may be a space in which the user can continuously observe the 3D image at or near the user's eyes, even when the user moves from side to side.

[0125] According to an embodiment, the processor 1330 may communicate with the memory 1350 to store data, retrieve data, or retrieve instructions related to performing control of image information. According to an example embodiment, the communication interface 1370 may be configured to receive external input information and provide the received information to the memory 1350 or the processor 1330. According to an example embodiment, the communication interface 1370 may be configured to output information processed by the processor 1330 or information retrieved from the memory.

[0126] According to an embodiment, the memory 1350 may be configured to store one or more instructions; and the processor 1330 may be configured to execute one or more instructions to: obtain first timing information associated with a first wavelength of light, obtain second timing information associated with a second wavelength of light, control the projector to scan light having a first wavelength onto the optical layer during a first timing time period based on the first timing information and scan light having a second wavelength onto the optical layer during a second timing time period based on the second timing information, and generate a 3D image in a viewing space based on the light scanned by the projector.

[0127] The example embodiments described herein can be implemented using hardware components, software components, and / or combinations thereof. The processing device can be implemented using one or more general-purpose computers or special-purpose computers (e.g., processors, controllers, and arithmetic logic units (ALUs), DSPs, microcomputers, FPGAs, programmable logic units (PLUs), microprocessors, or any other device capable of responding to and executing instructions in a defined manner). The processing device can run an operating system (OS) and one or more software applications running on the OS. The processing device can also access, store, manipulate, process, and create data in response to the execution of the software. For simplicity, the description of the processing device is used as a singular; however, those skilled in the art will understand that the processing device may include multiple processing elements and multiple types of processing elements. For example, the processing device may include multiple processors or a processor and a controller. In addition, different processing configurations (such as parallel processors) are feasible.

[0128] Software may include computer programs, code segments, instructions, or some combination thereof that are used, independently or collectively, to instruct or configure a processing device to operate in accordance with a desired operation. Software and data may be embodied permanently or temporarily in any type of machine, component, physical or virtual device, computer storage medium, or device, or in a propagated signal wave capable of providing instructions or data to or being interpreted by a processing device. Software may also be distributed across networked computer systems so that the software is stored and executed in a distributed manner. Software and data may be stored by one or more non-transitory computer-readable recording media.

[0129] The method according to the above-mentioned example embodiment can be recorded in a non-transitory computer-readable medium including program instructions to implement the various operations of the above-mentioned example embodiment. The medium can also include data files, data structures, etc., alone or in combination with the program instructions. The program instructions recorded on the medium can be program instructions specially designed and constructed for the purpose of the example embodiment, or they can be types known and available to those skilled in the art of computer software. Examples of non-transitory computer-readable media include magnetic media (such as hard disks, floppy disks, and tapes), optical media (such as CD-ROM disks, DVDs, and / or Blu-ray discs), magneto-optical media (such as optical discs), and hardware devices (such as read-only memories (ROMs), random access memories (RAMs), flash memories (e.g., USB flash drives, memory cards, memory sticks, etc.)) specially configured to store and execute program instructions. Examples of program instructions include machine codes such as those generated by a compiler and files containing higher-level codes that can be executed by a computer using an interpreter. The above-mentioned devices can be configured to be used as one or more software modules to perform the operations of the above-mentioned example embodiments, and vice versa.

[0130] A number of example embodiments have been described above. However, it should be understood that various modifications may be made to these example embodiments. For example, suitable results may be achieved if the described techniques are performed in a different order and / or if components in the described systems, architectures, devices, or circuits are combined in a different manner and / or replaced or supplemented with other components or their equivalents. Therefore, other implementations are within the scope of the following claims.

Claims

1. A three-dimensional display device, comprising: an optical layer comprising a plurality of optical elements; a projector configured to scan light onto the optical layer; as well as a processor configured to: control a timing in which the projector scans light onto the optical layer, and generate a three-dimensional image in a viewing space based on the timing in which the light is scanned onto the optical layer; wherein the optical layer includes a holographic optical element lens array coated with a dichroic mirror coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by a projector and increases transmittance for other wavelengths, The projector includes: at least one laser scanning module configured to scan a laser beam onto the optical layer, the at least one laser scanning module including: a plurality of laser light sources configured to output laser beams corresponding to a plurality of colors; a beam combiner configured to combine the outputs of the plurality of laser light sources into a single integrated beam; and a scanning mirror configured to control a direction of the single integrated light beam to scan the single integrated light beam onto the optical layer, The at least one laser scanning module moves the single integrated light beam in a first direction toward the optical layer while scanning a line in a second direction different from the first direction through a rotating scanning mirror, so that the single integrated light beam maintains a linear form in the optical layer. wherein the holographic optical element lens array includes a plurality of holographic optical element layers, one of the plurality of holographic optical element layers functions as a lens array, and another of the plurality of holographic optical element layers performs a function of correcting image distortion, The processor is further configured to generate a three-dimensional image by controlling a plurality of light sources that generate light based on values of scanned pixels corresponding to a timing at which light is scanned onto the optical layer. wherein the plurality of colors include a first color associated with a first wavelength of light and a second color associated with a second wavelength of light, the laser beam includes a first laser beam associated with the first wavelength of light and a second laser beam associated with the second wavelength of light, and the scanning pixel includes a first scanning pixel associated with the first wavelength of light and a second scanning pixel associated with the second wavelength of light, In which, the first scanning pixel is formed by outputting only the first laser beam and blocking or not outputting the second laser beam in a first scanning timing associated with the first wavelength of light, and the second scanning pixel is formed by outputting only the second laser beam and blocking or not outputting the first laser beam in a second scanning timing associated with the second wavelength of light.

2. The three-dimensional display device according to claim 1, wherein: The processor is further configured to generate a three-dimensional image based on the direction of the light according to the corresponding positional relationship between the plurality of optical elements and the scanning pixels.

3. The three-dimensional display device according to claim 1, wherein: The optical parameters of the optical layer are determined based on the position of the projector and the position of the viewing space.

4. The three-dimensional display device according to claim 1, wherein: The optical layer is disposed on or inside the windshield of the vehicle.

5. The three-dimensional display device according to claim 1, wherein: The holographic optical element lens array is recorded based on the position of the projector and the position of the viewing space to provide a three-dimensional image in the viewing space.

6. The three-dimensional display device according to claim 1, further comprising: an immersion layer disposed on the optical layer and having an optical coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by the projector and increases transmittance for other wavelengths, The immersion layer and the optical layer have the same refractive index.

7. The three-dimensional display device according to claim 1, wherein: The three-dimensional image includes an integrated image of a plurality of viewing zones formed by integrating element images including three-dimensional information of a target object.

8. The three-dimensional display device according to claim 1, further comprising: A compensation lens is disposed between the projector and the optical layer, wherein the compensation lens is configured to correct image distortion.

9. A three-dimensional display method, comprising: obtaining information related to a timing at which light is scanned by a projector onto an optical layer; Controlling the timing of the projector scanning light onto the optical layer; as well as A three-dimensional image is created in the viewing space based on the timing in which light is scanned onto the optical layers. wherein the optical layer includes a holographic optical element lens array coated with a dichroic mirror coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by a projector and increases transmittance for other wavelengths, The projector includes: at least one laser scanning module configured to scan a laser beam onto the optical layer, the at least one laser scanning module including: a plurality of laser light sources configured to output laser beams corresponding to a plurality of colors; a beam combiner configured to combine the outputs of the plurality of laser light sources into a single integrated beam; and a scanning mirror configured to control a direction of the single integrated light beam to scan the single integrated light beam onto the optical layer, The at least one laser scanning module moves the single integrated light beam in a first direction toward the optical layer while scanning a line in a second direction different from the first direction through a rotating scanning mirror, so that the single integrated light beam maintains a linear form in the optical layer. wherein the holographic optical element lens array includes a plurality of holographic optical element layers, one of the plurality of holographic optical element layers functions as a lens array, and another of the plurality of holographic optical element layers performs a function of correcting image distortion, The step of generating a three-dimensional image includes generating a three-dimensional image by controlling a plurality of light sources generating light based on the values of scanned pixels corresponding to the timing of light being scanned onto the optical layer, wherein the plurality of colors include a first color associated with a first wavelength of light and a second color associated with a second wavelength of light, the laser beam includes a first laser beam associated with the first wavelength of light and a second laser beam associated with the second wavelength of light, and the scanning pixel includes a first scanning pixel associated with the first wavelength of light and a second scanning pixel associated with the second wavelength of light, In which, the first scanning pixel is formed by outputting only the first laser beam and blocking or not outputting the second laser beam in a first scanning timing associated with the first wavelength of light, and the second scanning pixel is formed by outputting only the second laser beam and blocking or not outputting the first laser beam in a second scanning timing associated with the second wavelength of light.

10. The three-dimensional display method according to claim 9, wherein: A three-dimensional image is generated based on virtual scanned pixels, wherein the virtual scanned pixels are realized by light scanned according to the time sequence.

11. The three-dimensional display method according to claim 10, wherein: A three-dimensional image is generated based on the direction of light according to a corresponding positional relationship between a plurality of optical elements included in the optical layer and the virtual scanning pixels.

12. The three-dimensional display method according to claim 9, wherein: The optical parameters of the optical layer are determined based on the position of the projector and the position of the viewing space.

13. The three-dimensional display method according to claim 9, wherein: The optical layer is disposed on or inside the windshield of the vehicle.

14. The three-dimensional display method according to claim 9, wherein: The holographic optical element lens array is recorded based on the position of the projector and the position of the viewing space to provide a three-dimensional image in the viewing space.

15. The three-dimensional display method according to claim 9, wherein: The three-dimensional image includes an integrated image of a plurality of viewing zones formed by integrating element images including three-dimensional information of a target object.

16. The three-dimensional display method according to claim 9, wherein: an immersion layer disposed on the optical layer, and the immersion layer having an optical coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by the projector and increases transmittance for other wavelengths, The immersion layer and the optical layer have the same refractive index.

17. A non-transitory computer-readable storage medium storing instructions, wherein: When the instructions are executed by a processor, the processor is caused to execute the three-dimensional display method according to claim 9.

18. A three-dimensional display device, comprising: a memory configured to store one or more instructions; as well as A processor configured to execute the one or more instructions to: obtaining first timing information associated with a first wavelength of light; obtaining second timing information associated with a second wavelength of light; controlling the projector to scan light having a first wavelength onto the optical layer during a first timing period based on the first timing information to form first scanned pixels associated with the first wavelength of light and to scan light having a second wavelength onto the optical layer during a second timing period based on the second timing information to form second scanned pixels associated with the second wavelength of light; as well as Produces a three-dimensional image in the viewing space based on the light scanned by the projector, wherein the optical layer includes a holographic optical element lens array coated with a dichroic mirror coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by a projector and increases transmittance for other wavelengths, Wherein, the three-dimensional display device further includes a projector, and the projector includes: a scanning mirror configured to control the direction of light; and The laser scanning module is configured to output light through a scanning mirror, The laser scanning module moves the light in a first direction toward the optical layer while scanning a line in a second direction different from the first direction through a rotating scanning mirror, so that the light scanned by the projector onto the optical layer remains in a linear form in the optical layer. wherein the holographic optical element lens array includes a plurality of holographic optical element layers, one of the plurality of holographic optical element layers functions as a lens array, and another of the plurality of holographic optical element layers performs a function of correcting image distortion, In which, the first scanning pixel is formed by outputting only the first wavelength of light and blocking or not outputting the second wavelength of light in a first scanning timing associated with the first wavelength of light, and the second scanning pixel is formed by outputting only the second wavelength of light and blocking or not outputting the first wavelength of light in a second scanning timing associated with the second wavelength of light.

19. The three-dimensional display device according to claim 18, wherein: The first direction is a vertical direction or a horizontal direction.

20. The three-dimensional display device according to claim 18, wherein: an immersion layer disposed on the optical layer, and the immersion layer having an optical coating that selectively increases reflectivity for wavelengths of light scanned onto the optical layer by the projector and increases transmittance for other wavelengths, The immersion layer and the optical layer have the same refractive index.

Images