3D image display method and device using augmented reality

Abstract

The present invention relates to a 3D image display method and apparatus using augmented reality, which may include an eye position information collecting step of collecting information on the position of a user's actual eyes, a virtual display panel preparing step of preparing a virtual display panel having an augmented reality display specification, a virtual barrier calculating step of calculating a virtual barrier based on the actual eye position information and the virtual display panel, a virtual display panel pixel allocating step of allocating pixels of the virtual display panel to correspond to the user's actual time based on the actual eye position information and the virtual barrier, a rendering step of rendering stereo content corresponding to the user's actual time, and a displaying step of displaying a 3D image based on the allocated pixels and the stereo content.

Description

[Technical Field]

[0001] The present invention relates to a method and apparatus for displaying three-dimensional images using augmented reality. [Background technology]

[0002] Augmented reality (AR) displays have optical see-through properties that allow virtual images to blend with real scenes. To achieve a sufficient field of view (FoV) and virtual image distance (VID), the display is enlarged in combination with the display projection optics. At the same time, the enlarged image must have three-dimensional characteristics to better match the real object.

[0003] A 3D display with a lenticular lens or a parallax barrier can be used with the source image for 3D augmented reality.

[0004] Meanwhile, rendering and pixel allocation for such displays involves rendering and pixel allocation methods for specific viewpoints. Conventional techniques must search for virtual images for all actual viewpoints and virtual viewpoints for each frame. However, performing this method poses a problem because it requires additional calculations and latency in the process of converting actual viewpoints to virtual viewpoints. Summary of the Invention [Problem to be solved by the invention]

[0005] In order to solve the above-mentioned problems of the prior art, an object of the present invention is to perform a method of searching for a virtual image for an actual viewpoint using virtual barrier parameters, thereby enabling a virtual image to be searched for with a short waiting time. [Means for solving the problem]

[0006] In order to solve the above technical problem, one aspect of the present invention provides a 3D image display method, including: an eye position information collecting step of collecting actual eye position data of a user; a virtual display panel preparing step of preparing a virtual display panel having an AR display specification; a virtual barrier calculating step of calculating a virtual barrier based on the actual eye position information and the virtual display panel; a virtual display panel pixel allocating step of allocating pixels of the virtual display panel to correspond to the actual viewpoint of the user based on the actual eye position information and the virtual barrier; a rendering step of rendering stereo content corresponding to the actual viewpoint of the user; and a displaying step of displaying a 3D image based on the allocated pixels and the stereo content.

[0007] According to an embodiment, the actual eye position information may be collected through an eye tracking camera.

[0008] According to an embodiment, the actual time points may include left and right time points, and the pixel allocating step may allocate pixels corresponding to the left and right time points, respectively.

[0009] In some embodiments, the actual time points may include left-eye and right-eye time points, and the stereo content may be paired data of content corresponding to the left-eye time points and content corresponding to the right-eye time points.

[0010] In some embodiments, the augmented reality display specifications may include a virtual image distance (d) and a viewing angle.

[0011] According to an embodiment, the virtual display panel has a first parameter, and the virtual barrier calculation step may be characterized by calculating a second parameter of the virtual barrier from the augmented reality display specifications, the first parameter, and the actual eye position information.

[0012] In some embodiments, the first parameter is a magnification (M) of the virtual display panel and a pixel pitch (P' P ) and a number (N).

[0013] According to an embodiment, the second parameter may include a virtual barrier gap and a virtual barrier pitch.

[0014] According to another aspect of the present invention, a computer program stored on a medium can be provided for combining with hardware to perform one of the methods of the above-described embodiments.

[0015] According to another aspect of the present invention, there may be provided a 3D image display method including one or more of: an information collecting step of collecting actual eye position data of a user; a virtual display panel setting step of setting a virtual display panel located at a predetermined virtual image distance (d) from the actual eye position data and having a first parameter; a virtual barrier calculating step of calculating a second parameter of a virtual barrier based on an augmented reality display specification, the first parameter, and the actual eye position information; a pixel allocating step of allocating pixels of the virtual display panel based on the virtual barrier for which the second parameter has been calculated and the actual left eye position information and actual right eye position information, the actual eye position information including actual left eye position information and actual right eye position information; a rendering step of rendering paired contents corresponding to the actual left eye position information and the actual right eye position information, respectively; and a displaying step of displaying a 3D image based on the allocated pixels and the corresponding contents.

[0016] According to another aspect of the present invention, there may be provided a 3D image display device including a processor; and a memory containing computer-readable instructions; wherein when the instructions are executed by the processor, the processor calculates a virtual barrier based on collected actual eye position data of a user and a virtual display panel having an AR display specification, allocates pixels of the virtual display panel to correspond to the actual viewpoint of the user based on the actual eye position information and the virtual barrier, renders stereo content corresponding to the actual viewpoint of the user, and displays a 3D image based on the allocated pixels and the stereo content.

[0017] In some embodiments, the augmented reality display specifications may include a virtual image distance (d) and a viewing angle.

[0018] According to an embodiment, the virtual display panel has a first parameter, and the virtual barrier calculation step may be characterized by calculating a second parameter of the virtual barrier from the augmented reality display specifications, the first parameter, and the actual eye position information.

[0019] In some embodiments, the first parameter is a magnification (M) of the virtual display panel and a pixel pitch (P' P ) and a number (N).

[0020] According to an embodiment, the second parameter may include a virtual barrier gap and a virtual barrier pitch.

[0021] According to yet another aspect of the present invention, there is provided a method for designing a 3D image display device, including: an eye position information collecting step of collecting actual eye position data of a user; a virtual display panel preparing step of preparing a virtual display panel having an AR display specification; a virtual barrier calculating step of calculating a virtual barrier based on the actual eye position information and the virtual display panel; and an actual barrier design step of designing an actual barrier based on the virtual barrier.

[0022] In some embodiments, the augmented reality display specifications may include a virtual image distance (d) and a viewing angle.

[0023] According to an embodiment, the virtual display panel has a first parameter, and the virtual barrier calculation step may be characterized by calculating a second parameter of the virtual barrier from the augmented reality display specifications, the first parameter, and the actual eye position information.

[0024] In some embodiments, the first parameter is a magnification (M) of the virtual display panel and a pixel pitch (P' P ) and a number (N).

[0025] According to an embodiment, the second parameter may include a virtual barrier gap and a virtual barrier pitch.

[0026] According to an embodiment, in the step of designing the actual barrier, a third parameter of the actual barrier may be calculated and designed using a second parameter of the virtual barrier.

[0027] According to an embodiment, the second parameter may include a virtual barrier gap and a virtual barrier pitch, and the third parameter may include an actual barrier gap and an actual barrier pitch.

[0028] According to an embodiment, the step of designing the actual barrier may be characterized by calculating a distance from a main plane of an actual optical system to an actual display panel and a distance from the main plane of the actual optical system to the actual barrier.

[0029] According to another aspect of the present invention, there is provided a method for designing a 3D image display device, including: an eye position information collecting step of collecting actual eye position data of a user; a virtual display panel preparing step of preparing a virtual display panel having an AR display specification; a virtual barrier calculating step of calculating a virtual barrier based on the actual eye position information and the virtual display panel; a virtual display panel pixel allocating step of allocating pixels of the virtual display panel to correspond to the actual viewpoint of the user based on the actual eye position information and the virtual barrier; a rendering step of rendering stereo content corresponding to the actual viewpoint of the user; a display step of displaying a 3D image based on the allocated pixels and the stereo content; and an actual barrier designing step of designing an actual barrier based on the virtual barrier. [Effects of the Invention]

[0030] According to the present invention, the rendering and pixel allocation procedures are simplified by not searching for a virtual image of a viewpoint for each frame.

[0031] In addition, according to the present invention, a method for searching for a virtual image for a real time point is performed using virtual barrier parameters, and the virtual barrier parameters used for rendering and pixel allocation are calculated only once and are always the same, resulting in a fast calculation speed.

[0032] The present invention also provides an improved rendering procedure for an augmented reality display device. [Brief explanation of the drawings]

[0033] [Figure 1]FIG. 1 is a diagram showing a rendering process for a virtual screen and real eyes according to the prior art. [Figure 2a] FIG. 2a is a block diagram illustrating a prior art approach to finding a virtual image for each frame. [Figure 2b] FIG. 2b is a block diagram illustrating an approach for finding a virtual image for each frame according to one embodiment of the present invention. [Figure 3] FIG. 3 is a diagram illustrating a method for calculating a virtual barrier according to an embodiment of the present invention. [Figure 4] FIG. 4 is a diagram illustrating a pixel allocation method based on the short distance rule according to an embodiment of the present invention. [Figure 5] FIG. 5 is a diagram illustrating a system layout for three-dimensional rendering of a stereo content scene with a single path from a virtual display to the real eyes, according to one embodiment of the present invention. [Figure 6] FIG. 6 is a diagram illustrating a system layout for allocation and rendering with a single path from the virtual display to the real eye, according to one embodiment of the present invention. [Figure 7] FIG. 7 is a diagram illustrating a process of calculating a real barrier from a virtual barrier in consideration of the configuration of an optical system according to an embodiment of the present invention. [Figure 8a] FIG. 8a is a diagram showing a real barrier as a parallax barrier with slits according to one embodiment of the present invention. [Figure 8b] FIG. 8b is a diagram showing a real barrier as a lenticular lens with an air gap according to one embodiment of the present invention. [Figure 8c] FIG. 8c is a diagram showing a real barrier as a solid lenticular lens according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0034] The advantages and features of the present invention, and methods for achieving them, will become clearer with reference to the following detailed description of the embodiments accompanied by the accompanying drawings. However, the present invention is not limited to the following embodiments, and may be embodied in various different forms, and includes all modifications, equivalents, and alternatives within the spirit and technical scope of the present invention. The following embodiments are provided to ensure a complete disclosure of the present invention and to fully convey the scope of the invention to those skilled in the art to which the present invention pertains. When describing the present invention, detailed descriptions of related prior art may be omitted if it is deemed that such descriptions may obscure the gist of the present invention. The terms used in this application are merely used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "have" are intended to specify the presence of a specified feature, number, step, operation, component, part, or combination thereof, and should be understood as not precluding the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof. Terms such as "first," "second," etc. may be used to describe various components, but the components should not be limited by these terms. These terms are used only to distinguish one component from another. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, identical or corresponding components are given the same reference numerals, and duplicate descriptions thereof will be omitted.

[0035] FIG. 1 is a diagram showing the rendering process for a virtual screen and real eyes according to the prior art, FIG. 2a is a block diagram showing an approach to searching for a virtual image for every frame according to the prior art, and FIG. 2b is a block diagram showing an approach to searching for a virtual image for every frame according to one embodiment of the present invention.

[0036] Referring to FIG. 1, prior art 3D rendering methods using a 3D display device 10 and a catadioptric (20, catadioptric or other optical system in front of the 3D display) convert an actual viewpoint position 40 into a virtual image 50 of the viewpoint position.

[0037] In this case, pixel allocation can be performed for the virtual image 50 of the time position and content rendering can be performed for the actual time position 40 as shown in FIG.

[0038] A pixel may be composed of a plurality of sub-pixels, and a pixel value may be assigned to each sub-pixel. In the present invention, a pixel may refer to a sub-pixel in some cases. And, allocating a pixel may refer to allocating a sub-pixel.

[0039] Comparing the prior art with the present invention with reference to Figures 1, 2a and 2b, the prior art 3D image display method requires a step of defining virtual eye positions 50 and virtual eye position data, whereas the 3D image display method for realizing a 3D display image according to one embodiment of the present invention does not require virtual eye position data.

[0040] That is, the conventional technology is a method of obtaining virtual eye position data through optical transform using real eye position data, allocating pixel values ​​corresponding to the virtual eye position data to form a pixel allocation map, and creating an image on a display. However, this method requires a step of defining the virtual eye positions and virtual eye position data.

[0041] However, in the 3D image display method according to an embodiment of the present invention, a pixel allocation map is directly formed through pixel value allocation using real eye position data to create an image on a display, and therefore virtual eye position data is not required.

[0042] According to one embodiment of the present invention, a method for pixel allocation and rendering to a real time position is proposed without the need for transformation with a virtual image of the time position.

[0043] First, a 3D display system that implements a pixel allocation and rendering method according to an embodiment of the present invention will be described below.

[0044] An embodiment of a 3D display system for implementing a 3D display may include a 3D image control unit, a 3D display device, and an optical system, where the optical system may include a catadioptric system.

[0045] According to an embodiment, the optical system may be configured to be located in front of the 3D display device, or may be located between a user and the 3D display device.

[0046] Here, the 3D display device may include a display panel and an optical layer. Depending on the embodiment, the optical layer may be a parallax barrier or a lenticular lens. The display panel may include a plurality of pixels, and the 3D image controller may assign pixel values ​​corresponding to a predetermined number of time points to the plurality of pixels based on an input image. For example, the 3D image controller may assign a pixel value corresponding to a first time point to a first pixel and a pixel value corresponding to a second time point to a second pixel.

[0047] According to an embodiment, the first and second time points may include a left eye time point and a right eye time point for a user. The display panel may display a panel image based on pixel values ​​assigned by the 3D image controller.

[0048] Light from a light source can be provided to the pixels of a display panel. For example, the light source can be a backlight unit located behind the display panel. When light is provided to the pixels, light corresponding to the pixel values ​​of the pixels is visible to the user. At this time, an optical layer can limit the direction in which the light is viewed by the user. Specifically, a parallax barrier can output light in a limited direction through slits at regular intervals, and a lenticular lens can output light in a limited direction through lens bending.

[0049] According to the embodiment, a pixel assigned a pixel value according to a first time point may be provided with light in a direction toward the first time point, and a pixel assigned a pixel value according to a second time point may be provided with light in a direction toward the second time point. A user positioned in an eye space can view an image corresponding to the first time point through the first time point, and can view an image corresponding to the second time point through the second time point. If the first time point corresponds to the user's left eye and the second time point corresponds to the user's right eye, the user can experience a three-dimensional effect by viewing different images through both eyes.

[0050] The image output through the 3D display device may be provided to a user through an optical system, which may include, for example, a mirror corresponding to a reflective optical system or a lens corresponding to a refractive optical system.

[0051] According to an embodiment, the 3D display device may be implemented using a screen, and the optical system may magnify an image output to the 3D display device. For example, the 3D display device and the optical system may be implemented as part of a head-up display (HUD) installed in a vehicle. In this case, the optical system may include a semi-transparent concave mirror according to an embodiment.

[0052] In some embodiments, the display panel may include a predetermined number of pixels and the optical layer may include a periodic optical element covering the specified number of pixels, in which case the number of pixels in the display panel may be smaller than the pitch of the optical element.

[0053] The optical system can be configured to deliver the image of the optical layer at a magnification less than that of the display panel, and to vary the number of pixels under each optical element from small to large.

[0054] The 3D image controller can grasp the path of light passing through a pixel of the display panel in order to assign a pixel value to the pixel. Light passing through pixels of the display panel can be referred to as a ray. For example, if a ray of light passing through a first pixel is provided at a first time point, the 3D image controller can assign a pixel value corresponding to the first time point to the first pixel.

[0055] A display pixel may include a sub-pixel structure, and in this patent a sub-pixel structure may be referred to as a pixel structure.

[0056] A display panel according to one embodiment of the present invention may include one or more of an LCD panel with LED illumination, a self-emitting LED / OLED panel, the reproduction field of a holographic spatial light modulator (SLM), or any other projection product with or without the use of DLP engines or microelectromechanical systems (MEMS) relay optics.

[0057] The optical layer according to an embodiment of the present invention may include one of a parallax barrier having opaque regions and transparent slits, a solid lenticular lens array, and a lenticular lens array having an air gap.

[0058] An optical system according to one embodiment of the present invention may comprise one or more refractive or reflective components, at least one of which may act as a combiner to blend the virtual image of the display with the real scene.

[0059] Hereinafter, a 3D image display method according to an embodiment of the present invention, which is implemented through the above-described 3D display system, will be described in detail.

[0060] The 3D display method according to an embodiment of the present invention includes: an eye position information collecting step of collecting actual eye position data of a user;

[0061] a virtual display panel preparation step of preparing a virtual display panel having an AR display specification;

[0062] a virtual barrier calculation step of calculating a virtual barrier based on the real eye position information and the virtual display panel;

[0063] a pixel allocation step of allocating pixels of the virtual display panel to correspond to the actual viewpoint of the user based on the actual eye position information and the virtual barrier;

[0064] rendering stereo content corresponding to the actual time point of the user; and

[0065] The method may further include a display step of displaying a 3D image based on the allocated pixels and the stereo content.

[0066] The 3D image display method according to this embodiment can use actual eye position data obtained from eye-tracking to perform pixel allocation and rendering. The actual eye position information of a user can be collected, for example, through an eye-tracking camera.

[0067] FIG. 3 is a diagram illustrating a process of preparing a virtual display panel and a method of calculating a virtual barrier according to an embodiment of the present invention.

[0068] Referring to FIG. 3, a virtual display panel can be prepared to perform the 3D image display method according to this embodiment. Here, the virtual display panel can be configured to have, for example, an augmented reality display specification. The augmented reality display specification can include a virtual image distance (d) and a viewing angle (θ) depending on the embodiment. Here, the virtual image distance (d) can refer to the distance (d) at which a virtual image is located when it is determined that the virtual image is located at a certain distance from the actual eye position.

[0069] In some embodiments, the viewing angle (θ) may refer to the angle formed by two imaginary lines starting at both ends of the viewing width of the viewing zone encompassing the actual eye position, when the two imaginary lines are set to intersect each other at positions passing through the slits of the imaginary barrier.

[0070] 3, a virtual barrier 100 can be calculated for a virtual display panel. In this case, magnification due to the optical system can be taken into consideration, depending on the embodiment. Specifically, the virtual barrier 100 can be calculated from parameters of the optical system and the position of the virtual display panel.

[0071] Referring to FIG. 3, the virtual display panel can be positioned in a specific manner to provide a virtual image in an initial plane at a virtual image distance (d) from the actual eye position.

[0072] In this case, the optical system can create a three-dimensional display image with a particular magnification.

[0073] To estimate the virtual barrier 100 according to this embodiment, virtual barrier parameters can be calculated. Here, the virtual barrier parameters can include a virtual barrier gap (t') and a virtual barrier pitch (P').

[0074] First, the virtual barrier gap (t') can be calculated by the following Equation 1.

[0075]

number

[0076] where P P is the pixel pitch of the display panel, M is the magnification of the virtual display panel 101, N is the desired number of pixels in the virtual display panel 101 for a single barrier pitch, and θ is the viewing angle encompassing the viewing zone for both the left and right eyes.

[0077] By example, P P and M is the virtual display pixel pitch (P' P ) can be replaced with

[0078]

number

[0079] Then, the virtual barrier pitch (P') can be calculated by the following Equation 3.

[0080]

number

[0081] where d is the virtual image distance.

[0082] In the prior art, in the process of converting a real eye position to a virtual eye position, calculations must be continuously performed according to the real eye position, which causes a problem of slow system performance. That is, the virtual eye position corresponding to the real eye position must be converted, and the virtual screen must also be converted according to this conversion. However, in the present invention, once a fixed virtual screen is calculated for the initially designed real eye position, no additional calculations are required. Therefore, since calculations do not need to be continuously performed, the system speed is improved.

[0083] After the virtual barrier calculation step, a virtual display panel pixel allocation step can be performed in which pixels of the virtual display panel are allocated to the left eye point or the right eye point in accordance with the user's actual viewpoint based on the actual eye position information and the virtual barrier parameters.

[0084] The pixel allocation step of the virtual display panel according to this embodiment can use the concept of a lenticular lens or parallax barrier to split the signals from the pixels to the left eye or the right eye.

[0085] 4 is a diagram illustrating an allocation method based on the short distance rule according to an embodiment of the present invention. Referring to FIG. 4, eye positions can be tracked in pixels through a virtual barrier plane.

[0086] In accordance with an embodiment of the present invention, a 3D image display method acquires actual eye position data obtained from eye tracking to perform pixel allocation and rendering, and then allocates all pixels of a virtual display panel to the left or right eye according to the actual eye position. Then, by performing content rendering for the actual eye position, an image can be displayed on the display. This rendering step will be described later.

[0087] The pixel allocation stage of the virtual display panel will be described first with reference to FIG.

[0088] The pixel allocation stage of the virtual display panel can take into account nearby intersections at the virtual barrier slits in deciding whether to allocate a pixel going to the left eye or a pixel going to the right eye.

[0089] As shown in Figure 4, the actual eyes, i.e., the left eye and the right eye, are positioned corresponding to the viewpoint. Here, accurate eye position data can be obtained by eye tracking.

[0090] Here, a virtual line corresponding to the left eye point and a virtual line corresponding to the right eye point are set to pass through the virtual barrier and converge on one pixel selected on the virtual display panel, so that the virtual lines intersect the virtual barrier.

[0091] The distance from the intersection of the virtual lines and the virtual barrier to the nearest slit of the virtual barrier (Δ R , Δ L ) can be measured. That is, the distance (Δ L ) and the distance (Δ R ) the pixel with the smallest distance result value can be assigned to the left or right eye.

[0092] Referring to FIG. 4, the distance (Δ R ) results in the smallest distance result, pixel (k) can be assigned to the right eye.

[0093] Specifically, pixels of the virtual display panel can be assigned to the left or right eye by the following method.

[0094] First, let me explain the virtual line mentioned above.

[0095] (1) In the first step, each ray can be translated into an assigned pixel. Here, a real ray can be extended by a virtual ray, and vice versa. Here, the ray can be formed as a line that intersects with a virtual barrier plane at the real eye position and also intersects with the virtual display panel 101. Here, the pixel that intersects with the ray in the display panel can become the assigned pixel.

[0096] (2) In the second step, the intersection point between the ray and the barrier plane is calculated.

[0097] (3) In the third step, the distance (Δ R , Δ L ) is calculated. At this time, the distance (Δ R , Δ L ) are compared for the left eye and the right eye, and the minimum distance is the allocation condition. R , Δ L ) can be considered the pixel that belongs to the smallest distance as the assigned pixel.

[0098] In particular, if the eye position data is (x R , y R , d) and (x L , y L , d), and the corresponding pixel is (x P , y P , 0), the center of the barrier is (x b , y b , 0), so Δ R and Δ L can be calculated by the following mathematical formula 4.

[0099]

number

[0100] Here, the pixel is the minimum distance, i.e., Δ R and Δ L The image can be assigned to the left or right eye based on the minimum value between

[0101] Hereinafter, a 3D rendering step of a 3D image display method according to an embodiment of the present invention will be described.

[0102] 5 is a diagram illustrating a system layout for 3D rendering of a stereo content scene with a single path from a virtual display to real eyes, according to one embodiment of the present invention. In FIG. 5, the optical system is simplified to a single mirror.

[0103] Referring to FIG. 5, the 3D scene stereo content is generated by eye position data (x R , y R , z R )(x L , y L , z L ) and the distance between the virtual image distance (d) and the real eye.

[0104] Here, the eye position data is the left eye position data (x L , y L , z L ) and right eye position data (x R , y R , z R ).

[0105] In the early days L / z R =d, but may change depending on the user's movements.

[0106] The rendered stereo image is then assigned to the pixels of the display panel.

[0107] 6 is a diagram showing a system layout for allocation and rendering with a single path from a virtual display to real eyes according to one embodiment of the present invention. Referring to FIG. 6, an allocation with a layout equivalent to rendering using virtual objects on a more complex optical system layout is shown.

[0108] On the other hand, after calculating the virtual barrier parameters in the virtual barrier calculation step, pixel allocation and rendering can be performed immediately as described above, but we still need to design a physical device. To design a physical device, i.e., an actual 3D image display device, we can calculate the actual barrier from the virtual barrier.

[0109] 7 is a diagram showing a process of calculating a real barrier from a virtual barrier 100, taking into account the configuration of an optical system 110, according to one embodiment of the present invention. In FIG. 7, the barrier and screen are located at different distances from the principal plane of the optical system, so their magnifications are different. In FIG. 7, the optical system is simplified to a single mirror.

[0110] The method for designing a 3D image display device according to an embodiment of the present invention includes the steps of: collecting actual eye position data of a user;

[0111] a virtual display panel preparation step of preparing a virtual display panel having an AR displays specification;

[0112] A virtual barrier calculation step of calculating a virtual barrier based on the real eye position information and the virtual display panel; and

[0113] The method may further include an actual barrier design step of designing an actual barrier based on the virtual barrier.

[0114] The 3D image display device designed herein can include two main components that split the light signal from the pixels to the left or right eye: a display panel and an optical layer.

[0115] In the actual barrier design stage according to this embodiment, the optical properties of the optical system 110 can be used to implement an optical layer according to the parameters of the virtual barrier 100 calculated in the virtual barrier calculation stage described above.

[0116] The real barrier 120 and the real display panel 130 have different distances to the optical system 110 or to the principal plane of the optical system 110 and therefore different magnifications as shown in FIG.

[0117] To design the real barrier 120 according to this embodiment, the parameters of the real barrier can be calculated. Here, the parameters of the real barrier are the distance (a) from the principal plane 111 of the optical system 110 to the real barrier 120. b ), the actual barrier gap (t), and the actual barrier pitch (P) can be calculated.

[0118] Referring to Figure 7, a d is the distance from the main plane 111 to the actual display panel 130, and a' dis the distance from the principal plane 111 to the virtual display panel 101, and f is the focal length of the optical system.

[0119] First, the distance (a) from the main plane 111 to the actual barrier 120 b ) can be calculated by the following mathematical formula 5.

[0120]

number

[0121] where a' b is the distance from the principal plane 111 of the optical system 110 to the virtual barrier 100. b ) can be calculated by the following mathematical formula 6.

[0122]

number

[0123] Then, the actual barrier gap (t) can be calculated by the following mathematical formula 7.

[0124]

number

[0125] And the virtual barrier 100 magnification (M b ) can be calculated by the following mathematical formula 8.

[0126]

number

[0127] Here, the virtual barrier magnification of 100 (M b ) is smaller than the magnification (M) of the virtual display panel 101.

[0128] The actual barrier pitch (P) can be calculated by the following mathematical formula 9.

[0129]

number

[0130] The actual barrier pitch (P) is N*P P The virtual barrier pitch (P') is slightly larger than N*P'. P This corresponds to the position in front of and behind the display panel at each point in time.

[0131] FIG. 8a is a diagram showing a real barrier 120 as a parallax barrier having slits according to one embodiment of the present invention, FIG. 8b is a diagram showing a real barrier 120 as a lenticular lens having an air gap according to one embodiment of the present invention, and FIG. 8c is a diagram showing a real barrier 120 as a solid lenticular lens according to one embodiment of the present invention.

[0132] 8, the actual barrier may be designed as a parallax barrier, a lenticular lens with an air gap, or a solid lenticular lens, depending on the embodiment. Here, the barrier gap varies depending on the medium between the pixel and the barrier, but in this embodiment, calculations were performed for the case where the medium is air.

[0133] In the case of Figure 8a, a real parallax barrier is designed as the real barrier. In this case, the real parallax barrier can be designed using the real barrier gap (t) and real barrier pitch (P), which are the parameters of the real barrier described above.

[0134] That is, the actual barrier gap (t), which is a parameter of the actual barrier, can correspond to the thickness (t) of the actual parallax barrier, and the actual barrier pitch (P), which is a parameter of the actual barrier, can correspond to the distance (P) between the slits of the actual parallax barrier, so that the actual parallax barrier can be designed using this.

[0135] 8b, a practical lenticular lens having an air gap as a practical barrier is designed. In this case, the practical barrier gap (t), which is a parameter of the practical barrier, corresponds to the distance (t) between the practical lenticular lens to be designed and the practical display panel, and the practical barrier pitch (P) corresponds to the distance (P) between the centers of the convex portions of the practical lenticular lens to be designed. Therefore, practical lenticular lenses having an air gap can be designed using this.

[0136] In the embodiment, when a lenticular lens is used as the real barrier, the radius of the lenticular lens can be calculated so that the real barrier gap (t) corresponds to the focal length of the lenticular lens.

[0137] In the case of Figure 8c, a real solid lenticular lens is designed as the real barrier. In this case, the real barrier gap (t), which is a parameter of the real barrier, corresponds to the thickness (t) of the real solid lenticular lens, and the real barrier pitch (P) corresponds to the distance (P) between the centers of the convex parts of the real solid lenticular lens, so the real solid lenticular lens can be designed using this.

[0138] Generally, since a lenticular lens is made of a solid material, its actual thickness is t*n, where n is the refractive index of the lenticular lens material.

[0139] The above-described embodiments of the present disclosure may be embodied in the form of a computer program executable by various components on a computer, and such a computer program may be recorded on a computer-readable medium, which may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, and flash memories.

[0140] Meanwhile, the computer program may be one specially designed and constructed for the present disclosure, or one that is known and available to those of ordinary skill in the art of computer software. Examples of the computer program include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc.

[0141] In the specification of this disclosure (particularly in the claims), the use of the term "said" and similar indicators may be used in both singular and plural. Furthermore, when a range is described in this disclosure, it includes inventions to which individual values ​​within that range are applied (unless otherwise specified), and is equivalent to describing each individual value comprising that range in the detailed description of the invention. Unless explicitly stated or stated to the contrary, steps constituting a method according to the present disclosure may be performed in any suitable order. The present disclosure is not necessarily limited by the order of steps described above. The use of all examples or exemplary terms (e.g., etc.) in the present disclosure is merely for the purpose of explaining the present disclosure in detail, and the scope of the present disclosure is not limited by the claims. In addition, those skilled in the art will understand that various modifications, combinations, and variations can be made within the scope of the appended claims or their equivalents, depending on design conditions and factors. Therefore, the concept of the present disclosure should not be limited to the above-described embodiments, and not only the scope of the claims described below, but also all scopes equivalent to the scope of the claims or equivalent modifications thereto in the future fall within the scope of the concept of the present disclosure. The above description is merely an illustrative example of the technical concept of the present invention, and various modifications and variations can be made by a person having ordinary skill in the art to which the present invention pertains without departing from the essential characteristics of the present invention. The embodiments disclosed in the present invention are intended to illustrate, not limit, the technical idea of ​​the present invention, and the scope of the technical idea of ​​the present invention is not limited by these embodiments. [Explanation of symbols]

[0142] 100 Virtual Barrier 101 Virtual Display Panel 110 Optical System 111 Principal plane 120 Actual Barrier 130 Actual Display Panel

Claims

1. An eye position information collecting step of collecting actual eye position data of a user; a virtual display panel preparation step of preparing a virtual display panel having an AR display specification; a virtual barrier calculation step of calculating a virtual barrier based on the real eye position information and the virtual display panel; a pixel allocation step of allocating pixels of the virtual display panel to correspond to the actual viewpoint of the user based on the actual eye position information and the virtual barrier; Rendering stereo content corresponding to the actual time point of the user; and a display step of displaying a 3D image based on the allocated pixels and the stereo content; Contains A three-dimensional image display method.

2. The actual eye position information is collected through an eye tracking camera.

2. The three-dimensional image display method according to claim 1.

3. The actual time points include a left eye time point and a right eye time point, The pixel allocation step allocates pixels corresponding to the left eye time point and pixels corresponding to the right eye time point, respectively.

2. The three-dimensional image display method according to claim 1.

4. The actual time points include a left eye time point and a right eye time point, The stereo content is paired data of content corresponding to the left eye time point and content corresponding to the right eye time point.

2. The three-dimensional image display method according to claim 1.

5. The augmented reality display specifications include the virtual image distance (d) and the viewing angle (θ).

2. The three-dimensional image display method according to claim 1.

6. The virtual display panel has a first parameter: The virtual barrier calculation step calculates a second parameter of the virtual barrier based on the augmented reality display specifications, the first parameter, and the actual eye position information.

2. The three-dimensional image display method according to claim 1.

7. The first parameter is the magnification (M) of the virtual display panel and the pixel pitch (P') of the virtual display panel. Ｐ ) and the number (N) 7. The three-dimensional image display method according to claim 6.

8. The second parameter includes the virtual barrier gap (gap, t') and the virtual barrier pitch (P').

7. The three-dimensional image display method according to claim 6.

9. A method stored on a medium for performing the method according to any one of claims 1 to 8 in combination with hardware. A computer program characterized by:

10. an information collecting step of collecting actual eye position data of the user; a virtual display panel setting step of setting a virtual display panel located at a predetermined virtual image distance (d) from the actual eye position information and having a first parameter; a virtual barrier calculation step of calculating a second parameter of a virtual barrier based on the augmented reality display specifications, the first parameter, and the actual eye position information; a pixel allocating step of allocating pixels of the virtual display panel based on the virtual barrier and the actual left eye position information and the actual right eye position information, the actual eye position information including actual left eye position information and actual right eye position information, and the second parameter calculated; A rendering step of rendering paired contents corresponding to the actual left eye position information and the actual right eye position information, respectively; and a display step of displaying a 3D image based on the allocated pixels and the corresponding content; Contains A three-dimensional image display method.

11. a processor; and memory containing computer-readable instructions; Including, When the instruction is executed by the processor, the processor calculates a virtual barrier based on the collected actual eye position data of the user and a virtual display panel having an AR display specification, Allocating pixels of the virtual display panel to correspond to the user's actual viewpoint based on the actual eye position information and the virtual barrier; Rendering stereo content corresponding to the actual time point of the user; Displaying a 3D image based on the allocated pixels and the stereo content. A three-dimensional image display device.

12. The augmented reality display specifications include the virtual image distance (d) and the viewing angle (θ).

12. The three-dimensional image display device according to claim 11.

13. The virtual display panel has a first parameter: The virtual barrier calculation step calculates a second parameter of the virtual barrier based on the augmented reality display specifications, the first parameter, and the actual eye position information.

12. The three-dimensional image display device according to claim 11.

14. The first parameter is the magnification (M) of the virtual display panel and the pixel pitch (P') of the virtual display panel. Ｐ ) and the number (N) 14. The three-dimensional image display device according to claim 13.

15. The second parameter includes the virtual barrier gap (gap, t') and the virtual barrier pitch (P').

14. The three-dimensional image display device according to claim 13.

16. An eye position information collecting step of collecting actual eye position data of a user; a virtual display panel preparation step of preparing a virtual display panel having an AR display specification; A virtual barrier calculation step of calculating a virtual barrier based on the real eye position information and the virtual display panel; and an actual barrier design step of designing an actual barrier based on the virtual barrier; Contains A method for designing a three-dimensional image display device.

17. The augmented reality display specifications include the virtual image distance (d) and the viewing angle (θ).

17. The method for designing a three-dimensional image display device according to claim 16.

18. The virtual display panel has a first parameter: The virtual barrier calculation step calculates a second parameter of the virtual barrier based on the augmented reality display specifications, the first parameter, and the actual eye position information.

17. The method for designing a three-dimensional image display device according to claim 16.

19. The first parameter is the magnification (M) of the virtual display panel and the pixel pitch (P') of the virtual display panel. Ｐ ) and the number (N) 20. The method for designing a three-dimensional image display device according to claim 18.

20. The second parameter includes the virtual barrier gap (gap, t') and the virtual barrier pitch (P').

20. The method for designing a three-dimensional image display device according to claim 18.

21. In the actual barrier design step, a third parameter of the actual barrier is calculated and designed using a second parameter of the virtual barrier.

17. The method for designing a three-dimensional image display device according to claim 16.

22. The second parameter includes a virtual barrier gap (gap, t') and a virtual barrier pitch (P'), and the third parameter includes a real barrier gap (t) and a real barrier pitch (P).

22. The method for designing a three-dimensional image display device according to claim 21.

23. The actual barrier design step is performed by determining the distance (a) from the main plane of the actual optical system to the actual display panel. b ) and the distance (a) to the actual barrier in the principal plane of the actual optical system d ) is calculated 17. The method for designing a three-dimensional image display device according to claim 16.

Images