Method and device for measuring hud ghost image

Abstract

A method for measuring an optical characteristic according to embodiments of the present invention comprises the steps of: using one or more light measuring devices to generate images including points in each pattern for a virtual image plane, each of the images being captured on the basis of the one or more light measuring devices and corresponding to at least one of a left image, a center image, or a right image; and generating the positions of the points on the basis of the one or more light measuring devices and each of the patterns. The method further comprises a step of generating a level for a ghost image for the virtual image plane on the basis of the generated positions, wherein the positions are obtained on the basis of the field of view of the one or more light measuring devices and the gap between a left light measuring device and a right light measuring device.

Description

HUD ghost image measurement method and device

[0001] The present invention relates to a method and device for measuring a HUD ghost image, and more particularly, to a method and device for measuring the optical characteristics of a three-dimensional virtual image generated by an augmented reality device.

[0002] Augmented reality (AR) is a branch of virtual reality (AR) that is frequently used in digital media as a computer graphics technique that synthesizes virtual objects or information into the real environment to make them appear as if they existed in the original environment.

[0003] Augmented reality (AR) combines the real world with a virtual world with additional information in real time, creating a single image. Therefore, it's also called mixed reality (MR). Hybrid VR systems, which merge real and virtual environments, have been researched and developed since the late 1990s, primarily in the United States.

[0004] For example, AR can be used in remote medical diagnosis, broadcasting, architectural design, and manufacturing process management. Furthermore, with the recent widespread adoption of smartphones, it has entered the full-scale commercialization phase, and various products are being developed in the gaming and mobile solutions industries, as well as in education.

[0005] Meanwhile, wearable computers can be used to realize AR outdoors. In particular, head-mounted displays (HMDs) enable AR by overlaying computer graphics and text onto the user's actual environment in real time. Furthermore, head-up displays (HUDs) enable AR by projecting various driving information onto the outside of a vehicle's windshield.

[0006] For example, a head-up display can implement augmented reality by projecting light from inside the vehicle onto a virtual plane located outside the windshield, thereby allowing the driver to obtain information necessary for driving the vehicle on that virtual plane without moving their eyes while driving.

[0007] At this time, the geometric characteristics, including the position of the virtual plane formed by the augmented reality device, can be determined according to the optical characteristics of the individual augmented reality device, such as the HMD and HUD.

[0008] Therefore, there is a growing need for a method and device capable of measuring optical characteristics of the output of an augmented reality device.

[0009] Related prior art includes Korean Patent Publication No. 10-2017-0114375 (Title of invention: Virtual reality content display method and device, publication date: October 16, 2017).

[0010] The present invention seeks to provide a method and device for measuring optical characteristics of a virtual image generated by an augmented reality device.

[0011] In addition, the present invention seeks to provide a method and device for calculating a virtual image distance, a look down / up angle, a horizontal / vertical field of view, static distortion, a ghosting level, etc. of a virtual image based on a user of an augmented reality device by using the optical characteristics of a virtual image generated by an augmented reality device.

[0012] The problems to be solved by the present invention are not limited to the problem(s) mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

[0013] In order to achieve the above object, the method for measuring optical characteristics of an augmented reality device provided in the present invention includes the steps of: capturing a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position; obtaining angle information including information on angles of view of the plurality of cameras and arrangement information including information on arrangement of the plurality of cameras; and calculating coordinates of the plurality of patterns based on the measurement reference position based on the plurality of captured images captured by the plurality of cameras, the angle information, and the arrangement information.

[0014] Preferably, when the plurality of cameras are a central camera located at the measurement reference position, a left camera and a right camera located symmetrically with respect to the measurement reference position, and the plurality of patterns are arranged in horizontal and vertical alignment on the test image, the step of calculating the coordinates of the plurality of patterns may calculate the coordinates of the plurality of patterns by using the horizontal pixel count of the plurality of captured images, the coordinates of the plurality of patterns in the plurality of captured images, the angles of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0015] Preferably, the step of calculating the coordinates of the plurality of patterns can calculate the coordinates of the plurality of patterns using mathematical expression 1.

[0016] [Mathematical Formula 1]

[0017]

[0018]

[0019]

[0020] Here, x ij , y ij , z ijare the x, y, and z-axis coordinates of the i-th horizontal and j-th vertical pattern based on the measurement reference position, α is the distance between the left camera and the right camera, M is the horizontal pixel number of the plurality of captured images, θ is the angle of view of the plurality of cameras, and m L ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the above-mentioned captured image of the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the above-described captured image of the above-described central camera.

[0021] Preferably, the method may further include a step of calculating a virtual image distance between the measurement reference position and the virtual plane using the coordinates of the measurement reference position and the coordinates of at least one of the plurality of patterns on the virtual plane.

[0022] Preferably, the step of calculating the virtual image distance can calculate the virtual image distance using mathematical expression 2.

[0023] [Equation 2]

[0024]

[0025] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the coordinate of one of the above multiple patterns.

[0026] Preferably, the method may further include a step of calculating a look down / up angle from the measurement reference position to the virtual plane using the coordinates of the measurement reference position and the coordinates of at least one of the plurality of patterns on the virtual plane.

[0027] Preferably, the step of calculating the lookdown / up angle can calculate the lookdown / up angle using mathematical expression 3.

[0028] [Equation 3]

[0029]

[0030] Here, θ down / up is the above lookdown / up angle, and x 22 , y 22 , z 22 is the coordinate of one of the above multiple patterns.

[0031] Preferably, the method may further include a step of calculating a horizontal field of view of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among the plurality of patterns on the virtual plane.

[0032] Preferably, the step of calculating the horizontal viewing angle can calculate the horizontal viewing angle using mathematical expression 4.

[0033] [Equation 4]

[0034]

[0035] Here, θ H FOV is the horizontal viewing angle, O is the coordinate of the measurement reference position, and P 21 and P 23 are the coordinates of two patterns located at both ends in the horizontal direction.

[0036] Preferably, the method may further include a step of calculating a vertical field of view of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among the plurality of patterns on the virtual plane.

[0037] Preferably, the step of calculating the vertical viewing angle can calculate the vertical viewing angle using mathematical expression 5.

[0038] [Equation 5]

[0039]

[0040] Here, θ V FOV is the vertical viewing angle, O is the coordinate of the measurement reference position, and P 12 and P 32 are the coordinates of two patterns located at both ends in the vertical direction.

[0041] Preferably, the method may further include a step of calculating static distortion for each of three axes based on the measurement reference position based on the coordinates of the plurality of patterns on the virtual plane.

[0042] Preferably, the step of calculating the coordinates of the plurality of patterns may further include the step of calculating the coordinates of the plurality of ghost patterns corresponding to each of the plurality of patterns, and calculating a ghosting level based on the coordinates of the plurality of patterns and the coordinates of the plurality of ghost patterns.

[0043] In addition, in order to achieve the above object, the optical characteristic measuring device of the augmented reality device provided in the present invention includes a photographing unit that photographs a test image including a plurality of patterns output on a virtual plane by the augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position; an obtaining unit that obtains angle information including information on angles of view of the plurality of cameras and arrangement information including information on arrangement of the plurality of cameras; and a calculating unit that calculates coordinates of the plurality of patterns based on the measurement reference position, based on the plurality of photographed images photographed by the plurality of cameras, the angle information, and the arrangement information.

[0044] Preferably, when the plurality of cameras are a central camera located at the measurement reference position, a left camera and a right camera located symmetrically with respect to the measurement reference position, and the plurality of patterns are arranged in horizontal and vertical alignment on the test image, the calculation unit can calculate the coordinates of the plurality of patterns by using the horizontal pixel count of the plurality of captured images, the coordinates of the plurality of patterns in the plurality of captured images, the angles of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0045] Preferably, the output unit can output the coordinates of the plurality of patterns using mathematical expression 6.

[0046] [Equation 6]

[0047]

[0048]

[0049]

[0050] Here, x ij , y ij , z ijare the x, y, and z-axis coordinates of the i-th horizontal and j-th vertical pattern based on the measurement reference position, α is the distance between the left camera and the right camera, M is the horizontal pixel number of the plurality of captured images, θ is the angle of view of the plurality of cameras, and m L ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the above-mentioned captured image of the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the above-described captured image of the above-described central camera.

[0051] Preferably, the calculation unit can further calculate a virtual image distance between the measurement reference position and the virtual plane by using the coordinates of the measurement reference position and the coordinates of at least one of the plurality of patterns on the virtual plane.

[0052] Preferably, the above-described output unit can calculate the virtual image distance using mathematical expression 7.

[0053] [Equation 7]

[0054]

[0055] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the coordinate of one of the above multiple patterns.

[0056] Preferably, the calculation unit can further calculate a lookdown / up angle for the virtual plane from the measurement reference position using the coordinates of the measurement reference position and the coordinates of at least one of the plurality of patterns on the virtual plane.

[0057] Preferably, the output unit can calculate the lookdown / up angle using mathematical expression 8.

[0058] [Equation 8]

[0059]

[0060] Here, θ down / up is the above lookdown / up angle, and x 22 , y 22 , z 22 is the coordinate of one of the above multiple patterns.

[0061] Preferably, the calculation unit can further calculate the horizontal viewing angle of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among the plurality of patterns on the virtual plane.

[0062] Preferably, the output unit can calculate the horizontal viewing angle using mathematical expression 9.

[0063] [Equation 9]

[0064]

[0065] Here, θ H FOV is the horizontal viewing angle, O is the coordinate of the measurement reference position, and P 21 and P 23 are the coordinates of two patterns located at both ends in the horizontal direction.

[0066] Preferably, the calculation unit can further calculate the vertical viewing angle of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among the plurality of patterns on the virtual plane.

[0067] Preferably, the output unit can calculate the vertical viewing angle using mathematical expression 10.

[0068] [Equation 10]

[0069]

[0070] Here, θ V FOV is the vertical viewing angle, O is the coordinate of the measurement reference position, and P 12 and P 32 are the coordinates of two patterns located at both ends in the vertical direction.

[0071] Preferably, the output unit can further output static distortion for each of three axes based on the measurement reference position, based on the coordinates of the plurality of patterns on the virtual plane.

[0072] Preferably, the calculation unit may further calculate coordinates of a plurality of ghost patterns corresponding to each of the plurality of patterns based on the plurality of photographed images, the angle of view information, and the arrangement information, and may further calculate a ghosting level based on the coordinates of the plurality of patterns and the coordinates of the plurality of ghost patterns.

[0073] A method for measuring optical characteristics according to embodiments further comprises the steps of: generating images including points within each pattern for a virtual image plane using one or more optical measurement devices, each image captured based on the one or more optical measurement devices, each image corresponding to at least one of a left image, a center image, and a right image; and generating positions of the points based on the one or more optical measurement devices and each pattern; and generating levels for ghost images for the virtual image plane based on the generated positions, wherein the positions are obtained based on a field of view of the one or more optical measurement devices, a gap between a left optical measurement device and a right optical measurement device.

[0074] The present invention has the effect of easily measuring the optical characteristics of a virtual image generated by an augmented reality device by using a plurality of cameras.

[0075] In addition, the present invention has the effect of being able to calculate the virtual image distance, look down / up angle, horizontal / vertical field of view, static distortion, ghosting level, etc. of the virtual image based on the user of the augmented reality device by utilizing the optical characteristics of the virtual image generated by the augmented reality device.

[0076] FIG. 1 is a flowchart illustrating a method for measuring optical characteristics of an augmented reality device according to one embodiment of the present invention.

[0077] Figure 2 is a flowchart illustrating a method for calculating a virtual image distance according to one embodiment of the present invention.

[0078] FIG. 3 is a flowchart illustrating a lookdown / up angle calculation method according to one embodiment of the present invention.

[0079] Figure 4 is a flowchart showing a method for calculating a horizontal viewing angle according to one embodiment of the present invention.

[0080] Figure 5 is a flowchart showing a method for calculating a vertical viewing angle according to one embodiment of the present invention.

[0081] Figure 6 is a flowchart illustrating a static distortion calculation method according to one embodiment of the present invention.

[0082] Figure 7 is a flowchart illustrating a ghosting level calculation method according to one embodiment of the present invention.

[0083] FIG. 8 is a block diagram showing an optical characteristic measurement device of an augmented reality device according to one embodiment of the present invention.

[0084] FIGS. 9A and 9B are drawings for explaining an environment for measuring optical characteristics of an augmented reality device according to one embodiment of the present invention.

[0085] FIG. 10 is a drawing for explaining the result of capturing a test image on a virtual plane using multiple cameras according to one embodiment of the present invention.

[0086] FIGS. 11a and 11b are drawings for explaining coordinates of a plurality of patterns included in a photographed image taken using a plurality of cameras according to one embodiment of the present invention.

[0087] FIGS. 12a and 12b are drawings for explaining a method for calculating coordinates of a plurality of patterns according to one embodiment of the present invention.

[0088] FIG. 13 is a drawing for explaining a method for calculating a virtual image distance according to one embodiment of the present invention.

[0089] FIGS. 14a and 14b are drawings for explaining a method for calculating a lookdown / up angle according to one embodiment of the present invention.

[0090] FIGS. 15a and 15b are drawings for explaining a method for calculating a horizontal viewing angle and a vertical viewing angle according to one embodiment of the present invention.

[0091] FIG. 16 is a diagram for explaining a method for calculating static distortion according to one embodiment of the present invention.

[0092] FIG. 17 is a diagram for explaining a method for calculating a ghosting level according to one embodiment of the present invention.

[0093] FIG. 18 illustrates a measurement configuration for image quality characteristics of a virtual image type 3D display such as a 3D HUD according to embodiments.

[0094] Figure 19 shows a measurement method for ghost images according to embodiments.

[0095] Figure 20 shows a test image with nine measurement points according to embodiments and three corresponding images captured by LMDs.

[0096] Figure 21 illustrates a method for obtaining a ghost level for a ghost image according to embodiments.

[0097] Figure 22 shows an optical measurement method according to embodiments.

[0098] Figure 23 illustrates a setup configuration for ghost images and binocular misalignment according to embodiments.

[0099] Fig. 24 shows an optical measuring device according to embodiments.

[0100] The present invention is susceptible to various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention. Throughout the description of each drawing, similar reference numerals have been used to designate similar components.

[0101] Terms such as first, second, A, and B may be used to describe various components, but these components should not be limited by these terms. These terms are used solely to distinguish one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term "and / or" includes a combination of multiple related items described herein or any of multiple related items described herein.

[0102] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0103] The terminology used in this application is only used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that the terms "comprise" or "have" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0104] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0105] Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the attached drawings.

[0106] The present invention relates to a method and apparatus for measuring optical characteristics of a virtual reality device, and the measurement can be performed in the following environment. For example, referring to FIG. 9A, a user's eyes are positioned in an eye box, and a virtual plane by an output of the virtual reality device can be formed outside a transparent or translucent screen (e.g., a windshield of a vehicle). At this time, the user can see the entire virtual plane by moving only the eyes. In addition, referring to FIG. 9B, a plurality of cameras can be arranged in the eye box centered on a measurement reference position. More specifically, a cam C is placed, and cams are positioned symmetrically on both sides L and cam R This can be arranged. Meanwhile, multiple patterns can be positioned in the test image, aligned horizontally and vertically (e.g., 3x3).

[0107] However, the present invention is not limited to this environment and can be implemented in various other environments. For example, the location and size of the eye box, the number and arrangement of cameras, and the number and arrangement of patterns included in the test image may vary depending on the measurement environment.

[0108] FIG. 1 is a flowchart illustrating a method for measuring optical characteristics of an augmented reality device according to one embodiment of the present invention.

[0109] In step S110, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0110] For example, referring to FIG. 9b, one camera may be placed at a measurement reference position located at the center of the eye box, and the remaining cameras may be placed symmetrically facing the front at the same height on either side of it.

[0111] At this time, the optical characteristic measurement device can be connected to multiple cameras wirelessly or via wires to transmit a command to capture a test image on a virtual plane.

[0112] In step S120, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0113] For example, an optical characteristic measurement device may receive information about the camera's angle of view and camera arrangement from a user, thereby obtaining angle of view information and arrangement information. Preferably, the information about the camera's angle of view may be a horizontal angle of view, and the information about the camera arrangement may be a distance between cameras arranged symmetrically on either side of a measurement reference position.

[0114] Finally, in step S130, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0115] At this time, the optical characteristic measuring device can calculate three-dimensional coordinates of multiple patterns on a virtual plane with the measurement reference position as the origin (0, 0, 0) by using information about the sizes of multiple captured images, information about coordinates of multiple patterns included in the multiple captured images within the images, information about the angles of view of multiple cameras, and information about the arrangement of multiple cameras.

[0116] Meanwhile, a detailed method for calculating the coordinates of multiple patterns is described in detail in the examples below.

[0117] In another embodiment, when the optical characteristic measurement device has a central camera positioned at a measurement reference position, a left camera, and a right camera positioned symmetrically with respect to the measurement reference position, and a plurality of patterns are arranged in a horizontal and vertical alignment on a test image, the coordinates of the plurality of patterns can be calculated using the horizontal pixel count of the plurality of captured images, the coordinates of the plurality of patterns in the plurality of captured images, the angles of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0118] For example, referring to FIG. 9b, a central camera (cam) is positioned at a measurement reference position with multiple cameras. C ) and the left camera (cam) positioned symmetrically around the measurement reference position L ) and right camera (cam R ) can be. Additionally, nine patterns can be arranged horizontally and vertically in the test image.

[0119] At this time, the optical characteristic measuring device can calculate the three-dimensional coordinates of nine patterns on a virtual plane with the measurement reference position as the origin (0, 0, 0) by using the horizontal pixel count of multiple captured images, the coordinates of multiple patterns in the multiple captured images, the angles of view of the multiple cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0120] In another embodiment, the optical property measurement device can calculate coordinates of a plurality of patterns using mathematical expression 1.

[0121] [Mathematical Formula 1]

[0122]

[0123]

[0124]

[0125] Here, x ij , y ij , z ijare the x, y, and z-axis coordinates of the i-th horizontal and j-th vertical pattern based on the measurement reference position, α is the distance between the left and right cameras, M is the horizontal pixel count of multiple captured images, θ is the angle of view of multiple cameras, and m L ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the central camera.

[0126] At this time, referring to Figure 10, the central camera (cam) is positioned at the measurement reference position, which is the center of the eye box. C ) is placed, and the left camera (cam L ) and right camera (cam R ) can be placed at a distance of α. And, the central camera (cam) is placed so that the optical characteristic measurement device faces the front. C ), left camera (cam L ) and right camera (cam R ) can be used to capture a test image on a virtual plane. As a result, the left camera (cam L ) captured image by cam L ) is the test image is shifted to the right, and the central camera (cam C ) captured image by cam C ) is not biased in the test image, and the right camera (cam R ) captured image by cam R ) may cause the test image to be shifted to the left.

[0127] Meanwhile, referring to Fig. 11a, the three-dimensional coordinates of the nine patterns appearing on the virtual plane are P ij = (x ij , y ij , z ij ) can be represented as, i can be the horizontal index of the pattern (i=1,2,3), j can be the vertical index of the pattern (j=1,2,3). That is, P ij can be the three-dimensional coordinates of the center of the i-th horizontal and j-th vertical pattern.

[0128] Also, referring to Fig. 11b, the pixel coordinates of the nine patterns appearing in the captured image are P L ij , P C ij , P R ij , and each can be represented by the left camera (cam L ), central camera (cam C ), right camera (cam R ) may mean the coordinates of the pattern that appears in the photographed image. At this time, P L ij = (m L ij , n L ij ), P C ij = (m C ij , n C ij ), P R ij = (m R ij , n R ij ) may be. At this time, P L ij , P C ij , P R ij may be the pixel coordinates of the center of the i-th horizontal and j-th vertical pattern.

[0129] Meanwhile, referring to Fig. 12a, it can be seen that a proportional relationship as in mathematical equation 2 below holds.

[0130] [Equation 2]

[0131]

[0132] Here, z is the distance from the measurement reference position to the virtual plane along the z-axis, θ is the angle of view of the camera, α is the distance between the left and right cameras, and m L ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and M is the horizontal pixel number of the image captured.

[0133] At this time, it is obvious that mathematical expression 1 can be obtained by transforming mathematical expression 2.

[0134] For example, referring to Fig. 12b, the optical characteristic measurement device is a central camera (cam) with respect to the same pattern (i=1, j=1). C ), left camera (cam L ) and right camera (cam R ) using the results taken using mathematical expression 1, x 11 , y 11 , z 11 can be produced.

[0135] Figure 2 is a flowchart illustrating a method for calculating a virtual image distance according to one embodiment of the present invention.

[0136] In step S210, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0137] In step S220, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0138] In step S230, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0139] Finally, in step S240, the optical characteristic measurement device calculates a virtual image distance between the measurement reference position and the virtual plane using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0140] For example, referring to Fig. 13, the optical characteristic measurement device is P based on the measurement reference position (0, 0, 0). 22 The coordinates of (x 22 , y 22 , z 22 ) can be used to calculate the virtual image distance.

[0141] In another embodiment, the optical property measurement device can calculate the virtual image distance using Equation 3.

[0142] [Equation 3]

[0143]

[0144] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the three-dimensional coordinate of the pattern where i=2, j=2.

[0145] FIG. 3 is a flowchart illustrating a lookdown / up angle calculation method according to one embodiment of the present invention.

[0146] In step S310, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0147] In step S320, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0148] In step S330, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0149] Finally, in step S340, the optical characteristic measurement device calculates a look down / up angle from the measurement reference position to the virtual plane using the coordinates of the measurement reference position and at least one coordinate of a plurality of patterns on the virtual plane.

[0150] At this time, the lookdown / up angle is an angle that represents the difference in height between the eye box and the virtual plane, indicating whether the user is looking up or down at the virtual plane.

[0151] For example, P is based on the measurement reference position (0, 0, 0) where the user's eyes are located. 22 The coordinates of (x 22 , y 22 , z 22 ) was calculated, y 22 If < 0, it becomes a look down situation as in Fig. 14a, and y 22 > If 0, it can lead to a lookup situation like in Figure 14b.

[0152] In another embodiment, the optical property measurement device can calculate the lookdown / up angle using Equation 4.

[0153] [Equation 4]

[0154]

[0155] Here, θ down / up is the lookdown / up angle, and x 22 , y 22 , z22 is the three-dimensional coordinate of the pattern where i=2, j=2.

[0156] Figure 4 is a flowchart showing a method for calculating a horizontal viewing angle according to one embodiment of the present invention.

[0157] In step S410, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0158] In step S420, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0159] In step S430, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0160] Finally, in step S440, the optical characteristic measurement device calculates the horizontal field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among the plurality of patterns on the virtual plane.

[0161] For example, referring to Fig. 15a, the optical characteristic measurement device has three-dimensional coordinates O = (0, 0, 0) of the measurement reference position, and two patterns P located at both ends in the horizontal direction among multiple patterns on the virtual plane. 21 = (x 21 , y 21 , z 21 ) and P 23 = (x 23 , y 23 , z 23 ) using the three-dimensional coordinates of the angle ∠P 21 OP 23 can be calculated as a horizontal field of view.

[0162] In another embodiment, the optical property measurement device can calculate the horizontal viewing angle using Equation 5.

[0163] [Equation 5]

[0164]

[0165] Here, θ H FOV is the horizontal field of view, O is the coordinate of the measurement reference position, and P 21 and P 23 are the coordinates of two patterns located at both ends in the horizontal direction among multiple patterns.

[0166] Figure 5 is a flowchart showing a method for calculating a vertical viewing angle according to one embodiment of the present invention.

[0167] In step S510, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0168] In step S520, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0169] In step S530, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0170] Finally, in step S540, the optical characteristic measurement device calculates a vertical field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among the plurality of patterns on the virtual plane.

[0171] For example, referring to FIG. 15b, the optical characteristic measurement device has three-dimensional coordinates O = (0, 0, 0) of the measurement reference position, and two patterns P located at both ends in the vertical direction among multiple patterns on the virtual plane. 12 = (x 12 , y 12 , z 12 ) and P 32 = (x 32 , y 32 , z 32 ) using the three-dimensional coordinates of the angle ∠P 12 OP 32 can be calculated as a vertical viewing angle.

[0172] In another embodiment, the optical property measurement device can calculate the vertical viewing angle using Equation 6.

[0173] [Equation 6]

[0174]

[0175] Here, θ V FOV is the vertical viewing angle, O is the coordinate of the measurement reference position, and P 12 and P 32 are the coordinates of two patterns located at both ends in the vertical direction.

[0176] Figure 6 is a flowchart illustrating a static distortion calculation method according to one embodiment of the present invention.

[0177] In step S610, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0178] In step S620, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0179] In step S630, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0180] Finally, in step S640, the optical characteristic measurement device calculates static distortion for each of three axes based on the measurement reference position, based on the coordinates of a plurality of patterns on the virtual plane.

[0181] At this time, static distortion is caused by the projection of the virtual reality device, and as shown in Fig. 16, it represents the degree of deviation of the three-dimensional coordinates of multiple patterns based on the line corresponding to each of the three axes (x, y, z).

[0182] Meanwhile, the optical property measurement device can calculate the static distortion for each of the three axes using mathematical expression 7.

[0183] [Equation 7]

[0184]

[0185]

[0186]

[0187] Here, DT x Linearity , DT y Linearity , DT z Linearity are linear distortion values ​​based on the x, y, and z axes, respectively, and x ab , y ab , z ab are the x, y, z coordinates of the a-th (a=1,2,3)th horizontal and b-th (b=1,2,3)th vertical pattern.

[0188] Figure 7 is a flowchart illustrating a ghosting level calculation method according to one embodiment of the present invention.

[0189] In step S710, an optical characteristic measurement device captures a test image including a plurality of patterns output on a virtual plane by an augmented reality device using a plurality of cameras arranged around a predetermined measurement reference position.

[0190] In step S720, the optical characteristic measurement device obtains angle information including information about angles of view of the plurality of cameras and arrangement information including information about arrangement of the plurality of cameras.

[0191] In step S730, the optical characteristic measurement device calculates coordinates of a plurality of patterns based on a measurement reference position and coordinates of a plurality of ghost patterns based on a plurality of photographed images, angle information, and arrangement information captured by the plurality of cameras.

[0192] For example, ghost patterns can appear on a vehicle's windshield, which transmits half of the incoming light and reflects the other half. More specifically, referring to FIG. 17, the two physical layers of the windshield can cause ghosting, causing the user to see a double image of a pattern on a virtual plane and a corresponding ghost pattern, or the image may appear blurred.

[0193] At this time, the optical characteristic measuring device can calculate the coordinates of multiple ghost patterns corresponding to each of the multiple patterns in the same manner as the method of calculating the coordinates of the multiple patterns.

[0194] Finally, in step S740, the optical characteristic measurement device can calculate a ghosting level based on the coordinates of the plurality of patterns and the coordinates of the plurality of ghost patterns.

[0195] At this time, the optical characteristic measuring device can calculate the ghosting level from the difference (gap) between the original pattern and the corresponding ghost pattern.

[0196] More specifically, the optical property measurement device can calculate the ghosting level using mathematical expression 8.

[0197] [Equation 8]

[0198]

[0199] Here, Ghost is the ghosting level, and x ij , y ij , z ij are the x, y, z coordinates of the i-th (i=1,2,3)th horizontal and j-th (j=1,2,3)th vertical pattern, and x Gij , y Gij , z Gij are the x, y, and z coordinates of the i-th horizontal and j-th vertical ghost pattern.

[0200] FIG. 8 is a block diagram showing an optical characteristic measurement device of an augmented reality device according to one embodiment of the present invention.

[0201] Referring to FIG. 8, an optical characteristic measurement device (800) of an augmented reality device according to one embodiment of the present invention includes a photographing unit (810), an acquisition unit (820), and a calculation unit (830).

[0202] The shooting unit (810) uses a plurality of cameras arranged around a predetermined measurement reference position to shoot a test image including a plurality of patterns output on a virtual plane by an augmented reality device.

[0203] The acquisition unit (820) acquires angle information including information about the angles of view of the plurality of cameras and arrangement information including information about the arrangement of the plurality of cameras.

[0204] Finally, the output unit (830) calculates the coordinates of a plurality of patterns based on the measurement reference position based on a plurality of shooting images, angle information, and arrangement information captured by the plurality of cameras.

[0205] In another embodiment, when a plurality of cameras are a central camera positioned at a measurement reference position, a left camera and a right camera positioned symmetrically about the measurement reference position, and a plurality of patterns are arranged horizontally and vertically in a test image, the calculation unit (830) can calculate the coordinates of the plurality of patterns by using the horizontal pixel count of the plurality of captured images, the coordinates of the plurality of patterns in the plurality of captured images, the angles of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0206] In another embodiment, the output unit (830) can output coordinates of multiple patterns using mathematical expression 9.

[0207] [Equation 9]

[0208]

[0209]

[0210]

[0211] Here, x ij , y ij , z ij are the x, y, and z-axis coordinates of the i-th horizontal and j-th vertical pattern based on the measurement reference position, α is the distance between the left and right cameras, M is the horizontal pixel count of multiple captured images, θ is the angle of view of multiple cameras, and m L ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the central camera.

[0212] In another embodiment, the calculation unit (830) can further calculate a virtual image distance between the measurement reference position and the virtual plane using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0213] In another embodiment, the output unit (830) can output the virtual image distance using mathematical expression 10.

[0214] [Equation 10]

[0215]

[0216] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the coordinate of one pattern among multiple patterns.

[0217] In another embodiment, the calculation unit (830) can further calculate a lookdown / up angle from the measurement reference position to the virtual plane using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0218] In another embodiment, the output unit (830) can output the lookdown / up angle using mathematical expression 11.

[0219] [Equation 11]

[0220]

[0221] Here, θ down / up is the lookdown / up angle, and x 22 , y 22 , z 22 is the coordinate of one pattern among multiple patterns.

[0222] In another embodiment, the calculation unit (830) can further calculate the horizontal viewing angle of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among a plurality of patterns on the virtual plane.

[0223] In another embodiment, the output unit (830) can output the horizontal viewing angle using mathematical expression 12.

[0224] [Equation 12]

[0225]

[0226] Here, θ H FOV is the horizontal field of view, O is the coordinate of the measurement reference position, and P 21 and P 23 are the coordinates of two patterns located at both ends in the horizontal direction.

[0227] In another embodiment, the calculation unit (830) can further calculate the vertical viewing angle of the measurement reference position by using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among a plurality of patterns on the virtual plane.

[0228] In another embodiment, the output unit (830) can output the vertical viewing angle using mathematical expression 13.

[0229] [Equation 13]

[0230]

[0231] Here, θ V FOV is the vertical viewing angle, O is the coordinate of the measurement reference position, and P 12 and P 32 are the coordinates of two patterns located at both ends in the vertical direction.

[0232] In another embodiment, the output unit (830) can further output static distortion for each of three axes based on the measurement reference position, based on the coordinates of a plurality of patterns on the virtual plane.

[0233] In another embodiment, the calculation unit (830) may further calculate the coordinates of a plurality of ghost patterns corresponding to each of a plurality of patterns based on a plurality of captured images, angle information, and arrangement information, and may further calculate a ghosting level based on the coordinates of the plurality of patterns and the coordinates of the plurality of ghost patterns.

[0234] Meanwhile, the embodiments of the present invention described above can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium.

[0235] The computer-readable recording medium includes a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.) and an optical reading medium (e.g., CD-ROM, DVD, etc.).

[0236] The present invention has been described above, focusing on preferred embodiments thereof. Those skilled in the art will appreciate that the present invention can be implemented in modified forms without departing from its essential characteristics. Therefore, the disclosed embodiments should be considered illustrative rather than limiting. The scope of the present invention is set forth in the claims, not the foregoing description, and all differences within the scope equivalent thereto should be construed as being encompassed by the present invention.

[0237] Referring to FIGS. 9-10, a camera according to embodiments may correspond to a light measuring device (LMD). The light measuring device according to embodiments may generate a virtual image plane and generate images including patterns at different locations. A method for measuring optical characteristics according to embodiments includes the steps of: generating images including points in each pattern for a virtual image plane using one or more light measuring devices, each image captured based on the one or more light measuring devices, each image corresponding to at least one of a left image, a center image, and a right image; and generating positions of points based on the one or more light measuring devices and each pattern; wherein the positions may be obtained based on a field of view of the one or more light measuring devices, a gap between the left light measuring device and the right light measuring device.

[0238] Referring to FIG. 10, one LDM can capture three images for a virtual plane at the center, left, and right positions, and multiple LDMs can capture three images for a virtual plane at the center, left, and right positions.

[0239] Referring to FIG. 12, the positions of the points can be estimated based on, for example, the capture angle for the left LDM position and the capture angle for the right LDM position.

[0240] Based on mathematical expression 1, the coordinate values ​​of the position for the pattern of the image can be calculated.

[0241] Referring to Mathematical Formula 1, by the optical characteristic measurement method / device according to the embodiments, a left image including points within a pattern may be captured based on a left optical measurement device of one or more optical measurement devices, a central image including points within a pattern may be captured based on a central optical measurement device of one or more optical measurement devices, and a right image including points within a pattern may be captured based on a right optical measurement device of one or more optical measurement devices. An index according to the embodiments may indicate a number order, and a field of view may correspond to an angle of view.

[0242] Referring to FIG. 13 and mathematical expression 2, the coordinate values ​​of the position can be calculated based on the horizontal pixel index of the left light measurement device, the horizontal pixel index of the right light measurement device, the horizontal pixel index of the central light measurement device, and the field of view of the left light measurement device.

[0243] Referring to FIG. 14 and Equation 4, the optical characteristic measurement method according to the embodiments may further include a step of measuring a virtual image distance for a virtual image plane based on a position within the pattern at the center and an optical measurement device.

[0244] Referring to FIG. 15, a step of measuring a look-down angle and a look-up angle for a virtual image plane may be further included based on a position within the pattern and a virtual image distance.

[0245] Referring to FIG. 16, the method may further include: measuring a horizontal field of view for a virtual image plane based on a distance to a left point in the center and a distance to a right point in the center; and measuring a vertical field of view for the virtual image plane based on a distance to a top point in the center and a distance to a bottom point in the center.

[0246] The optical characteristic measuring method according to the embodiments may include the step of measuring horizontal distortion for a virtual image plane based on a line between a center and a center top point and a center bottom point; and the step of measuring vertical distortion for the virtual image plane based on a line between a center and a center left point and a center right point.

[0247] The optical specific measurement method / device according to the embodiments may be referred to as the method / device according to the embodiments.

[0248] FIG. 18 illustrates a measurement configuration for image quality characteristics of a virtual image type 3D display such as a 3D HUD according to embodiments.

[0249] The optical characteristic measuring device according to the embodiments of FIGS. 8 and 23 can measure the optical characteristics of a virtual image having a structure such as that of FIG. 18.

[0250] The method / device according to the embodiments may include the following configuration for measurement of image quality characteristics.

[0251] Referring to Figure 18, the geometric relationship between the eye box, the virtual image, and the white diffuser can be seen.

[0252] When the user's eyes are positioned within the eye box, it is assumed that the user can view the entire virtual image with the natural rolling movement of the eyes. The eye box position may be specified by the supplier. Otherwise, it may be estimated according to the method provided in IEC 62629-62-11 (see especially 4.2.3). The measuring device of the imaging LMD may be positioned within the eye box position. A 3D image may be provided in the front or back of the virtual image plane. The 3D coordinate system of xyz, as shown in Fig. 18, is defined to determine the positions of the 3D image and the virtual image plane from the user's eyes.

[0253] Referring to Figure 18, the designed viewing distance is the distance between the center of the eye box and the position of the half mirror. This distance can be specified by the supplier. At this distance, the proper view is observed or the image quality characteristics of the virtual image reproduced by the autostereoscopic 3D display are accurately measured. For measurement, the viewing distance can be applied as the measurement distance. The measurement distance can be fixed when measuring the item to be evaluated.

[0254] The configuration and condition measurements for contrast and chromaticity of 3D virtual overlays under ambient conditions are as follows.

[0255] Various virtual image content, such as numbers, letters, and other symbols, can be displayed on 3D displays in the form of virtual images, such as 3D HUDs. Typically, a clear 3D virtual image can be displayed over the real-world environment. To assess image quality from this perspective, contrast and color-related properties must be measured for the 3D virtual image overlapping the real-world surround.

[0256] However, real environments are very diverse. Background effects, where the color and brightness characteristics of a 3D virtual image appear different from those of adjacent real objects, are a visual perception issue and are therefore excluded from this criterion. To improve visibility, the brightness of the 3D virtual image can be controlled according to a predetermined algorithm embedded in the 3D HUD based on changes in the illumination level of the actual surround. Therefore, a measurement method is proposed to evaluate the contrast (reflecting changes in black and white luminance) and chromaticity of a 3D virtual image under various ambient conditions. The illumination level and correlated color temperature for the ambient conditions can be referenced.

[0257] The room where the measurements are performed is completely darkened. A white diffuser is positioned behind the virtual image plane, with a size larger than the horizontal and vertical field of view of the virtual image plane. Since the entire virtual image plane can be observed when the eye is inside the eyebox, the white diffuser screen size can also be large enough to overlap the entire virtual image plane if the LMD is inside the eyebox.

[0258] The ambient illuminance and correlated color temperature are measured at the center of a white diffuser. The luminance reflected by the white diffuser is measured with a zero input applied to the display being measured. This measurement is evaluated for the presence of stray light.

[0259] Figure 19 shows a measurement method for ghost images according to embodiments.

[0260] Figure 20 shows a test image with nine measurement points according to embodiments and three corresponding images captured by LMDs.

[0261] The optical characteristic measuring device according to the embodiments of FIGS. 8 and 23 can measure optical characteristics based on the above-described embodiments and / or the method described in FIGS. 18 and below. Specifically, it can generate measurement values ​​for ghost images related to the HUD.

[0262] The 3D virtual image is created through a process of reflection and magnification through the half mirror and optical system of the 3D HUD of Fig. 18. A certain amount of light reaching the mirror is reflected, and the remainder is transmitted outside the half mirror, similar to the windshield of Fig. 18. The two physical layers of the windshield cause a ghosting image, which appears as a double image with shadows and outlines. The level of ghosting can be measured by the gap between the original pattern and the second pattern.

[0263] The conditions for the measurement method according to the examples are as follows.

[0264] a) Test pattern: Test image with 9 circles in Fig. 20

[0265] b) Test signals: nine circles with black borders and central crosses against a completely white background;

[0266] c) ambient surround dark surround conditions; and

[0267] d) Test Pattern Image Acquisition: Three imaging LMDs in the eyebox are used to capture three sets of 2D images, the left, center and right images of Fig. 19.

[0268] The flow chart for the measurement method according to the embodiments is as follows.

[0269] a) Apply the test signal.

[0270] b) Three test pattern images are acquired by three imaging LMDs, LMD(L), LMD(C) and LMD(R) of Fig. 19.

[0271] c) All positions (xij, yij, zij)ij=1,2,3 for P11 to P33 of the original test pattern and the corresponding positions (xGij, yGij, zGij)ij=1,2,3 for PG11 to PG33. Ghost patterns are determined according to the procedure described above.

[0272] d) The level of the ghost image is calculated as the average of the distance or angle between the original and the corresponding location for P11 to P33 according to Fig. 21.

[0273] Figure 21 illustrates a method for obtaining a ghost level for a ghost image according to embodiments.

[0274] The method / device according to the embodiments can generate a ghost level (distance) and a ghost level (angle) based on the difference value between the positions of the test pattern and the positions of the ghost patterns of the ghost image, as in FIG. 21, by the flowchart described in FIG. 20.

[0275] Optical measurements related to ghost images according to embodiments can be performed based on the levels obtained as described above.

[0276] Figure 22 shows an optical measurement method according to embodiments.

[0277] The optical measurement method according to the embodiments may include the following flowchart.

[0278] The optical measurement method according to the S2200 embodiments may include a step of generating a test signal.

[0279] The optical measurement method according to embodiments S2201 may further include a step of acquiring a test pattern for a virtual image.

[0280] The optical measurement method according to embodiments S2202 may further include a step of generating positions of a test pattern and positions of a ghost pattern for a virtual image. The method for generating positions is described in the descriptions of FIGS. 1 to 17 described above.

[0281] The optical measurement method according to the S2203 embodiments may further include a step of generating a ghost level. The method of obtaining the ghost level is described in the descriptions of FIGS. 18 to 21 described above.

[0282] The step (S2203) of generating a ghost level of the optical measurement method according to the embodiments further includes the following operations: A general measurement method applied to ghost images and binocular misalignment.

[0283] Binocular misalignment can cause the position of a 3D virtual image to differ depending on the position of the left and right eyes. Ghost images appear as shadows or outlines surrounding the original image. The degree of ghosting and binocular misalignment is assessed using positional information from the 3D virtual test image. Therefore, the embodiments provide a measurement method for determining the position of a 3D virtual test image relative to the user's eyes.

[0284] The measurement configuration for position estimation of the embodiments is as follows:

[0285] Figure 23 illustrates a setup configuration for ghost images and binocular misalignment according to embodiments.

[0286] Referring to Fig. 23, the configuration of a 3D imaging LMD for evaluating the level of ghosting and the degree of misalignment between the two eyes and the test pattern displayed on a virtual image plane in a 3D xyz coordinate system are illustrated. Except for the test pattern, the calculation method for estimating the 3D virtual image geometry is the same in this standard and IEC 62629-62-11. The test pattern in Fig. 22 (a circle 2201 with a central cross on a shaded background 220) differs from the pattern applied to measure the shape of the 3D virtual image in IEC 62629-62-3D (a circle with a central cross on a background).

[0287] The center of the Eye Box is defined as the origin (x=0, y=0, z=0), and the location where the center of the image LMD entrance pupil is located (LMD C ) is. Left (LMD L ) and right (LMD R) The spacing (α) between the imaging LMDs is assumed to be equal to the user's interpupillary distance (IPD). An IPD of 60 mm or 65 mm can be used for this spacing. The IPD range for adults is 55 to 70 mm, and the average IPD values ​​for adult men and women with healthy eyes are 65 mm and 60 mm, respectively. LMD L and LMD R The distance between them is indicated by a. If only one imaging LMD is used instead of three, measurements can be taken by moving one imaging LMD. The measurement points are the centers of each of the nine circles of the whiteboard lines in the test pattern. These points are P ij (i and j = 1, 2, 3) are named as P ij is in the xyz coordinate system (x ij , y ij , z ij ) can be expressed as.

[0288] The step of generating a ghost level (S2203) may be referred to as a method of measuring a ghost image.

[0289] As shown in Figure 18, a certain amount of light reaching the mirror is reflected by a half-mirror, such as a windshield, and the remainder is transmitted out of the mirror. The two physical surfaces of the windshield create a ghosting image that appears as an unintended, low-intensity copy. The level of ghosting can be measured by the gap between the original and the copied pattern.

[0290] In most cases, glass windows are double-layered, so a single ghost image is observed. In reality, multiple-layer ghost images are observed extremely rarely. The measurement method according to the embodiments applies to cases where a single-layer ghost image is observed. In cases where multiple layers of ghost images are observed, the user can select the ghost image with the clearest boundary among the multiple layers.

[0291] The measurement method is as follows (see Fig. 19, which shows the measurement conditions for evaluating ghost images):

[0292] The following specific terms and conditions apply:

[0293] a) Test pattern: A test image consisting of 'nine circles of white board lines on a uniform black background', as shown in Fig. 12a;

[0294] For example, a test image consisting of nine circles is displayed on a virtual image plane with no parallax, so there is no need to consider ghosting due to crosstalk.

[0295] b) Ambient surround condition: dark surround condition;

[0296] c) Acquire test pattern images: Three sets of 2D images are captured using three imaging LMDs located in the eye box, i.e., the left, center and right images of Fig. 12b.

[0297] The measurement procedure is as follows:

[0298] a) Apply a test signal;

[0299] b) Three test pattern images are LMD of Fig. 12b L , LMD C and LMD R Three imaging LMDs are acquired.

[0300] LMD if needed L and LMD R Repeat the measurement with different spacing between them.

[0301] c) P of the original test pattern 11 ~P 33 All locations for (x ij , y ij ) i, j = 1,2,3 and P G11 ~P G33 The corresponding location for (x Gij , y Gij) i, j = 1,2,3 The ghost pattern is determined according to the following first equation;

[0302] Formula 1:

[0303] M, N are the horizontal and vertical number of pixels in the captured image.

[0304] i, j are P of the original test pattern 11 ~P 33 or P of ghost pattern G11 ~P G33 1,2,3 for;

[0305] is the pixel index of the image captured by LMDC.

[0306] is the horizontal field of view of the imaging LMD.

[0307] is the vertical field of view of the imaging LMD.

[0308] D VI is the virtual image distance in millimeters (mm) between (0, 0, 0) of the eye box and the center of the virtual image plane. D VI The measurement method is described in IEC 62629-62-11.

[0309] D VI is determined by the manufacturer's design value or measured value according to IEC 62629-62-11.

[0310] d) The level of the ghost image is P according to the following second equation 11 ~ P 33 It is calculated as the average of the distance or angle between the original and the corresponding location.

[0311] Second formula:

[0312] L d is the ghost level expressed in distance or angle (millimeters or degrees).

[0313] (x ij , y ij) i, j = 1, 2, 3 are P of the original pattern 11 ~P 33 It's a location.

[0314] (x Gij , y Gij ) i, j = 1, 2, 3 are P in the ghost pattern of Fig. 19 G11 ~P G33 is the location.

[0315] To harmonize the measurement locations specified in SAE J 1757-2, the measurement method described in this section is P of Fig. 19. 12 , P 22 and P 32 It only needs to be applied to the three central points.

[0316] Fig. 24 shows an optical measuring device according to embodiments.

[0317] The method according to the embodiments may be performed by the device of FIG. 24. Each component of FIG. 24 may correspond to hardware, software, a processor, and / or a combination thereof. FIG. 24 may correspond to the device of FIG. 8.

[0318] The light measurement unit may be a camera. The processor may be a processor that performs operations according to the embodiments. The memory may store data and information related to the operation of the processor. The memory may provide necessary data to the processor. The memory may be connected to the light measurement unit, the processor, etc.

[0319] With respect to ghost level measurement, referring to the drawings described above, the method according to the embodiments further includes the steps of generating images including points within each pattern for a virtual image plane using one or more optical measurement devices, each image being captured based on the one or more optical measurement devices, each image corresponding to at least one of a left image, a center image, and a right image; and generating positions of points based on the one or more optical measurement devices and each pattern; and generating levels for ghost images for the virtual image plane based on the generated positions, wherein the positions can be obtained based on a field of view of the one or more optical measurement devices, a gap between the left optical measurement device and the right optical measurement device.

[0320] Additionally, the step of generating a level for the ghost image may include the step of generating a test signal, the step of generating positions of a test pattern of a virtual image for the test signal and positions of a ghost pattern for the positions, and the step of generating a ghost level based on the positions of the test pattern and the positions of the ghost pattern.

[0321] Additionally, the ghost level can be obtained based on the average of the distances between the positions of the test pattern and the positions of the ghost pattern and the average of the angles between the positions of the test pattern and the positions of the ghost pattern.

[0322] A method according to embodiments may be performed by a device. The device according to embodiments may include a photographing unit that generates images including points within each pattern for a virtual image plane using one or more optical measurement devices, each image being captured based on the one or more optical measurement devices, and each image corresponding to at least one of a left image, a center image, and a right image; and a calculating unit that generates positions of points based on the one or more optical measurement devices and each pattern; wherein the calculating unit generates a level for a ghost image for the virtual image plane based on the generated positions, and the position may be obtained based on a field of view of the one or more optical measurement devices, a gap between the left optical measurement device and the right optical measurement device. Each component of the device may be composed of an interface for transmitting and receiving signals, a memory for storing operation-related information, and processors for controlling operations. Operations of the photographing unit and the calculating unit may be performed by the processor.

[0323] Additionally, the processor may perform a step of generating a test signal, a step of generating positions of a test pattern of a virtual image for the test signal and positions of a ghost pattern for the positions, and a step of generating a ghost level based on the positions of the test pattern and the positions of the ghost pattern.

[0324] Additionally, the ghost level can be obtained based on the average of the distances between the positions of the test pattern and the positions of the ghost pattern and the average of the angles between the positions of the test pattern and the positions of the ghost pattern.

[0325] The output unit may be configured to set conditions including a test image including a test pattern comprising circles consisting of white border lines on a single black background, an ambient surround condition, a dark surround condition, and acquisition of the test pattern image by one or more light measurement devices, for measuring a ghost image.

[0326] The output unit is configured to apply a test signal; acquire test pattern images by one or more optical measurement devices; and output positions of patterns in a test pattern image and positions of patterns in a ghost pattern with respect to the test pattern image; wherein X-coordinates of the patterns in the test pattern image are output by a virtual image distance between a center of the virtual image plane and an eye box, and a horizontal FOV of the one or more optical measurement devices, and Y-coordinates of the patterns in the ghost pattern can be output by a virtual image distance between a center of the virtual image plane and an eye box, and a vertical FOV of the one or more optical measurement devices (see Equation 1).

[0327] The output unit is further configured to generate a level for the ghost image based on the positions of the patterns in the test pattern image and the positions of the patterns in the ghost pattern (see Equation 2).

[0328] This can improve 3D HUD vehicle services from the perspective of driver visibility and convenience. Furthermore, by installing a light measurement device in the vehicle, measurement parameters for measuring optical characteristics, such as points and depth, for HUD virtual images can be efficiently acquired. Based on the acquired parameter information, a calibration process can be efficiently performed to reduce errors from the driver's perspective. Combined with autonomous driving technology, 3D HUD can enable safe and accurate autonomous driving. Furthermore, ghost image processing can be used to provide accurate and safe vehicle services to drivers.

[0329] The embodiments have been described in terms of methods and / or devices, and the descriptions of methods and devices may be applied complementarily.

[0330] For the convenience of explanation, each drawing has been described separately, but it is also possible to design a new embodiment by combining the embodiments described in each drawing. In addition, designing a computer-readable recording medium having a program recorded thereon for executing the previously described embodiments, as needed by a person skilled in the art, also falls within the scope of the embodiments. The devices and methods according to the embodiments are not limited to the configurations and methods of the embodiments described above, but the embodiments may be configured by selectively combining all or part of the embodiments so that various modifications can be made. Although preferred embodiments of the embodiments have been illustrated and described, the embodiments are not limited to the specific embodiments described above, and various modifications can be made by a person skilled in the art to which the present invention pertains without departing from the gist of the embodiments claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the embodiments.

[0331] The various components of the devices of the embodiments may be implemented by hardware, software, firmware, or a combination thereof. The various components of the embodiments may be implemented by a single chip, for example, a single hardware circuit. According to embodiments, the components according to the embodiments may be implemented by separate chips. According to embodiments, at least one of the components of the devices of the embodiments may be configured with one or more processors capable of executing one or more programs, and the one or more programs may perform, or include instructions for performing, one or more of the operations / methods according to the embodiments. The executable instructions for performing the methods / operations of the devices of the embodiments may be stored in non-transitory CRMs or other computer program products configured to be executed by one or more processors, or may be stored in temporary CRMs or other computer program products configured to be executed by one or more processors. In addition, the memory according to the embodiments may be used as a concept including not only volatile memory (e.g., RAM, etc.), but also non-volatile memory, flash memory, PROM, etc. Additionally, it may include implementations in the form of carrier waves, such as transmissions via the Internet. Furthermore, processor-readable recording media may be distributed across network-connected computer systems, allowing processor-readable code to be stored and executed in a distributed manner.

[0332] In this document, “ / ” and “,” are interpreted as “and / or”. For example, “A / B” is interpreted as “A and / or B”, and “A, B” is interpreted as “A and / or B”. Additionally, “A / B / C” means “at least one of A, B, and / or C”. Also, “A, B, C” means “at least one of A, B, and / or C”. Additionally, “or” in this document is interpreted as “and / or”. For example, “A or B” can mean 1) “A” only, 2) “B” only, or 3) “A and B”. In other words, “or” in this document can mean “additionally or alternatively”.

[0333] Terms such as first, second, etc. may be used to describe various components of the embodiments. However, the various components according to the embodiments should not be limited in their interpretation by the above terms. These terms are merely used to distinguish one component from another. For example, a first user input signal may be referred to as a second user input signal. Similarly, a second user input signal may be referred to as a first user input signal. The use of these terms should be interpreted as not departing from the scope of the various embodiments. Although a first user input signal and a second user input signal are both user input signals, they do not mean the same user input signals unless the context clearly indicates otherwise.

[0334] The terminology used to describe the embodiments is for the purpose of describing particular embodiments and is not intended to be limiting of the embodiments. As used in the description of the embodiments and in the claims, the singular is intended to include the plural unless the context clearly dictates otherwise. The expressions “and / or” are used to mean all possible combinations of terms. The expression “includes” describes the presence of features, numbers, steps, elements, and / or components, but does not mean that additional features, numbers, steps, elements, and / or components are not included. Conditional expressions such as “if” or “when” used to describe the embodiments are not intended to be limited to only optional cases. When a specific condition is satisfied, a related action is performed in response to a specific condition, or a related definition is intended to be interpreted.

[0335] Additionally, the operations according to the embodiments described in this document may be performed by a transceiver device including a memory and / or a processor according to the embodiments. The memory may store programs for processing / controlling the operations according to the embodiments, and the processor may control various operations described in this document. The processor may be referred to as a controller, etc. The operations according to the embodiments may be performed by firmware, software, and / or a combination thereof, and the firmware, software, and / or a combination thereof may be stored in the processor or in the memory.

[0336] Meanwhile, the operations according to the embodiments described above may be performed by a transmitting device and / or a receiving device according to the embodiments. The transmitting / receiving device may include a transmitting / receiving unit for transmitting and receiving media data, a memory for storing instructions (program code, algorithm, flowchart, and / or data) for a process according to the embodiments, and a processor for controlling the operations of the transmitting / receiving device.

[0337] The processor may be referred to as a controller or the like, and may correspond to, for example, hardware, software, and / or a combination thereof. The operations according to the above-described embodiments may be performed by the processor. Furthermore, the processor may be implemented as an encoder / decoder or the like for the operations of the above-described embodiments.

[0338] As described above, the relevant contents have been described in the best form for carrying out the embodiments.

[0339] As described above, the embodiments may be applied in whole or in part to a HUD ghost image measurement method and device.

[0340] Those skilled in the art may make various changes or modifications to the embodiments within the scope of the embodiments.

[0341] Embodiments may include modifications / changes, which do not depart from the scope of the claims and their equivalents.

Claims

1. A step of generating images including points within each pattern for a virtual image plane using one or more optical measuring devices; Each of the above images is captured based on one or more of the above optical measuring devices, Each image corresponds to at least one of the left image, the center image, and the right image; and A step of generating the positions of the above points based on the one or more optical measuring devices and each pattern; and Further comprising a step of generating a level for a ghost image for the virtual image plane based on the generated positions; The above position is obtained based on the field of view of one or more of the optical measurement devices, the gap between the left optical measurement device and the right optical measurement device. Method for measuring optical properties.

2. In paragraph 1, The left image including points within the pattern is captured based on the left optical measurement device of the one or more optical measurement devices, the central image including points within the pattern is captured based on the central optical measurement device of the one or more optical measurement devices, and the right image including points within the pattern is captured based on the right optical measurement device of the one or more optical measurement devices. Method for measuring optical properties.

3. In paragraph 1, The coordinate values of the above position are calculated based on the horizontal pixel index of the left light measuring device, the horizontal pixel index of the right light measuring device, the horizontal pixel index of the central light measuring device, and the field of view of the left light measuring device. Method for measuring optical properties.

4. In paragraph 1, the method Further comprising a step of measuring a virtual image distance for the virtual image plane based on a position within the pattern at the center and the optical measuring device. Method for measuring optical properties.

5. In paragraph 4, the method Further comprising a step of measuring a look down angle and a look up angle for the virtual image plane based on the position within the pattern and the virtual image distance. Method for measuring optical properties.

6. In paragraph 1, the method A step of measuring a horizontal field of view for the virtual image plane based on a distance to a left point of the center and a distance to a right point of the center; and further comprising: a step of measuring a vertical field of view for the virtual image plane based on a distance to the top point at the center and a distance to the bottom point at the center; Method for measuring optical properties.

7. In the first paragraph, the method A step of measuring horizontal distortion for the virtual image plane based on a line between the center and the top point of the center and the bottom point of the center; and A step of measuring vertical distortion for the virtual image plane based on a line between the center and the left point of the center and the right point of the center; comprising; Method for measuring optical properties.

8. In paragraph 1, The steps for generating levels for the above ghost images are: To measure the above ghost image, a test image including a test pattern including circles consisting of white boundary lines on a single black background, an ambient surround condition, a dark surround condition, and conditions including acquisition of the test pattern image by one or more of the above optical measurement devices are set. Method for measuring optical properties.

9. In paragraph 1, The steps for generating levels for the above ghost images are: Apply a test signal; Obtaining test pattern images by one or more of the above optical measuring devices; Comprising: calculating positions of patterns in the test pattern image and positions of patterns in a ghost pattern for the test pattern image; The X-coordinates of the patterns in the test pattern image are derived from the virtual image distance between the center of the virtual image plane and the eye box, and the horizontal FOV of the one or more optical measurement devices, The Y coordinates of the patterns in the above ghost pattern are derived from the virtual image distance between the center of the virtual image plane and the eye box, and the vertical FOV of the one or more optical measurement devices. Method for measuring optical properties.

10. In paragraph 9, The steps for generating levels for the above ghost images are: generating a level for the ghost image based on the positions of the patterns in the test pattern image and the positions of the patterns in the ghost pattern; Method for measuring optical properties.

11. A photographing unit that generates images containing points within each pattern for a virtual image plane using one or more optical measuring devices; Each of the above images is captured based on one or more of the above optical measuring devices, Each image corresponds to at least one of the left image, the center image, and the right image; and A calculation unit for generating the positions of the above points based on one or more of the optical measurement devices and each pattern; The above-mentioned generating unit generates a level for a ghost image for the virtual image plane based on the above-mentioned generated positions, The above position is obtained based on the field of view of one or more of the optical measurement devices, the gap between the left optical measurement device and the right optical measurement device. Optical property measuring device.

12. In paragraph 11, The left image including points within the pattern is captured based on the left optical measurement device of the one or more optical measurement devices, the central image including points within the pattern is captured based on the central optical measurement device of the one or more optical measurement devices, and the right image including points within the pattern is captured based on the right optical measurement device of the one or more optical measurement devices. Optical property measuring device.

13. In Article 11, The coordinate values of the above position are calculated based on the horizontal pixel index of the left light measuring device, the horizontal pixel index of the right light measuring device, the horizontal pixel index of the central light measuring device, and the field of view of the left light measuring device. Optical property measuring device.

14. In paragraph 11, The above output section Measuring a virtual image distance for the virtual image plane based on the position within the pattern at the center and the optical measuring device; Optical property measuring device.

15. In paragraph 14, The above output section Based on the position within the above pattern and the virtual image distance, a look down angle and a look up angle for the virtual image plane are measured. Optical property measuring device.

16. In paragraph 11, The above output section Measuring a horizontal field of view for the virtual image plane based on a distance to a left point of the center and a distance to a right point of the center, and Measuring the vertical field of view for the virtual image plane based on the distance to the top point in the center and the distance to the bottom point in the center. Optical property measuring device.

17. In paragraph 11, The above output section Measuring horizontal distortion for the virtual image plane based on a line between the center and the top point of the center and the bottom point of the center; and Measuring vertical distortion for the virtual image plane based on a line between the center and the left point of the center and the right point of the center; Optical property measuring device.

18. In paragraph 11, The above output section, To measure the above ghost image, a test image including a test pattern including circles consisting of white boundary lines on a single black background, an ambient surround condition, a dark surround condition, and conditions including acquisition of a test pattern image by one or more of the above optical measurement devices are set. Optical property measuring device.

19. In paragraph 11, The above output section, Apply a test signal; Obtaining test pattern images by one or more of the above optical measuring devices; configured to calculate the positions of patterns in the test pattern image and the positions of patterns in the ghost pattern for the test pattern image; The X-coordinates of the patterns in the test pattern image are derived from the virtual image distance between the center of the virtual image plane and the eye box, and the horizontal FOV of the one or more optical measurement devices, The Y coordinates of the patterns in the above ghost pattern are derived from the virtual image distance between the center of the virtual image plane and the eye box, and the vertical FOV of the one or more optical measurement devices. Optical property measuring device.

20. In paragraph 19, The above output section, Further configured to generate a level for the ghost image based on the positions of the patterns in the test pattern image and the positions of the patterns in the ghost pattern; Optical property measuring device.

Images