A method of measuring an ambient backgound effect on a 3D virtual image and an apparatus thereon

Abstract

A method for measuring an ambient background effect for a 3D virtual image according to embodiments may include: a step of applying a first test signal to the center of a virtual image plane; a step of measuring the luminance of the center of the virtual image plane; a step of applying a second test signal to the virtual plane; and a step of measuring the chromaticity coordinate of the center of the virtual plane.

Description

Technology Field

[0001] The present invention relates to a method and apparatus for measuring ambient background effects for 3D virtual images, and more specifically, to a method and apparatus for measuring the image quality and / or optical characteristics of a three-dimensional virtual image generated by an augmented reality device. Background Technology

[0002] Augmented reality (AR) is a field of virtual reality (AR) that uses computer graphics techniques to superimpose virtual objects or information onto a real environment, making them appear as if they exist within the original setting; it is frequently used in digital media.

[0003] Augmented reality is also called mixed reality (MR) because it combines a virtual world with real-time additional information into the real world to display it as a single image. As a hybrid VR system that fuses real and virtual environments, research and development have been underway since the late 1990s, primarily in the United States.

[0004] For example, augmented reality can be utilized in remote medical diagnosis, broadcasting, architectural design, and manufacturing process management. Furthermore, with the recent widespread adoption of smartphones, it has entered a full-scale commercialization phase, and various products are being developed in the gaming and mobile solutions industries, as well as in the education sector.

[0005] Meanwhile, wearable computers can be used to realize augmented reality outdoors. In particular, head-mounted displays (HMDs) enable augmented reality by overlaying computer graphics and text onto the real environment viewed by the user in real time. Additionally, head-up displays (HUDs) enable augmented reality by displaying various information necessary for driving the vehicle on the outside of the vehicle's windshield.

[0006] For example, a head-up display can implement augmented reality by displaying a light source emitted from inside the vehicle to the outside of the windshield on a virtual plane located outside the vehicle's windshield, thereby allowing the driver to obtain information necessary for driving the vehicle on that virtual plane without shifting their gaze while driving.

[0007] At this time, geometric characteristics, including the position of the virtual plane formed by the augmented reality device, can be determined according to the optical characteristics of individual augmented reality devices such as HMDs and HUDs.

[0008] Therefore, there is a growing need for methods and devices capable of measuring optical characteristics regarding the output of augmented reality devices. The problem to be solved

[0009] The present invention aims to provide a method and apparatus for measuring ambient background effects on 3D virtual images.

[0010] The present invention aims to provide a method and apparatus for accurately and efficiently measuring optical characteristics and image quality characteristics for an ambient background of a 3D virtual image.

[0011] The problems that the present invention aims to solve are not limited to the problem(s) mentioned above, and other unmentioned problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0012] To achieve this purpose, a method for measuring an ambient background effect for a 3D virtual image according to embodiments may include the steps of: applying a first test signal to the center of a virtual image plane; measuring the luminance of the center of the virtual image plane; applying a second test signal to the virtual plane; and measuring the chromaticity coordinate of the center of the virtual plane. Effects of the invention

[0013] The present invention has the effect of easily measuring the optical characteristics of a virtual image generated by an augmented reality device by using a plurality of cameras.

[0014] In addition, the present invention has the effect of being able to calculate the virtual image distance, the look down / up angle of the virtual image, the horizontal / vertical field of view, static distortion, and the ghosting level based on the user of the augmented reality device by utilizing the optical characteristics of the virtual image generated by the augmented reality device.

[0015] In addition, the present invention has the effect of accurately and efficiently measuring optical characteristics and image quality characteristics by taking into account the ambient background effect for 3D virtual images. Brief explanation of the drawing

[0016] FIG. 1 is a flowchart illustrating a method for measuring optical characteristics of an augmented reality device according to one embodiment of the present invention. FIG. 2 is a flowchart illustrating a method for calculating virtual image distance according to an embodiment of the present invention. FIG. 3 is a flowchart illustrating a look-down / up angle calculation method according to an embodiment of the present invention. FIG. 4 is a flowchart illustrating a method for calculating a horizontal field of view according to an embodiment of the present invention. FIG. 5 is a flowchart illustrating a method for calculating a vertical field of view according to an embodiment of the present invention. FIG. 6 is a flowchart illustrating a static distortion calculation method according to one embodiment of the present invention. FIG. 7 is a flowchart illustrating a method for calculating a ghosting level according to an embodiment of the present invention. FIG. 8 is a block diagram showing an optical characteristic measuring device of an augmented reality device according to one embodiment of the present invention. FIGS. 9a and 9b are drawings for illustrating an environment for measuring optical characteristics of an augmented reality device according to an embodiment of the present invention. FIG. 10 is a drawing for explaining the result of capturing a test image on a virtual plane using a plurality of cameras according to an embodiment of the present invention. FIGS. 11a and 11b are drawings for explaining the coordinates of a plurality of patterns included in a captured image taken using a plurality of cameras according to an embodiment of the present invention. FIGS. 12a and 12b are drawings for explaining a method for calculating the coordinates of a plurality of patterns according to an embodiment of the present invention. FIG. 13 is a diagram illustrating a method for calculating a virtual image distance according to an embodiment of the present invention. FIGS. 14a and 14b are drawings for explaining a method for calculating a look-down / up angle according to an embodiment of the present invention. FIGS. 15a and 15b are drawings for explaining a method for calculating a horizontal field of view and a vertical field of view according to an embodiment of the present invention. FIG. 16 is a diagram illustrating a method for calculating static distortion according to an embodiment of the present invention. FIG. 17 is a diagram illustrating a method for calculating a ghosting level according to an embodiment of the present invention. FIG. 18 shows a measurement configuration for evaluating the ambient background effect on the image quality properties of a 3D virtual image according to embodiments. FIG. 19 shows the relationship between a virtual image plane and a white diffuser according to embodiments. FIG. 20 shows non-uniform measurement points of the surrounding background according to embodiments. FIG. 21 illustrates a method for measuring the contrast and chromaticity of a 3D virtual image against various surrounding backgrounds according to embodiments. FIG. 22 shows a test image for measuring contrast and chromaticity characteristics affected by changes in the surrounding background in a 3D virtual image according to embodiments. FIG. 23 shows measurement conditions for contrast and chromaticity characteristics of 3D virtual images under various ambient background conditions according to embodiments. FIG. 24 illustrates a method for measuring ambient background effects on a 3D virtual image according to embodiments. FIG. 25 shows an ambient background effect measuring device for a 3D virtual image according to embodiments. Specific details for implementing the invention

[0017] The present invention is susceptible to various modifications and may have various embodiments; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the invention to specific embodiments, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each drawing.

[0018] Terms such as first, second, A, B, etc., may be used to describe various components, but said components should not be limited by said terms. These terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of a plurality of related described items or any of a plurality of related described items.

[0019] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0020] The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "having" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0021] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0022] Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings.

[0023] The present invention relates to a method and apparatus for measuring the optical characteristics of a virtual reality device, wherein the measurement can be performed in the following environment. For example, referring to FIG. 9a, the user's eyes are positioned in an eye box, and a virtual plane produced by the output of the virtual reality device may be formed outside a transparent or translucent screen (e.g., a vehicle windshield). In this case, the user can view the entire virtual plane by moving only their eyes. Additionally, referring to FIG. 9b, a plurality of cameras may be arranged in the eye box centered on a measurement reference position. More specifically, camC is positioned at the measurement reference position, and cams are positioned symmetrically on both sides thereof. L and cam R This can be arranged. Meanwhile, in the test image, multiple patterns may be positioned arranged horizontally and vertically (e.g., 3x3).

[0024] However, the present invention is not limited to being implemented only in such an environment, and it is understood that it may be implemented in various different environments. For example, the location and size of the eyebox, the number and arrangement of cameras, and the number and arrangement of patterns included in the test image may vary depending on the measurement environment.

[0025] FIG. 1 is a flowchart illustrating a method for measuring optical characteristics of an augmented reality device according to one embodiment of the present invention.

[0026] In step S110, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0027] For example, referring to FIG. 9b, one camera may be placed at a measurement reference position located at the center of the eyebox, and the remaining cameras may be symmetrically placed on both sides at the same height facing forward.

[0028] At this time, the optical characteristic measuring device is connected to a plurality of cameras via wireless or wired connection and can transmit a command to capture a test image on a virtual plane.

[0029] In step S120, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0030] For example, an optical characteristic measuring device can receive information regarding the camera's angle of view and information regarding the camera's placement from a user to obtain the angle of view information and the placement information. Preferably, the information regarding the camera's angle of view is a horizontal angle of view, and the information regarding the camera's placement may be the distance between cameras symmetrically placed on both sides of a measurement reference position.

[0031] Finally, in step S130, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0032] At this time, the optical characteristic measuring device can calculate the three-dimensional coordinates of a plurality of patterns on a virtual plane with the measurement reference position as the origin (0, 0, 0) by using information regarding the size of a plurality of captured images, information regarding the coordinates within the image of a plurality of patterns included in the plurality of captured images, information regarding the angle of view of a plurality of cameras, and information regarding the arrangement of a plurality of cameras.

[0033] Meanwhile, a detailed method for calculating the coordinates of multiple patterns will be described in detail in the following examples.

[0034] In another embodiment, when the optical characteristic measuring device comprises a central camera positioned at a measurement reference position, a left camera and a right camera positioned symmetrically with respect to the measurement reference position, and when a plurality of patterns are arranged horizontally and vertically in a test image, the coordinates of a plurality of patterns can be calculated using the number of horizontal pixels of a plurality of captured images, the coordinates of a plurality of patterns in a plurality of captured images, the angle of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0035] For example, referring to FIG. 9b, a plurality of cameras are positioned at the measurement reference position, including a central camera (cam C The left camera (cam) positioned symmetrically with respect to the ) and the measurement reference position L ) and right camera (cam R ) It can be. Also, 9 patterns can be arranged horizontally and vertically in the test image.

[0036] At this time, the optical characteristic measuring device can calculate the 3D coordinates of 9 patterns on a virtual plane with the measurement reference position as the origin (0, 0, 0) by using the number of horizontal pixels of a plurality of captured images, the coordinates of a plurality of patterns in a plurality of captured images, the angle of view of the plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0037] In another embodiment, the optical characteristic measuring device can calculate the coordinates of a plurality of patterns using Equation 1.

[0038] [Mathematical Formula 1]

[0039]

[0040]

[0041]

[0042] Here, x ij , y ij , z ij is the x, y, and z-axis coordinates of the horizontal i-th and vertical j-th pattern relative to the measurement reference position, α is the distance between the left camera and the right camera, M is the number of horizontal pixels of the multiple captured images, θ is the field of view of the multiple cameras, and mL ij is the horizontal coordinate of the horizontally i-th and vertically j-th pattern in the image captured by the left camera, and m R ij is the horizontal coordinate of the horizontally i-th and vertically j-th pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the center camera.

[0043] At this time, referring to FIG. 10, a central camera (cam C ) is positioned, and the left camera (cam L ) and right camera (cam R ) can be spaced apart at a distance α. And, a central camera (cam) positioned so that the optical characteristic measuring device faces forward C ), left camera (cam L ) and right camera (cam R Using ), a test image on a virtual plane can be captured. As a result, the left camera (cam L Captured image taken using )L The test image is shifted to the right, and the central camera (cam C Captured image taken using ) C ) ensures the test image is not biased, and the right camera (cam R Captured image taken using ) R The test image may be skewed to the left.

[0044] Meanwhile, referring to Fig. 11a, the 3D coordinates of the 9 patterns appearing on the virtual plane are P ij = (x ij , y ij , z ij It can be represented as ), where i can be the horizontal index of the pattern (i=1,2,3) and j can be the vertical index of the pattern (j=1,2,3). That is, P ij can be the 3D coordinates of the center of the i-th horizontal and j-th vertical pattern.

[0045] Additionally, referring to Fig. 11b, the pixel coordinates of the nine patterns appearing in the captured image are P L ij , P C ij , P R ij It can be represented as, and respectively the left camera (cam L ), central camera (cam C ), right camera (cam R It can refer to the coordinates of the pattern appearing in the captured image of ). In this case, P L ij = (m L ij , n L ij ), P C ij = (m C ij , n C ij ), P R ij = (m R ij , nR ij It can be ). In this case, P L ij , P C ij , P R ij can be the pixel coordinates of the center of the i-th horizontal and j-th vertical pattern.

[0046] Meanwhile, referring to Fig. 12a, it can be seen that a proportional relationship as shown in Equation 2 below holds.

[0047] [Mathematical Formula 2]

[0048]

[0049] Here, z is the distance along the z-axis from the measurement reference position to the virtual plane, θ is the camera's angle of view, α is the distance between the left camera and the right camera, and m L ij is the horizontal coordinate of the horizontally i-th and vertically j-th pattern in the image captured by the left camera, and m R ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the right camera, and M is the number of horizontal pixels of the image.

[0050] At this point, it is obvious that mathematical formula 1 can be obtained by modifying mathematical formula 2.

[0051] For example, referring to FIG. 12b, the optical characteristic measuring device with respect to the same pattern (i=1, j=1) the central camera (cam C ), left camera (cam L ) and right camera (cam R Using the results captured using ), through mathematical formula 1 x 11 , y 11 , z 11 It can produce.

[0052] FIG. 2 is a flowchart illustrating a method for calculating virtual image distance according to an embodiment of the present invention.

[0054] In step S210 of step 112, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0055] In step S220, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0056] In step S230, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0057] Finally, in step S240, the optical characteristic measuring device calculates the virtual image distance between the measurement reference position and the virtual plane using the coordinates of the measurement reference position and at least one of the multiple patterns on the virtual plane.

[0058] For example, referring to FIG. 13, the optical characteristic measuring device P with respect to the measurement reference position (0, 0, 0). 22 The coordinates of (x 22 , y 22 , z 22 The virtual image distance can be calculated by calculating the distance to ).

[0059] In another embodiment, the optical characteristic measuring device can calculate the virtual image distance using Equation 3.

[0060] [Mathematical Formula 3]

[0061]

[0062] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the 3D coordinate of the pattern with i=2, j=2.

[0063] FIG. 3 is a flowchart illustrating a look-down / up angle calculation method according to an embodiment of the present invention.

[0064] In step S310, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0065] In step S320, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0066] In step S330, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0067] Finally, in step S340, the optical characteristic measuring device calculates the look down / up angle from the measurement reference position to the virtual plane using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0068] At this time, the look-down / up angle is an angle representing the difference in height between the eyebox and the virtual plane, indicating whether the user is looking up or down at the virtual plane.

[0069] For example, based on the measurement reference position (0, 0, 0) where the user's eyes are located, P 22 The coordinates of (x 22 , y 22 , z 22 When ) is calculated, y 22 If < 0, it becomes a look-down situation as shown in Fig. 14a, and y 22 If it is 0, it can be a look-up situation as in Fig. 14b.

[0070] In another embodiment, the optical characteristic measuring device can calculate the look-down / up angle using Equation 4.

[0071] [Mathematical Formula 4]

[0072]

[0073] Here, θ down / up is the look-down / look-up angle, and x 22 , y 22 , z 22 is the 3D coordinate of the pattern with i=2, j=2.

[0074] FIG. 4 is a flowchart illustrating a method for calculating a horizontal field of view according to an embodiment of the present invention.

[0075] In step S410, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0076] In step S420, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0077] In step S430, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0078] Finally, in step S440, the optical characteristic measuring device calculates the horizontal field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among a plurality of patterns on a virtual plane.

[0079] For example, referring to FIG. 15a, the optical characteristic measuring device has the three-dimensional coordinates O = (0, 0, 0) of the measurement reference position, and P, which are two patterns located at both ends in the horizontal direction among a plurality of patterns on a virtual plane. 21 = (x 21 , y 21 , z 21 ) and P 23 = (x 23 , y 23 , z 23 Using the 3D coordinates of ), angle ∠P 21 OP 23 It can be calculated as the horizontal field of view.

[0080] In another embodiment, the optical characteristic measuring device can calculate the horizontal field of view using Equation 5.

[0081] [Mathematical Formula 5]

[0082]

[0083] Here, θ H FOV is the horizontal field of view, O is the coordinates of the measurement reference position, and P 21 and P 23 is the coordinates of two patterns located at both ends in the horizontal direction among multiple patterns.

[0084] FIG. 5 is a flowchart illustrating a method for calculating a vertical field of view according to an embodiment of the present invention.

[0085] In step S510, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0086] In step S520, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0087] In step S530, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0088] Finally, in step S540, the optical characteristic measuring device calculates the vertical field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among a plurality of patterns on a virtual plane.

[0089] For example, referring to FIG. 15b, the optical characteristic measuring device has the 3D coordinates O = (0, 0, 0) of the measurement reference position and P, which are two patterns located at both ends in the vertical direction among a plurality of patterns on a virtual plane. 12 = (x 12 , y 12 , z 12 ) and P 32 = (x 32 , y 32 , z 32 Using the 3D coordinates of ), angle ∠P 12 OP 32 It can be calculated as the vertical field of view.

[0090] In another embodiment, the optical characteristic measuring device can calculate the vertical field of view using Equation 6.

[0091] [Mathematical Formula 6]

[0092]

[0093] Here, θ V FOV is the vertical field of view, O is the coordinates of the measurement reference position, and P 12 and P 32 is the coordinates of two patterns located at both ends in the vertical direction.

[0094] FIG. 6 is a flowchart illustrating a static distortion calculation method according to one embodiment of the present invention.

[0095] In step S610, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0096] In step S620, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0097] In step S630, the optical characteristic measuring device calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0098] Finally, in step S640, the optical characteristic measuring device calculates static distortion for each of the three axes based on the measurement reference position, based on the coordinates of a plurality of patterns on a virtual plane.

[0099] At this time, static distortion is caused by the projection of a virtual reality device, and with reference to FIG. 16, it represents the degree of deviation of multiple patterns of three-dimensional coordinates based on a linear axis corresponding to each of the three axes (x, y, z).

[0100] Meanwhile, the optical characteristic measuring device can calculate static distortion for each of the three axes using mathematical formula 7.

[0101] [Mathematical Formula 7]

[0102]

[0103]

[0104]

[0105] Here, DT x Linearity , DT y Linearity , DTz Linearity are linear skew values ​​based on the x, y, and z axes, respectively, and x ab , y ab , z ab is the x, y, and z coordinates of the horizontal a (a=1,2,3)th and vertical b (b=1,2,3)th pattern.

[0106] FIG. 7 is a flowchart illustrating a method for calculating a ghosting level according to an embodiment of the present invention.

[0107] In step S710, an optical characteristic measuring device uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0108] In step S720, the optical characteristic measuring device obtains angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0109] In step S730, the optical characteristic measuring device calculates the coordinates of a plurality of patterns and the coordinates of a plurality of ghost patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0110] For example, a ghost pattern may appear on a vehicle windshield that transmits half of the incoming light and reflects the other half. More specifically, referring to FIG. 17, two physical layers of the windshield may cause a ghosting phenomenon, so that the pattern on the virtual plane and the ghost pattern corresponding to that pattern may appear to the user as double images overlaid or blurred.

[0111] At this time, the optical characteristic measuring device can calculate the coordinates of a plurality of ghost patterns corresponding to each of the plurality of patterns in the same way as the method for calculating the coordinates of a plurality of patterns.

[0112] Finally, in step S740, the optical characteristic measuring device can calculate a ghosting level based on the coordinates of a plurality of patterns and the coordinates of a plurality of ghost patterns.

[0113] At this time, the optical characteristic measuring device can calculate the ghosting level from the difference (gap) between the original pattern and the corresponding ghost pattern.

[0114] More specifically, the optical characteristic measuring device can calculate the ghosting level using mathematical formula 8.

[0115] [Mathematical Formula 8]

[0116]

[0117] Here, Ghost is the ghosting level, and x ij , y ij , z ij is the x, y, z coordinates of the horizontal i (i=1,2,3)th and vertical j (j=1,2,3)th pattern, and x Gij , y Gij , z Gij is the x, y, z coordinate of the i-th horizontal and j-th vertical ghost pattern.

[0118] FIG. 8 is a block diagram showing an optical characteristic measuring device of an augmented reality device according to one embodiment of the present invention.

[0119] Referring to FIG. 8, an optical characteristic measuring device (800) of an augmented reality device according to one embodiment of the present invention includes a shooting unit (810), an acquisition unit (820), and a calculation unit (830).

[0120] The shooting unit (810) uses a plurality of cameras positioned around a predetermined measurement reference position to capture a test image containing a plurality of patterns output on a virtual plane by an augmented reality device.

[0121] The acquisition unit (820) acquires angle of view information including information regarding the angle of view of the plurality of cameras and arrangement information including information regarding the arrangement of the plurality of cameras.

[0122] Finally, the calculation unit (830) calculates the coordinates of a plurality of patterns based on a measurement reference position, based on a plurality of captured images, angle of view information, and arrangement information captured by the plurality of cameras.

[0123] In another embodiment, when a plurality of cameras are a central camera located at a measurement reference position, a left camera and a right camera located symmetrically with respect to the measurement reference position, and when a plurality of patterns are arranged horizontally and vertically in a test image, the calculation unit (830) can calculate the coordinates of a plurality of patterns using the number of horizontal pixels of a plurality of captured images, the coordinates of a plurality of patterns in a plurality of captured images, the angle of view of a plurality of cameras included in the angle of view information, and the distance between the left camera and the right camera included in the arrangement information.

[0124] In another embodiment, the calculation unit (830) can calculate the coordinates of a plurality of patterns using mathematical formula 9.

[0125] [Mathematical Formula 9]

[0126]

[0127]

[0128]

[0129] Here, x ij , y ij , z ij is the x, y, and z axis coordinates of the horizontal i-th and vertical j-th pattern relative to the measurement reference position, α is the distance between the left camera and the right camera, M is the number of horizontal pixels of the multiple captured images, θ is the field of view of the multiple cameras, and m L ij is the horizontal coordinate of the horizontally i-th and vertically j-th pattern in the image captured by the left camera, and mR ij is the horizontal coordinate of the horizontally i-th and vertically j-th pattern in the image captured by the right camera, and m C ij is the horizontal coordinate of the i-th horizontal and j-th vertical pattern in the image captured by the center camera.

[0130] In another embodiment, the calculation unit (830) can further calculate the virtual image distance between the measurement reference position and the virtual plane by using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0131] In another embodiment, the calculation unit (830) can calculate the virtual image distance using mathematical formula 10.

[0132] [Mathematical Formula 10]

[0133]

[0134] Here, D VI is the virtual image distance, and x 22 , y 22 , z 22 is the coordinate of one of the multiple patterns.

[0135] In another embodiment, the calculation unit (830) can further calculate the look-down / up angle from the measurement reference position to the virtual plane using the coordinates of the measurement reference position and at least one of the coordinates of a plurality of patterns on the virtual plane.

[0136] In another embodiment, the calculation unit (830) can calculate the look-down / up angle using mathematical formula 11.

[0137] [Mathematical Formula 11]

[0138]

[0139] Here, θ down / up is the look-down / look-up angle, and x 22 , y 22 , z 22 is the coordinate of one of the multiple patterns.

[0140] In another embodiment, the calculation unit (830) can further calculate the horizontal field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the horizontal direction among a plurality of patterns on a virtual plane.

[0141] In another embodiment, the calculation unit (830) can calculate the horizontal field of view using mathematical formula 12.

[0142] [Mathematical Formula 12]

[0143]

[0144] Here, θ H FOV is the horizontal field of view, O is the coordinates of the measurement reference position, and P 21 and P 23 is the coordinates of two patterns located at both ends in the horizontal direction.

[0145] In another embodiment, the calculation unit (830) can further calculate the vertical field of view of the measurement reference position using the coordinates of the measurement reference position and the coordinates of two patterns located at both ends in the vertical direction among a plurality of patterns on a virtual plane.

[0146] In another embodiment, the calculation unit (830) can calculate the vertical viewing angle using mathematical formula 13.

[0147] [Mathematical Formula 13]

[0148]

[0149] Here, θ V FOV is the vertical field of view, O is the coordinates of the measurement reference position, and P 12 and P 32 is the coordinates of two patterns located at both ends in the vertical direction.

[0150] In another embodiment, the calculation unit (830) can further calculate static distortion for each of the three axes based on the measurement reference position based on the coordinates of a plurality of patterns on a virtual plane.

[0151] In another embodiment, the calculation unit (830) may further calculate the coordinates of a plurality of ghost patterns corresponding to each of a plurality of patterns based on a plurality of captured images, angle of view information, and arrangement information, and may further calculate a ghosting level based on the coordinates of the plurality of patterns and the coordinates of the plurality of ghost patterns.

[0152] Meanwhile, the embodiments of the present invention described above can be written as a program executable on a computer and can be implemented on a general-purpose digital computer that operates the program using a computer-readable recording medium.

[0153] The above computer-readable recording media include magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

[0154] The present invention has been described above with reference to its preferred embodiments. Those skilled in the art will understand that the present invention may be embodied in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention.

[0155] Referring to FIG. 9-10, a camera according to the embodiments may correspond to a light measuring device (LMD). The light measuring device according to the embodiments may generate a virtual image plane and may generate images containing patterns at different locations. An optical property measurement method according to the embodiments comprises the steps of: generating images containing points within each pattern for a virtual image plane using one or more light measuring devices; each image is captured based on one or more light measuring devices, and each image corresponds to at least one of a left image, a center image, and a right image; and generating positions of points based on one or more light measuring devices and each pattern; wherein the positions may be obtained based on the field of view of one or more light measuring devices, the gap between the left light measuring device and the right light measuring device.

[0156] Referring to FIG. 10, one LDM can capture three images for the virtual plane at the center, left, and right positions, and multiple LDMs can capture three images for the virtual plane at the center, left, and right positions.

[0157] Referring to FIG. 12, the positions of the points can be estimated based on, for example, the capture angle for the left LDM position and the capture angle for the right LDM position.

[0158] Based on mathematical formula 1, the coordinate values ​​of the position for the pattern of the image can be calculated.

[0159] Referring to Equation 1, by the optical characteristic measurement method / device according to the embodiments, a left image containing points within a pattern is captured based on the left optical measurement device of one or more optical measurement devices, a central image containing points within a pattern is captured based on the central optical measurement device of one or more optical measurement devices, and a right image containing points within a pattern is captured based on the right optical measurement device of one or more optical measurement devices. An index according to the embodiments may indicate the order of which number it is, and a field of view may correspond to an angle of view.

[0160] Referring to FIG. 13 and Equation 2, the position coordinate values ​​can be calculated based on the horizontal pixel index of the left light measuring device, the horizontal pixel index of the right light measuring device, the horizontal pixel index of the central light measuring device, and the field of view of the left light measuring device.

[0161] Referring to FIG. 14 and Equation 4, the optical characteristic measurement method according to the embodiments may further include the step of measuring a virtual image distance for a virtual image plane based on a position within the central pattern and an optical measurement device.

[0162] Referring to FIG. 15, the method may further include the step of measuring the look-down angle and look-up angle for the virtual image plane based on the position within the pattern and the virtual image distance.

[0163] Referring to FIG. 16, the method may further include the step of measuring a horizontal field of view of a virtual image plane based on a distance to a central left point and a distance to a central right point; and the step of measuring a vertical field of view of a virtual image plane based on a distance to a central top point and a distance to a central bottom point.

[0164] The optical property measurement method according to the embodiments may include the step of measuring horizontal distortion for a virtual image plane based on a line between a center and a center top point and a center bottom point; and the step of measuring vertical distortion for a virtual image plane based on a line between a center and a center left point and a center right point.

[0165] The optical specific measurement method / device according to the embodiments, the ambient background effect measurement method and device for a 3D virtual image according to the embodiments, etc., may be referred to as the method / device according to the embodiments.

[0166] FIG. 18 shows a measurement configuration for evaluating the ambient background effect on the image quality properties of a 3D virtual image according to embodiments.

[0167] The method / device according to the embodiments can reproduce virtual numbers, characters, or other symbols, etc., under different depth conditions through a 3D display in the form of a virtual image, such as a 3D HUD. A clear 3D virtual image is expected to be viewable in a wide variety of real environments, namely mixed lighting with different illuminance levels and correlated color temperatures. Because there are limitations to the actual implementation and application of an environment surrounding such a virtual image on all sides, the method / device according to the embodiments may include a measurement method for evaluating the effect of changes in the surrounding background on the quality of the virtual image.

[0168] Generally, a clear 3D virtual image is expected to be displayed against a real background. In this regard, to evaluate image quality, contrast and color-related properties of the 3D virtual image superimposed on the surrounding background must be measured. Accordingly, the method / device according to the embodiments may include and perform a measurement method for evaluating the contrast (reflecting changes in grayscale luminance) and chromaticity changes of the 3D virtual image under different surrounding background conditions. Examples of illuminance levels and correlated color temperatures for surrounding background conditions are described below.

[0169] According to the embodiments, the room in which the measurement is performed may be a completely dark room. For example, in FIG. 19, the size of the white diffuser behind the virtual image plane (which may be referred to as a virtual image plane, virtual image plane, virtual plane, etc.) may be determined to be larger than the horizontal and vertical FOV of the virtual image plane. Since the entire virtual image plane can be observed when the eye is located inside the eyeball, if the LMD is inside the eyeball, the size of the white diffuser screen may also be large enough to overlap the entire virtual image plane. The illuminance and correlated color temperature of the ambient background conditions can be measured at nine points on the white diffuser (see FIG. 20). The luminance reflected from the white diffuser is measured with zero input applied to the display to be measured. This measurement value is evaluated for the presence of stray light. A detailed measurement method for ambient background effects will be described later.

[0170] As shown in FIG. 20, the non-uniformity of the surrounding background may be such that the illuminance values ​​at nine points of the white diffuser are within a ±10% error range relative to the target value. For example, if the target value is 500 lx, the illuminance values ​​at nine points can be set to within 500 ± 50 lx.

[0171] FIG. 18 illustrates the geometric relationship consisting of an eye box, a virtual image plane, and a white diffuser. It is assumed that when the user's eye is positioned in the eye box, the user can view the entire virtual image through the natural rolling motion of the eye. The eye box position may be specified by the vendor, or otherwise estimated according to the method provided in IEC 62629-62-11 (specifically Section 4.2.3). The measuring device of the imaging LMD is set within the eye-box position. The 3D image may be displayed on the front or back of the virtual image plane. To determine the position of the 3D image and the virtual plane from the user's eye box, a 3D coordinate system of xyz shown in FIG. 1 is defined.

[0172] The design distance shown in FIG. 18 is the distance from the center of the eye-box to the position of the half mirror, as proposed by the supplier. At this distance, an appropriate field of view is observed and / or the image quality characteristics of the virtual image reproduced by the glasses-free stereoscopic 3D display are accurately measured. When measuring, the design distance is applied as the measurement distance. The measurement distance is fixed when measuring the item to be evaluated.

[0173] Numbers, letters, or other symbols can be reproduced on transparent virtual image type 3D displays, such as 3D HUDs. Generally, a clear 3D image of the real environment is expected to be displayed. In this regard, to evaluate image quality, contrast and color-related properties of the 3D virtual image superimposed on the actual surround must be measured.

[0174] However, real-world environments are highly diverse. Background effects, where the color and brightness characteristics of a 3D virtual image appear different from adjacent real objects, are excluded from this criterion as they are visual perception issues. To improve visibility, the luminance of a 3D virtual image can be controlled according to a predetermined algorithm on the 3D display based on changes in the brightness of the real environment.

[0175] Therefore, we propose a measurement method for the contrast (reflecting changes in grayscale luminance) and color characteristics of 3D virtual images that vary depending on ambient surround conditions. Images displayed for automotive display applications are typically shown in bright ambient environments as specified in ISO 15008, rather than dark ambient environments. The ambient brightness change for measurement is selected by referring to ISO 15008, and the correlated color temperature value is selected by referring to ISO 16505.

[0176] - Dark Surround: The maximum illuminance at the center of the white diffuser to be measured (see Fig. 18) should not exceed 10lx ± 5%, and the correlated color temperature is similar to the CIE A standard illumination of Tc = 2,848 ± 1,000K.

[0177] - Dim surround: The maximum illuminance at the center of the white diffuser to be measured (see Fig. 18) should not exceed 250 lx ± 5%, and the correlated color temperature is similar to the CIE A standard illumination of Tc = 2,848 ± 1,000 K.

[0178] - Bright surround with diffused ambient light: The maximum illuminance at the center of the white diffuser to be measured (see Fig. 18) should not exceed 5,000 lx ± 5%, and the correlated color temperature is similar to a CIE D65 standard light source with Tc = 6,500 ± 1,500 K.

[0179] FIG. 19 shows the relationship between a virtual image plane and a white diffuser according to embodiments.

[0180] As mentioned above, the size of the white diffuser behind the virtual image plane is determined to be larger than the horizontal and vertical FOV of the virtual image plane.

[0181] FIG. 20 shows non-uniform measurement points of the surrounding background according to embodiments.

[0182] The surrounding background refers to the ambient background.

[0183] As mentioned above, the non-uniformity of the surrounding background is such that the illuminance values ​​at 9 points of the white diffuser are within a ±10% error range relative to the target value. For example, if the target value is 500lx, the illuminance values ​​at 9 points are set to within 500±50lx.

[0184] The surrounding background conditions, that is, the conditions regarding the ambient background, are as follows.

[0185] Ambient background conditions vary significantly in the real world. Therefore, it is most desirable to simultaneously measure '(A) the contrast and color of the virtual image' and '(B) the illuminance and correlated color temperature of the corresponding background where the virtual image is observed'. However, measuring the simultaneous changes of (A) and (B) is practically very difficult due to limitations in implementing various ambient background conditions. Accordingly, the method / device according to the embodiments provides representative ambient background conditions as examples, taking into account that HUD manufacturers also configure the brightness of the HUD to automatically adjust according to the brightness of the external environment.

[0186] If the supplier does not specify the ambient background conditions, they may be selected from the following examples. For indoor use, refer to IEC 62977-2-2, and for outdoor use, refer to ISO 15008 to select the illuminance level and associated color temperature for the ambient background conditions. For spectral measurements of the ambient background conditions, a broadband light source with a smooth spectrum (e.g., an approximation to CIE A) may be used.

[0187] Indoor condition: The illuminance value of the white diffuser (see Figs. 18 and 20) is 500 lx ± 10%, and the correlated color temperature may be close to a CIE A or D50 or D65 standard light source.

[0188] Night condition: The illuminance value of the white diffuser (see Figs. 18 and 20) is 10lx ± 10%, and the correlated color temperature may be close to the CIE A standard light source.

[0189] Twilight condition: The illuminance value of the white diffuser (see Figs. 18 and 20) is 250 lx ± 10% and the correlated color temperature can be close to the CIE A standard light source.

[0190] Day condition with diffuse ambient light: The illuminance value of the white diffuser (see Fig. 18 and Fig. 3) is 5,000 lx ± 10% and the correlated color temperature may be close to the CIE D65 or D75 standard light source.

[0191] In fact, for 3D displays in the form of virtual images such as 3D HUDs, 3D virtual images are superimposed on dark or bright (indoor or outdoor) ambient backgrounds along with dark or indoor or outdoor backgrounds. Therefore, contrast (reflecting changes in grayscale luminance) and chromaticity characteristics must be evaluated by reflecting these changes in the ambient background. Below, a method for measuring these properties for various ambient background conditions according to embodiments is described. The brightness of the ambient background is changed by adjusting the illuminance of the light in front of the white diffuser (see FIG. 23), and the size of the white diffuser is determined as described above to be larger than the FOV of the virtual image plane.

[0192] The method / device according to the embodiments includes and can perform a method for measuring ambient background effects for a 3D virtual image.

[0193] FIG. 21 illustrates a method for measuring the contrast and chromaticity of a 3D virtual image against various surrounding backgrounds according to embodiments.

[0194] The conditions for measuring contrast and color may be as follows.

[0195] a) Display settings: If there are internal setting conditions that vary depending on the brightness of the actual environment, two internal display setting conditions with the darkest and brightest luminance outputs can be selected and evaluated alternately.

[0196] b) Test pattern: It may be a test image with a central square (Pc) having 128 of the 8-bit digitized RGB values ​​in FIG. 22 and a gray background.

[0197] This test pattern with a gray background can be prone to veiling glare errors when measuring the black center square.

[0198] c) Test signal for the center square (Pc): It may be black and white for contrast, or three primary colors (red, green, and blue) for chromaticity measurement.

[0199] d) Ambient background conditions: This may be a user-defined condition or a dark or bright ambient background condition as described above.

[0200] The measurement and calculation procedures according to the embodiments are explained by taking into account the surrounding background conditions defined as above so that the user can easily understand them.

[0201] e) Acquisition of test pattern image: Imaging LMDs located to the left and right of the eye-box are utilized (see Fig. 23).

[0202] The measuring flowchart of the method / device according to the embodiments is as follows.

[0203] a) First, the internal display setting condition with the darkest luminance output is selected.

[0204] b) Apply white and black test signals to the central square (Pc) of Fig. 22.

[0205] c) Using imaging LMDs located on the left and right of the eyebox, the luminance of the central square of the virtual image plane shown in FIG. 23 is measured in order from the dark background to the bright ambient background (measured based on the formula in FIG. 21(a)).

[0206] Here, referring to FIG. 21(a), the definition of each parameter is as follows.

[0207] Lk, l, white(Pc) is the white luminance measured at measurement point Pc using l LMD (LMDL or LMDR) under k surrounding background conditions.

[0208] Lk, l, black (Pc) is the black luminance measured at measurement point Pc using l LMD (LMDL or LMDR) under k surrounding background conditions.

[0209] k is the ambient background condition given in 4.2.4.

[0210] l is the imaging LMD located on the left or right side of the eye-box in Fig. 23.

[0211] d) Apply red, green, and blue test signals alternately.

[0212] e) Using imaging LMDs located to the left and right of the eye-box, the chromaticity coordinates of the center square of the virtual image plane shown in FIG. 23 are measured for the red, green, and blue signals, respectively, in order from the dark background to the bright ambient background (measured based on the formula in FIG. 21(b)).

[0213] Here, referring to FIG. 21(b), the definition of each parameter is as follows.

[0214] u'k, l, red(Pc), v'k, l, red(Pc), u'k, l, green(Pc), v'k, l, green(Pc), u'k, l, blue(Pc) and v'k, l, blue(Pc) are the chromaticity coordinates of the CIE 1976 u' and v' chromaticity diagrams, measured at measurement point Pc for red, green, and blue images, respectively.

[0215] k is the surrounding background condition.

[0216] l is the imaging LMD located on the left or right side of the eye-box in Fig. 23.

[0217] f) Repeat the process of (b) to (e) for the internal HUD setting conditions along with the luminance output.

[0218] The calculation flowchart of the method / device according to the embodiments is as follows.

[0219] a) Calculate the contrast value of C as in Fig. 21(c).

[0220] Here, referring to FIG. 21(c), the definition of each parameter is as follows.

[0221] Ck, l is the contrast calculated using l LMD (LMDL or LMDR) under k surrounding background conditions.

[0222] Lk, l, white(Pc) is the white luminance measured at measurement point Pc using l LMD (LMDL or LMDR) under k surrounding background conditions.

[0223] Lk, l, black (Pc) is the black luminance measured at measurement point Pc using l LMD (LMDL or LMDR) under k surrounding background conditions.

[0224] k is one of the dark or bright ambient background conditions.

[0225] l is the imaging LMD located on the left or right side of the eye-box in Fig. 23.

[0226] FIG. 22 shows a test image for measuring contrast and chromaticity characteristics affected by changes in the surrounding background in a 3D virtual image according to embodiments.

[0227] The method / device according to the embodiments can acquire a test pattern using a test image such as FIG. 22 and measure the contrast and chromaticity of a 3D virtual image for various ambient backgrounds through the test pattern.

[0228] FIG. 23 shows measurement conditions for contrast and chromaticity characteristics of 3D virtual images under various ambient background conditions according to embodiments.

[0229] The method / device according to the embodiments can perform a measurement operation using an optical measuring device by considering the position of the eyebox based on a configuration environment such as FIG. 23.

[0230] The eye box indicates the position of the user's eyes, and a virtual image plane can be constructed based on the eye box. The virtual image plane can be an area where 3D virtual objects are located. That is, 3D virtual objects can be constructed in front of, above, or behind the virtual image plane and perceived by the user's eyes. A white diffuser is located behind the virtual image plane, and a light source may be present to create various background environments.

[0231] The contrast and chromaticity measurement conditions of the 3D virtual overlay according to the embodiments are as follows.

[0232] a) The test pattern is a test image with a central square (Pc).

[0233] b) The test signals are black and white for contrast and three primary colors (red, green, and blue) for chromaticity measurement.

[0234] c) The surrounding surround conditions are the dark, dark, and bright surround conditions defined as previously explained.

[0235] d) Acquisition of test pattern image: An imaging LMD located in the center of the eyebox is utilized (see Fig. 23).

[0236] The method for measuring contrast and chromaticity of a 3D virtual overlay according to the embodiments is as follows.

[0237] a) Apply white and black test signals to the center square (Pc). This can be performed in the order of the previously described dark, dark, and bright surround conditions.

[0238] b) For each of the white and black signals, measure the luminance of the central square on the virtual image plane and record the luminance values ​​in the order of dark, dark, and bright ambient conditions.

[0239] c) Calculate the contrast value of C as follows (see Fig. 21d).

[0240] White(Pc) is the white luminance measured at measurement point Pc.

[0241] Lblack(Pc) is the black luminance measured at measurement point Pc.

[0242] k is a dark, dark, or bright surround condition.

[0243] d) Apply red, green, and blue test signals alternately.

[0244] e) For each of the red, green, and blue signals, the luminance of the central square in the virtual image plane is measured and the luminance values ​​are recorded in the order of dark, dark, and bright surround conditions (see FIG. 21e).

[0245] Lred(Pc) is the red luminance measured at measurement point Pc.

[0246] Lgreen(Pc) is the green luminance measured at measurement point Pc.

[0247] Lblue(Pc) is the black luminance measured at measurement point Pc.

[0248] k is a dark, dark, or bright surround condition.

[0249] f) For each of the red, green, and blue signals, the chromaticity coordinates of the center square in the virtual image plane are measured and the chromaticity coordinate values ​​are recorded in the order of dark, dark, and bright surround conditions (see FIG. 21 f).

[0250] u'red(Pc), u'green(Pc), u'blue(Pc), v'red(Pc), v'green(Pc), and v'blue(Pc) are the chromaticity coordinates of the CIE 1976 u' and v' chromaticity diagrams measured at measurement point Pc for red, green, and blue images, respectively.

[0251] k is a dark, dark, or bright surround condition.

[0252] FIG. 24 illustrates a method for measuring ambient background effects on a 3D virtual image according to embodiments.

[0253] The method according to the embodiments may include each of the following steps. Each step may be performed by an apparatus according to the embodiments.

[0254] S2400, a method for measuring an ambient background effect for a 3D virtual image according to embodiments may include the step of applying a first test signal to the center of the virtual image plane.

[0255] S2401, A method for measuring an ambient background effect for a 3D virtual image according to embodiments may further include the step of measuring the luminance of the central part of the virtual image plane.

[0256] S2402, a method for measuring an ambient background effect for a 3D virtual image according to embodiments may further include the step of applying a second test signal to a virtual plane.

[0257] S2403, a method for measuring an ambient background effect for a 3D virtual image according to embodiments may further include the step of measuring the chromaticity coordinate of the central part of the virtual plane.

[0258] FIG. 25 shows an ambient background effect measuring device for a 3D virtual image according to embodiments.

[0259] The method according to the embodiments can be performed by the device of FIG. 25. Each component of FIG. 25 may correspond to hardware, software, a processor, and / or a combination thereof. FIG. 25 may correspond to the device of FIG. 8.

[0260] The light measuring unit may be a camera. The processor may be a processor that performs operations according to the embodiments. The memory may store data and information related to the operation of the processor. The memory may provide necessary data to the processor. The memory may be connected to the light measuring unit, the processor, etc.

[0261] As a result, a 3D AR HUD can be implemented accurately and quickly in various ambient background environments. When combined with autonomous driving technology, the 3D HUD can enable safe and accurate autonomous driving. In addition, accurate and safe vehicle services can be provided to the driver by utilizing measurement results based on background conditions.

[0262] With respect to the measurement of contrast and chromaticity of a 3D virtual image against various surrounding backgrounds, referring to FIG. 21 (measuring procedure), the method according to the embodiments may include the steps of: applying a first test signal to the center of a virtual image plane; measuring the luminance of the center of the virtual image plane; applying a second test signal to the virtual plane; and measuring the chromaticity coordinate of the center of the virtual plane.

[0263] Referring to FIG. 21 (measuring procedure), the first test signal may include at least one of a white test signal or a black test signal.

[0264] In addition, luminance can be measured for the white test signal and the black test signal, respectively, using at least one LMD (Light Measuring Device) located on the left and right sides of the eye box.

[0265] Additionally, luminance is measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of indoor conditions, night conditions, twilight conditions, or day conditions with diffuse ambient light, and the ambient background conditions can be determined according to illuminance values ​​and correlated color temperatures.

[0266] Additionally, the luminance may include at least one of white luminance measured in the center using at least one LMD under ambient background conditions, or black luminance measured in the center using at least one LMD under ambient background conditions.

[0267] In relation to the measurement of chromaticity coordinates in FIG. 21 (measuring procedure), the second test signal may include at least one of a red test signal, a green test signal, or a blue test signal.

[0268] Additionally, chromaticity coordinates can be measured for the red test signal, the green test signal, or the blue test signal, respectively, using the at least one LMD located on the left and right sides of the eye box.

[0269] Additionally, chromaticity coordinates are measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of indoor conditions, night conditions, twilight conditions, or day conditions with diffuse ambient light, and the ambient background conditions can be determined according to illuminance values ​​and correlated color temperatures.

[0270] Additionally, the chromacity coordinates may include at least one of red chromacity coordinates measured at the center using at least one LMD under surrounding background conditions, green chromacity coordinates measured at the center using at least one LMD under surrounding background conditions, or blue chromacity coordinates measured at the center using at least one LMD under surrounding background conditions.

[0271] In relation to Fig. 21 (calculation procedure), the contrast with respect to ambient background conditions can be measured based on white luminance and black luminance.

[0272] A method for measuring ambient background effects for a 3D virtual image is performed by a device, and the device according to the embodiments includes a memory; and a processor connected to the memory; the processor includes instructions, and the instructions may cause the processor to perform operations such as: applying a first test signal to the center of the virtual image plane, measuring the luminance of the center of the virtual image plane, applying a second test signal to the virtual plane, and measuring the chromaticity coordinates of the center of the virtual plane.

[0273] In addition, the first test signal may include at least one of a white test signal or a black test signal.

[0274] In addition, luminance can be measured for the white test signal and the black test signal, respectively, using at least one LMD (Light Measuring Device) located on the left and right sides of the eye box.

[0275] Additionally, luminance is measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of indoor conditions, night conditions, twilight conditions, or day conditions with diffuse ambient light, and the ambient background conditions can be determined according to illuminance values ​​and correlated color temperatures.

[0276] Additionally, the luminance may include at least one of white luminance measured in the center using at least one LMD under ambient background conditions, or black luminance measured in the center using at least one LMD under ambient background conditions.

[0277] In addition, the second test signal may include at least one of a red test signal, a green test signal, or a blue test signal.

[0278] Additionally, chromaticity coordinates can be measured for the red test signal, the green test signal, or the blue test signal, respectively, using at least one LMD located to the left and right of the eye box.

[0279] Additionally, chromaticity coordinates are measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of indoor conditions, night conditions, twilight conditions, or day conditions with diffuse ambient light, and the ambient background conditions can be determined according to illuminance values ​​and correlated color temperatures.

[0280] Additionally, the chromacity coordinates may include at least one of red chromacity coordinates measured at the center using at least one LMD under surrounding background conditions, green chromacity coordinates measured at the center using at least one LMD under surrounding background conditions, or blue chromacity coordinates measured at the center using at least one LMD under surrounding background conditions.

[0281] In addition, based on white luminance and black luminance, the contrast with respect to ambient background conditions can be measured.

[0282] The embodiments may include a computer program stored on a recording medium that executes a method for measuring ambient background effects for a 3D virtual image described in at least one of the aforementioned methods.

[0283] The embodiments have been described in terms of methods and / or devices, and the description of the methods and the description of the devices may be applied complementarily.

[0284] Although the drawings have been described separately for the convenience of explanation, it is also possible to design a new embodiment by combining the embodiments described in each drawing. Furthermore, designing a computer-readable recording medium containing a program for executing the previously described embodiments, as required by a person skilled in the art, falls within the scope of the claims of the embodiments. The apparatus and method according to the embodiments are not limited to the configuration and method of the embodiments described above; rather, the embodiments may be configured by selectively combining all or part of each embodiment to allow for various modifications. Although preferred embodiments have been illustrated and described, the embodiments are not limited to the specific embodiments described above. It is not only possible for a person skilled in the art to make various modifications without departing from the essence of the embodiments claimed in the claims, but such modifications should not be understood individually from the technical concept or perspective of the embodiments.

[0285] Various components of the device of the embodiments may be implemented by hardware, software, firmware, or a combination thereof. Various components of the embodiments may be implemented as a single chip, for example, a single hardware circuit. Depending on the embodiments, the components according to the embodiments may each be implemented as separate chips. Depending on the embodiments, at least one of the components of the device according to the embodiments may be composed of one or more processors capable of executing one or more programs, and one or more programs may include instructions for performing or executing any one or more of the operations / methods according to the embodiments. Executable instructions for performing the methods / operations of the device according to the embodiments may be stored in non-transient CRMs or other computer program products configured to be executed by one or more processors, or may be stored in transient CRMs or other computer program products configured to be executed by one or more processors. Additionally, memory according to the embodiments may be used as a concept that includes not only volatile memory (e.g., RAM, etc.) but also non-volatile memory, flash memory, PROM, etc. In addition, it may also include implementation in the form of carrier waves, such as transmission over the Internet. Furthermore, processor-readable recording media are distributed across networked computer systems, allowing processor-readable code to be stored and executed in a distributed manner.

[0286] In this document, “ / ” and “,” are interpreted as “and / or.” For example, “A / B” is interpreted as “A and / or B,” and “A, B” is interpreted as “A and / or B.” Additionally, “A / B / C” means “at least one of A, B and / or C.” Also, “A, B, C” means “at least one of A, B and / or C.” Additionally, in this document, “or” is interpreted as “and / or.” For example, “A or B” may mean 1) “A” alone, 2) “B” alone, or 3) “A and B.” In other words, “or” in this document may mean “additionally or alternatively.”

[0287] Terms such as "first," "second," etc., may be used to describe various components of the embodiments. However, the interpretation of the various components according to the embodiments should not be limited by these terms. These terms are merely used to distinguish one component from another. For example, the first user input signal may be referred to as the second user input signal. Similarly, the second user input signal may be referred to as the first user input signal. The use of these terms should be interpreted as not departing from the scope of the various embodiments. Although the first user input signal and the second user input signal are both user input signals, they do not imply the same user input signals unless clearly indicated in the context.

[0288] The terms used to describe the embodiments are intended for the purpose of describing specific embodiments and are not intended to limit the embodiments. As used in the description of the embodiments and in the claims, the singular is intended to include the plural unless explicitly indicated in the context. Expressions of and / or are used to mean including all possible combinations between the terms. Expressions of include describe the presence of features, numbers, steps, elements, and / or components and do not imply the exclusion of additional features, numbers, steps, elements, and / or components. Conditional expressions such as "if" or "when" used to describe the embodiments are not limited to being optional. It is intended to be interpreted as "when a specific condition is satisfied," "when a related action is performed in response to a specific condition," or "when a related definition is interpreted."

[0289] Additionally, operations according to the embodiments described herein may be performed by a transmitting and receiving device including memory and / or a processor, depending on the embodiments. The memory may store programs for processing / controlling operations according to the embodiments, and the processor may control various operations described in this document. The processor may be referred to as a controller, etc. Operations in the embodiments may be performed by firmware, software, and / or a combination thereof, and the firmware, software, and / or a combination thereof may be stored in the processor or in memory.

[0290] Meanwhile, the operation according to the embodiments described above may be performed by a transmitting device and / or a receiving device according to the embodiments. The transmitting and receiving device may include a transmitting and receiving unit for transmitting and receiving media data, a memory for storing instructions (program code, algorithm, flowchart and / or data) for a process according to the embodiments, and a processor for controlling the operations of the transmitting and receiving devices.

[0291] The processor may be referred to as a controller, etc., and may correspond, for example, to hardware, software, and / or a combination thereof. The operation according to the embodiments described above may be performed by the processor. Additionally, the processor may be implemented as an encoder / decoder, etc., for the operation of the embodiments described above.

Claims

Claim 1 A step of applying a first test signal comprising at least one of a white test signal or a black test signal to the center of a virtual image plane; a step of measuring the luminance of the center of the virtual image plane in order from dark to bright under a plurality of ambient background conditions determined by illuminance values ​​and correlated color temperatures, including at least one of an indoor condition, a night condition, a twilight condition, or a day condition with diffuse ambient light, using at least one Light Measuring Device (LMD) located on the left and right sides of an eye box; a step of applying a second test signal comprising at least one of a red test signal, a green test signal, or a blue test signal to the virtual image plane; and a step of measuring the chromaticity coordinates of the center of the virtual image plane in order from dark to bright under the plurality of ambient background conditions using the at least one LMD located on the left and right sides of the eye box. A method for measuring ambient background effects for a 3D virtual image, including Claim 2 A method for measuring an ambient background effect for a 3D virtual image, wherein, in claim 1, the method further comprises the step of measuring the contrast of the ambient background condition based on the white luminance and black luminance measured at the central part for each of the plurality of ambient background conditions. Claim 3 delete Claim 4 delete Claim 5 A method for measuring ambient background effects for a 3D virtual image, wherein the luminance comprises at least one of white luminance measured at the center using at least one LMD under ambient background conditions, or black luminance measured at the center using at least one LMD under ambient background conditions. Claim 6 delete Claim 7 A method for measuring ambient background effects for a 3D virtual image, wherein, in claim 1, the chromaticity coordinates are measured for the red test signal, the green test signal, or the blue test signal, respectively, using the at least one LMD located to the left and right of the eye box. Claim 8 A method for measuring ambient background effects for a 3D virtual image, wherein, in claim 7, the chromaticity coordinates are measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of an indoor condition, a night condition, a twilight condition, or a day condition with diffuse ambient light, and the ambient background conditions are determined according to illuminance values ​​and correlated color temperatures. Claim 9 A method for measuring ambient background effects for a 3D virtual image, wherein the chromaticity coordinates include at least one of red chromaticity coordinates measured at the center using at least one LMD under ambient background conditions, green chromaticity coordinates measured at the center using at least one LMD under ambient background conditions, or blue chromaticity coordinates measured at the center using at least one LMD under ambient background conditions. Claim 10 A method for measuring an ambient background effect for a 3D virtual image, wherein, in claim 5, the contrast with respect to the surrounding background conditions is measured based on the white luminance and the black luminance. Claim 11 Memory; and a processor connected to the memory; ...including, wherein the processor includes an instruction, and the instruction causes the processor to: apply a first test signal comprising at least one of a white test signal or a black test signal to the center of a virtual image plane; and, using at least one Light Measuring Device (LMD) located on the left and right sides of an eye box, measure the luminance of the center of the virtual image plane in order from dark to bright under a plurality of ambient background conditions determined by illuminance values ​​and correlated color temperatures, including at least one of an indoor condition, a night condition, a twilight condition, or a day condition with diffuse ambient light; and apply a second test signal comprising at least one of a red test signal, a green test signal, or a blue test signal to the virtual image plane; and, using the at least one LMD located on the left and right sides of the eye box, measure the chromaticity coordinates of the center of the virtual image plane in order from dark to bright under the plurality of ambient background conditions. A device for measuring ambient background effects for a 3D virtual image, capable of measuring and performing actions. Claim 12 An ambient background effect measuring device for a 3D virtual image, wherein, in claim 11, the processor is further configured to measure the contrast for each of the plurality of ambient background conditions based on the white luminance and black luminance measured at the central portion. Claim 13 delete Claim 14 delete Claim 15 In Clause 11, the luminance is the surrounding background An ambient background effect measuring device for a 3D virtual image, comprising at least one of white luminance measured at the center using at least one LMD under the above conditions, or black luminance measured at the center using at least one LMD under the above ambient background conditions. Claim 16 delete Claim 17 An ambient background effect measuring device for a 3D virtual image, wherein the chromaticity coordinates are measured for the red test signal, the green test signal, or the blue test signal, respectively, using the at least one LMD located to the left and right of the eye box. Claim 18 An ambient background effect measuring device for a 3D virtual image, wherein, in claim 17, the chromaticity coordinates are measured in order from dark to bright under ambient background conditions, and the ambient background conditions include at least one of an indoor condition, a night condition, a twilight condition, or a day condition with diffuse ambient light, and the ambient background conditions are determined according to illuminance values ​​and correlated color temperatures. Claim 19 An ambient background effect measuring device for a 3D virtual image, wherein the chromaticity coordinates include at least one of red chromaticity coordinates measured at the center using at least one LMD under the ambient background conditions, green chromaticity coordinates measured at the center using at least one LMD under the ambient background conditions, or blue chromaticity coordinates measured at the center using at least one LMD under the ambient background conditions. Claim 20 An ambient background effect measuring device for a 3D virtual image, wherein, in claim 15, the contrast for the surrounding background conditions is measured based on the white luminance and the black luminance. Claim 21 A computer program stored on a recording medium for executing a method for measuring ambient background effects for a 3D virtual image as described in any one of claims 1 to 10.

Images