Method and apparatus for measuring dynamic crosstalk

Abstract

To provide a method and device for measuring dynamic crosstalk.SOLUTION: A method and device for measuring dynamic crosstalk are configured to: control a drive part which dynamically moves a camera which photographs a stereo pattern image that is output through a 3D display based upon positions of both eyes of a user, at a position of at least one of both the eyes; receive the image photographed by the camera having been dynamically moved; and measure the dynamic crosstalk generated by the 3D display by extracting a plurality of regions from the received image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The following embodiments relate to a method and apparatus for measuring dynamic crosstalk. [Background technology]

[0002] Stereo systems, which project separate images to each eye to create a 3D effect, are susceptible to crosstalk if they mistrack the user's eye position or if the generated image differs from the manufacturing specifications of optical layers such as lenticular lenses. For example, if crosstalk occurs in a glasses-free 3D display, the user not only fails to perceive the 3D effect but also experiences awkwardness or dizziness. Therefore, methods to resolve crosstalk are being considered. However, these methods assume that the user's eye position is fixed and are therefore not applicable when the user's eyes are moving.

[0003] The background technology described above is something the inventors have acquired or learned in the process of deriving the disclosures in this specification, and is not necessarily publicly known technology that was made public before the filing of this application. [Overview of the Initiative] [Problems that the invention aims to solve]

[0004] According to one embodiment, the system controls a drive unit that provides dynamic movements similar to those of the user to a camera that captures a stereo pattern image output via a 3D display that tracks the position of both of the user's eyes at the position of at least one of the eyes. Multiple regions are extracted from the image captured by the camera that reflects the dynamic movements, and dynamic crosstalk generated by the 3D display is measured.

[0005] According to one embodiment, by simultaneously placing a white image, which is a pattern image for measuring maximum brightness, and a black image, which is a pattern image for measuring minimum brightness, in the input left-eye / right-eye images, the measuring device can measure dynamic crosstalk even if it only captures the 3D rendering image provided by the 3D display once.

[0006] According to one embodiment, the input left-eye / right-eye images are reconstructed to calculate the crosstalk due to the camera's movement speed in a single measurement. [Means for solving the problem]

[0007] According to one embodiment, a method for measuring dynamic crosstalk includes the steps of: controlling a drive unit configured to cause the camera to have dynamic movement; capturing a stereo pattern image output by the camera via a 3D display while the camera is moving dynamically at either the position of the user's left eye or the position of the right eye or both; and measuring the dynamic crosstalk occurring on the 3D display based on the stereo pattern image captured by the camera.

[0008] The steps for measuring dynamic crosstalk may include detecting multiple markers that indicate multiple regions of a captured stereo pattern image corresponding to the maximum and minimum brightness in the captured image, respectively; extracting multiple regions based on the multiple markers; and measuring dynamic crosstalk based on the brightness values ​​of pixels measured from each of the multiple regions.

[0009] The step of measuring dynamic crosstalk may include the step of averaging the dynamic crosstalk according to the velocity of the dynamic motion.

[0010] When the camera captures a stereo pattern image, a left-eye image provided to the user's left eye, and a right-eye image provided to the user's right eye, the step of measuring dynamic crosstalk may include detecting multiple markers that divide the left-eye image and the right-eye image into multiple regions, extracting multiple regions based on the multiple markers, and measuring dynamic crosstalk based on statistical values ​​of the brightness values ​​of pixels measured from each of the multiple regions.

[0011] The step of controlling the drive unit may include the step of controlling the drive unit so that the camera moves in various directions at a constant speed.

[0012] The steps for controlling the drive unit may include controlling the drive unit so that the camera moves in a direction and at a speed that mimics the user's movements, and adjusting the distance between the eyes of a face mask positioned facing the 3D display.

[0013] The camera position can correspond to the position of at least one eye on a face mask that is facing the 3D display.

[0014] A method for measuring dynamic crosstalk may further include the step of capturing a stereo pattern image based on the interpupillary distance of a face mask arranged toward a 3D display at either the position of the user's left eye or the position of their right eye, or both.

[0015] The step of capturing stereo pattern images may include capturing stereo pattern images at regular intervals while the camera is moving at a constant velocity, and the step of measuring dynamic crosstalk may include measuring dynamic crosstalk by analyzing the stereo pattern images captured while the camera is moving at a constant velocity.

[0016] A method for measuring dynamic crosstalk may further include a step of correcting the dynamic crosstalk based on the camera's position in response to dynamic movement.

[0017] The stereo pattern video captured by the camera can include a first area corresponding to a first pattern video for measuring the maximum brightness, a second area corresponding to a second pattern video for measuring the minimum brightness, and a third area corresponding to a third pattern video for measuring the brightness offset of the 3D display.

[0018] The 3D display can generate a stereo pattern video that matches the positions of the user's left and right eyes based on the parameters of the optical layer obtained through 3D calibration.

[0019] The 3D display includes an eye tracker or sensor configured to detect the positions of the user's left and right eyes, and the 3D display can be configured to apply rendering to the positions of the stereo pattern video corresponding to the positions of the user's left and right eyes.

[0020] The 3D display can include at least one of a head-up display (HUD), a 3D digital information display (DID), a navigation device, a 3D mobile device, a smartphone, a smart TV, a smart vehicle, an IoT (Internet of Things) device, a medical device, and a measurement device.

[0021] The stereo pattern video can include a 2D pattern that displays the same single-color pattern on the left and right eyes, and a 3D pattern that shows a pattern of colors that contrast with the user's left and right eyes.

[0022] The stereo pattern video can include a 2D pattern that displays the same pattern of multiple colors that contrast with each other on the left and right eyes, and a 3D pattern that displays the pattern of colors that contrast with the left and right eyes of the user in the opposite way.

[0023] According to one embodiment, an apparatus for measuring dynamic crosstalk includes a face mask in which the positions of the left eye and the right eye of the corresponding face mask correspond to the positions of the left eye and the right eye of the user, respectively, and a camera that captures a stereo pattern video output via a 3D display at one or both of the positions of the left eye and the right eye of the face mask, a drive unit that enables the camera to have a dynamic movement, and a processor that measures dynamic crosstalk generated by the 3D display based on the stereo pattern captured by the camera while the camera is moving according to the dynamic movement.

[0024] The processor can detect a plurality of markers indicating a plurality of regions of the captured stereo pattern video corresponding to the maximum brightness and the minimum brightness, respectively, in the captured stereo pattern video, extract the plurality of regions based on the plurality of markers, and measure the dynamic crosstalk based on the brightness values of the pixels measured from each of the plurality of regions.

[0025] When the camera captures the left-eye video provided to the user's left eye and the right-eye video provided to the user's right eye in the stereo pattern video, the processor can detect a plurality of markers that divide each of the left-eye video and the right-eye video into a plurality of regions, extract the plurality of regions based on the plurality of markers, and measure the dynamic crosstalk based on the statistical values for the brightness values of the pixels measured from each of the plurality of regions.

[0026] The processor can further correct the dynamic crosstalk based on the position where the camera has moved according to the dynamic movement.

[0027] The captured stereo pattern video can include a first region corresponding to a first pattern video for measuring the maximum brightness, a second region corresponding to a second pattern video for measuring the minimum brightness, and a third region corresponding to a third pattern video for measuring the brightness offset of the 3D display.

[0028] The drive unit may include a motor that provides power to the camera to have dynamic movement, and a camera movement device that moves the camera in a powered direction and at a speed to mimic the user's movements.

[0029] The processor can control the camera movement device to move the camera at a constant speed.

[0030] The processor can control the camera movement device to change either the camera direction or the camera speed, or one or more of the other.

[0031] In a face mask, the distance between the eyes is adjustable, and the processor can extract multiple regions from the captured stereo pattern image and measure dynamic crosstalk based on the distance between the eyes adjusted by the face mask and their dynamic movement.

[0032] A 3D display can generate a stereo pattern image that matches the position of the user's eyes based on the parameters of the optical layer acquired through 3D calibration.

[0033] The 3D display further includes an eye tracker or sensor for locating the position of the user's eyes, and the 3D display can apply rendering positions of stereo pattern images corresponding to the positions of the user's eyes detected using the eye tracker or sensor.

[0034] The stereo pattern image may include a 2D pattern that displays a monochromatic pattern identically to the user's left and right eyes, and a 3D pattern that displays a color pattern that is inversely contrasted to the user's left and right eyes.

[0035] The stereo pattern image may include a 2D pattern that shows a color pattern identically contrasted to the user's left and right eyes, and a 3D pattern that displays the color pattern in reverse for the user's left and right eyes.

[0036] A 3D display may include at least one of the following: a head-up display (HUD), a 3D digital information display (DID), a navigation system, a 3D mobile device, a smartphone, a smart TV, a smart vehicle, an IoT (Internet of Things) device, a medical device, and a measurement device.

[0037] A crosstalk testing apparatus according to one embodiment includes at least one camera that captures a stereo pattern image output via a head-up display (HUD) at either the position of the user's left eye or the position of their right eye or both; a drive unit that causes the at least one camera to have dynamic movement; and a processor that measures dynamic crosstalk generated by the head-up display based on the stereo pattern image captured by the at least one camera while the at least one camera is moving in accordance with the dynamic movement. [Effects of the Invention]

[0038] According to one embodiment, a stereo pattern image output via a 3D display that tracks the position of both of the user's eyes is controlled by a drive unit that provides dynamic movements similar to the user's movements to a camera that captures images at the position of at least one of the eyes. Multiple regions can be extracted from the image captured by the camera, which reflects the dynamic movements, and dynamic crosstalk generated by the 3D display can be measured.

[0039] According to one embodiment, by simultaneously placing a white image, which is a pattern image for measuring maximum brightness, and a black image, which is a pattern image for measuring minimum brightness, in the input left-eye / right-eye images, the measuring device can measure dynamic crosstalk even if it only captures the 3D rendering image provided by the 3D display once.

[0040] According to one embodiment, the input left-eye / right-eye images can be reconstructed, and the crosstalk due to the camera's movement speed can be calculated in a single measurement. [Brief explanation of the drawing]

[0041] [Figure 1] This figure shows an example of a situation in which dynamic crosstalk occurs according to one embodiment. [Figure 2] This figure shows the structure of a system for measuring dynamic crosstalk according to one embodiment. [Figure 3] This is a flowchart illustrating a method for measuring dynamic crosstalk according to one embodiment. [Figure 4] This is a diagram illustrating the operation of a device for measuring dynamic crosstalk according to one embodiment. [Figure 5A] This figure shows an example of a stereo pattern image according to the embodiment. [Figure 5B] This figure shows an example of a stereo pattern image according to the embodiment. [Figure 6A] This figure illustrates a method for controlling a drive unit that provides dynamic movement to a camera according to an embodiment. [Figure 6B] This figure illustrates a method for controlling a drive unit that provides dynamic movement to a camera according to an embodiment. [Figure 7] This is a flowchart illustrating the process of measuring dynamic crosstalk according to one embodiment. [Figure 8] This figure illustrates a method for detecting markers that divide multiple regions according to one embodiment. [Figure 9] This figure illustrates a method for extracting multiple regions based on a marker according to one embodiment. [Figure 10] This is a block diagram of a device for measuring dynamic crosstalk according to one embodiment. [Figure 11] This is a block diagram of a crosstalk testing device according to one embodiment. [Modes for carrying out the invention]

[0042] The specific structural or functional descriptions disclosed herein are illustrative for the purpose of illustrating embodiments, and embodiments can be carried out in various different forms; the present invention is not limited to the embodiments described herein.

[0043] Terms such as "first" or "second" may be used to describe multiple components, but such terms should be interpreted solely for the purpose of distinguishing one component from others. For example, the first component can be named the second component, and similarly, the second component can also be named the first component.

[0044] When it is mentioned that one component is “linked” or “connected” to another component, it should be understood that it is directly linked to or connected to the other component, but that other components may be present in between.

[0045] A singular expression includes plural expressions unless the context clearly indicates otherwise. In this specification, terms such as “includes” or “has” indicate the presence of features, figures, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood not to preemptively exclude the possibility of the presence or addition of one or more other features, figures, steps, actions, components, parts, or combinations thereof.

[0046] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as those generally understood by a person of ordinary skill in the art to which this embodiment belongs. Commonly used, predefined terms should be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as ideal or overly formal unless expressly defined herein.

[0047] The embodiments will be described in detail below with reference to the attached drawings. In describing with reference to the attached drawings, the same reference numerals will be used for the same components regardless of the reference numerals in the drawings, and redundant explanations will be omitted.

[0048] Figure 1 is a diagram illustrating an example of a situation in which dynamic crosstalk occurs according to one embodiment. Referring to Figure 1, one embodiment shows a situation in which a user (e.g., driver) 150 sitting in the driver's seat of a vehicle is provided with 3D content objects via a content visualization device 110.

[0049] The content visualization device 110 is a system that provides a virtual content object 141 to a user 150 and includes, for example, a sensor 111, a processor 113, a HUD module 120, and an eye tracking camera 160 that tracks the position of the user 150's eyes.

[0050] Sensor 111 detects objects present in front of it. For example, sensor 111 can measure the distance to an object present in front of it, but is not limited to this. Sensor 111 can also measure the distance to objects present around the vehicle and generate a surrounding distance map indicating the distance to surrounding objects. Furthermore, sensor 111 can capture images of the environment in front of, behind, to the left, and to the right of the vehicle and generate video. Sensor 111 may also include a module that measures and estimates the position of the content visualization device 110, such as a GNSS (Global Navigation Satellite System) or a 3D depth camera.

[0051] The processor 113 obtains a virtual content object 141 containing information for the user 150. The processor 113 analyzes the surrounding information detected by the sensor 111 (for example, the distance to surrounding objects and images containing those objects) and performs actions such as modeling objects, detecting the position of objects, and recognizing objects. The processor 113 may also select and load content objects 141 to provide to the user 150 based on the current position and the object placement space determined by the field of view of the HUD module 120.

[0052] The HUD module 120 can visualize the virtual content object 141 in the user's visible area, which is located in front of the user 150.

[0053] The HUD module 120 may include a Picture Generation Unit (PGU) 123 configured to generate and / or process data for projection, a projection unit configured to generate and display images (e.g., a folding mirror 125 and a concave mirror 127, and a coupler that provides a surface onto which the image is projected (e.g., a vehicle windshield)). The PGU 123 may be provided separately from the processor 113 or integrated into the processor 113.

[0054] More specifically, the HUD module 120 can visualize a virtual content object 141 on a glass window (e.g., a vehicle's windshield) positioned in front of the user 150. The HUD module 120 forms a virtual projection plane 130. The virtual projection plane 130 is a plane on which a virtual image containing the virtual content object 141 generated by the HUD module 120 is displayed. The user 150 can perceive that the virtual image is placed on the projection plane 130. The projection plane 130 may be formed in an area that can be observed by the user 150's eyes.

[0055] Furthermore, the HUD module 120 can visualize virtual content objects 141 having a corresponding depth within the virtual region 140 on the projection plane 130. The virtual content objects 141 can be rendered in a three-dimensional graphic representation by the processor 113 based on the optical system of the HUD module 120.

[0056] The fold mirror 125 and the concave mirror 127 may display images directly or project them onto a virtual projection plane 130. However, the configuration of the HUD module 120 is not necessarily limited to this and may include, depending on the design, multiple components that form a projection plane 130 on which a virtual image is formed via projection onto a glass window positioned in front of the user 150. In some embodiments, the HUD module 120 may further include an eye-tracking camera 160 that tracks the position of the user 150's eyes.

[0057] The HUD module 120 forms a projection plane 130 that outputs a left-eye image for the user 150's left eye and a right-eye image for the user 150's right eye, based on the depth of the virtual content object 141. The left-eye image is provided to the user 150's left eye and the right-eye image to the user 150's right eye via the projection plane 130. Thus, the user 150 can perceive the depth of the three-dimensionally rendered virtual content object 141.

[0058] When a 3D display such as the HUD module 120 provides the right eye image for the right eye to the left eye of user 150, and the left eye image for the left eye to the right eye of user 150, crosstalk (X-talk, or crosstalk) may occur. Crosstalk is defined, for example, to the extent that the right eye image is visible to user 150's left eye, or the left eye image is visible to user 150's right eye.

[0059] Crosstalk is classified into static crosstalk and dynamic crosstalk depending on whether the user's eye position is fixed during measurement.

[0060] Static crosstalk is the crosstalk measured when the user 150's eye position is fixed. If the camera position is changed and images with different brightness levels are captured during static crosstalk measurement, an image matching issue may occur. Therefore, static crosstalk can be quantified when user 150 is stationary.

[0061] However, since the actual user 150 is not stationary but often moves, the position of user 150's eyes also continues to change. Dynamic crosstalk is the crosstalk measured when the position of user 150's eyes moves. Dynamic crosstalk occurs in the following situations:

[0062] For example, a driver in motion may perceive differences in 3D image quality for virtual content objects 141 provided via the HUD module 120 because they move in various ways from moment to moment. Dynamic crosstalk occurs due to the movements of the user 150 while driving.

[0063] Alternatively, for example, as shown in Figure 170, the total processing time spent by the content visualization device 110 to track the user's eye position and display the 3D-rendered virtual content object 141 on the 3D display according to the tracked position is T2-T1. In this case, the total processing time includes the capturing time 171 required to track the user's eye position by the eye tracking camera 160, the processing time 173 required to 3D render the virtual content object 141 based on the tracked eye position of the user 150, and the 3D-rendered virtual content object 141.

[0064] In this case, the total processing time T2-T1 corresponds to the latency of the content visualization device 110, and the user 150's eye position at time T1 and the user 150's eye position at time T2 are at a constant distance from each other. The 3D rendering result based on time T1 may be displayed at a position not too far from the user 150's eye position at time T1, or at a position far from the user 150's eye position at time T1, depending on the user 150's movement speed relative to the latency of the content visualization device 110.

[0065] For example, if user 150 has slow movement relative to latency, the rendering result based on time T1 may appear at the eye position of user 150 at time T2, which is not far from the eye position of user 150 at time T1. In this case, the probability of dynamic crosstalk occurring is extremely low. Conversely, if user 150 has fast movement relative to latency, the rendering result based on time T1 may appear at the eye position of user 150 at time T2, which is far away from the eye position of user 150 at time T1. In this case, the probability of dynamic crosstalk occurring becomes extremely high. Thus, dynamic crosstalk can occur depending on the eye movement speed of user 150 relative to the rayton.

[0066] In one embodiment, by measuring and quantifying the dynamic crosstalk that occurs in the various situations described above, it is possible to provide the user 150 with the optimal 3D image quality.

[0067] The following embodiments primarily describe an example in which a device for measuring dynamic crosstalk (hereinafter referred to as the "measuring device") measures dynamic crosstalk generated by a head-up display (HUD) mounted on a vehicle, but are not necessarily limited to this. For example, the measuring device may also be applied to measure dynamic crosstalk that occurs when combining real and virtual information, such as with augmented reality glasses (AR glasses) and mixed reality (MR) devices. Furthermore, the measuring device may be applied not only to devices that display virtual information, such as augmented reality, virtual reality, and mixed reality devices, but also to 3D display devices such as 3D televisions and 3D monitors.

[0068] Figure 2 shows the structure of a system for measuring dynamic crosstalk according to one embodiment. Referring to Figure 2, the configuration of the system for measuring dynamic crosstalk (hereinafter referred to as the "measurement system") 200 according to one embodiment is shown.

[0069] The measurement system 200 consists of a 3D display system 210, which is the target of dynamic crosstalk measurement, and a measuring device 250, which is the main unit for measuring dynamic crosstalk.

[0070] The 3D display system 210 includes, but is not limited to, an eye-tracking camera 211, a 3D display 213, an eye-tracking module 215, and a 3D rendering module 217.

[0071] The eye-tracking camera 211 may be separately attached to the 3D display 213 as a device for tracking the position of the user's binoculars. Depending on the embodiment, the eye-tracking camera 211 may be included in the 3D display 213. The eye-tracking camera 211 may include, but is not limited to, an eye tracker or sensor. The 3D display 213 can render a stereo pattern image at the position of the user's binoculars located using the eye tracker or sensor. Here, the 3D display 213 may set a small margin for 3D rendering error in the inward (In) direction where the nose is located, and a large margin for 3D rendering error in the outward (Out) direction where the ears are located, relative to the user's binoculars. This is because less crosstalk occurs when the face mask 251 moves outward than when it moves inward.

[0072] The facial image, including the positions of both of the user's eyes, captured by the eye-tracking camera 211 is transmitted to the eye-tracker module 215. The eye-tracker module 215 transmits the coordinates of the user's eyes tracked in the facial image to the 3D rendering module 217. Based on the coordinates of the user's eyes, the 3D rendering module 217 can generate a 3D rendered image (e.g., a stereo pattern image) by 3D rendering the input left-eye / right-eye images 205.

[0073] In one embodiment, dynamic crosstalk can be quantified in a single capture by configuring the input left-eye / right-eye video 205 such that all the video footage used for static crosstalk measurement is present in a single video, with one eye as the reference. Therefore, the input left-eye / right-eye video 205 can be configured so that the video footage captured by the camera 253 for measuring crosstalk is captured as seen by one eye. As will be described in more detail below, the input left-eye / right-eye video 205 may include markers. The markers may be placed, for example, on the edges of the 3D display 213 in the input left-eye / right-eye video 205.

[0074] The measuring device 250 can locate the location of various regions for measuring dynamic crosstalk and / or the region actually displayed on the 3D display 213 through the position of markers included in the stereo pattern image rendered via the 3D display 213.

[0075] In one embodiment, for example, by simultaneously arranging a white image, which is a pattern image for measuring maximum brightness, and a black image, which is a pattern image for measuring minimum brightness, in the input left-eye / right-eye image 205, the measuring device 250 can measure dynamic crosstalk even if it captures the 3D rendering image provided by the 3D display 213 only once with the camera 253.

[0076] The 3D display 213 refers to, but is not limited to, a transparent display for an augmented reality device such as a glasses-free 3D display, a head-up display (HUD), or augmented reality glasses. The 3D display 213 is understood to include all types of displays in which dynamic crosstalk may occur.

[0077] The 3D display 213 shows the left-eye image to the user's left eye and the right-eye image to the user's right eye. To show the corresponding images to the left and right eyes, the 3D display 213 can use a binocular separation device that directs the light generated by the panel in specific directions (for example, directions corresponding to the left and right eyes). The binocular separation device may be, but is not limited to, a lenticular lens or barrier attached to the panel of the 3D display 213.

[0078] The binocular separator may have design parameters such as a specific angle (Slanted Angle), thickness (Thickness), and a constant period width (Pitch), and the right-eye and left-eye images may be generated to match these design parameters. This generation of a right-eye image for the user's right eye and a left-eye image for the user's left eye is called "3D rendering." However, because there is a certain difference between the design values ​​and the manufactured values ​​when manufacturing the binocular separator, when 3D rendering is performed using the design values, the left-eye and right-eye images for the left and right eyes may appear inaccurate. Thus, crosstalk, where part or all of the right-eye image is seen by the left eye, or part or all of the left-eye image is seen by the right eye, can be reduced by using a 3D calibration method that calculates the accurate manufactured values ​​of the binocular separator. The 3D display system 210 can generate a stereo pattern image that matches the position of both eyes using the parameters of the optical layer acquired through 3D calibration. Here, the optical layer may be, for example, a lenticular lens, but is not necessarily limited to this. The parameters of the optical layer may include, for example, the width, inclination, and thickness of the optical layer.

[0079] However, even when accurate manufacturing values ​​are calculated using a 3D calibration method and 3D rendering is performed, due to the optical limitations of the binocular separation device, the right-side image may be seen in the left eye at an extremely small ratio. Thus, 3D calibration must be performed before the crosstalk can be quantified. In one embodiment, it is assumed that 3D calibration is performed based on various publicly available methods, and the specific 3D calibration method will not be described.

[0080] In one embodiment, a camera 253 positioned in front of the 3D display 213 can be placed at the user's (e.g., viewer's) eye level to measure crosstalk.

[0081] In one embodiment, a face mask 251 shaped like a face is attached in front of a camera 253 for measuring crosstalk, and after the camera 253 is positioned at the user's eye location, an eye-tracking camera 211 can locate the eye position using the face mask 251, and a 3D display 213 can 3D render and display an image corresponding to the corresponding eye position.

[0082] The measuring device 250 includes, but is not limited to, a face mask 251, a camera 253, a drive unit 255, and a processor 259.

[0083] The measuring device 250 can be positioned at the optimal viewing distance of the 3D display 213.

[0084] The face mask 251 may be a face model with positions set to correspond to the user's eyes. The face mask 251 may be a mask that includes a face model containing eyes, nose, and mouth, such as the face mask 630 shown in Figure 6B, and has a predetermined distance between the eyes. Here, since at least one eye is open in the face mask 251, the camera 253 positioned at that location can capture the image that the 3D display 213 renders in 3D. In the face mask 251, the distance between the user's eyes (Inter Pupil Distance; IPD) is adjustable, for example, to 60mm, 65mm, and 70mm. An example of the face mask 251 is shown in Figure 6B.

[0085] Camera 253 may be a camera for capturing dynamic crosstalk generated by the 3D display 213. Camera 253 captures the stereo pattern image output via the 3D display 213 of the 3D display system 210 at the position of at least one eye (e.g., the left eye) of the face mask 251. Here, the 3D display 213 is the object of measurement for determining whether or not dynamic crosstalk occurs or for quantifying dynamic crosstalk. In the following explanation, for convenience, an example will be given of the case where the stereo pattern image is captured at the position of the user's left eye, but it is not necessarily limited to this, and the stereo pattern image may be captured at the positions of both the right and left eyes.

[0086] In one embodiment, the camera 253 is positioned to capture a stereo pattern image output via the 3D display 213 at the position of at least one of the user's eyes. For example, the camera 253 may be positioned behind the left eye of the face mask 251 to capture the left eye image of the 3D display. Here, since it is important to keep track of the position of the continuously moving camera 253, the camera 253 can be positioned using, for example, an eye-tracking camera 211 connected to the 3D display system 210. Alternatively, the camera 253 may be positioned at the eye positions displayed on the face-shaped face mask 251 to more accurately align with the eye positions.

[0087] Camera 253 may be an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor, or a CMOS camera, CCD camera, or a luminance meter. Camera 253 may be implemented as a single camera for one of the user's eyes, or as multiple cameras for each of the user's eyes, or as a stereo camera. Camera 253 may be positioned at the optimal viewing position of the 3D display.

[0088] According to one embodiment, in order to measure dynamic crosstalk, it is necessary to know the speed at which the camera 253 moves at the moment it captures the stereo pattern image output from the 3D display 213, thus requiring synchronization between the camera 253 and the drive unit 255. Also, unlike static crosstalk, the direction of movement is important when measuring dynamic crosstalk, so the processor 259 can measure the dynamic crosstalk generated by the 3D display 213 by taking into account the speed and direction of the dynamic movement of the camera 253.

[0089] The drive unit 255 provides dynamic movement to the camera 253. The drive unit 255 may include a motor 256 and a camera moving device 257. The motor 256 provides power to the camera moving device 257 to provide dynamic movement to the camera 253. The camera moving device 257 can use the power provided by the motor 256 to move the camera 253 in a direction and speed that simulates or imitates the user's movements. The drive unit 255 can apply force to the camera 253 so that the camera 253 moves in a constant direction or at a constant speed, or moves in a variable direction and at a variable speed.

[0090] The camera movement device 257 can move the camera 253 at a constant speed in a direction that mimics or imitates the user's movements using power provided by the motor 256 in accordance with the control of the processor 259. In addition, the camera movement device 257 can vary at least one of the direction and speed of the camera 253 that mimics the user's movements, in accordance with the control of the processor 259, so that the camera 253 has dynamic movement.

[0091] The processor 259 extracts multiple regions from the video captured by the camera 253, which reflects dynamic motion, and measures the dynamic crosstalk generated by the 3D display 213. Here, the video captured using the camera 253 may include, for example, a first region corresponding to a first pattern (e.g., white) video for measuring the maximum brightness (e.g., 255), a second region corresponding to a second pattern (e.g., black) video for measuring the minimum brightness (e.g., 0), and a third region corresponding to a third pattern (e.g., black) video for measuring the brightness offset of the 3D display 213.

[0092] The processor 259, for example, detects multiple markers that divide the captured video into multiple regions corresponding to maximum and minimum brightness. Based on the markers, the processor 259 can extract multiple regions and measure dynamic crosstalk based on the brightness values ​​of pixels measured from each of the multiple regions.

[0093] In addition, the processor 259 can extract multiple regions from the video captured by the camera 253 and measure dynamic crosstalk based on the distance between the eyes and their dynamic movement, which are adjusted by the face mask 251.

[0094] In some embodiments, the processor 259 may correct crosstalk based on the position the camera has moved to in response to dynamic movement.

[0095] A more specific method by which processor 259 measures dynamic crosstalk will be explained with reference to Figures 3 and 4 below.

[0096] Figure 3 is a flowchart showing a method for measuring dynamic crosstalk according to one embodiment, and Figure 4 is a diagram illustrating the operation of a device for measuring dynamic crosstalk according to one embodiment. Referring to Figures 3 and 4, the device for measuring dynamic crosstalk according to one embodiment (hereinafter referred to as the "measuring device") can measure dynamic crosstalk through the process of steps S310 to S330.

[0097] In step S310, the measuring device controls the drive unit to cause the camera to have dynamic movement. The camera can capture a stereo pattern image output via a 3D display at the position of at least one of the user's eyes while the camera is moving dynamically. Here, the 3D display may be, but is not limited to, a naked-eye 3D display, a head-up display (HUD), or a transparent display of an augmented reality device such as augmented reality glasses. The 3D display is understood to include all types of displays capable of generating dynamic crosstalk. The 3D display receives the positions of the user's eyes, tracked by, for example, an eye tracker. When the 3D display outputs a stereo pattern image based on the received eye positions, the drive unit of the measuring device can control the camera's movement to have dynamic movement while capturing the stereo pattern image output from the 3D display at the position of at least one of the eyes. Here, the camera may be a camera that captures or measures crosstalk.

[0098] In step S310, the stereo pattern image output via the 3D display includes a left-eye image 410 for the user's left eye and a right-eye image 420 for the user's right eye.

[0099] The measuring device can capture a stereo pattern image composed of a left-eye image 410 and a right-eye image 420 so that dynamic crosstalk can be measured in a single shot. Here, the stereo pattern image may be composed of three regions, for example, as shown in Figure 5A, or four regions, as shown in Figure 5B. The stereo pattern image may include, for example, a first region corresponding to a first pattern image for measuring maximum brightness, a second region corresponding to a second pattern image for measuring minimum brightness, and a third region corresponding to a third pattern image for measuring the brightness offset of the 3D display. Alternatively, the stereo pattern image may include, for example, a first region corresponding to a first pattern image for measuring maximum brightness, a second region corresponding to a second pattern image for measuring minimum brightness, a third region corresponding to a third pattern image for measuring the brightness offset of the 3D display, and a fourth region corresponding to a fourth pattern image for measuring the degree of camera saturation. Various examples of stereo pattern images according to one embodiment are shown below with reference to Figures 5A and 5B.

[0100] Furthermore, the camera may be a single camera for one of the user's eyes, or it may be multiple cameras or a stereo camera, one for each of the user's eyes. The camera may be positioned in an optimal location for viewing the stereo pattern image output via the 3D display (for example, at eye level in front of the 3D display). The camera position may correspond, for example, to the position of at least one eye of a face mask positioned facing the 3D display. The camera may also be adjusted to prevent saturation.

[0101] In step S310, the measuring device can, for example, control the drive unit so that the camera moves at a constant velocity or in a variable direction and / or at a variable velocity, control the drive unit so that it provides the user with dynamic movement at a constant velocity, or control the drive unit so that it provides the camera with dynamic movement in which at least one of the direction and velocity of mimicking the user's movement is variable. Here, the direction of mimicking the user's movement may include, for example, the inward (In) direction from the eyes and the outward (Out) direction from the eyes to the ears, but is not necessarily limited to these. Depending on the environment in which the 3D display is provided, the direction of mimicking the user's movement may further include the up and down direction and / or the six degrees of freedom (DoF) direction, in addition to the left and right directions such as the inward and outward directions described above.

[0102] The measuring device can adjust the distance between the eyes, which are captured using a camera, in order to replicate or imitate the user's movements. The method by which the measuring device controls the drive unit in step S310 will be specifically described with reference to Figures 6A and 6B below.

[0103] In step S320, the measuring device receives the video captured by the camera, which reflects the dynamic movement controlled by the drive unit in step S310. In step S320, the measuring device, for example, takes a stereo pattern video output via the 3D display at the position of at least one eye, taking into account the adjusted distance between the two eyes using the camera that reflects the dynamic movement, and receives the captured video from the camera. More specifically, the measuring device takes a stereo pattern video output via the 3D display at the position of at least one eye in a section in which the camera has dynamic movement at a constant velocity. Here, if the eye-tracking camera finds the position of the eyes using the face mask, and the 3D display 3D renders 430 the video corresponding to the corresponding eye position, the measuring device can capture the 3D rendered video on the 3D display using the camera that reflects the dynamic movement controlled by the drive unit in step S310.

[0104] In some embodiments, the 3D display may, for example, render and display an image corresponding to the eye position in 2D during sections where the camera is moving at a specific speed (e.g., 200 mm / sec) or more, and render and display an image corresponding to the eye position in 3D during sections where the camera is moving at a constant speed below the specific speed.

[0105] According to one embodiment, the speed and / or motion characteristics of the driver's movements may provide a basis for the 3D display to generate images, as described above.

[0106] The measuring device can analyze video footage captured in a section where the camera is moving at a constant velocity and measure dynamic crosstalk. In step S330, the measuring device extracts multiple regions from the video footage received in step S320 and measures the dynamic crosstalk generated by the 3D display. Dynamic crosstalk may be quantified, for example, using the user's left eye as the reference, as shown in the following equation (1).

number

[0107] Here, LWRB L [x, y] represents the brightness values ​​in the LWRB region where a white image is output to the user's left eye and a black image is output to the right eye, and LBRW L [x, y] represents the brightness values ​​of the LBRW region, where a black image is output to the user's left eye and a white image to the right eye, based on the user's left eye. L [x, y] represents the brightness values ​​of the LBRB region where a black image is output to both of the user's eyes, with the user's left eye as the reference point. L [x, y] may be the offset of the 3D display. Here, L represents the left eye, R represents the right eye, W represents the white pattern image, and B represents the black pattern image. Also, x and y indicate the pixel positions in the image captured by the camera used to measure crosstalk.

[0108] Formula (1) shows the ratio of the right eye image to the user's left eye image. The measuring device can calculate the pixel positions corresponding to the screen area of ​​a 3D display using the image captured via formula (1).

[0109] Here, in step S320, the received video may include, for example, a first region corresponding to a first pattern video for measuring maximum brightness, a second region corresponding to a second pattern video for measuring minimum brightness, and a third region corresponding to a third pattern video for measuring the brightness offset of the 3D display. The process by which the measuring device measures dynamic crosstalk will be specifically described with reference to Figures 7 to 9 below.

[0110] In this embodiment, the measuring device can measure and quantify dynamic crosstalk and output a value. Alternatively, the measuring device may correct the dynamic crosstalk based on the position where the camera has moved in response to dynamic movement.

[0111] Figure 5 shows an example of a stereo pattern image according to the embodiment.

[0112] According to one embodiment, a portion of the stereo pattern image may be composed of a 2D pattern, and the remaining portion may be composed of a 3D pattern. For example, the same black pattern can be displayed in one half of the left eye image and the same half of the right eye image, while opposite black-white patterns can be displayed in the other half of the left eye image and the same other half of the right eye image. In this case, the offset can be calculated using the black area in the 2D pattern. Furthermore, the crosstalk generated by the 3D pattern can be calculated based on the offset.

[0113] More specifically, referring to Figure 5A, an example of a stereo pattern image is shown in which the positions of the LWRB region, LBRW region, and LBRB region are changed according to the embodiment.

[0114] The stereo pattern image may include, for example, a left-eye image divided into three regions such as the 1-1 region on the upper right side of the first size for the left eye, the 1-2 region on the lower right side of the first size, and the 1-3 region on the left side of the second size which is larger than the first size, and a right-eye image similarly divided into three regions such as the 2-1 region on the upper right side of the first size for the right eye, the 2-2 region on the lower right side of the first size, and the 2-3 region on the left side of the second size for the right eye. Here, the 1-1 region corresponds to the 2-1 region, the 1-2 region corresponds to the 2-2 region, and the 1-3 region corresponds to the 2-3 region. Furthermore, the 1-1 and 1-2 regions may contain pattern images with different brightness levels, while the 1-3 region may contain a pattern image with the same brightness level as the pattern image corresponding to either the 1-1 or 1-2 region. Furthermore, different combinations of brightness patterns may be placed in each of the 1-1 and 2-1 regions, and in each of the 1-2 and 2-2 regions, while the 1-3 and 2-3 regions may be placed with the same brightness pattern. Here, "placement of images with different combinations of brightness" is understood to mean, for example, that images with different brightness levels are placed in the 1-1 region (maximum brightness image) and the 2-1 region (minimum brightness image), and that images with different brightness levels are placed in the 1-2 region (minimum brightness image) and the 2-2 region (maximum brightness image).

[0115] In Figure 5A, 0-L and 0-R are stereo pattern images representing pairs of inputs for the left and right eyes. 1-L and 1-R correspond to stereo pattern images in which a portion of 1-L is arranged as Black (left side), White (lower right side), and Black (upper right side), and a portion of 1-R is arranged as Black (left side), White (upper right side), and Black (lower right side).

[0116] In one embodiment, eight pairs of stereo pattern images shown in Figure 5A may be used to measure dynamic crosstalk. Here, the conditions for the stereo pattern images would include a form of image pattern that allows for the measurement of the offset of the 3D display by measuring the maximum brightness once with the left eye and the minimum brightness once after 3D rendering.

[0117] In the 0-L and 0-R images, the black area on the left is for measuring the offset, and the area on the right where black and white intersect is for measuring the maximum brightness and minimum luminance values. Unlike static crosstalk, where the user's eye is fixed and various images must be captured and measured over time, dynamic crosstalk is difficult to measure because the measurement position changes if various images are captured over time.

[0118] Therefore, in one embodiment, dynamic crosstalk can be measured by capturing everything (e.g., maximum brightness, minimum brightness, and 3D display offset) in a single image. In one embodiment, after measuring crosstalk using each of the stereo pattern images, the dynamic crosstalk can be measured by calculating the average according to the camera's movement speed. The circular markers included in the stereo pattern image shown in Figure 5A will be specifically described with reference to Figures 7 to 9 below.

[0119] Alternatively, according to one embodiment, instead of displaying only a single black pattern in the 2D pattern that constitutes a part of the stereo pattern image, a black-white pattern can be displayed. For example, the same black-white pattern can be displayed in one half of the left eye image and the same half of the right eye image, while opposite black-white patterns can be displayed in the other half of the left eye image and the same other half of the right eye image. In this case, the offset can be calculated using the black area in the 2D pattern, and the saturation can be calculated using the white area in the 2D pattern. Furthermore, crosstalk generated by the 3D pattern can be calculated based on the offset and saturation.

[0120] More specifically, referring to Figure 5B, an example of a stereo pattern image is shown in which the left eye image 510 and the right eye image 530 are each divided into four regions. Depending on the embodiment, the marker may be a rectangle as shown in Figure 5B.

[0121] Depending on the embodiment, the left eye image 510 of the stereo pattern image may include a black pattern image in the 1-1 region of the upper left section 511 and the 1-3 regions of the lower right section, and a white pattern image in the 1-2 region of the lower left section 513 and the 1-4 regions of the upper right section. Similarly, the right eye image 530 of the stereo pattern image may include a black pattern image in the 2-1 region of the upper left section 531 and the 2-4 regions of the upper right section, and a white pattern image in the 2-2 region of the lower left section 533 and the 2-3 region of the lower right section.

[0122] Here, the black pattern image in the upper left (511) is for measuring the offset of the 3D display, and the white pattern image in the lower left (513) is for measuring the degree of camera saturation. If saturation occurs in the image acquired by the camera during crosstalk measurement, errors may occur.

[0123] In one embodiment, to measure the degree of camera saturation, the lower left region 513 of the left eye image 510 or the lower left region 533 of the right eye image 530 is detected to check the average value of the pixels. If the average value is higher than a specific brightness (e.g., 250), the camera gain is lowered to prevent measurement errors caused by camera saturation.

[0124] Figure 6 illustrates a method for controlling a drive unit that provides dynamic motion to a camera according to one embodiment. Referring to Figure 6A, stereo pattern images 610, 620 captured by cameras having different constant velocity dynamic motions are shown, and referring to Figure 6B, multiple face masks 660 with different arrangements of face masks 630 and cameras 640, and different pupil distances are shown.

[0125] In one embodiment, to measure dynamic crosstalk, for example, the face mask 630 shown in Figure 6B can be provided with dynamic movement in a specific direction and / or at a specific speed. When the face mask 630 is given dynamic movement, a camera 640 attached behind the left eye of the face mask 630 can capture an image seen by the user's left eye. If saturation occurs in the camera 640, an error will occur during crosstalk measurement; therefore, the measuring device can adjust the input of the camera 640 to prevent saturation.

[0126] The measuring device can measure dynamic crosstalk in the section in which the camera 640 is moving at a constant velocity. To this end, the camera moving device 650 that provides dynamic motion to the camera 640 may initially accelerate with a motor, and then decelerate to stop at a constant velocity from a certain position. In this case, the measuring device can measure crosstalk when the camera 640 is moving at a constant velocity without measuring crosstalk during acceleration and deceleration for the dynamic motion of the camera 640.

[0127] Referring to Figure 6A, stereo pattern image 610 is shown when camera 640 is moving at a constant speed of 20 mm / sec, and stereo pattern image 620 is shown when camera 640 is moving at a constant speed of 260 mm / sec.

[0128] In stereo pattern image 610, the upper right and lower right sections were captured with sharp white and sharp black, respectively. However, in stereo pattern image 620, it is shown that crosstalk occurred in the upper right and lower right sections, resulting in dark white and bright black. In other words, if camera 640 has high-speed dynamic movement, dynamic crosstalk can occur due to the aforementioned delay.

[0129] In one embodiment, dynamic crosstalk can be measured by controlling the camera moving device 650 so that the speed of movement of the face-shaped face mask 630, in other words, the dynamic movement speed of the camera 640 attached to the face mask 630, can be changed, for example, from 20 mm / sec to 260 mm / sec. The measuring device can use a motor to control the camera moving device 650 so that it moves at a uniform speed.

[0130] Furthermore, the measuring device can measure dynamic crosstalk by controlling the camera movement device 650 to provide dynamic movement with varying directions in addition to the speed of the dynamic movement. Since dynamic crosstalk can be measured differently depending on the direction of the dynamic movement, the measuring device can measure dynamic crosstalk by controlling the camera movement device 650 so that the camera moves in the medial margin direction 1 from the user's eyes toward the nose and in the lateral margin direction 2 from the user's eyes toward the ears.

[0131] Alternatively, the measuring device can measure dynamic crosstalk by varying the distance between the two eyes, for example, 60 mm, 65 mm, and 70 mm, as shown in the face mask 660 in Figure 6B below.

[0132] Figure 7 is a flowchart showing the process of measuring dynamic crosstalk according to one embodiment. Referring to Figure 7, the process of measuring dynamic crosstalk by a measuring device according to one embodiment is shown through steps S710 to S730.

[0133] In step S710, the measuring device detects markers from the video received in step S320, indicating multiple regions corresponding to the maximum and minimum brightness levels, respectively. The method by which the measuring device detects the markers will be explained in detail with reference to Figure 8 below.

[0134] In step S720, the measuring device extracts multiple regions based on the marker detected in step S710. The method by which the measuring device extracts multiple regions will be explained in more detail with reference to Figure 9 below.

[0135] In step S730, the measuring device measures dynamic crosstalk based on the brightness values ​​of pixels measured from each of the multiple regions extracted in step S720. The measuring device may, for example, average the dynamic crosstalk measured in step S730 according to the velocity of the dynamic motion and output the average value as the dynamic crosstalk measurement result.

[0136] In one embodiment, when the camera captures a left-eye image provided to the user's left eye and a right-eye image provided to the user's right eye, the measuring device can detect markers that divide multiple regions in each of the left-eye and right-eye images, and then measure dynamic crosstalk based on statistical values ​​of the brightness values ​​of pixels measured from each of the multiple regions extracted based on the markers. The statistical values ​​may include, but are not limited to, the mean, variance, and standard deviation.

[0137] Figure 8 illustrates an example of detecting markers that divide an image captured by one embodiment into multiple regions. Referring to Figure 8, we see the input left eye image 810 including the marker 815, the input right eye image 830, and the left eye camera image 850 which captures the input left eye image and the input right eye image at the position of the user's left eye.

[0138] The marker 815 may have a circular shape, for example, as shown in Figure 8, with a black interior and a white edge. The marker 815 may also have various other shapes, such as a square, triangle, or star shape, but is not necessarily limited to these.

[0139] The measuring device may detect the marker 815 using, for example, image processing, pattern recognition, or deep learning. The measuring device can detect the marker 815 by pre-recognizing its pattern or by pre-training it and identifying the marker 815 contained in the input images 810 and 830 using a neural network.

[0140] The measuring device can divide the input video 810, 830 received by the marker 815 into multiple regions corresponding to the maximum brightness and minimum brightness, respectively.

[0141] Marker 815 may also be used to locate the area to be actually displayed on the 3D display. Marker 815 may also be used to locate the LWRB region, where a white image is output to the user's left eye and a black image to the right eye; the LBRW region, where a black image is output to the user's left eye and a white image to the right eye; and the LBRB region, where a black image is output to both eyes of the user.

[0142] The marker 815 may be positioned, for example, on the edge of the 3D display in the input left-eye image 810 and the input right-eye image 830. Thus, the measuring device can locate the edge of the 3D display indicated by the dotted line in the left-eye camera image 850 using the marker 815.

[0143] Furthermore, the measuring device uses a marker 815 to output a white image to the user's left eye via the left eye camera image 850, and a black image to the right eye, using LWRB (Light-Wide Range Biometry). L The system uses LBRW (Light-Blocked-Light) technology, where a black image is output to the user's left eye and a white image to their right eye. L LBRB (Light Blocking Relay) outputs a black image to both of the user's eyes. L You can search for regions.

[0144] Here, the region delimited by the marker 815 is the region for measuring crosstalk among the 3D display screen regions, and is the range for measuring crosstalk in the mathematical formula for measuring crosstalk.

[0145] When the input left-eye video 810 and the input right-eye video 830 are 3D-rendered, in the actual 3D display screen, a part of the left, right, upper, and lower parts may be cut off and not visible like the left-eye camera video 850. Therefore, in one embodiment, the actual display region is set using the marker 815, and the video captured by the camera for measuring crosstalk (for example, the left-eye camera video 850) is analyzed to measure the dynamic crosstalk.

[0146] The measuring device, for example, applies the brightness values of each region (for example, the LWRB L region, the LBRW L region, and the LBRB L region) found in the left-eye camera video 850 to the above-described mathematical formula (1) to measure crosstalk.

[0147] FIG. 9 is a diagram for explaining a method of extracting a plurality of regions according to one embodiment. Referring to FIG. 9, using the center point of the marker detected by referring to FIG. 8, a plurality of regions LWRB L , LBRW L , LBRB L extracted from the left-eye camera video 930 are shown.

[0148] The process by which the measuring device detects the marker and extracts a plurality of regions will be more specifically described as follows.

[0149] The measuring device removes noise from the left-eye camera video 930 captured by the camera (for example, camera 253) that captures the dynamic crosstalk. The measuring device can remove noise from the captured left-eye camera video 930 through filtering by a filter such as an average value filter, a Gaussian filter, and a median filter.

[0150] The measuring device may perform image processing such as adaptive binarization and edge enhancement to more effectively find markers contained in the noise-removed image. Here, adaptive binarization is a method that binary-evolves the value of each pixel in the image to 0 or 1 using an adaptively determined threshold. Edge enhancement is a process to improve the discernibility of edges in the image, and is a method that has a certain directionality and emphasizes the regional contrast effect of light and dark.

[0151] The measuring device can detect circular markers from images in which the marker morphology has been processed more clearly through binary evolution and edge enhancement methods.

[0152] The measuring device can align the detected markers by region. Here, LWRB L Markers belonging to range1, which corresponds to a region, are aligned as follows, for example, 1-8-9-2, based on the position of the marker placed in the input left eye image 910, and LBRW L Markers belonging to range2, which corresponds to a region, may be arranged as 1-2-3-4. Also, LBRB L The markers belonging to range3, which correspond to a region, may be arranged as follows: 1-4-5-6 and 1-6-7-8.

[0153] The measuring device uses the center points of markers aligned for each region to measure multiple regions (e.g., LWRB) L area, LBRW L Region, and LBRB L The region can be separated and measured.

[0154] Dynamic crosstalk according to one embodiment can be measured, for example, by the following equation (2).

number

[0155] The aforementioned formula (1) applies when the LWRB, LBRW, and LBRB regions are all identical. When measuring dynamic crosstalk, since the three regions are all different from each other, dynamic crosstalk can be measured using the average value of the brightness values ​​measured for each region, as shown in formula (2).

[0156] The measuring device according to one embodiment may be used as a reference tool to evaluate the performance of the HUD module during mass production by measuring dynamic crosstalk as described above. Furthermore, according to one embodiment, the eye-tracking prediction performance of the eye-tracking camera can also be quantitatively evaluated from the perspective of crosstalk by measuring dynamic crosstalk while changing the spacing between the eyes of the mask.

[0157] Figure 10 is a block diagram of a device for measuring dynamic crosstalk according to one embodiment. Referring to Figure 10, the device for measuring dynamic crosstalk according to one embodiment (hereinafter referred to as the "measuring device") 1000 includes a face mask 1010, a camera 1030, a drive unit 1050, a processor 1070, and a memory 1090.

[0158] The face mask 1010 may be positioned in front of the camera 1030 as a mask with positions set to correspond to the user's eyes.

[0159] Camera 1030 captures a stereo pattern image output via a 3D display at the position of at least one eye on the face mask. Here, the 3D display may be a measurement target for determining the presence or absence of dynamic crosstalk or for quantifying dynamic crosstalk. The 3D display may be, but is not limited to, a naked-eye 3D display, a head-up display (HUD), or a transparent display of an augmented reality device such as augmented reality glasses. The term 3D display may be understood to include all types of displays in which dynamic crosstalk can occur. Camera 1030 may be an image sensor such as a CMOS sensor or a CCD sensor, or it may be a CMOS or CCD camera. Camera 1030 may be a single camera for one of the user's eyes, or it may be multiple cameras or a stereo camera for each of the user's eyes. Camera 1030 may be positioned at the optimal viewing position of the 3D display. Camera 1030 can also be adjusted to prevent saturation.

[0160] The drive unit 1050 causes the camera 1030 to have dynamic movement. The drive unit 1050 may include a motor 1053 and a camera moving device 1056. The motor 1053 can provide power to give the camera 1030 dynamic movement. The camera moving device 1056 can move the camera 1030 in a direction and speed that mimics the user's movement using the power provided by the motor 1053. The drive unit 1050 can apply force to the camera 1030 so that it moves in a fixed direction and at a fixed speed, or in a variable direction and at a variable speed.

[0161] The processor 1070 extracts multiple regions from the image captured by the camera 1030, which reflects the dynamic motion provided by the drive unit 1050, and measures the dynamic crosstalk generated by the 3D display. However, the operation of the processor 1070 is not limited to that described above, and the processor 1070 may perform the above-described operation in conjunction with at least one of the operations described above, with reference to Figures 1 to 9.

[0162] Processor 1070 is a measuring device embodied in circuitry-equipped hardware having a physical structure for performing a desired operation. For example, the desired operation may include code or instructions contained in a program. For example, the measuring device embodied in hardware may include a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), a processor core, a multi-core processor, a multiprocessor, an ASIC (Application-Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), an NPU (Neural Processing Unit), and the like.

[0163] The processor 1070 executes a program and controls the measuring device 1000. The program code executed by the processor 1070 may be stored in the memory 1090.

[0164] Memory 1090 stores stereo pattern images captured by camera 1030 at the position of at least one of the user's eyes. Memory 1090 also stores dynamic crosstalk generated by the 3D display as measured by processor 1070. Memory 1090 may also store a quantified value of the dynamic crosstalk measured by processor 1070.

[0165] Figure 11 is a block diagram of a crosstalk inspection device according to one embodiment. Referring to Figure 11, the crosstalk inspection device 1100 according to one embodiment includes at least one camera 1110, a drive unit 1130, and a processor 1150. The crosstalk inspection device 1100 may further include a memory 1170 and a communication interface 1190. The at least one camera 1110, the drive unit 1130, the processor 1150, the memory 1170, and the communication interface 1190 are connected via a communication bus 1105.

[0166] At least one camera 1110 captures a stereo pattern image, output via a head-up display (HUD) corresponding to the object being inspected, at the position of at least one of the user's eyes. The head-up display can form a projection plane on which a virtual image is formed by projection onto a glass window positioned in front of the user.

[0167] The drive unit 1130 ensures that at least one camera 1110 has dynamic movement. Although not shown, the drive unit 1130 may include a motor that provides power to give motion to at least one camera 1110, and a camera moving device that moves the camera in a direction and at a speed that mimics the user's movements using the power provided by the motor.

[0168] The processor 1150 extracts multiple regions from images captured by at least one camera 1110 that reflects dynamic motion, and measures the dynamic crosstalk generated by the head-up display. However, the operation of the processor 1150 is not limited to the above, and the processor 1150 may perform the above operations in conjunction with at least one of the operations described above, as shown in Figures 1 to 11.

[0169] The processor 1150 may be a measuring device embodied in hardware having a circuit with a physical structure for performing a desired operation. For example, the desired operation may include code or instructions included in a program. For example, the correction device embodied in hardware may include a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), a processor core, a multi-core processor, a multiprocessor, an ASIC (Application-Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), an NPU (Neural Processing Unit), and the like.

[0170] The processor 1150 can execute a program and control the crosstalk inspection device 1100. The program code executed by the processor 1150 may be stored in memory 1170.

[0171] Memory 1170 stores video footage captured by at least one camera 1110. Memory 1170 may also store dynamic crosstalk measured by processor 1150.

[0172] The communication interface 1190 can transmit the dynamic crosstalk measured by the lossr 1150 to other devices or output it to the crosstalk inspection device 1100.

[0173] The embodiments described above are embodied in hardware components, software components, or combinations of hardware and software components. For example, the devices and components described in this embodiment are embodied using one or more general-purpose or special-purpose computers, such as a processor, controller, ALU (arithmetic logic unit), digital signal processor, microcomputer, FPA (field programmable array), PLU (programmable logic unit), microprocessor, or different devices that execute and respond to instructions. The processing device can run an operating system (OS) and one or more software applications run on the OS. The processing device can also access, store, manipulate, process, and generate data in response to software execution. For convenience of understanding, the processing device may sometimes be described as being used as a single unit, but a person with ordinary skill in the art will see that the processing device includes multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0174] Software includes computer programs, code, instructions, or a combination of one or more of these, which can configure a processing unit to operate as desired, or instruct the processing unit independently or in combination. Software and / or data can be permanently or temporarily embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, for interpretation by the processing unit or for providing instructions or data to the processing unit. Software can be distributed across a network of computer systems and stored and executed in a distributed manner. Software and data can be stored on a recording medium readable by one or more computers.

[0175] The method according to this embodiment is embodied in the form of program instructions that are implemented via various computer means and recorded on a computer-readable recording medium. The recording medium includes program instructions, data files, data structures, etc., individually or in combination. The recording medium and program instructions may be specifically designed and configured for the purposes of the present invention, or they may be known and usable by those skilled in the art who have technology in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and hardware devices specifically configured to store and execute program instructions, such as ROMs, RAMs, and flash memory. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operations shown in the present invention, and vice versa.

[0176] As described above, although embodiments have been illustrated with limited drawings, a person with ordinary skill in the art can apply various technical modifications and variations based on the above description. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or assembled in a different manner than described, or replaced or substituted with other components or equivalents, and still achieve suitable results.

[0177] Therefore, the scope of the present invention is not limited to the disclosed embodiments, but is defined by the claims and equivalents thereof. [Explanation of symbols]

[0178] 1000: Crosstalk measuring device 1010: Face mask 1030: Camera 1050: Drive unit 1070: Processor 1190: Memory

Claims

1. The steps include controlling a drive unit configured to have dynamic movement of the camera, The steps include capturing a stereo pattern image output via a 3D display by the camera while the camera is dynamically moving at either the position of the user's left eye or the position of their right eye, or both; The step includes measuring dynamic crosstalk occurring in the 3D display based on a stereo pattern image captured by the camera, The 3D display includes an eye-tracker or sensor configured to detect the position of the user's left eye and right eye, The 3D display is configured to apply rendering to the positions of stereo pattern images corresponding to the positions of the user's left and right eyes. A method for measuring dynamic crosstalk.

2. The step of measuring the dynamic crosstalk is: The steps include detecting a plurality of markers in the captured stereo pattern image that indicate a plurality of regions of the captured stereo pattern image corresponding to the maximum brightness and the minimum brightness, respectively, A step of extracting the multiple regions based on the multiple markers, The step of measuring the dynamic crosstalk based on the brightness values ​​of pixels measured from each of the plurality of regions, A method for measuring dynamic crosstalk as described in claim 1.

3. The method for measuring dynamic crosstalk according to claim 1 or 2, wherein the step of measuring the dynamic crosstalk includes the step of averaging the dynamic crosstalk according to the velocity of the dynamic motion.

4. When the camera captures the stereo pattern image and the left-eye image provided to the user's left eye and the right-eye image provided to the user's right eye, The step of measuring the dynamic crosstalk is: The steps include detecting a plurality of markers that divide the left eye image and the right eye image into the plurality of regions, A step of extracting the multiple regions based on the multiple markers, The step of measuring the dynamic crosstalk based on statistical values ​​for the brightness values ​​of pixels measured from each of the plurality of regions, A method for measuring dynamic crosstalk according to claim 2 or claim 3 as referenced from claim 2.

5. A method for measuring dynamic crosstalk according to any one of claims 1 to 4, wherein the step of controlling the drive unit includes the step of controlling the drive unit so that the camera moves in various directions at a constant speed.

6. The step of controlling the drive unit is: The steps include controlling the drive unit so that the camera moves in a direction and at a speed that mimics the user's movements, The step includes adjusting the distance between the eyes of a face mask positioned toward the 3D display, A method for measuring dynamic crosstalk according to any one of claims 1 to 4.

7. A method for measuring dynamic crosstalk according to any one of claims 1 to 6, wherein the position of the camera corresponds to the position of at least one eye of a face mask positioned facing the 3D display.

8. A method for measuring dynamic crosstalk according to any one of claims 1 to 7, further comprising the step of capturing a stereo pattern image based on the pupillary distance of a face mask arranged toward the 3D display at either the position of the user's left eye or the position of their right eye or both.

9. The step of capturing the stereo pattern image includes capturing the stereo pattern image at regular intervals while the camera is moving at a constant speed, The step of measuring the dynamic crosstalk includes the step of measuring the dynamic crosstalk by analyzing the stereo pattern image captured while the camera is moving at the constant velocity, A method for measuring dynamic crosstalk according to claim 8.

10. A method for measuring dynamic crosstalk according to any one of claims 1 to 9, further comprising the step of correcting the dynamic crosstalk based on the position to which the camera has moved in response to the dynamic movement.

11. A method for measuring dynamic crosstalk according to any one of claims 1 to 10, wherein the stereo pattern image captured by the camera includes a first region corresponding to a first pattern image for measuring maximum brightness, a second region corresponding to a second pattern image for measuring minimum brightness, and a third region corresponding to a third pattern image for measuring brightness offset of the 3D display.

12. A method for measuring dynamic crosstalk according to any one of claims 1 to 11, wherein the 3D display generates the stereo pattern image that matches the position of the user's left eye and right eye based on the parameters of the optical layer acquired via 3D calibration.

13. A method for measuring dynamic crosstalk according to any one of claims 1 to 12, wherein the 3D display includes at least one of a head-up display, a 3D digital information display, a navigation device, a 3D mobile device, a smartphone, a smart TV, a smart vehicle, an IoT device, a medical device, and a measuring device.

14. The aforementioned stereo pattern video is A 2D pattern that displays a single-color pattern identically to both the left and right eyes, The 3D pattern includes a color pattern that is inversely contrasted with the left and right eyes of the user, A method for measuring dynamic crosstalk according to any one of claims 1 to 13.

15. The aforementioned stereo pattern video is A 2D pattern that displays a pattern of multiple contrasting colors identically to the left and right eyes, Includes a 3D pattern that displays the contrasting color patterns in reverse for the user's left and right eyes, A method for measuring dynamic crosstalk according to any one of claims 1 to 13.

16. A computer program stored on a computer-readable recording medium, which, in combination with hardware, causes the method described in any one of claims 1 to 15 to be performed.

17. A face mask in which the position of the left eye and the position of the right eye of the face mask correspond to the position of the user's left eye and the position of the right eye, A camera that captures a stereo pattern image output via a 3D display at either the left eye position or the right eye position or both of the face mask, A drive unit that causes the camera to have dynamic movement, An eye tracker or sensor for finding the position of the user's eyes, The camera includes a processor that measures dynamic crosstalk generated by the 3D display based on the stereo pattern captured by the camera while it is moving in response to the dynamic movement of the camera, The 3D display applies the rendering position of the stereo pattern image corresponding to the positions of the user's eyes detected using the eye tracker or the sensor. A device for measuring dynamic crosstalk.

18. The apparatus for measuring dynamic crosstalk according to claim 17, wherein the processor detects a plurality of markers indicating a plurality of regions of the captured stereo pattern image corresponding to the maximum brightness and minimum brightness, respectively, extracts the plurality of regions based on the plurality of markers, and measures the dynamic crosstalk based on the brightness values ​​of pixels measured from each of the plurality of regions.

19. The aforementioned processor, When the camera captures the left-eye image provided to the user's left eye and the right-eye image provided to the user's right eye in the stereo pattern image, The left eye image and the right eye image are each divided into a plurality of regions by a plurality of markers, the plurality of regions are extracted based on the plurality of markers, and the dynamic crosstalk is measured based on statistical values ​​of the brightness values ​​of pixels measured from each of the plurality of regions. The apparatus for measuring dynamic crosstalk according to claim 18.

20. The apparatus for measuring dynamic crosstalk according to any one of claims 17 to 19, wherein the processor further corrects the dynamic crosstalk based on the position to which the camera has moved in response to the dynamic movement.

21. The apparatus for measuring dynamic crosstalk according to any one of claims 17 to 20, wherein the captured stereo pattern image includes a first region corresponding to a first pattern image for measuring maximum brightness, a second region corresponding to a second pattern image for measuring minimum brightness, and a third region corresponding to a third pattern image for measuring brightness offset of the 3D display.

22. The aforementioned drive unit is The camera is powered by a motor that provides power to enable the camera to perform the dynamic movement described above. A camera moving device that moves the camera in the direction and speed determined by the power in order to mimic the movements of the user, An apparatus for measuring dynamic crosstalk according to any one of claims 17 to 21.

23. The device for measuring dynamic crosstalk according to claim 22, wherein the processor controls the camera moving device to move the camera at a constant speed.

24. The device for measuring dynamic crosstalk according to claim 22, wherein the processor controls the camera moving device to change either the direction or the velocity of the camera.

25. In the aforementioned face mask, the distance between the left eye and the right eye is adjustable. The processor extracts the multiple regions from the captured stereo pattern image and measures the dynamic crosstalk based on the inter-eye distance adjusted by the face mask and the dynamic movement. A device for measuring dynamic crosstalk according to any one of claims 18, 19, 20 when dependent on claim 18 or 19, 21 when dependent on any one of claims 18 to 20, 22 when dependent on any one of claims 18 to 21, 23, or 24.

26. The apparatus for measuring dynamic crosstalk according to any one of claims 17 to 25, wherein the 3D display generates the stereo pattern image that is matched to the position of the user's eyes based on the parameters of the optical layer acquired via 3D calibration.

27. The aforementioned stereo pattern video is A 2D pattern that displays the same monochrome pattern to the left and right eyes of the user, Includes a 3D pattern that displays a color pattern that is inversely contrasted with the user's left and right eyes, An apparatus for measuring dynamic crosstalk according to any one of claims 17 to 26.

28. The aforementioned stereo pattern video is A 2D pattern showing a color pattern that is identically contrasted to the user's left and right eyes, The 3D pattern includes the display of the contrasting color patterns in reverse for the user's left and right eyes, An apparatus for measuring dynamic crosstalk according to any one of claims 17 to 26.

29. The apparatus for measuring dynamic crosstalk according to any one of claims 17 to 28, wherein the 3D display includes at least one of a head-up display, a 3D digital information display, a navigation device, a 3D mobile device, a smartphone, a smart TV, a smart vehicle, an IoT device, a medical device, and a measuring device.

30. At least one camera that captures a stereo pattern image output via a head-up display at either the position of the user's left eye or the position of their right eye, or both; A drive unit that causes at least one of the cameras to have dynamic movement, An eye tracker or sensor for finding the position of the user's eyes, The system includes a processor that measures dynamic crosstalk generated by the head-up display based on a stereo pattern image captured by the at least one camera while the at least one camera is moving in response to the dynamic motion, The head-up display applies the rendering position of the stereo pattern image corresponding to the position of the user's eyes, as detected using the eye tracker or the sensor. Crosstalk testing device.

Images