Naked eye 3D real-time human eye pupil distance measuring and adjusting method
By real-time measurement and dynamically adjusting the user's pupil distance, the naked-eye 3D device can adjust the image output parameters according to individual needs, solving the problem of inaccurate display effects in the prior art, and significantly improving the comfort and accuracy of 3D display.
Patent Information
- Application Number
- CN202411839618.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-13
- Publication Date
- 2025-01-14
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing naked-eye 3D devices cannot accurately adjust image parameters based on the pupil distance of different users, resulting in limited accuracy and comfort of display effects.
By obtaining the user's eye image data in real time, identifying the center of the pupil, calculating the pupil distance between the left and right eyes, and dynamically adjusting the image output parameters of the naked eye 3D display device, including parallax and optical distortion compensation, to ensure personalized display effect match.
It significantly improves the comfort and accuracy of the 3D display effect, enhances the user's immersion, and ensures the consistency of the display effect at different viewing angles and gaze areas.
Smart Images

Figure CN119316583A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of naked-eye 3D display, and in particular to a real-time human eye pupil distance measurement and adjustment method for naked-eye 3D. Background Art
[0002] With the development of naked-eye 3D display technology, more and more devices and applications have begun to adopt this technology to enhance the user's visual experience. Naked-eye 3D display technology renders images at different angles on the display screen, so that the left and right eyes see slightly different images, thereby creating depth perception and giving the user a stereoscopic effect. However, the effect of naked-eye 3D display is extremely dependent on the user's pupil distance, that is, the physical distance between the left and right eyes. Different users have different pupil distances, and the image parameters of the display device (such as parallax, viewing angle, etc.) need to be adapted according to the pupil distance of each user.
[0003] However, most naked-eye 3D devices on the market currently fail to effectively solve this problem. They can usually only provide general display effects through fixed preset parameters and cannot be accurately adjusted according to the pupil distance of different users, thus affecting the accuracy and comfort of the display effect. Therefore, a real-time human eye pupil distance measurement and adjustment method for naked-eye 3D is proposed to solve the limitations of existing technologies in practical applications. Summary of the invention
[0004] Based on the above purpose, the present invention provides a method for measuring and adjusting the pupil distance of a human eye in real time for naked-eye 3D.
[0005] A method for measuring and adjusting the pupil distance of a human eye in real time for naked eye 3D, comprising the following steps: S1: using an image acquisition device to obtain eye image data of a user in real time, wherein the eye image data includes image information of a pupil area of at least one eye; S2: Based on the eye image data collected by S1, an image processing algorithm is used to identify the center position of the pupil; S3: Calculate the pupil distance between the left and right eyes according to the pupil center position identified in S2; S4: adjusting the image output parameters of the naked-eye 3D display device according to the pupil distance calculated in S3 to adapt it to the pupil distance of the user; S5: Track the user's eye movement information in real time, and dynamically correct the pupil distance calculation result according to the user's gaze area to ensure that the naked-eye 3D display device continues to adapt to the user's pupil distance requirements.
[0006] Optionally, the S1 specifically includes: S11: selecting an image acquisition device with a resolution of at least 3 million pixels, wherein the image acquisition device includes an infrared or near-infrared light source and a corresponding high-resolution camera; S12: starting the infrared or near-infrared light source in the image acquisition device to illuminate the eye area of the user, wherein the wavelength of the infrared light source is set between 850nm and 950nm to reduce the interference of ambient light on image acquisition; S13: Start the image acquisition device, and take real-time photos of the user's eyes with a high-resolution camera to obtain eye image data of the pupil area of at least one eye.
[0007] Optionally, the S2 specifically includes: S21: preprocessing the eye image data collected in S1, specifically using a Gaussian filter algorithm to denoise the image and enhance the edge features of the pupil area; and adjusting the contrast and brightness of the image to enhance the contrast between the pupil area and the eyeball background; S22: Use the Canny edge detection algorithm to perform edge detection on the preprocessed image and extract edge information of the pupil area; S23: Based on the edge information in S22, a Hough transform algorithm is used to perform circular fitting on the edge of the pupil, and the circular boundary of the pupil is identified by mapping the two-dimensional edge points to the parameter space to obtain the coordinates of the center of the circle and the radius; S24: Based on the circle center coordinates obtained in S23, determine the center position of the pupil, which is the center position of the pupil of the user's eye.
[0008] Optionally, the S22 specifically includes: S221: performing gradient calculation on the preprocessed image, filtering the image in the horizontal and vertical directions using the Sobel operator, and calculating the gradient of the image in the x-axis and y-axis directions; S222: Calculate the gradient amplitude of each pixel based on the gradient calculation results in the x-axis and y-axis directions and the gradient direction ; S223: performing non-maximum suppression on the calculated gradient amplitude map, retaining the local maximum value, and removing non-edge points; S224: Based on the set high and low thresholds, dual threshold detection is used to perform edge detection on the image; specifically setting the high threshold and low threshold , for gradient magnitudes greater than , marked as a strong edge; for the pixel point with a gradient amplitude between and If the pixel between is connected to a strong edge pixel, it is marked as an edge; otherwise, it is suppressed as a non-edge; the final edge information is obtained through double threshold detection.
[0009] Optionally, the S23 specifically includes: S231: Using the Hough transform algorithm to perform circle fitting on the edge information extracted in S22, by mapping each edge point in the image space to the parameter space to detect the parameters of the circle; S232: For each edge point in the image, calculate the coordinates of all circle centers in the parameter space. and radius , and for each group Voting; the voting value represents the frequency of occurrence of the circle corresponding to the parameter combination; the specific calculation formula is: and ,in, and are the coordinates of the edge points, is the gradient direction of the edge point, is the current radius, and is the coordinate of the center of the circle; S233: Based on the accumulated voting results, select the one with the highest accumulated voting value The parameter combination is the center coordinates and radius of the best fitting circle.
[0010] Optionally, the S3 specifically includes: S31: According to the left and right pupil center positions identified in step S2, the left eye pupil center coordinates and the right eye pupil center coordinates are obtained respectively, and the left eye pupil center coordinates are set to , the coordinates of the right eye pupil center are ; S32: Calculate the distance between the pupil centers of the left and right eyes in the horizontal axis direction, using the formula: ,in, and The center of the pupil of the left and right eyes coordinate, is the horizontal distance between the pupil centers of the left and right eyes; S33: Calculate the distance between the pupil centers of the left and right eyes in the vertical axis direction. The formula is: ,in, and The center of the pupil of the left and right eyes coordinate, is the vertical distance between the pupil centers of the left and right eyes; S34: Based on the horizontal and vertical distances calculated in S32 and S33, the distance between the left and right pupils is calculated using the Pythagorean theorem. The formula is: ,in, is the distance between the pupil centers of the left and right eyes, is the horizontal distance, is the vertical distance.
[0011] Optionally, the S4 specifically includes: S41: Obtaining default image output parameters of the naked-eye 3D display device, including viewing angle, image depth, and screen resolution; S42: Determine the image output parameters that need to be adjusted according to the pupil distance calculated in S3, including parallax and optical distortion compensation; S43: adjusting the image parallax according to the pupil distance, specifically by changing the depth difference between the left and right eye views so that the images received by the two eyes produce a depth perception suitable for the user's pupil distance, thereby achieving a natural naked-eye 3D effect; S44: Adjust the optical distortion of the displayed image according to the pupil distance, compensate for the difference in viewing angle caused by different pupil distances, ensure that the geometric shape of the image is not distorted when the user views it, and maintain visual realism.
[0012] Optionally, the S43 specifically includes: S431: Calculate the parallax difference between the left and right eye images based on the pupil distance calculated in S3 , the parallax difference is proportional to the pupil distance, and the calculation formula is: ,in, is the parallax difference, is the calculated pupil distance, is the parallax scale factor; S432: Based on the calculated parallax difference , adjust the viewing angle difference between the left and right eye images to produce the desired 3D effect. The parallax difference is achieved by horizontally offsetting the left and right eye views. The specific adjustment formula is: ,in, is the horizontal offset of the left and right eye images, is the parallax difference; S433: According to the adjusted parallax difference value, update the image output parameters of the display device, including the horizontal offsets of the left-eye and right-eye display images.
[0013] Optionally, the S44 specifically includes: S441: Calculate the perspective difference caused by different pupil distances according to the pupil distance calculated in S3. The perspective difference reflects the angle deviation between the left and right eye views. The specific calculation formula is: ,in, is the pupil distance, is the focal length of the display device, The difference in viewing angle is proportional to the pupil distance. The larger the pupil distance, the greater the difference in viewing angle. S442: Based on the calculated viewing angle difference , calculate the optical distortion compensation coefficient , this coefficient is used to adjust the optical distortion in the displayed image; the calculation formula is: ,in, is the constant for optical distortion compensation, representing the optical characteristics of the display device. For the difference in viewing angle, is the compensation coefficient; S443: Compensation coefficient calculated based on , adjust the optical distortion of the displayed image to reduce the visual distortion caused by different pupil distances; the adjustment expression is: and ,in, and are the coordinates of the original pixels in the image, and is the pixel coordinate after compensation; S444: Update the image output parameters of the display device according to the compensated optical distortion.
[0014] Optionally, the S5 specifically includes: S51: using an eye tracking device to obtain eye movement information of the user in real time, specifically including the pupil position and eye rotation angle of the user's eyes; S52: Calculate the coordinates of the area the user is currently looking at based on the pupil position and eye rotation angle provided by the eye tracking device. The formula is: and ,in, and are the coordinates of the user's gaze area, and is the coordinate of the pupil position, and is the eyeball rotation angle, and is the sight line offset; S53: Based on the coordinates of the user's gaze area , the pupil distance calculation result is dynamically corrected. Specifically, according to the deviation between the gaze area and the pupil center, the pupil distance calculation value is adjusted to adapt to the user's current visual needs; the correction formula is: ,in, is the corrected pupil distance, is the initial measurement of pupil distance, is the correction factor, is the deviation between the fixation area and the pupil center.
[0015] Beneficial effects of the present invention: The present invention achieves accurate adaptation of naked-eye 3D display devices to individual user needs by acquiring user's eye movement information in real time and combining it with dynamic adjustment of pupil distance. Compared with the prior art, it can measure and correct pupil distance in real time during user viewing, so that the display device can dynamically adjust image parallax and optical distortion compensation according to the actual pupil distance of different users, which significantly improves the comfort and accuracy of 3D display effects and enhances the user's sense of immersion.
[0016] The present invention ensures that the display effect remains consistent under different viewing angles and different gaze areas through eye tracking and real-time correction of pupil distance. Its dynamic adjustment mechanism can not only automatically adapt to the pupil distances of different users, but also adjust the calculation results in real time as the user's gaze area changes, thereby further optimizing the stereoscopic effect and visual experience of the 3D display. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only for the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 A schematic diagram of a method for measuring and adjusting pupil distance of a human eye according to an embodiment of the present invention; Figure 2 The present invention is a flowchart of adjusting output parameters of a naked-eye 3D display device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0019] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. At the same time, it is explained here that in order to make the embodiments more detailed, the following embodiments are the best and preferred embodiments, and those skilled in the art may also adopt other alternatives to implement some known technologies; and the accompanying drawings are only for more specific description of the embodiments, and are not intended to specifically limit the present invention.
[0020] It should be noted that the references to "one embodiment", "embodiment", "exemplary embodiments", "some embodiments" and the like in the specification indicate that the embodiments described may include specific features, structures or characteristics, but not every embodiment may include the specific features, structures or characteristics. In addition, when a specific feature, structure or characteristic is described in conjunction with an embodiment, it should be within the knowledge of a person skilled in the art to implement such feature, structure or characteristic in conjunction with other embodiments (whether or not explicitly described).
[0021] In general, a term can be understood, at least in part, from its use in context. For example, depending, at least in part, on the context, the term "one or more" as used herein can be used to describe any feature, structure, or characteristic in the singular sense, or can be used to describe a combination of features, structures, or characteristics in the plural sense. Additionally, the term "based on" can be understood as not necessarily intended to convey an exclusive set of factors, but can instead, depending, at least in part, on the context, allow for the presence of other factors that are not necessarily explicitly described.
[0022] like Figure 1-Figure 2 As shown, a method for measuring and adjusting the pupil distance of a human eye in real time for naked eye 3D includes the following steps: S1: using an image acquisition device to obtain eye image data of a user in real time, where the eye image data includes image information of a pupil area of at least one eye; S2: Based on the eye image data collected by S1, an image processing algorithm is used to identify the center position of the pupil; S3: Calculate the pupil distance between the left and right eyes according to the pupil center position identified in S2; S4: adjusting the image output parameters of the naked-eye 3D display device according to the pupil distance calculated in S3 to adapt it to the pupil distance of the user; S5: Track the user's eye movement information in real time, and dynamically correct the pupil distance calculation result according to the user's gaze area, to ensure that the naked-eye 3D display device continues to adapt to the user's pupil distance requirements and optimize the display effect.
[0023] S1 specifically includes: S11: Select an image acquisition device with a resolution of at least 3 megapixels, including an infrared or near-infrared light source and a corresponding high-resolution camera to ensure that clear eye images can be obtained in low-light environments; S12: starting an infrared or near-infrared light source in the image acquisition device to illuminate the user's eye area, wherein the wavelength of the infrared light source is set between 850nm and 950nm to reduce interference of ambient light on image acquisition and ensure clear acquisition of image information of the pupil area; S13: Start the image acquisition device, take real-time photos of the user's eyes with a high-resolution camera, and obtain eye image data of the pupil area of at least one eye; through the above steps, it can be ensured that the image acquisition device can accurately and clearly obtain eye image data under different lighting environments, especially image information of the pupil area, thereby ensuring high accuracy of pupil position recognition.
[0024] The identification of the center position of the pupil in S2 specifically includes: S21: Preprocess the eye image data collected in S1, specifically use the Gaussian filtering algorithm to denoise the image, reduce environmental interference, and enhance the edge features of the pupil area; and adjust the contrast and brightness of the image to improve the contrast between the pupil area and the eye background to ensure that the pupil edge is clearly visible; S22: Use the Canny edge detection algorithm to perform edge detection on the preprocessed image and extract edge information of the pupil area; S23: Based on the edge information in S22, a Hough transform algorithm is used to perform circular fitting on the edge of the pupil, and the circular boundary of the pupil is identified by mapping the two-dimensional edge points to the parameter space to obtain the coordinates of the center of the circle and the radius; S24: Based on the center coordinates of the circle obtained in S23, determine the center position of the pupil. The center coordinates of the circle are the center position of the pupil of the user's eye, providing data support for subsequent pupil distance calculation.
[0025] The edge information of the pupil area extracted in S22 specifically includes: S221: Calculate the gradient of the preprocessed image and use the Sobel operator to perform horizontal and vertical Directional filtering calculates the gradient of the image in the x-axis and y-axis directions. The formula is: and ,in, is the gray value of the image, and They are the gradient maps of the image in the x-axis and y-axis directions respectively; S222: Calculate the gradient amplitude of each pixel based on the gradient calculation results in the x-axis and y-axis directions and the gradient direction , the formula is: and ,in, is the gradient amplitude, indicating the strength of the edge; is the gradient direction, indicating the direction of the edge; S223: Perform non-maximum suppression on the calculated gradient amplitude map, retain the local maximum value, and remove non-edge points; specifically, based on the gradient direction Compare each pixel with its adjacent pixels to determine whether the pixel is a local maximum of the gradient amplitude; and suppress the pixels that are not local maximums, that is, set the amplitude of these points to 0, thereby retaining the strongest part of the edge; S224: Based on the set high and low thresholds, dual threshold detection is used to perform edge detection on the image; specifically setting the high threshold and low threshold , for gradient magnitudes greater than , marked as a strong edge; for the pixel point with a gradient amplitude between and If the pixel point between is connected to a strong edge pixel, it is marked as an edge; otherwise, it is suppressed as a non-edge; the final edge information is obtained after double threshold detection for subsequent steps of circle fitting and pupil center position calculation; through the above steps, the Canny edge detection algorithm can effectively extract the edge information of the pupil area and provide accurate boundary data for the identification and calculation of the pupil center position.
[0026] S23 specifically includes: S231: Use the Hough transform algorithm to perform circular fitting on the edge information extracted in S22, and map each edge point in the image space to the parameter space to detect the parameters of the circle; the expression of the circle is: ,in, and The center of the circle coordinate, is the radius of the circle; S232: For each edge point in the image, calculate the coordinates of all circle centers in the parameter space. and radius , and for each group Voting; the voting value represents the frequency of occurrence of the circle corresponding to the parameter combination; the specific calculation formula is: and ,in, and are the coordinates of the edge points, is the gradient direction of the edge point, is the current radius, and is the coordinate of the center of the circle; S233: Based on the accumulated voting results, select the one with the highest accumulated voting value The parameter combination is the center coordinates and radius of the best fitting circle; the specific selection formula is: ,in, are the center coordinates and radius of the circle with the highest voting value, For parameter combination The cumulative voting value; through the above steps, the circular boundary of the pupil area can be accurately fitted from the edge information through Hough transform, ensuring the accuracy of pupil position recognition and providing accurate data for subsequent pupil distance calculation.
[0027] S3 specifically includes: S31: According to the left and right pupil center positions identified in step S2, the left eye pupil center coordinates and the right eye pupil center coordinates are obtained respectively, and the left eye pupil center coordinates are set to , the coordinates of the right eye pupil center are ; S32: Calculate the distance between the pupil centers of the left and right eyes in the horizontal axis direction, using the formula: ,in, and The center of the pupil of the left and right eyes coordinate, is the horizontal distance between the pupil centers of the left and right eyes; S33: Calculate the distance between the pupil centers of the left and right eyes in the vertical axis direction. The formula is: ,in, and The center of the pupil of the left and right eyes coordinate, is the vertical distance between the pupil centers of the left and right eyes; S34: Based on the horizontal and vertical distances calculated in S32 and S33, the distance between the left and right pupils is calculated using the Pythagorean theorem. The formula is: ,in, is the distance between the pupil centers of the left and right eyes, is the horizontal distance, is the vertical distance; the calculated total interpupillary distance The measurement result of the pupil distance is used for pupil distance adjustment in subsequent steps. Through the above steps, the actual distance between the left and right pupils can be accurately calculated, thereby providing accurate pupil distance data for the naked-eye 3D display device. This calculation method can stably and accurately determine the distance between the pupils under different lighting and user facial postures, providing reliable data support for subsequent image adjustment and display optimization.
[0028] S4 specifically includes: S41: Obtaining default image output parameters of the naked-eye 3D display device, including viewing angle, image depth, and screen resolution, to provide a basis for subsequent adjustments; S42: according to the pupil distance calculated in S3, determining the image output parameters that need to be adjusted, including parallax and optical distortion compensation. The change of the pupil distance determines the deviation of the left and right eye viewing angles, so as to ensure that the user's visual needs are met. S43: adjusting the image parallax according to the pupil distance, specifically by changing the depth difference between the left and right eye views so that the images received by the two eyes produce a depth perception suitable for the user's pupil distance, thereby achieving a natural naked-eye 3D effect. The larger the pupil distance, the larger the adjusted parallax difference. S44: Adjust the optical distortion of the displayed image according to the pupil distance, compensate for the difference in viewing angle caused by different pupil distances, ensure that the geometric shape of the image is not distorted when the user views it, and maintain visual realism.
[0029] Adjusting the image parallax in S43 specifically includes: S431: Calculate the parallax difference between the left and right eye images based on the pupil distance calculated in S3 , the parallax difference is proportional to the pupil distance, and the calculation formula is: ,in, is the parallax difference, is the calculated pupil distance, is the parallax ratio coefficient, which is based on the naked eye Displays constants preset by the design requirements of the device; S432: Based on the calculated parallax difference , adjust the viewing angle difference between the left and right eye images to produce the desired 3D effect. The parallax difference is achieved by horizontally offsetting the left and right eye views. The specific adjustment formula is: ,in, is the horizontal offset of the left and right eye images, is the parallax difference; through this offset, the images seen by the left and right eyes can have a difference in depth perception, thus achieving a stereoscopic effect; S433: According to the adjusted parallax difference, the image output parameters of the display device are updated, including the horizontal offset of the left-eye and right-eye display images, to ensure that the 3D effect of the image is adapted to the user's pupil distance requirements; through these steps, the precise relationship between the parallax adjustment and the pupil distance is ensured, and a personalized and highly adaptable naked-eye 3D display effect is achieved.
[0030] S44 specifically includes: S441: Calculate the perspective difference caused by different pupil distances according to the pupil distance calculated in S3. The perspective difference reflects the angle deviation between the left and right eye views. The specific calculation formula is: ,in, is the pupil distance, is the focal length of the display device, The difference in viewing angle is proportional to the pupil distance. The larger the pupil distance, the greater the difference in viewing angle. S442: Based on the calculated viewing angle difference , calculate the optical distortion compensation coefficient , this coefficient is used to adjust the optical distortion in the displayed image; the calculation formula is: ,in, is the constant for optical distortion compensation, representing the optical characteristics of the display device. For the difference in viewing angle, is a compensation coefficient, which decreases as the viewing angle difference increases, and is used to reduce the image optical distortion caused by the pupil distance difference; S443: Compensation coefficient calculated based on , adjust the optical distortion of the displayed image by applying the compensation coefficient To correct the pixel positions of the image, reduce the visual distortion caused by different pupil distances, and ensure the geometric accuracy of the displayed image at different pupil distances; the adjusted expression is: and ,in, and are the coordinates of the original pixels in the image, and is the pixel coordinate after compensation; in this way, the geometric shape of the image is adjusted to adapt it to the user's pupil distance, ensuring that the image has no obvious optical distortion; S444: updating image output parameters of the display device according to the compensated optical distortion to ensure that the geometric shape of the image remains accurate and natural at different pupil distances, so as to provide an optimized naked-eye 3D visual experience.
[0031] S5 specifically includes: S51: Use an eye tracking device to obtain the user's eye movement information in real time, including the user's pupil position and eyeball rotation angle; this process is achieved by collecting eye position data and line of sight direction data. The eye tracking device uses the principle of infrared reflection to obtain the dynamic changes of the user's eyes and converts the pupil position into the user's eye direction. Coordinates and eye rotation angle data are tracked in real time; S52: Calculate the coordinates of the area the user is currently looking at based on the pupil position and eye rotation angle provided by the eye tracking device. The formula is: and ,in, and are the coordinates of the user's gaze area, and is the coordinate of the pupil position, and is the eyeball rotation angle, and is the sight line offset; S53: Based on the coordinates of the user's gaze area , the pupil distance calculation result is dynamically corrected. Specifically, according to the deviation between the gaze area and the pupil center, the pupil distance calculation value is adjusted to adapt to the user's current visual needs; the correction formula is: ,in, is the corrected pupil distance, is the initial measurement of pupil distance, is the correction factor, It is the deviation between the gaze area and the pupil center. By dynamically adjusting the pupil distance calculation result, it ensures that the naked-eye 3D display device always optimizes the image output according to the user's gaze area, thereby improving the user experience.
[0032] The present invention covers any substitution, modification, equivalent method and scheme made on the essence and scope of the present invention. In order to make the public have a thorough understanding of the present invention, specific details are described in detail in the following preferred embodiments of the present invention, but those skilled in the art can fully understand the present invention without the description of these details. In addition, in order to avoid unnecessary confusion about the essence of the present invention, well-known methods, processes, procedures, components and circuits are not described in detail.
[0033] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for measuring and adjusting the pupil distance of human eyes in real time for naked eye 3D, characterized in that: The following steps are involved: S1: using an image acquisition device to obtain eye image data of a user in real time, wherein the eye image data includes image information of a pupil area of at least one eye; S2: Based on the eye image data collected by S1, an image processing algorithm is used to identify the center position of the pupil; S3: Calculate the pupil distance between the left and right eyes according to the pupil center position identified in S2; S4: adjusting the image output parameters of the naked-eye 3D display device according to the pupil distance calculated in S3 to adapt it to the pupil distance of the user; S5: Track the user's eye movement information in real time, and dynamically correct the pupil distance calculation result according to the user's gaze area to ensure that the naked-eye 3D display device continues to adapt to the user's pupil distance requirements.
2. The method for measuring and adjusting the real-time pupil distance of human eyes for naked eye 3D according to claim 1, characterized in that: The S1 specifically includes: S11: selecting an image acquisition device with a resolution of at least 3 million pixels, wherein the image acquisition device includes an infrared or near-infrared light source and a corresponding high-resolution camera; S12: starting the infrared or near-infrared light source in the image acquisition device to illuminate the eye area of the user, wherein the wavelength of the infrared light source is set between 850nm and 950nm to reduce the interference of ambient light on image acquisition; S13: Start the image acquisition device, and take real-time photos of the user's eyes with a high-resolution camera to obtain eye image data of the pupil area of at least one eye.
3. The method for measuring and adjusting the real-time pupil distance of human eyes for naked eye 3D according to claim 1, characterized in that: The S2 specifically includes: S21: preprocessing the eye image data collected in S1, specifically using a Gaussian filter algorithm to denoise the image and enhance the edge features of the pupil area; and adjusting the contrast and brightness of the image to enhance the contrast between the pupil area and the eyeball background; S22: Use the Canny edge detection algorithm to perform edge detection on the preprocessed image and extract edge information of the pupil area; S23: Based on the edge information in S22, a Hough transform algorithm is used to perform circular fitting on the edge of the pupil, and the circular boundary of the pupil is identified by mapping the two-dimensional edge points to the parameter space to obtain the coordinates of the center of the circle and the radius; S24: Based on the circle center coordinates obtained in S23, determine the center position of the pupil, which is the center position of the pupil of the user's eye.
4. The method for measuring and adjusting the real-time pupil distance of human eyes for naked eye 3D according to claim 3, characterized in that: The S22 specifically includes: S221: performing gradient calculation on the preprocessed image, filtering the image in the horizontal and vertical directions using the Sobel operator, and calculating the gradient of the image in the x-axis and y-axis directions; S222: Calculate the gradient amplitude of each pixel based on the gradient calculation results in the x-axis and y-axis directions and the gradient direction ; S223: performing non-maximum suppression on the calculated gradient amplitude map, retaining the local maximum value, and removing non-edge points; S224: Based on the set high and low thresholds, dual threshold detection is used to perform edge detection on the image; specifically setting the high threshold and low threshold , for gradient magnitudes greater than , marked as a strong edge; for the pixel point with a gradient amplitude between and If the pixel points between are connected to strong edge pixels, they are marked as edges; otherwise, they are suppressed as non-edges; the final edge information is obtained through double threshold detection.
5. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 4, characterized in that: The S23 specifically includes: S231: Using the Hough transform algorithm to perform circle fitting on the edge information extracted in S22, by mapping each edge point in the image space to the parameter space to detect the parameters of the circle; S232: For each edge point in the image, calculate the coordinates of all circle centers in the parameter space. and radius , and for each group Voting; the voting value represents the frequency of occurrence of the circle corresponding to the parameter combination; the specific calculation formula is: and ,in, and are the coordinates of the edge points, is the gradient direction of the edge point, is the current radius, and is the coordinate of the center of the circle; S233: Based on the accumulated voting results, select the one with the highest accumulated voting value The parameter combination is the center coordinates and radius of the best fitting circle.
6. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 1, characterized in that: The S3 specifically includes: S31: According to the left and right pupil center positions identified in step S2, the left eye pupil center coordinates and the right eye pupil center coordinates are obtained respectively, and the left eye pupil center coordinates are set to , the coordinates of the right eye pupil center are ; S32: Calculate the distance between the pupil centers of the left and right eyes in the horizontal axis direction, using the formula: ,in, and The center of the pupil of the left and right eyes coordinate, is the horizontal distance between the pupil centers of the left and right eyes; S33: Calculate the distance between the pupil centers of the left and right eyes in the vertical axis direction. The formula is: ,in, and The center of the pupil of the left and right eyes coordinate, is the vertical distance between the pupil centers of the left and right eyes; S34: Based on the horizontal and vertical distances calculated in S32 and S33, the distance between the left and right pupils is calculated using the Pythagorean theorem. The formula is: ,in, is the distance between the pupil centers of the left and right eyes, is the horizontal distance, is the vertical distance.
7. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 1, characterized in that: The S4 specifically includes: S41: Obtaining default image output parameters of the naked-eye 3D display device, including viewing angle, image depth, and screen resolution; S42: Determine the image output parameters that need to be adjusted according to the pupil distance calculated in S3, including parallax and optical distortion compensation; S43: adjusting the image parallax according to the pupil distance, specifically by changing the depth difference between the left and right eye views so that the images received by the two eyes produce a depth perception suitable for the user's pupil distance, thereby achieving a natural naked-eye 3D effect; S44: Adjust the optical distortion of the displayed image according to the pupil distance, compensate for the difference in viewing angle caused by different pupil distances, ensure that the geometric shape of the image is not distorted when the user views it, and maintain visual realism.
8. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 7, characterized in that: The S43 specifically includes: S431: Calculate the parallax difference between the left and right eye images based on the pupil distance calculated in S3 , the parallax difference is proportional to the pupil distance, and the calculation formula is: ,in, is the parallax difference, is the calculated pupil distance, is the parallax scale factor; S432: Based on the calculated parallax difference , adjust the viewing angle difference between the left and right eye images to produce the desired 3D effect. The parallax difference is achieved by horizontally offsetting the left and right eye views. The specific adjustment formula is: ,in, is the horizontal offset of the left and right eye images, is the parallax difference; S433: According to the adjusted parallax difference value, update the image output parameters of the display device, including the horizontal offsets of the left-eye and right-eye display images.
9. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 8, characterized in that: The S44 specifically includes: S441: Calculate the perspective difference caused by different pupil distances according to the pupil distance calculated in S3. The perspective difference reflects the angle deviation between the left and right eye views. The specific calculation formula is: ,in, is the pupil distance, is the focal length of the display device, The difference in viewing angle is proportional to the pupil distance. The larger the pupil distance, the greater the difference in viewing angle. S442: Based on the calculated viewing angle difference , calculate the optical distortion compensation coefficient , this coefficient is used to adjust the optical distortion in the displayed image; the calculation formula is: ,in, is the constant for optical distortion compensation, representing the optical characteristics of the display device. For the difference in viewing angle, is the compensation coefficient; S443: Compensation coefficient calculated based on , adjust the optical distortion of the displayed image to reduce the visual distortion caused by different pupil distances; the adjustment expression is: and ,in, and are the coordinates of the original pixels in the image, and is the pixel coordinate after compensation; S444: Update the image output parameters of the display device according to the compensated optical distortion.
10. The method for measuring and adjusting the real-time pupil distance of human eyes for naked-eye 3D according to claim 1, characterized in that: The S5 specifically includes: S51: using an eye tracking device to obtain eye movement information of the user in real time, specifically including the pupil position and eye rotation angle of the user's eyes; S52: Calculate the coordinates of the area the user is currently looking at based on the pupil position and eye rotation angle provided by the eye tracking device. The formula is: and ,in, and are the coordinates of the user's gaze area, and is the coordinate of the pupil position, and is the eyeball rotation angle, and is the sight line offset; S53: Based on the coordinates of the user's gaze area , the pupil distance calculation result is dynamically corrected. Specifically, according to the deviation between the gaze area and the pupil center, the pupil distance calculation value is adjusted to adapt to the user's current visual needs; the correction formula is: ,in, is the corrected pupil distance, is the initial measurement of pupil distance, is the correction factor, is the deviation between the fixation area and the pupil center.
Citation Information
Patent Citations
Pupil dynamic tracking method and system based on naked eye 3D
CN116723308A
Eye movement tracking method and system based on pupil shift
CN118506433A
Naked eye 3D real-time dynamic pupil tracking system based on double cameras
CN119011806A
Adaptive parallax adjustment method and virtual reality display device
US20190121428A1
Cited By
Naked eye 3D display method based on parallax compensation
CN120529055A
Parameter adjusting method and device and 3D display equipment
CN121284218A