Imaging system based on optical waveguide plate
By performing optical path recording and three-dimensional light field modeling in the optical waveguide plate, combined with user position detection, dynamically adjusting the pixel light intensity and light exit angle, the problem of imaging consistency difference in dielectric holographic floating imaging is solved, and imaging consistency and stability are achieved at multiple perspectives.
Patent Information
- Application Number
- CN202510353509.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-25
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2045-03-25
AI Technical Summary
During the process of media-free holographic floating imaging, due to the difference in light propagation paths, the observer will have an angle deviation when observing the same image at different spatial locations, resulting in a difference in imaging consistency.
Through optical path recording, three-dimensional light field modeling and user position detection in the optical waveguide plate, the pixel light intensity and light exit angle are dynamically adjusted to eliminate imaging differences in different observation positions.
Imaging consistency in multi-view angles is achieved, the stability and adaptability of floating imaging is improved, and the images are consistent when different users observe at different angles.
Smart Images

Figure CN119861495A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of optical imaging, and more particularly to an imaging system based on an optical waveguide plate. Background Art
[0002] An optical waveguide is an optical guiding element, usually made of optical materials, with microstructures or specific channels inside. It can guide the input optical signal to a specified spatial position through total internal reflection of light or a specific reflection path, thereby achieving spatial distribution control of the light field. Non-medium holographic floating imaging is a display technology that uses optical structures to separate images from the physical screen and directly suspend them in the air. It does not rely on any physical medium to carry images, but forms a visible three-dimensional virtual image in real space through special optical path design or light field reconstruction principles. During the process of medium-free holographic floating imaging by the optical waveguide plate, due to the difference in the path of light propagation, observers at different spatial positions will have angular deviations when observing the same image, resulting in obvious consistency differences in the observed content. Summary of the invention
[0003] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides an imaging system based on an optical waveguide plate, which dynamically adjusts the pixel light intensity and the light emission angle through optical path recording in the optical waveguide plate, three-dimensional light field modeling and user position detection, and eliminates the imaging differences at different observation positions, so as to solve the problems raised in the above-mentioned background technology.
[0004] To achieve the above-mentioned object, the present invention provides the following technical solutions: an imaging system based on an optical waveguide plate, comprising: an optical waveguide control module, an imaging module; the optical waveguide control module comprises a display unit and an optical imaging unit, the display unit is connected to the imaging module; the display unit is used to generate a light source image, receive a signal from the imaging module and convert it into an initial image source; the optical imaging unit comprises an optical waveguide plate; The imaging module includes an image optimization module, an optical path transmission module, a space modeling module, a parallax detection module, a dynamic correction module, a consistency evaluation module, and an adaptive output module; The image optimization module is used to obtain the image signal, convert it into a two-dimensional light source image, and then optimize it through an image preprocessing algorithm; The optical path transmission module is used to transmit the optimized light source image through the display unit into the optical waveguide plate, and record the light propagation path of each channel in the optical waveguide plate to form a preliminary floating imaging light field; The spatial modeling module builds a 3D light field model based on a spatial reconstruction algorithm and records the spatial distribution characteristics of parallax; The disparity detection module detects the spatial position of each user based on the spatial distribution characteristics of the disparity, calculates the disparity error of each position, and forms an error data set; The dynamic correction module adjusts the image pixel light intensity and emission direction of the display unit according to the consistency of the error data set based on observations at different positions to obtain an adjusted image; The consistency evaluation module evaluates the image consistency of each viewing angle according to the adjusted image, and generates feedback parameters for light source image adjustment for controlling the output of the display unit; The adaptive output module outputs a consistent floating imaging image after parallax adaptive compensation based on the feedback parameters.
[0005] In a preferred embodiment, the image preprocessing algorithm includes grayscale correction, sharpness enhancement, and edge enhancement; The grayscale correction includes a nonlinear grayscale mapping function For each pixel position The gray value is adjusted to make the image gray uniformly distributed; To indicate the grayscale correction The gray level of the pixel at ; in To represent the coordinate position of the original image in the two-dimensional plane of the image The gray value of the pixel at ; is the nonlinear correction parameter; The sharpness enhancement is based on the second-order Laplace operator The sharpening algorithm performs spatial sharpening on the grayscale of each pixel; Indicates that the image is sharper after enhancement. The pixel grayscale of the position; ; in is the sharpness enhancement coefficient, which is used to control the strength of the sharpening effect; is the second-order spatial derivative of the image grayscale; The edge enhancement is based on a nonlinear edge enhancement operator process; pass Indicates that the final optimized image after all preprocessing is completed The gray level of the pixel at the position; ; in represents the nonlinear edge detection function; is the edge enhancement strength coefficient.
[0006] In a preferred embodiment, after the image is optimized by the image preprocessing algorithm, the two-dimensional optimized image The light will enter the optical waveguide plate through the display unit for multiple reflections to form a preliminary light field structure required for floating imaging; record the light propagation path data in each channel of the preliminary light field structure to describe the floating light field structure; To indicate the The total length of the propagation path of the light after passing through the optical waveguide plate; ; in For the The number of reflections a light ray experiences in the microchannel of the optical waveguide plate; Indicates The ray is in The geometric dimensions of the channel through which the first reflection is passed; Indicates The ray is in The spatial angle of emission after the second reflection; is the light energy attenuation coefficient of the microchannel material.
[0007] In a preferred embodiment, the three-dimensional light field model is established based on the spatial reconstruction algorithm to record the spatial distribution characteristics of the parallax, including: constructing the three-dimensional light field model using the spatial reconstruction algorithm according to the obtained preliminary light field structure ; Spatial reconstruction algorithms include NeRF light field reconstruction methods based on ray tracing or neural networks; In the 3D light field reconstruction function, , reconstruct the three-dimensional light field; ; in is the weight coefficient of each ray’s contribution to the overall three-dimensional light field; is the total number of light rays recorded in the optical waveguide.
[0008] In a preferred embodiment, the imaging module establishes a three-dimensional light field model based on the spatial modeling module, obtains the coordinate position of each observer in space in real time through the parallax detection module, measures the three-dimensional spatial position of each user through the position sensor, thereby determining the observation angle of each observer, performs error detection on the coordinate position of each observer in space, calculates the difference between the actual image light intensity and the ideal image light intensity at each position in space, and defines it as a spatial parallax error; Calculate the Users are at spatial locations The degree of visual difference between the actual three-dimensional floating image and the ideal imaging; ; Among them is The spatial area range where the user actually watches the floating image; The three-dimensional light intensity distribution of the current actual space imaging; The light intensity distribution of the target space floating imaging under the ideal state without parallax; is the spatial sensitivity weight function; is the three-dimensional coordinate position in space.
[0009] In a preferred embodiment, the dynamic correction module performs pixel-level correction according to the overall spatial parallax error of each user's position, and adjusts the angle and intensity of light emitted by each pixel of the image, so that users at different positions can see consistent floating images; ; in Indicates The light intensity output of each pixel after dynamic parallax correction; Indicates the basic pixel light intensity emitted by the display unit before parallax adjustment; Express Perform multiplication operations on the observed users; Respectively represent the horizontal and vertical coordinates of the pixels of the two-dimensional image; For the User to The pixel's parallax correction weight coefficient; For the The spatial parallax error value of each user; For the The spatial distance between the user's sight center and the current pixel; For the The change in the user's location to pixels Sensitivity of light intensity output; The consistency evaluation module is used to evaluate the consistency of the dynamically corrected floating image under multiple user perspectives; and Represents the horizontal azimuth and vertical azimuth of the observer's line of sight, construct To express the quantitative value of the difference in the consistency of the image when the observer observes from different positions in space; ; in is the standard image intensity for the ideal reference viewing angle; is the spatial spectrum weight function; It is the space observation area under different observation angles; It represents the actual distribution of the image in the spatial spectrum domain after dynamic parallax correction; is the spatial spectrum distribution of the reference image under ideal conditions, and is the spectrum space coordinate, Vertical spectrum axis used to represent the spectrum of the standard reference image.
[0010] In a preferred embodiment, based on the quantified values of the consistency difference degree calculated by the consistency evaluation module under the perspectives of multiple users, a feedback adjustment parameter for controlling the pixel output of the display unit is generated by the consistency evaluation module; ; in For pixels Feedback adjustment parameters; Pixel The degree of difference from the ideal situation in the spatial spectrum domain; is the polar coordinate representing the spectrum domain; is the maximum radius of the spatial spectrum analysis; For pixels The adjustment weight factor at position The importance of the difference in the final display adjustment decision; is the complete angular range covered by the integration in the angular dimension of the spatial spectrum domain; According to the generated , through the imaging module to control the light-emitting state of each pixel of the display unit, and output a consistent floating image; For the The complex light field expression of the floating image after parallax compensation output by pixels; ; in is the pixel intensity determined after parallax correction; Display adjustment parameters representing feedback; is an imaginary unit; For the The initial setting value of the pixel base phase; represents the first Pixel fine phase adjustment control parameters; For the The sensitivity coefficient of the pixel phase adjustment.
[0011] In a preferred embodiment, the optical waveguide plate is used to receive and process the initial light source image, and form a medium-free holographic floating image through optical total reflection; the optical waveguide plate includes a glass original sheet containing an air surface and a reflective surface, a second metal film layer, a magnetic material film layer, a first metal film layer and a filter layer; the angle between two adjacent layers of the glass original sheet containing an air surface and a reflective surface, the second metal film layer, the magnetic material film layer, the first metal film layer and the filter layer is 35-55 degrees.
[0012] Technical effects and advantages of the present invention: Through the recording of the optical path in the optical waveguide, 3D light field modeling and user position detection, the pixel light intensity and light emission angle are dynamically adjusted to eliminate the imaging differences at different observation positions and improve the consistency of multiple viewing angles. Pre-processing algorithms such as grayscale correction, sharpness enhancement and edge enhancement are used to improve the clarity of input images, reduce attenuation and noise in optical transmission, and enhance the stability of the final floating imaging; By monitoring the user's position in real time, calculating the parallax error, and dynamically adjusting the pixel intensity and direction, it ensures that the image is consistent when different users observe from different angles, thus improving adaptability; Use spatial spectrum analysis to evaluate imaging consistency, optimize light source output based on feedback parameters, and make the system adaptively adjust to improve the visual accuracy and dynamic adaptability of floating images; By recording the light propagation path, the microchannel structure error of the optical waveguide plate is compensated, and the impact of manufacturing deviation on imaging quality is reduced. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Figure 1 It is a schematic diagram of the system module of the present invention; Figure 2 It is a schematic diagram of the structure of the optical waveguide plate of the present invention; Legend 1. Magnetic material film layer; 2. First metal film layer; 3. Second metal film layer; 4. Glass original piece; 5. Filter layer. DETAILED DESCRIPTION
[0014] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0015] Refer to the instruction manual Figure 1 and Figure 2An imaging system based on an optical waveguide plate according to an embodiment of the present invention comprises: an optical waveguide control module and an imaging module; the optical waveguide control module comprises a display unit and an optical imaging unit, the display unit being connected to the imaging module; the display unit is used to generate a light source image, receive a signal from the imaging module and convert it into an initial image source; The optical imaging unit comprises an optical waveguide plate, which is used to receive and process the initial light source image and form a medium-free holographic floating image through optical total reflection; the optical waveguide plate comprises a glass original plate 4 having an air surface and a reflection surface, a second metal film layer 3, a magnetic material film layer 1, a first metal film layer 2 and a filter layer 5; the angle between two adjacent layers of the glass original plate 4 having an air surface and a reflection surface, the second metal film layer 3, the magnetic material film layer 1, the first metal film layer 2 and the filter layer 5 is 35-55 degrees; The angle between two adjacent layers refers to the reflection angle / refraction angle formed between the functional layers or interfaces during the propagation of light inside the optical waveguide plate. The "angle" here does not refer to the geometric stacking angle between the film layers, but the propagation angle of light, which is similar to the "optical path design angle" in the prior art. It affects: optical path length, stray light amount, imaging clarity and consistency; The reason for choosing an angle of 35-55 degrees is that in the optical waveguide, the light is guaranteed to be , which refers to ) and air (refractive index , which refers to ) between the two surfaces, the theoretical critical angle of which is about 41.8°, is given by the formula: ;in is the inverse sine function; The critical angle refers to the minimum incident angle required for total reflection when light enters a low refractive index material from a high refractive index material. It is the angle between the light and the normal line. If there is any reflection path with an angle lower than 41.8°, the light will partially penetrate and transmit, causing light loss, stray light, and imaging failure. The purpose of choosing 35° as the lower limit of the angle is not to allow light to be directly incident at this angle, but to consider: the adjustment range of the incident angle caused by the geometric tilt angle of the interlayer arrangement; in a complex multi-layer structure, the deviation angle of the actual reflection path of the light will fluctuate by 5° to 10° due to microstructural disturbances and material inhomogeneity; If the angle is designed to be 35°, the actual reflection angle can be guaranteed to be close to or higher than the critical angle in the reflection geometry, and even if there are microscopic defects or errors in the material, the total reflection condition is still met; Therefore, 35° represents a "safe lower limit" angle design redundancy interval within the refractive index range of a material, while avoiding light leakage problems caused by process fluctuations; For applications with an angle of 55 degrees, as the angle increases, the incident angle of light between the film layers also increases. Although total reflection is easier to meet, it will bring three negative effects: The optical path is too long: The larger the angle, the path of light propagating in the waveguide will be geometrically elongated, increasing the attenuation and delay of light energy; Too many reflections: A longer path means an increase in the number of reflections required to form an image for a single pixel, which leads to increased stray light, ghosting, and interference waves. The spatial emission angle is limited: At the extreme angle, the emission direction is more concentrated at the waveguide boundary, which can easily cause poor imaging concentration and narrow viewing angle, especially in multi-view floating imaging, where parallax inconsistency will occur.
[0016] According to the principles of geometric optics and multi-layer reflection theory, when the angle approaches or exceeds 55°, the reflection path of the light in the optical waveguide plate becomes longer, resulting in an increase in the number of reflections, which can easily cause stray light interference and concentration of the emission direction, thereby reducing imaging stability and multi-viewing angle consistency; Therefore, 55° is selected as the upper limit value, which represents the physical angle at which the optical waveguide plate structure can maintain relatively low loss, multi-viewing angle consistency and control stray light under the current glass refractive index and reflective film reflectivity; To summarize, the angle range of 35°-55° is a structural design range determined by comprehensive consideration of multiple factors such as material refractive index, critical conditions for total reflection, optical path stability, reflection number control, and consistency of floating images. It is also theoretical data that can be derived based on common sense. Among them, 35° is used to ensure the safety redundancy lower limit of total reflection, and 55° is used to control the feasible upper limit of reflection diffusion and stray light interference. It has a clear physical basis and feasibility in engineering practice.
[0017] The imaging module includes an image optimization module, an optical path transmission module, a space modeling module, a parallax detection module, a dynamic correction module, a consistency evaluation module, and an adaptive output module; The image optimization module is used to obtain image signals, convert them into two-dimensional light source images, and then optimize them through image preprocessing algorithms; the image preprocessing algorithms include grayscale correction, sharpness enhancement, and edge enhancement; The optical path transmission module is used to transmit the optimized light source image through the display unit into the optical waveguide plate, and record the light propagation path of each channel in the optical waveguide plate to form a preliminary floating imaging light field; The spatial modeling module builds a 3D light field model based on a spatial reconstruction algorithm and records the spatial distribution characteristics of parallax; The disparity detection module detects the spatial position of each user based on the spatial distribution characteristics of the disparity, calculates the disparity error of each position, and forms an error data set; The dynamic correction module adjusts the image pixel light intensity and emission direction of the display unit according to the consistency of the error data set based on observations at different positions to obtain an adjusted image; The consistency evaluation module evaluates the image consistency of each viewing angle according to the adjusted image, and generates feedback parameters for light source image adjustment for controlling the output of the display unit; The adaptive output module outputs a consistent floating imaging image after parallax adaptive compensation based on the feedback parameters.
[0018] The image preprocessing algorithm includes grayscale correction, sharpness enhancement, and edge enhancement; The grayscale correction includes a nonlinear grayscale mapping function For each pixel position The gray value is adjusted to make the image gray uniformly distributed; To indicate the grayscale correction The gray level of the pixel at ; in To represent the coordinate position of the original image in the two-dimensional plane of the image The gray value of the pixel at ; It is a nonlinear correction parameter with a value range of 0.4-2.5. By selecting different gamma values, the grayscale distribution in different areas of the image can be balanced.
[0019] The sharpness enhancement is based on the second-order Laplace operator The sharpening algorithm performs spatial sharpening on the grayscale of each pixel; Indicates that the image is sharper after enhancement. The pixel grayscale of the position; ; in is the sharpness enhancement coefficient, which is used to control the strength of the sharpening effect; It is the second-order spatial derivative of the image grayscale, which is used to locate image details and texture feature areas; The edge enhancement is based on a nonlinear edge enhancement operator process; pass Indicates that the final optimized image after all preprocessing is completed The gray level of the pixel at the position; ; in Represents a nonlinear edge detection function, which includes a function calculated using a Canny or Sobel operator; It is the edge enhancement strength coefficient, which is used to determine the degree of edge enhancement effect.
[0020] After the image is optimized by the image preprocessing algorithm, the two-dimensional optimized image The light will enter the optical waveguide through the display unit and be reflected multiple times to form the preliminary light field structure required for floating imaging. Since the optical waveguide has a large number of parallel microchannel structures, each microchannel will affect the light transmission path due to slight differences in process precision. The light propagation path data in each microchannel of the preliminary light field structure is recorded to describe the floating light field structure. To indicate the The total length of the propagation path of the light after passing through the optical waveguide plate; ; in For the The number of reflections a light ray experiences in the microchannel of the optical waveguide plate; Indicates The ray is in The geometric dimensions of the microchannel through which the secondary reflection passes; Indicates The ray is in The spatial angle of emission after the second reflection; is the light energy attenuation coefficient of the microchannel material. The light energy attenuation coefficient of the microchannel material is used to indicate the intensity loss of light after reflection.
[0021] The three-dimensional light field model is established based on the spatial reconstruction algorithm to record the spatial distribution characteristics of the parallax, including: constructing the three-dimensional light field model using the spatial reconstruction algorithm according to the obtained preliminary light field structure , That is, in three-dimensional space coordinates The light field intensity at the position; the spatial reconstruction algorithm includes the NeRF light field reconstruction method based on ray tracing or neural network; In the 3D light field reconstruction function, , reconstruct the three-dimensional light field; ; The three-dimensional light field reconstruction function Functions obtained through neural network training or multi-view ray tracing; is the weight coefficient of each ray’s contribution to the overall three-dimensional light field; is the total number of light rays recorded in the optical waveguide.
[0022] The imaging module establishes a three-dimensional light field model based on the spatial modeling module, obtains the coordinate position of each observer in space in real time through the parallax detection module, measures the three-dimensional spatial position of each user through a position sensor, and the position sensor includes but is not limited to an infrared stereo camera or a depth sensor, so as to determine the observation angle of each observer, perform error detection on the coordinate position of each observer in space, calculate the difference between the actual image light intensity and the ideal image light intensity at each position in space, and define it as a spatial parallax error; propose Indicates The overall spatial parallax error of the user's position is calculated by Calculate the Users are at spatial locations The degree of visual difference between the actual three-dimensional floating image and the ideal imaging; ; Among them is The spatial area range where the user actually watches the floating image; The three-dimensional light intensity distribution of the current actual space imaging; The light intensity distribution of the target space floating imaging under the ideal state without parallax; is the spatial sensitivity weight function, which is used to reflect the position Place opposite The influence of the parallax error of each user, the more sensitive the position, the higher the value; is the spatial three-dimensional coordinate position, which corresponds to the relative position of the display device.
[0023] The dynamic correction module performs pixel-level correction according to the overall spatial parallax error of each user's position, and adjusts the angle and intensity of light emitted from each pixel of the image, so that users at different positions can see consistent floating images; ; in Indicates The light intensity output of each pixel after dynamic parallax correction; Indicates the basic pixel light intensity emitted by the display unit before parallax adjustment; It is a continuous multiplication operation, which is used to emphasize the comprehensive correction effect in the case of multiple users; Express Perform multiplication operations on the observed users; Respectively represent the horizontal and vertical coordinates of the pixels of the two-dimensional image; For the User to The pixel parallax correction weight coefficient, which indicates the influence of the user position on the pixel adjustment; For the The spatial parallax error value of each user; For the The spatial distance between the user's sight center and the current pixel; For the The change in the user's location to pixels Sensitivity of light intensity output; The consistency evaluation module is used to evaluate the consistency of the dynamically corrected floating image under multiple user perspectives; and Represents the horizontal azimuth and vertical azimuth of the observer's line of sight, construct To express the quantitative value of the difference in the consistency of the image when the observer observes from different positions in space; ; in is the standard image intensity for the ideal reference viewing angle; is the spatial spectrum weight function, which is used to indicate the influence of spectrum features on visual consistency; It is the space observation area under different observation angles; represents the actual distribution of the image in the spatial spectrum domain after dynamic parallax correction, and is the spatial frequency coordinate in the spectral domain; is the spatial spectrum distribution of the reference image under ideal conditions, and is the spectrum space coordinate, A vertical spectrum axis used to represent the spectrum of the standard reference image to avoid conflicts with the aforementioned parameters; Indicates the entire field of view involved in evaluating image consistency; The numerator of the formula represents the difference in spectral distribution of the adjusted image under different observation angles, and the denominator is the benchmark normalization factor, that is, the spatial intensity integral of the ideal image. The above formula is used to evaluate the consistency quality of the floating image under each user's perspective and feedback the consistency evaluation data.
[0024] Based on the quantified values of the consistency difference degrees calculated by the consistency evaluation module under the perspectives of multiple users, a feedback adjustment parameter for controlling the pixel output of the display unit is generated by the consistency evaluation module; ; in For pixels Feedback adjustment parameters; Pixel The degree of difference from the ideal situation in the spatial spectrum domain; is the polar coordinate representing the spectrum domain; is the maximum radius of the spatial spectrum analysis, which represents the spectrum evaluation range; For pixels The adjustment weight factor at position The importance of the difference in the final display adjustment decision; is the complete angle range covered by the integration in the angle dimension of the spatial spectrum domain; the above formula realizes the comprehensive evaluation of errors in different frequency ranges through integration, obtains the adjustment feedback data set, and guides the next output of the display unit; According to the generated , through the imaging module to control the light-emitting state of each pixel of the display unit, and output a consistent floating image; For the The complex light field expression of the parallax-compensated floating image finally output by each pixel reflects the intensity and phase information of the light wave; ; in is the pixel intensity determined after parallax correction; represents the feedback display adjustment parameter, which is used to adjust the spatial spectrum characteristics of the pixel output light wave in real time; the introduction of the exponential function in the above formula describes the phase change of the light wave; is an imaginary unit; For the The initial setting value of the pixel base phase; represents the first Pixel fine phase adjustment control parameters; For the The sensitivity coefficient of the pixel phase adjustment.
[0025] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. An imaging system based on an optical waveguide plate, comprising: An optical waveguide control module and an imaging module; the optical waveguide control module includes a display unit and an optical imaging unit, wherein the display unit is connected to the imaging module; the display unit is used to generate a light source image, receive a signal from the imaging module and convert it into an initial image source; the optical imaging unit includes an optical waveguide plate; Features: The imaging module includes an image optimization module, an optical path transmission module, a spatial modeling module, a parallax detection module, a dynamic correction module, a consistency evaluation module, and an adaptive output module; The image optimization module is used to obtain the image signal, convert it into a two-dimensional light source image, and then optimize it through an image preprocessing algorithm; The optical path transmission module is used to transmit the optimized light source image through the display unit into the optical waveguide plate, and record the light propagation path of each channel in the optical waveguide plate to form a preliminary floating imaging light field; The spatial modeling module builds a 3D light field model based on a spatial reconstruction algorithm and records the spatial distribution characteristics of parallax; The disparity detection module detects the spatial position of each user based on the spatial distribution characteristics of the disparity, calculates the disparity error of each position, and forms an error data set; The dynamic correction module adjusts the image pixel light intensity and emission direction of the display unit according to the consistency of the error data set based on observations at different positions to obtain an adjusted image; The consistency evaluation module evaluates the image consistency of each viewing angle according to the adjusted image, and generates feedback parameters for light source image adjustment for controlling the output of the display unit; The adaptive output module outputs a consistent floating imaging image after parallax adaptive compensation based on the feedback parameters.
2. The imaging system based on the optical waveguide plate according to claim 1, characterized in that: The image preprocessing algorithm includes grayscale correction, sharpness enhancement, and edge enhancement; The grayscale correction includes a nonlinear grayscale mapping function For each pixel position The gray value is adjusted to make the image gray uniformly distributed; To indicate the grayscale correction The gray level of the pixel at ; in To represent the coordinate position of the original image in the two-dimensional plane of the image The gray value of the pixel at ; is the nonlinear correction parameter; The sharpness enhancement is based on the second-order Laplace operator The sharpening algorithm performs spatial sharpening on the grayscale of each pixel; Indicates that the image is sharper after enhancement. The pixel grayscale of the position; ; in is the sharpness enhancement coefficient, which is used to control the strength of the sharpening effect; is the second-order spatial derivative of the image grayscale; The edge enhancement is based on a nonlinear edge enhancement operator process; pass Indicates that the final optimized image after all preprocessing is completed The gray level of the pixel at the position; ; in represents the nonlinear edge detection function; is the edge enhancement strength coefficient.
3. The imaging system based on the optical waveguide plate according to claim 2, characterized in that: After the image is optimized by the image preprocessing algorithm, the two-dimensional optimized image The light will enter the optical waveguide plate through the display unit for multiple reflections to form a preliminary light field structure required for floating imaging; record the light propagation path data in each channel of the preliminary light field structure to describe the floating light field structure; To indicate the The total length of the propagation path of the light after passing through the optical waveguide plate; ; in For the The number of reflections a light ray experiences in the microchannel of the optical waveguide plate; Indicates The ray is in The geometric dimensions of the channel through which the first reflection is passed; Indicates The ray is in The spatial angle of emission after the second reflection; is the light energy attenuation coefficient of the microchannel material.
4. The imaging system based on the optical waveguide plate according to claim 3, characterized in that: The three-dimensional light field model is established based on the spatial reconstruction algorithm to record the spatial distribution characteristics of the parallax, including: constructing the three-dimensional light field model using the spatial reconstruction algorithm according to the obtained preliminary light field structure ; Spatial reconstruction algorithms include NeRF light field reconstruction methods based on ray tracing or neural networks; In the 3D light field reconstruction function, , reconstruct the three-dimensional light field; ; in is the weight coefficient of each ray’s contribution to the overall three-dimensional light field; is the total number of light rays recorded in the optical waveguide.
5. The imaging system based on the optical waveguide plate according to claim 4, characterized in that: The imaging module establishes a three-dimensional light field model based on the spatial modeling module, obtains the coordinate position of each observer in space in real time through the parallax detection module, measures the three-dimensional spatial position of each user through the position sensor, thereby determining the observation angle of each observer, performs error detection on the coordinate position of each observer in space, calculates the difference between the actual image light intensity and the ideal image light intensity at each position in space, and defines it as a spatial parallax error; proposes Indicates The overall spatial parallax error of the user's position is calculated by Calculate the Users are at spatial locations The degree of visual difference between the actual three-dimensional floating image and the ideal imaging; ; Among them is The spatial area range where users actually watch the floating image; The three-dimensional light intensity distribution of the current actual space imaging; The light intensity distribution of the target space floating imaging under the ideal state without parallax; is the spatial sensitivity weight function; is the three-dimensional coordinate position in space.
6. The imaging system based on the optical waveguide plate according to claim 5, characterized in that: The dynamic correction module performs pixel-level correction according to the overall spatial parallax error of each user's position, and adjusts the angle and intensity of light emitted from each pixel of the image, so that users at different positions can see consistent floating images; ; in Indicates The light intensity output of each pixel after dynamic parallax correction; Indicates the basic pixel light intensity emitted by the display unit before parallax adjustment; Express Perform multiplication operations on the observed users; Respectively represent the horizontal and vertical coordinates of the pixels of the two-dimensional image; For the User to The pixel's parallax correction weight coefficient; For the The spatial parallax error value of each user; For the The spatial distance between the user's sight center and the current pixel; For the The change in the user's location to pixels Sensitivity of light intensity output; The consistency evaluation module is used to evaluate the consistency of the dynamically corrected floating image under multiple user perspectives; and Represents the horizontal azimuth and vertical azimuth of the observer's line of sight, construct To express the quantitative value of the difference in the consistency of the image when the observer observes from different positions in space; ; in is the standard image intensity for the ideal reference viewing angle; is the spatial spectrum weight function; It is the space observation area under different observation angles; It represents the actual distribution of the image in the spatial spectrum domain after dynamic parallax correction; is the spatial spectrum distribution of the reference image under ideal conditions, and is the spectrum space coordinate, Vertical spectrum axis used to represent the spectrum of the standard reference image.
7. The imaging system based on the optical waveguide plate according to claim 6, characterized in that: Based on the quantized values of the consistency difference degrees calculated by the consistency evaluation module under the perspectives of multiple users, a feedback adjustment parameter for controlling the pixel output of the display unit is generated by the consistency evaluation module; ; in For pixels Feedback adjustment parameters; Pixel The degree of difference from the ideal situation in the spatial spectrum domain; is the polar coordinate representing the spectrum domain; is the maximum radius of the spatial spectrum analysis; For pixels The adjustment weight factor at position The importance of the difference in the final display adjustment decision; is the complete angular range covered by the integration in the angular dimension of the spatial spectrum domain; According to the generated , through the imaging module to control the light-emitting state of each pixel of the display unit, and output a consistent floating image; For the The complex light field expression of the floating image after parallax compensation output by pixels; ; in is the pixel intensity determined after parallax correction; Display adjustment parameters representing feedback; is an imaginary unit; For the The initial setting value of the pixel base phase; represents the first Pixel fine phase adjustment control parameters; For the The sensitivity coefficient of the pixel phase adjustment.
8. An imaging system based on an optical waveguide plate according to any one of claims 1 to 7, characterized in that: The optical waveguide plate is used to receive and process an initial light source image, and to form a medium-free holographic floating image through optical total reflection; the optical waveguide plate comprises a glass original plate (4) having an air surface and a reflection surface, a second metal film layer (3), a magnetic material film layer (1), a first metal film layer (2) and a filter layer (5); the angle between two adjacent layers of the glass original plate (4) having an air surface and a reflection surface, the second metal film layer (3), the magnetic material film layer (1), the first metal film layer (2) and the filter layer (5) is 35-55 degrees.
Citation Information
Patent Citations
Movement expansion goal based big-view-field wavefront distortion detection method
CN102865931A
Method and device for encoding signal representative of light-field content
CN107529062A
Floating three-dimensional image display system
CN114827566A
Multifunctional medium-free projection system and application method
CN115150601A
Light modulation device for a display for representing two- and / or three-dimensional image content
US20140055692A1