Integrated imaging light field display method and device with cataract correction function

Abstract

The invention discloses an integrated imaging light field display method and device with a cataract correction function. The method comprises the following steps: acquiring the position and size of an eye turbid area of a patient to be corrected; if the size of the eye turbid area is smaller than or equal to a preset size, determining a target pixel position on the micro-display based on the position of the eye turbid area, and turning off a light-emitting unit at the target pixel position to obtain a corrected image; if the size is larger than the preset size, according to the position of the area with the large turbid area, the aberration type of the patient to be corrected is obtained by turning off the light-emitting unit at the position of the target pixel and then analyzing the eye data, a corresponding point spread function is determined according to the aberration type, Fourier transform is carried out on the obtained blurred image, and the image is obtained. And correcting the transformed image by using a corresponding correction function obtained by the point spread function to obtain a corrected image. Through the method, the correction precision of the cataract patient is improved.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional display technology, and in particular to an integrated imaging light field display method and device with cataract correction function. Background Art

[0002] In the three-dimensional world, when a three-dimensional scene is projected onto a two-dimensional display screen, depth information will be lost. To solve this problem, traditional three-dimensional display technology uses the binocular parallax characteristics of the human eye to present images with slight horizontal parallax to the left and right eyes respectively, so that the brain can combine the visual information of both eyes and "perceive" the existence of three-dimensional space with the help of the convergence adjustment mechanism. However, this technology is only an approximate simulation of the three-dimensional effect and cannot provide freely adjustable optical depth. It will cause convergence adjustment conflicts, leading to dizziness and visual discomfort.

[0003] In order to eliminate the conflict of convergence and accommodation and realize true 3D display, the current technical paths include: holographic display, volumetric 3D display, deep fusion 3D display, integrated imaging light field display, etc. Among them, the integrated imaging light field display technology has the advantages of continuous adjustable depth of single eye and small system volume. By arranging a microlens array in front of the display screen, the element image array of the real 3D scene is captured and recorded, and then the element image array and the microlens array are used to reconstruct the 3D scene according to the reversibility of the light path. Figure 1 The common architecture of the virtual image type integrated imaging light field display is demonstrated, which is mainly composed of a microdisplay and a microlens array. The element image array is displayed on the microdisplay. After being regulated by the microlens array, the three-dimensional scene can be reconstructed and received by the human eye. However, after the light passes through the cornea and lens, it is projected onto the retina to form an image, and then transmitted to the brain through the optic nerve to perceive the outside world. The normal lens is transparent, but the lens of cataract patients has turbidity in some or even all areas, causing patients to have blurred vision, increased myopia, diplopia, halos, photophobia and other visual disorders. The integrated imaging light field display method in the prior art still has problems such as low correction accuracy and incompatible correction methods in the correction of cataract patients. Summary of the invention

[0004] In order to solve the above technical problems, an embodiment of the present invention provides an integrated imaging light field display method and device with cataract correction function to solve the technical problem that the integrated imaging light field display method in the prior art has low correction accuracy for cataract patients.

[0005] A first aspect of an embodiment of the present invention provides an integrated imaging light field display method with a cataract correction function, the method comprising:

[0006] Obtaining the position and size of the cloudy area of ​​the patient's eye to be corrected;

[0007] If the size of the cloudy eye area is less than or equal to the preset size, the target pixel position is determined on the microdisplay based on the position of the cloudy eye area, and the light-emitting unit at the target pixel position is turned off to obtain a corrected image;

[0008] If the size of the cloudy eye area is larger than a preset size, the target pixel position is determined on the microdisplay based on the position and size of the cloudy eye area, the light-emitting unit at the target pixel position is turned off, an initial corrected image is obtained, eye data of the patient to be corrected is acquired, the eye data is analyzed to obtain the aberration type of the patient to be corrected, a corresponding point spread function is determined according to the aberration type, the initial corrected image is Fourier transformed using the correction function to obtain a transformed image, the transformed image is corrected using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0009] In a possible implementation manner of the first aspect, determining a target pixel position on a microdisplay based on a position of an eye turbidity region includes:

[0010] According to the position and size of the cloudy area of ​​the patient's eye to be corrected, the cloudy area of ​​the eye is connected to the centers of several corresponding microlenses, and extended to the pixels of the microdisplay to determine the optical path from the microdisplay to the retina;

[0011] The blur range on the micro display is calculated according to the size of the cloudy area of ​​the patient's eye to be corrected, the focal length of the micro lens array, and the focal length of the human eye approximation model;

[0012] The target pixel position is determined on the microdisplay according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the microdisplay and the microlens array.

[0013] In a possible implementation manner of the first aspect, determining a corresponding point spread function according to the aberration type includes:

[0014] If the aberration type is a low-order aberration, the point spread function is the first point spread function;

[0015] If the aberration type is a higher-order aberration, the point spread function is a second point spread function;

[0016] If the aberration type is mixed aberration, the point spread function is the third point spread function.

[0017] In a possible implementation manner of the first aspect, the corresponding correction function obtained by using the point spread function includes:

[0018] If the aberration type is a low-order aberration, the inverse of the first point spread function is taken to obtain a first correction function, where the first correction function is:

[0019]

[0020] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0021] If the aberration type is a high-order aberration, the reciprocal of the second point spread function is taken to obtain a second correction function, where the second correction function is:

[0022]

[0023] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0024] If the aberration type is a mixed aberration, the inverse of the third point spread function is taken to obtain a third correction function, where the third correction function is:

[0025]

[0026] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

[0027] In order to solve the same technical problem, a second aspect of an embodiment of the present invention provides an integrated imaging light field display device with a cataract correction function, the device comprising:

[0028] An acquisition module, used for acquiring the position and size of the cloudy area of ​​the patient's eye to be corrected;

[0029] A first correction module, configured to determine a target pixel position on the microdisplay based on the position of the cloudy eye area if the size of the cloudy eye area is less than or equal to a preset size, turn off the light-emitting unit at the target pixel position, and obtain a corrected image;

[0030] The second correction module is used to determine the target pixel position on the microdisplay based on the position and size of the cloudy eye area if the size of the cloudy eye area is larger than the preset size, turn off the light-emitting unit at the target pixel position to obtain an initial corrected image, obtain eye data of the patient to be corrected, analyze the eye data to obtain the aberration type of the patient to be corrected, determine the corresponding point spread function according to the aberration type, perform Fourier transformation on the initially corrected image using the correction function to obtain a transformed image, and correct the transformed image using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0031] In a possible implementation manner of the second aspect, the first correction module includes a light path determination unit, a blur range determination unit, and a target pixel position determination unit, wherein:

[0032] The optical path determination unit is used to connect the cloudy eye area with the corresponding centers of several microlenses according to the position and size of the cloudy eye area to be corrected, and extend it to the pixel of the microdisplay to determine the optical path from the microdisplay to the retina;

[0033] The blur range determination unit is used to calculate the blur range on the micro display according to the size of the turbidity area of ​​the patient's eye to be corrected, the focal length of the micro lens array and the focal length of the human eye approximation model;

[0034] The target pixel position determination unit is used to determine the target pixel position on the micro display according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the micro display and the micro lens array.

[0035] In a possible implementation manner of the second aspect, the second correction module includes a first point spread function determination unit, a second point spread function determination unit, and a third point spread function determination unit.

[0036] The first point spread function determining unit is used for determining that if the aberration type is a low-order aberration, the point spread function is a first point spread function;

[0037] The second point spread function determining unit is used for, if the aberration type is a high-order aberration, the point spread function is a second point spread function;

[0038] The third point spread function determining unit is used for determining that if the aberration type is mixed aberration, the point spread function is a third point spread function.

[0039] In a possible implementation manner of the second aspect, the second correction module further includes a first correction function determination unit, a second correction function determination unit, and a third correction function determination unit, wherein:

[0040] The first correction function determination unit is used to obtain a first correction function by taking the inverse of the first point spread function if the aberration type is a low-order aberration, wherein the first correction function is:

[0041]

[0042] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0043] The second correction function determination unit is used to obtain a second correction function by taking the inverse of the second point spread function if the aberration type is a high-order aberration, wherein the second correction function is:

[0044]

[0045] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0046] The third correction function determination unit is used to take the inverse of the third point spread function to obtain a third correction function if the aberration type is a mixed aberration, wherein the third correction function is:

[0047]

[0048] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

[0049] A third aspect of an embodiment of the present invention provides a computer device, including:

[0050] Memory for storing computer programs;

[0051] A processor is used to implement the steps of the integrated imaging light field display method with cataract correction function as in the first aspect when executing the computer program.

[0052] A fourth aspect of an embodiment of the present invention provides a storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the integrated imaging light field display method with cataract correction function as in the first aspect are implemented.

[0053] The technical solution of the present invention has the following advantages:

[0054] The integrated imaging light field display method with cataract correction function provided by the embodiment of the present invention obtains the position and size of the cloudy area of ​​the patient's eye to be corrected; if the area of ​​the cloudy area of ​​the eye is not large, the target pixel position is determined on the microdisplay, and the light-emitting unit at the target pixel position is turned off to obtain a corrected image. By controlling the closure of some pixels of the display panel, the cataract patient can see a clear reconstructed image.

[0055] If the area of ​​the cloudy area of ​​the eye is large, the target pixel position is determined on the microdisplay, and the light-emitting unit at the target pixel position is turned off to obtain the initial corrected image. The eye data is then analyzed based on the eye data of the patient to be corrected to obtain the aberration type of the patient to be corrected, and the corresponding point spread function is determined based on the aberration type. The initial corrected image is Fourier transformed using the correction function, and then the transformed image is corrected based on the corresponding correction function obtained using the point spread function to obtain a corrected image. The above method pre-processes some pixels of the display panel to correct the light passing through the slightly cloudy area of ​​the lens of the cataract patient, so that the cataract patient can obtain clear imaging without losing too much image brightness, thereby achieving correction of cataract visual impairment. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0057] Figure 1 is a flow chart of an integrated imaging light field display method with cataract correction function in an embodiment of the present invention;

[0058] Figure 2 It is a schematic diagram of lens imaging in an eyeball of an integrated imaging light field display method with cataract correction function in an embodiment of the present invention;

[0059] Figure 3 This is a schematic diagram of imaging when the integrated imaging light field display method with cataract correction function in an embodiment of the present invention is used to correct cataract vision;

[0060] Figure 4 A schematic diagram of the working principle of a cataract vision impairment correction device of an integrated imaging light field display method with cataract correction function in an embodiment of the present invention;

[0061] Figure 5 A schematic diagram comparing correction effects of a cataract vision impairment correction device of an integrated imaging light field display method with a cataract correction function in an embodiment of the present invention;

[0062] Figure 6 It is a schematic diagram of another cataract vision impairment correction device of the integrated imaging light field display method with cataract correction function in an embodiment of the present invention;

[0063] Figure 7A schematic diagram comparing correction effects of another cataract vision impairment correction device of the integrated imaging light field display method with cataract correction function in an embodiment of the present invention;

[0064] Figure 8 4 is a structural block diagram of an integrated imaging light field display device with cataract correction function in an embodiment of the present invention. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0066] In the description of the present invention, it should be noted that the terms "first", "second" and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0067] The integrated imaging light field display method with cataract correction function provided by the embodiment of the present invention is as follows: Figure 1 As shown, Figure 1 The integrated imaging light field display flow chart with cataract correction function includes steps S101 to S103, each of which is as follows:

[0068] S101: Obtain the position and size of the cloudy area of ​​the patient's eye to be corrected.

[0069] In this embodiment, if Figure 2 As shown in (a), for people with healthy eyes, the lens in their eyeballs has good transparency and can produce clear images. However, for people with cataracts, Figure 2 As shown in (b), the protein in the lens denatures, causing partial or even complete opacity of the lens, resulting in visual impairment such as blurred vision. Figure 3 In (a), the image is blurred due to the light passing through the cloudy area in the lens. By controlling some pixels on the display panel not to emit light, the light is prevented from entering the cloudy part in the lens, thereby ensuring that the image received by the retina is clear. First, select a suitable imaging device to obtain the position and size of the cloudy area in the eye.

[0070] S102: If the size of the cloudy eye area is less than or equal to a preset size, a target pixel position is determined on the microdisplay based on the position of the cloudy eye area, and the light-emitting unit at the target pixel position is turned off to obtain a corrected image.

[0071] In this embodiment, if Figure 4As shown, for cataract patients with mild opacity in the lens, the light passing through the cloudy part can be turned off according to parameters such as the area size and position information of the cloudy part to avoid blurred imaging.

[0072] If the size of the cloudy area of ​​the eye, that is, the area, is smaller than the set size threshold, then the cloudy area of ​​the lens is directly connected to the corresponding centers of several microlenses based on the reversibility of the optical path, and extended to the pixels of the microdisplay, so that the position of the non-luminous pixel on the display panel can be determined, such as Figure 3 (b) is shown. This can prevent the retina from receiving a blurred image, and can also enable the human eye to see the reconstructed three-dimensional scene through the true 3D display function of the integrated imaging light field display. In this process, since each volume pixel reconstructed by the integrated imaging light field display is composed of several surface pixels, there will be no pixel missing on the reconstructed image.

[0073] It should be noted that the size threshold can be set according to actual needs.

[0074] In one embodiment, based on the position of the cloudy area of ​​the eye, determining the target pixel position on the microdisplay includes:

[0075] According to the position and size of the cloudy area of ​​the patient's eye to be corrected, the cloudy area of ​​the eye is connected to the centers of several corresponding microlenses, and extended to the pixels of the microdisplay to determine the optical path from the microdisplay to the retina;

[0076] The blur range on the micro display is calculated according to the size of the cloudy area of ​​the patient's eye to be corrected, the focal length of the micro lens array, and the focal length of the human eye approximation model;

[0077] The target pixel position is determined on the microdisplay according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the microdisplay and the microlens array.

[0078] In this embodiment, according to the position and size of the cloudy area of ​​the patient's eye to be corrected, the cloudy area of ​​the eye is connected to the corresponding centers of several microlenses and extended to the pixels of the microdisplay to determine the optical path from the microdisplay to the retina; the blur range on the microdisplay is calculated using the size of the cloudy area of ​​the patient's eye to be corrected, the focal length of the microlens array, and the focal length of the approximate model of the human eye; then, the target pixel position is determined on the microdisplay according to the blur range, the distance between the microdisplay and the microlens array, and the obtained optical path.

[0079] S103: If the size of the cloudy eye area is larger than a preset size, the target pixel position is determined on the microdisplay based on the position and size of the cloudy eye area, the light-emitting unit at the target pixel position is turned off, an initial corrected image is obtained, eye data of the patient to be corrected is acquired, the eye data is analyzed to obtain the aberration type of the patient to be corrected, a corresponding point spread function is determined according to the aberration type, a Fourier transform is performed on the initial corrected image using the correction function to obtain a transformed image, and the transformed image is corrected using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0080] In this embodiment, if the size of the cloudy area in the eye, that is, the area, is larger than the set size threshold, and the cloudy part in the lens is relatively large, the image entering the slightly cloudy area in the lens can be preprocessed so that the image light on the display screen can still reconstruct a clear image after passing through the cloudy part of the lens.

[0081] The target pixel position is determined on the microdisplay, and the light-emitting unit at the target pixel position is turned off to obtain the initial corrected image, which is a blurred image. Then, by using a wavefront aberration analyzer and other equipment to analyze the eye data of the cataract visually impaired person, such as wavefront aberration or point spread function, the aberration type of the cloudy part of the lens can be determined, and the point spread function h(x, y) of the aberration imaging of the cataract patient can be obtained. The display screen image of the reconstructed clear virtual image is represented by p(x, y), and the blurred imaging affected by the aberration of the cloudy part can be approximately expressed as (represents the convolution operation).

[0082] Then the blurred image is Fourier transformed and the image is preprocessed in the frequency domain. The correction function in the frequency domain is defined as Then the corrected display screen image is P(u,v)·O(u,v), and the corrected imaging is P(u,v)·O(u,v)·H(u,v)=P(u,v). The corrected imaging can be obtained by inverse Fourier transform to obtain p(x,y). By preprocessing by multiplying the display screen image that enters the cloudy part of the lens with the correction function in the frequency domain, cataract patients can see the reconstructed clear image. Preprocessing based on inverse filtering is not limited to direct deconvolution, and algorithms that are more robust to noise, such as Wiener filtering, can be used.

[0083] The correction effect of cataract vision correction glasses used by patients is as follows Figure 5 As shown, Figure 5 a is the actual displayed image, Figure 5 b is the simulated imaging of cataract patients. Figure 5c Use cataract vision impairment correction glasses to simulate imaging. Since the light passing through the cloudy part is turned off, the clarity and contrast of the corrected image are significantly improved, but there is a significant loss in brightness.

[0084] In one embodiment, determining a corresponding point spread function according to the aberration type includes:

[0085] If the aberration type is a low-order aberration, the point spread function is the first point spread function;

[0086] If the aberration type is a higher-order aberration, the point spread function is a second point spread function;

[0087] If the aberration type is mixed aberration, the point spread function is the third point spread function.

[0088] In this embodiment, the aberration type includes low-order aberration, high-order aberration and mixed aberration. Therefore, if the aberration type is low-order aberration, the point spread function is the first point spread function; if the aberration type is high-order aberration, the point spread function is the second point spread function; if the aberration type is mixed aberration, the point spread function is the third point spread function.

[0089] In one embodiment, the corresponding correction function obtained by using the point spread function includes:

[0090] If the aberration type is a low-order aberration, the inverse of the first point spread function is taken to obtain a first correction function, where the first correction function is:

[0091]

[0092] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0093] If the aberration type is a high-order aberration, the reciprocal of the second point spread function is taken to obtain a second correction function, where the second correction function is:

[0094]

[0095] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0096] If the aberration type is a mixed aberration, the inverse of the third point spread function is taken to obtain a third correction function, where the third correction function is:

[0097]

[0098] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

[0099] In this embodiment, if the aberration type of the turbid area of ​​the patient's eye to be corrected is a low-order aberration, the inverse of the first point spread function is taken to obtain a first correction function, wherein the first correction function is:

[0100]

[0101] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0102] If the aberration type is a high-order aberration, the reciprocal of the second point spread function is taken to obtain a second correction function, where the second correction function is:

[0103]

[0104] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0105] If the aberration type is a mixed aberration, the inverse of the third point spread function is taken to obtain a third correction function, where the third correction function is:

[0106]

[0107] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

[0108] As an example of this embodiment, the schematic diagram of the cataract vision impairment correction device is as follows: Figure 6 As shown, for cataract patients with uneven lens opacity, the aberration correction of the severely opaque lens area is complex and the light transmittance is low, and the display screen pixels are controlled to shut off the light passing through the severely opaque lens area; the aberration correction of the mildly opaque lens area is simple and the light transmittance is high, and the image passing through the mildly opaque lens area is preprocessed to correct the aberration, so that a clear virtual image can be presented at the retina. This method can enable cataract patients to obtain clear imaging without losing too much image brightness, thereby achieving correction of cataract visual impairment.

[0109] The correction effect of cataract vision impairment correction device used by patients is as follows Figure 7 As shown, Figure 7 a is the actual display image before correction. Figure 7 b is the simulated imaging of cataract patients before pretreatment. Figure 7 cSimulated imaging using cataract vision impairment correction glasses that can be pre-processed. Since the light passing through the severely opaque part is turned off and the image through the slightly opaque area of ​​the lens is pre-processed, the clarity and contrast of the corrected image are significantly improved with only a slight loss in brightness.

[0110] The method proposed in the embodiment of the present invention can make full use of the patient's eye data to achieve accurate correction of low-order aberrations, high-order aberrations and cataracts, and has high integration and good compatibility. Through the development and application of this technology, a clearer and more realistic three-dimensional visual experience can be brought to cataract patients.

[0111] The integrated imaging light field display device with cataract correction function provided by the embodiment of the present invention is as follows: Figure 8 As shown, Figure 8 A block diagram of an integrated imaging light field display device with cataract correction function, comprising:

[0112] An acquisition module 801 is used to acquire the position and size of the cloudy area of ​​the patient's eye to be corrected;

[0113] A first correction module 802 is configured to determine a target pixel position on the microdisplay based on the position of the eye turbidity area if the size of the eye turbidity area is less than or equal to a preset size, turn off the light emitting unit at the target pixel position, and obtain a corrected image;

[0114] The second correction module 803 is used to determine the target pixel position on the microdisplay based on the position and size of the cloudy eye area if the size of the cloudy eye area is larger than a preset size, turn off the light-emitting unit at the target pixel position to obtain an initial corrected image, obtain eye data of the patient to be corrected, analyze the eye data to obtain the aberration type of the patient to be corrected, determine the corresponding point spread function according to the aberration type, perform Fourier transformation on the initial corrected image using the correction function to obtain a transformed image, and correct the transformed image using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0115] In one embodiment, the first correction module 802 includes a light path determination unit, a blur range determination unit and a target pixel position determination unit, wherein:

[0116] The optical path determination unit is used to connect the cloudy eye area with the corresponding centers of several microlenses according to the position and size of the cloudy eye area to be corrected, and extend it to the pixel of the microdisplay to determine the optical path from the microdisplay to the retina;

[0117] The blur range determination unit is used to calculate the blur range on the micro display according to the size of the turbidity area of ​​the patient's eye to be corrected, the focal length of the micro lens array and the focal length of the human eye approximation model;

[0118] The target pixel position determination unit is used to determine the target pixel position on the micro display according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the micro display and the micro lens array.

[0119] In one embodiment, the second correction module 803 includes a first point spread function determination unit, a second point spread function determination unit and a third point spread function determination unit.

[0120] The first point spread function determining unit is used for determining that if the aberration type is a low-order aberration, the point spread function is a first point spread function;

[0121] The second point spread function determining unit is used for, if the aberration type is a high-order aberration, the point spread function is a second point spread function;

[0122] The third point spread function determining unit is used for determining that if the aberration type is mixed aberration, the point spread function is a third point spread function.

[0123] In one embodiment, the second correction module 803 further includes a first correction function determination unit, a second correction function determination unit and a third correction function determination unit, wherein:

[0124] The first correction function determination unit is used to take the inverse of the first point spread function to obtain a first correction function if the aberration type is a low-order aberration, wherein the first correction function is:

[0125]

[0126] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0127] The second correction function determination unit is used to take the inverse of the second point spread function to obtain a second correction function if the aberration type is a high-order aberration, wherein the second correction function is:

[0128]

[0129] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected;

[0130] The third correction function determination unit is used for, if the aberration type is a mixed aberration, taking the inverse of the third point spread function to obtain a third correction function, wherein the third correction function is:

[0131]

[0132] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

[0133] In one embodiment of the present application, a computer device is provided, which includes a memory and a processor, wherein a computer program is stored in the memory, and the above steps are implemented when the processor executes the computer program; the computer device provided in this embodiment has an implementation principle and technical effects similar to those of the above method embodiments, and will not be repeated here.

[0134] In one embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and the above steps are implemented when the computer program is executed by a processor; the computer-readable storage medium provided in this embodiment has an implementation principle and technical effects similar to those of the above method embodiment, and will not be repeated here.

[0135] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0136] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.

Claims

1. An integrated imaging light field display method with cataract correction function, characterized in that: include: Obtaining the position and size of the cloudy area of ​​the patient's eye to be corrected; If the size of the cloudy eye area is less than or equal to a preset size, a target pixel position is determined on the microdisplay based on the position of the cloudy eye area, and the light-emitting unit at the target pixel position is turned off to obtain a corrected image; If the size of the cloudy eye area is larger than the preset size, the target pixel position is determined on the microdisplay based on the position and the size of the cloudy eye area, the light-emitting unit at the target pixel position is turned off to obtain an initially corrected image, the eye data of the patient to be corrected is acquired, the eye data is analyzed to obtain the aberration type of the patient to be corrected, a corresponding point spread function is determined according to the aberration type, the initially corrected image is Fourier transformed to obtain a transformed image, the transformed image is corrected using the corresponding correction function obtained by the point spread function to obtain a corrected image.

2. The integrated imaging light field display method with cataract correction function according to claim 1, characterized in that: The step of determining a target pixel position on a microdisplay based on the position of the cloudy eye area comprises: According to the position and size of the cloudy area of ​​the patient's eye to be corrected, the cloudy area of ​​the eye is connected to the centers of several corresponding microlenses and extended to the pixels of the microdisplay to determine the optical path from the microdisplay to the retina; The blur range on the microdisplay is calculated according to the size of the turbidity area of ​​the patient's eye to be corrected, the focal length of the microlens array, and the focal length of the human eye approximation model; A target pixel position is determined on the microdisplay according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the microdisplay and the microlens array.

3. The integrated imaging light field display method with cataract correction function according to claim 1, characterized in that: Determining a corresponding point spread function according to the aberration type includes: If the aberration type is a low-order aberration, the point spread function is a first point spread function; If the aberration type is a high-order aberration, the point spread function is a second point spread function; If the aberration type is mixed aberration, the point spread function is a third point spread function.

4. The integrated imaging light field display method with cataract correction function according to claim 1, characterized in that: The corresponding correction function obtained by using the point spread function includes: If the aberration type is a low-order aberration, the inverse of the first point spread function is taken to obtain a first correction function, wherein the first correction function is: Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected; If the aberration type is a high-order aberration, the reciprocal of the second point spread function is taken to obtain a second correction function, wherein the second correction function is: Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected; If the aberration type is a mixed aberration, the inverse of the third point spread function is taken to obtain a third correction function, wherein the third correction function is: Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

5. An integrated imaging light field display device with cataract correction function, characterized in that: include: An acquisition module, used for acquiring the position and size of the cloudy area of ​​the patient's eye to be corrected; A first correction module, configured to determine a target pixel position on the microdisplay based on the position of the eye turbidity area if the size of the eye turbidity area is less than or equal to a preset size, turn off the light emitting unit at the target pixel position, and obtain a corrected image; The second correction module is used to determine the target pixel position on the microdisplay based on the position and the size of the eye cloudy area if the size of the eye cloudy area is larger than the preset size, turn off the light-emitting unit at the target pixel position to obtain an initially corrected image, acquire eye data of the patient to be corrected, analyze the eye data to obtain the aberration type of the patient to be corrected, determine a corresponding point spread function according to the aberration type, perform Fourier transformation on the initially corrected image to obtain a transformed image, and correct the transformed image using a corresponding correction function obtained by the point spread function to obtain a corrected image.

6. The integrated imaging light field display device with cataract correction function as claimed in claim 5, characterized in that: The first correction module includes a light path determination unit, a blur range determination unit and a target pixel position determination unit, wherein: The optical path determination unit is used to connect the cloudy eye area to the corresponding centers of several microlenses according to the position and size of the cloudy eye area to be corrected, and extend it to the pixels of the microdisplay to determine the optical path from the microdisplay to the retina; The blur range determination unit is used to calculate the blur range on the micro display according to the size of the turbidity area of ​​the patient's eye to be corrected, the focal length of the micro lens array and the focal length of the human eye approximation model; The target pixel position determination unit is used to determine the target pixel position on the microdisplay according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the microdisplay and the microlens array.

7. The integrated imaging light field display device with cataract correction function as claimed in claim 5, characterized in that: The second correction module includes a first point spread function determination unit, a second point spread function determination unit and a third point spread function determination unit, Wherein, the first point spread function determining unit is used for, if the aberration type is a low-order aberration, the point spread function is a first point spread function; The second point spread function determining unit is used for, if the aberration type is a high-order aberration, the point spread function is a second point spread function; The third point spread function determining unit is configured to determine that if the aberration type is a mixed aberration, the point spread function is a third point spread function.

8. The integrated imaging light field display device with cataract correction function as claimed in claim 5, characterized in that: The second correction module further includes a first correction function determination unit, a second correction function determination unit and a third correction function determination unit, wherein: The first correction function determination unit is used for, if the aberration type is a low-order aberration, taking the inverse of the first point spread function to obtain a first correction function, wherein the first correction function is: Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected; The second correction function determination unit is used for, if the aberration type is a high-order aberration, taking the inverse of the second point spread function to obtain a second correction function, wherein the second correction function is: Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected; The third correction function determination unit is used to take the inverse of the third point spread function to obtain a third correction function if the aberration type is a mixed aberration, wherein the third correction function is: Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions in the position of the cloudy area of ​​the patient's eye to be corrected.

9. A computer device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the integrated imaging light field display method with cataract correction function as claimed in any one of claims 1 to 5 when executing the computer program.

10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the integrated imaging light field display method with cataract correction function as claimed in any one of claims 1 to 5 are implemented.

Images