An integrated imaging light field display method and device with cataract correction function

Abstract

The application discloses an integrated imaging light field display method and device with cataract correction function, and the position and size of an eye turbidity area of a patient to be corrected are acquired; if the size of the eye turbidity area is less than or equal to a preset size, the position of the eye turbidity area is used to determine a target pixel position on a micro display, the light emitting unit at the target pixel position is turned off, and a corrected image is obtained; if the size is greater than the preset size, the position of a turbidity area with a large size is used to analyze the eye data after the light emitting unit at the target pixel position is turned off, the type of aberration of the patient to be corrected is obtained, a corresponding point spread function is determined according to the type of aberration, the Fourier transform of a blurred image is performed, a transformed image is obtained, the transformed image is corrected by using a corresponding correction function obtained by using the point spread function, and a corrected image is obtained. Through the above method, the correction accuracy of a cataract patient is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of three-dimensional display, in particular to an integrated imaging light field display method and device with cataract correction function. BACKGROUND

[0002] In the three-dimensional world, the three-dimensional scene is projected onto a two-dimensional display screen, which will cause the loss of depth information. In order to solve this problem, the traditional three-dimensional display technology uses the binocular disparity characteristics of the human eye, and presents images with subtle horizontal disparity to the left and right eyes respectively, so that the brain can combine the visual information of the two eyes, and "perceive" the existence of three-dimensional space through the vergence adjustment mechanism. However, this technology is only an approximate simulation of three-dimensional effect, and cannot provide freely adjustable optical depth, which will cause vergence- accommodation conflict and lead to dizziness and visual discomfort.

[0003] In order to eliminate the vergence-accommodation conflict and realize real three-dimensional display, the current technical path includes holographic display, volumetric three-dimensional display, depth fusion three-dimensional display, integrated imaging light field display, etc. Among them, the integrated imaging light field display technology has the advantages of single-eye depth continuous adjustment and small system volume. Through arranging a microlens array in front of the display screen, the element image array of the real 3D scene is captured and recorded, and then according to the reversibility of the light path, the three-dimensional scene is reconstructed by using the element image array and the microlens array. Figure 1 The common architecture of the virtual image type integrated imaging light field display is shown, which mainly consists of a micro display and a microlens array. The element image array is displayed on the micro display, and after the regulation of the microlens array, the three-dimensional scene can be reconstructed and received by the human eye. However, the light passes through the cornea and the lens to form an image on the retina, and then is transmitted to the brain through the optic nerve, so as to perceive the external world. The normal lens is transparent, while the lens of the cataract patient is cloudy in some or even all areas, which causes visual impairment such as blurred vision, increased myopia, diplopia, halo, photophobia, etc. The existing integrated imaging light field display method still has problems such as low correction accuracy and incompatible correction method in correcting cataract patients. SUMMARY

[0004] In order to solve the above technical problems, the embodiments of the present application provide an integrated imaging light field display method and device with cataract correction function, to solve the technical problem of low correction accuracy of the existing integrated imaging light field display method in correcting cataract patients.

[0005] The first aspect of the embodiments of the present application provides an integrated imaging light field display method with cataract correction function, which comprises:

[0006] obtaining the position and size of the turbid region of the patient's eye to be corrected;

[0007] If the size of the eye turbidity region is less than or equal to the preset size, a target pixel position is determined on the micro display based on the position of the eye turbidity region, a light-emitting unit at the target pixel position is turned off, and a corrected image is obtained;

[0008] If the size of the eye turbidity region is greater than the preset size, a target pixel position is determined on the micro display based on the position and size of the eye turbidity region, a light-emitting unit at the target pixel position is turned off, and an initial corrected image is obtained, eye data of the patient to be corrected is acquired, the eye data is analyzed to obtain an aberration type of the patient to be corrected, a corresponding point spread function is determined according to the aberration type, a transformed image is obtained by performing Fourier transform on the initial corrected image using the correction function, and the transformed image is corrected using the corresponding correction function obtained by the point spread function, and a corrected image is obtained.

[0009] In a possible implementation of the first aspect, the target pixel position is determined on the micro display based on the position of the eye turbidity region, and includes:

[0010] According to the position and size of the eye turbidity region of the patient to be corrected, the eye turbidity region is connected with a plurality of corresponding microlens centers and is extended to a pixel of the micro display to determine an optical path from the micro display to the retina;

[0011] The blur range on the micro display is calculated according to the size of the eye turbidity region of the patient to be corrected, the focal length of the microlens array, and the focal length of the approximate model of the human eye.

[0012] The target pixel position is determined on the micro display according to the blur range, a geometric distance, and the optical path, where the geometric distance is a distance between the micro display and the microlens array.

[0013] In a possible implementation of the first aspect, the corresponding point spread function is determined according to the aberration type, and includes:

[0014] If the aberration type is a low-order aberration, the point spread function is a first point spread function.

[0015] If the aberration type is a high-order aberration, the point spread function is a second point spread function.

[0016] If the aberration type is a mixed aberration, the point spread function is a third point spread function.

[0017] In a possible implementation of the first aspect, the corresponding correction function obtained by the point spread function includes:

[0018] If the aberration type is a low-order aberration, the first point spread function is inverted to obtain a first correction function, where the first correction function is:

[0019]

[0020] In the formula, H1(u,v) is a point spread function, O1(u,v) is a correction function, u and v are spatial frequencies corresponding to the x direction and the y direction of the position of the turbid region of the patient's eye to be corrected, respectively;

[0021] If the type of aberration is high-order aberration, the reciprocal of the second point spread function is taken to obtain a second correction function, wherein the second correction function is:

[0022]

[0023] In the formula, H2(u,v) is a point spread function, O2(u,v) is a correction function, u and v are spatial frequencies corresponding to the x direction and the y direction of the position of the turbid region of the patient's eye to be corrected, respectively;

[0024] If the type of aberration is mixed aberration, the reciprocal of the third point spread function is taken to obtain a third correction function, wherein the third correction function is:

[0025]

[0026] In the formula, H3(u,v) is a point spread function, O3(u,v) is a correction function, u and v are spatial frequencies corresponding to the x direction and the y direction of the position of the turbid region of the patient's eye to be corrected, respectively.

[0027] To solve the same technical problem, a second aspect of an embodiment of the present application provides an integrated imaging light field display device with cataract correction function, the device comprising:

[0028] An acquisition module is configured to acquire the position and size of the turbid region of the patient's eye to be corrected.

[0029] A first correction module is configured to, if the size of the turbid region of the eye is less than or equal to a preset size, determine a target pixel position on the micro display based on the position of the turbid region of the eye, turn off the light-emitting unit at the target pixel position, and obtain a corrected image.

[0030] A second correction module is configured to, if the size of the turbid region of the eye is greater than the preset size, determine a target pixel position on the micro display based on the position and size of the turbid region of the eye, turn off the light-emitting unit at the target pixel position, and obtain an initial corrected image, acquire eye data of the patient to be corrected, analyze the eye data to obtain the type of aberration of the patient to be corrected, determine a corresponding point spread function according to the type of aberration, obtain a transformed image by performing Fourier transform on the initial corrected image using the correction function, correct the transformed image using the corresponding correction function obtained by the point spread function, and obtain a corrected image.

[0031] In a possible implementation manner of the second aspect, the first correction module comprises an optical path determination unit, a blur range determination unit and a target pixel position determination unit, wherein

[0032] The optical path determination unit is configured to connect the eye turbidity region to corresponding micro-lens centers and extend to pixels of the micro-display according to the position and size of the eye turbidity region of the patient to be corrected, to determine the optical path from the micro-display to the retina;

[0033] The blur range determination unit is configured to calculate the blur range on the micro-display according to the size of the eye turbidity region of the patient to be corrected, the focal length of the micro-lens array and the focal length of the approximate model of the human eye;

[0034] The target pixel position determination unit is configured to determine the target pixel position on the micro-display according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the micro-display and the micro-lens array.

[0035] In a possible implementation manner of the second aspect, the second correction module comprises a first point spread function determination unit, a second point spread function determination unit and a third point spread function determination unit,

[0036] The first point spread function determination unit is configured to, if the aberration type is low-order aberration, the point spread function is the first point spread function;

[0037] The second point spread function determination unit is configured to, if the aberration type is high-order aberration, the point spread function is the second point spread function;

[0038] The third point spread function determination unit is configured to, if the aberration type is mixed aberration, the point spread function is the third point spread function.

[0039] In a possible implementation manner of the second aspect, the second correction module further comprises a first correction function determination unit, a second correction function determination unit and a third correction function determination unit, wherein

[0040] The first correction function determination unit is configured to, if the aberration type is low-order aberration, take the inverse of the first point spread function to obtain the first correction function, wherein the first correction function is:

[0041]

[0042] In the formula, H1(u, v) is the point spread function, O1(u, v) is the correction function, and u and v are spatial frequencies corresponding to the x direction and the y direction of the position of the eye turbidity region of the patient to be corrected, respectively.

[0043] The second correction function determination unit is configured to take the inverse of the second point spread function to obtain a second correction function if the type of the aberration is high-order aberration, wherein the second correction function is:

[0044]

[0045] In the formula, H2(u, v) is the point spread function, O2(u, v) is the correction function, u and v are respectively the spatial frequencies corresponding to the x direction and the y direction of the position of the turbid region of the eye of the patient to be corrected;

[0046] The third correction function determination unit is configured to take the inverse of the third point spread function to obtain a third correction function if the type of the aberration is mixed aberration, wherein the third correction function is:

[0047]

[0048] In the formula, H3(u, v) is the point spread function, O3(u, v) is the correction function, u and v are respectively the spatial frequencies corresponding to the x direction and the y direction of the position of the turbid region of the eye of the patient to be corrected.

[0049] The third aspect of the embodiment of the present application provides a computer device, comprising:

[0050] a memory configured to store a computer program;

[0051] a processor configured to execute the computer program to implement the steps of the integrated imaging light field display method with cataract correction function according to the first aspect.

[0052] The fourth aspect of the embodiment of the present application provides a storage medium, and the storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the integrated imaging light field display method with cataract correction function according to the first aspect.

[0053] The technical scheme of the present application has the following advantages:

[0054] The integrated imaging light field display method with cataract correction function provided by the embodiment of the present application acquires the position and size of the turbid region of the eye of the patient to be corrected; if the area of the turbid region of the eye is not large, the target pixel position is determined on the micro display, the light emitting unit at the target pixel position is turned off to obtain the corrected image, and the clear reconstructed image can be seen by the cataract patient by controlling the turning off of part of the pixels of the display panel.

[0055] If the area of the turbid region of the eye is large, the target pixel position is determined on the micro display, the light emitting unit at the target pixel position is turned off, the initial corrected image is obtained, then the eye data of the patient to be corrected is analyzed to obtain the aberration type of the patient to be corrected, the corresponding point spread function is determined according to the aberration type, the initial corrected image is subjected to Fourier transform using the correction function, then the transformed image is corrected according to the corresponding correction function obtained by using the point spread function, and the corrected image is obtained. The above method pre-processes part of the pixels of the display panel to correct the light passing through the mild turbid region of the lens of the cataract patient, so that the cataract patient can obtain clear imaging without losing too much image brightness, and the correction of cataract visual impairment is realized. BRIEF DESCRIPTION OF DRAWINGS

[0056] In order to more clearly illustrate the specific embodiments of the present application or the technical solutions in the prior art, the drawings required to be used in the specific embodiments or the prior art description will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0057] Figure 1 Flow chart of the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0058] Figure 2 Imaging schematic diagram of the lens in the eyeball for the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0059] Figure 3 Imaging schematic diagram when the integrated imaging light field display method corrects cataract vision for the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0060] Figure 4 Working principle schematic diagram of a cataract vision impairment correction device for the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0061] Figure 5 Correction effect comparison schematic diagram of a cataract vision impairment correction device for the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0062] Figure 6 Another cataract vision impairment correction device principle diagram for the integrated imaging light field display method with cataract correction function in the embodiments of the present application;

[0063] Figure 7A correction effect comparison schematic diagram of another cataract vision obstacle correction device with the integrated imaging light field display method with cataract correction function in the embodiment of the present application;

[0064] Figure 8 A structure block diagram of the integrated imaging light field display device with cataract correction function in the embodiment of the present application. DETAILED DESCRIPTION

[0065] The technical solutions in the embodiments of the present application will be clearly and completely described in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0066] In the description of the present application, it should be noted that the terms “first”, “second”, “third” are only for the purpose of description, and cannot be understood as indicating or implying relative importance.

[0067] The integrated imaging light field display method with cataract correction function provided by the embodiments of the present application, as shown in Figure 1 , includes the following steps. Figure 1 The integrated imaging light field display flowchart with cataract correction function includes steps S101-S103, and each step is specifically as follows.

[0068] S101: Obtain the position and size of the turbid region of the patient's eye to be corrected.

[0069] In the present embodiment, as shown in Figure 2 (a), for the eye health population, the lens in the eyeball has good transparency, and can be clearly imaged. For the population with cataract vision obstacle, as shown in Figure 2 (b), the protein in the lens is denatured, causing the lens to be partially or even completely turbid, causing visual obstacles such as blurred vision. Therefore, in order to avoid the imaging blur caused by the light passing through the turbid region in the lens in Figure 3 (a), the part of the pixels on the display panel is controlled not to emit light to avoid the light entering the turbid part in the lens, so as to ensure that the image received by the retina is clear. First, select a suitable imaging device to obtain the position and size of the turbid region of the eye.

[0070] S102: If the size of the turbid region of the eye is less than or equal to the preset size, based on the position of the turbid region of the eye, the target pixel position is determined on the micro display, the light emitting unit at the target pixel position is turned off, and the corrected image is obtained.

[0071] In the present embodiment, as shown in Figure 4As shown, for the cataract patient with slight turbidity in the lens, the light passing through the turbid part can be turned off according to the size, position information and other parameters of the turbid part to avoid imaging blur.

[0072] If the size of the eye turbidity region, i.e. the area, is smaller than the set size threshold, the turbid region of the lens is connected with the corresponding micro-lens centers according to the reversibility of the light path, and is extended to the pixels of the micro-display, so as to determine the pixel positions on the display panel that do not emit light, as shown in (b). Figure 3 In this way, the retina can avoid receiving blurred images, and the true 3D display function of the integrated imaging light field display can make the human eye see the reconstructed three-dimensional scene. In this process, since each pixel of the reconstructed image is composed of a plurality of surface pixels, the pixel missing of the reconstructed image will not occur.

[0073] It should be noted that the set size threshold can be set according to actual needs.

[0074] In an embodiment, the target pixel position on the micro-display is determined based on the position of the eye turbidity region, and includes:

[0075] The eye turbidity region is connected with the corresponding micro-lens centers according to the position and size of the eye turbidity region of the patient to be corrected, and is extended to the pixels of the micro-display, to determine the light path from the micro-display to the retina;

[0076] The blur range on the micro-display is calculated according to the size of the eye turbidity region of the patient to be corrected, the focal length of the micro-lens array and the focal length of the approximate model of the human eye.

[0077] The target pixel position on the micro-display is determined according to the blur range, the geometric distance and the light path, wherein the geometric distance is the distance between the micro-display and the micro-lens array.

[0078] In this embodiment, the eye turbidity region is connected with the corresponding micro-lens centers according to the position and size of the eye turbidity region of the patient to be corrected, and is extended to the pixels of the micro-display, to determine the light path from the micro-display to the retina; the blur range on the micro-display is calculated according to the size of the eye turbidity region of the patient to be corrected, the focal length of the micro-lens array and the focal length of the approximate model of the human eye; and then the target pixel position on the micro-display is determined according to the blur range, the distance between the micro-display and the micro-lens array, and the obtained light path.

[0079] S103: If the size of the ocular turbidity region is greater than the preset size, a target pixel position is determined on the micro display based on the position and size of the ocular turbidity region, the light-emitting unit at the target pixel position is turned off to obtain an initial corrected image, eye data of the patient to be corrected is obtained, the eye data is analyzed to obtain an aberration type of the patient to be corrected, a corresponding point spread function is determined according to the aberration type, a transformed image is obtained by performing Fourier transform on the initial corrected image using the correction function, and the transformed image is corrected using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0080] In this embodiment, if the size of the ocular turbidity region, i.e., the area, is greater than the set size threshold, and the range of the turbid part of the lens is large, the image entering the slightly turbid region of the lens can be preprocessed, so that the light rays of the display screen image can still reconstruct a clear image through the turbid part of the lens.

[0081] After determining the target pixel position on the micro display and turning off the light-emitting unit at the target pixel position to obtain an initial corrected image, the initial corrected image is a blurred image. Then, by analyzing the eye data of the cataract visually impaired person using a wavefront aberration analyzer or other equipment, such as wave aberration or point spread function, the aberration type of the turbid part of the lens can be determined, the point spread function h(x, y) of the aberration of the cataract patient is obtained, and the display screen image for reconstructing a clear virtual image is represented by p(x, y). Then, the blurred imaging affected by the aberration of the turbid part can be approximately expressed as (representing convolution operation).

[0082] Then, Fourier transform is performed on the blurred imaging, and the correction function in the frequency domain is defined as Then, the corrected display screen image is P(u, v)·O(u, v), and the corrected imaging is P(u, v)·O(u, v)·H(u, v)=P(u, v). The inverse Fourier transform is performed on the corrected imaging to obtain p(x, y). By using the correction function in the frequency domain and multiplying it with the display screen image entering the turbid part of the lens for preprocessing, the cataract patient can see the reconstructed clear image. The preprocessing based on inverse filtering is not limited to direct deconvolution, and more robust algorithms such as Wiener filtering can be used.

[0083] The correction effect of the cataract vision correction glasses used by the patient is as shown in Figure 5 , wherein, Figure 5 a is the actual display image, Figure 5 b is the simulated imaging of the cataract patient, Figure 5c. Simulated imaging using cataract correction glasses. Since light passing through the cloudy area is blocked, the corrected image clarity and contrast are significantly improved, but there is a noticeable loss of brightness.

[0084] In one embodiment, determining a corresponding point spread function according to the aberration type includes:

[0085] If the aberration type is low-order aberration, the point spread function is the first point spread function;

[0086] If the aberration type is a higher-order aberration, the point spread function is the second point spread function;

[0087] If the aberration type is mixed aberration, the point spread function is the third point spread function.

[0088] In this embodiment, the aberration types include low-order aberrations, high-order aberrations, and mixed aberrations. Therefore, if the aberration type is low-order aberrations, the point spread function is the first point spread function; if the aberration type is high-order aberrations, the point spread function is the second point spread function; if the aberration type is mixed aberrations, the point spread function is the third point spread function.

[0089] In one embodiment, the corresponding correction function obtained using the point spread function includes:

[0090] If the aberration type is a low-order aberration, the inverse of the first point spread function is taken to obtain the first correction function, where the first correction function is:

[0091]

[0092] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x-direction and y-direction of the position of the cloudy area of ​​the patient's eye to be corrected;

[0093] If the aberration type is a high-order aberration, the inverse of the second point spread function is taken to obtain a second correction function, where the second correction function is:

[0094]

[0095] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x-direction and y-direction of the position of the cloudy area of ​​the patient's eye to be corrected;

[0096] If the aberration type is mixed aberration, the inverse of the third point spread function is taken to obtain the third correction function, where the third correction function is:

[0097]

[0098] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected, respectively.

[0099] In this embodiment, if the aberration type of the cloudy area of ​​the patient's eye to be corrected is a low-order aberration, the inverse of the first point spread function is taken to obtain a first correction function, where the first correction function is:

[0100]

[0101] Where H1(u,v) is the point spread function, O1(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x-direction and y-direction of the position of the cloudy area of ​​the patient's eye to be corrected;

[0102] If the aberration type is a high-order aberration, the inverse of the second point spread function is taken to obtain a second correction function, where the second correction function is:

[0103]

[0104] Where H2(u,v) is the point spread function, O2(u,v) is the correction function, u and v are the spatial frequencies corresponding to the x-direction and y-direction of the position of the cloudy area of ​​the patient's eye to be corrected;

[0105] If the aberration type is mixed aberration, the inverse of the third point spread function is taken to obtain the third correction function, where the third correction function is:

[0106]

[0107] Where H3(u,v) is the point spread function, O3(u,v) is the correction function, and u and v are the spatial frequencies corresponding to the x and y directions of the position of the cloudy area of ​​the patient's eye to be corrected, respectively.

[0108] As an example of this embodiment, the schematic diagram of the cataract vision impairment correction device is as follows: Figure 6 As shown, for cataract patients with uneven lens opacity, the aberration correction of the severely opaque lens area is complex and the light transmittance is low, and the display screen pixels are controlled to shut off the light passing through the severely opaque lens area; the aberration correction of the mildly opaque lens area is simple and the light transmittance is high, and the image passing through the mildly opaque lens area is preprocessed to correct the aberration, so that a clear virtual image can be presented at the retina. This method can enable cataract patients to obtain clear imaging without losing too much image brightness, thereby achieving correction of cataract visual impairment.

[0109] The correction effect of cataract vision impairment correction device used by patients is as follows Figure 7 As shown,Figure 7 a is an actual display image before correction, Figure 7 b is a simulation imaging of a cataract patient before pre-processing, Figure 7 c is a simulation imaging using cataract vision impairment correction glasses that can be pre-processed. Since the light passing through the severe turbidity part is turned off and the image passing through the slightly turbid area of the lens is pre-processed, the corrected imaging clarity and contrast are significantly improved, and the brightness only has a slight loss.

[0110] The method provided by the embodiment of the application can fully utilize the eye data of the patient, realize accurate correction of low-order aberration, high-order aberration and cataract, and has high integration and good compatibility. Through research and application of the technology, the cataract patient can have a clearer and more realistic three-dimensional visual experience.

[0111] The integrated imaging light field display device with cataract correction function provided by the embodiment of the application has the advantages that Figure 8 as shown in the figure, Figure 8 is a block diagram of the integrated imaging light field display device with cataract correction function, comprising:

[0112] The acquisition module 801 is configured to acquire the position and size of the turbid region of the eye of the patient to be corrected.

[0113] The first correction module 802 is configured to, if the size of the turbid region of the eye is less than or equal to a preset size, determine a target pixel position on the micro display based on the position of the turbid region of the eye, turn off the light-emitting unit at the target pixel position, and obtain a corrected image.

[0114] The second correction module 803 is configured to, if the size of the turbid region of the eye is greater than the preset size, determine a target pixel position on the micro display based on the position and size of the turbid region of the eye, turn off the light-emitting unit at the target pixel position, obtain an initial corrected image, acquire the eye data of the patient to be corrected, analyze the eye data to obtain the aberration type of the patient to be corrected, determine the corresponding point spread function according to the aberration type, obtain a transformed image by performing Fourier transform on the initial corrected image using the correction function, and correct the transformed image using the corresponding correction function obtained by the point spread function to obtain a corrected image.

[0115] In an embodiment, the first correction module 802 comprises a light path determination unit, a blur range determination unit and a target pixel position determination unit, wherein,

[0116] The light path determination unit is configured to connect the turbid region of the eye to a plurality of corresponding micro lens centers according to the position and size of the turbid region of the eye of the patient to be corrected, and extend to the pixels of the micro display to determine the light path from the micro display to the retina.

[0117] The blur range determination unit is configured to calculate a blur range on the micro display according to a size of the patient's eye turbidity region to be corrected, a focal length of the micro lens array, and a focal length of the human eye approximate model;

[0118] The target pixel position determination unit is configured to determine a target pixel position on the micro display according to the blur range, a geometric distance, and an optical path, wherein the geometric distance is a distance between the micro display and the micro lens array.

[0119] In an embodiment, the second correction module 803 includes a first point spread function determination unit, a second point spread function determination unit, and a third point spread function determination unit,

[0120] The first point spread function determination unit is configured to, if the aberration type is a low-order aberration, determine the point spread function as a first point spread function.

[0121] The second point spread function determination unit is configured to, if the aberration type is a high-order aberration, determine the point spread function as a second point spread function.

[0122] The third point spread function determination unit is configured to, if the aberration type is a mixed aberration, determine the point spread function as a third point spread function.

[0123] In an embodiment, the second correction module 803 further includes a first correction function determination unit, a second correction function determination unit, and a third correction function determination unit, wherein,

[0124] The first correction function determination unit is configured to, if the aberration type is a low-order aberration, take an inverse of the first point spread function to obtain a first correction function, wherein the first correction function is:

[0125]

[0126] In the formula, H1(u, v) is the point spread function, O1(u, v) is the correction function, and u and v are spatial frequencies corresponding to x and y directions in a position of the patient's eye turbidity region to be corrected, respectively.

[0127] The second correction function determination unit is configured to, if the aberration type is a high-order aberration, take an inverse of the second point spread function to obtain a second correction function, wherein the second correction function is:

[0128]

[0129] In the formula, H2(u, v) is the point spread function, O2(u, v) is the correction function, and u and v are spatial frequencies corresponding to x and y directions in a position of the patient's eye turbidity region to be corrected, respectively.

[0130] The third correction function determination unit is configured to, if the aberration type is a mixed aberration, take an inverse of the third point spread function to obtain a third correction function, wherein the third correction function is:

[0131]

[0132] In the formula, H3(u, v) is the point spread function, O3(u, v) is the correction function, and u and v are respectively the spatial frequencies corresponding to the x direction and the y direction of the position of the turbidity region of the patient's eye to be corrected.

[0133] In an embodiment of the present application, a computer device is provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the above steps when executing the computer program; the computer device provided in the embodiment has similar implementation principles and technical effects to the above method embodiments, and will not be described here.

[0134] In an embodiment of the present application, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the above steps; the computer readable storage medium provided in the embodiment has similar implementation principles and technical effects to the above method embodiments, and will not be described here.

[0135] The technical features of the above embodiments can be combined in any manner. To make the description concise, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combinations of the technical features do not exist contradictions, they should be considered as the scope of the present application.

[0136] The above specific embodiments further illustrate the purpose, technical solutions and advantages of the present application. It should be understood that the above description is only for specific embodiments of the present application and is not intended to limit the protection scope of the present application. It is particularly pointed out that any modification, equivalent replacement, improvement, etc. made by those skilled in the art within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. An integrated imaging light field display method with cataract correction function, characterized in that, The method comprises the following steps: acquiring the position and size of a turbid region of a patient's eye to be corrected; if the size of the turbid region of the eye is less than or equal to a preset size, determining a target pixel position on a micro display based on the position of the turbid region of the eye, turning off a light-emitting unit at the target pixel position, and obtaining a corrected image; if the size of the turbid region of the eye is greater than the preset size, determining a target pixel position on a micro display based on the position and size of the turbid region of the eye, turning off a light-emitting unit at the target pixel position, obtaining an initial corrected image, acquiring eye data of the patient to be corrected, analyzing the eye data to obtain an aberration type of the patient to be corrected, determining a corresponding point spread function according to the aberration type, performing Fourier transform on the initial corrected image to obtain a transformed image, and correcting the transformed image by using a corresponding correction function obtained by using the point spread function, and obtaining a corrected image. 2.The integrated imaging light field display method with cataract correction function of claim 1, wherein, The method further comprises the following steps: connecting the turbid region of the eye to a corresponding plurality of microlens centers according to the position and size of the turbid region of the eye to be corrected, and extending to a pixel of the micro display to determine an optical path from the micro display to the retina; calculating a blur range on the micro display according to the size of the turbid region of the eye, the focal length of the microlens array, and the focal length of an approximate model of the human eye; determining a target pixel position on the micro display according to the blur range, a geometric distance, and the optical path, wherein the geometric distance is the distance between the micro display and the microlens array. 3.The integrated imaging light field display method with cataract correction function of claim 1, wherein, The method further comprises the following steps: if the aberration type is low-order aberration, the point spread function is a first point spread function; if the aberration type is high-order aberration, the point spread function is a second point spread function; if the aberration type is mixed aberration, the point spread function is a third point spread function. 4.The integrated imaging light field display method with cataract correction function of claim 3, wherein, The method further comprises the following steps: if the aberration type is low-order aberration, taking the inverse of the first point spread function to obtain a first correction function, wherein the first correction function is: wherein is a point spread function, is a correction function, , respectively the spatial frequencies corresponding to the directions of direction and direction of the position of the turbid region of the patient's eye to be corrected. if the aberration type is high-order aberration, taking the inverse of the second point spread function to obtain a second correction function, wherein the second correction function is: wherein is a point spread function, is a correction function, , are spatial frequencies corresponding to the directions of directions and directions, respectively. if the aberration type is mixed aberration, taking the inverse of the third point spread function to obtain a third correction function, wherein the third correction function is: wherein is a point spread function, is a correction function, , are spatial frequencies corresponding to the directions of and respectively.

5. An integrated imaging light field display device with cataract correction function, characterized in that, The method comprises the following steps: an acquiring module, configured to acquire the position and size of a turbid region of a patient's eye to be corrected; a first correcting module, configured to, if the size of the turbid region of the eye is less than or equal to a preset size, determine a target pixel position on a micro display based on the position of the turbid region of the eye, turn off a light-emitting unit at the target pixel position, and obtain a corrected image; The second correction module is configured to: if the size of the eye turbidity region is greater than a preset size, determine a target pixel position on the micro display based on the position and the size of the eye turbidity region, turn off a light-emitting unit at the target pixel position, obtain an initial corrected image, acquire eye data of the patient to be corrected, analyze the eye data to obtain an aberration type of the patient to be corrected, determine a corresponding point spread function according to the aberration type, perform Fourier transform on the initial corrected image to obtain a transformed image, and correct the transformed image by using a corresponding correction function obtained by the point spread function to obtain a corrected image.

6. The integrated imaging light field display device with cataract correction function according to claim 5, wherein, The first correction module comprises an optical path determination unit, a blur range determination unit and a target pixel position determination unit, wherein The optical path determination unit is configured to connect the eye turbidity region and a plurality of corresponding micro-lens centers according to the position and the size of the eye turbidity region of the patient to be corrected, and extend to the pixels of the micro display to determine the optical path from the micro display to the retina; The blur range determination unit is configured to calculate the blur range on the micro display according to the size of the eye turbidity region of the patient to be corrected, the focal length of the micro-lens array and the focal length of the approximate model of the human eye; The target pixel position determination unit is configured to determine the target pixel position on the micro display according to the blur range, the geometric distance and the optical path, wherein the geometric distance is the distance between the micro display and the micro-lens array.

7. The integrated imaging light field display device with cataract correction function according to claim 5, wherein, The second correction module comprises a first point spread function determination unit, a second point spread function determination unit and a third point spread function determination unit, The first point spread function determination unit is configured to, if the aberration type is a low-order aberration, determine the point spread function as a first point spread function; The second point spread function determination unit is configured to, if the aberration type is a high-order aberration, determine the point spread function as a second point spread function; The third point spread function determination unit is configured to, if the aberration type is a mixed aberration, determine the point spread function as a third point spread function.

8. The integrated imaging light field display device with cataract correction function of claim 7, wherein, The second correction module further comprises a first correction function determination unit, a second correction function determination unit and a third correction function determination unit, wherein The first correction function determination unit is configured to, if the aberration type is a low-order aberration, take the inverse of the first point spread function to obtain a first correction function, wherein the first correction function is: wherein is a point spread function, is a correction function, , are spatial frequencies corresponding to the directions of and respectively. The second correction function determination unit is configured to, if the aberration type is a high-order aberration, take the inverse of the second point spread function to obtain a second correction function, wherein the second correction function is: wherein is a point spread function, is a correction function, , are spatial frequencies corresponding to the directions of and respectively. The third correction function determination unit is configured to, if the aberration type is a mixed aberration, take the inverse of the third point spread function to obtain a third correction function, wherein the third correction function is: wherein is a point spread function, is a correction function, , are spatial frequencies corresponding to the directions of and respectively.

9. A computer device, comprising: The system comprises: a memory configured to store a computer program; a processor configured to execute the computer program to implement the steps of the integrated imaging light field display method with cataract correction function according to any one of claims 1 to 5.

10. A storage medium, characterized by The storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the integrated imaging light field display method with cataract correction function according to any one of claims 1 to 5.

Images