Retinal defocus detection device and method based on human eye wavefront and retinal imaging

Through the retinal defocus detection equipment based on wavefront and retinal imaging of human eye, the problem that traditional equipment cannot synchronize and detect the refractive topographic map and retinal surface height in real time is solved, and efficient and accurate ophthalmic examination is achieved, providing real-time data support.

CN118717029BActive Publication Date: 2024-11-12CHANGCHUN INST OF OPTICS FINE MECHANICS & PHYSICS CHINESE ACAD OF SCI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411221169.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2024-11-12
Estimated Expiration
2044-09-02

AI Technical Summary

Technical Problem

Traditional refractive detection equipment cannot synchronize and detect fundus retinal surface height in real time, and there are problems of low information age, low efficiency and singularity.

Method used

Design a retinal defocus detection device based on wavefront and retinal imaging of human eye. Through the illumination light path, fixed light path and measurement light path, the human eye wavefront information and retinal imaging information are obtained by using one exposure, and the retinal defocusing topographic map is generated, using a ring shape. Illumination light sources, tunable filters and stereo vision algorithms reduce the impact of corneal reflections and improve detection accuracy.

Benefits of technology

Real-time capture and analysis of height changes in the retinal surface of the fundus is achieved, which improves the efficiency and accuracy of ophthalmic examinations, reduces the impact of human eye jitter on detection, and provides more reliable data support.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118717029B_ABST
    Figure CN118717029B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of medical imaging, and in particular to a retinal defocus detection device and method based on human eye wavefront and retinal imaging, the method comprising S1: taking a single exposure shot of the retina of a human eye to be tested, and simultaneously acquiring human eye wavefront information and retinal imaging information based on the measurement light reflected by the retina; S2: generating human eye refractive information based on the human eye wavefront information and generating retinal surface height information based on the retinal imaging information; S3: calculating retinal defocus information based on the human eye refractive information and retinal surface height information, and generating a retinal defocus topography map based on the retinal defocus information. The present invention synchronously detects and quickly acquires human eye wavefront information and retinal surface height information based on the measurement light, thereby acquiring retinal defocus information and displaying it in real time, which is helpful for immediate decision-making and treatment follow-up, not only improving the efficiency and accuracy of ophthalmic examinations, but also providing more reliable data support for ophthalmologists in the treatment and management of eye diseases.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of medical imaging technology, and in particular relates to a retinal defocus detection device and method based on human eye wavefront and retinal imaging. Background Art

[0002] Traditional refractive testing equipment can perform the following tests:

[0003] 1. Perform two-dimensional imaging of the fundus, compensate the fundus image by focusing, and then perform refraction detection based on the compensation amount. This detection method takes a long time;

[0004] 2. Use a microlens array to obtain the wavefront of the human eye for aberration detection;

[0005] 3. Use a microlens array to obtain a single defocus value of the diopter.

[0006] The information obtained by the above method has the problems of low timeliness, low efficiency and singleness. Summary of the invention

[0007] In view of this, the present invention aims to provide a retinal defocus detection device and a detection method thereof based on human eye wavefront and retinal imaging, so as to solve the technical problem that traditional refractive detection equipment cannot synchronously and real-time detect the fundus refractive topography and the fundus retinal surface height.

[0008] To achieve the above object, the technical solution created by the present invention is implemented as follows:

[0009] A retinal defocus detection device based on human eye wavefront and retinal imaging, comprising:

[0010] The illumination optical path is used to evenly project the illumination light onto the retina of the human eye to be measured, and the retina reflects the illumination light to form the measurement light; the illumination optical path includes an illumination light source module, an illumination beam splitter, a tunable filter, an illumination lens group and an illumination reflector which are coaxially arranged in sequence along the light propagation direction, and the wavelength range of the illumination light source is 400nm-1000nm;

[0011] The fixation optical path is used to fix the sight direction of the human eye to be tested and reduce the eye movement of the human eye to be tested; the fixation optical path includes a fixation reflector, a fixation module, a fixation lens group and a first beam splitter which are coaxially arranged in sequence along the light propagation direction, the fixation reflector is located in the reflection direction of the illumination beam splitter, and the first beam splitter is located in the reflection direction of the illumination reflector;

[0012] The measuring optical path is used to receive the measuring light reflected by the retina, simultaneously obtain the human eye wavefront information and the retinal imaging information based on the light field information of the measuring light, respectively generate the human eye refractive information and the retinal surface height information through the human eye wavefront information and the retinal imaging information, and generate the retinal defocus topography according to the human eye refractive information and the retinal surface height information; the measuring optical path comprises a relay imaging mirror group, a second beam splitter, a first microlens array, a second microlens array, a retinal defocus image acquisition and processing unit, a human eye wavefront detection and processing unit and an image processing and display terminal, the second beam splitter is located on the image side of the relay imaging mirror group, the first microlens array and the retinal defocus image acquisition and processing unit are sequentially arranged in the transmission direction of the second beam splitter, the second microlens array and the human eye wavefront detection and processing unit are sequentially arranged in the reflection direction of the second beam splitter, the retinal defocus image acquisition and processing unit and the human eye wavefront detection and processing unit are respectively connected to the image processing and display terminal, and the optical path from the second beam splitter to the human eye wavefront detection and processing unit is equal to the optical path to the retinal defocus image acquisition and processing unit.

[0013] Furthermore, the illumination light source module includes an annular illumination light source, a Kohler mirror, an annular aperture, a field aperture and a condenser which are arranged in sequence.

[0014] Furthermore, the annular lighting source includes a red LED, a blue LED and a green LED which are coaxially arranged side by side.

[0015] Furthermore, the fixation module is a projection system for projecting a static fixation image onto the eyes of the person to be tested to fix the direction of the eyes.

[0016] Furthermore, the relay imaging lens group includes a contact eyepiece, a field lens, a third beam splitter, an aperture stop and a relay imaging lens that are coaxially arranged in sequence. The human eye to be tested is in contact with the contact eyepiece, and the aperture stop and the pupil of the human eye to be tested are in a conjugate position.

[0017] Furthermore, the imaging fields of two adjacent microlenses in the first microlens array and the second microlens array partially overlap.

[0018] Furthermore, the retinal defocus image acquisition and processing unit includes an image detector, a retinal image plane calculation module and a retinal surface height calculation module. The detection wavelength range of the image detector is 400nm-1000nm, which is used to detect the measurement light reflected by the retina and obtain image information of the retina at different viewing angles; the retinal image plane calculation module is used to calculate retinal imaging information based on the image information of the retina at different viewing angles using a stereoscopic vision algorithm; the retinal surface height calculation module is used to generate retinal surface height information based on the retinal imaging information.

[0019] Furthermore, the human eye wavefront detection and processing unit includes a wavefront information calculation module and a refractive information calculation module. The wavefront information calculation module is used to calculate the wavefront slope of the human eye to be tested, and obtain the wavefront information of the human eye to be tested according to the wavefront slope of the human eye to be tested; the refractive information calculation module is used to calculate the refractive information of the human eye according to the wavefront information of the human eye to be tested.

[0020] Furthermore, the image processing display terminal is used to calculate retinal defocus information based on human eye refractive information and retinal surface height information, and generate a retinal defocus topography map based on the retinal defocus information.

[0021] A retinal defocus detection method is implemented using the above-mentioned retinal defocus detection device based on human eye wavefront and retinal imaging, comprising the following steps:

[0022] S1: Take a single exposure shot of the retina of the human eye to be tested, and simultaneously obtain the human eye wavefront information and retinal imaging information based on the measurement light reflected by the retina;

[0023] S2: Generate human eye refraction information based on human eye wavefront information and generate retinal surface height information based on retinal imaging information;

[0024] S3: Calculate retinal defocus information based on human eye refraction information and retinal surface height information, and generate a retinal defocus topography map based on the retinal defocus information.

[0025] Furthermore, in step S1, the process of acquiring retinal imaging information based on the measurement light reflected by the retina includes the following steps:

[0026] S11: the measuring light is transmitted to the first microlens array through the relay imaging lens group and the second beam splitter for secondary multi-view imaging to form multiple sub-images, which are then received by the retinal defocused image acquisition and processing unit to obtain retinal images of different view angles;

[0027] S12: Calculate each position on the retinal image surface using a stereoscopic vision algorithm to obtain different axial imaging positions on the retinal surface at each position, and obtain retinal imaging information.

[0028] Furthermore, step S12 specifically includes the following steps:

[0029] S121: obtaining a sub-image set related to each position on the retinal surface, evaluating the sub-image set using a clarity algorithm, obtaining the clearest sub-image in the sub-image set and using it as a reference image, and using the remaining images in the sub-image set as offset images;

[0030] S122: offsetting and matching the offset image to the reference image to obtain offsets of different offset images, and using the offsets of different offset images as disparity information;

[0031] S123: Obtaining different axial imaging positions of the retinal surface at each location based on the disparity information depth ; The calculation formula is as follows:

[0032] ;

[0033] In the formula, d represents the distance between the relay imaging lens group and the first microlens array, disp The parallax corresponding to each axial imaging position on the retinal surface is represented by d 1 represents the object distance when the parallax is 0, base Indicates the distance between the selected sub-image and the center of the microlens.

[0034] Furthermore, in step S2, the retinal surface height information of the human eye to be tested is generated based on different axial imaging positions of the retinal surface at each position.

[0035] Furthermore, in step S1, the process of obtaining the wavefront information of the human eye based on the measurement light reflected by the retina includes the following steps:

[0036] S101: The measurement light is transmitted to the second microlens array through the relay imaging lens group and the second beam splitter, and is received by the human eye wavefront detection processing unit. x Directional wavefront slope and y Directional wavefront slope ;in,

[0037] ;

[0038] ;

[0039] In the formula, m represents the number of the microlens in the x direction, and n represents the number of the microlens in the y direction. M express x 1 / 2 of the total number of microlenses in the direction, N express y 1 / 2 of the total number of microlenses in the direction, Indicates the pixel value of the microlens with sequence numbers m and n received by the pixel with coordinates x and y. r represents the diameter of the microlens, Indicates the focal length of the relay imaging lens group;

[0040] S102: Based on the wavefront slope in the x direction of the human eye and the wavefront slope in the y direction Zernike polynomials are used to reconstruct the wavefront information of the human eye;

[0041] ;

[0042] ;

[0043] In the formula, Represents the wavefront information of the human eye, C i represents the coefficient matrix, C for C i In matrix form, Represents the matrix The transposed matrix of , -1 represents the inverse matrix, Indicates the zernike item, for In matrix form, S express and of superposition.

[0044] Furthermore, in step S2, the human eye refractive information is calculated based on the reconstructed human eye wavefront information. ; Among them, human eye refractive information The calculation formula is as follows:

[0045] ;

[0046] Among them, A represents x The coefficient related to the second-order derivative of the directional wavefront, B represents y The coefficients related to the second derivative of the directional wavefront, Represents the partial differential symbol.

[0047] Furthermore, in step S3, the calculation formula of retinal defocus information is as follows:

[0048] ;

[0049] In the formula, Represents the refractive information of the human eye. depth Represents the different axial imaging positions at each location on the retinal surface depth .

[0050] Compared with the prior art, the invention can achieve the following beneficial effects:

[0051] 1. The present invention adopts a single exposure method and generates a human eye refractive distribution map based on an algorithm. While reducing the image quality reduced by human eye jitter, it avoids damage to the human eye caused by multiple exposures and improves detection safety.

[0052] 2. The present invention adopts an annular lighting source to reduce the reflection of the corneal edge of the Kohler lighting system, achieve uniform illumination of the fundus retina, and minimize the influence of the light reflected from the cornea on the detection accuracy.

[0053] 3. For different fundus tissues, the present invention adopts a tunable filter for filtering to achieve the purpose of switching / screening wavelengths, so that the illumination light source does not need to be changed, and illumination of different fundus tissues can be achieved.

[0054] 4. The present invention can capture and analyze the height changes of the retinal surface of the fundus in real time without physical contact or further processing, thereby improving the efficiency of ophthalmic examinations.

[0055] 5. The present invention is based on synchronous detection of measuring light and quickly obtains the wavefront information of the human eye and the retinal surface height information, and obtains the retinal defocus information from the wavefront information of the human eye and the retinal surface height information and displays it in real time, which is helpful for immediate decision-making and treatment follow-up. This not only improves the efficiency and accuracy of ophthalmic examinations, but also provides more reliable data support for ophthalmologists in the treatment and management of eye diseases. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The drawings constituting part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments and descriptions of the present invention are used to explain the present invention and do not constitute an improper limitation on the present invention. In the drawings:

[0057] Figure 1 A schematic diagram of the structure of a retinal defocus detection device based on human eye wavefront and retinal imaging according to an embodiment of the present invention;

[0058] Figure 2 A schematic diagram of the light path of the illumination light path described in the embodiment of the present invention;

[0059] Figure 3 A schematic diagram of the optical path of the fixation optical path described in an embodiment of the present invention;

[0060] Figure 4 A schematic diagram of a light path of a measuring light path according to an embodiment of the present invention;

[0061] Figure 5 A schematic diagram of the structure of the lighting source module according to an embodiment of the present invention;

[0062] Figure 6 A schematic diagram of a three-dimensional display of the refractive power distribution of a human eye to be tested according to an embodiment of the present invention;

[0063] Figure 7 A schematic diagram of a three-dimensional display of the height of the retinal surface according to an embodiment of the present invention;

[0064] Figure 8 A schematic diagram of the overall process of the retinal defocus detection method according to an embodiment of the present invention;

[0065] Fig. 9 A logical flow chart of the retinal defocus detection method described in an embodiment of the present invention.

[0066] Description of reference numerals:

[0067] Illumination light source module 11, tunable filter 12, illumination lens group 13, illumination reflector 14, illumination beam splitter 15, annular illumination light source 11a, Köhler mirror 11b, annular aperture 11c, field aperture 11d, condenser 11e, fixation reflector 21, fixation module 22, fixation lens group 23, first beam splitter 24, contact eyepiece 31a, field lens 31b, third beam splitter 31c, aperture aperture 31d, relay imaging mirror 31e, first microlens array 32, retinal defocused image acquisition processing unit 33, second beam splitter 34, second microlens array 35, human eye wavefront detection processing unit 36, image processing display terminal 37. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solution and advantages of the invention more clear, the invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the invention and do not constitute a limitation of the invention.

[0069] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0070] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0071] In the description of the invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the invention can be understood according to specific circumstances.

[0072] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments.

[0073] like Figures 1 to 6 As shown, an embodiment of the present invention provides a retinal defocus detection device based on human eye wavefront and retinal imaging, including an illumination optical path, a fixation optical path and a measurement optical path; wherein the illumination optical path is used to uniformly project illumination light onto the retina of the human eye to be tested, and the retina reflects the illumination light to form measurement light; the fixation optical path is used to relax the human eye and further fix the direction of the human eye's line of sight to prevent errors caused by movements such as drift of the human eye; the measurement optical path is used to receive the measurement light reflected by the retina, and simultaneously obtain the human eye wavefront information and retinal imaging information based on the light field information of the measurement light, and generate the human eye refractive information and retinal surface height information respectively through the human eye wavefront information and the retinal imaging information, calculate the retinal defocus information according to the human eye refractive information and the retinal surface height information, and generate a retinal defocus topography map according to the retinal defocus information.

[0074] The illumination optical path comprises an illumination light source module 11, an illumination beam splitter 15, a tunable filter 12, an illumination lens group 13 and an illumination reflector 14 which are coaxially arranged in sequence along the light propagation direction.

[0075] The wavelength range of the illumination light source module 11 is 400nm-1000nm, realizing wide-band uniform illumination of the retina; the illumination light source module 11 comprises an annular illumination light source 11a, a Kohler mirror 11b, an annular aperture 11c, a field aperture 11d, and a condenser lens 11e which are arranged in sequence.

[0076] The annular illumination light source 11a can use LEDs of different wavelengths, for example, red LED, green LED, and blue LED are coaxially arranged side by side. The annular illumination light sources 11a of different wavelengths are configured with different switches to cope with the characteristics of human eyes in different situations. The light source has different reflectivity to wavelengths for different fundus retinal tissues. For example, blood vessels have a higher reflectivity to green. Therefore, by adjusting the switch of a certain wavelength light source, some tissue details can be photographed to obtain detailed information of different fundus retinal tissues.

[0077] The illumination light source module 11 is a Kohler illumination system. The purpose of using the annular illumination light source 11a is to allow the Kohler illumination system to reduce the reflection of the corneal edge and achieve uniform illumination of the fundus retina. More specifically, the light emitted by the annular illumination light source 11a passes through the annular aperture 11c and is in the shape of an annular light, so as to reduce the light reflected from the cornea from affecting the detection accuracy.

[0078] The tunable filter 12 includes but is not limited to an acousto-optic tunable filter and a liquid crystal tunable filter. The function of the tunable filter 12 is to filter the light emitted by the wide-band illumination light source and screen out the specific wavelength of the wide-band illumination light source, so that illumination of different fundus tissues can be achieved without switching the illumination light source.

[0079] The fixation optical path includes a fixation reflector 21, a fixation module 22, a fixation lens group 23, and a first beam splitter 24, which are coaxially arranged in sequence along the light propagation direction; wherein the fixation reflector 21 is located in the reflection direction of the illumination beam splitter 15, and the first beam splitter 24 is located in the reflection direction of the illumination reflector 14. The fixation module 22 is a projection system, which is used to project static patterns, numbers or other patterns to the human eye to be tested, so as to fix the direction of the human eye and ensure that the line of sight of the human eye does not move randomly.

[0080] The measuring optical path is sequentially arranged with a relay imaging lens group, a first microlens array 32, a retinal defocus image acquisition and processing unit 33, a second beam splitter 34, a second microlens array 35, a human eye wavefront detection and processing unit 36, and an image processing and display terminal 37. The human eye to be measured is located on the object side of the relay imaging lens group, the second beam splitter 34 is located on the image side of the relay imaging lens group, the first microlens array 32 and the retinal defocus image acquisition and processing unit 33 are sequentially arranged in the transmission direction of the second beam splitter 34, the second microlens array 35 and the human eye wavefront detection and processing unit 36 ​​are sequentially arranged in the reflection direction of the second beam splitter 34, the retinal defocus image acquisition and processing unit 33 and the human eye wavefront detection and processing unit 36 ​​are respectively connected to the image processing and display terminal 37, and the optical path from the surface of the second beam splitter 34 to the human eye wavefront detection and processing unit 36 ​​is equal to the optical path to the retinal defocus image acquisition and processing unit 33.

[0081] The relay imaging lens group includes a contact eyepiece 31a, a field lens 31b, a third beam splitter 31c, an aperture stop 31d and a relay imaging lens 31e which are coaxially arranged in sequence. The human eye is connected to the contact eyepiece 31a and is combined with a head fixing device to reduce interference from inaccurate measurements caused by head movement. The third beam splitter 31c is located in the light emitting direction of the first beam splitter 24.

[0082] The aperture stop 31d is in a conjugate position with the pupil of the eye to be tested, and the aperture of the aperture stop 31d is adjustable to reduce the influence of external stray light and improve the imaging quality. For example, when the pupil of the eye to be tested is small, the aperture of the aperture stop 31d can be reduced to further separate the light beams of the illumination light path and the measurement light path, thereby improving the imaging quality. For another example, by increasing the aperture of the aperture stop 31d, the light beam entering the eye to be tested can be increased, thereby realizing a wide range of illumination of the fundus retina.

[0083] The first microlens array 32 is used to perform secondary multi-view imaging on the retinal image of the human eye to be measured (i.e., the image formed by the measuring light) collected by the relay imaging lens group. The first microlens array 32 has a plurality of microlenses arranged on the same plane, and the imaging position distribution information of different axial directions on the retinal surface is obtained through the plurality of microlenses.

[0084] Each microlens forms an imaging channel, and the fields of view of the imaging channels of two adjacent microlenses overlap. The purpose of this setting is to obtain image information at the same position twice or more, improve the resolution of image restoration, and further obtain accurate position information.

[0085] The second microlens array 35 is used to acquire the wavefront of the human eye to be measured. The second microlens array 35 has the same structure as the first microlens array 32 to ensure the consistency of information acquisition.

[0086] The second beam splitter 34 is used to split the measurement light reflected by the retina into two beams. The two separated light beams reach the first microlens array 32 and the second microlens array 35 at the same time, ensuring that the human eye wavefront and retinal imaging information are measured simultaneously.

[0087] The second beam splitter 34 is set to split the measuring light into two paths, one path enters the first microlens array 32, and the other path enters the second microlens array 35. Since the optical paths of the two measuring lights are the same, the two measuring lights reach the retinal defocus image acquisition and processing unit 33 and the human eye wavefront detection and processing unit 36 ​​respectively at the same time. The acquisition of human eye wavefront information and retinal imaging information is simultaneous and matched, and is basically not affected by other environments or time. Other devices that detect separately or have mismatched optical paths cannot achieve this effect.

[0088] The retinal defocused image acquisition and processing unit 33 includes an image detector, a retinal image plane calculation module and a retinal surface height calculation module. The detection wavelength range of the image detector is 400nm-1000nm to collect the secondary multi-view images of the first microlens array 32. The image detector adopts but is not limited to photoelectric sensing structures such as CCD and CMOS; the retinal image plane calculation module is used to calculate the secondary multi-view images according to the stereoscopic vision algorithm to obtain the axial different imaging positions of the retinal surface at each position, and then obtain the retinal imaging information; the retinal surface height calculation module is used to generate the retinal surface height information according to the image plane information. The retinal image plane calculation module and the retinal surface height calculation module adopt but are not limited to single-chip microcomputers and computers, and have the ability to process image data to calculate the surface height of different retinal positions.

[0089] The human eye wavefront detection processing unit 36 ​​includes a wavefront information calculation module and a refractive information calculation module. The wavefront information calculation module is used to calculate the wavefront slope of the human eye to be tested collected by the second microlens array 35, and obtain the wavefront information of the human eye to be tested by fitting the wavefront slope of the human eye to be tested; the refractive information calculation module is used to calculate the refractive information of the human eye according to the wavefront information of the human eye to be tested. The wavefront information calculation module and the refractive information calculation module adopt, but are not limited to, devices with image data processing capabilities such as single-chip microcomputers and computers.

[0090] The wide-band illumination light emitted by the illumination light source module 11 is split by the illumination beam splitter 15. A part of the light beam passes through the illumination beam splitter 15 and is screened out by the tunable filter 12 to obtain a light beam of a specific wavelength, and then passes through the illumination lens group 13, the illumination reflector 14, the first beam splitter 24, the third beam splitter 31c, the field lens 31b and the contact eyepiece 31a in sequence to irradiate the human eye to be tested, so as to realize large-scale uniform illumination of the fundus retina. Another part of the light beam enters the fixation module 22 through the reflection of the illumination beam splitter 15 and the fixation reflector 21 in sequence, so as to provide illumination for the fixation module 22. The image projected by the fixation module 22 is irradiated to the human eye to be tested through the fixation lens group 23, the first beam splitter 24, the third beam splitter 31c, the field lens 31b and the contact eyepiece 31a. The measurement light reflected by the retina of the human eye to be tested passes through the contact eyepiece 31a, the field lens 31b, the third beam splitter 31c, the aperture stop 31d, the relay imaging mirror 31a in sequence. e is incident on the second beam splitter 34, and is divided into two paths by the second beam splitter 34. One path of measuring light is transmitted to the first microlens array 32 and received by the retinal defocus image acquisition and processing unit 33. The retinal defocus image acquisition and processing unit 33 receives the position information of the fundus retina of the human eye to be tested at multiple different angles, and obtains the height information of each position of the fundus retina of the human eye to be tested based on the stereoscopic vision algorithm, and then obtains the height information of the fundus retina surface; the other path of measuring light is transmitted to the second microlens array 35, and is received by the human eye wavefront detection processing unit 36, and the human eye wavefront slope is obtained, and the human eye wavefront information is obtained by Zernike polynomial fitting, and the human eye refractive information is further calculated from the human eye wavefront information; finally, the image processing display terminal 37 calculates the retinal defocus information in combination with the human eye refractive information and the fundus retinal surface height information, and generates a retinal defocus topography map according to the retinal defocus information. At the same time, when the image processing and display terminal 37 receives the human eye refractive information and the fundus retinal surface height information, it can generate a human eye refractive distribution map based on the human eye refractive information and display it in three dimensions, and generate a fundus retinal surface height distribution map based on the fundus retinal surface height information and display it in three dimensions.

[0091] It should be noted that the human eye refractive power distribution map is a two-dimensional distribution map or a three-dimensional distribution map. In the process of generating the two-dimensional distribution map, a coordinate system is established with the image center of the retina as the origin, and the refractive power of each imaging position of the retina can be calculated. The refractive power of all imaging positions can be arranged according to the corresponding (x, y) positions to obtain a two-dimensional distribution map. If the two-dimensional distribution map is converted into a three-dimensional display map, the refractive power corresponding to different imaging positions of the retina needs to be represented by the height and color distribution of different areas. The vertical axis "0" coordinate represents hyperopic defocus, and the vertical axis "0" coordinate represents myopic defocus; warm tones represent hyperopic defocus, and cold tones represent myopic defocus. Analogous to the horizon, a higher refractive power than the center is a peak, and the height is the value of the higher refractive power relative to the center. A lower refractive power than the center is a depression, and the depth is the value of the lower refractive power relative to the center.

[0092] The present invention obtains retinal imaging information while obtaining the wavefront information of the human eye through a single exposure shot of the human eye to be tested, calculates the refractive information of the human eye based on the wavefront information, calculates the retinal surface height information based on the retinal imaging information, and then calculates the retinal defocus information based on the refractive information of the human eye and the retinal surface height information and displays it in real time, which helps to make immediate decisions and follow up on treatment. This not only improves the efficiency and accuracy of ophthalmic examinations, but also provides more reliable data support for ophthalmologists in the treatment and management of eye diseases.

[0093] The above content describes in detail the retinal defocus detection device based on human eye wavefront and retinal imaging provided by the embodiment of the present invention. The embodiment of the present invention also provides a retinal defocus detection method, which is implemented using the above-mentioned retinal defocus detection device based on human eye wavefront and retinal imaging.

[0094] like Figure 8 and Fig. 9 As shown, the refraction detection method of the human eye to be tested provided by the embodiment of the present invention comprises the following steps:

[0095] S1: Take a single exposure shot of the retina of the human eye to be tested, and simultaneously obtain the human eye wavefront information and retinal imaging information based on the measurement light reflected by the retina.

[0096] After the illumination light is evenly irradiated to the fundus retina, the fundus retina is exposed and photographed once through the relay imaging lens group. The fundus retina reflects the illumination light to form measurement light. The image formed by the measurement light is an image of different defocus degrees and different angle positions in the retina.

[0097] The measuring light is transmitted to the second spectrometer through the relay imaging lens group, and is divided into two paths through the second spectrometer. One path is received by the retinal defocus image acquisition and processing unit through the first microlens array to obtain retinal imaging information, and the other path is received by the human eye wavefront detection and processing unit through the second microlens array to obtain human eye wavefront information.

[0098] The process of obtaining retinal imaging information based on the measurement light reflected by the retina includes the following steps:

[0099] S11: The measuring light is transmitted to the first microlens array through the relay imaging lens group and the second beam splitter for secondary multi-view imaging to form multiple sub-images, which are then received by the retinal defocused image acquisition and processing unit to obtain retinal images of different view angles.

[0100] S12: Calculate each position on the retinal image surface using a stereoscopic vision algorithm to obtain different axial imaging positions on the retinal surface at each position, and then obtain retinal imaging information.

[0101] Step S12 specifically includes the following steps:

[0102] S121: obtaining a sub-image set related to each position on the retinal surface, evaluating the sub-image set using a clarity algorithm, obtaining the clearest sub-image in the sub-image set and using it as a reference image, and using the remaining images in the sub-image set as offset images;

[0103] S122: offsetting and matching the offset image to the reference image to obtain offsets of different offset images, and using the offsets of different offset images as disparity information;

[0104] S123: Obtaining different axial imaging positions of the retinal surface at each location based on the disparity information depth ; The calculation formula is as follows:

[0105] (1);

[0106] In the formula, d represents the distance between the relay imaging lens group and the first microlens array, disp The parallax corresponding to each axial imaging position on the retinal surface is represented by d 1 represents the object distance when the parallax is 0, base Indicates the distance between the selected sub-image and the center of the microlens.

[0107] The process of obtaining the wavefront information of the human eye based on the measurement light reflected by the retina includes the following steps:

[0108] S101: The measurement light is transmitted to the second microlens array through the relay imaging lens group and the second beam splitter, and is received by the human eye wavefront detection processing unit. x Directional wavefront slope and y Directional wavefront slope ;in,

[0109] (2);

[0110] (3);

[0111] Where m represents the number of the microlens in the x direction, m=0, 1, 2…M, n represents the number of the microlens in the y direction, n=0, 1, 2…N, M express x 1 / 2 of the total number of microlenses in the direction, N express y 1 / 2 of the total number of microlenses in the direction, Indicates the pixel value of the microlens with sequence numbers m and n received by the pixel with coordinates x and y. r represents the diameter of the microlens, Indicates the focal length of the relay imaging lens group;

[0112] S102: Based on the wavefront slope in the x direction of the human eye and the wavefront slope in the y direction Zernike polynomials are used to reconstruct the wavefront information of the human eye;

[0113] (4);

[0114] (5);

[0115] In the formula, Represents the wavefront information of the human eye, C i represents the coefficient matrix, C for C i In matrix form, Represents the matrix The transposed matrix of , -1 represents the inverse matrix, Indicates the zernike item, i represents the item number, represents the coordinates, for In matrix form, for example , express and superposition, for example , ,but .

[0116] S2: Generate human eye refractive information based on human eye wavefront information and generate retinal surface height information based on retinal imaging information.

[0117] Generating retinal surface height information based on retinal imaging information is actually generating retinal surface height information of the human eye to be tested based on different axial imaging positions at each position of the retinal surface.

[0118] Generating human eye refractive information based on human eye wavefront information is actually calculating human eye refractive information based on reconstructed human eye wavefront information. ; Among them, human eye refractive information The calculation formula is as follows:

[0119] (6);

[0120] In the formula, A represents x The coefficient related to the second-order derivative of the directional wavefront, B represents y The coefficients related to the second derivative of the directional wavefront, Represents the partial differential symbol.

[0121] S3: Calculate retinal defocus information based on human eye refraction information and retinal surface height information, and generate a retinal defocus topography map based on the retinal defocus information.

[0122] The calculation formula of retinal defocus information is as follows:

[0123] (7);

[0124] In the formula, Represents the refractive information of the human eye. depth Represents the different axial imaging positions at each location on the retinal surface depth .

[0125] The defocus amount at each retinal position can be calculated using formula (7). The defocus amounts at all positions are arranged according to the corresponding (x, y) positions to obtain the retinal defocus topography.

[0126] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the disclosure of the present invention can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solution disclosed in the present invention can be achieved, and this document does not limit this.

[0127] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A retinal defocus detection method, implemented by using a retinal defocus detection device based on human eye wavefront and retinal imaging, characterized in that: Retinal defocus detection equipment based on human eye wavefront and retinal imaging, including: The illumination optical path is used to evenly project the illumination light onto the retina of the human eye to be measured, and the retina reflects the illumination light to form the measurement light; the illumination optical path includes an illumination light source module, an illumination beam splitter, a tunable filter, an illumination lens group and an illumination reflector which are coaxially arranged in sequence along the light propagation direction, and the wavelength range of the illumination light source is 400nm-1000nm; The fixation optical path is used to fix the sight direction of the human eye to be tested and reduce the eye movement of the human eye to be tested; the fixation optical path includes a fixation reflector, a fixation module, a fixation lens group and a first beam splitter which are coaxially arranged in sequence along the light propagation direction, the fixation reflector is located in the reflection direction of the illumination beam splitter, and the first beam splitter is located in the reflection direction of the illumination reflector; A measuring optical path is used to receive the measuring light reflected by the retina, and simultaneously obtain the human eye wavefront information and the retinal imaging information based on the light field information of the measuring light, and respectively generate the human eye refractive information and the retinal surface height information through the human eye wavefront information and the retinal imaging information, and generate a retinal defocus topography map according to the human eye refractive information and the retinal surface height information; the measuring optical path includes a relay imaging mirror group, a second beam splitter, a first microlens array, a second microlens array, a retinal defocus image acquisition and processing unit, a human eye wavefront detection and processing unit, and an image processing and display terminal, the second beam splitter is located on the image side of the relay imaging mirror group, the first microlens array and the retinal defocus image acquisition and processing unit are sequentially arranged in the transmission direction of the second beam splitter, the second microlens array and the human eye wavefront detection and processing unit are sequentially arranged in the reflection direction of the second beam splitter, the retinal defocus image acquisition and processing unit and the human eye wavefront detection and processing unit are respectively connected to the image processing and display terminal, and the optical path from the second beam splitter to the human eye wavefront detection and processing unit is equal to the optical path to the retinal defocus image acquisition and processing unit; A retinal defocus detection method comprises the following steps: S1: Take a single exposure shot of the retina of the human eye to be tested, and simultaneously obtain the human eye wavefront information and retinal imaging information based on the measurement light reflected by the retina; In step S1, the process of obtaining the wavefront information of the human eye based on the measurement light reflected by the retina includes the following steps: S101: The measurement light is transmitted to the second microlens array through the relay imaging lens group and the second beam splitter, and is received by the human eye wavefront detection processing unit. x Directional wavefront slope and y Directional wavefront slope ;in, ; ; In the formula, m represents the number of the microlens in the x direction, and n represents the number of the microlens in the y direction. M express x 1 / 2 of the total number of microlenses in the direction, N express y 1 / 2 of the total number of microlenses in the direction, Indicates the pixel value of the microlens with sequence numbers m and n received by the pixel with coordinates x and y. r represents the diameter of the microlens, Indicates the focal length of the relay imaging lens group; S102: Based on the wavefront slope in the x direction of the human eye and the wavefront slope in the y direction Zernike polynomials are used to reconstruct the wavefront information of the human eye; ; ; In the formula, Represents the wavefront information of the human eye, C i represents the coefficient matrix, C for C i In matrix form, Represents the matrix The transposed matrix of , -1 represents the inverse matrix, Indicates the zernike item, for In matrix form, S express and The superposition of S2: Generate human eye refraction information based on human eye wavefront information and generate retinal surface height information based on retinal imaging information; S3: Calculate retinal defocus information based on human eye refraction information and retinal surface height information, and generate a retinal defocus topography map based on the retinal defocus information.

2. The retinal defocus detection method according to claim 1, characterized in that: The illumination light source module comprises an annular illumination light source, a Kohler mirror, an annular aperture, a field aperture and a condenser which are arranged in sequence.

3. The retinal defocus detection method according to claim 2, characterized in that: The annular lighting source comprises a red light LED, a blue light LED and a green light LED which are coaxially arranged side by side.

4. The retinal defocus detection method according to claim 1, characterized in that: The fixation module is a projection system used to project a static fixation image onto the eye of the person to be tested in order to fix the eye direction.

5. The retinal defocus detection method according to claim 1, characterized in that: The relay imaging mirror group includes a contact eyepiece, a field lens, a third beam splitter, an aperture diaphragm and a relay imaging mirror which are coaxially arranged in sequence. The human eye to be tested is in contact with the contact eyepiece, and the aperture diaphragm is in a conjugate position with the pupil of the human eye to be tested.

6. The retinal defocus detection method according to claim 1, characterized in that: The imaging fields of two adjacent microlenses in the first microlens array and the second microlens array partially overlap.

7. The retinal defocus detection method according to claim 1, characterized in that: The retinal defocused image acquisition and processing unit includes an image detector, a retinal image plane calculation module and a retinal surface height calculation module. The detection wavelength range of the image detector is 400nm-1000nm, which is used to detect the measurement light reflected by the retina and obtain image information of the retina at different viewing angles; The retinal image plane calculation module is used to calculate the retinal imaging information using a stereoscopic vision algorithm based on the image information of the retina at different viewing angles; the retinal surface height calculation module is used to generate the retinal surface height information based on the retinal imaging information.

8. The retinal defocus detection method according to claim 1, characterized in that: The human eye wavefront detection processing unit includes a wavefront information calculation module and a refractive information calculation module. The wavefront information calculation module is used to calculate the wavefront slope of the human eye to be tested, and obtain the wavefront information of the human eye to be tested according to the wavefront slope of the human eye to be tested. The refractive information calculation module is used to calculate the refractive information of the human eye according to the wavefront information of the human eye to be measured.

9. The retinal defocus detection method according to claim 1, characterized in that: The image processing display terminal is used to calculate retinal defocus information based on human eye refractive information and retinal surface height information, and to generate a retinal defocus topography map based on the retinal defocus information.

10. The retinal defocus detection method according to claim 1, characterized in that: In step S1, the process of acquiring retinal imaging information based on the measurement light reflected by the retina includes the following steps: S11: the measuring light is transmitted to the first microlens array through the relay imaging lens group and the second beam splitter for secondary multi-view imaging to form multiple sub-images, which are then received by the retinal defocused image acquisition and processing unit to obtain retinal images of different view angles; S12: Calculate each position on the retinal image surface using a stereoscopic vision algorithm to obtain different axial imaging positions on the retinal surface at each position, and then obtain retinal imaging information.

11. The retinal defocus detection method according to claim 10, characterized in that: Step S12 specifically includes the following steps: S121: obtaining a sub-image set related to each position on the retinal surface, evaluating the sub-image set using a clarity algorithm, obtaining the clearest sub-image in the sub-image set and using it as a reference image, and using the remaining images in the sub-image set as offset images; S122: offsetting and matching the offset image to the reference image to obtain offsets of different offset images, and using the offsets of different offset images as disparity information; S123: Obtaining different axial imaging positions of the retinal surface at each location based on the disparity information depth ; The calculation formula is as follows: ; In the formula, d represents the distance between the relay imaging lens group and the first microlens array, disp The parallax corresponding to each axial imaging position on the retinal surface is represented by d 1 represents the object distance when the parallax is 0, base Indicates the distance between the selected sub-image and the center of the microlens.

12. The retinal defocus detection method according to claim 10 or 11, characterized in that: In step S2, the retinal surface height information of the human eye to be tested is generated based on different axial imaging positions of the retinal surface at each position.

13. The retinal defocus detection method according to claim 1, characterized in that: In step S2, the human eye refractive information is calculated based on the reconstructed human eye wavefront information ; Among them, human eye refractive information The calculation formula is as follows: ; In the formula, A represents x The coefficient related to the second-order derivative of the directional wavefront, B, is related to y The coefficients related to the second derivative of the directional wavefront, Represents the partial differential symbol.

14. The retinal defocus detection method according to claim 1, characterized in that: In step S3, the calculation formula of retinal defocus information is as follows: ; In the formula, Represents the refractive information of the human eye. depth Represents the different axial imaging positions at each location on the retinal surface depth .