Ophthalmic oct image processing method and apparatus, electronic device, and storage medium
By acquiring panoramic OCT images in a single shot and displaying the fovea region of the retina in real time, the problems of eye movement and stitching errors were solved, and high-quality axial length measurement was achieved.
Patent Information
- Application Number
- PCT/CN2025/102915
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-08-07
- Filing Date
- 2025-06-24
- Publication Date
- 2026-02-12
AI Technical Summary
In existing technologies, eye movement problems and image stitching errors lead to inaccurate measurements of axial length, making it difficult to obtain high-quality panoramic OCT images.
A panoramic OCT image covering the area from the cornea to the retina is obtained by capturing a single image. The fovea region of the retina is then cropped and magnified from the image to display the image quality in real time. This ensures that the corneal epithelial apex is aligned with the fovea of the retina, avoiding time differences and stitching errors.
It improves the accuracy of axial length measurement, reduces errors introduced by eye movement and image stitching, and ensures the quality of panoramic OCT images.
Smart Images

Figure CN2025102915_12022026_PF_FP_ABST
Abstract
Description
Ophthalmic OCT image processing method and device, electronic equipment and storage medium
[0001] The present application claims priority to the Chinese patent application No. 202411083608.5, filed on August 7, 2024, with the Chinese Patent Office, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD
[0002] The present application relates to the technical field of optical coherence tomography, optical biometry, etc., for example, to an ophthalmic OCT image processing method and device, electronic equipment and storage medium. BACKGROUND
[0003] Optical coherence tomography (OCT) is a biomedical optical imaging technology that can be used for ophthalmic imaging. A human eye and an animal eye generally include an anterior segment and a posterior segment, and the axial length generally refers to the length between the corneal epithelial apex of the anterior segment and the macular fovea of the posterior segment.
[0004] The ophthalmic OCT image processing method provided in the related art generally adjusts the delay line position to sequentially or simultaneously perform OCT imaging on the anterior segment and the posterior segment of the eye to be measured, and then splices the anterior segment OCT image and the posterior segment OCT image, and finally measures the axial length of the eye to be measured according to the spliced ophthalmic OCT image.
[0005] In the related art, the eye movement problem and the image splicing error problem affect the axial length measurement. SUMMARY
[0006] The present application provides an ophthalmic OCT image processing method and device, electronic equipment and storage medium, which can display the OCT image of the eye to be measured in real time through panoramic visualization, so that the user can easily observe and capture a high-quality panoramic OCT image with the corneal epithelial apex position and the macular fovea position aligned when capturing the image, thereby overcoming the influence of the eye movement problem and the image splicing error problem on the axial length measurement in the related art, and improving the accuracy of the axial length measurement.
[0007] The present application provides an ophthalmic OCT image processing method, comprising: obtaining and displaying at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image obtained by a single shot, and the imaging range of each panoramic OCT image covers the ocular tissue in the range from the cornea to the retina of the eye to be measured; intercepting a preset image region containing the macular fovea from the displayed panoramic OCT image; and superimposing and displaying the enlarged preset image region in a target region in the displayed panoramic OCT image.
[0008] The application provides an ophthalmic OCT image processing device, comprising: an OCT image display module configured to acquire and display at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image obtained by single shooting and covering eye tissue from cornea to retina of an eye to be measured; an OCT image intercepting module configured to intercept a preset image region containing a macular fovea from the displayed panoramic OCT image; and an OCT image superimposed display module configured to superimpose and display the preset image region after being enlarged by a preset ratio in a target region in the displayed panoramic OCT image.
[0009] The application provides an electronic device, comprising: at least one processor; and a memory connected with the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the ophthalmic OCT image processing method.
[0010] The application provides a computer readable storage medium, which stores computer instructions, and the computer instructions are used to enable a processor to execute the ophthalmic OCT image processing method. BRIEF DESCRIPTION OF DRAWINGS
[0011] Fig. 1 is a flow chart of an ophthalmic OCT image processing method according to an embodiment of the application;
[0012] Fig. 2 is a pupil diagram with an OCT imaging direction according to an embodiment of the application;
[0013] Fig. 3A is a transverse panoramic OCT image according to an embodiment of the application;
[0014] Fig. 3B is an image region containing a macular fovea position intercepted based on Fig. 3A;
[0015] Fig. 3C is a panoramic OCT image superimposed and displayed based on Fig. 3A and Fig. 3B;
[0016] Fig. 4 is a flow chart of an ophthalmic OCT image processing method with image linkage display according to an embodiment of the application;
[0017] Fig. 5 is a schematic diagram of a pupil diagram and a panoramic OCT image linkage display according to an embodiment of the application;
[0018] Fig. 6 is a transverse and longitudinal OCT local diagram according to an embodiment of the application;
[0019] Fig. 7 is a flow chart of an axial length measurement method with panoramic OCT image display according to an embodiment of the present application;
[0020] Fig. 8 is a flow chart of another axial length measurement method with panoramic OCT image display according to an embodiment of the present application;
[0021] Fig. 9A is a transverse eye OCT image according to an embodiment of the present application;
[0022] Fig. 9B is a longitudinal eye OCT image corresponding to Fig. 9A;
[0023] Fig. 10A is another transverse eye OCT image according to an embodiment of the present application;
[0024] Fig. 10B is a longitudinal eye OCT image corresponding to Fig. 10A;
[0025] Fig. 11 is a flow chart of an axial length equivalent measurement method with panoramic OCT image display according to an embodiment of the present application;
[0026] Fig. 12 is a flow chart of an axial length accurate measurement method with panoramic OCT image display according to an embodiment of the present application;
[0027] Fig. 13 is a structural schematic diagram of an ophthalmic OCT image processing device according to an embodiment of the present application;
[0028] Fig. 14 is a structural schematic diagram of an electronic device implementing an ophthalmic OCT image processing method according to an embodiment of the present application. DETAILED DESCRIPTION
[0029] The terms "first", "second", etc. in the specification and claims of the present application and in the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units shown in the embodiments of the present application can also include other processes, methods, systems, products and devices that are not clearly listed, or other steps or units inherent to these processes, methods, systems, products or devices. The acquisition, storage, use, processing, etc. of data in the technical solutions of the present application all comply with the relevant provisions of national laws and regulations.
[0030] Fig. 1 is a flowchart of an ophthalmic OCT image processing method according to an embodiment of the present application. The embodiment is applicable to eye axial length measurement in the case of panoramic OCT imaging of an eye. The method can be executed by an ophthalmic OCT image processing device, which can be implemented in the form of hardware and / or software. The ophthalmic OCT image processing device can be configured in an electronic device (e.g., a computer), which can be connected to an ophthalmic biometer and serve as a host (server) of the ophthalmic biometer.
[0031] In the embodiment, the server connected to the ophthalmic biometer can control the ophthalmic biometer to perform image acquisition (including pupil map acquisition and panoramic OCT imaging of an eye) and measure the eye axial length based on the images acquired by the ophthalmic biometer. In the embodiment, the panoramic OCT imaging of an eye by the ophthalmic biometer means that the device can obtain the OCT imaging of the ocular tissue from the cornea to the retina within the imaging range by single shooting of the eye, i.e., the device can obtain the OCT imaging of the ocular tissue from the cornea to the retina within the imaging range by single shooting of the eye, instead of separately performing OCT imaging of the anterior segment and the posterior segment of the eye or simultaneously performing OCT imaging of the anterior segment and the posterior segment of the eye, and then splicing the OCT imaging of the anterior segment and the posterior segment to obtain the panoramic OCT imaging of the ocular tissue from the cornea to the retina within the imaging range.
[0032] As shown in Fig. 1, the method can include operations S110-S130.
[0033] In operation S110, at least one panoramic OCT image is acquired and displayed, wherein each panoramic OCT image is an OCT image of the ocular tissue from the cornea to the retina within the imaging range of the eye to be measured, which is obtained by single shooting.
[0034] In operation S120, a preset image region containing the fovea of the macula lutea is cropped from the currently displayed panoramic OCT image.
[0035] In operation S130, the cropped preset image region is enlarged according to a preset ratio and then superimposed and displayed in a target region in the currently displayed panoramic OCT image.
[0036] The premise of accurately measuring the axial length of the eye is to collect a high-quality panoramic OCT image, and the high-quality panoramic OCT image requires the optical axis to pass through the corneal epithelial vertex and the macular fovea position of the retina at the same time, that is, the corneal epithelial vertex position and the macular fovea position of the retina need to be aligned. Therefore, in the panoramic OCT image displayed in operation S110, the image region containing the macular fovea position of the retina is intercepted through operation S120, and the image region is enlarged according to a preset ratio and then superimposed and displayed in a target region of the currently displayed panoramic OCT image through operation S130, so that the OCT image of the eye to be measured can be displayed in real time through panoramic visualization, so that the user can observe and judge in real time whether the optical axis in the collected image passes through the corneal epithelial vertex and the macular fovea position of the retina at the same time when collecting the panoramic OCT image of the eye to be measured, thereby guiding the user (doctor) to shoot a high-quality OCT image. Using the high-quality OCT image for subsequent axial length measurement can improve the accuracy of the measurement result. Moreover, in the embodiment of the present application, by realizing the panoramic visualization of the OCT image of the eye to be measured, the user can also observe and judge whether the optical axis in the collected image passes through the corneal epithelial vertex and the macular fovea position of the retina at the same time, to help the user determine whether the image quality of the currently collected panoramic OCT image meets the requirements.
[0037] In one embodiment, when measuring the axial length of the eye to be measured (human eye or animal eye), only one panoramic OCT image can be shot for axial length measurement. This case may be affected by accidental factors (such as the pupil of the person to be measured being blocked or poor fixation), resulting in poor image quality and affecting the axial length measurement result. In another embodiment, when measuring the axial length of the eye to be measured, a group of panoramic OCT images (including multiple panoramic OCT images) can also be shot at one time for axial length measurement, so as to avoid the influence of accidental factors on the axial length measurement result when only one panoramic OCT image is shot. Therefore, in operation S110, at least one panoramic OCT image obtained by the ophthalmic biometry instrument by shooting the eye to be measured once can be obtained for measuring the axial length of the eye to be measured.
[0038] In one embodiment, the panoramic OCT image can include at least one of a transverse panoramic OCT image and a longitudinal panoramic OCT image, the transverse panoramic OCT image being a panoramic OCT image of the eye to be measured shot in a transverse imaging direction, and the longitudinal panoramic OCT image being a panoramic OCT image of the eye to be measured shot in a longitudinal imaging direction.
[0039] In the embodiments of the present application, a plurality of OCT imaging directions can be preset, for example, 12 imaging directions can be set in the pupil diagram as shown in FIG. 2, which include horizontal imaging directions (lateral imaging directions) and vertical imaging directions (longitudinal imaging directions). When the axial length of the eye to be measured needs to be measured, the ophthalmic biometer can be controlled to collect a panoramic OCT image in each of the 12 imaging directions, so that a set of images containing 12 panoramic OCT images can be obtained, wherein a lateral panoramic OCT image can be obtained in the lateral imaging direction, and a longitudinal panoramic OCT image can be obtained in the longitudinal imaging direction.
[0040] Considering the limitation of the display interface of the server connected to the ophthalmic biometer, in one embodiment, only the lateral panoramic OCT image in the at least one panoramic OCT image obtained in operation S110 can be displayed. In another embodiment, for the at least one panoramic OCT image obtained in operation S110, the lateral panoramic OCT image and the longitudinal panoramic OCT image can be simultaneously displayed in the display interface of the server connected to the ophthalmic biometer. Through the embodiments of the present application, the panoramic OCT image of the eye to be measured in the specified imaging direction can be dynamically displayed to the user visually and intuitively in the image collection, so as to assist the user to collect images of higher quality, or to facilitate the user to preliminarily judge whether the collected images meet the use requirements. In another embodiment, in response to the current imaging direction (which can be any imaging direction in the figure) in the pupil diagram as shown in FIG. 2 being triggered, the panoramic OCT image corresponding to the current imaging direction can be displayed in linkage, so as to dynamically display the panoramic OCT image of the eye to be measured in the specified imaging direction to the user visually and intuitively in the image collection, thereby assisting the user to collect images of higher quality, or facilitating the user to preliminarily judge whether the collected images meet the use requirements. In the embodiments of the present application, the OCT imaging of the axial eye can be dynamically panoramic visualized.
[0041] For example, the OCT image as shown in FIG. 3A is a lateral panoramic OCT image collected for the eye to be measured; the image region as shown in FIG. 3B is an image region containing the position of the retinal macular fovea, which is cut from the lateral panoramic OCT image as shown in FIG. 3A; and the OCT image as shown in FIG. 3C is a panoramic OCT image obtained by superimposing the image region as shown in FIG. 3B onto the lateral panoramic OCT image as shown in FIG. 3A after magnifying the image region according to a preset ratio. From the panoramic OCT image as shown in FIG. 3C, it can be visually and intuitively seen that the current optical axis passes through the position of the retinal macular fovea, and therefore the panoramic OCT image can be used as a higher quality OCT image for measuring the axial length of the eye.
[0042] In the related art, when measuring the axial length of the eye, one scheme is to first acquire an anterior segment OCT image of the eye to be measured by single shooting, and then acquire a posterior segment OCT image of the eye to be measured by single shooting (or first acquire a posterior segment OCT image of the eye to be measured by single shooting, and then acquire an anterior segment OCT image of the eye to be measured by single shooting), and then splice the anterior segment OCT image and the posterior segment OCT image obtained by single shooting twice to form a “panoramic OCT image” for axial length measurement. In this scheme, since the anterior segment OCT image and the posterior segment OCT image are obtained by single shooting respectively, there is a time difference between the two separate shootings. In this case, the pupil is easily blocked due to blinking of the person to be measured, or the corneal epithelial vertex position and the retinal macular fovea position in the panoramic OCT image formed by splicing cannot be aligned due to eye movement of the person to be measured, thereby causing inaccurate axial length measurement. In addition, in this scheme, the image splicing operation itself also introduces errors, affecting the image quality and further affecting the accuracy of the axial length measurement result.
[0043] In the related art, when measuring the axial length of the eye, another scheme is to first simultaneously and separately perform OCT imaging on the anterior segment and the posterior segment of the eye to be measured, and then splice the anterior segment OCT image obtained by single shooting and the posterior segment OCT image obtained by single shooting to form a panoramic OCT image for axial length measurement. In this scheme, although the anterior segment OCT image and the posterior segment OCT image are obtained by single shooting at the same time, there is no time difference problem, and further there is no problem such as the pupil being blocked due to blinking of the person to be measured or the corneal epithelial vertex position and the retinal macular fovea position in the panoramic OCT image formed by splicing cannot be aligned due to eye movement of the person to be measured. However, this scheme still needs to splice the two OCT images (anterior segment OCT image and posterior segment OCT image) into a “panoramic OCT image” first, and then perform axial length measurement based on the “panoramic OCT image” formed by splicing, so this scheme still has the problem of errors introduced by the image splicing operation, and thus this scheme also has the problem of inaccurate axial length measurement.
[0044] Unlike the related art, the technical scheme provided in the embodiments of the present application, when measuring the axial length of the eye, since the OCT images obtained by single shooting are all panoramic OCT images whose imaging range covers the anterior segment tissue and the posterior segment tissue at the same time, there is no time difference problem caused by separately performing OCT imaging on the anterior segment and the posterior segment, and there is also no error problem caused by image splicing, thereby improving the quality of the OCT image. Therefore, the embodiments of the present application realize true axial length measurement by true panoramic OCT imaging of the eye, and can improve the accuracy of the axial length measurement.
[0045] In an optional embodiment, the operation S120 of cropping the preset image region containing the fovea of the retina from the currently displayed panoramic OCT image can include: cropping a middle image region from the currently displayed panoramic OCT image to obtain a retinal OCT image; performing brightness identification on the retinal OCT image to determine a position of maximum brightness; cropping a target image region from the retinal OCT image based on the position of maximum brightness and a preset display range; and taking the cropped target image region as the preset image region containing the fovea of the retina.
[0046] In this embodiment, after obtaining the retinal OCT image, the average brightness of each row of pixels in the retinal OCT image can be determined, and then the position of maximum pixel brightness in the retinal OCT image is found using the sliding window method, and a target image region is cropped from the retinal OCT image based on the position of maximum pixel brightness and a preset display range, and then the cropped target image region is taken as the preset image region containing the fovea of the retina, and the target image region is enlarged by a preset ratio and then superimposed and displayed in the target region in the currently displayed OCT image.
[0047] In the embodiments of the present application, the target image region containing the fovea of the retina in the panoramic OCT image is accurately positioned and cropped, and the target image region is enlarged and then superimposed and displayed in the target region in the panoramic OCT image, which can facilitate the user to observe and judge in real time whether the optical axis in the collected image passes through the vertex of the corneal epithelium and the position of the fovea of the retina at the same time, so as to screen out high-quality panoramic OCT images.
[0048] In an embodiment, in addition to the operations S110-S130 as shown in FIG. 1, the ophthalmic OCT image processing method can further include operations S440-S460 as shown in FIG. 4.
[0049] In the embodiments of the present application, the operations S110-S130 correspond to the operations S110-S130 in the embodiment as shown in FIG. 1, which are the same or similar, and will not be repeated here.
[0050] The operation S440 obtains and displays a pupil map of the eye to be measured.
[0051] The operation S450 determines the imaging direction of each panoramic OCT image in the at least one panoramic OCT image obtained in the operation S110.
[0052] The operation S460 superimposes and displays the imaging direction of each panoramic OCT image determined in the operation S450 in the displayed pupil map.
[0053] In the embodiment of the present application, the pupil diagram of the to-be-measured eye can be collected by the ophthalmic biometer. Therefore, in operation S440, the ophthalmic biometer can be controlled to collect the pupil diagram of the to-be-measured eye and display the currently collected pupil diagram in real time on the server side.
[0054] In addition, as described above, in the embodiment of the present application, a plurality of OCT imaging directions can be set in advance, for example, 12 imaging directions can be set in the pupil diagram as shown in FIG. 2, which include horizontal imaging directions (lateral imaging directions) and vertical imaging directions (longitudinal imaging directions). When the axial length of the to-be-measured eye needs to be measured, the ophthalmic biometer can be controlled to collect a panoramic OCT image in each of the 12 imaging directions, so that a group of images containing 12 panoramic OCT images can be obtained. Each image in the image group is stored in association with its imaging direction. Therefore, in operation S450 and operation S460, the imaging direction of each OCT image in the at least one OCT image obtained in operation S110 can be determined according to the association storage relationship between each image in the image group and its imaging direction, and the imaging direction of each OCT image determined in operation S450 can be superimposed and displayed in the currently displayed pupil diagram. For example, each imaging direction can be displayed as a line, and the direction of the line represents the imaging direction.
[0055] In the embodiment of the present application, the pupil diagram of the to-be-measured eye is collected and displayed in real time during the shooting of the panoramic OCT image, and the imaging direction of the panoramic OCT image is displayed in real time in the pupil diagram, so that the user can view and understand the imaging direction of the panoramic OCT image in real time.
[0056] In an optional embodiment, for each imaging direction, in response to the current imaging direction being triggered, the current imaging direction can be specially displayed, for example, by changing the thickness, color or shape of the line representing the imaging direction, and the panoramic OCT image corresponding to the current imaging direction is displayed in linkage.
[0057] In the embodiment, by displaying the pupil diagram, the imaging direction and the panoramic OCT image in the corresponding imaging direction in linkage, the user can view and understand the image quality of the panoramic OCT image in each imaging direction, and then determine whether the image needs to be re-shot to obtain a high-quality OCT image to assist the doctor in accurately judging and evaluating the axial length of the patient's eye.
[0058] For example, as shown in FIG. 5, the displayed pupil diagram and panoramic OCT image are images displayed in linkage, and the panoramic OCT image is a lateral panoramic OCT image. When the user triggers the lateral imaging direction (the imaging direction represented by line a) in the pupil diagram, the line a changes color and increases an arrow, and the panoramic OCT image display area displays the lateral panoramic OCT image in association.
[0059] In an optional embodiment, the imaging directions of the at least one panoramic OCT image can include a transverse imaging direction and a longitudinal imaging direction, i.e., the transverse imaging direction and the longitudinal imaging direction can also be specially displayed in the pupil diagram, and all or part of the OCT image corresponding to the transverse imaging direction and all or part of the OCT image corresponding to the longitudinal imaging direction can be displayed in linkage.
[0060] In an embodiment, considering the limitation of the display interface, the partial OCT image can be displayed by default. Exemplarily, the OCT partial image can be an anterior segment OCT image, which is an OCT image of the anterior segment portion cut from the panoramic OCT image. In another embodiment, the entire OCT image can be displayed so as to allow the user to observe the panoramic OCT image more comprehensively.
[0061] Exemplarily, the transverse OCT partial image (left image) and the longitudinal OCT partial image (right image) displayed in the display interface shown in FIG. 6 can be images displayed in linkage with the pupil diagram shown in FIG. 5. In this embodiment, through the linkage display, when the panoramic OCT image is taken, the user can conveniently preview and observe whether the optical axis appears in both the transverse OCT partial image and the longitudinal OCT partial image. If the optical axis appears in both the transverse OCT partial image and the longitudinal OCT partial image, it indicates that in this case, the OCT image shooting key is pressed to obtain a panoramic OCT image of higher quality. Therefore, the dynamic visualization linkage display scheme provided in this embodiment can guide the user to collect a panoramic OCT image of higher quality, thereby providing image support for subsequent accurate measurement of the axial length.
[0062] In an embodiment, in addition to the operations S110-S130 shown in FIG. 1, the ophthalmic OCT image processing method can further include operations S740-S750 shown in FIG. 7.
[0063] In the embodiment of the present application, the operations S110-S130 correspond to the operations S110-S130 in the embodiment shown in FIG. 1, and are the same or similar, which will not be described herein again.
[0064] In operation S740, position recognition is performed on the at least one panoramic OCT image to obtain a plurality of target positions, wherein the plurality of target positions at least include a corneal epithelial vertex position and a retinal macular fovea position.
[0065] In operation S750, the axial length of the eye to be measured is determined based on the plurality of target positions.
[0066] The axial length of the eye refers to the length between the corneal epithelial vertex and the fovea of the macula of the retina. Therefore, in the embodiments of the present application, in operation S740 and operation S750, the panoramic OCT images obtained in operation S110 can be subjected to position recognition, and the axial length of the eye to be measured can be calculated based on the target positions including at least the corneal epithelial vertex and the fovea of the macula of the retina obtained from the same panoramic OCT image. In another embodiment of the present application, in operation S740, high-quality images can be first selected from all the panoramic OCT images obtained in operation S110, and then the selected high-quality images can be subjected to position recognition for axial length measurement.
[0067] In operation S740, for each panoramic OCT image used for axial length measurement, the position recognition of the image can be performed by a shortest path algorithm such as Dijkstra algorithm, so as to obtain the target positions in each panoramic OCT image.
[0068] In one embodiment, in operation S750, for each panoramic OCT image used for axial length measurement, the axial length of the eye to be measured can be calculated only according to the corneal epithelial vertex and the fovea of the macula of the retina of each panoramic OCT image obtained in operation S740, and the average refractive index (equivalent refractive index) of the ocular tissues between the corneal epithelium and the retina and the axial resolution of the image. In another embodiment, in operation S740, for each panoramic OCT image used for axial length measurement, the target positions obtained can include not only the corneal epithelial vertex and the fovea of the macula of the retina, but also specific positions of other ocular tissues between the cornea and the retina. In this case, in operation S750, the axial length of the eye to be measured can be more accurately calculated according to the corneal epithelial vertex and the fovea of the macula of the retina and the specific positions of other ocular tissues between the cornea and the retina, and the actual refractive index of each layer of ocular tissues between the corneal epithelium and the retina and the axial resolution of the image.
[0069] Unlike the related art, the technical solutions provided in the embodiments of the present application do not have the time difference problem and its influence problem caused by separate OCT imaging of the anterior segment and separate OCT imaging of the posterior segment, and do not have the error problem introduced by image stitching, because the OCT images obtained by single shooting are all panoramic OCT images whose imaging range covers both the anterior segment and the posterior segment. Therefore, the embodiments of the present application realize true axial length measurement by true ophthalmic panoramic OCT imaging, and can improve the accuracy of axial length measurement.
[0070] As described above, in order to improve the accuracy of the measurement result, multiple panoramic OCT images of the eye can be taken at one time for axial length measurement. However, in actual operation, the subject may blink or have poor fixation, which may result in one or more images of poor quality in the multiple panoramic OCT images taken, thereby affecting the accuracy of the measurement result. Therefore, in an embodiment of the present application, in operation S740, in order to further improve the accuracy of the measurement result, for all panoramic OCT images obtained in operation S110, the images of high quality can be selected first, and then the selected images of high quality are subjected to position recognition for axial length measurement.
[0071] As shown in FIG. 8, the ophthalmic OCT image processing method includes operations S110-S130, S841, S842, and S750.
[0072] Operation S110, acquiring and displaying at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image of the ocular tissue in the cornea to the retina range of the eye obtained by a single shot.
[0073] Operation S120, cutting a preset image region containing the fovea of the macula lutea from the currently displayed panoramic OCT image.
[0074] Operation S130, superimposing and displaying the cut preset image region in the target region in the currently displayed panoramic OCT image after magnifying the preset image region by a preset ratio.
[0075] Operation S841, performing optical axis recognition on the at least one panoramic OCT image obtained in operation S110 to obtain at least one target OCT image containing the optical axis in the at least one OCT image.
[0076] Operation S842, performing position recognition on the at least one target OCT image obtained in operation S841 to obtain multiple target positions, wherein the multiple target positions at least include the corneal epithelial vertex position and the fovea of the macula lutea position.
[0077] Operation S750, determining the axial length of the eye based on the multiple target positions.
[0078] In the embodiment of the present application, operation S110 and S130 correspond to the same as operation S110 and S130 shown in FIG. 1, respectively, and operation S750 corresponds to the same as operation S750 shown in FIG. 7. The present embodiment will not be described here.
[0079] In the process of taking the ophthalmic panoramic OCT images by using the ophthalmic biometer, if the subject blinks or has poor fixation, the optical axis cannot be seen in the taken panoramic OCT images. On the contrary, if the subject does not blink or has no poor fixation during the taking process, the optical axis can be seen in the taken panoramic OCT images. Therefore, in the embodiment of the present application, when the high-quality images are screened, the optical axis recognition is performed on the at least one panoramic OCT image obtained in operation S110, and the image containing the optical axis is obtained as the target OCT image for the axial length measurement. The image not containing the optical axis is discarded in the axial length measurement. That is, in operation S842, only the position recognition is performed on all the target OCT images obtained in operation S841 to obtain the target position for determining the axial length of the subject eye.
[0080] For example, it is assumed that the taken set of panoramic OCT images includes the transverse eye OCT image as shown in FIG. 9A and the longitudinal eye OCT image as shown in FIG. 9B, wherein the imaging directions of the transverse eye OCT image and the longitudinal eye OCT image are perpendicular to each other. As can be seen from the figures, both the transverse eye OCT image and the longitudinal eye OCT image contain the optical axis. In this case, both the OCT images are considered to be high-quality images, and the corneal epithelial apex position and the retinal macular fovea position in the images are aligned. The OCT images can be retained for subsequent axial length calculation. For example, it is assumed that another taken set of panoramic OCT images includes the transverse eye OCT image as shown in FIG. 10A and the longitudinal eye OCT image as shown in FIG. 10B. As can be seen from the figures, the transverse eye OCT image does not contain the optical axis. In this case, the transverse eye OCT image is considered to be a low-quality image, and the corneal epithelial apex position and the retinal macular fovea position in the image are not aligned. The OCT image can be removed and no longer used for subsequent axial length calculation.
[0081] In the embodiment of the present application, the high-quality panoramic OCT images containing the optical axis can be screened by the optical axis recognition, and the low-quality panoramic OCT images without the optical axis are removed. Finally, only the high-quality panoramic OCT images are used for the axial length measurement. Therefore, the accuracy of the axial length measurement can be further improved in the embodiment of the present application.
[0082] In addition, in the embodiment of the present application, in operation S841, if the number of the target OCT images containing the optical axis obtained after the optical axis recognition on all the panoramic OCT images obtained in operation S110 is small, it indicates that the overall quality of the taken set of panoramic OCT images is poor. In this case, if the set of images is still used for the axial length measurement, the accuracy of the measurement result cannot be ensured.
[0083] Therefore, in an optional embodiment of the present application, if the number of target OCT images obtained after optical axis recognition is small, the user (doctor) can also be prompted to re-shoot a set of panoramic OCT images for axial length measurement. Illustratively, the method can further include: in response to the number of at least one target OCT image obtained in operation S841 being less than a preset value, prompting the user to re-shoot a set of panoramic OCT images for the eye to be measured for axial length measurement.
[0084] In an embodiment of the present application, the number of OCT images that need to be taken in a set of panoramic OCT images and the above-mentioned preset value can be self-defined according to experimental or statistical values, which are not limited in the present embodiment.
[0085] Illustratively, multi-directional panoramic OCT imaging can be performed on the eye to be measured in 12 different imaging directions, thereby obtaining a set of image groups containing 12 panoramic OCT images. If it is found that the number of OCT images containing the optical axis in the set of panoramic OCT image groups is less than 5 based on optical axis recognition screening, it is considered that the overall quality of the OCT images taken this time is poor, which can lead to inaccurate subsequent axial length measurement. Therefore, the user can be prompted in the interactive interface of the server connected with the ophthalmic biometer to re-shoot a set of OCT images for the eye to be measured for axial length measurement, so as to improve the accuracy of axial length measurement.
[0086] In an optional embodiment, the position recognition on the at least one target OCT image obtained in operation S841 to obtain a plurality of target positions can include: for each OCT image in the at least one target OCT image, performing eye tissue recognition (recognizing each layer of eye tissue) based on the current OCT image to determine the corneal epithelial boundary and the retinal pigment epithelial boundary; performing optical axis recognition based on the current OCT image, and determining the first intersection Q1 of the optical axis and the corneal epithelial boundary, and the second intersection Q2 of the optical axis and the retinal pigment epithelial boundary. Wherein, the position corresponding to the first intersection Q1 is the corneal epithelial vertex position, and the position corresponding to the second intersection Q2 is the retinal macular fovea position.
[0087] In an embodiment of the present application, by performing eye tissue recognition and optical axis recognition on each target OCT image, the corneal epithelial vertex position and the retinal macular fovea position can be accurately positioned to assist in improving the accuracy of axial length measurement.
[0088] In another optional embodiment, the position recognition on the at least one target OCT image obtained in operation S841 to obtain a plurality of target positions can include: for each OCT image in the at least one target OCT image, performing eye tissue recognition based on the current OCT image to determine a corneal epithelial boundary, a subcorneal epithelial boundary, a lens anterior surface, a lens posterior surface and a retinal pigment epithelial boundary; performing optical axis recognition based on the current OCT image, and determining a first intersection Q1 of the optical axis and the corneal epithelial boundary, a fifth intersection Q5 of the optical axis and the subcorneal epithelial boundary, a third intersection Q3 of the optical axis and the lens anterior surface, a fourth intersection Q4 of the optical axis and the lens posterior surface, and a second intersection Q2 of the optical axis and the retinal pigment epithelial boundary. The position corresponding to the first intersection Q1 can be determined as the corneal epithelial vertex position, the position corresponding to the fifth intersection Q5 can be determined as the corneal endothelial intersection position, the position corresponding to the third intersection Q3 can be determined as the lens anterior surface intersection position, the position corresponding to the fourth intersection Q4 can be determined as the lens posterior surface intersection position, and the position corresponding to the second intersection Q2 can be determined as the retinal macular fovea position.
[0089] In the embodiments of the present application, by performing eye tissue recognition and optical axis recognition on each target OCT image, the corneal epithelial vertex position, the corneal endothelial intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position and the retinal macular fovea position can be accurately positioned to assist in improving the accuracy of the axial length measurement in the axial length precise model calculation.
[0090] In addition, in other optional embodiments, when the position recognition is performed on the at least one panoramic OCT image in operation S740 to obtain a plurality of target positions, a similar method provided in the above embodiments can also be used to process each panoramic OCT image, which will not be described herein. In the embodiments of the present application, by performing eye tissue recognition and optical axis recognition on each panoramic OCT image, the corneal epithelial vertex position and the retinal macular fovea position (or the corneal epithelial vertex position, the corneal endothelial intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position and the retinal macular fovea position) can be accurately positioned to assist in improving the accuracy of the axial length measurement.
[0091] In an embodiment of the present application, an equivalent model calculation method of the axial length is provided. Using the equivalent model calculation method of the axial length, the corneal endothelial intersection position, the lens anterior surface intersection position and the lens posterior surface intersection position do not need to be positioned, but only the corneal epithelial vertex position and the retinal macular fovea position are positioned, and the axial length can be calculated using the equivalent model of the axial length.
[0092] In another embodiment of the present application, an accurate axial length model calculation method is provided. Using the accurate axial length model calculation method, the corneal epithelial vertex position, the corneal endothelial intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position and the macular fovea position can be located for the accurate axial length model calculation.
[0093] For the axial length equivalent model calculation method, as shown in FIG. 11, the method includes operations S110-S130, S740 and S1151.
[0094] Operation S110, at least one panoramic OCT image is acquired and displayed, wherein each panoramic OCT image is an OCT image obtained by a single shot, and the imaging range covers the ocular tissue from the cornea to the retina of the eye to be measured.
[0095] Operation S120, a preset image region containing the macular fovea of the retina is cropped from the currently displayed panoramic OCT image.
[0096] Operation S130, the cropped preset image region is enlarged by a preset ratio and then superimposed and displayed in the target region in the currently displayed panoramic OCT image.
[0097] Operation S740, position recognition is performed on the at least one panoramic OCT image to obtain a plurality of target positions, wherein the plurality of target positions at least include the corneal epithelial vertex position and the macular fovea position of the retina.
[0098] Operation S1151, based on the corneal epithelial vertex position and the macular fovea position of the retina, the axial length of the eye to be measured is determined.
[0099] In the embodiment of the present application, operations S110-S130, S740 correspond to operations S110-S130, S740 shown in FIG. 7 respectively, and the embodiment will not be described here.
[0100] In an optional embodiment, operation S1151 can include: calculating an initial distance L0 between the corneal epithelial vertex position and the macular fovea position of the retina; and based on the initial distance L0, the image axial resolution and the equivalent refractive index of the ocular tissue, obtaining the equivalent axial length of the eye to be measured.
[0101] Exemplarily, the initial distance L0 between the retinal fovea position and the corneal epithelial vertex position can be calculated according to the pixel coordinates of the retinal fovea position and the pixel coordinates of the corneal epithelial vertex position, and then the initial distance L0 is multiplied by the axial resolution of the image to obtain the optical length of the axial length of the eye, and then the optical length of the axial length of the eye is converted based on the equivalent refractive index of the ocular tissue to finally obtain the equivalent axial length of the eye to be measured. For example, the calculated optical length of the axial length of the eye can be divided by the equivalent refractive index of the ocular tissue to obtain the equivalent axial length of the eye to be measured.
[0102] In the embodiments of the present application, only the corneal epithelial vertex position and the retinal fovea position are located, and the equivalent calculation of the axial length of the eye can be realized, which simplifies the calculation method of the axial length of the eye and can improve the measurement efficiency of the axial length of the eye.
[0103] For the accurate model calculation method of the axial length of the eye, as shown in FIG. 12, the method includes operations S110-S130, S740 and S1252.
[0104] Operation S110, acquiring and displaying at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image obtained by a single shooting, and the imaging range of each panoramic OCT image covers the ocular tissue in the cornea to the retina of the eye to be measured.
[0105] Operation S120, cutting a preset image region containing the retinal fovea from the currently displayed panoramic OCT image.
[0106] Operation S130, magnifying the cut preset image region by a preset ratio and then superimposing and displaying it in a target region in the currently displayed panoramic OCT image.
[0107] Operation S740, performing position recognition on the at least one panoramic OCT image to obtain a plurality of target positions, wherein the plurality of target positions at least include the corneal epithelial vertex position, the retinal fovea position, the corneal endothelial intersection position, the anterior lens surface intersection position and the posterior lens surface intersection position.
[0108] Operation S1251, determining the axial length of the eye to be measured based on the corneal epithelial vertex position, the corneal endothelial intersection position, the anterior lens surface intersection position, the posterior lens surface intersection position and the retinal fovea position.
[0109] In the embodiments of the present application, operations S110-S130, S740 correspond to operations S110-S130, S740 shown in FIG. 7 respectively, which are the same or similar, and will not be described here.
[0110] Further, in the embodiments of the present application, in operation S740, the eye tissue of each OCT image acquired in operation S110 can be recognized by an image recognition algorithm, so as to recognize the corneal epithelial boundary, the subcorneal epithelial boundary, the anterior lens surface, the posterior lens surface and the retinal pigment epithelial boundary, and to perform optical axis recognition on each OCT image, and to determine the first intersection point Q1 of the optical axis and the corneal epithelial boundary, the fifth intersection point Q5 of the optical axis and the subcorneal epithelial boundary, the third intersection point Q3 of the optical axis and the anterior lens surface, the fourth intersection point Q4 of the optical axis and the posterior lens surface, and the second intersection point Q2 of the optical axis and the retinal pigment epithelial boundary, and further, the position corresponding to the first intersection point Q1 can be determined as the corneal epithelial vertex position, the position corresponding to the fifth intersection point Q5 can be determined as the corneal endothelial intersection position, the position corresponding to the third intersection point Q3 can be determined as the anterior lens surface intersection position, the position corresponding to the fourth intersection point Q4 can be determined as the posterior lens surface intersection position, and the position corresponding to the second intersection point Q2 is the retinal macular fovea position.
[0111] In an optional embodiment, operation S1251 can include: calculating a first distance between the corneal epithelial vertex position and the corneal endothelial intersection position, and obtaining a length L1 of a first ocular axis substructure based on the first distance, the image axial resolution and the corneal refractive index; calculating a second distance between the corneal endothelial intersection position and the anterior lens surface intersection position, and obtaining a length L2 of a second ocular axis substructure based on the second distance, the image axial resolution and the anterior chamber refractive index; calculating a third distance between the anterior lens surface intersection position and the posterior lens surface intersection position, and obtaining a length L3 of a third ocular axis substructure based on the third distance, the image axial resolution and the lens refractive index; calculating a fourth distance between the posterior lens surface intersection position and the retinal macular fovea position, and obtaining a length L4 of a fourth ocular axis substructure based on the fourth distance, the image axial resolution and the vitreous refractive index; and determining the ocular axis length of the to-be-measured eye based on the lengths of the first to fourth ocular axis substructures.
[0112] In this embodiment, the calculation methods of the first distance to the fourth distance are similar to the calculation method of the initial distance L0 in the foregoing embodiment, which will not be described herein. In addition, in this embodiment, the calculation method of each of the length L1 of the first ocular axis substructure to the length L4 of the fourth ocular axis substructure is similar to the calculation method of the equivalent ocular axis length in the foregoing embodiment. For example, when calculating the length L1 of the first ocular axis substructure, the product of the first distance and the image axial resolution can be calculated first to obtain the optical length of the first ocular axis substructure, and then the optical length of the first ocular axis substructure is divided by the refractive index of the cornea to obtain the length L1 of the first ocular axis substructure. The lengths of other ocular axis substructures can also be calculated in a similar manner, except that different refractive indices of the ocular axis substructures are used in the calculation of the lengths of the ocular axis substructures, which will not be described herein.
[0113] In the embodiments of the present application, the positions of the corneal epithelial apex, the corneal endothelial intersection, the anterior lens surface intersection, the posterior lens surface intersection, and the macular fovea of the retina need to be located to achieve accurate calculation of the ocular axis length. In this embodiment, although the calculation method of the accurate ocular axis length is not as simple as the calculation method of the equivalent ocular axis length, the accurate model calculation method of the ocular axis length can improve the measurement accuracy and measurement accuracy of the ocular axis length.
[0114] In the embodiments of the present application, if the optical axis in the panoramic OCT image passes through both the corneal epithelial apex and the macular fovea of the retina, it indicates that the corneal epithelial apex and the macular fovea of the retina of the eye to be measured are aligned.
[0115] FIG. 13 is a structural schematic diagram of an ophthalmic OCT image processing device provided by an embodiment of the present application. As shown in FIG. 13, the device includes: an OCT image display module 1310 configured to acquire and display at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image of ocular tissue in the cornea to retina range of an eye to be measured obtained by a single shooting; an OCT image cutting module 1320 configured to cut a preset image region containing the macular fovea of the retina from a currently displayed panoramic OCT image; and an OCT image superimposed display module 1330 configured to superimpose and display the cut preset image region in a target region in the currently displayed panoramic OCT image after magnifying the cut preset image region by a preset ratio.
[0116] In some optional embodiments, the at least one panoramic OCT image comprises at least one of a transverse panoramic OCT image and a longitudinal panoramic OCT image, the transverse panoramic OCT image being a panoramic OCT image of the eye to be examined taken in a transverse imaging direction, and the longitudinal panoramic OCT image being a panoramic OCT image of the eye to be examined taken in a longitudinal imaging direction.
[0117] In some optional embodiments, the OCT image cropping module 1320 comprises: a retinal OCT image cropping unit configured to crop a middle image region from the currently displayed panoramic OCT image to obtain a retinal OCT image; a maximum brightness position identifying unit configured to identify the brightness of the retinal OCT image to determine a position of maximum brightness; a target image region cropping unit configured to crop a target image region from the retinal OCT image based on the position of maximum brightness and a preset display range; and a preset image region determining unit configured to determine the cropped target image region as the preset image region containing the retinal macular fovea.
[0118] In some optional embodiments, the ophthalmic OCT image processing apparatus further comprises: a pupil map obtaining module configured to obtain and display a pupil map of the eye to be examined; an imaging direction determining module configured to determine an imaging direction of each panoramic OCT image in the at least one panoramic OCT image; and an imaging direction superimposed display module configured to superimpose and display the imaging direction of each panoramic OCT image in the displayed pupil map.
[0119] In some optional embodiments, the ophthalmic OCT image processing apparatus further comprises: a linkage display module configured to, in response to a current imaging direction being triggered, specially display the current imaging direction and linkage display a panoramic OCT image corresponding to the current imaging direction.
[0120] In some optional embodiments, the imaging direction of the at least one panoramic OCT image comprises a transverse imaging direction and a longitudinal imaging direction, and the linkage display module is further configured to: specially display the transverse imaging direction and the longitudinal imaging direction in the pupil map; linkage display all or part of an OCT image corresponding to the transverse imaging direction; and linkage display all or part of an OCT image corresponding to the longitudinal imaging direction.
[0121] In some optional embodiments, the ophthalmic OCT image processing apparatus further comprises: a target position identifying module configured to identify positions of the at least one panoramic OCT image to obtain a plurality of target positions, wherein the plurality of target positions at least include a corneal epithelial apex position and a retinal macular fovea position; and an axial length determining module configured to determine an axial length of the eye to be measured based on the plurality of target positions.
[0122] In some optional embodiments, the target position identifying module comprises: an optical axis identifying unit configured to identify optical axes of the at least one panoramic OCT image to obtain at least one target OCT image containing an optical axis in the at least one OCT image; and a position identifying unit configured to identify positions of the at least one target OCT image to obtain the plurality of target positions.
[0123] In some optional embodiments, the ophthalmic OCT image processing apparatus further comprises: an eye re-shooting module configured to, in response to a number of the at least one target OCT image being less than a preset value, prompt a user to re-shoot a set of panoramic OCT images for axial length measurement of the eye to be measured.
[0124] In some optional embodiments, the position identifying unit is further configured to: for each OCT image in the at least one target OCT image, identify ocular tissues based on a current OCT image to determine a corneal epithelial boundary and a retinal pigment epithelial boundary; identify optical axes based on the current OCT image to determine a first intersection point of an optical axis and the corneal epithelial boundary and a second intersection point of the optical axis and the retinal pigment epithelial boundary; and wherein the position corresponding to the first intersection point is the corneal epithelial apex position and the position corresponding to the second intersection point is the retinal macular fovea position.
[0125] In some optional embodiments, the axial length determining module comprises: an axial length equivalent calculating unit configured to determine the axial length of the eye to be measured based on the corneal epithelial apex position and the retinal macular fovea position.
[0126] In some optional embodiments, the axial length equivalent calculating unit is configured to: calculate an initial distance between the corneal epithelial apex position and the retinal macular fovea position; and obtain an equivalent axial length of the eye to be measured based on the initial distance, an axial resolution of the image, and an equivalent refractive index of ocular tissues.
[0127] In some optional embodiments, the plurality of target positions further comprises: a corneal endothelium intersection position, a lens anterior surface intersection position, and a lens posterior surface intersection position; and the axial length determination module comprises: an axial length accurate calculation unit configured to determine the axial length of the eye to be measured based on the corneal epithelial vertex position, the corneal endothelium intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position, and the retinal macular fovea position.
[0128] In some optional embodiments, the axial length accurate calculation unit is configured to: calculate a first distance between the corneal epithelial vertex position and the corneal endothelium intersection position, and obtain a length of a first axial substructure based on the first distance, an axial resolution of the image, and a corneal refractive index; calculate a second distance between the corneal endothelium intersection position and the lens anterior surface intersection position, and obtain a length of a second axial substructure based on the second distance, the axial resolution of the image, and an anterior chamber refractive index; calculate a third distance between the lens anterior surface intersection position and the lens posterior surface intersection position, and obtain a length of a third axial substructure based on the third distance, the axial resolution of the image, and a lens refractive index; calculate a fourth distance between the lens posterior surface intersection position and the retinal macular fovea position, and obtain a length of a fourth axial substructure based on the fourth distance, the axial resolution of the image, and a vitreous refractive index; and determine the axial length of the eye to be measured based on the lengths of the first axial substructure to the fourth axial substructure.
[0129] The ophthalmic OCT image processing apparatus provided by the embodiments of the present application can perform the ophthalmic OCT image processing method provided by any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of performing the method.
[0130] FIG. 14 shows a structural schematic diagram of an electronic device 10 that can be used to implement embodiments of the present application. The electronic device is intended to represent a variety of forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent a variety of forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices (e.g., headsets, eyewear, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present application described and / or claimed in this document.
[0131] As shown in FIG. 14, the electronic device 10 includes at least one processor 11, and a memory, such as a Read-Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., connected to the at least one processor 11 in communication. The memory stores computer programs executable by the at least one processor 11, and the processor 11 can perform various appropriate actions and processes according to the computer programs stored in the ROM 12 or loaded from the storage unit 18 into the RAM 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An Input / Output (I / O) interface 15 is also connected to the bus 14.
[0132] Various components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc., an output unit 17, such as various types of displays, a speaker, etc., a storage unit 18, such as a magnetic disk, an optical disk, etc., and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.
[0133] The processor 11 can be various general and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various special-purpose Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processing (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as an ophthalmic OCT image processing method including: obtaining and displaying at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image obtained by a single shot with an imaging range covering ocular tissues from the cornea to the retina of an eye under test; cropping a preset image region containing the retinal macular fovea from a currently displayed panoramic OCT image; and superimposing and displaying the cropped preset image region in a target region in the currently displayed panoramic OCT image after being enlarged by a preset scale.
[0134] In some embodiments, the ophthalmic OCT image processing method can be implemented as a computer program tangibly embodied in a computer readable storage medium, e.g., storage unit 18. In some embodiments, parts or all of the computer program can be loaded and / or installed onto electronic device 10 via, e.g., ROM 12 and / or communication unit 19. When the computer program is loaded onto RAM 13 and executed by processor 11, one or more steps of the ophthalmic OCT image processing method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the ophthalmic OCT image processing method by other means, e.g., with the aid of firmware.
[0135] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a complex programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
[0136] Computer programs used to implement the methods of the present application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed by the processor, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.
[0137] In the context of this application, a computer-readable storage medium can be a tangible medium that can contain or store computer programs for use by or in connection with an instruction execution system, apparatus, or device. Computer-readable storage media can include electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0138] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a Cathode-Ray Tube (CRT) or a Liquid Crystal Display (LCD) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
[0139] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a Local Area Network (LAN), a Wide Area Network (WAN), a blockchain network, and the Internet.
[0140] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and virtual private server (VPS) services.
[0141] The various forms of flow shown above can be reordered, additional steps added, or steps deleted. For example, the various steps described in this application can be performed in parallel, in series, or in a different order, as long as the desired results of the technical solutions of the present application are achieved, which are not limited herein.
Claims
1. An ophthalmic optical coherence tomography (OCT) image processing method, comprising: obtaining and displaying at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image covering eye tissue from cornea to retina of an eye to be measured obtained by a single shot; cropping a preset image region containing a macular fovea from the displayed panoramic OCT image; and superimposing and displaying the cropped preset image region in a target region in the displayed panoramic OCT image after being enlarged by a preset ratio. The at least one panoramic OCT image comprises at least one of a transverse panoramic OCT image and a longitudinal panoramic OCT image, the transverse panoramic OCT image being a panoramic OCT image of the eye to be measured taken in a transverse imaging direction, and the longitudinal panoramic OCT image being a panoramic OCT image of the eye to be measured taken in a longitudinal imaging direction. The cropping of the preset image region containing the macular fovea from the displayed panoramic OCT image comprises: cropping a middle image region from the displayed panoramic OCT image to obtain a retina OCT image; performing brightness recognition on the retina OCT image to determine a position of maximum brightness; cropping a target image region from the retina OCT image based on the position of maximum brightness and a preset display range; and taking the cropped target image region as the preset image region containing the macular fovea.
4. The method of claim 1, further comprising: obtaining and displaying a pupil map of the eye to be measured; determining an imaging direction of each panoramic OCT image in the at least one panoramic OCT image; and superimposing and displaying the imaging direction of each panoramic OCT image in the displayed pupil map.
2. The method of claim 1, wherein, 5. The method of claim 4, further comprising: for each imaging direction, in response to the imaging direction being triggered, specially displaying the imaging direction and displaying a panoramic OCT image corresponding to the imaging direction in linkage.
3. The method of claim 1, wherein, The imaging direction of the at least one panoramic OCT image comprises a transverse imaging direction and a longitudinal imaging direction, and the method further comprises: specially displaying the transverse imaging direction and the longitudinal imaging direction in the pupil map; displaying all or part of an OCT image corresponding to the transverse imaging direction in linkage; and displaying all or part of an OCT image corresponding to the longitudinal imaging direction in linkage.
7. The method of claim 1, further comprising: performing position recognition on the at least one panoramic OCT image to obtain a plurality of target positions, wherein the plurality of target positions at least include a corneal epithelial apex position and a macular fovea position; and determining an axial length of the eye to be measured based on the plurality of target positions. The performing of position recognition on the at least one panoramic OCT image to obtain the plurality of target positions comprises: performing optical axis recognition on the at least one panoramic OCT image to obtain at least one target OCT image containing an optical axis in the at least one panoramic OCT image; and performing position recognition on the at least one target OCT image to obtain the plurality of target positions. 6. The method of claim 4, wherein, 8. The method of claim 7, wherein, Position recognition is performed on the at least one target OCT image to obtain the plurality of target positions.
9. The method of claim 8, further comprising: in response to the number of the at least one target OCT image being less than a preset value, prompting a user to re-shoot a set of panoramic OCT images for the eye under test for axial length measurement.
10. The method of claim 8, wherein, Position recognition is performed on the at least one target OCT image to obtain the plurality of target positions, including: For each of the at least one target OCT image, performing eye tissue recognition based on the OCT image to determine a corneal epithelium boundary and a retinal pigment epithelium boundary; performing optical axis recognition based on the OCT image, and determining a first intersection point of an optical axis and the corneal epithelium boundary, and a second intersection point of the optical axis and the retinal pigment epithelium boundary; and wherein the position corresponding to the first intersection point is the corneal epithelium vertex position, and the position corresponding to the second intersection point is the retinal macular fovea position.
11. The method of claim 7, wherein, Based on the plurality of target positions, determining the axial length of the eye under test, including: Based on the corneal epithelium vertex position and the retinal macular fovea position, determining the axial length of the eye under test.
12. The method of claim 11, wherein, Based on the corneal epithelium vertex position and the retinal macular fovea position, determining the axial length of the eye under test, including: calculating an initial distance between the corneal epithelium vertex position and the retinal macular fovea position; and based on the initial distance, an image axial resolution, and an eye tissue equivalent refractive index, obtaining an equivalent axial length of the eye under test.
13. The method of claim 7, wherein: the plurality of target positions further include a corneal endothelium intersection position, a lens anterior surface intersection position, and a lens posterior surface intersection position; wherein, based on the plurality of target positions, determining the axial length of the eye under test, includes: based on the corneal epithelium vertex position, the corneal endothelium intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position, and the retinal macular fovea position, determining the axial length of the eye under test.
14. The method of claim 13, wherein, Based on the corneal epithelium vertex position, the corneal endothelium intersection position, the lens anterior surface intersection position, the lens posterior surface intersection position, and the retinal macular fovea position, determining the axial length of the eye under test, including: calculating a first distance between the corneal epithelium vertex position and the corneal endothelium intersection position, and based on the first distance, an image axial resolution, and a corneal refractive index, obtaining a length of a first axial substructure; calculating a second distance between the corneal endothelium intersection position and the lens anterior surface intersection position, and based on the second distance, the image axial resolution, and an anterior chamber refractive index, obtaining a length of a second axial substructure; calculating a third distance between the lens anterior surface intersection position and the lens posterior surface intersection position, and based on the third distance, the image axial resolution, and a lens refractive index, obtaining a length of a third axial substructure; obtaining a fourth distance between the crystalline lens posterior surface intersection position and the retinal macular fovea position, and obtaining a length of a fourth ocular axial substructure based on the fourth distance, the image axial resolution and the vitreous refractive index; and determining the ocular axial length of the to-be-measured eye based on the length of the first ocular axial substructure, the length of the second ocular axial substructure, the length of the third ocular axial substructure and the length of the fourth ocular axial substructure. 15.An ophthalmic optical coherence tomography (OCT) image display device, comprising: an OCT image display module configured to acquire and display at least one panoramic OCT image, wherein each panoramic OCT image is an OCT image of ocular tissue from the cornea to the retina of a to-be-measured eye obtained by a single shot; an OCT image cropping module configured to crop a preset image region containing a retinal macular fovea from the displayed panoramic OCT image; and an OCT image superimposed display module configured to superimpose and display the cropped preset image region in a target region in the displayed panoramic OCT image after being enlarged by a preset scale. 16.An electronic device, comprising: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the ophthalmic optical coherence tomography (OCT) image processing method of any one of claims 1-14. 17.A computer readable storage medium storing computer instructions for causing a processor to execute the ophthalmic optical coherence tomography (OCT) image processing method of any one of claims 1-14 when executed by the processor.
Citation Information
Patent Citations
OCT apparatus and recording medium
CN110786821A
Ophthalmology OCT image processing method and device, electronic equipment and storage medium
CN119006494A
Fundus observation apparatus, fundus image processing device, and program
JP2009183332A
Imaging method, ophthalmologic apparatus, and program
JP2021048958A
Ophthalmologic apparatus and control method thereof
JP2022123365A