Refractive Topography Measurement Method, Device, Electronic Device and Readable Storage Medium
By using a fundus imaging device with a movable fixation mark in refractive detection, collecting fundus images in multiple fixation directions, and performing image registration and stitching, the problem of small field angle range of the refractive topographic map is solved, and refractive topographic map measurement with a larger field angle is achieved.
Patent Information
- Application Number
- CN202311049723.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-21
- Publication Date
- 2025-05-30
- Estimated Expiration
- 2043-08-21
AI Technical Summary
The field angle range of the refractive topographic map obtained by the existing refractive detection methods is relatively small, which is difficult to meet the peripheral refractive measurement needs of wearing corneal reticle lenses.
The fundus imaging device with a movable fixation mark collects fundus image sequences in multiple fixation directions, selects target images based on the fundus image clarity, performs registration and spatial transformation, and splices the refractive topographic maps of each fixation direction to generate a refractive topographic map with a larger field of view.
Covering larger corneal and retinal areas, a refractive topographic map with a larger field of view angle range is measured to meet the peripheral refractive measurement needs of wearing corneal reticle lenses.
Smart Images

Figure CN117036318B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of refractive detection, and particularly to a method, device, electronic device and readable storage medium for measuring a refractive topographic map. Background Art
[0002] The refractive information of the peripheral retina area of the human eye is very important for myopia prevention and control. Using appropriate methods to accurately and quickly measure and evaluate the peripheral refractive state is the basis for in-depth research on myopia prevention and control. Currently, the existing refractive measurement methods on the market include skiascopy, open-window optometry and aberration measurement methods. However, these methods are complex in operation, slow in measurement speed, time-consuming and laborious. Another refractive detection method is to take multiple fundus images at different depths of the fundus through a zoom camera, and obtain the refractive distribution of the fundus field of view by processing the sharpness of multiple fundus images. However, due to the size of the field of view angle of the fundus image, the maximum field of view angle range of the obtained refractive topographic map can only cover 60°, which is difficult to meet the peripheral refractive measurement requirements of wearing orthokeratology lenses. Therefore, this refractive detection method also has the situation that the field of view angle range of the refractive topographic map is too small. Summary of the Invention
[0003] The main purpose of the present application is to provide a method, device, electronic device and readable storage medium for measuring a refractive topographic map, aiming to solve the technical problem that the field of view angle range of the refractive topographic map obtained by the current refractive detection method is too small.
[0004] To achieve the above purpose, the present application provides a method for measuring a refractive topographic map, and the method for measuring a refractive topographic map includes:
[0005] Collecting a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each sequence of fundus images through a fundus imaging device with a movable fixation target, and determining the first refractive topographic map of each fixation direction according to the sequence of fundus images of each fixation direction and the corresponding shooting parameters, wherein the position of the movable fixation target includes at least the nasal side and the temporal side;
[0006] Selecting the target fundus image corresponding to each fixation direction from each sequence of fundus images based on the sharpness of each fundus image in each sequence of fundus images of each fixation direction;
[0007] Performing registration on the target fundus images corresponding to each fixation direction respectively to obtain the transformation model corresponding to each target fundus image;
[0008] Performing spatial transformation on the first refractive topographic map of each fixation direction according to the transformation model corresponding to each target fundus image to obtain the second refractive topographic map of each fixation direction;
[0009] Stitch the second refractive topographies of each of the fixation directions to obtain a target refractive topography.
[0010] Optionally, the step of collecting fundus image sequences of a subject in multiple fixation directions and the shooting parameters corresponding to each of the fundus image sequences, and determining the first refractive topography of each of the fixation directions according to the fundus image sequences of each of the fixation directions and the corresponding shooting parameters includes:
[0011] Based on the current position of the fixation target, collect fundus images of the subject under different shooting parameters to obtain a fundus image sequence of the current fixation direction;
[0012] Adjust the position of the fixation target, and return to execute the step: based on the current position of the fixation target, collect fundus images of the subject under different shooting parameters to obtain a fundus image sequence of the current position, until fundus image sequences of a preset number of fixation directions are obtained;
[0013] Determine the first refractive topography of each of the fixation directions according to the fundus image sequences of each of the fixation directions and the shooting parameters of each fundus image in each of the fundus image sequences.
[0014] Optionally, the step of registering the target fundus images respectively corresponding to each of the fixation directions to obtain a transformation model respectively corresponding to each of the target fundus images includes:
[0015] Randomly select two target fundus images of adjacent fixation directions, and use one of the target fundus images as a reference image and the other target fundus image as a to-be-registered image;
[0016] Register the to-be-registered image based on the reference image to obtain a transformation model of the to-be-registered image, wherein the transformation model is one of a rigid transformation model, an affine transformation model or a perspective transformation model;
[0017] Return to execute the step: randomly select two target fundus images of adjacent fixation directions, and use one of the target fundus images as a reference image and the other target fundus image as a to-be-registered image, until transformation models of the target fundus images of all fixation directions are obtained.
[0018] Optionally, the step of registering the to-be-registered image based on the reference image to obtain a transformation model of the to-be-registered image includes:
[0019] Extract the fundus features of the reference image and the to-be-registered image;
[0020] Match the fundus features of the reference image and the to-be-registered image to obtain feature matching points respectively corresponding to the reference image and the to-be-registered image;
[0021] Calculate a transformation model of the image to be registered according to the relative poses between the feature matching points corresponding to the reference image and the image to be registered respectively.
[0022] Optionally, the step of performing a spatial transformation on the first refractive topographic maps in each of the fixation directions according to the transformation models corresponding to the respective target fundus images to obtain the second refractive topographic maps in each of the fixation directions includes:
[0023] Select the target fundus image in the central fixation direction as the reference fundus image;
[0024] Based on the coordinate system where the first refractive map of the reference fundus image is located, convert the first refractive topographic maps in each of the fixation directions into second refractive topographic maps located in the coordinate system according to the transformation models corresponding to the respective target fundus images.
[0025] Optionally, the step of stitching the second refractive topographic maps in each of the fixation directions to obtain a target refractive topographic map includes:
[0026] Based on the relative position relationship between each of the second refractive topographic maps and the first refractive topographic map in the central fixation direction, stitch the second refractive topographic maps in adjacent fixation directions with the first refractive topographic map in the central fixation direction to obtain a third refractive topographic map;
[0027] According to the average diopter of each of the second refractive topographic maps in the overlapping area in the third refractive topographic map, perform diopter compensation on the area of the second refractive topographic map in which the fixation direction is farther from the central fixation direction among the two second refractive topographic maps involved in the overlapping area to obtain a fourth refractive topographic map;
[0028] Determine the weights of the points on the overlapping area with respect to each of the second refractive topographic maps according to the distances between the points on the overlapping area of each of the second refractive topographic maps in the fourth refractive topographic map and each of the second refractive topographic maps;
[0029] Calculate the diopter of the points on the overlapping area according to the weights of the points on the overlapping area with respect to each of the second refractive topographic maps to obtain a target refractive topographic map.
[0030] Optionally, the step of performing diopter compensation on the second refractive topographic map in which the fixation direction is farther from the central fixation direction among the two second refractive topographic maps involved in the overlapping area according to the average diopter of each of the second refractive topographic maps in the overlapping area in the third refractive topographic map to obtain a fourth refractive topographic map includes:
[0031] Calculate the average diopter of each of the second refractive topographic maps in the overlapping area in the third refractive topographic map respectively;
[0032] Calculate the difference between the average diopter of the second refractive topographic map closer to the central fixation direction and the average diopter of the second refractive topographic map farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area to obtain a diopter compensation value;
[0033] Compensate the diopter of the second refractive topographic map farther from the central fixation direction according to the diopter compensation value to obtain a fourth refractive topographic map.
[0034] The present application also provides a refractive topographic map measuring device, which is applied to a refractive topographic map measuring device. The refractive topographic map measuring device includes:
[0035] A refractive power measurement module, configured to collect a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each sequence of fundus images through a fundus imaging device with a movable fixation target, and determine the first refractive topographic map of each fixation direction according to the sequence of fundus images of each fixation direction and the corresponding shooting parameters, wherein the position of the movable fixation target includes at least the nasal side and the temporal side;
[0036] An image selection module, configured to select the target fundus image corresponding to each fixation direction from each sequence of fundus images based on the sharpness of each fundus image in each sequence of fundus images of each fixation direction;
[0037] An image registration module, configured to perform registration on the target fundus images corresponding to each fixation direction respectively to obtain a transformation model corresponding to each target fundus image;
[0038] A spatial transformation module, configured to perform spatial transformation on the first refractive topographic map of each fixation direction according to the transformation model corresponding to each target fundus image to obtain the second refractive topographic map of each fixation direction;
[0039] An image stitching module, configured to stitch the second refractive topographic maps of each fixation direction to obtain a target refractive topographic map.
[0040] The present application also provides an electronic device, which is a physical device. The electronic device includes: a memory, a processor, and a program of the refractive topographic map measuring method stored on the memory and executable on the processor. When the program of the refractive topographic map measuring method is executed by the processor, the steps of the refractive topographic map measuring method as described above can be implemented.
[0041] The present application also provides a computer-readable storage medium, on which a program for implementing a refractive topographic map measurement method is stored. When the program for the refractive topographic map measurement method is executed by a processor, the steps of the refractive topographic map measurement method as described above are implemented.
[0042] The present application also provides a computer program product, including a computer program. When the computer program is executed by a processor, the steps of the refractive topographic map measurement method as described above are implemented.
[0043] The present application provides a refractive topographic map measurement method, device, electronic device and readable storage medium. First, a fundus image sequence of a subject in multiple fixation directions and the corresponding shooting parameters of each fundus image sequence are collected by a fundus imaging device with a movable fixation target. According to the fundus image sequence and the corresponding shooting parameters in each fixation direction, a first refractive topographic map in each fixation direction is determined, wherein the position of the movable fixation target includes at least the nasal side and the temporal side. Then, based on the sharpness of each fundus image in the fundus image sequence in each fixation direction, a target fundus image corresponding to each fixation direction is selected from each fundus image sequence. Then, the target fundus images corresponding to each fixation direction are respectively registered to obtain a transformation model corresponding to each target fundus image. Furthermore, according to the transformation model corresponding to each target fundus image, a spatial transformation is performed on the first refractive topographic map in each fixation direction to obtain a second refractive topographic map in each fixation direction. Finally, the second refractive topographic maps in each fixation direction are stitched together to obtain a target refractive topographic map. The present application calculates the refractive topographic map corresponding to each fixation direction by obtaining the fundus image sequences of the subject in multiple fixation directions, and then performs registration and stitching, overcoming the limitation of the field of view angle range of the refractive topographic map, being able to cover a larger corneal and retinal area, measuring the refractive topographic map in a larger field of view angle range, and meeting the peripheral refractive measurement requirements of wearing orthokeratology lenses. Description of the Drawings
[0044] The drawings here are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.
[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained according to these drawings without creative efforts.
[0046] Figure 1 It is a schematic flowchart of the first embodiment of the refractive topographic map measurement method of the present application;
[0047] Figure 2 This is a schematic diagram of the fundus image and refractive topographic map in the refractive topographic map measurement method of this application. Among them, (a) is the fundus image, (b) is the refractive topographic map, and (c) is the three-dimensional refractive topographic map;
[0048] Figure 3 This is a schematic diagram of the principle of the refractive topographic map in the refractive topographic map measurement method of this application;
[0049] Figure 4 This is a schematic diagram of the target refractive topographic map after splicing in the refractive topographic map measurement method of this application;
[0050] Figure 5 This is a schematic diagram of the composition structure of the refractive topographic map measurement device in the embodiment of this application;
[0051] Figure 6 This is a schematic diagram of the device structure of the hardware operating environment involved in the refractive topographic map measurement method in the embodiment of this application.
[0052] The implementation, functional features, and advantages of this application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners
[0053] To make the above objects, features, and advantages of this application more obvious and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of this application without creative efforts shall fall within the protection scope of this application.
[0054] Embodiment 1
[0055] The embodiment of this application provides a refractive topographic map measurement method. In the first embodiment of the refractive topographic map measurement method of this application, with reference to Figure 1 , the refractive topographic map measurement method includes:
[0056] Step S10: Collect a sequence of fundus images of the subject in multiple fixation directions and the corresponding shooting parameters of each fundus image sequence through a fundus imaging device with a movable fixation target. According to the fundus image sequences in each fixation direction and the corresponding shooting parameters, determine the first refractive topographic map in each fixation direction, where the position of the movable fixation target includes at least the nasal side and the temporal side;
[0057] Step S20: Select the target fundus image corresponding to each fixation direction from each fundus image sequence based on the clarity of each fundus image in each fundus image sequence of each fixation direction;
[0058] Step S30: Perform registration on the target fundus images respectively corresponding to each of the fixation directions to obtain the transformation models respectively corresponding to each of the target fundus images.
[0059] Step S40: According to the transformation models respectively corresponding to each of the target fundus images, perform spatial transformation on the first refractive topographies of each of the fixation directions to obtain the second refractive topographies of each of the fixation directions.
[0060] Step S50: Stitch the second refractive topographies of each of the fixation directions to obtain a target refractive topography.
[0061] In the embodiments of the present application, it should be noted that the fixation direction is the fixed gaze direction of the subject. In general fundus imaging devices, the position of the fixation mark is default fixed at the center of the optical system. At this time, the center of the captured fundus image is the macular area of the retina. In the embodiments of the present application, the position of the fixation mark of the fundus imaging device is set to be adjustable, and there are multiple positions to choose from, such as the nasal side, the temporal side, the upper side, the lower side, etc. The number and position of the fixation marks are not limited. When the position of the fixation mark is on the nasal side, the captured fundus image corresponds to the temporal area of the human eye retina. When the position of the fixation mark is on the temporal side, the captured fundus image corresponds to the nasal area of the human eye retina. Therefore, in the process of collecting the sequence of fundus images of the subject in the embodiments of the present application, the fundus images can be captured by a fundus imaging device with a movable fixation mark. Among them, the fundus imaging device has a movable fixation mark, and the position of the fixation mark is moved to guide the subject's eye to rotate, so as to capture the fundus images in different fixation directions. In addition, the first refractive topography is the refractive topography corresponding to the sequence of fundus images respectively corresponding to each fixation direction, which respectively reflects the refractive conditions of the fundus images in different regions. The process of performing registration on the target fundus images respectively corresponding to each of the fixation directions is to obtain the stitching transformation matrix between the target fundus images, so that the target fundus images can be displayed in the same coordinate system, so as to stitch the refractive topographies in different fixation directions to obtain a refractive topography with a larger viewing angle range. Among them, the transformation model is the stitching transformation matrix, which is used to convert the coordinate system from one target fundus image to another target fundus image. In addition, the second refractive topography is the refractive topography after each first refractive topography is converted to the same coordinate system. The target refractive topography includes the refractive data of the second refractive topographies of all fixation directions, so it has refractive data with a larger viewing angle range, so it can meet the peripheral refractive measurement requirements of orthokeratology lenses.
[0062] As an example, steps S10 to S50 include: guiding a subject to rotate the eyeball through a fundus imaging device with a movable fixation target, and collecting a sequence of fundus images of the subject in multiple fixation directions and the shooting parameters corresponding to each fundus image sequence, wherein each group of fundus image sequences includes multiple fundus images with different sharpness levels, and the shooting parameters include focal length and image distance; calculating the focal length of each point in the fundus image sequence in each fixation direction according to the fundus image sequence in each fixation direction and the corresponding shooting parameters, and further calculating the diopter of each point in the fundus image sequence in each fixation direction according to the focal length of each point in the fundus image sequence in each fixation direction, so as to generate a corresponding first refractive topographic map; calculating the sharpness corresponding to each of the multiple fundus images in each fixation direction based on a preset sharpness operator; respectively selecting a target fundus image with the highest sharpness from the fundus image sequences in each fixation direction, wherein each fixation direction corresponds to one target fundus image; dividing each of the fixation directions into pairs according to the adjacent position relationship between the fixation directions; respectively registering the target fundus images corresponding to each group of fixation directions to obtain a transformation model of the target fundus image in each fixation direction; performing a spatial transformation process on the first refractive topographic maps in each fixation direction through the transformation models corresponding to each of the target fundus images to obtain second refractive topographic maps corresponding to the first refractive topographic maps in the same coordinate system; and splicing the second refractive topographic maps in the same coordinate system to obtain a target refractive topographic map.
[0063] Further, the steps of collecting a sequence of fundus images of the subject in multiple fixation directions and the shooting parameters corresponding to each fundus image sequence, and determining the first refractive topographic map in each fixation direction according to the fundus image sequence in each fixation direction and the corresponding shooting parameters include:
[0064] Step S11, based on the current position of the fixation target, collecting fundus images of the subject under different shooting parameters to obtain a sequence of fundus images in the current fixation direction;
[0065] Step S12, adjusting the position of the fixation target, and returning to execute the step: based on the current position of the fixation target, collecting fundus images of the subject under different shooting parameters to obtain a sequence of fundus images at the current position, until a preset number of sequences of fundus images in fixation directions are obtained;
[0066] Step S13, respectively determining the first refractive topographic map in each fixation direction according to the sequence of fundus images in each fixation direction and the shooting parameters of each fundus image in each sequence of fundus images.
[0067] In the embodiments of the present application, it should be noted that in the embodiments of the present application, fundus images of a subject under different imaging parameters are mainly collected by a fundus imaging device capable of adjusting the position of the fixation target, so as to obtain a corresponding sequence of fundus images. Among them, the imaging parameters include focal length and image distance. The fundus of a human eye is composed of the retina, choroid, optic disc, etc. The fundus image is as Figure 2 shown in (a). As Figure 2 shown in (b) and Figure 2 shown in (c), due to factors such as congenital morphology, refractive guidance, and muscle traction, the refractive topography often presents different diopter distribution situations. Among them, Figure 2 (b) is a two-dimensional refractive topography, Figure 2 and (c) is a three-dimensional refractive topography. The horizontal coordinate represents the coordinates of each point in the fundus image (the positional relationship with the fixation directions such as the temporal, nasal, inferior, and superior), and the vertical coordinate represents the diopter. As Figure 3 shown in (a), light rays emit from an ideal fundus point p and are transmitted through the optical path composed of the refractive medium of the human eye and the imaging optics of the fundus camera, and finally form an image on the sensor plane of the camera. When the light rays are focused on the image sensing surface, a smallest light spot appears at this time, corresponding to the clearest image point. As Figure 3 shown in (b), by adjusting the focal length of the fundus camera, the position of the light ray focus can be changed, and the image point can be correspondingly adjusted to a relatively defocused state, forming blurred spots of different sizes and grayscales. During the refractive scanning process, by changing the parameters of the optical system (focal length, image distance, etc.), a sequence of fundus images with different degrees of blurring can be obtained. As Figure 3 shown in (c), it is the change curve of the image sharpness of point P at different focal lengths. According to the maximum value of the sharpness curve, the focal length when the image point is focused on the sensing surface can be obtained, so as to calculate the diopter of the human eye, and calculate the diopters of all points in the current field of view of the fundus image, and generate the refractive topography corresponding to the current field of view.
[0068] As an example, steps S11 to S13 include: setting the fixation target position of the fundus imaging device to the initial position, guiding the subject to fixate on the fixation target, and capturing the fundus image of the subject in the current fixation direction, where the fixation target is a mark on the fundus imaging device for guiding the subject's fixation direction; adjusting the imaging parameters, collecting the fundus images of the subject under different imaging parameters, and obtaining a sequence of fundus images in the current fixation direction, where the sequence of fundus images includes fundus images under different imaging parameters, and the imaging parameters include focal length and image distance; adjusting the fixation target position of the fundus imaging device, guiding the subject to fixate on the fixation target after adjustment, and returning to execute step S11: collecting the fundus images of the subject under different imaging parameters based on the current position of the fixation target, and obtaining a sequence of fundus images in the current fixation direction until a preset number of sequences of fundus images in different fixation directions are obtained, where the preset number of fixation directions includes directions such as nasal side, temporal side, upper side, and lower side; calculating the diopter of each point in the sequence of fundus images in each fixation direction according to the sequence of fundus images in each fixation direction and the imaging parameters of each fundus image in each sequence of fundus images, where the imaging parameters include focal length, and the shorter the focal length of the point position in the sequence of fundus images, the higher the diopter; generating the first refractive topographic map of each fixation direction according to the diopter of each point in the sequence of fundus images in each fixation direction.
[0069] In addition, the step of registering the target fundus images corresponding to each fixation direction respectively to obtain the transformation model corresponding to each target fundus image includes:
[0070] Step S21, randomly selecting two target fundus images of adjacent fixation directions, and taking one of the target fundus images as the reference image and the other target fundus image as the image to be registered;
[0071] Step S22, registering the image to be registered based on the reference image to obtain the transformation model of the image to be registered, where the transformation model is one of a rigid transformation model, an affine transformation model, or a perspective transformation model;
[0072] Step S23, returning to execute the step: randomly selecting two target fundus images of adjacent fixation directions, and taking one of the target fundus images as the reference image and the other target fundus image as the image to be registered until the transformation models of all the target fundus images in all fixation directions are obtained.
[0073] In the embodiments of the present application, it should be noted that the embodiments of the present application provide a method for registering target fundus images. Specifically, by pairwise registering the target fundus images in each fixation direction, the corresponding transformation model is obtained to convert each target fundus image into the same coordinate system to complete the stitching. Among them, the two target fundus images for registration are the target fundus images in the vector fixation direction, and there needs to be an overlapping area to find feature points for easy registration. For example, five fixation directions such as above, center, below, left, and right can be set. Among them, the center fixation direction is adjacent to the other four fixation directions. Then, the target fundus image in the center fixation direction can be used as the reference image, and the target fundus images in the other four fixation directions are used as the images to be registered respectively, and the transformation models of the other four fixation directions relative to the reference image are obtained.
[0074] As an example, steps S21 to S23 include: selecting two target fundus images in adjacent fixation directions, and using one of the target fundus images as the reference image and the other as the image to be registered; performing feature matching on the reference image and the image to be registered to obtain the feature matching points between the reference image and the image to be registered; calculating the transformation model of the image to be registered relative to the reference image according to the feature matching points. Among them, the transformation model can be a rigid transformation model, an affine transformation model or a perspective transformation model; return to execute steps S21 - S22 until the transformation models of all target fundus images except the center fixation direction relative to the target fundus images in at least one adjacent fixation direction are obtained.
[0075] In the above embodiments of the application, the method for registering images can perform fundus image registration based on gray level or feature-based methods, or can also be registered through the structure of retinal blood vessels, which is not limited here.
[0076] Further, the step of registering the image to be registered based on the reference image to obtain the transformation model of the image to be registered includes:
[0077] Step S221, extracting the fundus features of the reference image and the image to be registered;
[0078] Step S222, matching the fundus features of the reference image and the image to be registered to obtain the corresponding feature matching points of the reference image and the image to be registered respectively;
[0079] Step S223, calculating the transformation model of the image to be registered according to the relative poses between the corresponding feature matching points of the reference image and the image to be registered.
[0080] In the embodiments of the present application, it should be noted that the embodiments of the present application provide a method for registering a to-be-registered image based on a reference image. When extracting the fundus features of the reference image and the to-be-registered image, operators such as Scale Invariant Feature Transform (SIFT), Speeded Up Robust Feature (SURF), Histogram of Oriented Gradient (HOG), and Local Binary Patterns (LBP) can be used to extract the fundus features. In addition, when performing feature matching, methods such as brute-force matching operator and fast nearest neighbor approximation search operator can be used for feature matching. Optionally, the feature points can also be filtered and screened. For example, the feature points can be screened based on the prior position information of the fixation direction or the clustering method, where the prior position information is the relative position relationship of each fixation direction.
[0081] As an example, steps S221 to S223 include: extracting the fundus features of the reference image and the to-be-registered image through operators such as Scale Invariant Feature Transform, Histogram of Oriented Gradient, or Local Binary Patterns to obtain feature points; matching the feature points of the reference image and the to-be-registered image through a brute-force matching operator or a fast nearest neighbor approximation search operator to obtain the feature matching points corresponding to the reference image and the to-be-registered image respectively, where the feature matching points are the feature points that exist in both the reference image and the to-be-registered image, that is, they can be recognized as the same feature point; calculating the transformation matrix of the to-be-registered image relative to the reference image according to the positions of the feature matching points in the coordinate systems of the reference image and the to-be-registered image, and the transformation matrix is the transformation model of the to-be-registered image.
[0082] In a feasible embodiment, before extracting the features of the target fundus image, image preprocessing can be performed to enhance the detailed features of the target fundus image and suppress noise.
[0083] In addition, the step of performing a spatial transformation on the first refractive topographies of the respective fixation directions according to the transformation models corresponding to the respective target fundus images to obtain the second refractive topographies of the respective fixation directions includes:
[0084] Step S41, selecting the target fundus image of the central fixation direction as the reference fundus image;
[0085] Step S42: Based on the coordinate system of the first refractive map of the reference fundus image, convert the first refractive topographic maps in each of the fixation directions into second refractive topographic maps located in the coordinate system according to the transformation models respectively corresponding to the target fundus images.
[0086] In the embodiments of the present application, it should be noted that the central fixation direction may be the fixation direction when the subject looks straight ahead. The central position of the target refractive topographic map obtained in the refractive topographic map measurement method of the embodiments of the present application is the first refractive topographic map corresponding to the reference fundus image of the central fixation direction. The conversion in step S42 is a process of spatially converting the refractive topographic maps in other fixation directions for display in the coordinate system of the reference fundus image. Specifically, if the target fundus image in the first fixation direction does not overlap with the target fundus image in the central fixation direction, it is first converted to the coordinate system of the target fundus image in the second fixation direction that overlaps with the target fundus image in the first fixation direction, and then re-converted according to the transformation model of the target fundus image in the second fixation direction until it is converted to the position in the coordinate system of the reference fundus image. It can be imagined that since there are overlapping regions between the target fundus images in adjacent fixation directions, the corresponding second refractive topographic maps also have overlapping regions.
[0087] As an example, steps S41 to S42 include: selecting the target fundus image in the central fixation direction among the fixation directions as the reference fundus image for spatial conversion of the refractive topographic maps in other fixation directions; performing spatial transformation on the first refractive topographic maps in each of the fixation directions through the transformation models of the target fundus images, and converting each of the first refractive topographic maps into the coordinate system of the reference fundus image to obtain the second refractive topographic maps in each of the fixation directions located in the coordinate system of the reference fundus image, where the relative positions of the second refractive topographic maps and the first refractive topographic map in the central fixation direction are fixed and there are overlapping regions.
[0088] Further, the step of stitching the second refractive topographic maps in each of the fixation directions to obtain the target refractive topographic map includes:
[0089] Step S51: Based on the relative position relationship between each of the second refractive topographic maps and the first refractive topographic map in the central fixation direction, stitch the second refractive topographic maps in adjacent fixation directions with the first refractive topographic map in the central fixation direction to obtain a third refractive topographic map;
[0090] Step S52: According to the average diopter of each second refractive topographic map in the overlapping area of the third refractive topographic map, perform diopter compensation on the area where the second refractive topographic map with a fixation direction farther from the central fixation direction is located among the two second refractive topographic maps involved in the overlapping area, to obtain a fourth refractive topographic map;
[0091] Step S53: Determine the weights of each point on the overlapping area with respect to each second refractive topographic map according to the distances between each point on the overlapping area of the fourth refractive topographic map and each second refractive topographic map;
[0092] Step S54: Calculate the diopters of each point on the overlapping area according to the weights of each point on the overlapping area with respect to each second refractive topographic map, to obtain a target refractive topographic map.
[0093] In the embodiment of the present application, it should be noted that the embodiment of the present application provides a method for stitching each second refractive topographic map. Since direct stitching will cause gaps and unnaturalness at the joints, the joints need to be optimized. Specifically, it includes performing diopter compensation on the second refractive topographic map far from the central fixation direction, and determining weights according to the distances between the overlapping area and the two second refractive topographic maps on both sides to optimize the diopter values in the overlapping area, making the distribution of diopters more natural. The two-dimensional image of the target refractive topographic map after stitching and optimization is as Figure 4 shown, where the depth of color represents the level of diopter. Among them, the third refractive topographic map is a combined topographic map of the second refractive topographic maps in each fixation direction and the first refractive topographic map in the central fixation direction, that is, the third refractive topographic map includes the second refractive topographic maps in each fixation direction and the first refractive topographic map in the central fixation direction; the fourth refractive topographic map is a refractive topographic map generated after performing diopter compensation on some areas of the third refractive topographic map.
[0094] As an example, steps S51 to S54 include: Based on the relative positional relationship between each of the second refractive topographies and the first refractive topography in the central fixation direction, splicing and combining the second refractive topographies in adjacent fixation directions with the first refractive topography in the central fixation direction to obtain a third refractive topography; extracting the overlapping region from the third refractive topography, and calculating the average refractive power of the two second refractive topographies involved in the overlapping region in the overlapping region respectively; calculating the difference between the average refractive power of the second refractive topography closer to the central fixation direction and the average refractive power of the second refractive topography farther from the central fixation direction in the overlapping region among the two second refractive topographies involved in the overlapping region to obtain a refractive power compensation value; performing overall compensation on the second refractive topography farther from the central fixation direction through the refractive power compensation value to obtain a fourth refractive topography; calculating the weight of each point relative to the two second refractive topographies involved in the overlapping region according to the distance between each point on the overlapping region of each second refractive topography in the fourth refractive topography and each second refractive topography, where the distance is the shortest distance from each point to the boundary of the overlapping region. For example, if a point on the overlapping region is equidistant from the two second refractive topographies, then the weight ratio of this point relative to the two second refractive topographies involved in the overlapping region is 1:1; calculating the refractive power of each point on the overlapping region according to the weights of each point on the overlapping region with respect to the two second refractive topographies and the refractive power values of the two second refractive topographies at each point to obtain the target refractive topography.
[0095] In a feasible embodiment, in steps S53 to S54, if a point on the overlapping region is equidistant from the two second refractive topographies, and the refractive powers of the two second refractive topographies at this point are 1.3 and 1.5 respectively, then the refractive power of this point is calculated as 1.3 * 0.5 + 0.1 * 1.5 = 1.4.
[0096] Further, the step of obtaining the fourth refractive topography by performing refractive power compensation on the second refractive topography with a fixation direction farther from the central fixation direction among the two second refractive topographies involved in the overlapping region according to the average refractive power of each second refractive topography in the overlapping region of the third refractive topography includes:
[0097] Step S521, calculating the average refractive power of each second refractive topography in the overlapping region of the third refractive topography respectively;
[0098] Step S522, calculating the difference between the average refractive power of the second refractive topography closer to the central fixation direction and the average refractive power of the second refractive topography farther from the central fixation direction among the two second refractive topographies involved in the overlapping region to obtain a refractive power compensation value;
[0099] Step S523: Compensate the diopter of the second diopter topographic map that is farther from the central fixation direction according to the diopter compensation value to obtain a fourth diopter topographic map.
[0100] In the embodiment of the present application, it should be noted that the embodiment of the present application provides a method for compensating the diopter according to the distance of each second diopter topographic map from the central fixation direction, achieving the effect of making the splicing and fusion of the diopter topographic map more natural and avoiding the generation of gaps.
[0101] As an example, steps S521 to S523 include: calculating the average diopter value in the overlapping area according to the diopter distribution data of each second diopter topographic map in the overlapping area of the third diopter map; each overlapping area corresponds to two second diopter topographic maps, and there is one second diopter topographic map that is closer to the central fixation direction and one second diopter topographic map that is farther from the central fixation direction in the two second diopter maps; calculating the difference between the average diopter value of the second diopter topographic map that is closer to the central fixation direction and the average diopter value of the second diopter topographic map that is farther from the central fixation direction to obtain a diopter compensation value; adding the diopter compensation value to the diopter of each point on the second diopter topographic map that is farther from the central fixation direction respectively to realize the diopter compensation of the second diopter topographic map that is farther from the central fixation direction and obtain a fourth diopter topographic map.
[0102] The embodiment of the present application provides a method for measuring a diopter topographic map. First, collect a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each fundus image sequence. According to the sequence of fundus images and the corresponding shooting parameters of each fixation direction, determine the first diopter topographic map of each fixation direction. Then, based on the clarity of each fundus image in the sequence of fundus images of each fixation direction, select the target fundus image corresponding to each fixation direction from each sequence of fundus images. Then, register the target fundus images corresponding to each fixation direction respectively to obtain the transformation model corresponding to each target fundus image. Furthermore, according to the transformation model corresponding to each target fundus image, perform a spatial transformation on the first diopter topographic map of each fixation direction to obtain the second diopter topographic map of each fixation direction. Finally, splice the second diopter topographic maps of each fixation direction to obtain a target diopter topographic map. The technical solution of the embodiment of the present application calculates the diopter topographic map corresponding to each fixation direction by obtaining a sequence of fundus images of a subject in multiple fixation directions, and then performs registration and splicing, overcoming the limitation of the field of view angle range of the diopter topographic map, being able to cover a larger corneal and retinal area, measuring the diopter topographic map in a larger field of view angle range, and being able to meet the peripheral diopter measurement requirements of wearing orthokeratology lenses.
[0103] Embodiment Two
[0104] An embodiment of the present application further provides a refractive topographic map measuring device, which is applied to a refractive topographic map measuring device. Referring to Figure 5 , the refractive topographic map measuring device includes:
[0105] A refractive measurement module 101, configured to collect a sequence of fundus images of a subject in multiple fixation directions and the shooting parameters corresponding to each sequence of fundus images through a fundus imaging device with a movable fixation target, and determine a first refractive topographic map for each fixation direction according to the sequence of fundus images and the corresponding shooting parameters for each fixation direction, where the position of the movable fixation target includes at least the nasal side and the temporal side;
[0106] An image selection module 102, configured to select a target fundus image corresponding to each fixation direction from each sequence of fundus images based on the clarity of each fundus image in each sequence of fundus images for each fixation direction;
[0107] An image registration module 103, configured to perform registration on the target fundus images corresponding to each fixation direction respectively, and obtain a transformation model corresponding to each target fundus image;
[0108] A spatial transformation module 104, configured to perform spatial transformation on the first refractive topographic maps for each fixation direction according to the transformation models corresponding to each target fundus image respectively, and obtain a second refractive topographic map for each fixation direction;
[0109] An image stitching module 105, configured to stitch the second refractive topographic maps for each fixation direction to obtain a target refractive topographic map.
[0110] Optionally, the refractive measurement module 101 is further configured to:
[0111] Based on the current position of the fixation target, collect fundus images of the subject under different shooting parameters to obtain a sequence of fundus images in the current fixation direction;
[0112] Adjust the position of the fixation target, and return to execute the step: based on the current position of the fixation target, collect fundus images of the subject under different shooting parameters to obtain a sequence of fundus images at the current position, until a preset number of sequences of fundus images in different fixation directions are obtained;
[0113] Determine the first refractive topographic map for each fixation direction according to the sequence of fundus images for each fixation direction and the shooting parameters of each fundus image in each sequence of fundus images.
[0114] Optionally, the image registration module 103 is further configured to:
[0115] Randomly select two target fundus images with adjacent fixation directions, and use one of the target fundus images as the reference image and the other target fundus image as the image to be registered;
[0116] Register the image to be registered based on the reference image to obtain a transformation model of the image to be registered, where the transformation model is one of a rigid transformation model, an affine transformation model, or a perspective transformation model;
[0117] Return to execute the steps: Randomly select two target fundus images with adjacent fixation directions, and use one of the target fundus images as the reference image and the other target fundus image as the image to be registered, until transformation models of all target fundus images in all fixation directions are obtained.
[0118] Optionally, the image registration module 103 is further configured to:
[0119] Extract the fundus features of the reference image and the image to be registered;
[0120] Match the fundus features of the reference image and the image to be registered to obtain the feature matching points corresponding to the reference image and the image to be registered respectively;
[0121] Calculate the transformation model of the image to be registered according to the relative poses between the feature matching points corresponding to the reference image and the image to be registered respectively.
[0122] Optionally, the spatial transformation module 104 is further configured to:
[0123] Select the target fundus image in the central fixation direction as the reference fundus image;
[0124] Based on the coordinate system where the first refractive power map of the reference fundus image is located, convert the first refractive power topographic maps in each fixation direction into second refractive power topographic maps located in the coordinate system according to the transformation models corresponding to each target fundus image respectively.
[0125] Optionally, the image stitching module 105 is further configured to:
[0126] Based on the relative position relationship between each second refractive power topographic map and the first refractive power topographic map in the central fixation direction, stitch the second refractive power topographic maps in adjacent fixation directions with the first refractive power topographic map in the central fixation direction to obtain a third refractive power topographic map;
[0127] According to the average refractive power in the overlapping area of each second refractive power topographic map in the third refractive power topographic map, perform refractive power compensation on the area of the second refractive power topographic map with a fixation direction farther from the central fixation direction among the two second refractive power topographic maps involved in the overlapping area to obtain a fourth refractive power topographic map;
[0128] Determine the weights of each point on the overlapping area with respect to each second refractive topographic map according to the distances between each point on the overlapping area of each second refractive topographic map in the fourth refractive topographic map and each second refractive topographic map;
[0129] Calculate the refractive power of each point on the overlapping area according to the weights of each point on the overlapping area with respect to each second refractive topographic map, and obtain the target refractive topographic map.
[0130] Optionally, the image stitching module 105 is further configured to:
[0131] Calculate the average refractive power of each second refractive topographic map in the overlapping area of the third refractive topographic map respectively;
[0132] Calculate the difference between the average refractive power of the second refractive topographic map closer to the central fixation direction and the average refractive power of the second refractive topographic map farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area, and obtain the refractive power compensation value;
[0133] Compensate the refractive power of the second refractive topographic map farther from the central fixation direction according to the refractive power compensation value, and obtain the fourth refractive topographic map.
[0134] The refractive topographic map measuring device provided by the present application adopts the refractive topographic map measuring method in the above embodiment, and solves the technical problem that the field of view angle range of the refractive topographic map obtained by the current refractive detection method is too small. Compared with the prior art, the beneficial effects of the refractive topographic map measuring device provided by the embodiment of the present application are the same as those of the refractive topographic map measuring method provided by the above embodiment, and other technical features in the refractive topographic map measuring device are the same as those disclosed in the method of the previous embodiment, and will not be elaborated here.
[0135] Embodiment III
[0136] The embodiment of the present application provides an electronic device, which includes: at least one processor; and a memory communicatively linked to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the refractive topographic map measuring method in Embodiment I above.
[0137] Next, refer to Figure 6, which shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (Portable Media Players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is merely an example and should not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.
[0138] As Figure 6 shown, the electronic device may include a processing device (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and data required for the operation of the electronic device are also stored. The processing device, the ROM, and the RAM are connected to each other through a bus. An input / output (I / O) interface is also linked to the bus.
[0139] Generally, the following systems may be linked to the I / O interface: input devices including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices including, for example, magnetic tapes, hard disks, etc.; and communication devices. The communication device may allow the electronic device to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows an electronic device having various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or had alternatively.
[0140] Specifically, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device, or installed from the storage device, or installed from the ROM. When the computer program is executed by the processing device, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.
[0141] The electronic device provided by this application adopts the refractive topographic map measurement method in the above-mentioned embodiment, and solves the technical problem that the field of view angle range of the refractive topographic map obtained by the current refractive detection method is too small. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of this application are the same as those of the refractive topographic map measurement method provided in the first embodiment above, and other technical features in this electronic device are the same as those disclosed in the method of the previous embodiment, and will not be elaborated here.
[0142] It should be understood that each part of the present disclosure can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in a suitable manner in any one or more embodiments or examples.
[0143] The above is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.
[0144] Embodiment 4
[0145] This embodiment provides a computer-readable storage medium, which has computer-readable program instructions stored thereon. The computer-readable program instructions are used to execute the refractive topographic map measurement method in the first embodiment above.
[0146] The computer-readable storage medium provided by the embodiment of this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical links with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0147] The above computer-readable storage medium may be included in an electronic device; or it may exist independently without being assembled into the electronic device.
[0148] The above computer-readable storage medium stores one or more programs. When the one or more programs are executed by an electronic device, the electronic device is caused to: collect a sequence of fundus images of a subject in multiple fixation directions and the shooting parameters corresponding to each of the fundus image sequences through a fundus imaging device with a movable fixation target, and determine a first refractive topographic map for each of the fixation directions according to the fundus image sequences and the corresponding shooting parameters for each of the fixation directions, wherein the position of the movable fixation target includes at least the nasal side and the temporal side; select a target fundus image corresponding to each of the fixation directions from each of the fundus image sequences based on the sharpness of each fundus image in each of the fundus image sequences for each of the fixation directions; register the target fundus images corresponding to each of the fixation directions respectively to obtain a transformation model corresponding to each of the target fundus images; perform a spatial transformation on the first refractive topographic map for each of the fixation directions according to the transformation model corresponding to each of the target fundus images respectively to obtain a second refractive topographic map for each of the fixation directions; and splice the second refractive topographic maps for each of the fixation directions to obtain a target refractive topographic map.
[0149] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be linked to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be linked to an external computer (for example, by using an Internet service provider to link through the Internet).
[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.
[0151] The modules involved in the embodiments described in the present disclosure may be implemented in software or in hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.
[0152] The computer-readable storage medium provided in the present application stores computer-readable program instructions for executing the above-mentioned refractive topographic map measurement method, and solves the technical problem that the field of view angle range of the refractive topographic map obtained by the current refractive detection method is relatively small. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the embodiments of the present application are the same as those of the refractive topographic map measurement method provided in the above embodiments, and will not be elaborated here.
[0153] Embodiment Five
[0154] The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the steps of the refractive topographic map measurement method as described above.
[0155] The computer program product provided in the present application solves the technical problem that the field of view angle range of the refractive topographic map obtained by the current refractive detection method is relatively small. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiments of the present application are the same as those of the refractive topographic map measurement method provided in the above embodiments, and will not be elaborated here.
[0156] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structural or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be similarly included in the patent scope of the present application.
Claims
1. A method for measuring a refractive topographic map, characterized in that, the method for measuring a refractive topographic map includes: collecting a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each sequence of fundus images through a fundus imaging device with a movable fixation target, and determining the first refractive topographic map of each fixation direction according to the sequence of fundus images of each fixation direction and the corresponding shooting parameters, wherein the position of the movable fixation target includes at least the nasal side and the temporal side; selecting the target fundus image corresponding to each fixation direction from each sequence of fundus images based on the sharpness of each fundus image in each sequence of fundus images of each fixation direction; performing registration on the target fundus images corresponding to each fixation direction respectively to obtain the transformation model corresponding to each target fundus image; performing spatial transformation on the first refractive topographic map of each fixation direction according to the transformation model corresponding to each target fundus image respectively to obtain the second refractive topographic map of each fixation direction; stitching the second refractive topographic maps of each fixation direction to obtain a target refractive topographic map; wherein, the step of stitching the second refractive topographic maps of each fixation direction to obtain a target refractive topographic map includes: based on the relative position relationship between each second refractive topographic map and the first refractive topographic map of the central fixation direction, stitching the second refractive topographic maps of adjacent fixation directions with the first refractive topographic map of the central fixation direction to obtain a third refractive topographic map; compensating the diopter of the area of the second refractive topographic map where the fixation direction is farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area according to the average diopter of the overlapping area in each second refractive topographic map in the third refractive topographic map to obtain a fourth refractive topographic map; determining the weight of each point on the overlapping area with respect to each second refractive topographic map according to the distance between each point on the overlapping area in the fourth refractive topographic map and each second refractive topographic map; calculating the diopter of each point on the overlapping area according to the weight of each point on the overlapping area with respect to each second refractive topographic map to obtain a target refractive topographic map.
2. The method for measuring a refractive topographic map according to claim 1, characterized in that, the step of collecting a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each sequence of fundus images, and determining the first refractive topographic map of each fixation direction according to the sequence of fundus images of each fixation direction and the corresponding shooting parameters includes: collecting fundus images of the subject under different shooting parameters based on the current position of the fixation target to obtain a sequence of fundus images of the current fixation direction; adjusting the position of the fixation target, and returning to execute the step: collecting fundus images of the subject under different shooting parameters based on the current position of the fixation target to obtain a sequence of fundus images of the current position, until a preset number of sequences of fundus images of fixation directions are obtained; respectively determining the first refractive topographic map of each fixation direction according to the sequence of fundus images of each fixation direction and the shooting parameters of each fundus image in each sequence of fundus images.
3. The refractive topographic map measurement method according to claim 1, characterized in that the step of respectively registering the target fundus images corresponding to the respective fixation directions to obtain the transformation models corresponding to the respective target fundus images includes: randomly selecting two target fundus images of adjacent fixation directions, and using one of the target fundus images as a reference image and the other target fundus image as a registration target image; registering the registration target image based on the reference image to obtain the transformation model of the registration target image, wherein the transformation model is one of a rigid transformation model, an affine transformation model or a perspective transformation model; return to execute the steps: randomly select two target fundus images of adjacent fixation directions, and use one of the target fundus images as a reference image and the other target fundus image as a registration target image, until the transformation models of the target fundus images of all fixation directions are obtained.
4. The refractive topographic map measurement method according to claim 3, characterized in that the step of registering the registration target image based on the reference image to obtain the transformation model of the registration target image includes: extracting the fundus features of the reference image and the registration target image; matching the fundus features of the reference image and the registration target image to obtain the feature matching points corresponding to the reference image and the registration target image respectively; calculating the transformation model of the registration target image according to the relative poses between the feature matching points corresponding to the reference image and the registration target image respectively.
5. The refractive topographic map measurement method according to claim 1, characterized in that the step of spatially transforming the first refractive topographic maps of the respective fixation directions according to the transformation models corresponding to the respective target fundus images to obtain the second refractive topographic maps of the respective fixation directions includes: selecting the target fundus image of the central fixation direction as the reference fundus image; based on the coordinate system where the first refractive map of the reference fundus image is located, converting the first refractive topographic maps of the respective fixation directions into second refractive topographic maps located in the coordinate system according to the transformation models corresponding to the respective target fundus images.
6. The refractive topographic map measurement method according to claim 1, characterized in that the step of compensating the diopter of the second refractive topographic map with a fixation direction farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area according to the average value of the diopters of the respective second refractive topographic maps in the overlapping area in the third refractive topographic map to obtain the fourth refractive topographic map includes: respectively calculating the average value of the diopters of the respective second refractive topographic maps in the overlapping area in the third refractive topographic map; calculating the difference between the average value of the diopters of the second refractive topographic map closer to the central fixation direction and the average value of the diopters of the second refractive topographic map farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area to obtain the diopter compensation value; compensating the diopter of the second refractive topographic map farther from the central fixation direction according to the diopter compensation value to obtain the fourth refractive topographic map.
7. A refractive topographic map measurement device, characterized in that The refractive topographic map measuring device includes: A refractive measurement module, configured to collect a sequence of fundus images of a subject in multiple fixation directions and the corresponding shooting parameters of each of the sequences of fundus images through a fundus imaging device with a movable fixation target, and determine the first refractive topographic map of each of the fixation directions according to the sequences of fundus images of each of the fixation directions and the corresponding shooting parameters, wherein the position of the movable fixation target includes at least the nasal side and the temporal side; An image selection module, configured to select the target fundus image corresponding to each of the fixation directions from the sequences of fundus images of each of the fixation directions based on the clarity of each fundus image in the sequences of fundus images of each of the fixation directions; An image registration module, configured to perform registration on the target fundus images corresponding to each of the fixation directions respectively to obtain the transformation model corresponding to each of the target fundus images; A spatial transformation module, configured to perform spatial transformation on the first refractive topographic maps of each of the fixation directions according to the transformation models corresponding to each of the target fundus images respectively to obtain the second refractive topographic maps of each of the fixation directions; An image stitching module, configured to stitch the second refractive topographic maps of each of the fixation directions to obtain a target refractive topographic map; Wherein, the image stitching module is further configured to: based on the relative position relationship between each of the second refractive topographic maps and the first refractive topographic map of the central fixation direction, stitch the second refractive topographic maps of adjacent fixation directions with the first refractive topographic map of the central fixation direction to obtain a third refractive topographic map; perform diopter compensation on the area of the second refractive topographic map where the fixation direction is farther from the central fixation direction in the two second refractive topographic maps involved in the overlapping area according to the average diopter value of each second refractive topographic map in the overlapping area of the third refractive topographic map to obtain a fourth refractive topographic map; determine the weights of each point on the overlapping area with respect to each second refractive topographic map according to the distances between each point on the overlapping area of the fourth refractive topographic map and each second refractive topographic map; calculate the diopter of each point on the overlapping area according to the weights of each point on the overlapping area with respect to each second refractive topographic map to obtain a target refractive topographic map.
8. An electronic device Characterized in that The electronic device includes: At least one processor; and A memory communicatively linked to the at least one processor; wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the steps of the refractive topographic map measuring method according to any one of claims 1 to 6.
9. A computer-readable storage medium Characterized in that A program for implementing the refractive topographic map measuring method is stored on the computer-readable storage medium, and the program for implementing the refractive topographic map measuring method is executed by a processor to implement the steps of the refractive topographic map measuring method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Device and method applied to measurement of retina topographic map
CN110236485A
Refractive graph generation method, device and computer readable storage medium
CN111358421A