Volumetric OCT image data processing
By determining the axis shift indicator and reliability evaluation in the B-scan sequence in the OCT imaging system, corrected data is generated to compensate for the axial displacement caused by relative motion, solving the problem of motion artifacts in the OCT imaging system and improving the retinal layer the accuracy of identification and diagnostic measurements.
Patent Information
- Application Number
- CN202111319714.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-11-12
- Filing Date
- 2021-11-09
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-11-09
AI Technical Summary
The axial displacement caused by involuntary motion of the subject during the acquisition of C-scan data by the existing OCT imaging system affects the accuracy of the identification of the retinal layer and the subsequent diagnostic measurements, and the prior art is difficult to effectively compensate for the motion artifact caused by motion. .
By determining the axis shift indicator of common eye characteristics by adjacent B-scans in the B-scan sequence acquired for the OCT imaging system, correction data is generated, and the reliability indicator is used to judge the reliability of the correction data, thereby compensating for relative motion axial displacement caused. The method includes calculating a metric value to evaluate the relative velocity or acceleration and judging a reliability indicator based on the threshold to determine the reliability and applicability of the correction data.
Effectively compensate for the axial displacement caused by relative motion between the OCT imaging system and the imaging target, improves the accuracy of the C-scan image and the reliability of subsequent diagnostic measurements, and reduces the impact of motion artifacts.
Smart Images

Figure CN114549575B_ABST
Abstract
Description
Technical Field
[0001] Example aspects of the present invention generally relate to the field of ophthalmic optical coherence tomography (OCT) imaging systems, and more specifically, to a method and apparatus for processing C-scan data that has been acquired by an optical coherence tomography (OCT) imaging system to generate correction data, the C-scan data including a B-scan sequence of an imaging target, the correction data being used to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion between the OCT imaging system and the imaging target, the relative motion causing a distance between the OCT imaging system and the imaging target to change during acquisition of the B-scan by the OCT imaging system. background
[0002] The acquisition of a typical volumetric optical coherence tomography (OCT) scan (also called a C-scan) of a portion of a subject's eye (e.g., the retina) may take approximately 1 second to 5 seconds. During this period, the OCT imaging system repeatedly scans the OCT beam in a first scanning direction to record a (two-dimensional) B-scan sequence, each B-scan comprising a series of axial scans (A-scans) recorded at corresponding points on the retinal surface along the first scanning direction. The B-scans in the B-scan sequence are typically arranged in a direction perpendicular to the first direction. During the acquisition of the C-scan, the eye may typically move axially (along the direction of the OCT beam) due to involuntary movement of the subject. In order to successfully render the C-scan image and ensure the accuracy of subsequent measurements performed based on the C-scan image, it may be necessary to correct for motion artifacts caused by the subject's movement during the C-scan capture. If the B-scan data is not compensated to correct for the axis shift between some B-scans caused by the subject's movement, the accuracy of retinal layer identification and subsequent diagnostic measurements may be adversely affected.
[0003] Overview
[0004] According to a first exemplary aspect of the present invention, the inventors have devised a method of processing C-scan data to generate correction data and also generate a reliability indicator indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans of an imaging target acquired by an OCT imaging system, the correction data being used to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion of the OCT imaging system and the imaging target, the relative motion causing a distance between the OCT imaging system and the imaging target to vary during acquisition of the B-scans by the OCT imaging system. The method comprises generating the correction data by determining, for each of a plurality of pairs of adjacent B-scans in the sequence, a respective indicator of the axial displacement between respective representations of common ocular features in the adjacent B-scans. The method also includes generating a reliability indicator by: calculating a corresponding value of a metric using a B-scan pair in a B-scan sequence, the corresponding value of the metric indicating a corresponding velocity or a corresponding acceleration of an imaging target relative to an OCT imaging system when acquiring the B-scan pair; determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; in a case where at least a predetermined number of the calculated values of the metric are determined to exceed the threshold, setting the reliability indicator to indicate that the correction data is unreliable; and in a case where it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold, setting the reliability indicator to indicate that the correction data is reliable.
[0005] Correction data may be generated by determining a first frequency component of the variation of the determined indicator as the position of corresponding adjacent B-scan pairs in the sequence indicates relative motion of the OCT imaging system and the imaging target during acquisition of the B-scans by the OCT imaging system.
[0006] A corresponding indicator of axial shift can be determined for each adjacent B-scan pair by calculating a cross-correlation between adjacent B-scan pairs and determining an offset between the B-scans corresponding to a peak in the calculated cross-correlation as an indicator, or by identifying corresponding positions of common eye features in the B-scans of adjacent B-scan pairs and determining a displacement between the identified positions along an axis of the B-scan, where the axis of the B-scan represents an axial direction of the imaging system.
[0007] The imaging target may have a curvature, and the method may further include determining a second frequency component of the change indicative of the curvature of the imaging target. The second frequency component may be determined by fitting an m-order polynomial to the determined change in the indicator, and the first frequency component may be determined by subtracting a value of the m-order polynomial from the indicator in the determined change in the indicator to generate a corrective change in the indicator, and fitting an n-order polynomial to the corrective change in the indicator, where m and n are integers and m is less than n.
[0008] The method may further include, if the reliability indicator has been set to indicate that the correction data is reliable, using the correction data to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion of the OCT imaging system and the imaging target.
[0009] In an embodiment of the first example aspect, the first frequency component may be determined by further performing at least two iterations of a process comprising the following steps:
[0010] (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator in the variation of the indicator and a corresponding value of the n-th order polynomial;
[0011] (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold;
[0012] (iii) in a case where it is determined that the plurality of residual values include an outlier, removing the indicator corresponding to the outlier from the change of the indicator to generate an updated change of the indicator, and in a case where it is determined that the residual value does not include the outlier, determining an n-th order polynomial as the first frequency component and ending the process; and
[0013] (iv) fitting an nth-order polynomial to the updated changes of the indicator,
[0014] wherein, in a first iteration of the process, each of the plurality of residual values is calculated as a difference between the indicator in a corrected change of the indicator and a corresponding value of an nth-order polynomial fitted to the corrected change of the indicator, and wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in an updated change of the indicator generated in a previous iteration of the process and a corresponding value of an nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
[0015] In an embodiment of the first example aspect, the method may further include, when a reliability indicator has been set to indicate that the correction data is reliable: determining a number of residual values in a plurality of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold, wherein the second positive threshold is less than the first positive threshold and the second negative threshold is greater than the first negative threshold; compensating for an axial displacement between B scans in a B scan sequence by applying an offset based on a first frequency component to the B scans in the B scan sequence, when the determined number of residual values is less than a third threshold; and determining not to compensate for an axial displacement between B scans in the B scan sequence, when the determined number of residual values is not less than the third threshold.
[0016] In addition, according to a second exemplary aspect of the present invention, the inventors have devised a method for processing C-scan data and tracking scan data to generate correction data and also generate a reliability indicator indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans of an imaging target acquired by an OCT imaging system scanning along corresponding scan lines extending across the imaging target, the tracking scan data being acquired by the OCT imaging system scanning along tracking scan lines intersecting the scan lines, the correction data being used to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion between the OCT imaging system and the imaging target, the relative motion causing a distance between the OCT imaging system and the imaging target to change during the acquisition of the B-scan by the OCT imaging system. The method comprises generating the correction data by determining, for each of at least some of the B-scans in the sequence, a corresponding indicator of the axial displacement between corresponding representations of common ocular features in the B-scan and the tracking scan data. The method also includes generating a reliability indicator by: calculating a corresponding value of a metric using an indicator determined for a B-scan pair in at least some of the B-scans, the corresponding value of the metric indicating a corresponding velocity or a corresponding acceleration of the imaging target relative to the OCT imaging system when the B-scan pair was acquired; determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; in the event that at least a predetermined number of the calculated values of the metric are determined to exceed the threshold, setting the reliability indicator to indicate that the correction data is unreliable; and in the event that it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold, setting the reliability indicator to indicate that the correction data is reliable.
[0017] The method of the second example aspect may further include, in a case where the reliability indicator has been set to indicate that the correction data is reliable, using the correction data to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion of the OCT imaging system and the imaging target. Additionally or alternatively, in an embodiment of the second example aspect, the correction data may be generated by performing at least two iterations of a process comprising the steps of:
[0018] (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator in the variation of the indicator and a corresponding value of the n-th order polynomial;
[0019] (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold;
[0020] (iii) in the case where it is determined that the plurality of residual values include an abnormal value, removing the indicator corresponding to the abnormal value from the change of the indicator to generate an updated change of the indicator, and in the case where it is determined that the residual value does not include the abnormal value, determining the n-th order polynomial as correction data and ending the process; and
[0021] (iv) fitting the nth-order polynomial to the updated change of the indicator;
[0022] wherein, in a first iteration of the process, each residual value of the plurality of residual values is calculated as a difference between the indicator in the corrected change of the indicator and a corresponding value of the nth order polynomial fitted to the corrected change of the indicator, and
[0023] wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between an indicator in an updated change of the indicator generated in a previous iteration of the process and a corresponding value of the nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
[0024] In an embodiment of the second example aspect, the method may further include, in a case where a reliability indicator has been set to indicate that the correction data is reliable: determining a number of residual values among a plurality of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold, wherein the second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold; in a case where the determined number of residual values is less than a third threshold, compensating for an axial displacement between B scans in a B scan sequence by applying an offset based on the correction data to the B scans in the B scan sequence; and in a case where the determined number of residual values is not less than the third threshold, determining not to compensate for the axial displacement between B scans in the B scan sequence.
[0025] In addition, according to a third exemplary aspect of the present invention, the inventors have designed a computer program, which includes computer program instructions that, when executed by a processor, cause the processor to perform at least one of the above methods. The computer program can be stored on a non-transitory computer-readable storage medium, or it can be carried by a signal.
[0026] Furthermore, according to a fourth exemplary aspect of the present invention, the inventors have devised a data processing apparatus, the data processing apparatus being arranged to process C-scan data to generate correction data and also to generate a reliability indicator indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans of an imaging target acquired by an OCT imaging system, the correction data being used to compensate for an axial displacement between B-scans in the B-scan sequence caused by a relative motion between the OCT imaging system and the imaging target, the relative motion causing a distance between the OCT imaging system and the imaging target to vary during the acquisition of the B-scans by the OCT imaging system. The apparatus comprises a correction data generator module, the correction data generator module being arranged to determine the correction data by determining, for each of a plurality of pairs of adjacent B-scans in the sequence, a corresponding indicator of the axial displacement between corresponding representations of common ocular features in the adjacent B-scans. The device also includes a reliability indicator generator module, which is arranged to generate a reliability indicator in the following manner: using a corresponding value of a metric calculated from a B-scan pair in a B-scan sequence to generate a reliability indicator, the corresponding value of the metric indicating a corresponding speed or a corresponding acceleration of the imaging target relative to the OCT imaging system when the B-scan pair is acquired; determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; in a case where at least a predetermined number of the calculated values of the metric are determined to exceed the threshold, setting the reliability indicator to indicate that the correction data is unreliable; and in a case where it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold, setting the reliability indicator to indicate that the correction data is reliable.
[0027] The correction data generator module can be arranged to generate correction data in the following manner: determining a first frequency component of the change in the position of the corresponding adjacent B-scan pairs in the sequence based on the determined indicator, the first frequency component indicating the relative movement of the OCT imaging system and the imaging target during the acquisition of the B-scan by the OCT imaging system.
[0028] The correction data generator module can be arranged to determine a corresponding indicator of the axial shift of each adjacent B-scan pair by calculating a cross-correlation between adjacent B-scan pairs and determining an offset between the B-scans corresponding to a peak in the calculated cross-correlation as an indicator, or, identifying corresponding positions of common eye features in the B-scans of adjacent B-scan pairs and determining a displacement between the identified positions along an axis of the B-scan, the axis of the B-scan representing an axial direction of the imaging system.
[0029] The imaging target may have a curvature, and the correction data generator module may be further arranged to determine a second frequency component of the change indicative of the curvature of the imaging target. The second frequency component may be determined by fitting an m-order polynomial to the determined change in the indicator, and the first frequency component may be determined by subtracting a value of the m-order polynomial from the indicator in the determined change in the indicator to generate a corrective change in the indicator, and fitting an n-order polynomial to the corrective change in the indicator, wherein m and n are integers, and m is less than n.
[0030] The above-mentioned data processing device may also include a displacement compensation module, which is arranged to use the correction data to compensate for the axial displacement between B scans in the B scan sequence caused by the relative movement of the OCT imaging system and the imaging target when the reliability indicator has been set to indicate that the correction data is reliable.
[0031] In an embodiment of the fourth example aspect, the correction data generator module may be arranged to determine the first frequency component by performing at least two iterations of a process further comprising the steps of:
[0032] (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator of the change of the indicator and a corresponding value of the nth-order polynomial;
[0033] (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold;
[0034] (iii) in a case where it is determined that the plurality of residual values include an outlier, removing the indicator corresponding to the outlier from the change of the indicator to generate an updated change of the indicator, and in a case where it is determined that the residual value does not include the outlier, determining an n-th order polynomial as the first frequency component and ending the process; and
[0035] (iv) fitting the nth-order polynomial to the updated changes of the indicator,
[0036] wherein, in a first iteration of the process, each of the plurality of residual values is calculated as a difference between the indicator in a corrected change of the indicator and a corresponding value of an nth-order polynomial fitted to the corrected change of the indicator, and wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in an updated change of the indicator generated in a previous iteration of the process and a corresponding value of an nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
[0037] In an embodiment of the fourth example aspect, in a case where the reliability indicator has been set to indicate that the correction data is reliable, the correction data generator module (2) can also be arranged to: determine the number of residual values in a plurality of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold, wherein the second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold; in a case where the determined number of residual values is less than a third threshold, the displacement compensation module can be arranged to compensate for the axial displacement between the B scans in the B scan sequence by applying an offset based on the correction data to the B scans in the B scan sequence; and in a case where the determined number of residual values is not less than the third threshold, the displacement compensation module can be arranged not to compensate for the axial displacement between the B scans in the B scan sequence.
[0038] Furthermore, according to a fifth exemplary aspect of the present invention, the inventors have devised a data processing apparatus, the data processing apparatus being arranged to process C-scan data and tracking scan data to generate correction data and also generate a reliability indicator indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans of an imaging target acquired by an OCT imaging system scanning along corresponding scan lines extending across the imaging target, the tracking scan data being acquired by the OCT imaging system scanning along tracking scan lines intersecting the scan lines, the correction data being used to compensate for axial displacement between B-scans in the B-scan sequence caused by relative motion between the OCT imaging system and the imaging target, the relative motion causing a distance between the OCT imaging system and the imaging target to vary during the acquisition of the B-scan by the OCT imaging system. The apparatus comprises a correction data generator module, the correction data generator module being arranged to generate correction data by determining, for each of at least some of the B-scans in the sequence, a corresponding indicator of the axial displacement between corresponding representations of common ocular features in the B-scan and tracking scan data. The apparatus also includes a reliability indicator generator module, which is arranged to generate a reliability indicator by: using indicators determined for B-scan pairs in at least some of the B-scans, calculating a corresponding value of a metric, the corresponding value of the metric indicating a corresponding velocity or a corresponding acceleration of the imaging target relative to the OCT imaging system when the B-scan pairs were acquired; determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; in the event that at least a predetermined number of the calculated values of the metric are determined to exceed the threshold, setting the reliability indicator to indicate that the correction data is unreliable; and in the event that it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold, setting the reliability indicator to indicate that the correction data is reliable.
[0039] The data processing device of the fifth exemplary aspect may also include a displacement compensation module, which is arranged to use the correction data to compensate for axial displacement between B scans in a B scan sequence caused by relative movement between the OCT imaging system and the imaging target when a reliability indicator has been set to indicate that the correction data is reliable.
[0040] In an embodiment of the fifth example aspect, the correction data generator module may be arranged to generate the correction data by performing at least two iterations of a process comprising the following steps:
[0041] (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator of the change of the indicator and a corresponding value of the nth-order polynomial;
[0042] (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold;
[0043] (iii) in a case where it is determined that the plurality of residual values include the abnormal value, removing the indicator corresponding to the abnormal value from the change of the indicator to generate an updated change of the indicator, and in a case where it is determined that the residual value does not include the abnormal value, determining the n-th order polynomial as the correction data and ending the process; and
[0044] (iv) fitting the nth-order polynomial to the updated change of the indicator, wherein, in a first iteration of the process, each of the plurality of residual values is calculated as a difference between the indicator in the corrected change of the indicator and a corresponding value of the nth-order polynomial fitted to the corrected change of the indicator, and wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in the updated change of the indicator generated in a previous iteration of the process and a corresponding value of the nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
[0045] In an embodiment of the fifth example aspect, in a case where a reliability indicator has been set to indicate that the correction data is reliable, the correction data generator module can be arranged to: determine the number of residual values in a plurality of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold, wherein the second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold; in a case where the determined number of residual values is less than a third threshold, the displacement compensation module is arranged to compensate for the axial displacement between B scans in the B scan sequence by applying an offset based on the correction data to the B scans in the B scan sequence; and in a case where the determined number of residual values is not less than the third threshold, the displacement compensation module is arranged not to compensate for the axial displacement between the B scans in the B scan sequence. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Example embodiments will now be explained in detail, by way of non-limiting example only, with reference to the accompanying drawings described below. Like reference numerals appearing in different figures of the drawings may represent identical or functionally similar elements, unless otherwise indicated.
[0047] Figure 1 is a schematic diagram of a data processing apparatus for processing C-scan data according to a first exemplary embodiment of the present invention.
[0048] Figure 2A An example of movement of a subject causing a change in the distance between the subject's retina and an OCT imaging system during imaging of the retina by the OCT imaging system is shown.
[0049] Figure 2B An example of an axis shift between common ocular features in adjacent B-scan pairs in a B-scan sequence acquired by an OCT imaging system is shown. Figure 2A The retinal movements shown are induced.
[0050] Figure 3 is a block diagram illustrating an example implementation in programmable signal processing hardware of a data processing apparatus of example embodiments herein.
[0051] Figure 4 is a flow chart illustrating a method by which, Figure 1 The data processing device processes C-scan data comprising a B-scan sequence to generate correction data for compensating for axial displacement between B-scans in the sequence, and also generates a reliability indicator indicating the reliability of the correction data.
[0052] Figure 5 A method according to a first example embodiment described herein is shown which may be performed by a data processing apparatus to determine a varying first frequency component indicative of relative motion of an OCT imaging system and a retina during acquisition of a B-scan.
[0053] Figure 6 Graphs showing a plurality of sequences of indicator values, each indicator value indicating an axis shift between common retinal features in a pair of B-scans in a B-scan sequence. The graphs show how the indicator values vary with the position of corresponding adjacent pairs of B-scans in the sequence.
[0054] Figure 7 A method according to a second example implementation described herein is shown, which may be performed by a data processing apparatus to determine a varying first frequency component.
[0055] Figure 8A method according to a third example implementation described herein is shown, which may be performed by a data processing apparatus to determine a first frequency component.
[0056] Fig. 9 A method according to an example embodiment herein is shown that may be performed by a data processing apparatus to determine whether to compensate for axial displacement between B-scans in a B-scan sequence.
[0057] Fig.10 is a schematic diagram of a data processing apparatus for processing C-scan data according to a second exemplary embodiment of the present invention.
[0058] Fig.11 is a flow chart showing a method by which a data processing apparatus of a second exemplary embodiment processes C-scan data to generate correction data for compensating for axial displacement between B-scans and a reliability indicator indicating the reliability of the generated correction data.
[0059] Fig.12 is a diagram showing an example relationship between the position of the A-scan in the C-scan and the position of the A-scan of the tracking scan data.
[0060] Fig.13 is a diagram showing another example relationship between the position of an A-scan in a C-scan and the position of an A-scan of tracking scan data. DETAILED DESCRIPTION
[0061] [Example 1]
[0062] Figure 1 is a schematic diagram of a data processing device 10 according to a first exemplary embodiment. The data processing device 10 is configured to process C-scan data of a B-scan sequence including an imaging target 20 (the C-scan data is acquired by an OCT imaging system 30) to generate correction data for compensating for axial displacement between B-scans in the B-scan sequence, and also to generate a reliability indicator 5 indicating the reliability of the generated correction data.
[0063] As in the present example embodiment, the imaging target 20 may be the retina of the subject's eye 25, but alternatively, the imaging target 20 may be another portion of the eye 25 (such as, for example, the anterior region of the eye 25). The axial displacement is caused by the relative motion of the OCT imaging system 30 and the imaging target 20, which causes the distance between the OCT imaging system 30 and the imaging target 20 to change during the acquisition of the B-scan by the OCT imaging system 30. The axial displacement may be understood as a displacement along the propagation direction of the OCT beam 40 incident on the eye 25 during the imaging of the retina using the OCT imaging system 30.
[0064] The OCT imaging system 30 employs an ophthalmic scanner to scan an OCT imaging beam 40 across an imaging target 20 to acquire C-scan data that is processed by a data processing device 10. As in the present example embodiment, the data processing device 10 may be provided as a standalone processor such as a PC or laptop, which may be communicatively coupled to the OCT imaging system 30 (directly or via a network, such as the Internet) to receive C-scan data therefrom. Alternatively, the data processing device 10 may be provided as part of the OCT imaging system 30. The OCT imaging system 30 may be any type of OCT scanner known to those skilled in the art that is capable of acquiring OCT data from a subject's eye 25.
[0065] like Figure 1 As shown, the data processing apparatus 10 of the present exemplary embodiment includes a correction data generator module 2 configured to generate correction data by, for each of a plurality of pairs of adjacent B-scans in a sequence, determining a corresponding indicator of an axis shift between corresponding representations of common ocular features in adjacent B-scans. As in the present exemplary embodiment, the axis shift may represent a displacement (or offset) between common ocular features in adjacent B-scans along the axis of the B-scan corresponding to the axial direction (i.e., the direction in which data in each of the A-scans constituting the B-scans are arranged, the data being obtained by measurements at different depths along the propagation direction of the OCT beam 40 incident on the eye 25). In the present exemplary embodiment, the B-scan sequence processed by the correction data generator module 2 includes a complete B-scan sequence forming C-scan data acquired by the OCT imaging system 30. However, it should be noted that the B-scan sequence processed by the correction data generator module 2 need not be the aforementioned complete sequence, and may alternatively span a subset including the complete sequence, such as a subset including every other B-scan in the complete B-scan sequence.
[0066] The data processing device 10 also includes a reliability indicator generator module 4, which is arranged to generate a reliability indicator 5. More specifically, the reliability indicator generator module 4 is arranged to use the B-scan pairs in the B-scan sequence to calculate a corresponding value of a metric, the corresponding value of the metric indicating a corresponding speed or a corresponding acceleration of the imaging target relative to the OCT imaging system when the B-scan pairs are acquired. The reliability indicator generator module 4 is also arranged to determine whether at least a predetermined number of the calculated values of the metric exceed a threshold value. In the event that at least a predetermined number of the calculated values of the metric exceed the threshold value, the reliability indicator generator module 4 is arranged to set the reliability indicator 5 to indicate that the correction data is unreliable. However, in the event that it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold value, the reliability indicator generator module 4 is arranged to set the reliability indicator 5 to indicate that the correction data is reliable.
[0067] As in Figure 1 In the example embodiment shown, the data processing apparatus 10 may further include a displacement compensation module 6, which is arranged to use the correction data to compensate for the axial displacement between B scans in the B scan sequence caused by the relative motion of the OCT imaging system 30 and the imaging target 20 during the acquisition of the B scan by the OCT imaging system 30. In some example embodiments, the displacement compensation module 6 is arranged to perform the aforementioned compensation only if the reliability indicator 5 has been set to indicate that the correction data is reliable.
[0068] The C-scan may be rendered to provide a three-dimensional image of a portion of the eye 25, and includes a sequence of B-scans, which are typically acquired by scanning the OCT beam 40 in a raster pattern or the like across a two-dimensional region of the eye 25. Each B-scan is acquired by scanning the OCT beam 40 in a single direction (e.g., such as along the X-axis on the surface of the retina) to record a two-dimensional cross-sectional view (along the X-axis and the Z-axis) of a region of the eye 25. Each B-scan includes multiple A-scans, wherein each A-scan provides image data representing the axial / depth direction of the eye 25 (i.e., along the Z-axis) for a single lateral point in the eye 25.
[0069] Figure 2A An example of motion of the imaging target 20 (ie, the retina in this example) relative to the OCT imaging system 30 is shown, which causes a change in the distance between the retina and the OCT imaging system 30 during acquisition of C-scan data. Figure 2A As shown in the example of , movement of the subject during acquisition of the B-scan causes the distance (along the axial direction) between the retina and the OCT imaging system 30 to decrease by a distance D.
[0070] Figure 2B Shown in Figure 2A The axis shift of the position of a common ocular feature observed in the adjacent B-scan pairs, labeled 210 and 220, captured before and after the relative motion of the eye 25 and the OCT imaging system 30 is shown. In this example, the common ocular feature in the adjacent B-scan pairs is the retinal layer 230 of the eye 25. Figure 2B As shown, due to the movement of the retina during the acquisition of the B-scan, the position of the retinal layer 230 in the B-scan 220 is offset by a distance of d pixels along the Y axis of the B-scan relative to its position in the B-scan 210. Figure 2BIn the C-scan data, the Y-axis of B-scans 210 and 220 represents the axial direction, while the X-axis represents the lateral direction along the surface of the retina. If not corrected, the axis shift of the retinal layer 230 in adjacent B-scans will cause motion artifacts to appear in the rendering of the C-scan data, which may prevent the correct diagnosis or measurement of the underlying features in the retina being made.
[0071] Figure 3 is a schematic diagram of programmable signal processing hardware 300 that can be configured to process functional C-scan data using the techniques described herein and that can be used as the correction data generator module 2, reliability indicator generator module 4, and displacement compensation module 6 of the first example embodiment.
[0072] The programmable signal processing device 300 includes a communication interface (I / F) 310 for communicating with the OCT imaging system 30 to receive C-scan data therefrom. The signal processing device 300 also includes a processor (e.g., a central processing unit CPU and / or a graphics processing unit GPU) 320, a working memory 330 (e.g., a random access memory), and an instruction storage device 340 storing a computer program 390 including computer-readable instructions that, when executed by the processor 320, cause the processor 320 to perform various functions, including the functions of the correction data generator module 2, the reliability indicator generator module 4, and the displacement compensation module 6 described herein. The working memory 330 stores information used by the processor 320 during the execution of the computer program 390. The instruction storage device 340 may include a ROM (e.g., in the form of an electrically erasable programmable read-only memory (EEPROM) or flash memory) preloaded with computer-readable instructions. Alternatively, the instruction storage device 340 may include a RAM or similar type of memory, and the computer-readable instructions of the computer program 390 may be input to the instruction storage device 340 from a computer program product (such as a non-volatile computer-readable storage medium 350 in the form of a CD-ROM, DVD-ROM, etc., or a computer-readable signal 360 carrying the computer-readable instructions). In any case, the computer program 390, when executed by the processor 320, causes the processor 320 to perform the method of processing C-scan data as described herein. However, it should be noted that the correction data generator module 2, the reliability indicator generator module 4, and the displacement compensation module 6 may alternatively be implemented in non-programmable hardware (such as an application-specific integrated circuit (ASIC)).
[0073] Figure 4 is a flow chart illustrating a method by which, Figure 1The data processing device processes C-scan data including a B-scan sequence to generate correction data for compensating for axial displacement between B-scans in the B-scan sequence and a reliability indicator indicating reliability of the generated correction data.
[0074] exist Figure 4 In step S10 of , the correction data generator module 2 generates correction data by determining, for each adjacent B-scan pair in a plurality of adjacent B-scans in the sequence, a corresponding indicator of an axis shift between corresponding representations of a common ocular feature in the adjacent B-scans. As in the present example embodiment, the corresponding indicator of the axis shift may be a distance between corresponding coordinates of the common ocular feature in a pair of adjacent B-scans along an axis of the B-scan corresponding to the axial direction described above. However, the indicator of the axis shift is not limited in this respect and may alternatively be a value determined based on the distance. As an example, for a sequence B of N+1 B-scans k A set of N indicators S can be derived from the N corresponding B-scan pairs in the B-scan sequence (for k=1, 2, ..., N+1). i (for i=1, 2, ..., N), where the indicator S i is scanning from B k=i and B k=i+1 The B scan is exported and indicates the k=i and B k=i+1 Thus, indicator index i corresponds to the axis shift between the corresponding representations of the common eye feature in S. i The positions of adjacent B-scan pairs in the B-scan sequence.
[0075] As in the present example embodiment, an indicator of axis shift can be determined for each adjacent B-scan pair by calculating a cross-correlation between adjacent B-scan pairs and determining as an indicator the offset between the B-scans corresponding to the peak in the calculated cross-correlation. The cross-correlation can, for example, be a normalized two-dimensional cross-correlation of adjacent B-scan pairs that determines the offset (along the two axes of the B-scan) of the position of the representation of an ocular feature in one B-scan (of the B-scan pair) relative to the position of the representation of the same ocular feature in the other B-scan. However, only the offset determined along the axis of the B-scan corresponding to the axial direction can be considered as an indicator of axis shift between the corresponding representations of the common ocular feature in the adjacent B-scan pair. In some cases, where lateral movement of the eye during acquisition of the B-scan can be ignored, a one-dimensional cross-correlation of adjacent B-scan pairs can be performed, and the offset between the B-scans corresponding to the peak in the calculated one-dimensional cross-correlation can be considered as an indicator of axis shift.
[0076] Although cross-correlation is used in the present example embodiment to calculate the indicator of axis shift, any other suitable method may alternatively be employed. For example, in an alternative embodiment, the indicator of axis shift may be determined for each adjacent B-scan pair by identifying corresponding positions of common ocular features in the B-scans of the adjacent B-scan pair and determining the displacement between the identified positions along the axis of the B-scan corresponding to the axial direction as described above. For example, a machine learning algorithm or any other suitable image processing algorithm may be used to identify corresponding positions of common ocular features in the adjacent B-scan pair.
[0077] exist Figure 4 In step S20, the reliability indicator generator module 4 uses the B-scan pairs in the B-scan sequence to calculate corresponding values of a metric indicating the velocity and / or acceleration of the imaging target 20 relative to the OCT imaging system 30 when the B-scan pairs were acquired. As in the present example embodiment, the metric may be a velocity metric indicating the velocity (in the axial direction) of the imaging target 20 relative to the OCT imaging system 30.
[0078] As in this example embodiment, the Figure 4 In step S10 of , a velocity metric is calculated using indicators determined for adjacent B-scan pairs in the B-scan sequence. Since each indicator indicates an axial shift of a common ocular feature in a pair of adjacent B-scans, the indicator value, when divided by the time between adjacent B-scans, represents the velocity of the imaging target 20 relative to the OCT imaging system 30. However, it should be understood that the velocity metric need not be calculated using adjacent B-scans, but can be calculated based on the axial shift of the common ocular feature in non-adjacent B-scan pairs in the B-scan sequence. More generally, the axial shift of the common ocular feature determined in the B-scan pair, separated by the time interval between capturing the B-scans in the B-scan pair, provides an indication of the rate of axial movement of the common ocular feature, and therefore indicates the velocity of the relative motion of the imaging target 20 and the OCT imaging system 30. As in the present example embodiment, the metric may be calculated for each adjacent B-scan pair in the sequence, but may alternatively be calculated for only a subset of all acquired B-scan pairs, as previously described.
[0079] exist Figure 4 In step S30, the reliability indicator generator module 4 determines whether at least a predetermined number of the calculated values of the metric exceed the threshold value. In the case where at least a predetermined number of the calculated values of the metric are determined to exceed the threshold value, Figure 4 In step S40A, the reliability indicator generator module 4 sets the reliability indicator 5 to indicate that the correction data is unreliable. On the other hand, in the case where it is determined in step S30 that less than a predetermined number of the calculated values of the metric exceed the threshold, Figure 4In step S40B, the reliability indicator generator module 4 sets the reliability indicator 5 to indicate that the correction data is reliable. In this example embodiment, in the case where the metric is a speed metric, Figure 4 The threshold used in step S30 may correspond to the maximum physically possible velocity that the imaging target 20 is expected to occur during the capture of the OCT C-scan data. Any calculated value of the metric that exceeds this threshold may be considered an anomaly caused by a spurious correlation between the B-scans, rather than an anomaly caused by actual relative motion of the imaging target 20 and the OCT imaging system 30. Therefore, Figure 4 The predetermined number in step S30 may be set based on a maximum number of anomalies that may be accepted before the correction data is deemed unreliable.
[0080] Although in this example embodiment the metric is a speed metric, Figure 4 The metric calculated in step S20 may take other forms, such as an acceleration metric indicating the acceleration of the imaging target 20 relative to the OCT imaging system 30. Figure 4 When the metric in step S20 is taken as an acceleration metric, the threshold in step S30 can be set based on the maximum value of the acceleration of the imaging target 20 that is considered to be realistic or physically possible. The reliability indicator generator module 4 can evaluate the acceleration metric by determining a first value indicating the rate of axis shift of the common eye feature in a first pair of B-scans and a second value indicating the rate of axis shift of the common eye feature in a second pair of B-scans, where the first pair differs from the second pair by at least one B-scan. The reliability indicator generator module 4 can also evaluate the acceleration metric based on the difference between the first value and the second value. For example, for a first pair of B-scans captured at times T1 and T2 and having a determined axis shift rate value A1, and a second pair of B-scans captured at times T3 and T4 (occurring after times T1 and T2) and having a determined axis shift rate value A2, the acceleration metric can be calculated as:
[0081]
[0082] However, it should be understood that the acceleration measure is not limited to the above form and can be calculated based on the difference between A2 and A1 and another measure of the time interval of the two B-scan pairs (eg, T3 - T1 or T4 - T2).
[0083] In some example embodiments, where the reliability indicator 5 has been set to indicate that the correction data is reliable, the displacement compensation module 6 may use the correction data to compensate for the axial displacement between B-scans in the B-scan sequence caused by the relative motion of the OCT imaging system 30 and the imaging target 20, such as Figure 4On the other hand, in the case where the reliability indicator 5 has been set to indicate that the correction data is unreliable, the displacement compensation module 6 does not use the correction data to perform the aforementioned compensation for the axial displacement between the B scans, as shown in step S50A. For example, when the reliability indicator has been set to indicate that the correction data is unreliable, the B scan sequence can be discarded and / or indicated to the user as unreliable, and new C scan data including a new B scan sequence can be captured by performing a new OCT scan on the imaging target 20. Figure 4 The new B-scan sequence is processed using the process in to generate new correction data and new reliability indicators.
[0084] The determined variation of the indicator with the position of the corresponding adjacent B-scan pair in the sequence may include high frequency components caused by noisy data and / or data contaminated by image artifacts caused by flicker and lines and, therefore, spurious correlations between adjacent B-scans. Therefore, without some form of pre-filtering to remove outliers or anomalies, indicators generated directly based on adjacent B-scans may not be suitable for compensating for axial displacement of the B-scans. Therefore, in some example embodiments, frequency components of the variation indicative of relative motion of the OCT imaging system 30 and the imaging target 20 during acquisition of the B-scans may be determined and used to perform compensation in step S50B.
[0085] Figure 5 is a flow chart illustrating a method according to a first example embodiment described herein that may be performed by the correction data generator module 2 to determine a varying first frequency component indicative of relative motion of the OCT imaging system 30 and the imaging target 20 during acquisition of a B-scan.
[0086] like Figure 5 As shown in step S210, the correction data generator module 2 can generate correction data by determining a first frequency component of the change as the position of the corresponding adjacent B-scan pair in the sequence changes according to the determined indicator, and the first frequency component indicates the relative motion of the OCT imaging system 30 and the imaging target 20 during the acquisition of the B-scan by the OCT imaging system 30. Figure 5 In step S220 , the displacement compensation module 6 may compensate for the displacement between B scans in the B scan sequence caused by the relative motion between the OCT imaging system 30 and the imaging target 20 by applying the offset based on the first frequency component to the B scans in the B scan sequence.
[0087] For example, in Figure 5 In step S210, the correction data generation module 2 may generate the first frequency component of the change by fitting an n-order polynomial to the change of the indicator. Figure 5In step S220, the displacement compensation module 6 may compensate for the axial displacement between adjacent B scans in the sequence based on an n-order polynomial (e.g., by using one or more values of the n-order polynomial to offset one or more B scans in the B scan sequence). It should be noted that in some example embodiments, Figure 5 The compensation performed in step S220 may be conditioned on the following: Figure 4 In step S40A the reliability indicator has been set to indicate that the correction data is reliable.
[0088] It should also be noted that the first frequency component does not need to be Figure 5 The step S210 may be determined by polynomial fitting, and other suitable methods may be used. For example, in an alternative embodiment, the correction data generator module 2 may alternatively generate the first frequency component in step S210 by low-pass filtering the determined change of the indicator to remove high-frequency components that are not derived from the change of the relative motion of the imaging target 20 and the OCT imaging system 30.
[0089] Figure 6 Six example graphs are shown corresponding to six different sets of indicators determined from six different B-scan sequences of imaging a target 20 in an eye 25. Each graph shows the variation of the determined indicators for the corresponding B-scan sequence, wherein each indicator is calculated by cross-correlating adjacent B-scan pairs in the sequence and represents the axis shift between the adjacent B-scan pairs. Figure 6 In the example of , the indicator determined for each adjacent B-scan pair is plotted against an indicator index i, which also corresponds to the adjacent B-scan pair and thus represents the position of the adjacent B-scan pair in the B-scan sequence.
[0090] like Figure 6As shown, the determined indicator changes with the position of the corresponding adjacent B-scan pairs in the B-scan sequence can include multiple frequency components attributed to different reasons. For example, in addition to the frequency components due to the relative motion of the eye 25 and the OCT imaging system 30 during the acquisition of the B-scan sequence, the change can also include various other frequency components, such as, for example, low-frequency components caused by the curvature of the retina, which can be observed in the curve graphs 510, 520 and 530. In particular, the frequency component caused by the curvature of the retina may be lower than the frequency component caused by the motion of the eye 25, because the rate of the axis shift of the eye feature caused by the curvature of the retina in the B-scan sequence will likely be lower than the rate of the axis shift caused by the motion of the subject. In addition, the indicator changes with the position of the corresponding adjacent B-scan pairs in the sequence can also include high-frequency components caused by spurious correlations between adjacent B-scans. Such high-frequency components can be observed in the curve graphs 540, 550 and 560, each of which shows a large number of peaks that contribute to the presence of high-frequency components in the changes of these indicator values.
[0091] In some example embodiments, the imaging target 20 may have a curvature. In these embodiments, directly compensating the B-scan using indicators (determined by cross-correlating adjacent B-scans or by performing feature recognition using adjacent B-scans) may cause the imaging target 20 to be rendered without its curvature. Therefore, in some embodiments, it may be desirable to preserve the curvature of the imaging target 20 in the rendered C-scan (formed from the compensated B-scan) in order to more accurately diagnose and / or measure ocular features.
[0092] Figure 7 A method is shown in an embodiment where the imaging target 20 has a curvature, which can be performed by the correction data generator module 2 to Figure 5 In step S210, the first frequency component is determined. Figure 7 In step S310, the correction data generator module 2 determines a second frequency component of the variation, the second frequency component indicating the curvature of the imaging target 20 (in this example, the retina). As in this example embodiment, the correction data generator module 2 may determine the second frequency component by fitting an m-order polynomial to the variation of the determined indicator, where m is an integer. For example, the sequence S of the determined indicator i (i=1, 2, ..., N) can be represented as a set of N data points (x i , S i )(i=1, 2, ..., N). Then, by fitting an m-order polynomial to a set of equivalent data points (x i , S i )(i=1 to N), the m-order polynomial P m (x) Fit to the sequence S of indicatorsi (i=1、2、……、N), where x i is the same as the data point (x i , S i ) i The associated X coordinate value.
[0093] exist Figure 7 In step S320, the correction data generator module 2 subtracts the value of the m-order polynomial from the indicator in the determined indicator change to generate the correction change of the indicator. For example, for the indicator in the form of data points (x i , S i )(i=1、2、……、N) represents a certain indicator S i (i=1, 2, ..., N), and for the m-order polynomial P fitted to the indicator sequence m (x), the corrective change of the indicator can be represented by a set of values C i =S i –P m (x i )(i=1, 2, ..., N). In the present example, the second frequency component of the change indicative of the retinal curvature is determined by fitting a second order polynomial to the determined change in the indicator. However, polynomials of different orders may be used depending on the expected curvature of the imaging target 20. As in the present example embodiment, a second order polynomial may be fit using the least squares method to minimize the residual sum of squares between the change in the indicator and the second order polynomial, but any suitable polynomial regression method may alternatively be used.
[0094] exist Figure 7 In step S330, the correction data generator module 2 generates the correction data by fitting an n-order polynomial to the correction change C of the indicator. i (i=1, 2, ..., N) to determine the first frequency component of the change of the indicator, where N is an integer greater than m. The first frequency component indicating the relative motion of the OCT imaging system 30 and the imaging target 20 is thus represented by an n-order polynomial. As an example, the correction change C of the indicator i (i=1, 2, ..., N) can be represented as a data point (x i , C i )(i=1, 2, ..., N), and the n-order polynomial P n (x) can be fitted to the data points (x i , C i)(i=1, 2, ..., N). In some embodiments, the correction data generator module 2 may first apply a smoothing operation (e.g., by using a moving average filter) to the correction change of the indicator before fitting the nth-order polynomial, thereby avoiding overfitting to data points caused by spurious correlations. In the present example embodiment, a fifth-order polynomial is fitted to the correction change of the indicator as an nth-order polynomial. However, the value of n is not limited thereto and may be selected in any suitable manner. In some embodiments, the value of n may be selected based on scanning parameters used by the OCT imaging system 30 to obtain C-scan data, such as scanning density (e.g., the number of B-scans captured per unit area of the retina) and scanning duration (i.e., the total time spent acquiring C-scan data). As a general rule, for higher scanning densities and longer scanning durations, higher values of n may be selected for the nth-order polynomial.
[0095] Although the curvature of the retina is determined in this example embodiment by fitting a low-order polynomial function to the change in the indicator, other methods may be used instead. For example, the correction data generator module 2 may alternatively determine the curvature of the retina by fitting a low-order polynomial function to the change in the indicator (x i , S i )(i=1, 2, ..., N) performs a discrete Fourier transform to determine a second frequency component indicating the curvature of the retina to determine frequency domain samples of the change of the indicator. The correction data generator module 2 can also extract a subset of the frequency domain samples corresponding to a predetermined frequency range associated with the curvature of the retina. For example, the frequency range can be empirically determined based on the expected curvature of the retina. The frequency determination module 4 can also perform an inverse Fourier transform on a subset of the frequency domain samples to obtain a value corresponding to the second frequency component, which can be subtracted from the indicator in the determined change of the indicator to generate a corrected change of the indicator.
[0096] In some example embodiments, rather than performing an inverse Fourier transform on a subset of frequency domain samples and subtracting the obtained value corresponding to the second frequency component from the change in the indicator, the correction data generator module 2 may instead process the frequency domain samples by setting the subset of frequency domain samples to zero and perform an inverse Fourier transform on the processed frequency domain samples to directly obtain the corrective change in the indicator. Alternatively, the correction data generator module 2 may bandpass filter the change in the indicator to remove the second frequency component corresponding to the curvature of the retina in order to determine the corrective change in the indicator, and then fit an nth order polynomial to the corrective change in the indicator. The lower cutoff frequency of the bandpass filtering process may be selected based on the expected curvature of the retina.
[0097] However, it should be noted that in cases where the scanned spatial extent is small relative to the curvature of the retina, the curvature of the retina can be assumed to be negligible and, therefore, no second frequency component has to be determined. In this case, an nth-order polynomial can be directly fitted to the sequence S of the determined indicators i (i=1, 2, . . . , N), and is determined as a first frequency component indicating a relative motion between the OCT imaging system 30 and the imaging target 20 .
[0098] exist Figure 7 After determining the n-order polynomial in step S330, the displacement compensation module 6 can Figure 7 In step S340, an offset based on an nth-order polynomial is applied to the B scans in the B scan sequence, and the nth-order polynomial is used as correction data to compensate for the displacement between the B scans in the B scan sequence caused by the relative movement of the OCT imaging system 30 and the imaging target 20 during the OCT imaging system 30 acquiring the B scan.
[0099] In this exemplary embodiment, the first frequency component is represented by an n-order polynomial P n (x) is given, and therefore, the displacement compensation module 6 can apply an offset by offsetting each B-scan in the B-scan sequence based on the value of the n-th order polynomial. Figure 7 The correction change sequence C fitted to the indicator in step S330 i (i=1, ..., N) (or more specifically, fitting to a corresponding set of data points (x i , C i n-order polynomial P )(i=1、2、……、N) n (x), we can determine a set of values P of the n-order polynomial n (x i )(for i=1, 2, ..., N). A set of values P can be used n (x i ) (for i = 1, 2, ..., N) and a mapping between the B scans in the sequence such that a set of values P n (x i Each value of )(i=1, 2, ..., N) is used to offset the B scan in the B scan sequence. In this example, since the indicator S i is scanning from B k=i and B k=i+1 Derived, so the polynomial value P n (x i ) can be used to offset the B scan B k=i+1 However, since each indicator indicates the axis shift between adjacent B-scans in the sequence, it is applied to each B-scan in the B-scan sequence. kThe offset of must also include the cumulative sum of the offsets applied to each previous B-scan in the sequence (i.e., the B-scans with indices lower than k in the sequence). In other words, for each B-scan B in the sequence k , An offset can be applied to the B-scan to correct for axis shift.
[0100] As an example, for a k The C scan of a sequence of 100 B scans represented by (k=1 to 100) can be obtained from the indicator S calculated from the 100 B scans. i Determine the n-order polynomial P from the variation of (i=1, 2, ..., 99) n (x), first by subtracting an m-order polynomial representing the curvature of the retina from the change in the indicator to obtain the corrected change C of the indicator i (i=1, 2, ..., 99), and then fit the n-order polynomial to the corrected change of the indicator. The displacement compensation module 6 can also determine the n-order polynomial P according to the corrected change of the indicator. n A set of values P of (x) n (x i )(i=1、2、……、99). A set of values P n (x i ) (for i=1, 2, ..., 99) can then be used to offset the B scan B k (k=1 to 100). For example, the displacement compensation module 6 can compensate for the displacement between 100 B scans by: shifting the B scan B2 by P n (x1) value, shift B scan B3 by P n (x1)+P n (x2), and more generally, B scans B k Offset offset.
[0101] It should be noted that although Figure 7 The offset of the B scan in step S340 is based on the sequence C of correction changes fitted to the indicator i (i=1, ..., N) is a polynomial of order n, but in some other example embodiments, the sequence C of the correction variation of the indicator i (i=1, ..., N) can be considered as the first frequency component and is used to directly shift the B scans in the B scan sequence. For example, for each B scan B in the sequence k , you can An offset of is applied to the B scan in order to correct for the axis shift of the eye 25.
[0102] In some example embodiments, the correction change C fitted to the indicatori The n-th order polynomial (i=1, ..., N) is not directly used as Figure 7 In contrast, according to the second exemplary embodiment, the correction data generator module 2 may be configured to generate the first frequency component of the offset B scan in step S340. Figure 5 In step S210, the first frequency component is determined by further performing at least two iterations of the process comprising the following steps:
[0103] (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator in which the indicator is changing and a corresponding value of the n-th order polynomial;
[0104] (ii) determining whether the plurality of residual values include an outlier that exceeds a first positive threshold or is below a first negative threshold;
[0105] (iii) in the case where it is determined that the plurality of residual values include an outlier, removing the indicator corresponding to the outlier from the change of the indicator to generate an updated change of the indicator, and in the case where it is determined that the plurality of residual values do not include an outlier, ending the process and determining the nth-order polynomial as the first frequency component; and
[0106] (iv) Fitting an nth-order polynomial to the updated changes of the indicator.
[0107] In a first iteration of the above process, each of the plurality of residual values is calculated as a difference between the indicator in the corrected change of the indicator and a corresponding value of an n-order polynomial fitted to the corrected change of the indicator. Additionally, in each of the remaining one or more iterations of the above process, each of the plurality of residual values is calculated as a difference between the indicator in the updated change of the indicator generated in a previous iteration of the process and a corresponding value of an n-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
[0108] Figure 8 is a flow chart illustrating a process that may be performed by the correction data generator module 2 to determine a first frequency component according to a second example implementation. Figure 8 As shown, the correction data generator module 2 can first execute the above reference Figure 7 However, in the second example embodiment, after the n-th order polynomial is determined in step S330, the n-th order polynomial is not directly used to shift the B-scan in step S340. Instead, Figure 8 In step S440, the correction data generator module 2 further calculates a plurality of residual values, each residual value being calculated as the difference between the indicator in the change of the indicator and the corresponding value of the n-order polynomial. i(i=1, 2, ..., N) is represented as a data point (x i , C i )(i=1, 2, ..., N), and the n-order polynomial is represented as P n (x), in Figure 8 In step S440, multiple residual values can be determined as R(x i )=C i -P n (x i )(for i=1, 2, ..., N).
[0109] exist Figure 8 In step S450, the correction data generator module 2 determines whether the plurality of residual values include an abnormal value that is higher than a first positive predetermined threshold or lower than a first negative predetermined threshold. In response to determining that the plurality of residual values include an abnormal value, Figure 8 In step S460, the correction data generator module 2 changes the correction value C of the indicator from i (i=1, 2, ..., N) to remove the correction indicator C corresponding to the abnormal value i , to generate the updated change U of the indicator i (For x=1 to N). Remove the correction indicator C corresponding to the outlier i This may include, for example, placing the correction indicator C i For example, if it is determined that the correction indicator C i=p The residual value is an outlier, then a set of data points (x i , C i The data points (x) representing the corrected changes of the indicators in (i=1, 2, ..., N) are p , C p ) may be set to zero. However, it should be noted that in some embodiments, the correction data generator module 2 may alternatively replace the correction indicator C corresponding to the outlier with a new value. i , instead of the correction indicator C corresponding to the outlier p =0, the new value may be based on the C having the residual value that is not determined as an abnormal value in step S460. i one or more other values of and obtained from these values, for example, by interpolation.
[0110] exist Figure 8 In step S470, the correction data generator module 2 fits an n-order polynomial to the updated change U of the indicator. i(for x=1, 2, ..., N). Then, the process of step S440 is repeated, this time calculating a plurality of residual values, where each residual value is calculated as the difference between the indicator in the updated variation of the indicator (determined in step S460) and the corresponding value of the n-th order polynomial that has been fitted to the updated variation of the indicator in step S470. After step S470 has been performed, it may be repeated Figure 8 The steps S440, S450, S460 and S470 in the above are repeated until it is determined in step S450 that the determined plurality of residual values for iteration do not contain an outlier (or in an alternative embodiment, contain a plurality of outliers less than a predetermined number). If it is determined in step S450 that there are no outliers in the plurality of residual values, the process proceeds to step S450A, where the n-order polynomial used to generate the plurality of residual values is considered as the first frequency component, and then Figure 7 The first frequency component is used in step S340 to shift the B scans so as to compensate for the displacement between B scans in the B scan sequence caused by the relative motion (in the axial direction) of the retina and the OCT imaging system 30. In particular, the correction data generator module 2 may use the same frequency component as previously described for Figure 7 In the same manner as described in step S340 , the B scan is offset based on the value of the nth order polynomial.
[0111] In some example embodiments, when Figure 8 When it is determined in step S450 that the plurality of residual values used for iteration do not contain any abnormal value, the correction data generator module 2 may further evaluate the plurality of residual values to determine whether the n-order polynomial used to obtain the plurality of residual values can be regarded as the first frequency component and Figure 7 In step S340, the B scan is used to offset. More specifically, referring to Fig. 9 ,exist Fig. 9 In step S510, the correction data generator module 2 may also determine the number of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold among the plurality of residual values, wherein the second positive threshold is less than Figure 8 The first positive threshold in step S450; and the second negative threshold is greater than Figure 8 The first negative threshold in step S450. Fig. 9 In step S520, the correction data generator module 2 determines Fig. 9 In response to determining whether the number of residual values determined in step S510 exceeds a third threshold value. Fig. 9 The number of residual values determined in step S510 does not exceed the third threshold, the correction data generator module 2 Fig. 9 In step S530A, an n-order polynomial used to generate a plurality of residual values (excluding any abnormal values) is selected as a first frequency component, and the n-order polynomial is performed by using the n-order polynomial as the first frequency component. Figure 7 On the other hand, if the correction data generator module 2 determines that Fig. 9 If the number of residual values determined in step S510 does exceed the third threshold, then Fig. 9 Step S530B is not executed Figure 7 Step S340. This is because, when a notable number of residual values is relatively high, this can be considered to indicate a poor fit of the nth order polynomial to the corrected change of the indicator (or the updated change of the indicator). Therefore, instead of using an nth order polynomial to correct the axial displacement in the B-scan sequence, the B-scan sequence can be discarded, and new C-scan data including the new B-scan sequence can be captured by performing a new OCT scan on the imaging target 20. The new B-scan sequence can be processed using any of the aforementioned methods to generate correction data for compensating for the axial displacement between B-scans in the B-scan sequence caused by the relative motion of the OCT imaging system 30 and the imaging target 20.
[0112] [Example 2]
[0113] In the first example embodiment described above and its variations, correction data may be derived from adjacent B-scan pairs in a B-scan sequence. However, in the data processing apparatus of the present example embodiment, correction data for compensating for axial shifts between B-scans is generated using tracking scan data used as reference data, and the acquired B-scans may be compared with the reference data in order to determine the correction data. That is, instead of generating correction data by determining a corresponding indicator of relative axial shifts between corresponding representations of common eye features in adjacent B-scans for each adjacent B-scan pair in a plurality of B-scans in a sequence, correction data may alternatively be generated by determining, for each B-scan of at least some of the B-scans in the sequence, a corresponding indicator of axial shifts between corresponding representations of common eye features in the B-scan and tracking scan data.
[0114] Fig.10 is a schematic diagram of a data processing device 10' for processing C-scan data according to a second exemplary embodiment of the present invention. The data processing device 10' is arranged to process C-scan data and tracking scan data to generate correction data for compensating for axis shifts between B-scans in a B-scan sequence, and to generate a reliability indicator 5' indicating the reliability of the generated correction data, wherein the C-scan data includes a B-scan sequence of an imaging target 20 acquired by scanning an OCT imaging system 30 along corresponding scan lines extending across the imaging target 20.
[0115] The OCT imaging system 30 acquires tracking scan data by performing scanning along the tracking scan line that intersects the scan line. As in the first exemplary embodiment, the axial displacement is caused by the relative motion of the OCT imaging system 30 and the imaging target 20, which causes the distance between the OCT imaging system 30 and the imaging target 20 to change during the period when the OCT imaging system 30 acquires the B scan. Fig.10 As shown, the data processing device 10' comprises a correction data generator module 2' and a reliability indicator generator module 4'. Furthermore, as in the present exemplary embodiment, the data processing device 10' may comprise a displacement compensation module 6'.
[0116] Fig.11 is a flow chart illustrating a method by which Fig.10 The data processing device 10' processes the C-scan data including the B-scan sequence to generate correction data and reliability indicators 5'. Fig.11 In step S10', the correction data generator module 2' generates correction data by determining, for each of at least some of the B-scans in the sequence, a respective indicator of an axis shift between respective representations of common eye features in the B-scan and tracking scan data.
[0117] Fig.12 is a diagram showing the relationship between the position of an A scan in a B scan of a B scan sequence forming a C scan according to a first example and the position of an A scan from tracking scan data. Fig.12 , matrix 1200 represents a top-down view of a C-scan at all lateral positions of the imaging target covered by the C-scan. Each cell in matrix 1200 corresponds to an A-scan in the C-scan. In addition, each row of matrix 1200 corresponds to a B-scan in the C-scan. A sequence of B-scans corresponding to the rows of matrix 1200 is acquired by performing an OCT scan along a plurality of scan lines extending along the imaging target 20. To illustrate this, Fig.12 A tracking scan line 1220 is shown superimposed on the matrix 1200, along which an OCT scan is performed to generate corresponding tracking scan data. Fig.12 , each grey cell 1205 represents an A-scan of tracking scan data superimposed on the C-scan represented by the matrix 1200 . Fig.12 The tracking scan data in is generated by performing an OCT scan along a tracking scan line extending across the imaging target 20.
[0118] like Fig.12As shown, the tracking scan line 1220 intersects with the plurality of scan lines 1210 such that each B-scan in the matrix 1200 (i.e., a row in the matrix 1200) has an A-scan that overlaps or intersects with a corresponding A-scan of the tracking scan data. Therefore, based on a mapping of each A-scan in the C-scan to a correspondingly positioned A-scan in the tracking scan data, the A-scan of the B-scan and the corresponding A-scan of the tracking scan data can be used to determine the indicator described in step S10'. Therefore, the correction data generator module 2' can determine the indicator in step S10' by cross-correlating the A-scan in the B-scan sequence with the correspondingly positioned A-scan of the tracking scan data. Alternatively, the correction data generator module 2' can use an appropriate feature recognition algorithm to identify representations of common features in the A-scan of the B-scan and the correspondingly positioned A-scan of the tracking scan data before determining the offset (along the axial direction) between the corresponding representations of the common features.
[0119] However, it should be noted that the tracking scan line is not limited to Fig.12 The straight line shown, and may more generally extend across the imaging target 20 along any trajectory as long as it intersects (or overlaps) a scan line that is scanned to generate a B-scan sequence.
[0120] Fig.13 1 shows the relationship between the position of the A scan in the C scan and the position of the A scan forming the tracking scan data in another example using circular tracking scanning. Fig.12 The same way as the C-scan is described. Fig.13 In the example of FIG. 1 , the tracking scan data includes a plurality of A-scans 1310 corresponding to a plurality of lateral positions on the imaging target 20 scanned in a circular manner by the OCT imaging light. In other words, in the present example, the tracking scan line along which the OCT imaging system 30 scans the OCT imaging light beam to generate the tracking scan data follows a circular trajectory along the surface of the imaging target 20. In addition, as shown in FIG. Fig.13 As shown, according to the density of the A scans forming the tracking scan data, a plurality of A scans of the tracking scan data may overlap with the A scans of the B scans in the B scan sequence forming the C scan. In this case, for example, an indicator may be calculated for each of the plurality of A scans, and an average value of the indicators obtained by the plurality of A scans may be calculated and used as an indicator of the B scan.
[0121] Reference again Fig.11 ,exist Fig.11After the correction data is determined in step S10' of the reliability indicator generator module 4', the reliability indicator 5' is generated by executing steps S20', S30', and one of S40A' and S40B'. More specifically, in step S20', the correction data generator module 2' generates the reliability indicator 5' by using the corresponding value of the indicator calculation metric determined for the B-scan 210, 220 pair in at least some of the B-scans, the corresponding value of the metric indicating the corresponding velocity or the corresponding acceleration of the imaging target 20 relative to the OCT imaging system 30 when the B-scan 210, 220 pair was acquired.
[0122] As in this example embodiment, the metric may be a velocity metric indicating the velocity (in the axial direction) of the imaging target 20 relative to the OCT imaging system 30. As in this example embodiment, the metric may be used Fig.11 The velocity metric is calculated from a pair of indicators among the plurality of indicators determined in step S10', the pair of indicators corresponding to two B-scans in the B-scan sequence. In particular, the difference between the values of the two indicators divided by the time between the acquisition of the two B-scans corresponding to the two indicators represents the velocity of the imaging target 20 relative to the OCT imaging system 30. The two indicators do not need to be indicators of two adjacent B-scans, but may be indicators corresponding to two non-adjacent B-scans in the B-scan sequence.
[0123] In some example embodiments, instead of a speed metric, Fig.11 The metric calculated in step S20' may alternatively be an acceleration metric that indicates the acceleration of the imaging target 20 relative to the OCT imaging system 30. The reliability indicator generator module 4' may calculate the acceleration metric by determining a first value indicating the axis shift rate of the common eye feature in a first pair of B-scans and a second value indicating the axis shift rate of the common eye feature in a second pair of B-scans, wherein the first pair differs from the second pair by at least one B-scan. In this example, the first value may be determined using a first pair of indicators corresponding to a first pair of B-scans among the multiple indicators determined in step S10'. The first value may be calculated, for example, as the difference between the first pair of indicators. Similarly, the second value may be determined using a second pair of indicators corresponding to a second pair of B-scans among the multiple indicators determined in step S10'. The second value may be calculated, for example, as the difference between the second pair of indicators. The reliability indicator generator module 4' may also evaluate the acceleration metric based on the difference between the first value and the second value. For example, for a first pair of B-scans captured at times T1 and T2 and having a determined axis shift rate value A1, and a second pair of B-scans captured at times T3 and T4 (occurring after times T1 and T2) and having a determined axis shift rate value A2, the acceleration metric may be calculated as:
[0124]
[0125] However, it should be understood that the acceleration metric is not limited to the above form and can be calculated based on the difference between A2 and A1 and another metric of the time interval between two pairs of B scans (e.g., T3-T1 or T4-T2). When the metric is considered to be an acceleration metric in step S20', the threshold set in step S30' can be set based on the maximum value of acceleration that is considered to be realistic or physically possible.
[0126] In step S30', the reliability indicator generator module 4' further determines whether at least a predetermined number of the metric calculation values exceed a threshold value. Step S30' and Figure 4 The only difference is that the threshold value and the predetermined number of values used in step S30' may be different from Figure 4 The corresponding features in step S30 are different due to the different way of calculating the metric in step S20' compared to the metric in step S20.
[0127] Back to Fig.11 In the case where at least a predetermined number of the calculated values of the metric are determined to exceed the threshold value, the reliability indicator generator module 4' sets the reliability indicator 5' to indicate that the correction data is unreliable in step S40A'. However, in the case where it is determined that at least a predetermined number of the calculated values of the metric do not exceed the threshold value, the reliability indicator generator module 4' sets the reliability indicator 5' to indicate that the correction data is reliable.
[0128] In some example embodiments, where the reliability indicator 5' has been set to indicate that the correction data is reliable, the displacement compensation module 6' may use the correction data to compensate for axial displacement between B-scans in a B-scan sequence caused by relative motion between the OCT imaging system 30 and the imaging target 20, such as Fig.11 On the other hand, in the case where the reliability indicator 5' has been set to indicate that the correction data is unreliable, the displacement compensation module 6' does not use the correction data to perform the aforementioned compensation for the axial displacement between B scans, such as Fig.11 As shown in step S50A'.
[0129] It should be understood that Fig.10 The data processing device 10' and Figure 1The apparatus of is different in that, instead of generating correction data by determining, for each of a plurality of pairs of adjacent B-scans in a sequence, a respective indicator of an axis shift between respective representations of common eye features in adjacent B-scans, correction data is generated by determining, for each of at least some of the B-scans in the sequence, a respective indicator of an axis shift between respective representations of common eye features in B-scan and tracking scan data. In this regard, all implementation details of the data processing apparatus 10 described above also apply to the data processing apparatus 10'. For example, with reference to Figure 5 The described process is also applicable to the data processing device 10', the only difference being that in this exemplary embodiment, the first frequency component can be determined based on the determined indicator as the position of the corresponding B-scan in the sequence changes. Furthermore, in the case where a polynomial is fitted to the indicator to determine the first frequency component, taking into account Figure 1 Compared with the correction data generator module 2 in , the correction data generator module 2 ′ generates its indicator in a different way, and in this example embodiment, polynomials of different orders may be selected.
[0130] For the data processing device 10', as described in relation to Figure 7 As described in steps S310 to S330 of , there is no need to perform determination of a second frequency component indicative of the curvature of the imaging target 20, because performing compensation based on correction data generated using the tracking scan data can allow any curvature of the imaging target 20 to be preserved. This is because the curvature is captured by both the tracking scan data and the B-scan sequence, and any calculated axis shift between the tracking scan data and the B-scan sequence may simply be the result of relative motion during scan acquisition, as well as spurious correlation results as described above. However, Figure 8 Steps S440 to S470 of , and all the examples and variations described above with respect to these steps are also applicable to the data processing device 10'. More specifically, for the data processing device 10', by fitting an n-order polynomial to Fig.11 After determining the first frequency component based on the change indicator generated in step S10', the data processing device 10' may generate correction data by performing at least two iterations of a process comprising the following steps:
[0131] (i) calculating a plurality of residual values, each residual value being calculated as a difference between an indicator of the determined change in the indicator of the axis shift and a corresponding value of an nth order polynomial fitted to the change in the indicator;
[0132] (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold;
[0133] (iii) in a case where it is determined that the plurality of residual values include the abnormal value, removing the indicator corresponding to the abnormal value from the change of the indicator to generate an updated change of the indicator, and in a case where it is determined that the residual value does not include the abnormal value, determining the n-th order polynomial as correction data and ending the process; and
[0134] (iv) Fitting an nth-order polynomial to the updated changes of the indicator.
[0135] In a first iteration of the process, each of the plurality of residual values is calculated as a difference between the indicator in the corrected variation of the indicator and a corresponding value of an n-order polynomial fitted to the corrected variation of the indicator. Additionally, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in the updated variation of the indicator generated in a previous iteration of the process and a corresponding value of an n-order polynomial fitted to the updated variation of the indicator generated in the previous iteration of the process.
[0136] In addition, Fig.11 In the case where the reliability indicator at S40B' has been set to indicate that the correction data is reliable, the correction data generator module 2' can determine the number of residual values in the plurality of residual values that have a magnitude greater than a second positive threshold or less than a second negative threshold, wherein the second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold. In the case where the determined number of residual values is less than the third threshold, the displacement compensation module 6' can compensate for the axial displacement between the B scans in the B scan sequence by applying an offset based on the correction data to the B scans in the B scan sequence. However, in the case where the determined number of residual values is not less than the third threshold, the displacement compensation module 6' may not compensate for the axial displacement between the B scans in the B scan sequence.
[0137] The example aspects described herein avoid limitations associated with conventional OCT data processing (particularly limitations rooted in computer technology), which can produce rendered volumetric OCT data that display motion artifacts, which are typically caused by involuntary movement of the subject during the acquisition of the volumetric OCT data. For example, these motion artifacts may adversely affect the accuracy of ocular feature identification and any subsequent diagnostic measurements. With the help of the example aspects described herein, correction data is generated to compensate for axial displacement between B-scans in a B-scan sequence that forms a C-scan, which axial displacement may be caused by relative motion of the OCT imaging system and the imaging target. In particular, for each adjacent B-scan pair in the B-scan sequence, a corresponding indicator of the axial displacement between corresponding representations of common ocular features in adjacent B-scans is determined. In addition, a reliability indicator indicating the reliability of the correction data is also generated. The reliability indicator is based on a measure of velocity or acceleration indicating relative motion. In at least some embodiments, if the reliability indicator indicates that the correction data is reliable, the correction data is only used to compensate for the axial displacement of the B-scan. Thus, processing of B-scans for compensating for axial displacement between B-scans can be improved because only reliable correction data can be used to compensate for axial displacement. In at least some embodiments, rather than generating correction data by determining a corresponding indicator of axial displacement between corresponding representations of common ocular features in adjacent B-scans for each of a plurality of adjacent B-scan pairs in a sequence, correction data is generated by determining a corresponding indicator of axial displacement between corresponding representations of common ocular features in B-scan and tracking scan data for each of at least some of the B-scans in the sequence. In addition, in at least some example embodiments, a residual of a polynomial fitted to the variation of the determined indicator is used to estimate the quality of the correction data and, therefore, to determine whether the correction data should be used to perform compensation. Moreover, with the aforementioned capabilities of the example aspects described herein rooted in computer technology, the example aspects described herein improve computers and computer processing / functions, and also improve at least the fields of image processing, optical coherence tomography (OCT) and data processing, and processing of OCT image data.
[0138] In the foregoing description, example aspects have been described with reference to several example embodiments. Therefore, the description should be regarded as illustrative rather than restrictive. Similarly, the drawings shown in the accompanying drawings highlighting the features and advantages of the example embodiments are presented for illustrative purposes only. The architecture of the example embodiments is sufficiently flexible and configurable that it can be utilized in ways other than those shown in the accompanying drawings.
[0139] In an example embodiment, the software embodiments of the examples presented herein may be provided as computer programs or software, such as one or more programs having instructions or instruction sequences included or stored in an article (e.g., a machine-accessible or machine-readable medium, an instruction storage device, or a computer-readable storage device, each of which may be non-transitory). Programs or instructions on non-transitory machine-accessible media, machine-readable media, instruction storage devices, or computer-readable storage devices may be used to program a computer system or other electronic device. Machine or computer-readable media, instruction storage devices, and storage devices may include, but are not limited to, floppy disks, optical disks, and magneto-optical disks or other types of media / machine-readable media / instruction storage devices / storage devices suitable for storing or transmitting electronic instructions. The techniques described herein are not limited to any particular software configuration. They may be applied in any computing or processing environment. The terms "computer-readable", "machine-accessible medium", "machine-readable medium", "instruction storage device", and "computer-readable storage device" used herein shall include any medium capable of storing, encoding, or transmitting instructions or instruction sequences to be executed by a machine, a computer, or a computer processor and causing the machine / computer / computer processor to perform any of the methods described herein. Furthermore, it is common in the art to refer to software in one form or another (e.g., program, procedure, process, application, module, unit, logic, etc.) as taking an action or causing a result. Such expressions are merely a shorthand way of stating that execution of the software by a processing system causes the processor to perform an action to produce a result.
[0140] Some embodiments may also be implemented by the preparation of application specific integrated circuits, field programmable gate arrays, or by interconnecting an appropriate network of conventional component circuits.
[0141] Some embodiments include computer program products. A computer program product may be one or more storage media, instruction storage devices, or storage devices on or in which instructions that can be used to control or cause a computer or computer processor to perform any process of the example embodiments described herein are stored. Storage media / instruction storage devices / storage devices may include, by way of example and without limitation, optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory, flash memory cards, magnetic cards, optical cards, nanosystems, molecular memory integrated circuits, RAIDs, remote data storage / archiving / warehousing devices, and / or any other type of device suitable for storing instructions and / or data.
[0142] Some implementations stored on any of one or more computer-readable media, instruction storage devices (multiple instruction storage devices), or storage devices (multiple storage devices) include hardware for controlling the system and software for enabling the system or microprocessor to interact with a human user or other mechanism using the results of the example embodiments described herein. Such software may include, without limitation, device drivers, operating systems, and user applications. Ultimately, as described above, such computer-readable media or storage devices also include software for performing example aspects of the present invention.
[0143] Software modules for implementing the processes described herein are included in the programming and / or software of the system. In some example embodiments herein, the modules include software, but in other example embodiments herein, the modules include hardware or a combination of hardware and software.
[0144] Although a number of example embodiments of the present invention have been described above, it should be understood that they are presented as examples rather than limitations. It will be apparent to those skilled in the relevant art that various changes may be made in form and detail. Therefore, the present invention should not be limited to any of the above example embodiments, but should only be defined in accordance with the appended claims and their equivalents.
[0145] Furthermore, the purpose of the Abstract is to enable patent offices and the public in general, and especially scientists, engineers, and practitioners in the art who are not familiar with patent or legal terminology or wording, to quickly ascertain the nature and essence of the technical disclosure of the present application based on a cursory inspection. The Abstract is not intended to be limiting in any way with respect to the scope of the example embodiments presented herein. It should also be understood that the processes recited in the claims need not be performed in any order presented.
[0146] Although this specification contains many specific embodiment details, these should not be understood as limitations on the scope of any invention or content that may be claimed, but should be understood as descriptions of features specific to the specific embodiments described herein. Certain features described in this specification in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented in multiple embodiments individually or in any suitable sub-combination. In addition, although features may be described above as acting in a specific combination and even initially claimed as such, one or more features from the claimed combination may be deleted from the combination in some cases, and the claimed combination may be directed to a sub-combination or a variant of the sub-combination.
[0147] In some cases, multitasking and parallel processing may be advantageous. In addition, the separation of the various components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
[0148] Now that some illustrative embodiments and embodiments have been described, it is apparent that the foregoing embodiments are illustrative rather than restrictive and have been given by way of example. Specifically, although many of the examples presented herein relate to specific combinations of devices or software elements, these elements may be combined in other ways to achieve the same purpose. Actions, elements, and features discussed only in conjunction with one embodiment are not intended to be excluded from similar roles in the embodiments or other embodiments.
[0149] The devices described herein may be implemented in other specific forms without departing from their characteristics. The foregoing embodiments are illustrative rather than limiting of the described systems and methods. Therefore, the scope of the devices described herein is indicated by the appended claims rather than the foregoing description, and therefore changes that fall within the meaning and range of equivalents of the claims are included therein.
Claims
1. A method for processing C-scan data to generate correction data and also generating a reliability indicator (5) indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans (210, 220) of an imaging target (20) that has been acquired by an optical coherence tomography (OCT) imaging system (30), the correction data being used to compensate for an axial displacement (d) between the B-scans (210, 220) in the sequence of B-scans (210, 220) caused by relative motion between the OCT imaging system (30) and the imaging target (20), the relative motion causing a change in the distance between the OCT imaging system and the imaging target during acquisition of the B-scans (210, 220) by the OCT imaging system (30), the method comprising: generating (S10) the correction data by determining, for each of a plurality of pairs of adjacent B-scans (210, 220) in the sequence, a respective indicator of an axis shift between respective representations of a common eye feature (230) in the adjacent B-scans (210, 220); and The reliability indicator (5) is generated in the following manner: calculating (S20) a corresponding value of a metric using a pair of B-scans (210, 220) in the sequence of B-scans (210, 220), the corresponding value of the metric indicating a corresponding velocity or a corresponding acceleration of the imaging target (20) relative to the OCT imaging system (30) when the pair of B-scans (210, 220) was acquired; determining (S30) whether at least a predetermined number of the calculated values of the metric exceed a threshold; In case it is determined that at least the predetermined number of the calculated values of the metric exceeds the threshold, setting (S40A) the reliability indicator (5) to indicate that the correction data is unreliable; and In case it is determined that none of at least the predetermined number of the calculated values of the metric exceeds the threshold, the reliability indicator (5) is set (S40B) to indicate that the correction data is reliable.
2. The method according to claim 1, wherein: The correction data is generated by determining (S210) a first frequency component of the change as the position of a corresponding pair of adjacent B-scans (210, 220) in the sequence changes based on the determined indicator, the first frequency component indicating relative motion of the OCT imaging system (30) and the imaging target (20) during acquisition of the B-scans (210, 220) by the OCT imaging system (30).
3. The method according to claim 2, wherein: The imaging target (20) has a curvature, and the method further comprises: A second frequency component of the variation is determined, the second frequency component being indicative of a curvature of the imaging target (20).
4. The method according to claim 3, wherein The second frequency component is determined by fitting (S310) an m-order polynomial to the determined change of the indicator, and The first frequency component is determined by subtracting (S320) the value of the m-order polynomial from the indicator in the determined indicator change to generate a corrected change of the indicator, and fitting (S330) an n-order polynomial to the corrected change of the indicator, where m and n are integers and m is less than n.
5. The method according to any one of claims 1 to 4, wherein: A respective indicator of the axis shift is determined for each of the adjacent B-scans (210, 220) by: calculating a cross-correlation between the pair of adjacent B-scans (210, 220) and determining an offset between the B-scans (210, 220) corresponding to a peak in the calculated cross-correlation as an indicator of the axis shift, or Respective positions of the common ocular feature (230) in the B-scans (210, 220) of the pair of adjacent B-scans (210, 220) are identified, and a displacement between the identified positions along an axis of the B-scans (210, 220) is determined, wherein the axis of the B-scans (210, 220) represents an axial direction of the OCT imaging system (30).
6. The method according to any one of claims 1 to 4 further includes, when a reliability indicator (5) has been set to indicate that the correction data is reliable, using (S50B) the correction data to compensate for an axial displacement (d) between B scans (210, 220) in the B scan (210, 220) sequence caused by relative movement between the OCT imaging system (30) and the imaging target (20).
7. The method according to claim 4, wherein: The first frequency component is determined by performing at least two iterations of a process further comprising the steps of: (i) calculating (S440) a plurality of residual values, each residual value being calculated as a difference between the indicator of the change of the indicator and a corresponding value of the n-th order polynomial; (ii) determining ( S450 ) whether the plurality of residual values include an abnormal value that is higher than a first positive threshold or lower than a first negative threshold; (iii) in the case where it is determined that the plurality of residual values include the abnormal value, removing (S460) the indicator corresponding to the abnormal value from the change of the indicator to generate an updated change of the indicator, and in the case where it is determined that the residual value does not include the abnormal value, determining (S450A) the n-th order polynomial as the first frequency component and ending the process; and (iv) fitting (S470) said nth-order polynomial to said updated change of the indicator, wherein, in a first iteration of the process, each residual value of the plurality of residual values is calculated as a difference between the indicator in the corrected change of the indicator and a corresponding value of the nth order polynomial fitted to the corrected change of the indicator, and wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in the updated change of the indicator generated in a previous iteration of the process and a corresponding value of the nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
8. The method according to claim 7 further comprises, in case a reliability indicator (5) has been set to indicate that the correction data is reliable: Determining (S510) the number of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold among the plurality of residual values, wherein The second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold; compensating (S530A) for an axial displacement (d) between B-scans (210, 220) in the sequence of B-scans (210, 220) by applying an offset based on the first frequency component to the B-scans in the sequence of B-scans (210, 220), if the determined number of residual values is less than a third threshold; and In the event that the determined number of residual values is not less than a third threshold, it is determined not to compensate (S530B) for the axial displacement between the B-scans (210, 220) in the B-scan (210, 220) sequence.
9. A method for processing C-scan data and tracking scan data to generate correction data and also generating a reliability indicator (5') indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans (210, 220) of an imaging target (20) having been acquired by scanning an optical coherence tomography (OCT) imaging system (30) along corresponding scan lines (1210) extending across the imaging target (20), and the tracking scan data being acquired by the OCT imaging system (30) along corresponding scan lines (1210) extending across the imaging target (20). The correction data is obtained by performing scanning by scanning a tracking scan line (1220) intersected by an OCT imaging system (30) and an imaging target (20), the correction data being used to compensate for an axial displacement (d) between B scans (210, 220) in the B scan (210, 220) sequence caused by relative motion between the OCT imaging system (30) and the imaging target (20), the relative motion causing a distance between the OCT imaging system and the imaging target to change during acquisition of the B scans (210, 220) by the OCT imaging system (30), the method comprising: generating (S10') the correction data by determining, for each B-scan (210, 220) of at least some of the B-scans (210, 220) in the sequence, a respective indicator of an axis shift between the B-scan (210, 220) and a respective representation of a common eye feature (230) in the tracking scan data; and The reliability indicator (5') is generated in the following manner: using the indicators determined for a pair of B-scans (210, 220) of the at least some of the B-scans, calculating a respective value of a metric indicative of a respective velocity or a respective acceleration of the imaging target (20) relative to the OCT imaging system (30) when the pair of B-scans (210, 220) was acquired; determining ( S30 ′) whether at least a predetermined number of the calculated values of the metric exceed a threshold; In case it is determined that at least the predetermined number of the calculated values of the metric exceeds the threshold, setting (S40A') the reliability indicator (5') to indicate that the correction data is unreliable; and In case it is determined that none of at least the predetermined number of the calculated values of the metric exceeds the threshold, the reliability indicator (5') is set (S40B') to indicate that the correction data is reliable.
10. The method according to claim 9 further includes, when the reliability indicator (5') has been set to indicate that the correction data is reliable, using (S50B') the correction data to compensate for the axial displacement (d) between the B scans (210, 220) in the B scan (210, 220) sequence caused by the relative movement of the OCT imaging system (30) and the imaging target (20).
11. The method according to claim 9 or claim 10, wherein: The correction data is generated by performing at least two iterations of a process comprising the following steps: (i) calculating a plurality of residual values, each residual value being calculated as a difference between the indicator of the change of the indicator and a corresponding value of the nth-order polynomial; (ii) determining whether the plurality of residual values include an outlier above a first positive threshold or below a first negative threshold; (iii) in the case where it is determined that the plurality of residual values include the abnormal value, removing the indicator corresponding to the abnormal value from the change of the indicator to generate an updated change of the indicator, and in the case where it is determined that the residual value does not include the abnormal value, determining the n-th order polynomial as the correction data and ending the process; and (iv) fitting the nth-order polynomial to the updated change of the indicator; wherein, in a first iteration of the process, each residual value of the plurality of residual values is calculated as a difference between the indicator in a corrected change of the indicator and a corresponding value of the nth-order polynomial fitted to the corrected change of the indicator, wherein the corrected change of the indicator is generated by subtracting a value of the mth-order polynomial fitted to the change of the indicator from the indicator in the change of the indicator, wherein m and n are integers and m is less than n, and wherein, in each of the remaining one or more iterations of the process, each of the plurality of residual values is calculated as a difference between the indicator in the updated change of the indicator generated in a previous iteration of the process and a corresponding value of the nth-order polynomial fitted to the updated change of the indicator generated in the previous iteration of the process.
12. The method according to claim 11 further comprises, in case a reliability indicator (5') has been set to indicate that the correction data is reliable: determining a number of residual values in the plurality of residual values having a magnitude greater than a second positive threshold or less than a second negative threshold, wherein The second positive threshold is less than the first positive threshold, and the second negative threshold is greater than the first negative threshold; compensating for axial displacement between B-scans in the sequence of B-scans (210, 220) by applying an offset based on the correction data to a B-scan in the sequence of B-scans (210, 220); and In case the determined number of residual values is not less than a third threshold, it is determined not to compensate for the axial displacement (d) between the B-scans (210, 220) in the B-scan (210, 220) sequence.
13. A non-transitory computer readable storage medium (350) storing a computer program (390) comprising computer program instructions which, when executed by a processor (320), cause the processor (320) to perform the method according to any one of claims 1 to 12.
14. A data processing apparatus (10) arranged to process C-scan data to generate correction data and also to generate a reliability indicator (5) indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans (210, 220) of an imaging target (20) which have been acquired by an optical coherence tomography (OCT) imaging system (30), the correction data being used to compensate for an axial displacement (d) between the B-scans (210, 220) in the sequence of B-scans (210, 220) caused by a relative motion between the OCT imaging system (30) and the imaging target (20), the relative motion causing a change in the distance between the OCT imaging system and the imaging target during acquisition of the B-scans (210, 220) by the OCT imaging system (30), the apparatus (10) comprising: a correction data generator module (2) arranged to determine the correction data by determining, for each of a plurality of pairs of adjacent B-scans (210, 220) in the sequence, a respective indicator of an axis shift between respective representations of a common eye feature (230) in the adjacent B-scans (210, 220); and A reliability indicator generator module (4) arranged to generate said reliability indicator (5) by: A corresponding value of a metric is calculated using a pair of B-scans (210, 220) in the sequence of B-scans (210, 220), the corresponding value of the metric indicating when the B-scans (210, 220) were acquired. 220) synchronizing a corresponding speed or corresponding acceleration of the imaging target (20) relative to the OCT imaging system (30); determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; In case it is determined that at least the predetermined number of the calculated values of the metric exceeds the threshold, setting the reliability indicator (5) to indicate that the correction data is unreliable; and In case it is determined that none of the calculated values of the metric at least the predetermined number of calculated values exceeds the threshold value, the reliability indicator (5) is set to indicate that the correction data is reliable.
15. A data processing apparatus (10') arranged to process C-scan data and tracking scan data to generate correction data and also to generate a reliability indicator (5') indicating the reliability of the generated correction data, the C-scan data comprising a sequence of B-scans (210, 220) of an imaging target (20) acquired by scanning an optical coherence tomography (OCT) imaging system (30) along corresponding scan lines (1210) extending across the imaging target (20), the tracking scan data being acquired by the OCT imaging system (30) along corresponding scan lines (1210) extending across the imaging target (20) The correction data is obtained by performing scanning on a tracking scan line (1220) crossed by the scan line (1210), the correction data is used to compensate for the axial displacement (d) between the B scans (210, 220) in the B scan (210, 220) sequence caused by the relative movement of the OCT imaging system (30) and the imaging target (20), the relative movement causing the distance between the OCT imaging system and the imaging target to change during the acquisition of the B scan (210, 220) by the OCT imaging system (30), the device (10') comprising: a correction data generator module (2') arranged to generate the correction data by determining, for each B-scan (210, 220) of at least some of the B-scans (210, 220) in the sequence, a respective indicator of an axis shift between the B-scan and a respective representation of a common eye feature in the tracking scan data; and A reliability indicator generator module (4') arranged to generate said reliability indicator (5') by: calculating, using the indicators determined for a pair of B-scans (210, 220) of the at least some of the B-scans, a respective value of a metric indicative of a respective velocity or a respective acceleration of the imaging target (20) relative to the OCT imaging system (30) when the pair of B-scans (210, 220) was acquired; determining whether at least a predetermined number of the calculated values of the metric exceed a threshold; In case it is determined that at least the predetermined number of the calculated values of the metric exceeds the threshold value, setting the reliability indicator (5') to indicate that the correction data is unreliable; and In case it is determined that none of at least the predetermined number of calculated values of the metric exceeds the threshold value, the reliability indicator (5') is set to indicate that the correction data is reliable.
