Image analysis method, computer program product, and image analysis device

Abstract

An image analysis method for quantitative assessment of uterine movement consistency includes the steps of obtaining a uterine recording, tracking at least two uterine movement propagation waves in at least two different uterine regions and / or at least two times within the recording, and determining the consistency of uterine movement based on similarity criteria of at least two characteristics of the at least two propagation waves.

Description

[Technical Field]

[0001] The present invention relates to an image analysis method and system for quantitatively assessing the degree of coordination of uterine motility, and further to a computer program product for such quantitative assessment. [Background technology]

[0002] Globally, approximately one in six couples experience infertility problems during their reproductive years (ages 22 to 44). One of the treatments available to these infertile couples is assisted reproductive technology, such as in vitro fertilization (IVF). In 2008, IVF was used as a last resort for more than 2.5 million couples in Europe. Meanwhile, over the last decade, the number of IVF cycles performed each year has increased by more than 20%. However, the success rate of IVF treatment remains below 30%, representing only a 4% increase.

[0003] In an IVF cycle, hormone levels are tested, and then multiple eggs are retrieved and fertilized in a test tube. The resulting embryos are then transferred back into the uterus. If the embryo successfully implants in the uterine wall, pregnancy results.

[0004] One of the factors that hinder successful embryo implantation is dysfunction of uterine contractions. As shown in Figure 1, the uterine body consists of three parts: an outer serous layer, an inner membrane called the endometrium, and a middle muscular layer called the myometrium. Uterine contractions (UC), caused by contractions of the myometrium, were first described by Dickinson in 1937, based on bimanual examination of an infertile uterus. Most commonly, UC occurs around the endometrium and acts as a wave propagation along the endometrium. The resulting uterine deformation (movement) is also known as uterine peristalsis (UP). The patterns of UC and UP vary in direction, frequency, speed, and intensity during different phases of the menstrual cycle due to the influence of hormone levels. Particularly during ovulation, when a mature egg is released from the ovary, countercurrent waves of contractions often occur, trapping the egg in the endometrial cavity and awaiting fertilization. However, women who suffer from infertility often suffer from uterine disorders such as endometriosis and adenomyosis, as well as endocrine disorders. These disorders can affect the UP and may prevent embryo implantation.

[0005] Therefore, reliable assessment of uterine activity that contributes to infertility is expected to provide valuable insight into the impact of UP on IVF failure.

[0006] Currently, most assessments and characterizations of UC and UP are based on qualitative measurements using visual inspection of transvaginal ultrasound (TVUS). However, visual characterization of uterine activity is difficult and subjective, especially during the late luteal phase of the menstrual cycle and immediately prior to IVF embryo transfer, when the uterus is often quieter than at other times. Summary of the Invention [Problem to be solved by the invention]

[0007] In a visual inspection of 80 TVUS recordings, only three medical professionals agreed on the direction and timing of UP. In other words, the lack of an objective, quantitative analysis of uterine contractions makes characterizing UC and improving IVF cycles difficult. The present invention addresses at least some of these shortcomings. [Means for solving the problem]

[0008] One of the aims of the present invention is to provide a quantitative assessment of the coherence of uterine motility.

[0009] A first aspect of the present invention provides an image analysis method for quantitatively assessing the degree of coordination of uterine motility, the method comprising: obtaining a uterine recording; - tracking at least two propagating waves of uterine movement in at least two different uterine regions and / or at at least two times within said recordings; - determining a consistency of said uterine movements based on a similarity criterion of at least two characteristics of said at least two propagating waves; Includes.

[0010] The dependent claims define various embodiments.

[0011] It should be noted that the at least two propagating waves may be in two different uterine regions at the same time, may be in the same uterus at two different times, or may be in two different uterine regions at two different times, which is expressed herein as "at least two propagating waves of uterine movement in at least two different uterine regions and / or at least two times."

[0012] In one embodiment, the at least two properties include a direction, a main direction, a velocity, an amplitude or a phase of the at least two propagating waves.

[0013] In one embodiment, the method includes determining a measure of temporal or spatial variance of at least two properties.

[0014] In one embodiment, the tracking step includes using semi-automatic computer assistance to select tracking markers within the recording such that successive tracking markers are substantially equidistant.

[0015] In a further embodiment, the tracking markers are selected to match the anatomical features of the uterus, preferably along the anterior and posterior sides of the endometrium.

[0016] In one embodiment, the method comprises: -Select a set of tracking markers from among the tracking markers in the recording, determining a fitting curve based on the set of selected tracking markers; - determining the displacement and rotation of the fitting curve, - Compensate tracking marker coordinates based on displacement and rotation The method includes the step of compensating for movement of the tracking marker in successive frames within the recording by adjusting the time domain.

[0017] In one embodiment, the at least two propagating waves are tracked using any of the following motion estimation techniques: block matching, optical flow, or optical flow including iterative space warping.

[0018] In a further embodiment, the iterative space warping comprises combining an optical flow from the current frame to the first frame and an optical flow from the current frame to the second frame; The first frame is a frame after the current frame, The second frame is a frame that comes after the first frame.

[0019] In one embodiment, the similarity measure is determined using one of the following: cross-correlation, coherence, mean squared error, mutual information, or Hausdorff distance.

[0020] In one embodiment, the method comprises: - representing at least two propagating waves in the frequency domain, preferably using a Fast Fourier Transform; - determining a first sum of energy spectra from first quadrants of at least two propagating waves expressed in the frequency domain as the propagating energy from the neck to the base; - determining a second sum of energy spectra from second quadrants of at least two propagating waves expressed in the frequency domain as the propagating energy from the base to the neck; - determining a ratio of the neck-to-bottom propagating energy to the bottom-to-neck propagating energy based on the first sum and the second sum to determine a main direction of at least two propagating waves; Further includes:

[0021] In one embodiment, the method comprises: - determining whether the at least two propagating waves are substantially symmetrical with respect to at least two characteristics, with respect to at least one axis of symmetry related to an anatomical feature of the uterus, preferably with respect to at least one axis of symmetry related to the endometrium of the uterus; - outputting the determined substantially symmetric or not result as a criterion for successful fertilization of the uterus; Includes.

[0022] In some embodiments, the method includes filtering out uterine movement originating from sources other than the uterus; Non-uterine sources include organs other than the uterus, such as the bowel and / or bladder, as well as acquisition motions, including heartbeat, breathing, and probe movement during acquisition.

[0023] In some embodiments, the recording step uses either two-dimensional (2D) ultrasound, three-dimensional (3D) ultrasound, magnetic resonance, or X-ray imaging. In some embodiments, the recording time of the recording step is 20 seconds or more, preferably 2 minutes or more, and more preferably 4 minutes or more. Advantageously, 20 seconds would be sufficient to obtain a manageable portion of at least one alignment of the uterus. 2 minutes would be sufficient to more reliably obtain at least one alignment. 4 minutes would be sufficient to more reliably obtain multiple alignments for greater precision.

[0024] A second aspect of the present invention provides a computer program product comprising a computer readable medium having stored thereon instructions which, when executed on a processor, are configured to cause the processor to perform any of the methods described above.

[0025] Those skilled in the art will appreciate that the considerations applied to the above methods are equally applicable to computer program products and vice versa.

[0026] A third aspect of the present invention provides an image analysis system for quantitative assessment of uterine motility coordination, the system comprising a processor and a memory configured to store instructions that, when executed on the processor, cause the processor to perform any of the methods described above.

[0027] Those skilled in the art will appreciate that the considerations applied to the method above are equally applicable to the system, and vice versa. In particular, the instructions stored in the memory of the system embodiment may include additional instructions similar to those of the method embodiment above.

[0028] Those skilled in the art will further appreciate that the system may be implemented using general computer hardware, specialized hardware, or a combination of both, and that software may be used in addition to hardware-implemented components to implement any suitable functionality or logical components of the system. [Brief explanation of the drawings]

[0029] These and other aspects and considerations of the present invention will be more fully understood from the following description and accompanying drawings. [Figure 1] 1 is a schematic diagram of an exemplary embodiment of the present invention: US frames acquired from an in vivo recording during the LF phase, showing some anatomical features of the uterus. [Figure 2] 1 is a schematic diagram of an exemplary embodiment of the present invention showing tracking markers (TMs) placed within 2D ultrasound. [Figure 3A-B] 3A is a schematic diagram of an exemplary embodiment of the present invention, showing motion compensation; [Figure 4A-D] 4A and 4B are schematic diagrams of an exemplary embodiment of the present invention: Figure 4A shows a spatiotemporal representation of the UP generated by the RSR extracted from the anterior endometrium of a healthy volunteer; [Figure 5A-B] 5A-5C are schematic diagrams of an exemplary embodiment of the present invention.The bar plot in Figure 5A shows the statistics of match measurements in 16 IVF patients before embryo transfer. [Figure 6A-B] 6A and 6B are schematic diagrams of an exemplary embodiment of the present invention, showing a bull's-eye display and a 3D representation of UP wave parameters, respectively. [Figure 7A-B] 7A and 7B are schematic diagrams of exemplary embodiments of the present invention, respectively, a method embodiment and an apparatus embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0030] One object of the present invention is to provide an image analysis method for quantitative analysis of the consistency of uterine movement. Another object of the present invention is to provide related apparatus and systems for efficiently performing image analysis. Further embodiments include apparatus and systems that integrate an image analysis hardware device or system into the image analysis method. Further embodiments include computer hardware and software techniques capable of implementing the image analysis method. To this end, motion tracking techniques may be applied to extract uterine movement and deformation from 2D or 3D video recordings. Various imaging techniques, ranging from ultrasound to magnetic resonance and X-ray imaging, may be applied. Uterine movement and deformation may be recorded spatially and temporally during one or more uterine peristaltic movements (also called contractions). In particular, movement and deformation (radial, circumferential, or meridian) may be recorded anatomically (i.e., with respect to anatomical features of the uterus). Figure 2 is a schematic diagram of tracking markers (TMs) placed on a 2D ultrasound, according to an exemplary embodiment of the present invention. The markers may be placed along the anterior and posterior endometrium to analyze the consistency of deformation along the meridian. The transvaginal recording was taken from a healthy volunteer in the late follicular phase. As an example, the radial deformation may be assessed along the uterine meridian around the endometrial line, as shown in Figure 2. Some embodiments of the invention may relate to a method for assessing this alignment or peristaltic wave based on the uterine anatomical spatiotemporal evolution of peristaltic movement.

[0031] One approach is to evaluate the similarity of the temporal evolution of the main direction of propagation between different regions of the uterus. An example is the similarity between the anterior and posterior walls. Similarly, the velocity of different directions may be evaluated to evaluate the similarity between different regions. Multiple similarity measures (e.g., correlation, coherence, mean square error, and mutual information) may be used. To evaluate the similarity, the spatial evolution of the amplitude and phase of peristaltic waves in different regions of the uterus may be considered in addition to the propagation direction. A comprehensive consistency index may be extracted by evaluating the variance (e.g., standard deviation) of the direction, amplitude, and phase of peristaltic waves throughout the uterus. Coordinated contractions are anatomically symmetric (i.e., radially symmetric with respect to the endometrial line), leading to efficient peristaltic movement and stronger macrostreams within the endometrium. This phenomenon may have a significant impact on uterine function, the feasibility of desired embryo implantation, and endometrial evacuation during menstruation. Evaluating temporally estimated indices allows for the assessment of certain movement conditions and the stability of uterine behavior.

[0032] In one embodiment, the present invention relates to a method for assessing uterine integrity by analyzing the spatiotemporal deformations of the uterus in the meridian, radial, and circumferential directions. Such deformations are represented by harmonic waves propagating along the uterus. The integrity can be defined as the similarity of the properties of these waves in different regions of the uterus. The properties considered may include the time evolution of the propagation direction, phase, and intensity of these waves in any time interval spanning at least one cycle (period) or more. The similarity measures employed may include correlation, spectral coherence, mutual information, and squared error. A integrity index may be extracted by evaluating the spread of the wave properties measured in all regions of the uterus at a predetermined instant. The temporal evolution of these indices may also be evaluated as a measure of uterine stability or the stability of uterine regions under certain motion conditions.

[0033] Various embodiments of the present invention are directed to dedicated ultrasound speckle tracking for quantitative analysis of uterine motility. In these embodiments, quantitative assessment of uterine activity can be obtained by focusing on the propagation pattern of UP along the uterus during natural menstrual cycles and during IVF cycles.

[0034] In particular, the present invention considers the spatiotemporal alignment of UP next to the evaluation of the speed and direction of the propagating waves (e.g., Huang et al. Quantitative ultrasound imaging and characterization of uterine peristaltic waves, IEEE IUS, Kobe (Japan), October 22-25, 2018), which can provide a powerful descriptor of the uterine ability to aid or hinder embryo implantation.

[0035] To quantify UC, it is desirable to first assess uterine motion using ultrasound (US) recordings. In the field of US-based speckle tracking, two main motion estimation methods are known: block matching (BM) and optical flow (OF). BM segments images into blocks and finds the best match among these blocks in consecutive frames based on selected matching criteria. On the other hand, OF is a pixel-to-pixel gradient approach that estimates the velocity of a target object between two consecutive frames. Our preferred embodiment employs OF rather than BM because OF is more sensitive to subpixel motion. Furthermore, the tracking accuracy of OF can be further improved by implementing iterative spatial warping. After optimization, the employed OF method may then be validated in vitro using a dedicated setup on a human ex vivo uterus.

[0036] [Uterine motility tracking] One embodiment of the present invention may be based on 2-4 minute 2D ultrasound (US) imaging of the uterus. US speckle occurs due to interference of backscattered ultrasound energy received by the transducer. Typically, tissue forms a unique speckle pattern. This speckle pattern may be tracked in time. In other words, tissue motion can be reconstructed by tracking the motion of the speckle pattern. Block matching (BM) and optical flow (OF) are two speckle tracking algorithms commonly used for tissue motion tracking.

[0037] The tracking results using BM are limited to integer pixels. Therefore, the accuracy is limited by the pixel size of the US image. In contrast, OF does not have such a limitation. The maximum speed of the observed peristaltic waves was less than 2 mm per second (acquisition frame rate and pixel size were 30 Hz and 0.065 mm, respectively), so the uterine movement was less than 1 pixel per frame. Therefore, OF is considered more suitable for obtaining accurate tracking results.

[0038] The principle of OF is based on the assumption that "even if a pixel at a spatiotemporal position (x, y, t) is displaced by (Δx, Δy) during time Δt, its intensity I does not change." That is, I(x, y, t)=I(x+Δx, y+Δy, t+Δt) (1)

[0039] The Taylor expansion of the right-hand side of equation (1) is given. Assuming that the time and space changes between frames are small enough, the higher-order terms in this expansion can be ignored. The velocity v of a pixel moving in the x and y directions can be expressed in terms of the gradient of the intensity as follows:

number

[0040] To solve the above ill-conditioned equation, Lukas and Kanade proposed to estimate the motion of blocks rather than pixels, assuming that the flow within the blocks is steady (Lukas et al., Iterative Image Registration Technique with an Application To Stereo Vision. Technical report, 1981). Then, the velocities in both directions are obtained by least-squares estimation. The pixel position in the target frame is then updated based on the estimated velocities.

[0041] Under the assumption that the motion is small, the accuracy of OF can be further improved by applying an iterative refinement approach. In a preferred embodiment, OF may first be applied to track the motion of a selected speckle pattern between a reference frame and a target frame. Based on an initial estimate v_1, the target frame may be warped by 2D interpolation. In this way, the speckle pattern motion may be partially recovered between the reference frame and the target frame. Then, in a second iteration, a new estimate v_2 of the residual motion may be derived between the reference frame and the warped target frame. This process may be applied iteratively until the residual motion vn converges to a very small value or until the number of iterations reaches a predetermined maximum value N. Then, a final estimate v_end of the pixel motion may be calculated as the sum of the initial estimate and all the residual motions, i.e., v_end=

number

[0042] Apart from the application of iterative refinement, the appropriate selection of block size is crucial for OF to obtain accurate tracking results. If the selected block size is too small, tracking will be overly sensitive to local motion and noise. Conversely, if the block size is too large, the assumption that the flow is stationary will not hold. Block size optimization was performed in vitro using the specific experimental setup proposed by Sammali et al. (Sammali et al., Dedicated Ultrasound Speckle Tracking for Quantitative Analysis of Uterine Motion Outside Pregnancy. IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 66(3):581-590, Mar 2019). The optimized block size may be considered 41 x 41 pixels (around 2.6 x 2.6 mm). 2 ).

[0043] [Anatomical alignment mechanism] UPs are often observed near the endometrium at junctions, rather than within the myometrium. Therefore, tracking markers (TMs) may be selected along the anterior and posterior sides of the endometrial cavity in the first frame of each US recording. As shown in Figure 2, a semi-automatic approach may be employed to ensure equidistant radial distances between each pair of TMs along the endometrium. In this embodiment, the distance may be selected to optimize block size to avoid block overlap. However, other choices may be made as long as the grid follows the uterine anatomy.

[0044] 3A-3B are schematic diagrams of an exemplary embodiment of the present invention. Fig. 3A shows motion compensation, where 10 TMs midlineis selected along the middle lining of the endometrium. In Figure 3B, out-of-plane (OOP) motion begins in the nth frame. Speckle tracking fails at two TMs (indicated by white arrows). However, as explained below, the global rotation of the endometrium is recovered by a fitted line between consecutive frames. OOP motion is a phenomenon that frequently occurs during in vivo 2D US recordings. OOP motion is primarily caused by the movement of the imaged target in a third direction perpendicular to the observation plane. OOP motion can also occur due to the effects of probe motion or patient movement. When OOP motion occurs, the tracked speckle pattern moves outside the observation plane. The resulting decorrelation of the speckle pattern will cause speckle tracking to fail. To mitigate the impact of OOP motion on the accuracy of 2D speckle tracking for in vivo data, a two-step approach can be considered. As shown in Figure 3A, in the first step, 10 tracking markers (TMs) with isotropic distances are selected. midline ) may be selected along the middle lining of the endometrium. Throughout the recording, speckle tracking is performed on the TMs. midline may be applied to the global displacement of the endometrium (x t , y t ) is TMs midline The movement of the TMs may then be evaluated by averaging them horizontally and vertically, as shown in Figure 3B. midline The endometrial rotation (θ) was calculated using a linear fit based on the coordinates of t ) may be evaluated. In this way, even if a portion of the endometrium is affected by OOP motion, the global (rigid body) displacement and rotation are independent of the remaining TMs. midlin) (This is compensated for by the fact that OOP motion is not affected.)

[0045] Global endometrial displacement throughout the recording (x t , y t ) and rotation (θ t ), the coordinates of the TMs may be updated at each frame as follows:

number

[0046] [Radial deformation rate analysis] Deformation velocity imaging is a known approach for measuring local or global muscle deformation. To characterize the UP, radial deformability velocity (RSR) may be derived from the anterior and posterior sides of the endometrium. As shown in Figure 2, RSR may be calculated from the rate of change of radial spacing between pairs of TMs.

number

number

[0047] Often, in US recordings, the motion sources affecting endometrial motion are not limited to UC. Other motions, such as those from organs other than the uterus (e.g., the bowel or bladder), heartbeat, breathing, and probe movement during acquisition, are also recorded during the US scan. Therefore, a bandpass filter can be applied to the RSR signal to remove interference from unwanted motion sources. UC is known to vary between 0.5 and 4.1 contractions per minute during a normal menstrual cycle. During IVF treatment, however, UC varies more rapidly, between 0.5 and 5 contractions per minute, due to hormonal ovarian stimulation. Therefore, the cutoff frequency of the bandpass filter can be selected according to these ranges, depending on the intended application. An alternative preprocessing step can involve singular value decomposition (SVD) filtering of the recorded US loops, depending on the frequencies of interest.

[0048] [Uterine alignment] Based on the RSR signals, spatiotemporal representations of UP propagating along the endometrium may be generated. In FIG. 4A, clear cervix-to-fundus (C2F) propagation of UC is observed. In FIG. 4B, fundus-to-cervix (F2C) propagation of UC is observed. FIGS. 4A-4D are schematic diagrams of exemplary embodiments of the present invention. FIG. 4A shows a spatiotemporal representation of UP generated using RSR extracted from the anterior endometrium of a healthy volunteer. The plot shows clear C2F propagation. FIG. 4B shows a spatiotemporal representation of UP generated using RSR extracted from the posterior endometrium of a healthy volunteer. The plot shows F2C propagation. FIG. 4C corresponds to the frequency-domain representation (k-space) of (a). The main spectral peaks (indicated by red dots) appear in the first and third quadrants, indicating C2F propagation. FIG. 4D corresponds to the frequency-domain representation (k-space) of (b). The main spectral peaks (indicated by red dots) appear in the second and fourth quadrants, indicating F2C propagation.

[0049] To assess the velocity of the UP, a two-dimensional fast Fourier transform may be applied to the spatiotemporal representation, resulting in a frequency representation in the k-space domain. Figures 4C and 4D show the k-space representations corresponding to Figures 4A and 4B, respectively. The temporal and spatial frequencies of the primary peristaltic movement may be identified as peaks in the spectrum. The velocity (meridional) of such UP, v UP is expressed as follows: t and spatial frequency f x It may be calculated as the ratio of

number

[0050] However, in practice, more complex UP patterns are sometimes observed. For example, after ovulation, to support embryo implantation, counterpropagation (which shows both C2F and F2C propagation) is often observed. Furthermore, rebound propagation (which involves the reflection and superposition of multiple peristaltic waves) and more complex propagations may also be observed.

[0051] To evaluate UP velocity under more complex conditions, a moving window method may be applied to temporally segment the spatiotemporal representation. Within each segment, the UP velocity in the C2F and F2C directions may be explicitly evaluated from peaks in the first (representing UP propagating to C2F) and second (representing UP propagating to F2C) quadrants of k-space, which represent spatiotemporal frequencies. This provides the evolution of the UP velocity in both directions. Advantageously, this provides a more comprehensive understanding of how the UP propagation pattern evolves over time. In a preferred embodiment, a moving window size of 600 frames (20 seconds) and a step size of 1 frame are chosen.

[0052] Following the evaluation of the magnitude of the velocity, additional relevant information may be given by evaluating the direction of propagation. UP The energy spectrum may be determined by the sign of the radiative energy spectrum (E1, representing C2F propagation) and the radiative energy spectrum (E2, representing F2C propagation). C2F propagation may be represented by a positive sign, and F2C propagation by a negative sign. However, when complex propagation patterns occur, such a binary classification may not be appropriate. Therefore, an energy ratio (ER) criterion may be defined. In this case, the sum of the energy spectra may be extracted from the first quadrant (E1, representing C2F propagation) and the second quadrant (E2, representing F2C propagation). This is given as follows:

number

[0053] The parameter ER (which takes values ​​between -1 and 1) may represent a measure of UP alignment in the time domain. Advantageously, this gives the dominant direction of propagation at a given time. Aligned motion yields an ER approaching 1 (reflecting C2F propagation) or -1 (reflecting F2C propagation). When ER is close to zero, back propagation and standing waves are likely occurring.

[0054] The fact that UP locally (e.g., along the anterior or posterior wall) exhibits a predominant direction does not necessarily guarantee effective peristalsis (one that is coordinated and generates microstreaming within the endometrial cavity). Simply focusing on the anterior and posterior walls, coordinated and effective peristalsis would require UC propagation on both sides of the endometrium, which is simultaneous and directional. Particularly during ovulation, coordinated contraction generation by muscles from both sides of the endometrium is considered important to support embryo implantation. In this way, the anterior (ER) side of the endometrium is also important. ant ) and posterior (ER pos ) can be expected to yield similar ERs. Similarity criteria, namely cross-correlation (CC) and mean square error, may be applied as cost functions to evaluate the spatiotemporal alignment of UPs.

[0055] Figures 5A-5B are schematic diagrams of an exemplary embodiment of the present invention. In Figure 5A, bar plots represent the statistics of matched measurements in 16 IVF patients before embryo transfer. Two groups are separated, corresponding to successful IVF (7 patients at 11 weeks gestation) and unsuccessful IVF (9 patients). The ER similarity between the anterior and posterior uterine walls is shown using cross-correlation and mean square error. The bar plots show the mean (thick blue bars) and standard deviation (thin black bars). An asterisk (*) indicates a significant difference (p<0.05) between the successful and unsuccessful groups. Figures 5A and 5B show the ER similarity for 16 patients undergoing IVF treatment. ant and ER pos It has been shown that the CC and MSE between and can predict embryo implantation and pregnancy success before embryo implantation. Alternative similarity criteria (e.g., based on statistical dependence and mutual information) may be considered. Next to the main direction (which is represented by ER according to equation (6)), the absolute value of the velocity in different directions may be evaluated for similarity in different regions. Advantageously, this provides an alternative matching criterion that is also related to the propagation direction.

[0056] The above supports the principle that the alignment can be interpreted as correlated propagation directions in different regions of the uterus. In an alternative embodiment, the alignment may be derived from the spatial distribution of the phases of the peristaltic waves in a given time interval. Indeed, if non-stationary characteristics are ignored (e.g., if the time interval is limited by a window), the peristaltic wave P(r_, t), which reflects the uterine anatomical deformation in a given direction (e.g., radial deformation), can be expressed as follows:

number

[0057] While the above embodiment uses 2D ultrasound recordings, 3D ultrasound recordings may be advantageously used to obtain more accurate information. ER parameters may then be calculated for all regions of the uterus. As shown in Figures 6A and 6B, the propagation direction representation uses a 3D spatial representation or bull's-eye display to represent the phase, amplitude, frequency, and direction (ER) of the UP in all radial segments of the uterus. Regarding UP wave parameters, Figure 6A shows a bull's-eye display, while Figure 6B shows a 3D display. A global match may then be derived based on the similarity of the phase, direction, and amplitude of the extracted peristaltic waves for each uterine segment. Isolated inconsistent regions (which indicate inconsistent movement patterns) may be identified. Such tools are also useful for diagnosing uterine dysfunctions and pathologies other than IVF, such as endometriosis, adenomyosis, fibroids, and sarcomas.

[0058] 7A and 7B are schematic diagrams of a method embodiment and an apparatus embodiment of the present invention, respectively. Method 700 shown in FIG. 7A includes step 701 of obtaining uterine recordings, step 702 of tracking at least two uterine movement propagating waves within the recordings in at least two different uterine regions and / or at least two different times, and step 703 of determining uterine movement consistency based on similarity criteria of at least two characteristics of the at least two propagating waves. Those skilled in the art will readily understand how to add additional steps to this method. Apparatus 710 shown in FIG. 7B includes a processor 711 and a memory 712. Memory 712 may be configured to store instructions that, when executed on processor 711, cause processor 711 to perform the method embodiments described herein.

[0059] It should be noted that the above embodiments are illustrative rather than limiting of the present invention, and that those skilled in the art will be able to design various alternative embodiments.

[0060] In the claims, references between parentheses do not limit the claim. The use of the verb "to comprise" and its conjugations does not exclude the presence of elements or steps not listed in a claim. The indefinite article "a" or "an" preceding an element does not exclude the presence of a plurality of these elements. Different logical entities in an apparatus may be embodied by a single and identical piece of hardware. Features recited in different independent claims may be combined where appropriate.

Claims

1. A method for operating an image analysis device for quantitatively evaluating the consistency of uterine motility, comprising: the image analysis device includes a processor and a memory; The memory, when executed on the processor, - obtaining a uterine recording; - tracking at least two propagating waves of uterine movement in at least two different uterine regions and / or at at least two times within said recordings; - determining the consistency of said uterine movements based on a similarity criterion of at least two characteristics of said at least two propagating waves; configured to store instructions that cause the processor to execute The method, wherein the degree of conformity relates to at least radial deformation of the endometrium.

2. 2. The method of claim 1, wherein the at least two characteristics include a direction, a main direction, a velocity, an amplitude, or a phase of the at least two propagating waves.

3. - determining a measure of the temporal or spatial dispersion of said at least two properties; 3. The method according to claim 1, further comprising:

4. 4. A method according to any one of claims 1 to 3, wherein the step of tracking comprises using semi-automatic computer assistance to select tracking markers within the recording such that successive tracking markers are substantially equidistant.

5. 5. The method of claim 4, wherein the tracking markers are selected to match anatomical features of the uterus.

6. 6. The method of claim 5, wherein the tracking markers are selected along the anterior and posterior sides of the endometrium.

7. - selecting a set of tracking markers from among the tracking markers in said record, - determining a fitting curve based on the set of selected tracking markers; - determining the displacement and rotation of said fitting curve; - Compensating the coordinates of the tracking marker based on the displacement and rotation 6. A method according to claim 4 or 5, comprising the step of compensating for movement of a tracking marker in successive frames within said recording by:

8. the at least two propagating waves are tracked using optical flow including iterative spatial warping; the iterative spatial warping includes combining an optical flow from a current frame to a first frame and an optical flow from the current frame to a second frame; the first frame is a frame after the current frame; 2. The method of claim 1, wherein the second frame is a frame that follows the first frame.

9. 9. The method according to any one of claims 1 to 8, wherein the similarity measure is determined using one of the following: cross-correlation, coherence, mean squared error, mutual information or Hausdorff distance.

10. - representing said at least two propagating waves in the frequency domain; - determining a first sum of energy spectra from first quadrants of said at least two propagating waves expressed in the frequency domain as the propagating energy from the neck to the base; - determining a second sum of the energy spectra from second quadrants of said at least two propagating waves expressed in the frequency domain as the propagating energy from the floor to the neck; - determining the ratio of the neck-to-bottom propagating energy to the bottom-to-neck propagating energy based on the first sum and the second sum in order to determine a main direction of the at least two propagating waves; 10. The method according to claim 1, comprising:

11. 11. The method of claim 10, wherein the step of representing the at least two propagating waves in the frequency domain uses a Fast Fourier Transform.

12. - determining whether the at least two propagating waves are substantially symmetrical with respect to the at least two characteristics, with respect to at least one axis of symmetry related to an anatomical feature of the uterus and with respect to at least one axis of symmetry related to the endometrium of the uterus; - outputting the determined substantially symmetric or not result as a measure of the success of fertilization of said uterus; 12. The method according to any one of claims 1 to 11, comprising:

13. 13. The method of claim 12, wherein the at least one axis of symmetry related to an anatomical feature of the uterus is at least one axis of symmetry related to the endometrium of the uterus.

14. filtering out uterine movement originating from sources other than the uterus; 14. The method of any of claims 1 to 13, wherein the non-uterine sources include bowel and / or bladder and acquisition movements including heartbeat, breathing and probe movement during acquisition.

15. obtaining a recording of the uterus using any of two-dimensional (2D) ultrasound, three-dimensional (3D) ultrasound, magnetic resonance, or X-ray imaging; 15. The method of any of claims 1 to 14, wherein the recording time of the step of obtaining a recording of the uterus is 20 seconds or more.

16. 16. The method of claim 15, wherein the recording time for the step of obtaining a uterine recording is 2 minutes or more.

17. 16. The method of claim 15, wherein the step of obtaining a uterine recording has a recording time of 4 minutes or more.

18. A computer program product comprising a computer-readable medium having instructions stored thereon, 18. A computer program product, wherein the instructions, when executed on a processor, are configured to cause the processor to perform the method of any of claims 1 to 17.

19. An image analysis device for quantitatively evaluating the consistency of uterine motility, comprising: A processor and a memory, 18. Apparatus, wherein the memory is configured to store instructions that, when executed on the processor, cause the processor to perform a method according to any one of claims 1 to 17.

Images