Inferior vena cava measurement method, device and equipment and storage medium

Abstract

The invention discloses an inferior vena cava measurement method, device and equipment and a storage medium, and relates to the field of inferior vena cava measurement, and the method comprises the steps: carrying out the key point positioning and semantic segmentation of an inferior vena cava ultrasonic image, so as to obtain a key point at the joint of the inferior vena cava and the right atrium, and a mask region corresponding to the inferior vena cava; determining a corresponding inferior vena cava direction by using the mask region, and drawing a target vertical line section perpendicular to the inferior vena cava direction on a measurement position determined based on the key point; and measuring a line segment passing through the mask area on the target vertical line segment to determine the inner diameter of the inferior vena cava. According to the method, the target vertical line section perpendicular to the front wall and the rear wall of the inferior vena cava can be automatically determined in the inferior vena cava ultrasonic image in a key point positioning and semantic segmentation mode, so that automatic measurement of the inner diameter of the inferior vena cava is achieved, and the accuracy of measurement of the inner diameter of the inferior vena cava is improved.

Description

Technical Field

[0001] The present invention relates to the field of inferior vena cava measurement, and in particular to an inferior vena cava measurement method, device, equipment and storage medium. Background Art

[0002] The inferior vena cava (IVC) is the venous pathway for systemic blood to return to the right atrium. At the same time, ultrasound detection has the advantages of being non-invasive, simple, highly repeatable and highly sensitive, so ultrasound is generally used to detect the inferior vena cava. Breathing has a relatively large impact on the measurement of the inner diameter of the inferior vena cava, so the patient's respiratory condition must be stable in actual clinical operations. Since the inner diameter of the inferior vena cava changes continuously with a certain amplitude when the human body inhales and exhales, the inner diameter of the inferior vena cava can reflect the changes in important signs of the human body. In addition, in the clinical work of the ICU (Intensive Care Unit), the measurement of the inferior vena cava is often widely used to evaluate the hemodynamics of patients, which is of great significance and value for critically ill patients. However, the accuracy of the measurement of the inner diameter of the inferior vena cava needs to be further improved. Summary of the invention

[0003] In view of this, the purpose of the present invention is to provide an inferior vena cava measurement method, device, equipment and storage medium, which can automatically determine the target vertical line segment perpendicular to the front and back walls of the inferior vena cava in the inferior vena cava ultrasound image by key point positioning and semantic segmentation, so as to realize automatic measurement of the inner diameter of the inferior vena cava and improve the accuracy of the measurement of the inner diameter of the inferior vena cava. The specific scheme is as follows:

[0004] In a first aspect, the present application provides a method for measuring an inferior vena cava, comprising:

[0005] Performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava;

[0006] Determine the corresponding inferior vena cava direction using the mask area, and draw a target vertical line segment perpendicular to the inferior vena cava direction at a measurement position determined based on the key point;

[0007] The line segment on the target vertical line segment passing through the mask area is measured to determine the inner diameter of the inferior vena cava.

[0008] Optionally, the performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava includes:

[0009] Acquire an ultrasound video of the inferior vena cava; the ultrasound video of the inferior vena cava is an ultrasound video obtained by collecting at least one respiratory cycle of the inferior vena cava;

[0010] The preset model is used to perform key point positioning and semantic segmentation on the inferior vena cava ultrasound image in the inferior vena cava ultrasound video to obtain the corresponding key points of the connection between the inferior vena cava and the right atrium and the mask area corresponding to the inferior vena cava.

[0011] Optionally, before using a preset model to perform key point positioning and semantic segmentation on the inferior vena cava ultrasound image in the inferior vena cava ultrasound video, the method further includes:

[0012] Obtaining a historical ultrasound image of the inferior vena cava, and obtaining label information obtained by annotating key points of the inferior vena cava and right atrium connection in the historical ultrasound image of the inferior vena cava and the area where the inferior vena cava is located, so as to obtain a training set;

[0013] Model training is performed based on the training set to obtain the trained preset model.

[0014] Optionally, the method further includes:

[0015] The inferior vena cava ultrasound images in the inferior vena cava ultrasound video are sequentially displayed on a display screen, and the corresponding target vertical line segment and the inner diameter of the inferior vena cava are displayed on the inferior vena cava ultrasound image.

[0016] Optionally, the method further includes:

[0017] Draw a corresponding inner diameter change curve based on the timestamp corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video and the inner diameter of the inferior vena cava;

[0018] Analyzing the inner diameter change period in the inner diameter change curve to determine at least one corresponding first respiratory period;

[0019] The target curve segment corresponding to each of the first respiratory cycles in the inner diameter variation curve and the peaks and troughs in the target curve segment are determined to obtain the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycle.

[0020] Optionally, after obtaining the inner diameters of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycles, the method further includes:

[0021] Selecting at least one breathing cycle from the first breathing cycles corresponding to the inner diameter change curve to obtain a second breathing cycle;

[0022] Determine, from the inferior vena cava ultrasound video, a first inferior vena cava ultrasound image corresponding to end expiration and a second inferior vena cava ultrasound image corresponding to end inspiration in the second respiratory cycle;

[0023] The first inferior vena cava ultrasound image, the second inferior vena cava ultrasound image and the respective corresponding target vertical line segments are displayed.

[0024] Optionally, after obtaining the inner diameters of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycles, the method further includes:

[0025] Displaying the measurement result of the inferior vena cava corresponding to the second respiratory cycle;

[0026] Among them, the inferior vena cava measurement results include at least one of the following: the inner diameter of the inferior vena cava corresponding to the end of exhalation and / or end of inspiration in the second respiratory cycle, and the difference between the inner diameters of the inferior vena cava corresponding to the end of exhalation and end of inspiration in the second respiratory cycle.

[0027] Optionally, selecting at least one respiratory cycle from the first respiratory cycles corresponding to the inner diameter change curve to obtain a second respiratory cycle includes:

[0028] Determine the respiratory cycle with the largest target difference from the first respiratory cycle corresponding to the inner diameter change curve to obtain the second respiratory cycle; the target difference is the difference between the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration, respectively;

[0029] Or, based on a cycle selection instruction, the second breathing cycle is selected from the first breathing cycles corresponding to the inner diameter change curve.

[0030] Optionally, the determining the corresponding inferior vena cava direction using the mask area includes:

[0031] Determining a truncation position that satisfies a first preset orientation relationship based on a position that is a first preset distance from the key point;

[0032] Using the truncation position to truncate the mask area in a preset direction, and selecting a target mask area closest to the key point from the truncation mask area;

[0033] The target coordinate points in the target mask area are used to perform straight line fitting to determine the corresponding direction of the inferior vena cava.

[0034] Optionally, drawing a target vertical line segment perpendicular to the direction of the inferior vena cava at the measurement position determined based on the key point includes:

[0035] Determining the measurement position satisfying a second preset orientation relationship based on a position at a second preset distance from the key point;

[0036] The target vertical line segment perpendicular to the inferior vena cava direction is drawn at the measurement position.

[0037] Optionally, measuring a line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava includes:

[0038] Determine a starting intersection position and an ending intersection position of the target vertical line segment and the mask area;

[0039] The length of the line segment between the starting intersection position and the ending intersection position is measured to determine the inner diameter of the inferior vena cava.

[0040] In a second aspect, the present application provides an inferior vena cava measurement device, comprising:

[0041] An image processing module, used for performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava;

[0042] A measurement line drawing module, used for determining the corresponding inferior vena cava direction using the mask area, and drawing a target vertical line segment perpendicular to the inferior vena cava direction at the measurement position determined based on the key point;

[0043] The inner diameter determination module is used to measure the line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava.

[0044] In a third aspect, the present application provides an electronic device, including:

[0045] Memory, used to store computer programs;

[0046] A processor is used to execute the computer program to implement the aforementioned inferior vena cava measurement method.

[0047] In a fourth aspect, the present application provides a computer-readable storage medium for storing a computer program, which implements the aforementioned inferior vena cava measurement method when executed by a processor.

[0048] In the present application, the key point positioning and semantic segmentation of the ultrasound image of the inferior vena cava are performed to obtain the key points of the connection between the inferior vena cava and the right atrium and the mask area corresponding to the inferior vena cava; the mask area is used to determine the corresponding inferior vena cava direction, and a target vertical line segment perpendicular to the direction of the inferior vena cava is drawn at the measurement position determined based on the key points; the line segment on the target vertical line segment passing through the mask area is measured to determine the inner diameter of the inferior vena cava. It can be seen that the present application can automatically determine the target vertical line segment perpendicular to the direction of the inferior vena cava in the ultrasound image of the inferior vena cava by means of key point positioning and semantic segmentation, that is, the direction of the target vertical line segment is perpendicular to the anterior and posterior walls of the inferior vena cava, thereby quickly realizing the automatic measurement of the inner diameter of the inferior vena cava, reducing manual operations, and improving the accuracy of the measurement of the inner diameter of the inferior vena cava. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0050] Figure 1 A flow chart of a method for measuring the inferior vena cava disclosed in an embodiment of the present application;

[0051] Figure 2 A schematic diagram of measuring the inner diameter of the inferior vena cava disclosed in an embodiment of the present application;

[0052] Figure 3 A flow chart for determining the direction of the inferior vena cava disclosed in an embodiment of the present application;

[0053] Figure 4 A flowchart for determining the inner diameter of the inferior vena cava corresponding to the end of expiration and the end of inspiration, respectively, disclosed in an embodiment of the present application;

[0054] Figure 5 A schematic diagram of the structure of an inferior vena cava measuring device disclosed in an embodiment of the present application;

[0055] Figure 6 A structural diagram of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0057] Since the inner diameter of the inferior vena cava changes continuously with a certain amplitude when the human body inhales and exhales, the inner diameter of the inferior vena cava can reflect the changes in important physical signs of the human body, but the accuracy of the measurement of the inner diameter of the inferior vena cava needs to be further improved. To this end, the present application provides a method for measuring the inferior vena cava, which can automatically determine the target vertical line segment perpendicular to the front and back walls of the inferior vena cava in the ultrasound image of the inferior vena cava through key point positioning and semantic segmentation, so as to realize the automatic measurement of the inner diameter of the inferior vena cava and improve the accuracy of the measurement of the inner diameter of the inferior vena cava.

[0058] See also Figure 1 As shown, an embodiment of the present invention discloses a method for measuring an inferior vena cava, which can be applied to electronic devices such as ultrasound equipment. Taking an ultrasound equipment as an example, the ultrasound equipment can perform ultrasound image acquisition to obtain an inferior vena cava ultrasound image, and then perform the corresponding steps of the inferior vena cava measurement method on the obtained inferior vena cava ultrasound image.

[0059] Further, the method comprises:

[0060] Step S11, performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava.

[0061] In this embodiment, for the key point of the connection between the inferior vena cava and the right atrium, after the connection between the inferior vena cava and the right atrium is determined, a certain connection point of the connection can be determined as the key point of the connection between the inferior vena cava and the right atrium; of course, other positions can also be determined as key points according to actual measurement requirements. For the mask area corresponding to the inferior vena cava, when semantic segmentation is performed on the ultrasound image of the inferior vena cava, each pixel in the ultrasound image of the inferior vena cava is classified and marked to form a mask area based on pixels marked as the inferior vena cava category.

[0062] In this embodiment, an ultrasound video of the inferior vena cava is obtained, and a preset model is used to perform key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava, so as to obtain the key points of the connection between the inferior vena cava and the right atrium corresponding to the ultrasound image of the inferior vena cava and the mask area corresponding to the inferior vena cava. It should be noted that in one case, a preset model that simultaneously completes key point positioning and semantic segmentation can be used to perform key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava. In another case, two preset models that separately complete key point positioning and semantic segmentation can be used to perform key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava; wherein, for the two preset models that separately complete key point positioning and semantic segmentation, the order in which the two preset models are connected is not limited. Furthermore, for the results of key point positioning and semantic segmentation in the ultrasound image of the inferior vena cava, such as Figure 2 As shown in the figure, the white solid dot is the key point of the connection between the inferior vena cava and the right atrium, the black shadow on the right side of the white solid dot is the right atrium, and the range circled by the white solid circle on the left side is the mask area corresponding to the inferior vena cava. It should be noted that the preset models include but are not limited to HRnet (High-Resolution Network), Mask R-CNN (Mask Region-Convolutional Neural Networks), FCIS (Fully Convolutional Instance-aware Semantic Segmentation), etc.

[0063] Specifically, for the key point of the connection between the inferior vena cava and the right atrium, in the process of locating the key point of any frame of the inferior vena cava ultrasound image in the inferior vena cava ultrasound video, the brightest prediction point is determined from the heat map containing several prediction points of different brightness, and the brightest prediction point is determined as the key point of the connection between the inferior vena cava and the right atrium corresponding to the inferior vena cava ultrasound image.

[0064] It should be noted that, since the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration can reflect the changes in important physical signs of the human body, it is necessary to collect the inferior vena cava for at least one respiratory cycle to obtain an ultrasound video of the inferior vena cava. In one specific embodiment, the ultrasound device can directly use its own ultrasound probe to collect the inferior vena cava for at least one respiratory cycle to obtain an ultrasound video of the inferior vena cava, and use the locally deployed preset model to realize the operation of key point positioning and semantic segmentation of the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava. In another specific embodiment, the ultrasound device can use its own ultrasound probe to collect the inferior vena cava for at least one respiratory cycle to obtain an ultrasound video of the inferior vena cava, and transmit the ultrasound video of the inferior vena cava to a third-party device that deploys a preset model, so as to realize the operation of key point positioning and semantic segmentation of the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava through the third-party device. In which, the ultrasound device includes but is not limited to an ultrasound diagnostic instrument, an ultrasound imager, etc., and the third-party device includes but is not limited to an ultrasound diagnostic instrument, an ultrasound imaging workstation, a personal computer, etc.

[0065] Furthermore, before using the preset model to perform key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava, it is necessary to complete the training of the preset model first. Specifically, taking the training of a preset model that simultaneously completes key point positioning and semantic segmentation as an example, a historical ultrasound image of the inferior vena cava is obtained, and the key points of the connection between the inferior vena cava and the right atrium in the historical ultrasound image of the inferior vena cava and the area where the inferior vena cava is located are annotated to obtain label information, and a training set is constructed based on the historical ultrasound image of the inferior vena cava and the corresponding label information; model training is performed based on the training set to obtain a trained preset model that can simultaneously complete key point positioning and semantic segmentation. Among them, the judgment of whether the model training is completed can be judged by whether the iterative rounds of the model training reach the preset rounds, or by whether the model accuracy reaches the preset accuracy threshold, which is not limited here. It should be noted that the training steps for the two preset models that complete key point positioning and semantic segmentation separately are similar to the above steps, and only the respective training sets need to be modified accordingly.

[0066] Step S12: using the mask area to determine the corresponding inferior vena cava direction, and drawing a target vertical line segment perpendicular to the inferior vena cava direction at the measurement position determined based on the key point.

[0067] In this embodiment, a portion of the mask area closest to the key point is selected from the mask area corresponding to the inferior vena cava to obtain a target mask area, the corresponding inferior vena cava direction is determined based on the target mask area, and the corresponding measurement position is determined based on the key point at the connection between the inferior vena cava and the right atrium, so as to draw a target vertical line segment perpendicular to the inferior vena cava direction at the measurement position. The target mask area can be selected by truncating the mask area corresponding to the inferior vena cava and selecting the target mask area closest to the key point from the truncated mask area, or by automatically selecting the target mask area closest to the key point from the mask area corresponding to the inferior vena cava through a model.

[0068] Here, taking the truncation of the mask region corresponding to the inferior vena cava as an example, see Figure 3 As shown, the steps of using the mask area to determine the corresponding inferior vena cava direction include: step S21, determining a truncation position that satisfies a first preset orientation relationship based on a position that is a first preset distance away from a key point; step S22, using the truncation position to truncate the mask area in a preset direction, and selecting a target mask area closest to the key point from the truncated mask area; step S23, using the target coordinate points in the target mask area to perform straight line fitting to determine the corresponding inferior vena cava direction.

[0069] It should be noted that the inventors have found that it is more accurate to measure the inferior vena cava at a position 2 cm to the left of the key point where the inferior vena cava and the right atrium are connected. Therefore, when determining the direction of the inferior vena cava, only the part of the mask area corresponding to the inferior vena cava close to the key point is needed. For example, the position 5 cm to the left of the key point where the inferior vena cava and the right atrium are determined as the truncation position, and the mask area corresponding to the inferior vena cava is truncated in the vertical direction at the truncation position to obtain two truncated mask areas, and then the part of the mask area closest to the key point is selected from the two truncated mask areas as the target mask area. By performing a straight line fitting on the target coordinate point in the target mask area, the corresponding inferior vena cava direction can be determined.

[0070] Among them, for the use of the target coordinate points in the target mask area to perform straight line fitting to determine the corresponding inferior vena cava direction, in the first case, the corresponding inferior vena cava direction can be determined by performing straight line fitting on all the coordinate points in the target mask area. In the second case, all the coordinate points in the target mask area can be determined first, and some coordinate points can be selected from all the coordinate points, and then the corresponding inferior vena cava direction can be determined by performing straight line fitting on some of the coordinate points; the selection of some coordinate points includes but is not limited to equidistant selection, random selection, etc. In the third case, the corresponding inferior vena cava direction can be determined by performing straight line fitting on all contour points in the target mask area. In the fourth case, all contour points in the target mask area can be determined first, and some contour points can be selected from all the contour points, and then the corresponding inferior vena cava direction can be determined by performing straight line fitting on some contour points; the selection of some contour points includes but is not limited to equidistant selection, random selection, etc. It should be noted that the determination of the target coordinate points in the target mask area is not limited to the above four methods.

[0071] In this embodiment, after the direction of the inferior vena cava is determined, the target vertical line segment is drawn by determining a measurement position that satisfies a second preset orientation relationship based on a position that is a second preset distance from the key point, and drawing a target vertical line segment perpendicular to the direction of the inferior vena cava at the measurement position. Figure 2 As shown in FIG. 1 , a position 2 cm to the left of the key point where the inferior vena cava and the right atrium are connected is determined as the measurement position, and a target vertical line segment perpendicular to the direction of the inferior vena cava is drawn at the measurement position. It should be noted that the target vertical line segment is perpendicular to the direction of the inferior vena cava, which means that the target vertical line segment is perpendicular to the anterior wall and the posterior wall of the inferior vena cava at the same time.

[0072] Step S13: measuring the line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava.

[0073] In this embodiment, after drawing the target vertical line segment, the line segment passing through the mask area is determined from the target vertical line segment, and the line segment passing through the mask area is measured to obtain the inner diameter of the inferior vena cava. Specifically, the starting intersection position and the ending intersection position of the target vertical line segment and the mask area are determined, and the length of the line segment between the starting intersection position and the ending intersection position is measured to determine the corresponding inner diameter of the inferior vena cava. Among them, the line segment between the starting intersection position and the ending intersection position is the inner diameter measurement line for the inferior vena cava, and the length of the inner diameter measurement line is the inner diameter of the inferior vena cava. It should be noted that since the target vertical line segment is perpendicular to the anterior wall and the posterior wall of the inferior vena cava at the same time, the length of the line segment between the starting intersection position and the ending intersection position of the target vertical line segment and the mask area can be directly determined as the corresponding inner diameter of the inferior vena cava.

[0074] Furthermore, in the process of inputting the inferior vena cava ultrasound video into the preset model to determine the inferior vena cava inner diameter corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video through the preset model, the inferior vena cava ultrasound images in the inferior vena cava ultrasound video are sequentially displayed on the display screen, and the corresponding target vertical line segment and the inferior vena cava inner diameter are displayed on the inferior vena cava ultrasound image, so that the user can intuitively see the change of the inferior vena cava inner diameter. It should be noted that the inferior vena cava inner diameter can be determined for each frame of the inferior vena cava ultrasound image in the inferior vena cava ultrasound video, or the inferior vena cava inner diameter can be determined for the inferior vena cava ultrasound image in the inferior vena cava ultrasound video by using a custom frame extraction or a preset interval frame extraction method.

[0075] It should be noted that after determining the inner diameter of the inferior vena cava corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video, the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each respiratory cycle can be further obtained. Figure 4 As shown, step S31, drawing a corresponding inner diameter change curve based on the timestamp corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video and the inner diameter of the inferior vena cava; step S32, analyzing the inner diameter change period in the inner diameter change curve to determine at least one corresponding first respiratory cycle; step S33, determining the target curve segment corresponding to each first respiratory cycle in the inner diameter change curve and the peaks and troughs in the target curve segment to obtain the inner diameters of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each first respiratory cycle.

[0076] It can be understood that the timestamp corresponding to the ultrasound image of the inferior vena cava is the X-axis, and the inner diameter of the inferior vena cava is the Y-axis. Based on the timestamp corresponding to the ultrasound image of the inferior vena cava in the ultrasound video of the inferior vena cava and the inner diameter of the inferior vena cava, the corresponding inner diameter change curve is drawn, and the inner diameter change curve is fitted with a periodic function to obtain the fitted inner diameter change curve. By determining one or more first respiratory cycles in the inner diameter change curve, and determining the peaks and troughs corresponding to each first respiratory cycle in the inner diameter change curve, the peaks are used as the inner diameter of the inferior vena cava corresponding to the end of exhalation in each first respiratory cycle, and the troughs are used as the inner diameter of the inferior vena cava corresponding to the end of inspiration in each first respiratory cycle. In this way, by analyzing the inner diameter change curve to determine the inner diameters of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each respiratory cycle, the workload of manual identification can be reduced and the efficiency of inferior vena cava measurement can be improved.

[0077] Among them, for periodic function fitting, it can include trigonometric function superposition fitting of the inner diameter change curve drawn based on the timestamp and the inner diameter of the inferior vena cava, so as to better fit and reconstruct the periodic inner diameter of the inferior vena cava through a linear combination of multiple sine and cosine functions, thereby obtaining a fitted inner diameter change curve. It should be noted that the linear combination of multiple sine and cosine functions is a combination determined by adjusting parameters such as amplitude, frequency, and phase. In this way, the fitted inner diameter change curve can have a higher noise resistance and be closer to the original inner diameter change.

[0078] Further, after obtaining the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each first respiratory cycle, at least one respiratory cycle is selected from the first respiratory cycle corresponding to the inner diameter change curve to obtain the second respiratory cycle, that is, the second respiratory cycle is in the first respiratory cycle, and then the video moments corresponding to the end of exhalation and the end of inspiration in the second respiratory cycle are determined to extract the ultrasound image of the inferior vena cava at the corresponding moment in the ultrasound video of the inferior vena cava, so as to obtain the first ultrasound image of the inferior vena cava corresponding to the end of exhalation and the second ultrasound image of the inferior vena cava corresponding to the end of inspiration in the second respiratory cycle. Then, the first ultrasound image of the inferior vena cava, the second ultrasound image of the inferior vena cava, and the target vertical line segments corresponding to the first ultrasound image of the inferior vena cava and the second ultrasound image of the inferior vena cava are displayed on the current display screen, so that the user can compare and observe the ultrasound images of the inferior vena cava corresponding to the end of inspiration and the end of exhalation.

[0079] At the same time, after obtaining the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration in each first respiratory cycle, the measurement results of the inferior vena cava corresponding to the second respiratory cycle can also be displayed on the current display screen, wherein the measurement results of the inferior vena cava include but are not limited to the inner diameters of the inferior vena cava corresponding to the end of expiration and / or the end of inspiration in the second respiratory cycle, the difference between the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration in the second respiratory cycle, and the related results derived based on the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration in the second respiratory cycle. In this way, the user can clearly understand the changes in the inner diameters of the inferior vena cava at the end of inspiration and the end of expiration.

[0080] Among them, for selecting at least one respiratory cycle from the first respiratory cycle corresponding to the inner diameter change curve to obtain the second respiratory cycle, in a specific embodiment, the target difference between the inner diameters of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each first respiratory cycle can be determined, and the first respiratory cycle with the largest target difference can be determined from at least one first respiratory cycle corresponding to the inner diameter change curve, so as to determine the first respiratory cycle with the largest target difference as the second respiratory cycle; that is, at this time, the inner diameter change difference between the inner diameter of the inferior vena cava corresponding to the end of inspiration and the inner diameter of the inferior vena cava corresponding to the end of exhalation in the second respiratory cycle is the largest. In another specific embodiment, the cycle selection instruction input by the user can be obtained through the preset cycle selection interface, and the second respiratory cycle can be screened from at least one first respiratory cycle corresponding to the inner diameter change curve based on the cycle selection instruction; wherein, the preset cycle selection interface includes but is not limited to a text input box, a radio button, a screen drawing interface, etc. It should be noted that the selection of the second respiratory cycle is not limited to the above two methods.

[0081] It can be seen that the present application can automatically determine the target vertical line segment perpendicular to the direction of the inferior vena cava in the inferior vena cava ultrasound image by means of key point positioning and semantic segmentation, that is, the direction of the target vertical line segment is perpendicular to the front and back walls of the inferior vena cava, thereby quickly realizing the automatic measurement of the inner diameter of the inferior vena cava, reducing manual operations, and improving the accuracy of the measurement of the inner diameter of the inferior vena cava. In addition, the present application determines the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each respiratory cycle by drawing an inner diameter change curve based on the measurement time and the inner diameter of the inferior vena cava, and compares and displays the inferior vena cava ultrasound images corresponding to the end of inspiration and the end of exhalation, so that the user can clearly observe the changes in the inferior vena cava at the end of inspiration and the end of exhalation.

[0082] See also Figure 5 As shown, the embodiment of the present invention discloses an inferior vena cava measuring device, comprising:

[0083] An image processing module 11 is used to perform key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava;

[0084] A measurement line drawing module 12, used for determining the corresponding inferior vena cava direction using the mask area, and drawing a target vertical line segment perpendicular to the inferior vena cava direction at the measurement position determined based on the key point;

[0085] The inner diameter determination module 13 is used to measure the line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava.

[0086] It can be seen that the present application can automatically determine the target vertical line segment perpendicular to the direction of the inferior vena cava in the inferior vena cava ultrasound image through key point positioning and semantic segmentation, that is, the direction of the target vertical line segment is perpendicular to the anterior and posterior walls of the inferior vena cava, thereby quickly realizing automatic measurement of the inner diameter of the inferior vena cava, reducing manual operations, and improving the accuracy of the measurement of the inner diameter of the inferior vena cava.

[0087] In some specific embodiments, the image processing module 11 includes:

[0088] A video acquisition unit, used for acquiring an ultrasound video of the inferior vena cava; the ultrasound video of the inferior vena cava is an ultrasound video acquired by collecting at least one respiratory cycle of the inferior vena cava;

[0089] An image processing unit is used to use a preset model to perform key point positioning and semantic segmentation on the inferior vena cava ultrasound image in the inferior vena cava ultrasound video to obtain the corresponding key points of the connection between the inferior vena cava and the right atrium and the mask area corresponding to the inferior vena cava.

[0090] In some specific embodiments, the inferior vena cava measurement device further includes:

[0091] A training set determination unit is used to obtain a historical ultrasound image of the inferior vena cava, and obtain label information obtained by annotating key points of the connection between the inferior vena cava and the right atrium and the area where the inferior vena cava is located in the historical ultrasound image of the inferior vena cava, so as to obtain a training set;

[0092] The model training unit is used to perform model training based on the training set to obtain the trained preset model.

[0093] In some specific embodiments, the inferior vena cava measurement device further includes:

[0094] An image display unit is used to sequentially display the inferior vena cava ultrasound images in the inferior vena cava ultrasound video on a display screen, and to display the corresponding target vertical line segment and the inner diameter of the inferior vena cava on the inferior vena cava ultrasound image.

[0095] In some specific embodiments, the inferior vena cava measurement device further includes:

[0096] A change curve drawing unit, used for drawing a corresponding inner diameter change curve based on the timestamp corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video and the inner diameter of the inferior vena cava;

[0097] a cycle analysis unit, configured to analyze the inner diameter variation cycle in the inner diameter variation curve to determine at least one corresponding first respiratory cycle;

[0098] The inner diameter determination unit is used to determine the target curve segment corresponding to each of the first respiratory cycles in the inner diameter change curve and the peaks and troughs in the target curve segment, so as to obtain the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycle.

[0099] In some specific embodiments, the inferior vena cava measurement device further includes:

[0100] A cycle selection submodule, used for selecting at least one breathing cycle from the first breathing cycles corresponding to the inner diameter change curve to obtain a second breathing cycle;

[0101] An image determination unit, configured to determine, from the inferior vena cava ultrasound video, a first inferior vena cava ultrasound image corresponding to the end of exhalation and a second inferior vena cava ultrasound image corresponding to the end of inspiration in the second respiratory cycle;

[0102] The first display unit is used to display the first inferior vena cava ultrasound image and the second inferior vena cava ultrasound image and the corresponding target vertical line segments.

[0103] In some specific embodiments, the inferior vena cava measurement device further includes:

[0104] A second display unit, used for displaying the measurement result of the inferior vena cava corresponding to the second respiratory cycle;

[0105] Among them, the inferior vena cava measurement results include at least one of the following: the inner diameter of the inferior vena cava corresponding to the end of exhalation and / or end of inspiration in the second respiratory cycle, and the difference between the inner diameters of the inferior vena cava corresponding to the end of exhalation and end of inspiration in the second respiratory cycle.

[0106] In some specific embodiments, the period selection submodule includes:

[0107] A respiratory cycle determination unit, configured to determine a respiratory cycle with a maximum target difference from the first respiratory cycles corresponding to the inner diameter change curve, so as to obtain the second respiratory cycle; the target difference is a difference between the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration, respectively;

[0108] The breathing cycle screening unit is used to screen the second breathing cycle from the first breathing cycle corresponding to the inner diameter change curve based on a cycle selection instruction.

[0109] In some specific embodiments, the measurement line drawing module 12 includes:

[0110] A truncation position determining unit, configured to determine a truncation position satisfying a first preset orientation relationship based on a position at a first preset distance from the key point;

[0111] a target region selection unit, configured to truncate the mask region in a preset direction using the truncation position, and select a target mask region closest to the key point from the truncation mask region;

[0112] A straight line fitting unit is used to perform straight line fitting using the target coordinate points in the target mask area to determine the corresponding direction of the inferior vena cava.

[0113] In some specific embodiments, the measurement line drawing module 12 includes:

[0114] a measurement position determining unit, configured to determine the measurement position satisfying a second preset orientation relationship based on a position at a second preset distance from the key point;

[0115] A measurement line drawing unit is used to draw the target vertical line segment perpendicular to the direction of the inferior vena cava at the measurement position.

[0116] In some specific embodiments, the inner diameter determination module 13 includes:

[0117] An intersection position determination unit, used to determine a starting intersection position and an ending intersection position of the target vertical line segment and the mask area;

[0118] The length measuring unit is used to measure the length of the line segment between the starting intersection position and the ending intersection position to determine the inner diameter of the inferior vena cava.

[0119] Furthermore, the present application also discloses an electronic device. Figure 6 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content in the diagram cannot be regarded as any limitation on the scope of use of the present application.

[0120] Figure 6 A schematic diagram of the structure of an electronic device 20 provided in an embodiment of the present application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 is used to store a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the inferior vena cava measurement method disclosed in any of the aforementioned embodiments. In addition, the electronic device 20 in this embodiment may specifically be an electronic computer.

[0121] In this embodiment, the power supply 23 is used to provide working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and the external device, and the communication protocol it follows is any communication protocol that can be applied to the technical solution of the present application, and is not specifically limited here; the input and output interface 25 is used to obtain external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs and is not specifically limited here.

[0122] In addition, the memory 22, as a carrier for storing resources, can be a read-only memory, a random access memory, a disk or an optical disk, etc. The resources stored thereon can include an operating system 221, a computer program 222, etc., and the storage method can be temporary storage or permanent storage.

[0123] The operating system 221 is used to manage and control the hardware devices and computer program 222 on the electronic device 20, and can be Windows Server, Netware, Unix, Linux, etc. In addition to including a computer program that can be used to complete the inferior vena cava measurement method performed by the electronic device 20 disclosed in any of the aforementioned embodiments, the computer program 222 can further include a computer program that can be used to complete other specific tasks.

[0124] Furthermore, the present application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned inferior vena cava measurement method is implemented. The specific steps of the method can be referred to the corresponding contents disclosed in the aforementioned embodiments, and will not be repeated here.

[0125] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0126] Those skilled in the art may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0127] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0128] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0129] The technical solution provided by the present application is introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technicians in this field, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for measuring the inferior vena cava, It is characterized in that include: Performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava; Determine the corresponding inferior vena cava direction using the mask area, and draw a target vertical line segment perpendicular to the inferior vena cava direction at a measurement position determined based on the key point; The line segment on the target vertical line segment passing through the mask area is measured to determine the inner diameter of the inferior vena cava.

2. The method for measuring the inferior vena cava according to claim 1, It is characterized in that The key point positioning and semantic segmentation of the ultrasound image of the inferior vena cava to obtain the key points of the connection between the inferior vena cava and the right atrium and the mask area corresponding to the inferior vena cava include: Acquire an ultrasound video of the inferior vena cava; the ultrasound video of the inferior vena cava is an ultrasound video obtained by collecting at least one respiratory cycle of the inferior vena cava; The preset model is used to perform key point positioning and semantic segmentation on the inferior vena cava ultrasound image in the inferior vena cava ultrasound video to obtain the corresponding key points of the connection between the inferior vena cava and the right atrium and the mask area corresponding to the inferior vena cava.

3. The method for measuring the inferior vena cava according to claim 2, It is characterized in that Before using the preset model to perform key point positioning and semantic segmentation on the inferior vena cava ultrasound image in the inferior vena cava ultrasound video, the method further includes: Obtaining a historical ultrasound image of the inferior vena cava, and obtaining label information obtained by annotating key points of the inferior vena cava and right atrium connection in the historical ultrasound image of the inferior vena cava and the area where the inferior vena cava is located, so as to obtain a training set; Model training is performed based on the training set to obtain the trained preset model.

4. The method for measuring the inferior vena cava according to claim 2, It is characterized in that Also includes: The inferior vena cava ultrasound images in the inferior vena cava ultrasound video are sequentially displayed on a display screen, and the corresponding target vertical line segment and the inner diameter of the inferior vena cava are displayed on the inferior vena cava ultrasound image.

5. The method for measuring the inferior vena cava according to claim 2, It is characterized in that Also includes: Draw a corresponding inner diameter change curve based on the timestamp corresponding to the inferior vena cava ultrasound image in the inferior vena cava ultrasound video and the inner diameter of the inferior vena cava; Analyzing the inner diameter change period in the inner diameter change curve to determine at least one corresponding first respiratory period; The target curve segment corresponding to each of the first respiratory cycles in the inner diameter variation curve and the peaks and troughs in the target curve segment are determined to obtain the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycle.

6. The method for measuring the inferior vena cava according to claim 5, It is characterized in that After obtaining the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycles, the method further includes: Selecting at least one breathing cycle from the first breathing cycles corresponding to the inner diameter change curve to obtain a second breathing cycle; Determine, from the inferior vena cava ultrasound video, a first inferior vena cava ultrasound image corresponding to end expiration and a second inferior vena cava ultrasound image corresponding to end inspiration in the second respiratory cycle; The first inferior vena cava ultrasound image, the second inferior vena cava ultrasound image and the respective corresponding target vertical line segments are displayed.

7. The method for measuring the inferior vena cava according to claim 6, It is characterized in that After obtaining the inner diameter of the inferior vena cava corresponding to the end of exhalation and the end of inspiration in each of the first respiratory cycles, the method further includes: Displaying the measurement result of the inferior vena cava corresponding to the second respiratory cycle; Among them, the inferior vena cava measurement results include at least one of the following: the inner diameter of the inferior vena cava corresponding to the end of exhalation and / or end of inspiration in the second respiratory cycle, and the difference between the inner diameters of the inferior vena cava corresponding to the end of exhalation and end of inspiration in the second respiratory cycle.

8. The method for measuring the inferior vena cava according to claim 6, It is characterized in that The selecting at least one breathing cycle from the first breathing cycles corresponding to the inner diameter change curve to obtain a second breathing cycle includes: Determine the respiratory cycle with the largest target difference from the first respiratory cycle corresponding to the inner diameter change curve to obtain the second respiratory cycle; the target difference is the difference between the inner diameters of the inferior vena cava corresponding to the end of expiration and the end of inspiration, respectively; Or, based on a cycle selection instruction, the second breathing cycle is selected from the first breathing cycles corresponding to the inner diameter change curve.

9. The method for measuring the inferior vena cava according to any one of claims 1 to 8, It is characterized in that The step of using the mask area to determine the corresponding inferior vena cava direction includes: Determining a truncation position that satisfies a first preset orientation relationship based on a position that is a first preset distance from the key point; Using the truncation position to truncate the mask area in a preset direction, and selecting a target mask area closest to the key point from the truncation mask area; The target coordinate points in the target mask area are used to perform straight line fitting to determine the corresponding direction of the inferior vena cava.

10. The method for measuring the inferior vena cava according to any one of claims 1 to 8, It is characterized in that The step of drawing a target vertical line segment perpendicular to the direction of the inferior vena cava at the measurement position determined based on the key point comprises: Determining the measurement position satisfying a second preset orientation relationship based on a position at a second preset distance from the key point; The target vertical line segment perpendicular to the inferior vena cava direction is drawn at the measurement position.

11. The method for measuring the inferior vena cava according to any one of claims 1 to 8, It is characterized in that The step of measuring the line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava comprises: Determine a starting intersection position and an ending intersection position of the target vertical line segment and the mask area; The length of the line segment between the starting intersection position and the ending intersection position is measured to determine the inner diameter of the inferior vena cava.

12. An inferior vena cava measuring device, It is characterized in that include: An image processing module, used for performing key point positioning and semantic segmentation on the ultrasound image of the inferior vena cava to obtain key points at the connection between the inferior vena cava and the right atrium and a mask area corresponding to the inferior vena cava; A measurement line drawing module, used for determining the corresponding inferior vena cava direction using the mask area, and drawing a target vertical line segment perpendicular to the inferior vena cava direction at the measurement position determined based on the key point; The inner diameter determination module is used to measure the line segment on the target vertical line segment passing through the mask area to determine the inner diameter of the inferior vena cava.

13. An electronic device, It is characterized in that include: Memory, used to store computer programs; A processor, configured to execute the computer program to implement the inferior vena cava measurement method according to any one of claims 1 to 11.

14. A computer-readable storage medium, It is characterized in that Used to store a computer program, which, when executed by a processor, implements the inferior vena cava measurement method according to any one of claims 1 to 11.

Images