Method and system for automatically collecting two-dimensional heart ultrasonic section annotation data

By using a size detection model and OCR technology in cardiac ultrasound examinations to automatically identify key dimensions and convert them into actual physical dimensions, the errors and inefficiencies caused by manual measurement by ultrasound physicians are solved, achieving efficient and accurate measurement results.

CN120852269AActive Publication Date: 2025-10-28BEIJING XIANXINAN TECHNOLOGY CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202510662662.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-21
Publication Date
2025-10-28
Estimated Expiration
2045-05-21

AI Technical Summary

Technical Problem

In existing cardiac ultrasound examinations, ultrasound doctors need to manually mark and measure, which makes the measurement results susceptible to human errors, inefficient and inaccurate, and lacks automation.

Method used

The trained size detection model and auxiliary model are used to automatically identify key dimensions in ultrasound images, and the values ​​are extracted by combining OCR technology. The values ​​are converted into actual physical dimensions based on the scale information and a measurement report is generated.

Benefits of technology

The system automates the measurement of cardiac ultrasound images, improving the accuracy and efficiency of measurements, reducing human error, and ensuring the standardization and consistency of measurement results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120852269A_ABST
    Figure CN120852269A_ABST
Patent Text Reader

Abstract

The invention discloses a two-dimensional heart ultrasonic section annotation data automatic acquisition method and system, and the method comprises the steps: inputting an ultrasonic section image of a doctor video freeze frame into a trained size detection model and an auxiliary model, and enabling the size detection model to output a key size annotation in the ultrasonic section image; comprising endpoints, line segments, text areas, ellipses, straight lines and angles; the auxiliary model outputs a tangent plane where the key size in the ultrasonic tangent plane image is located, a cavity where the key size is located and the geometric direction of the cavity; extracting corresponding numerical values from the critical dimension marks by using an OCR (Optical Character Recognition) technology, sorting line segment lengths in the critical dimension marks, converting the detected dimension marks into actual physical dimensions of a corresponding dimension table from pixel units according to proportional scale information in the image, and sorting the actual physical dimensions; and according to a sorting result, outputting multiple groups of size information of the ultrasonic section image, generating a measurement report, and automatically completing acquisition of size data in the two-dimensional heart ultrasonic image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of automatic data acquisition technology, and in particular to a method and system for automatic acquisition of two-dimensional cardiac ultrasound cross-sectional annotation data. Background Technology

[0002] Echocardiography is a crucial tool for assessing cardiac structure and function, widely used in clinical diagnosis. Echocardiographic images not only allow physicians to view key physiological indicators such as the morphology and wall thickness of the heart chambers, as well as the internal diameters of the ventricles and atria, in real time, but also enable effective assessment of the heart's pumping function by measuring these parameters. In clinical practice, sonographers typically need to perform detailed annotation and dimensional measurements on two-dimensional echocardiographic images to provide a basis for judging cardiac health. However, the manual annotation and measurement process is cumbersome and susceptible to human error, thus limiting the accuracy and consistency of the measurement results.

[0003] Currently, although ultrasound image analysis technology has made significant progress, and ultrasound artificial intelligence (AI) technology has achieved some advancements in image classification and chamber segmentation, its automation in cardiac ultrasound measurement remains insufficient. Ultrasound physicians still need to manually annotate and measure dimensions, inputting the calibrated dimensions and data into the system. Existing technologies largely focus on image classification and recognition, lacking support for automatic acquisition of dimensional data, real-time correction of physician annotation, and outlier identification. Furthermore, the operation between physicians and the system remains disconnected, failing to achieve automated correction and intelligent interaction, resulting in low measurement efficiency and a high risk of human error in numerous diagnostic tasks, further impacting diagnostic accuracy.

[0004] Therefore, automating cardiac ultrasound image measurement and improving the standardization and efficiency of data acquisition are important requirements in clinical applications. Summary of the Invention

[0005] This application provides a method, system, computer equipment, and storage medium for automatic acquisition of two-dimensional cardiac ultrasound section annotation data, aiming to solve the problem that in existing cardiac ultrasound examination procedures, ultrasound doctors usually rely on manual operation, the whole process is highly dependent on the doctor's experience, and the accuracy of measurement is easily affected by personal judgment deviations or operational errors.

[0006] In a first aspect, a method for automatically acquiring two-dimensional cardiac ultrasound cross-sectional annotation data, the method comprising:

[0007] The ultrasound cross-sectional image captured by the doctor is input into a trained size detection model and an auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image.

[0008] OCR technology is used to extract corresponding values ​​from the key dimension annotations, and the line segment lengths in the key dimension annotations are sorted. At the same time, based on the scale information in the image, the detected dimension annotations are converted from pixel units to actual physical dimensions and sorted.

[0009] Based on the sorting results, multiple sets of size information of the ultrasonic cross-section image are output, and a measurement report is generated.

[0010] Optionally, the above scheme may further include converting the detected dimension annotations from pixel units to actual physical dimensions and sorting them:

[0011] The detected key dimension annotations are matched to ensure that each annotation corresponds correctly to the actual physical size, and the matching results are verified to check for errors or omissions.

[0012] Optionally, in the above scheme, the training process of the trained size detection model includes:

[0013] Collect pre-annotated ultrasound image data, which covers various ultrasound examination scenarios, obtain ultrasound images annotated by doctors, the annotation content includes key dimension information, and preprocess the ultrasound image data, wherein the key dimension information includes: line segments, text regions, ellipses, straight lines and angles;

[0014] Detailed annotations are performed on the preprocessed ultrasound images, including endpoints, line segments, text regions, ellipses, lines, and angles.

[0015] The YOLOv11 model was used to train the recognition of the dimensions of the labeled ultrasound images. During the training process, the model parameters were optimized, and the trained model was evaluated using a validation set to check the model's ability to recognize different labeled content. Based on the evaluation results, the model parameters were adjusted or the training strategy was optimized.

[0016] Optionally, the preprocessing of the ultrasound image data in the above scheme includes: extracting images containing key size information from the ultrasound image data, preprocessing the images containing key size information to ensure consistent image quality, and converting the images into a uniform format and resolution.

[0017] In the above scheme, optionally, the auxiliary model includes an ultrasonic section classification model and an ultrasonic chamber segmentation model;

[0018] The ultrasound section classification model is used to automatically identify the section type of an ultrasound image;

[0019] The ultrasound chamber segmentation model is used to segment the chamber regions in the ultrasound image.

[0020] Optionally, in the above scheme, the OCR technology uses a convolutional neural network model combined with a long short-term memory network structure for training, in order to improve the accuracy of extracting text region size data in images.

[0021] In the above scheme, optionally, the labeled size information included in the training dataset includes multiple size measurement labels of the heart chambers, including key dimensions such as the inner diameter and wall thickness of the ventricles and atria.

[0022] Optionally, in the above scheme, the size annotation information output by the target detection model may also include a confidence score for the annotated region, which is used to represent the reliability of the detection result.

[0023] Secondly, an automatic data acquisition system for two-dimensional cardiac ultrasound cross-sectional annotation data, the system comprising:

[0024] The detection module is used to input the ultrasound cross-sectional image captured by the doctor into the trained size detection model and auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image.

[0025] Recognition module: Used to extract corresponding values ​​from the key dimension annotations using OCR technology, sort the line segment lengths in the key dimension annotations, and convert the detected dimension annotations from pixel units to actual physical dimensions and sort them according to the scale information in the image;

[0026] Output module: Used to output multiple sets of size information of the ultrasonic cross-section image according to the sorting results, and generate a measurement report.

[0027] Compared with the prior art, this application has at least the following beneficial effects:

[0028] This application, based on further analysis and research into the problems of existing technologies, recognizes that in current cardiac ultrasound examination procedures, sonographers typically rely on manual operation, and the entire process is highly dependent on the doctor's experience. This makes it susceptible to errors in judgment or operation, which can affect measurement accuracy. The application addresses this by inputting the ultrasound cross-sectional image captured by the doctor into a trained size detection model and an auxiliary model. The size detection model outputs key dimension annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the key dimensions in the ultrasound cross-sectional image. OCR technology is used to extract corresponding values ​​from the key dimension annotations, and the line segment lengths in the key dimension annotations are sorted. Simultaneously, based on the scale information in the image, the detected dimension annotations are converted from pixel units to actual physical dimensions and sorted. Based on the sorting results, multiple sets of dimension information from the ultrasound cross-sectional image are output, generating a measurement report. This automates the acquisition of dimension data from two-dimensional cardiac ultrasound images, effectively solving the problems of low measurement efficiency, large human error, and cumbersome operation mentioned in the background technology.

[0029] By automatically identifying key dimensions in ultrasound images using target detection technology and combining this with OCR technology to read the dimensional values, the system achieves automatic acquisition of labeled data in ultrasound images, significantly improving measurement efficiency and accuracy. Furthermore, the automated data acquisition process reduces human intervention, avoiding errors caused by physician fatigue or experience differences, and ensuring the accuracy and consistency of every measurement. Simultaneously, the system can correct the labeled data in real time, intelligently reporting abnormal dimensions to assist physicians in making corrections, further enhancing the reliability and standardization of diagnostic results. Therefore, this invention not only solves the problems of low efficiency and high error in traditional ultrasound measurement but also improves the overall accuracy and efficiency of cardiac ultrasound diagnosis, promoting the automation and intelligent development of cardiac ultrasound examinations. Attached Figure Description

[0030] Figure 1 A flowchart illustrating an automatic acquisition method for two-dimensional cardiac ultrasound section annotation data provided in one embodiment of this application;

[0031] Figure 2 This is a schematic diagram of two-dimensional cardiac ultrasound cross-section annotation provided in one embodiment of this application;

[0032] Figure 3 A flowchart illustrating an embodiment of the method for automatically obtaining dimension values ​​provided in this application;

[0033] Figure 4 This is a schematic diagram of an image showing the automatically obtained size values ​​provided in one embodiment of this application.

[0034] Figure 5 This is a schematic diagram of the size values ​​of an image automatically obtained according to an embodiment of this application;

[0035] Figure 6 A flowchart illustrating an embodiment of the method for automatically obtaining size names provided in this application;

[0036] Figure 7 This is a schematic diagram of chamber segmentation for an automatic acquisition method of two-dimensional cardiac ultrasound cross-sectional annotation data provided in one embodiment of this application;

[0037] Figure 8 A schematic diagram illustrating the overlap determination of an automatic acquisition method for two-dimensional cardiac ultrasound section annotation data provided in an embodiment of this application;

[0038] Figure 9 This is a schematic diagram illustrating the rectangular method for determining the major and minor axes in an automatic acquisition method for two-dimensional cardiac ultrasound section annotation data provided in one embodiment of this application. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0040] In one embodiment, such as Figure 1 As shown, an automatic acquisition method for two-dimensional cardiac ultrasound cross-sectional annotation data is provided, including the following steps:

[0041] The ultrasound cross-sectional image captured by the doctor is input into a trained size detection model and an auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image.

[0042] OCR technology is used to extract corresponding values ​​from the key dimension annotations, and the line segment lengths in the key dimension annotations are sorted. At the same time, based on the scale information in the image, the detected dimension annotations are converted from pixel units to actual physical dimensions and sorted.

[0043] Based on the sorting results, multiple sets of size information of the ultrasonic cross-section image are output, and a measurement report is generated.

[0044] In this embodiment, after converting the detected size annotations from pixel units to actual physical dimensions and sorting them, the process further includes:

[0045] The detected key dimension annotations are matched to ensure that each annotation corresponds correctly to the actual physical size, and the matching results are verified to check for errors or omissions.

[0046] In this embodiment, the training process of the trained size detection model includes:

[0047] Collect pre-annotated ultrasound image data, which covers various ultrasound examination scenarios, obtain ultrasound images annotated by doctors, the annotation content includes key dimension information, and preprocess the ultrasound image data, wherein the key dimension information includes: line segments, text regions, ellipses, straight lines and angles;

[0048] Detailed annotations are performed on the preprocessed ultrasound images, including endpoints, line segments, text regions, ellipses, lines, and angles.

[0049] The YOLOv11 model was used to train the recognition of the dimensions of the labeled ultrasound images. During the training process, the model parameters were optimized, and the trained model was evaluated using a validation set to check the model's ability to recognize different labeled content. Based on the evaluation results, the model parameters were adjusted or the training strategy was optimized.

[0050] In this embodiment, preprocessing the ultrasound image data includes: extracting images containing key size information from the ultrasound image data, preprocessing the images containing key size information to ensure consistent image quality, and converting the images into a uniform format and resolution.

[0051] In this embodiment, the auxiliary model includes an ultrasonic section classification model and an ultrasonic chamber segmentation model;

[0052] The ultrasound section classification model is used to automatically identify the section type of an ultrasound image;

[0053] The ultrasound chamber segmentation model is used to segment the chamber regions in the ultrasound image.

[0054] In this embodiment, the OCR technology uses a convolutional neural network model combined with a long short-term memory network structure for training, in order to improve the accuracy of extracting text region size data in images.

[0055] In this embodiment, the labeled size information included in the training dataset includes multiple size measurement labels of the heart chambers, including key dimensions such as the inner diameter and wall thickness of the ventricles and atria.

[0056] In this embodiment, the size annotation information output by the target detection model also includes a confidence score for the annotated region, which is used to represent the reliability of the detection result.

[0057] In one embodiment, an automatic acquisition system for two-dimensional cardiac ultrasound cross-sectional annotation data is provided, comprising:

[0058] The detection module is used to input the ultrasound cross-sectional image captured by the doctor into the trained size detection model and auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image.

[0059] Recognition module: Used to extract corresponding values ​​from the key dimension annotations using OCR technology, sort the line segment lengths in the key dimension annotations, and convert the detected dimension annotations from pixel units to actual physical dimensions and sort them according to the scale information in the image;

[0060] Output module: Used to output multiple sets of size information of the ultrasonic cross-section image according to the sorting results, and generate a measurement report.

[0061] The specific implementation details of each module can be found in the above description of the limitations of the automatic acquisition method for two-dimensional cardiac ultrasound cross-sectional annotation data, and will not be repeated here.

[0062] In one embodiment, an automatic size acquisition method for two-dimensional ultrasound sections is proposed, enabling size determination and numerical reading within a single image. In cardiac ultrasound diagnostic scenarios, sonographers typically take 30-50 measurements, of which approximately 20-30 are two-dimensional ultrasound measurements. Currently, there are no well-developed technologies for automatically matching the labeled dimensions and automatically reading their values. This invention, based on image recognition technology, can automatically detect key cardiac anatomical structures and accurately obtain the doctor's measurement results, improving measurement efficiency. Simultaneously, this method can run synchronously with the doctor's measurement process, providing intelligent measurement assistance. The system can automatically compare the doctor's annotation results, identify potential errors, and provide correction suggestions to ensure measurement accuracy and consistency. Furthermore, for abnormal dimensions, the system automatically alerts the doctor for verification and supports interactive adjustments to enhance the reliability of measurement results. This intelligent assistance method not only optimizes the clinical data acquisition process but also provides more efficient and accurate support for cardiac ultrasound diagnosis.

[0063] Current ultrasound AI technology primarily focuses on image classification, structural segmentation, and chamber identification, but lacks sufficient support for automating the measurement process. Doctors still need to manually mark measurement points, draw dimension lines, and input values. In particular, the doctor's measurement process is disconnected from AI analysis, and the system cannot synchronously correct errors or intelligently identify outliers. Realizing real-time reading and intelligent interaction of doctor's dimensional measurements based on existing image recognition technology, along with automatic report generation, represents a gap in current ultrasound AI applications.

[0064] This invention relates to the field of medical image analysis and intelligent measurement technology, specifically to an automatic acquisition method for two-dimensional cardiac ultrasound section annotation data. Based on image recognition technology, this method acquires dimensional data from the doctor's annotation process within a single ultrasound section, reducing the doctor's data entry work and improving the accuracy and efficiency of data acquisition. It is suitable for dimensional measurement and diagnostic assistance in freeze-frame examinations of continuous ultrasound video.

[0065] This embodiment mainly addresses two key technical issues in the automatic acquisition of two-dimensional cardiac ultrasound cross-sectional dimension data:

[0066] Automatic acquisition of dimensional values: Ultrasound images typically contain multiple dimensions that need to be labeled. Ensuring these dimensions accurately correspond to specific values ​​in a dimension table is essential. This invention employs target detection technology to detect the location of the labeled dimensions and the location of the dimension table. Dimension values ​​are obtained through OCR, and a sorting method is used to complete the dimensional value acquisition process.

[0067] Automatic size name acquisition: In traditional measurement processes, doctors rely on their experience to determine the dimensions to be measured, and the definitions of these dimensions depend on the specific cardiac chamber structure. This invention automatically identifies cardiac chamber structures in ultrasound images through section classification and chamber segmentation, and intelligently matches the dimensions to be measured based on the geometry of the chambers, thereby determining the specific measurement content and achieving standardized automatic size determination. Figure 2 , Figure 3 and Figure 4 As shown.

[0068] The first key technical issue mentioned above, the automatic acquisition of size values, includes the following three steps: Step 1: Train an object detection model to detect the acquired size information, including the rectangular bounding box and size label. Add all sizes, including the pixel length of the longer side of the rectangle, to list1; Step 2: Use OCR technology to recognize the contents of the size table and add the values ​​to list2; Step 3: Use a sorting algorithm to match sizes; Obtain labeled size information through the object detection model: Size information includes: the rectangular coordinates of the ruler, label name, and size table. First, train an object detection model for size; Second: In a normal doctor's ultrasound work scenario, extract the doctor's still image and use the object detection model to automatically recognize the size information in the ultrasound image. Calculate the length of the rectangle with line segment labels (edge) and add multiple length line segments to list1;

[0069] Using OCR to read dimension tables from images: OCR (Optical Character Recognition) technology is used to extract values ​​from the dimension table (box labels) of the target detection results. OCR can read dimension information from images, including numbers, units, and annotations. This technology can obtain values ​​from the ultrasound machine and add length values ​​(unit: mm) to list2.

[0070] Dimension length sorting and correspondence with the dimension table: All line segments in list1 are sorted according to the corresponding rectangle length, where the rectangle length is the pixel length of the rectangle. Simultaneously, the actual dimension values ​​in list2 are also sorted. This process ensures that all dimension annotations correspond accurately and that each annotated dimension corresponds one-to-one with the values ​​given by the ultrasonic machine. Figure 5 As shown.

[0071] The second key issue is the automatic acquisition of dimension names: using medical image classification and segmentation methods, the dimensions labeled by the doctor are assigned to various cavities on different sections, and then the specific dimension content is determined based on the geometry of the cavity. All dimensions uniquely correspond to a feature table, and each dimension must have three attributes: the section it belongs to, the cavity it belongs to, and the geometric orientation of the cavity. The automatic determination of dimension names consists of the following three key components: such as... Figure 6 As shown, the main function of the section classifier is to automatically classify different ultrasound section types based on the chambers and structures in the cardiac ultrasound image. Cardiac ultrasound images can present a variety of different sectional views, such as the four-chamber view, the left ventricular outflow island, and the right ventricular outflow tract. Each section contains different anatomical information; therefore, accurate section classification is fundamental to precisely acquiring specific dimensions. It can distribute a large number of dimensions across various sections, and matching candidate dimensions within each section reduces the difficulty of matching.

[0072] The section classifier uses image classification technology to divide input ultrasound images into different section categories. Based on a deep learning model, this classifier learns a large number of cardiac image section features during training, enabling it to accurately identify and classify different types of sections. For example, when the input image is a four-chamber view of the left ventricle, the section classifier can identify this section and label it as a four-chamber view. This classification process provides the foundation for subsequent chamber segmentation and keypoint recognition.

[0073] Chamber Segmentation Component: The core task of the chamber segmenter is to accurately segment the heart chambers in ultrasound images and extract the contour of each chamber. The heart has multiple chambers: the left ventricle, right ventricle, left atrium, and right atrium. The size, shape, and location of each chamber are crucial for assessing cardiac health.

[0074] The chamber segmenter employs advanced image segmentation techniques, particularly deep convolutional neural networks (ResNet), to automatically segment cardiac chambers in ultrasound images. This segmenter can identify the boundaries of each chamber and provide accurate regional information for the measurement of each chamber. For example, when segmenting the left ventricle, the segmenter can accurately delineate the inner and outer walls of the left ventricle, avoiding interference from other anatomical structures. The chamber segmenter can process complex ultrasound images, ensuring high accuracy and reliability in chamber segmentation, thus providing a basis for the extraction of specific dimensions. Figure 7 As shown, the overlap detection component matches the dimensional information annotated by the doctor with the chamber segmentation results, ensuring that the measured dimensions correspond to the correct cardiac chamber structure. Specifically, when the doctor annotates dimensions on the ultrasound image, the chamber segmenter automatically identifies the location of the annotated line segment and calculates its overlap with the chamber boundary. By comparing the matching of the annotated dimensions with the chamber contour, the system can accurately determine the chamber to which that dimension belongs, thereby achieving automatic classification and optimization of measurement data.

[0075] like Figure 8 As shown, the determination of geometric structure includes: in a single chamber structure, the dimensions that need to be measured are very few. The above process essentially completes the determination of most dimensions, especially for cases where a chamber has two dimensions, such as the major and minor axes. To accurately determine the dimensions, this invention uses the rectangular method or the aforementioned relative dimension method for differentiation:

[0076] Rectangular method: Based on the segmented contour of the chamber, fit the minimum bounding rectangle, and use its major and minor axes as the preliminary criteria for determining the major and minor axes, such as... Figure 9 As shown.

[0077] This embodiment provides an automatic size measurement method for cardiac ultrasound images, the core of which lies in the design and implementation of the size detection model and the involvement of the size location acquisition model. Specifically, it includes the following steps:

[0078] Data acquisition and preprocessing: Acquire ultrasound image data with doctor annotations, extract images containing key size information, and perform standardization processing.

[0079] Training of the size detection model: The YOLO11 model is used to identify and train the size annotations of doctors. The core goal is to accurately obtain the annotation endpoints and determine the size annotation pair to which the endpoints belong. The specific annotation content includes: endpoints, line segments, text regions, ellipses, lines, and angles.

[0080] Auxiliary model training: mainly for training ultrasonic section classification and ultrasonic chamber segmentation models.

[0081] Dimension detection of fixed-section: The trained model is used to automatically detect key dimensions in the image and convert them into actual physical dimensions by combining the scale bar to ensure measurement accuracy.

[0082] Measurement result output: Generates measurement reports and automatically enters the results into the system, reducing human transcription errors and improving diagnostic efficiency.

[0083] This embodiment includes a method for size correspondence of a single page: it includes a target detection model that detects all size positions and size labels marked by doctors; and it makes an ordered correspondence between the size pixel length and the real values ​​in the size table recognized by OCR.

[0084] Determining the size of content on a single page: Using a classification and segmentation model, the size is assigned to the chamber, and the size content is determined by the geometry or length of the chamber.

[0085] This embodiment is used for the automatic acquisition of annotation content of two-dimensional cardiac ultrasound fixed-frame sections; the automatic acquisition of measurement annotation of fixed-frame sections of ultrasound scenes; and the automatic data acquisition of manual annotation of medical images in dynamic and static frames.

[0086] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for automatically acquiring two-dimensional cardiac ultrasound cross-sectional annotation data, characterized in that, The method comprises: The ultrasound cross-sectional image captured by the doctor is input into a trained size detection model and an auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image. OCR technology is used to extract corresponding values ​​from the key dimension annotations, and the line segment lengths in the key dimension annotations are sorted. At the same time, based on the scale information in the image, the detected dimension annotations are converted from pixel units to actual physical dimensions and sorted. Based on the sorting results, multiple sets of size information of the ultrasonic cross-section image are output, and a measurement report is generated.

2. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 1, characterized in that, After converting the detected dimension annotations from pixels to actual physical dimensions and sorting them, the process also includes: The detected key dimension annotations are matched to ensure that each annotation corresponds correctly to the actual physical size, and the matching results are verified to check for errors or omissions.

3. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 1, characterized in that, The training process of the trained size detection model includes: Collect pre-annotated ultrasound image data, which covers various ultrasound examination scenarios, obtain ultrasound images annotated by doctors, the annotation content includes key dimension information, and preprocess the ultrasound image data, wherein the key dimension information includes: line segments, text regions, ellipses, straight lines and angles; Detailed annotations are performed on the preprocessed ultrasound images, including endpoints, line segments, text regions, ellipses, lines, and angles. The YOLOv11 model was used to train the recognition of the dimensions of the labeled ultrasound images. During the training process, the model parameters were optimized, and the trained model was evaluated using a validation set to check the model's ability to recognize different labeled content. Based on the evaluation results, the model parameters were adjusted or the training strategy was optimized.

4. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 3, characterized in that, Preprocessing the ultrasound image data includes: extracting images containing key size information from the ultrasound image data, preprocessing the images containing key size information to ensure consistent image quality, and converting the images into a uniform format and resolution.

5. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 1, characterized in that, The auxiliary models include an ultrasonic section classification model and an ultrasonic chamber segmentation model; The ultrasound section classification model is used to automatically identify the section type of an ultrasound image; The ultrasound chamber segmentation model is used to segment the chamber regions in the ultrasound image.

6. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 1, characterized in that, The OCR technology uses a convolutional neural network model combined with a long short-term memory network structure for training, in order to improve the accuracy of extracting text region size data in images.

7. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 3, characterized in that, The training dataset contains labeled dimensional information including multiple dimensional measurements of the heart chambers, including key dimensions such as the inner diameter and wall thickness of the ventricles and atria.

8. The automatic acquisition method for two-dimensional cardiac ultrasound section annotation data according to claim 1, characterized in that, The size annotation information output by the target detection model also includes a confidence score for the annotated region, which is used to indicate the reliability of the detection results.

9. An automatic data acquisition system for two-dimensional cardiac ultrasound cross-sectional annotation, characterized in that, include: The detection module is used to input the ultrasound cross-sectional image captured by the doctor into the trained size detection model and auxiliary model. The size detection model outputs key size annotations in the ultrasound cross-sectional image, including endpoints, line segments, text regions, ellipses, lines, and angles. The auxiliary model outputs the cross-section, chamber, and geometric orientation of the chamber containing the key dimensions in the ultrasound cross-sectional image. Recognition module: Used to extract corresponding values ​​from the key dimension annotations using OCR technology, sort the line segment lengths in the key dimension annotations, and convert the detected dimension annotations from pixel units to actual physical dimensions and sort them according to the scale information in the image; Output module: Used to output multiple sets of size information of the ultrasonic cross-section image according to the sorting results, and generate a measurement report.

Citation Information

Patent Citations

  • Processing method and device for measuring feature size based on cardiac ultrasound video

    CN115775233A

  • Ultrasonic measurement quality control method and equipment

    CN116236225A

  • Cardiac ultrasonic data detection method and device, ultrasonic equipment and storage medium

    CN116687446A

  • Automatic measuring method, device and equipment for aortic sinus root and storage medium

    CN118096650A

  • Image data inspection method and apparatus, computer device, and storage medium

    US20220233160A1