Ultrasound imaging systems and related workflow systems and methods

Abstract

The application discloses a section processing method and an ultrasound imaging workflow system. The method comprises an automatic identification of section type step and an automatic matching association step. By automatically identifying ultrasound image data, determining the section type corresponding to the ultrasound image, and matching the section type of the ultrasound image with the section in the automatic workflow protocol, the doctor's operation of selecting and starting the section and frame selection can be reduced, and the work efficiency is improved. In addition, the doctor can also retain his own scanning habits without being affected by the automatic workflow process, which is more humanized. An embodiment also automatically adds a body position map, annotations, and performs automatic measurement on the matched ultrasound section, and stores the image to the corresponding standard section in the automatic workflow, thereby reducing the doctor's measurement and image storage operations, and further improving the work efficiency.

Description

Technical Field

[0001] This application relates to the field of medical ultrasound imaging, and more particularly to an ultrasound imaging system and method, as well as an ultrasound imaging workflow system and a section processing method in the ultrasound imaging workflow. Background Technology

[0002] With the release of various ultrasound examination guidelines and standards, doctors are required to complete a series of standard scans for diagnostic purposes during all types of examinations. Automated ultrasound workflows, by providing template protocols, organize relevant scans in a specific order or format, with some tasks completed automatically by the system. This improves doctors' work efficiency and standardizes their operating procedures.

[0003] Current automated ultrasonic workflow systems, such as Figure 1 As shown, the automated workflow pre-sets a set of standard sections that doctors need to scan. Initially, these sections are represented by section icons. During the scan, the doctor scans the standard sections one by one according to the pre-set order in the automated workflow, or scans the standard sections out of order according to the patient's condition or their own habits. After scanning a standard section, the doctor needs to actively freeze the image, select the section from the video, measure, and save the image. After saving the image, the section is marked as completed. At the same time, the system automatically unfreezes the image after saving to facilitate the doctor's scanning of the next section.

[0004] However, current automated ultrasonic workflow systems have the following problems:

[0005] 1) If the scanning sequence is not followed according to the automatic workflow, the doctor needs to manually match the currently scanned section with the preset section in the automatic workflow, which increases the workload.

[0006] 2) For each incision, the doctor needs to manually move the trackball to find the most ideal incision image from multiple frames of video images;

[0007] 3) When it is necessary to perform continuous or comparative scanning of relevant sections, there may be multiple standard sections at the same time. According to the existing automatic ultrasound workflow system, the image is automatically unfrozen after saving only one section, so the remaining sections need to be scanned one by one, which is time-consuming and laborious.

[0008] These are the issues that need to be addressed and resolved to further improve doctors' work efficiency and maintain their diagnostic habits. For emergency room doctors, who deal with emergencies, it is even more crucial to assess patients' conditions as quickly as possible to provide guidance on the next steps in treatment. Therefore, for ultrasound doctors and emergency room doctors using automated workflows, a more intelligent and efficient workflow is needed to cope with the heavy and urgent daily workload. Summary of the Invention

[0009] In one embodiment, a method for section processing of an ultrasound imaging workflow is provided, the method comprising:

[0010] acquiring ultrasound image data, wherein the ultrasound image data comprises a single frame of ultrasound image or comprises a sequence of ultrasound images;

[0011] automatically identifying a section type of the single frame of ultrasound image or automatically identifying a section type of the sequence of ultrasound images;

[0012] automatically associating the single frame of ultrasound image to a corresponding standard section in a workflow protocol as a corresponding ultrasound section image according to the identified section type of the single frame of ultrasound image, or automatically matching each frame of ultrasound image in the sequence of ultrasound images to the corresponding standard section in the workflow protocol, selecting the ultrasound image with the highest matching degree to automatically associate to the corresponding standard section in the workflow protocol as the corresponding ultrasound section image according to the identified section type of the sequence of ultrasound images; wherein the workflow protocol comprises a preset group of standard sections.

[0013] In one embodiment, the workflow protocol further comprises a predefined operation for each standard section, the operation comprising at least one of adding an annotation, measuring, adding a body position map, adding a probe marker, storing; the method further comprises automatically performing the corresponding operation on the ultrasound section image according to the predefined operation of the workflow protocol.

[0014] In one embodiment, the method further comprises providing a human-machine interaction interface, the human-machine interaction interface presenting at least one of the following information: the ultrasound image data, the ultrasound section image, relevant information of the workflow protocol.

[0015] In one embodiment, the method further comprises receiving an input signal through the human-machine interaction interface, the input signal being used to represent a confirmation or denial of the ultrasound section image.

[0016] In one embodiment, the method further comprises providing a playback selection control on the human-machine interaction interface to play back the sequence of ultrasound images and / or to re-determine the ultrasound section image for each frame of ultrasound image played back.

[0017] In one embodiment, the method further comprises providing a matching control on the human-machine interaction interface to match the selected ultrasound image that is possibly missed to identify the section type of the ultrasound image that is possibly missed.

[0018] In one embodiment, the method further comprises: receiving at least one selected frame of ultrasound image from the played back sequence of ultrasound images, and automatically associating, by the matching control, the at least one selected frame of ultrasound image to a corresponding standard section in the workflow protocol as the ultrasound section image corresponding to the corresponding standard section.

[0019] In one embodiment, the workflow protocol further comprises various types of section features pre-stored in a database; and the step of automatically identifying the section type of the sequence of ultrasound images comprises:

[0020] performing feature extraction on each frame of ultrasound image in the sequence of ultrasound images;

[0021] classifying the extracted features corresponding to the each frame of ultrasound image according to the various types of section features, thereby determining the section type of the each frame of ultrasound image.

[0022] In one embodiment, the feature extraction method comprises a feature extraction method of conventional digital image processing or a deep learning method; and the classification comprises classifying the each frame of ultrasound image using a pattern recognition algorithm and determining the section type to which the each frame of ultrasound image belongs and / or the probability of belonging to the section type.

[0023] In one embodiment, the step of automatically associating the single frame of ultrasound image to a corresponding standard section in the workflow protocol as the ultrasound section image corresponding to the corresponding standard section comprises: searching for the corresponding standard section in the workflow protocol according to the identified section type of the single frame of ultrasound image, and automatically determining the single frame of ultrasound image as the ultrasound section image corresponding to the standard section.

[0024] In one embodiment, obtaining the ultrasound image data comprises:

[0025] transmitting an ultrasound wave to a target to be detected, receiving an ultrasound echo of the ultrasound wave returned from the target to be detected, obtaining an ultrasound echo signal, performing beamforming and signal processing on the ultrasound echo signal to obtain the ultrasound image data; or

[0026] importing the ultrasound image data.

[0027] In one embodiment, an ultrasound imaging method is provided, the method comprising:

[0028] transmitting an ultrasound wave to a target to be detected, and receiving an ultrasound echo of the ultrasound wave returned from the target to be detected to obtain an ultrasound echo signal;

[0029] obtaining an ultrasound image according to the ultrasound echo signal;

[0030] determining a section type to which the ultrasound image belongs;

[0031] determine a target standard cut plane from standard cut planes included in a workflow protocol according to the cut plane type;

[0032] associate the target standard cut plane with the ultrasound image.

[0033] In one embodiment, the method further comprises: if the target standard cut plane is not identified from the standard cut planes included in the workflow protocol according to the cut plane type, returning a matching failure.

[0034] In one embodiment, an ultrasound imaging workflow system is provided, the system comprising a workflow processor and a display, wherein:

[0035] the workflow processor is configured to:

[0036] acquire ultrasound image data, wherein the ultrasound image data comprises a single frame of ultrasound image or comprises a sequence of ultrasound images;

[0037] automatically identify a cut plane type of the single frame of ultrasound image or automatically identify a cut plane type of the sequence of ultrasound images;

[0038] automatically associate the single frame of ultrasound image to a corresponding standard cut plane in a workflow protocol as an ultrasound cut plane image corresponding to the corresponding standard cut plane according to the identified cut plane type of the single frame of ultrasound image, or automatically match each frame of ultrasound image in the sequence of ultrasound images with a corresponding standard cut plane in the workflow protocol, select an ultrasound image with the highest matching degree and automatically associate the ultrasound image to the corresponding standard cut plane in the workflow protocol as an ultrasound cut plane image corresponding to the corresponding standard cut plane according to the identified cut plane type of the sequence of ultrasound images; wherein the workflow protocol comprises a preset set of standard cut planes;

[0039] the display is configured to display a human-machine interface, the human-machine interface comprising at least one of the ultrasound image data, the ultrasound cut plane image and information of the workflow protocol.

[0040] In one embodiment, the system further comprises:

[0041] an ultrasound probe,

[0042] transmitting and receiving circuitry configured to excite the ultrasound probe to transmit ultrasound waves to a target to be detected, and receive ultrasound echoes returned from the target to be detected and form echo signals;

[0043] a beamforming and signal processing module configured to perform beamforming and signal processing on the echo signals to obtain the ultrasound image data, the ultrasound image data comprising at least one frame of ultrasound image.

[0044] In one embodiment, a matching control is provided on the human-machine interface for matching the selected possibly-missed-identified ultrasound image, and identifying the section type of the possibly-missed-identified ultrasound image.

[0045] In one embodiment, a freeze image control is provided on the human-machine interface, and the ultrasound section image is frozen or unfrozen by triggering the freeze image control.

[0046] In one embodiment, an ultrasound imaging system is provided, and the system comprises:

[0047] an ultrasound probe,

[0048] transmitting and receiving circuitry for exciting the ultrasound probe to transmit ultrasound waves to a target to be detected, receiving ultrasound echoes of the ultrasound waves returned from the target to be detected, and obtaining ultrasound echo signals;

[0049] a processor for obtaining an ultrasound image according to the ultrasound echo signals, determining a section type to which the ultrasound image belongs, determining a target standard section from standard sections included in a workflow protocol according to the section type, and associating the target standard section with the ultrasound image;

[0050] a display for displaying the ultrasound image.

[0051] In one embodiment, a readable storage medium is provided, and the readable storage medium stores a computer program which, when executed, implements the steps of any of the foregoing methods.

[0052] The present application has the following beneficial effects: by automatically identifying ultrasound image data, determining the section type corresponding to the ultrasound image, and matching the section type of the ultrasound image with the sections in the protocol in the automatic workflow, the doctor can be relieved of the operations of selecting and starting a section and frame selection, and thus the work efficiency is improved. In addition, the doctor can also retain his / her own scanning habits and is almost not affected by the process of the automatic workflow, and is more humanized. In one embodiment, the matched ultrasound section is automatically added with a body position map, annotations, and automatic measurement, and the image is stored in the automatic workflow at the preset corresponding standard section, and thus the doctor is relieved of the operations of measurement and image storage, and the work efficiency is further improved. BRIEF DESCRIPTION OF DRAWINGS

[0053] Figure 1 is a schematic diagram of a current ultrasound automatic workflow system;

[0054] Figure 2 is a schematic diagram of an ultrasound imaging workflow system according to one embodiment of the present application;

[0055] Figure 3 is a schematic diagram of an ultrasound imaging workflow system according to another embodiment of the present application;

[0056] Figure 4 is a schematic diagram of an ultrasound imaging workflow system according to another embodiment of the present application;

[0057] Figure 5 is a schematic diagram of an ultrasound imaging workflow system according to another embodiment of the present application;

[0058] Figure 6 is a schematic diagram of an ultrasound imaging workflow according to an embodiment of the present application;

[0059] Figure 7 is a schematic diagram of an ultrasound imaging workflow according to another embodiment of the present application;

[0060] Figure 8 is a schematic diagram of an ultrasound imaging workflow according to another embodiment of the present application;

[0061] Figure 9 is a schematic diagram of an ultrasound imaging workflow according to another embodiment of the present application;

[0062] Figure 10 is a schematic diagram of an ultrasound imaging system according to an embodiment of the present application;

[0063] Figure 11 is a schematic diagram of an ultrasound imaging method according to an embodiment of the present application. DETAILED DESCRIPTION

[0064] The application will be further described with reference to the drawings, in which like elements are referred to with like reference numerals, and additional reference numerals are used to illustrate additional aspects of the application. The various embodiments of the application are described in detail below. The description is made in connection with the drawings, wherein like numerals designate similar elements throughout the several views. In the following description, numerous specific details are described to provide a thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present application can be practiced without these specific details. In other instances, well-known methods have not been described in detail, so as not to unnecessarily obscure the present application. In the following description, numerous specific details are described to provide a thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present application can be practiced without these specific details. In other instances, well-known methods have not been described in detail, so as not to unnecessarily obscure the present application.

[0065] In addition, the features, operations, or steps described herein can be combined in any suitable manner in various embodiments. Also, the various steps or actions described herein can be performed in any suitable order, unless otherwise specified. Thus, the various sequences and / or orderings of steps is illustrative only and the order of any sequence should not be construed as a requirement or limitation unless expressly stated to be an order dependent step.

[0066] The serial numbers assigned to components in this document, such as "first" and "second," are used only to distinguish the described objects and have no sequential or technical meaning. The terms "connection" and "linkage" used in this application, unless otherwise specified, include both direct and indirect connections (linkages).

[0067] One embodiment of this application provides an ultrasound imaging method and system, which relates to the section processing of the ultrasound imaging workflow. In this method, the content of the doctor's scanned image is intelligently identified to determine the section type corresponding to the current image. The current image is matched with sections in the protocol of the automated workflow. Position diagrams, annotations, and automatic measurements are automatically added to the matched sections, and the image is stored at the corresponding preset standard section in the automated workflow. This solution reduces almost all operations for doctors, such as selecting and initiating sections, selecting frames, measuring, and saving images, significantly improving work efficiency. Furthermore, this application allows doctors to retain their previous scanning habits, remaining almost unaffected by the automated workflow, making it more user-friendly.

[0068] In the ultrasound imaging method or system of this application embodiment, the section processing in the ultrasound imaging workflow is performed on ultrasound images or ultrasound image sequences. The acquisition of ultrasound images or ultrasound image sequences can be achieved in various ways, such as through real-time ultrasound scanning or by importing. For importing, for example, image data can be imported using a CD, a USB flash drive, or received from a network, etc. This invention does not limit the scope of the method. The following description uses an ultrasound image sequence as an example. An ultrasound image sequence includes multiple ultrasound images, and a single ultrasound image can be considered a special case of multiple frames.

[0069] An embodiment of this application obtains an ultrasound image sequence through real-time ultrasound scanning imaging. For example... Figure 2As shown, the ultrasound imaging workflow system 10 of an embodiment of the present application comprises an ultrasound probe 110, a transmitting and receiving circuit 111, a beamforming and signal processing module 120, a workflow processor 130 and a display 140. In one specific implementation of the illustrated embodiment, a set of pulses focused by delay are transmitted to the ultrasound probe 110 by the transmitting and receiving circuit 111, the ultrasound probe 111 emits ultrasound waves to the target to be detected, and the transmitting and receiving circuit 111 receives the ultrasound echoes reflected back from the target to be detected after a certain delay to form echo signals; the echo signals enter the beamforming and signal processing module 120 to complete the focusing delay, weighting and channel summation and signal processing to obtain a real-time ultrasound image sequence; the workflow processor 130 classifies the current acquired ultrasound image sequence in combination with a database (which can be a pre-collected image gallery information of automatic workflow, such as a preset set of standard sections) to determine the section type corresponding to the current acquired ultrasound image sequence, and matches the section type with the standard sections of the preset automatic workflow protocol to output the ultrasound image with the highest matching degree as the ultrasound section image, and these ultrasound image sequences and corresponding ultrasound section images can be displayed on the display 140 or stored in a storage (not shown in the figure).

[0070] In the embodiment of the present application, the display 140 of the aforementioned ultrasound imaging workflow system 10 can be a touch display screen, a liquid crystal display screen, etc., or can be a liquid crystal display, a television set, etc. independent display device independent of the ultrasound imaging workflow system 10, or can be a display screen on a mobile phone, a tablet computer, etc. electronic device. In addition, in the embodiment of the present application, the storage of the aforementioned ultrasound imaging workflow system 10 can be a flash memory card, a solid state storage, a hard disk, etc.

[0071] Figure 2 In another specific implementation of the illustrated embodiment, as shown, Figure 3 The ultrasound imaging workflow system 10 can further comprise a matching result processing module for automatically performing corresponding operations on the matched ultrasound section image according to the preset annotations, body position maps, measurements and image storage operations, etc. in the preset automatic workflow protocol.

[0072] Figure 4 The ultrasound imaging workflow system 10 of another embodiment of the present application is shown, which is different from Figure 2 in that a human-computer interaction interface is provided to interact with the user for feedback, for example, after image matching, the matching result can be output on the display 140 for the user to confirm, and each obtained confirmed image can be matched and associated to the preset standard section of the automatic workflow protocol, and the confirmed image is the ultrasound section image. Figure 4 Another variant of Figure 5 is shown, which is different from Figure 4The difference is that the matching associated ultrasound image or image sequence is automatically operated according to the preset annotation, body position map, measurement and image storage and other operations in the automatic workflow protocol.

[0073] The ultrasound imaging method in the present application is described in detail below. The section processing method of the ultrasound imaging workflow provided in an embodiment of the present application is applied to the ultrasound imaging workflow system 10, and is particularly suitable for the ultrasound imaging workflow system 10 containing a touch display screen, and can utilize the contact touch display screen to input the touch screen operation.

[0074] Referring to Figure 6 The section processing method of the ultrasound imaging workflow in an embodiment of the present application includes steps S20 and S40.

[0075] Step S20: automatically identifying the section type, including: in the case of single-frame ultrasound image data, automatically identifying the section type of the single-frame ultrasound image, and in the case of ultrasound image sequence data, automatically identifying the section type of the ultrasound image sequence.

[0076] In step S20, the common classification recognition method is to combine the database and use the machine learning method to learn, which can distinguish the features or rules of different section categories, and then classify and recognize the input image according to the learned features or rules. Generally, step S20 can include a database construction step and a recognition step.

[0077] In the database construction step, the database can be composed of a large number of samples. In the specific implementation, for the case of using the full supervision learning method, each sample is composed of a section image and the section category corresponding to the image; and for the case of using the semi-supervised learning method, a part of the samples are composed of the section image and the section category corresponding to the image, and the other part of the samples only have the image without the label of the section category corresponding to the image. Of course, the samples suitable for the full supervision learning method and the semi-supervised learning method can also be stored in the database at the same time.

[0078] In the recognition step, the machine learning algorithm is designed to learn the features or rules that can distinguish different section categories in the database, so as to realize the recognition of the image. The image recognition step of an embodiment includes a feature extraction sub-step and a classification judgment sub-step.

[0079] In the feature extraction sub-step, the feature extraction method can be a conventional digital image processing feature extraction method, such as a PCA (Principal Component Analysis) algorithm, an LDA (Linear Discriminant Analysis) algorithm, a Harr feature, a texture feature, etc. The feature extraction method can also use a deep learning method to learn the features of the constructed database by stacking convolutional layers, pooling layers, activation layers, and fully connected layers; commonly used deep learning networks include CNN (Convolutional Neural Networks), ResNet (Residual Network), MobileNet light-weight convolutional neural network, VGG convolutional neural network, Inception network, DenseNet network, etc.

[0080] In the classification and judgment sub-step, the features in the database are combined to use a KNN (K-Nearest Neighbor) classification algorithm, a SVM (Support Vector Machine) algorithm, a random forest, a neural network, etc. to classify the extracted features to determine which standard section the current processed ultrasound image belongs to and / or the probability of belonging to the standard section. Generally, through the classification and judgment sub-step, the probability of the current image belonging to each section category can be output.

[0081] Step S40: automatic association and matching, including automatically associating a single-frame ultrasound image with a corresponding standard section in an automatic workflow protocol to obtain an ultrasound section image when the section type of the single-frame ultrasound image is identified, and automatically matching each frame of ultrasound image in an ultrasound image sequence with a corresponding standard section in an automatic workflow protocol to select the ultrasound image with the highest matching degree as an ultrasound section image when the section type of the ultrasound sequence is identified, wherein the automatic workflow protocol includes a preset set of standard sections.

[0082] In step S40, the current identified ultrasound image is associated with the corresponding standard section in the automatic workflow protocol. Specifically, if the identified ultrasound image belongs to the standard section in the automatic workflow protocol, the ultrasound image is matched with the standard section in the automatic workflow protocol.

[0083] For an ultrasound image sequence, the contents of adjacent frames are generally similar, and after step S20, they are usually classified as the same section type, so the frame of ultrasound image with the highest matching degree can be automatically selected as the ultrasound section image, and the user does not need to manually select the frame, which can be presented on the human-computer interaction interface.

[0084] For the ultrasound image sequence, there can be multiple types of sections at the same time, for example, when scanning the fetal head, moving the ultrasound probe can obtain cerebellum section, thalamus section and lateral ventricle section at the same time, therefore, these section types can be identified through step S20, and then these sections can be displayed to the doctor in turn for confirmation. In the above single frame or multiple frame case, if the identified ultrasound image does not belong to the standard section in the automatic workflow protocol, it returns to the matching failure.

[0085] Referring to Figure 7 The section processing method of the ultrasound imaging workflow of another embodiment of the present application further includes step S41: automatically performing corresponding operations on the ultrasound section image according to the pre-defined operations of the automatic workflow protocol, in addition to steps S20 and S40. The pre-defined operations of the automatic workflow protocol include at least one of adding annotations, automatic or manual measurement, adding body position map, adding probe marker, storing images and labeled information, etc. That is, after image matching, the system can store images, add annotations, add body position map and probe marker, and automatically or manually measure according to the requirements of the ultrasound section image in the automatic workflow protocol. The above operations can be pre-set, and after the corresponding section is identified, the system automatically retrieves and automatically completes, solving the demand for automation in the application of doctors.

[0086] Since there is a certain probability of recognition error in automatic recognition of section type, after the matching and association of step S40, an association confirmation link can be set to confirm the association result by the user. Referring to Figure 8 The section processing method of the ultrasound imaging workflow of another embodiment of the present application further includes the related steps of step S61 branch and / or the related steps of step S62 branch, in addition to steps S20 and S40.

[0087] In step S61, the input function and the playback selection function are provided on the human-computer interaction interface. Through the input function, the human-computer interaction interface receives an input signal representing the user's confirmation or denial of the ultrasound section image output in step S40, from which the accuracy of the matching can be known. Through the playback selection function, the ultrasound image sequence can be played back and / or the ultrasound section image can be reselected for each frame of the ultrasound image played back. That is, through the input function and the playback selection function, it can be determined whether the user is satisfied with the ultrasound section image output in step S40. If the user is not satisfied with the current matching result, if the user believes that there are other images in the current processed video of multiple frames of ultrasound images that have better matching effects with the section, the user can directly manually play back the movie (i.e., the video) to find. In a specific implementation, the playback selection function can be presented to the user through a control (referred to as a playback selection control) provided on the human-computer interaction interface. The control can be implemented in the form of a button, a menu item, etc. The input function can also be implemented in the form of a trackball, a mouse, a keyboard, etc. to check, frame, and confirm the ultrasound section image presented on the display.

[0088] In step S62, the matching function is provided on the human-computer interaction interface to match the selected ultrasound image that can be missed to identify and identify the section type of the ultrasound image that can be missed to identify. In a specific implementation, the matching function implemented in the form of a control (such as a button) is provided on the human-computer interaction interface for the user to select the ultrasound image that the user believes can be missed to identify. That is, if the user is not satisfied with the current matching result, if the user believes that there is a section in the current multiple frames of images that can be matched with the section but is not identified by the system, the user can play back the multiple frames of video to the image and click the corresponding standard section icon (the standard section icon is one of a group of icons presented on the human-computer interaction interface, and the group of icons corresponds to a group of standard sections preset in the automatic workflow protocol) to perform matching, or the user can first click the standard section icon and then play back the image to perform matching. In an example, when the user clicks the ultrasound section image that is not completed, the ultrasound section image is stored, and the ultrasound section image can be marked as a completed state. When the user clicks the ultrasound section image that is completed, a new ultrasound section image is automatically copied and displayed on the display after the ultrasound section image is stored.

[0089] For example, the user collects a transparent septum image, identifies that the current image is a transparent septum image through step S20, and matches and associates the image with the transparent septum section in the automatic workflow protocol through step S40. Subsequently, in an embodiment, as shown in FIG. 6, the user can click the transparent septum icon in the standard section icon group to perform matching on the current image. In another embodiment, as shown in FIG. 7, the user can click the transparent septum icon in the standard section icon group to perform matching on the current image, and then click the transparent septum icon in the standard section icon group to perform matching on the current image. Figure 8As shown, according to the requirements for the transparent cavity cross-section in the automated workflow protocol, operations such as annotation, measurement, and adding body position diagrams are performed in the image area. Then, the user confirms whether the matching association is accurate. If the user confirms the association is accurate, the image can be saved directly or after measurement. In another embodiment, such as... Figure 9 As shown, the user first confirms whether the matching association is accurate. If the user confirms that the association is accurate, then according to the requirements for the transparent cavity section in the automatic workflow protocol, operations such as annotation, measurement, and adding body position diagrams are performed in the image area, and then the image is saved.

[0090] In the foregoing embodiments of this application, a freeze image control can also be provided on the human-computer interaction interface. Freezing and thawing of the ultrasound section image can only be achieved by triggering this freeze image control. In the frozen state, clicking controls such as the section button or save image on the human-computer interaction interface will not thaw the image; the image remains frozen. Clicking the section button or similar controls will only display preset annotations and positional diagrams on the currently frozen image. The image will only thaw if the user clicks the freeze image control again. This allows users to adjust and select the ultrasound section image they deem more suitable, supporting multiple matchings of relevant standard sections and ultrasound image sequences according to the automatic workflow protocol, ensuring that the ultrasound images scanned by the user are used to their fullest potential.

[0091] In addition, such as Figure 10 As shown, one embodiment of this application also provides an ultrasound imaging system 20, which includes an ultrasound probe 210, a transmitting and receiving circuit 220, a processor 230, and a display 240. In the ultrasound imaging system 20, the transmitting and receiving circuit 220 can excite the ultrasound probe 210 to emit ultrasound waves toward the target to be detected, and receive the ultrasound echoes returned from the target to obtain ultrasound echo signals. The processor 230 can obtain at least one frame of ultrasound image based on the ultrasound echo signals, determine the section type to which the at least one frame of ultrasound image belongs, determine at least one target standard section from the standard sections included in the automated workflow protocol according to the section type, associate the at least one target standard section with the at least one frame of ultrasound image, and the display 240 can display the at least one frame of ultrasound image. The implementation of each component can refer to the relevant content involved in the aforementioned ultrasound imaging workflow system and its section processing method, and will not be described in detail here.

[0092] based on Figure 10 The ultrasound imaging system shown in this application, in one embodiment, also provides an ultrasound imaging method, such as... Figure 11 As shown, it includes the following steps S100-S108.

[0093] Step S100: Emit ultrasonic waves to the target to be detected and receive the ultrasonic echo returned by the target to obtain the ultrasonic echo signal;

[0094] Step S102: obtaining at least one frame of ultrasound image according to the ultrasound echo signal;

[0095] Step S104: determining the type of the section to which the at least one frame of ultrasound image belongs;

[0096] Step S106: determining at least one target standard section from the standard sections included in the automatic workflow protocol according to the type of the section;

[0097] Step S108: associating the at least one target standard section with the at least one frame of ultrasound image.

[0098] The implementation of steps S100 to S106 can refer to the related content involved in the aforementioned ultrasound imaging workflow system and the section processing method thereof.

[0099] In step S108, if the ultrasound image obtained in step S102 is a single frame of ultrasound image, it is automatically associated to the corresponding standard section (i.e. the target standard section) in the preset group of standard sections in the automatic workflow protocol. The specific implementation of the association can be achieved by means such as feature extraction and image matching as described above. If the ultrasound image obtained in step S102 is a plurality of frames of ultrasound image, the following situations can exist:

[0100] (1) If the plurality of frames of ultrasound image are similar and are identified as the same type of section, the frame of ultrasound image with the highest matching degree can be automatically selected and automatically associated to the target standard section;

[0101] (2) If the plurality of frames of ultrasound image are identified as sections of multiple types, the plurality of frames of ultrasound image are automatically associated to the corresponding standard sections;

[0102] (3) If the plurality of frames of ultrasound image are identified as sections of multiple types, and some of the frames of ultrasound image are identified as the same type of section A, for the frames of ultrasound image identified as the same type of section A, the frame of ultrasound image with the highest matching degree can be automatically selected and associated to the section A according to (1), and the remaining frames are automatically associated according to (2);

[0103] (4) If the plurality of frames of ultrasound image are identified as sections of multiple types, the user can be prompted to confirm and manually associate.

[0104] If the identified ultrasound image does not belong to the standard section in the automatic workflow protocol, it is returned as a matching failure.

[0105] Compared with the existing automatic workflow of ultrasound, the method and system provided in the embodiments of the present application save the time of repeated scanning and matching images, significantly reduce the operation of the ultrasound equipment by the doctor, greatly improve the work efficiency, shorten the examination time, and are more humanized, and fully respect the scanning habits of the user. The embodiments of the present application further provide a computer readable storage medium, the computer readable storage medium stores a plurality of program instructions, after the plurality of program instructions are called and executed by the workflow processor 130 or the processor 230, some steps or all steps or any combination of steps in the automatic processing method of the section of the ultrasound imaging workflow in the embodiments of the present application can be executed. In one embodiment, the computer readable storage medium can be the aforementioned memory, which can be a flash card, a solid state memory, a hard disk, or the like nonvolatile storage medium.

[0106] In the embodiments of the present application, the workflow processor 130 of the aforementioned ultrasound imaging workflow system 10 and the processor 230 of the ultrasound imaging system 20 can be implemented by software, hardware, firmware or a combination thereof, and can use a circuit, a single or multiple application specific integrated circuits (ASIC), a single or multiple general purpose integrated circuits, a single or multiple microprocessors, a single or multiple programmable logic devices, or a combination of the aforementioned circuits or devices, or other suitable circuits or devices, so that the processor 105 can execute the corresponding steps of the automatic processing method of the section of the ultrasound imaging workflow in the aforementioned various embodiments.

[0107] Various exemplary embodiments are described herein with reference to a particular aspect. Those having ordinary skill in the art will appreciate, however, that changes and modifications can be made thereto without departing from the scope thereof. For example, various operational steps and components used to effect the operational steps can be implemented in different manners depending on a particular application or any number of cost functions associated with implementing the system.

[0108] Additionally, as will be appreciated by those skilled in the art, the principles described herein can be reflected in a computer program product having a computer-readable medium pre-loaded with computer-readable program code. Any tangible, non-transitory computer-readable storage medium can be used, including magnetic storage devices (hard disk; floppy disk, etc.), optical storage devices (CD-ROM; DVD; Blu Ray disc, etc.), flash memory, and / or the like. These computer program instructions can be loaded onto a general purpose computer, a special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions that execute on the computer or other programmable data processing apparatus create means for implementing the functions specified. These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including an implementation to

[0109] While the principles described herein have been illustrated in various embodiments, many modifications, adaptations, and variations can be made to the structures, arrangements, proportions, elements, materials, and components described and illustrated without departing from the principles of the present disclosure. Such modifications and variations are considered to be within the scope of the disclosure.

[0110] The foregoing detailed description has been described with reference to various examples. However, one of ordinary skill in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Accordingly, the description of the present disclosure is to be taken in an illustrative, and not a limiting sense. All modifications and changes are intended to be included within the scope of the present disclosure. Also, the advantages, other advantages, and solutions to problems have been described above with regard to various embodiments. However, the benefits, advantages, solutions to problems and any element(s) that can cause any of such should not be construed as critical, required or essential. The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Also, the use of the term "coupled" and any variations thereof are intended to refer to a direct or indirect connection, an electrical connection, a magnetic connection, an optical connection, a communicative connection, a functional connection, and / or any other connection.

[0111] Those skilled in the art will recognize that many modifications can be made to the details of the above-described embodiments without departing from the underlying principles of the present application. The scope of the present application should, therefore, be determined only by the following claims.

Claims

1. A method for cross-sectional processing in an ultrasonic imaging workflow, characterized in that, include: Acquire ultrasound image data, which includes a single frame ultrasound image or a sequence of ultrasound images; Automatic section type identification steps: When the ultrasound image data is a single frame ultrasound image, automatically identify the section type of the single frame ultrasound image; or when the ultrasound image data is an ultrasound image sequence, automatically identify the section type of the ultrasound image sequence. Automatic matching and association steps: When the section type of the single-frame ultrasound image is identified, the single-frame ultrasound image is automatically associated with the corresponding standard section in the automatic workflow protocol to obtain an ultrasound section image. After storing the ultrasound section image, the ultrasound section image is marked as completed. Alternatively, when the section type of the ultrasound image sequence is identified, the ultrasound images in the ultrasound image sequence are automatically matched with the corresponding standard sections in the automatic workflow protocol to obtain an ultrasound section image. After storing the ultrasound section image, the ultrasound section image is marked as completed. The automatic workflow protocol includes a preset set of standard sections. The step of automatically associating the single-frame ultrasound image with the corresponding standard section in the automatic workflow protocol to obtain an ultrasound section image includes: based on the identified section type of the single-frame ultrasound image, searching for the corresponding standard section in the automatic workflow protocol, and automatically determining the single-frame ultrasound image as the ultrasound section image corresponding to the standard section.

2. The method as described in claim 1, characterized in that, The automated workflow protocol also includes pre-defining operations for each standard section, the operations including at least one of the following: adding annotations, measuring, adding body position diagrams, adding probe markers, and storing; The method further includes: automatically performing corresponding operations on the ultrasonic cross-sectional image according to the predefined operations of the automated workflow protocol.

3. The method as described in claim 1, characterized in that, The method further includes: providing a human-computer interaction interface, wherein the human-computer interaction interface presents at least one of the following information: the ultrasound image data, the ultrasound cross-sectional image, and information related to the automated workflow protocol.

4. The method as described in claim 3, characterized in that, The method further includes: receiving an input signal through the human-computer interaction interface, the input signal being used to characterize the confirmation or denial of the ultrasound section image.

5. The method as described in claim 4, characterized in that, The method further includes providing a playback selection control on the human-computer interaction interface to play back the ultrasound image sequence and / or reselect an ultrasound cross-sectional image for each frame of the played back ultrasound image.

6. The method as described in claim 5, characterized in that, The method further includes providing a matching control on the human-computer interaction interface to match selected ultrasound images that may have been missed in identification, and to identify the cross-section type of the ultrasound images that may have been missed in identification. The step of receiving the input signal includes: receiving at least one frame of ultrasound image selected from the played ultrasound image sequence, and automatically associating the selected at least one frame of ultrasound image with the corresponding standard section in the automatic workflow protocol through the matching control to obtain the ultrasound section image.

7. The method as described in claim 3, characterized in that, The method further includes providing a freeze image control on the human-computer interaction interface, which freezes or thaws the ultrasound image currently being processed by triggering the freeze image control.

8. The method as described in claim 1, characterized in that, The automated workflow protocol also includes various types of aspect features pre-stored in the database; The step of automatically identifying the section type of the ultrasound image sequence includes: Feature extraction is performed on each frame of the ultrasound image sequence; The extracted features corresponding to each frame of ultrasound image are classified according to the various types of cross-sectional features, thereby determining the cross-sectional type of each frame of ultrasound image.

9. The method as described in claim 8, characterized in that, The feature extraction method includes feature extraction methods of conventional digital image processing or deep learning methods; the classification includes classifying each frame of ultrasound image using a pattern recognition algorithm and determining the section type to which each frame of ultrasound image belongs and / or the probability of belonging to that section type.

10. The method as described in claim 1, characterized in that, The method further includes: transmitting ultrasonic waves to the target to be detected, receiving ultrasonic echoes of the ultrasonic waves returned from the target to be detected, obtaining ultrasonic echo signals, and performing beamforming and signal processing on the ultrasonic echo signals to obtain the ultrasonic image data. Alternatively, the method may also include: importing the ultrasound image data.

11. A method for cross-sectional processing in an ultrasonic imaging workflow, characterized in that, include: An ultrasonic wave is emitted toward the target to be detected, and the ultrasonic echo returned by the target to be detected is received to obtain an ultrasonic echo signal. A sequence of ultrasound images is obtained based on the ultrasound echo signal; Determine the section type to which the sequence of ultrasound images belongs; At least one target standard section is determined from the standard sections included in the automated workflow protocol based on the section type; The at least one target standard section is associated with at least one frame of ultrasound image in the sequence ultrasound to obtain an ultrasound section image. After the ultrasound section image is stored, the ultrasound section image is marked as completed. Specifically, when the at least one frame of ultrasound image is a single frame ultrasound image, the corresponding standard section in the automatic workflow protocol is searched according to the determined section type of the single frame ultrasound image to determine the target standard section.

12. An ultrasonic imaging workflow system, characterized in that, include: A workflow processor is used to acquire ultrasound image data, which includes single-frame ultrasound images or ultrasound image sequences. When the ultrasound image data is a single-frame ultrasound image, it automatically identifies the cross-section type of the single-frame ultrasound image; or, when the ultrasound image data is an ultrasound image sequence, it automatically identifies the cross-section type of the ultrasound image sequence. It is also used to, upon identifying the cross-section type of the single-frame ultrasound image, automatically associate the single-frame ultrasound image with the corresponding standard cross-section in an automated workflow protocol to obtain an ultrasound cross-section image. After storing the ultrasound cross-section image, the ultrasound cross-section image is marked as completed. Alternatively, upon identifying the cross-section of the ultrasound image sequence... In the case of a certain type, the ultrasound images in the ultrasound image sequence are automatically matched with the corresponding standard sections in the automated workflow protocol to obtain an ultrasound section image. After storing the ultrasound section image, the ultrasound section image is marked as completed. The automated workflow protocol includes a preset set of standard sections. The step of automatically associating the single-frame ultrasound image with the corresponding standard sections in the automated workflow protocol to obtain the ultrasound section image includes: based on the identified section type of the single-frame ultrasound image, searching for the corresponding standard section in the automated workflow protocol, and automatically determining the single-frame ultrasound image as the ultrasound section image corresponding to the standard section.

13. The system as described in claim 12, characterized in that, Also includes: Ultrasonic probe, The transmitting and receiving circuit is used to excite the ultrasonic probe to emit ultrasonic waves toward the target to be detected, receive the ultrasonic echoes returned from the target to be detected, and form an echo signal; A beamforming and signal processing module is used to perform beamforming and signal processing on the echo signal to obtain the ultrasound image data, which includes at least one frame of ultrasound image. A display screen showing a human-machine interface, wherein the human-machine interface presents at least one of the following information: the ultrasound image data, the ultrasound cross-sectional image, and information related to the automated workflow protocol.

14. The system as described in claim 13, characterized in that, The human-computer interaction interface provides a matching control for matching selected ultrasound images that may have been missed, and for identifying the cross-sectional type of the ultrasound images that may have been missed.

15. The system as described in claim 13, characterized in that, The human-computer interaction interface provides a freeze image control, which can be triggered to freeze or unfreeze the ultrasound section image.

16. An ultrasound imaging system, characterized in that, include: Ultrasonic probe, The transmitting and receiving circuit is used to excite the ultrasonic probe to emit ultrasonic waves toward the target to be detected, receive the ultrasonic echo of the ultrasonic waves returned from the target to be detected, and obtain the ultrasonic echo signal. The processor is configured to obtain a sequence of ultrasound images based on the ultrasound echo signal, determine the section type to which the sequence of ultrasound images belongs, determine at least one target standard section from a set of preset standard sections included in the automated workflow protocol based on the section type, associate the at least one target standard section with at least one frame of ultrasound image in the sequence of ultrasound images to obtain an ultrasound section image, and after storing the ultrasound section image, the ultrasound section image is marked as completed. A display is used to display the at least one frame of ultrasound image; wherein, when the at least one frame of ultrasound image is a single frame ultrasound image, the corresponding standard section in the automatic workflow protocol is searched according to the determined section type of the single frame ultrasound image to determine the target standard section.

17. A readable storage medium, characterized in that, The readable storage medium stores a computer program that, when executed, implements the steps of the method as described in any one of claims 1 to 11.

Images