An ultrasound imaging system and an ultrasound imaging method

Abstract

The present application provides an ultrasound imaging method, comprising: acquiring ultrasound data about a tissue to be imaged; generating an ultrasound image based on the ultrasound data; determining an anatomical region corresponding to the ultrasound image and generating a first visual indication reflecting the anatomical region corresponding to the ultrasound image; determining a quality level of the ultrasound image and generating a second visual indication reflecting the quality level of the ultrasound image; and sending a first signal to a display device, so that the display device simultaneously displays the ultrasound image, the first visual indication and the second visual indication. Further embodiments of the present application also provide an ultrasound imaging system, comprising a probe, a processor performing the above method, and a display device.

Description

Technical Field

[0001] This invention relates to the field of medical imaging, and in particular to ultrasound imaging systems and methods. Background Technology

[0002] Ultrasound imaging is a widely used imaging technique. Ultrasound imaging systems can automatically identify parameters of a target object, such as the length or diameter of anatomical structures, the volume of blood or fluid flowing through a region over a period of time, the acquisition velocity, and the average or peak velocity.

[0003] For less experienced ultrasound clinicians, the quality of acquired ultrasound images is often unacceptable, requiring rescanning. However, a lack of experience can lead to an inability to determine whether the ultrasound image quality is acceptable. Furthermore, when unacceptable ultrasound image quality is detected, the rescanning process is often time-consuming and labor-intensive due to its lack of specificity. Summary of the Invention

[0004] The aforementioned defects, shortcomings, and problems are addressed in this article. These problems and solutions will be understood by reading and understanding the following explanation.

[0005] Some embodiments of the present invention provide an ultrasound imaging method, comprising: acquiring ultrasound data about a tissue to be imaged; generating an ultrasound image based on the ultrasound data; determining an anatomical region corresponding to the ultrasound image and generating a first visual indication reflecting the anatomical region corresponding to the ultrasound image; determining a quality level of the ultrasound image and generating a second visual indication reflecting the quality level of the ultrasound image; and sending a first signal to a display device, the first signal being configured to: cause the display device to simultaneously display the ultrasound image, the first visual indication, and the second visual indication.

[0006] Some embodiments of the present invention provide an ultrasound imaging apparatus, comprising: a probe for acquiring ultrasound data; a processor configured to: acquire ultrasound data about a tissue to be imaged; generate an ultrasound image based on the ultrasound data; determine an anatomical region corresponding to the ultrasound image and generate a first visual indication reflecting the anatomical region corresponding to the ultrasound image; determine a quality level of the ultrasound image and generate a second visual indication reflecting the quality level of the ultrasound image; and send a first signal to a display device, the first signal being configured to: cause the display device to simultaneously display the ultrasound image, the first visual indication, and the second visual indication. The apparatus further includes a display device for receiving signals from the processor for display.

[0007] Some embodiments of the present invention provide a non-transitory computer-readable medium storing a computer program having at least one code segment executable by a machine to cause the machine to perform the following steps: acquiring ultrasound data about a tissue to be imaged; generating an ultrasound image based on the ultrasound data; determining an anatomical region corresponding to the ultrasound image and generating a first visual indication reflecting the anatomical region corresponding to the ultrasound image; determining a quality level of the ultrasound image and generating a second visual indication reflecting the quality level of the ultrasound image; and sending a first signal to a display device configured to simultaneously display the ultrasound image, the first visual indication, and the second visual indication.

[0008] It should be understood that the brief description provided above is intended to introduce some concepts further described in the detailed embodiments in a simplified form. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed description. Furthermore, the claimed subject matter is not limited to the implementation of any shortcomings mentioned above or in any paragraph of this disclosure. Attached Figure Description

[0009] The invention will be better understood by referring to the accompanying drawings and by reading the following description of non-limiting embodiments, in which:

[0010] Figure 1 This is a schematic diagram of an ultrasound imaging system according to some embodiments of the present invention;

[0011] Figure 2 This is a schematic diagram of an ultrasound imaging method according to some embodiments of the present invention;

[0012] Figure 3 These are schematic diagrams of images according to some embodiments of the present invention;

[0013] Figure 4 These are schematic diagrams of images according to other embodiments of the present invention;

[0014] Figure 5 This is a schematic diagram of an enlarged ultrasound image according to some embodiments of the present invention;

[0015] Figure 6 This is a schematic diagram showing multiple ultrasound images according to some embodiments of the present invention. Detailed Implementation

[0016] The following describes specific embodiments of the present invention. It should be noted that, in order to provide a concise description, the present invention cannot provide a detailed description of all features of the actual embodiments. It should be understood that, in the actual implementation of any embodiment, just as in any engineering or design project, various specific decisions are often made to achieve the developer's specific goals and to meet system-related or business-related constraints, and this can change from one embodiment to another. Furthermore, it is understood that although the efforts made in this development process may be complex and lengthy, for those skilled in the art related to the content disclosed in this invention, some design, manufacturing, or production modifications based on the technical content disclosed herein are merely conventional technical means and should not be construed as insufficient content of this disclosure.

[0017] Unless otherwise defined, the technical or scientific terms used in the claims and description shall have the ordinary meaning understood by one of ordinary skill in the art. The terms "first," "second," and similar terms used in this invention and the claims do not indicate any order, quantity, or importance, but are merely used to distinguish different components. The terms "an" or "a" and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms "comprising" or "including" and similar terms mean that the elements or objects preceding "comprising" or "including" encompass the elements or objects listed following "comprising" or "including" and their equivalents, and do not exclude other elements or objects. The terms "connected" or "linked" and similar terms are not limited to physical or mechanical connections, nor are they limited to direct or indirect connections.

[0018] Figure 1 This is a schematic diagram of an ultrasound imaging system 100 according to some embodiments of the present invention. The ultrasound imaging system 100 includes a transmit beamformer 101 and a transmitter 102, both of which drive elements 104 within a probe 106 to transmit pulsed ultrasound signals into a body (not shown). According to various embodiments, the probe 106 can be any type of probe, including linear probes, curved array probes, 1.25D arrays, 1.5D arrays, 1.75D arrays, or 2D array probes. According to other embodiments, the probe 106 can also be a mechanical probe, such as a mechanical 4D probe or a hybrid probe. The probe 106 can be used to acquire 4D ultrasound data containing information about how a volume changes over time. Each volume can include multiple 2D images or slices. Still referring to... Figure 1Pulsed ultrasound signals are backscattered from structures within the body (such as blood cells or muscle tissue), generating echoes that return to element 104. The echoes are converted by element 104 into electrical signals or ultrasound data, and the electrical signals are received by receiver 108. The electrical signals representing the received echoes pass through receiver beamformer 110, which outputs ultrasound data. According to some embodiments, probe 106 may include electronic circuitry to perform all or part of the operation of transmit beamforming and / or receive beamforming. For example, all or part of transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110 may be located in probe 106. The terms “scanning” or “under scanning” may also be used in this disclosure to refer to the process of acquiring data by transmitting and receiving ultrasound signals. The terms “data” and “ultrasound data” may be used in this disclosure to refer to one or more datasets acquired using an ultrasound imaging system. User interface 115 can be used to control the operation of ultrasound imaging system 100. The user interface can be used to control the input of patient data or to select various modes, operations, and parameters, etc. User interface 115 may include one or more user input devices, such as a keyboard, hard keys, touch pad, touch screen, trackball, rotary control, slider, soft keys, or any other user input device.

[0019] The ultrasound imaging system 100 also includes a processor 116 that controls the transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110. According to various embodiments, the receive beamformer 110 can be a conventional hardware beamformer or a software beamformer. If the receive beamformer 110 is a software beamformer, it can include one or more of the following components: a graphics processing unit (GPU), a microprocessor, a central processing unit (CPU), a digital signal processor (DSP), or any other type of processor capable of performing logical operations. The beamformer 110 can be configured to implement conventional beamforming techniques as well as techniques such as backtracking transmit beamforming (RTB).

[0020] Processor 116 communicates electronically with probe 106. Processor 116 can control probe 106 to acquire ultrasound data. Processor 116 controls which elements 104 are activated and the shape of the beam emitted from probe 106. Processor 116 also communicates electronically with display device 118, and can process the ultrasound data into images for display on display device 118. For the purposes of this disclosure, the term "electronic communication" can be defined to include both wired and wireless connections. According to one embodiment, processor 116 may include a central processing unit (CPU). According to other embodiments, processor 116 may include other electronic components capable of performing processing functions, such as a digital signal processor, a field-programmable gate array (FPGA), a graphics processing unit (GPU), or any other type of processor. According to other embodiments, processor 116 may include multiple electronic components capable of performing processing functions. For example, processor 116 may include two or more electronic components selected from a list including: a central processing unit (CPU), a digital signal processor (DSP), a field-programmable gate array (FPGA), and a graphics processing unit (GPU). According to another embodiment, processor 116 may include a demodulator (not shown) that demodulates RF data and generates raw data. In another embodiment, demodulation may be performed earlier in the processing chain. Processor 116 may be adapted to perform one or more processing operations on the data according to a plurality of selectable ultrasonic modes. As echo signals are received, the data may be processed in real time during the scanning phase. For the purposes of this disclosure, the term “real time” is defined as including processes performed without any intentional delay. The real-time frame or volume rate may vary based on the size of the location or volume from which the data is acquired and the specific parameters used during the acquisition process. Data may be temporarily stored in a buffer (not shown) during the scanning phase and processed in a less real-time manner during live or offline operation. Some embodiments of the invention may include multiple processors (not shown) to handle processing tasks. For example, a first processor may be used to demodulate and decimate the RF signal, while a second processor may be used to further process the data before displaying it as an image. It should be appreciated that other embodiments may use different processor arrangements. For embodiments where the receive beamformer 110 is a software beamformer, the processing tasks described above concerning the processor 116 and the software beamformer can be performed by a single processor, such as the receive beamformer 110 or the processor 116. Alternatively, the processing functions belonging to the processor 116 and the software beamformer can be distributed among any number of separate processing components in different ways.

[0021] According to one embodiment, the ultrasound imaging system 100 can continuously acquire ultrasound data at frame rates, for example, 10 Hz to 30 Hz. Images generated from this data can be refreshed at similar frame rates. Other embodiments may acquire and display data at different rates. For example, depending on the size and potential application, some embodiments may acquire ultrasound data at frame rates less than 10 Hz or greater than 30 Hz. For example, many applications involve acquiring ultrasound data at a frame rate of 50 Hz. A memory 120 is included therein to store processed frames of acquired data. In an exemplary embodiment, the memory 120 has sufficient capacity to store ultrasound data frames acquired over a period of time, with a length of at least several seconds. The data frames are stored in a manner that facilitates retrieval based on the order or time of their acquisition. The memory 120 may include any known data storage medium.

[0022] Alternatively, contrast agents can be used to perform embodiments of the invention. When using an ultrasound contrast agent comprising microbubbles, contrast imaging generates enhanced images of in vivo anatomical structures and blood flow. After data acquisition using the contrast agent, image analysis includes: separating harmonic and linear components, enhancing the harmonic components, and generating an ultrasound image by using the enhanced harmonic components. Separation of harmonic components from the received signal is performed using appropriate filters. The use of contrast agents in ultrasound imaging is well known to those skilled in the art and will not be described in further detail.

[0023] In various embodiments of the invention, data may be processed by processor 116 through modules of other or different related modes (e.g., B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastography, TVI, strain, strain rate, etc.) to form 2D or 3D images or data. For example, one or more modules may generate B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastography, TVI, strain, strain rate, and combinations thereof. Image beams and / or frames are stored, and timing information indicating the time when data is acquired in memory may be recorded. The modules may include, for example, a scan conversion module that performs a scan conversion operation to convert image frames from coordinate beam space to display space coordinates. A video processor module may be provided that reads image frames from memory and displays image frames in real time while being operated on a patient. The video processor module may store image frames in image memory, read images from image memory, and display them. The ultrasound imaging system 100 may be a console-based system, a laptop computer, a handheld or portable system, or any other configuration.

[0024] Figure 2This is a flowchart of an ultrasound imaging method 200 according to some embodiments of the present invention. Each module of the flowchart represents a step that can be performed according to method 200. Additional embodiments may perform the shown steps in a different order, and / or additional embodiments may include... Figure 2 Additional steps are not shown in the document.

[0025] The following describes the exemplary embodiments. Figure 2 A further detailed description is provided. This method can be derived from... Figure 1 The ultrasound imaging system 100 shown is used for this purpose. For example, it can be performed by the processor 116 in the ultrasound imaging system 100.

[0026] In step 201, ultrasound data about the tissue to be imaged is acquired. This acquisition process can be implemented by the processor 116 described above. For example, the processor 116 can obtain ultrasound data collected from the body part of the person to be scanned from the probe 106. Generally, an ultrasound signal can be sent to the tissue to be imaged through the probe 106, and then the ultrasound echo signal from the tissue to be imaged can be received through the probe 106. The processor 116 can thus acquire ultrasound data about the tissue to be imaged. The tissue to be imaged can be any human / animal tissue or organ. For example, the tissue to be imaged can be the liver, kidney, heart, carotid artery, breast, etc., which will not be elaborated further here.

[0027] The aforementioned ultrasound data may include 1D ultrasound data, 2D ultrasound data, 3D ultrasound data, or 4D ultrasound data. The ultrasound data may be acquired and displayed in real time, thus serving as part of a real-time ultrasound imaging process. Alternatively, in some other embodiments, the ultrasound data may be acquired, processed, and then displayed after processing within a first discrete time period.

[0028] In step 202, an ultrasound image is generated based on the aforementioned ultrasound data. This process can be performed by processor 116. The image can be a 1D image, a 2D image, a 3D image, or a 4D image. The image can be generated from ultrasound data in any mode. For example, the image can be a B-mode image, a color Doppler image, an M-mode image, a color M-mode image, a spectral Doppler image, an elastography image, a TVI image, or any other type of image generated from ultrasound data. According to one embodiment, the image can be a still frame generated from ultrasound data. According to other embodiments, processor 116 can generate images based on ultrasound data from two or more different imaging modes. For example, in VTI mode, processor 116 can generate both a B-mode image and a spectral Doppler image based on ultrasound data. For example, in IVC mode, processor 116 can generate both a B-mode image and an M-mode image based on ultrasound data.

[0029] In step 203, the anatomical region corresponding to the ultrasound image is determined, and a first visual indication reflecting the anatomical region corresponding to the ultrasound image is generated. This process can also be implemented by processor 116. The anatomical region is a specific location in the tissue to be imaged from which the ultrasound image is acquired.

[0030] There are various methods for determining the anatomical region corresponding to the ultrasound image. In some embodiments, a pre-trained neural network can be used to directly determine the anatomical region corresponding to the ultrasound image. For example, the ultrasound image can be a 3D ultrasound image, and the processor 116 can directly determine which anatomical region (e.g., the left atrium) the 3D ultrasound image originates from through the neural network. This neural network can be obtained through methods such as deep learning and machine learning, which will not be elaborated here. Such an implementation can have a high degree of automation and can be applied to scanning different tissues throughout the body.

[0031] In other embodiments, the method for determining the anatomical region corresponding to the ultrasound image may be independent of the ultrasound image itself. For example, in automated or semi-automated ultrasound imaging systems, the probe's scanning trajectory or angle is programmed and controlled by a processor. In such examples, the processor can constantly know the probe's position, thereby directly determining which anatomical region the acquired ultrasound image originates from. For instance, in automated breast ultrasound, the processor can directly determine which region of the breast the ultrasound image originates from based on the probe's travel distance.

[0032] After determining the anatomical region corresponding to the ultrasound image, a first visual indication reflecting the anatomical region can be generated. This first visual indication can be represented directly in text form. However, in some tissue scans, text representations are insufficient to directly indicate the anatomical region corresponding to the ultrasound image.

[0033] In other embodiments, the first visual indication may be a visual indication that includes the location of the anatomical region corresponding to the ultrasound image on the tissue to be imaged. For example, the entire tissue to be imaged (e.g., heart, breast, liver, kidney, carotid artery, etc.) may be represented graphically, and the anatomical region corresponding to the generated ultrasound image may be highlighted on the graphical representation.

[0034] The above-mentioned graphic representation can be done in various ways. For example, the shape of the tissue to be imaged can be outlined with lines, facilitating direct and intuitive judgment by the user. This shape can be transparent or colored. Correspondingly, the above-mentioned highlighting methods can also be diverse. For example, a different color than the aforementioned color can be used to represent the anatomical region corresponding to the ultrasound image. Alternatively, shading lines or other methods can be used to highlight the anatomical region. In short, by providing a direct visual indication of the location of the anatomical region corresponding to the ultrasound image on the tissue to be imaged, the user can greatly facilitate direct observation and judgment.

[0035] In step 204, the quality level of the ultrasound image is determined, and a second visual indication reflecting the quality level of the ultrasound image is generated. This step can be implemented by processor 116.

[0036] Specifically, processor 116 may determine the target acquisition quality level based on two or more different quality parameters. Alternatively, according to other embodiments, processor 116 may determine the ultrasound image acquisition quality level based on only a single quality parameter.

[0037] According to some implementations, quality parameters may include ultrasound image quality parameters calculated from ultrasound data, while in other implementations, quality parameters may be derived from data including non-ultrasound data. For example, quality parameters may be acquired using non-ultrasound sensors. Quality parameters may include, for example, the noise level of the image, a time-varying frame consistency metric, signal strength, a view correctness metric, the correctness of the flow spectrum waveform, or any other parameter associated with the object acquisition quality. Generally, lower noise levels are associated with higher ultrasound image acquisition quality, lower probe motion is associated with higher ultrasound image acquisition quality, higher time-varying frame consistency metrics are associated with higher ultrasound image acquisition quality, and object size and shape (including roundness) are associated with higher ultrasound image acquisition quality. View correctness metrics can be calculated by comparing acquired image frames to a standard view using image correlation techniques. Some implementations may employ neural networks to determine the degree of matching between acquired image frames and a standard view. Neural networks can be trained using deep learning or machine learning methods.

[0038] The quality level of an ultrasound image can be determined, for example, by the noise level of the image. Specifically, a threshold noise level can be provided, and a first ultrasound image quality level, such as having an excellent quality level, is determined when the noise level does not exceed any threshold noise level, while a second acquired ultrasound image quality level, such as having an average quality level, is determined when the noise level is above the first threshold level but below a second threshold level. Similarly, a noise level exceeding the second threshold level has a third acquired ultrasound image quality level, such as having a poor quality level. In some embodiments, the distinction between quality levels can be three or more, for example, good, average, and poor. Alternatively, in other embodiments, the distinction between quality levels can include only two, for example, acceptable or unacceptable.

[0039] In yet another example, the ultrasound image quality level is determined based on or in response to the amount of probe motion. In this example, changes in orientation are continuously monitored by sensors (such as accelerometers) to determine the amount of probe movement. In this example, the quality level is inversely proportional to the amount of movement and varies over time.

[0040] In another example, a time-varying frame consistency metric is used as an ultrasound image quality parameter, and an algorithm determines a consistency range. Based on the size of this range or the difference in frames over time, the quality level of the acquired target object is determined based on the size of this range or the variance between frames, where a smaller range indicates higher quality and a larger range indicates lower quality. Alternatively, the average variance with the mean frame value is used, where increasing variance indicates lower quality and decreasing variance indicates higher quality. Similarly, the average variance with the median frame value is used, where increasing variance indicates lower quality. Alternatively, in an embodiment, a neural network is used to determine the target object quality level.

[0041] In another example, signal intensity is used to determine the quality level of the ultrasound image. In one example, a single threshold level is used. In this example, intensity levels above the threshold are considered high quality, while signals at or below the threshold are considered low quality.

[0042] In another example, a view correctness metric is calculated to determine the ultrasound image quality level. In one example, a reinforcement learning algorithm is used, where different weights are assigned to different variables based on the accuracy of the readings being examined. In one example, interference level is one variable, view correctness metric is another, and signal strength is yet another. During iterative examinations, weights are applied to each variable. Specifically, a variable is given more weight when a reading is considered accurate during the examination than when the reading is inaccurate. Therefore, if the interference value is above a threshold, while the view correctness metric and signal strength values ​​are below the threshold, and the reading is determined to be accurate, the view correctness threshold and signal strength threshold are given higher weights, while the interference threshold is given lower weights. These new weights are then used to determine whether the next value iteration yields an accurate reading or a determination. Alternatively, the interference threshold can be increased in response to an accurate reading. Thus, the threshold can also be changed through this iterative process.

[0043] In yet another example, the accuracy of the flow spectrum waveform can be utilized. Similarly, reinforcement learning methods can be employed. Alternatively, different features such as slope, peak-to-peak height, etc., can be used and compared with previous measurements to determine the ultrasound image quality level.

[0044] In some examples, the determination of the aforementioned quality parameters can also rely at least in part on a direct assessment of the quality level of the ultrasound images generated by the ultrasound imaging system. This direct assessment of quality level can be achieved through artificial intelligence. For example, neural networks can be used to determine whether artifacts exist in the ultrasound images generated by the system, whether the generated ultrasound images are sufficiently complete, and whether the scanning depth of the generated ultrasound images meets requirements. These quality parameters can be combined with the quality parameters mentioned above to jointly determine the quality level of the ultrasound images, thereby making the assessment of ultrasound image quality level more accurate and tailored to user needs.

[0045] The parameters for judging the quality level of ultrasound images can be diverse, as listed above. The inventors discovered that using the same quality parameters for all tissues to be imaged may lead to inaccurate judgments. Users have different priorities regarding the ultrasound image quality for different tissues. For example, during breast scans, the completeness of the breast tissue scan is one of the most important criteria for evaluating ultrasound image quality. The carotid artery, however, does not have glandular structures similar to those in the breast, and the scanning angle during carotid artery scans has a more significant impact on image quality. Therefore, applying the same judgment criteria to these two different tissues may reduce users' confidence in the accuracy of the indications provided by this ultrasound imaging method.

[0046] In some embodiments of the present invention, the quality level of the ultrasound image can be automatically determined using a corresponding neural network based on the different tissues to be imaged. Different tissues to be imaged can have different trained models. For example, for breast ultrasound scans, the model can include some specific parameters. For example, the integrity of the mammary glands obtained from the ultrasound image, whether the pressure value of the probe on the breast during the ultrasound image acquisition process is appropriate, whether the acquired image has artifacts, and the degree of contact between the probe and the breast during the acquisition process, etc. These parameters can be assigned different weights to determine the overall quality level of the ultrasound image. The above model can be specifically designed for breast scans. When the scan object is the heart, carotid artery, kidney, liver, etc., other corresponding neural networks can also be used to automatically determine the quality level of the ultrasound image of these tissues to be imaged. Before the determination, the determination of the tissue to be imaged can be varied. For example, it can be selected by the user or automatically determined by the ultrasound imaging system 100, which will not be elaborated here. In addition, in some embodiments, the quality level judgment criteria can also be selected based on the anatomical region corresponding to the ultrasound image.

[0047] After determining the quality level of the ultrasound image through the above example, a second visual indication reflecting the quality level of the ultrasound image can be generated. This second visual indication can be arbitrary, and its purpose is to allow the user to intuitively understand whether the quality of the ultrasound image acquired by the ultrasound imaging system is acceptable. The second visual indication is described exemplarily below.

[0048] The second visual indication can be a color indication. The processor selects a color corresponding to the quality level of the ultrasound image. The processor 116 can select from at least a first color and a second color, wherein the second color is different from the first color. According to one embodiment, the first color can represent a first ultrasound image quality level, and the second color can represent a second ultrasound image quality level. According to one embodiment, the first color can represent a first range of ultrasound image quality levels, and the second color can represent a second range of ultrasound image quality levels, wherein the second range does not overlap with the first range. The first color can be, for example, green, and the ultrasound image quality level of the first range can represent an acquisition quality level considered acceptable. The second color can be, for example, red, and the acquisition quality level of the second range can represent an ultrasound image quality level considered unacceptable.

[0049] Furthermore, three or more colors can be used to represent three or more different ultrasound image quality levels. For example, a first color, such as green, can represent a first quality level; a second color, such as yellow, can represent a second quality level; and a third color, such as red, can represent a third quality level. Alternatively, a first color can represent a first range of quality levels, a second color can represent a second range of quality levels, and a third color can represent a third range of quality levels. According to one embodiment, the first range of quality levels, the second range of quality levels, and the third range of quality levels can each be a discrete, non-overlapping range. According to other embodiments, more than three different colors can be used to represent various quality levels or various ranges of quality levels. Specifically, green can be the first color, which can be used to represent a high ultrasound image quality level; red can be the second color, which can be used to represent a low ultrasound image quality level; and yellow can be the third color, which can be used to represent a medium ultrasound image quality level.

[0050] The correspondence between color and ultrasound image quality level may not be intuitive. For example, users with little experience or those using the ultrasound imaging system disclosed in this invention for the first time may not be able to intuitively understand which color represents a high ultrasound image quality level and which color represents a low ultrasound image quality level. In some embodiments, the second visual indication may reflect the ultrasound image quality level in other ways.

[0051] The second visual indicator can also be an icon indicator. The processor selects an icon corresponding to the quality level of the ultrasound image. The processor 116 can select from at least a first icon and a second icon, wherein the second icon is different from the first icon. Similar to the color indicator described above, the first icon can represent a first ultrasound image quality level, and the second icon can represent a second ultrasound image quality level. The first icon can represent a first range of ultrasound image quality levels, and the second icon can represent a second range of ultrasound image quality levels, wherein the second range does not overlap with the first range.

[0052] The appearance of the first and second icons can be configured to be visually easily distinguishable. This allows users to make an intuitive judgment and determine the level of ultrasound image quality in subsequent processes. For example, the first icon could represent an acceptable level of ultrasound image quality, which could be a "√"; the second icon could represent a low level of ultrasound quality, which could be an "×". Seeing such prominent symbols allows users to directly assess the level of ultrasound image quality.

[0053] Furthermore, three or more icons can be used to represent three or more different ultrasound image quality levels. For example, a first icon (e.g., "√") can represent a first acquisition quality level; a second icon (e.g., "√") can represent a second acquisition quality level; and a third icon (e.g., "×") can represent a third acquisition quality level. Alternatively, a first icon can represent a first range of acquisition quality levels, a second icon can represent a second range of acquisition quality levels, and a third icon can represent a third range of acquisition quality levels. According to one embodiment, the first range of image quality levels, the second range of image quality levels, and the third range of image quality levels can each be a discrete, non-overlapping range. According to other embodiments, more than three different icons can be used to represent various image quality levels or various ranges of image quality levels, which will not be elaborated further here.

[0054] In other examples, the secondary visual indicator can also be a combination of color and icon indicators. This provides the user with clearer guidance in subsequent processes.

[0055] For example, processor 116 can select a color and icon corresponding to the quality level of the ultrasound image. Processor 116 can select from a first icon having at least a first color and a second icon having a second color, wherein the second color is different from the first color, and the second icon is also different from the first icon. According to one embodiment, the first color can represent a first ultrasound image quality level, and the second color can represent a second ultrasound image quality level. According to one embodiment, the first color can represent a first range of ultrasound image quality levels, and the second color can represent a second range of ultrasound image quality levels, wherein the second range does not overlap with the first range. The first icon with the first color can be, for example, a green "√", and the first range of ultrasound image quality levels can represent an acquisition quality level considered acceptable. The second icon with the second color can be, for example, a red "×", and the second range of acquisition quality levels can represent an ultrasound image quality level considered unacceptable. Furthermore, similar to the above, three or more different icons with different colors can be used to represent three or more different ultrasound image quality levels, which will not be elaborated further here.

[0056] Based on the generation of the aforementioned ultrasound image, first visual indication, and second visual indication, the display can be controlled to display them. Specifically, as shown in step 205, a first signal can be sent to the display device, the first signal being configured to cause the display device to simultaneously display the ultrasound image, the first visual indication, and the second visual indication. The display device can be, for example,... Figure 1The display device 118 shown. Simultaneous display means that the ultrasound image, the first visual indicator, and the second visual indicator are displayed simultaneously on the same interface of the display device 118, so that the user can directly observe the three at the same time.

[0057] The simultaneous display method described above can be achieved by arranging the three images on the display device 118 in any manner. The arrangement can include non-overlapping, partial overlap, or overlapping. In some embodiments, the second visual indicator can be positioned at the edge of the ultrasound image. For example, the edge of a high-quality ultrasound image can be set to a first color, and the edge of a low-quality ultrasound image can be set to a second color. Alternatively, the edge of a high-quality ultrasound image (e.g., a corner) can be set to a first icon, and the edge of a low-quality ultrasound image can be set to a second icon. It is also possible to set the edge of a high-quality ultrasound image (e.g., a corner) to a first icon with a first color, and the edge of a low-quality ultrasound image to a second icon with a second color. This arrangement ensures that the user can quickly correlate the ultrasound image with its quality level, and also ensures that the second visual indicator does not excessively interfere with the observation of the ultrasound image.

[0058] This invention utilizes a first visual indicator to indicate the anatomical location corresponding to the ultrasound image, combined with a second visual indicator to indicate the ultrasound image quality, and arranges both indicators together with the ultrasound image. During subsequent ultrasound scans, users can easily determine whether the quality level of the obtained ultrasound image meets requirements, and can intuitively identify the location of the tissue from which the ultrasound image was taken. Thus, if the ultrasound scan result for a certain location is unsatisfactory, the user can selectively rescan that location.

[0059] The following provides some more specific exemplary descriptions of the above embodiments, which can be found by referring to the relevant references. Figure 3 , Figure 4 . Figure 3 The diagram shows images from some embodiments of the present invention. Figure 4 Schematic diagrams showing images from other embodiments of the present invention are illustrated. Figure 3 , 4 The tissue to be imaged is a human breast. First, refer to... Figure 3 This example simultaneously displays an ultrasound image 301, a first visual indicator 302, and a second visual indicator 303. The ultrasound image 301 and the first visual indicator 302 can be displayed separately on a display device. They are arranged vertically, with the first visual indicator 302 positioned above the ultrasound image 301. Figure 3As can be seen, the first visual indicator 302 includes a contour map 304 of the breast (the tissue to be imaged in this example) and an anatomical region view 305 corresponding to the ultrasound image 301. The anatomical region view 305 is clearly marked in the contour map 304, thus facilitating the user's intuitive observation. The first visual indicator 302 is schematically arranged above the ultrasound image 301. In addition, a second visual indicator 303 is overlapped above one corner (specifically, the lower right corner) of the ultrasound image 301 to indicate the imaging quality of the ultrasound image 301. In this example, the second visual indicator 303 is an icon indicator (specifically, a "√") with a color (specifically green), which can be used to indicate acceptable ultrasound image quality. On the one hand, the second visual indicator 303 is set at one corner of the ultrasound image 301, so it does not obstruct the user's observation of the ultrasound image 301. On the other hand, it provides an intuitive and eye-catching indication to remind the user of the quality of the ultrasound image 301.

[0060] See again Figure 4 This example also shows another ultrasound image 401, another first visual indicator 402, and another second visual indicator 403. The example is broadly similar to... Figure 3 The example shown differs in that another second visual indicator 403 schematically depicts another icon indicator (specifically, an "×") with a different color (which could be red), which can be used to indicate substandard ultrasound image quality. It can be seen that this visual indicator allows the user to clearly identify substandard ultrasound image quality, thereby facilitating further decision-making, such as rescanning in conjunction with the anatomical structures indicated by the other first visual indicator 402 described above.

[0061] Displaying multiple images (e.g., the ultrasound image described above, the first visual indicator, and the second visual indicator) on the same display device can make it difficult for users to clearly view the details of the ultrasound image. Some embodiments of the present invention further provide a solution. References Figure 5 The diagram illustrates a magnified ultrasound image 501 in some embodiments of the present invention. This magnified ultrasound image can be implemented by a processor sending a second signal to the display device in response to user input, the second signal being configured to cause the display device to display the magnified ultrasound image 501. The user input can be arbitrary, for example, via a keyboard, trackball, mouse, or touchscreen. In some non-limiting embodiments, it can also be implemented via voice input, which will not be elaborated further. For example, the user can input the image by clicking... Figure 4The other ultrasound image 401 shown can be used to send the user input to the processor. In response to the user input, the processor sends a second signal to the display device, causing the display device to display the magnified ultrasound image 501. The magnified ultrasound image 501 can be displayed on top of the content displayed in the previous step, or it can be displayed independently.

[0062] By magnifying the image, users can observe the details of the ultrasound image more clearly, especially when the ultrasound image quality is low. By magnifying the image, users can better understand the reasons for the low quality, thereby improving the success rate of rescanning.

[0063] In some other examples, the second signal is further configured to cause the display device to display the magnified ultrasound image and a quality indicator of the ultrasound image. This quality indicator may be, for example... Figure 5 The quality indicator 502 is shown. The quality indicator 502 can visually indicate the quality of the ultrasound image based on the ultrasound image quality level judgment results from the preceding steps. For example, it can indicate areas of image quality defects (…). Figure 5 The location is indicated by the dashed box in the middle. Furthermore, it can be used to indicate the cause of the image quality defect in text ( Figure 5 (The solid line box indicates "bubble artifacts"). Alternatively, it can be a combination of both, showing both the location of image quality defects and their causes. The quality indicator 502 provides a more intuitive way for users to improve their ultrasound scans.

[0064] In addition, the processor can be configured to accept input from another user, so that the magnified ultrasound image returns to the display state of the previous step, which will not be elaborated here.

[0065] In some applications, users may need to confirm whether a scan of the tissue to be imaged is complete. For example, whether the acquisition of each anatomical plane of the tissue to be imaged is complete and meets requirements. Some embodiments of the present invention illustrate indications for the integrity of the tissue scan. (See reference...) Figure 6 The image illustrates an indication of the integrity of a scanned tissue under certain embodiments of the present invention. In some embodiments, the image may include a plurality of ultrasound images 601, including a plurality of first visual indicators 602 reflecting the corresponding anatomical region of each of the plurality of ultrasound images 601, and a plurality of second visual indicators 603 reflecting the quality level of each of the plurality of ultrasound images 601.

[0066] The generation and display methods of the aforementioned multiple ultrasound images 601, multiple first visual indicators 602, and multiple second visual indicators 603 are the same as described in any of the embodiments above and will not be repeated here. Unlike the embodiments described above, in this embodiment, the multiple ultrasound images 601 are acquired from the same tissue to be imaged. Specifically, the multiple ultrasound images 601 are acquired from different locations within the same tissue to be imaged, for example, from different locations within the breast. This arrangement can more intuitively reflect the quality and acquisition location of all ultrasound images acquired from the entire tissue to be imaged, providing a more intuitive display for the user.

[0067] Furthermore, in some examples, a third visual indication is also included. This third visual indication may be obtained by a processor through the steps of: generating a third visual indication reflecting the scan integrity of the tissue to be imaged, based on the quality level of each of a plurality of ultrasound images and the anatomical region corresponding to each of the plurality of ultrasound images; and the first signal is further configured to: cause the display device to simultaneously display the ultrasound image, the first visual indication, the second visual indication, and the third visual indication. Specifically, refer to... Figure 6 The third visual indicator 604 is generated by the processor based on the quality level of each of the plurality of ultrasound images 601 and the corresponding anatomical region of each of the plurality of ultrasound images, and is used to reflect the scanning completeness of the tissue to be imaged where the anatomical region is located. For example, when the quality level of one of the plurality of ultrasound images 601 is judged to be unqualified, it can be determined that its corresponding anatomical region has not been scanned. When the quality level of another ultrasound image is judged to be qualified, it can be determined that its corresponding anatomical region has been scanned. When a required anatomical region does not correspond to an ultrasound image, it can be determined that the region has not been scanned. According to the above method, the scanning completeness of the tissue to be imaged can be determined and further indicated by the third visual indicator 604. The third visual indicator 604 can be displayed in various ways. For example, it can represent a complete tissue outline 605 of the tissue to be scanned, and use one color to indicate the scanned area 606 and another color to indicate the scanned area 607. In this way, the user can intuitively judge which area has not been scanned and then make a judgment on whether to rescan and which area to rescan. This greatly improves the efficiency of user scanning and the targeting of secondary scanning. Figure 6 The third visual indicator 604 is applied to multiple ultrasound images 601, and it is also applicable to images such as... Figure 3 , 4 The image shown is a single ultrasound image.

[0068] Some embodiments of the present invention also provide an ultrasound imaging system, which can, for example... Figure 1As shown, it can also be any other method. The system includes: a probe for acquiring ultrasound data; a processor configured to perform the method of any of the above embodiments; and a display device for receiving signals from the processor for display.

[0069] Some embodiments of the present invention also provide a non-transitory computer-readable medium storing a computer program having at least one code segment that can be executed by a machine to cause the machine to perform the steps of the method described in any of the above embodiments.

[0070] The purpose of providing the above specific embodiments is to enable a more thorough and comprehensive understanding of the disclosure of this invention, but this invention is not limited to these specific embodiments. Those skilled in the art should understand that various modifications, equivalent substitutions, and changes can be made to this invention, and all such modifications and changes should be within the scope of protection of this invention, as long as they do not depart from the spirit of this invention.

Claims

1. An ultrasound imaging method, comprising: Acquire ultrasound data about the tissue to be imaged; Multiple ultrasound images are generated based on the ultrasound data; The anatomical region corresponding to each of the plurality of ultrasound images is determined, and a plurality of first visual indications reflecting the anatomical region corresponding to each of the plurality of ultrasound images are generated. The first visual indications include a graphic representation of the tissue to be imaged and a shaded area indicating the location of the anatomical region. The quality level of each of the plurality of ultrasound images is determined, and a plurality of second visual indicators reflecting the quality level of each of the plurality of ultrasound images are generated, the second visual indicators being positioned at the edges of the ultrasound images; Based on the quality level of each of the plurality of ultrasound images and the anatomical region corresponding to each of the plurality of ultrasound images, a third visual indication is generated that reflects the scan completeness of the tissue to be imaged in the anatomical region. The third visual indication is independent of the first visual indication and the second visual indication, and the third visual indication shows the areas where the scan is completed and the areas where the scan is not completed. as well as A first signal is sent to the display device, the first signal being configured to cause the display device to simultaneously display the plurality of ultrasound images, the plurality of first visual indications, the plurality of second visual indications, and the third visual indication.

2. The ultrasound imaging method according to claim 1, wherein: Determining the quality level of the ultrasound image includes: automatically judging the quality level of the ultrasound image based on the tissue to be imaged using a corresponding neural network.

3. The ultrasound imaging method according to claim 1, wherein: The second visual indicator includes at least one of color indicators and icon indicators.

4. The ultrasound imaging method according to claim 1, wherein, Also includes: In response to user input, a second signal is sent to the display device, the second signal being configured to cause the display device to display the magnified ultrasound image.

5. The ultrasound imaging method according to claim 4, wherein: The second signal is further configured to cause the display device to display the magnified ultrasound image and a quality indicator of the ultrasound image.

6. The ultrasound imaging method according to claim 1, wherein: The anatomical regions corresponding to the multiple ultrasound images all originate from the same tissue to be imaged.

7. An ultrasound imaging system, comprising: The probe is used to acquire ultrasound data; A processor configured to perform the ultrasound imaging method according to any one of claims 1-6; as well as A display device is used to receive signals from the processor for display.

8. A non-transitory computer-readable medium storing a computer program having at least one code segment that is executable by a machine to cause the machine to perform the steps of the ultrasound imaging method according to any one of claims 1-6.

Images