Multi-mode combined ultrasonic imaging method and system

Abstract

The invention discloses a multi-modal combined ultrasonic imaging method and an ultrasonic imaging system, and the method comprises the steps: responding to a first modal imaging instruction, and entering a single-modal imaging mode of a first modal; under the single-mode imaging mode of the first mode, ultrasonic imaging of the first mode is carried out, and an ultrasonic image of the first mode is displayed on a first ultrasonic interface; displaying a multi-mode control on the first operation interface; in response to a first operation on the multi-modal control, entering a multi-modal joint imaging mode; in the multi-mode combined imaging mode, multi-mode combined ultrasonic imaging is carried out, and one or more ultrasonic images corresponding to multiple modes are displayed on the second ultrasonic interface. Due to the fact that multi-mode combined ultrasonic imaging is directly entered through the multi-mode control, different modes do not need to be combined in functions of different levels, the multi-mode combination efficiency is greatly improved, and better use experience is provided for a user.

Description

Technical Field

[0001] The present invention relates to the technical field of ultrasonic imaging, and in particular to a multi-modal combined ultrasonic imaging method and system. Background Art

[0002] Ultrasound imaging uses ultrasonic beams to scan human tissues and organs, and obtains ultrasound images of tissues and organs in the body by receiving and processing reflected signals. Ultrasound imaging has multiple modes, such as B-mode, shear wave elastic mode, and viscosity mode, and ultrasound images obtained in different modes can reflect different characteristics of tissues and organs. Currently, in many clinical scenarios, ultrasound images and quantitative parameter evaluations obtained by a single mode are very limited for disease diagnosis and evaluation. For example, due to acute inflammation, shear wave elasticity is limited in evaluating the degree of hepatitis B liver fibrosis; B-mode ultrasound has low sensitivity and cannot detect early fatty liver, and lacks quantitative evaluation tools; therefore, in order to reflect the various characteristics of tissues and organs from multiple dimensions, multiple modes need to be combined in real time.

[0003] In the current solution, when users perform multi-mode real-time integration, there are multiple process steps and the operation is relatively complicated, which leads to low efficiency of real-time integration. Therefore, a new solution needs to be proposed. Summary of the invention

[0004] The main technical problem solved by the present invention is the low efficiency of multi-mode combination.

[0005] According to the first aspect, an embodiment provides a multi-modal combined ultrasound imaging method, comprising:

[0006] In response to the first modality imaging instruction, entering a single-modality imaging mode of the first modality;

[0007] In the single-modality imaging mode of the first modality, performing ultrasound imaging of the first modality and displaying the ultrasound image of the first modality on a first ultrasound interface;

[0008] Displaying a multimodal control on a first operation interface; entering a multimodal joint imaging mode in response to a first operation on the multimodal control;

[0009] In the multi-modality combined imaging mode, multi-modality combined ultrasound imaging is performed and one or more ultrasound images corresponding to the multi-modality are displayed on the second ultrasound interface.

[0010] In one embodiment, in response to a second operation on the multimodal control, a multimodal joint imaging setting sub-interface is displayed on the second operation interface; the multimodal joint imaging setting sub-interface includes at least one of the following, and the first operation and the second operation are the same operation or different operations:

[0011] A first setting area for multi-modal image types; in response to an operation on the first setting area, setting the modality types included in the multi-modal joint imaging mode;

[0012] a second setting area for multimodal image layout; in response to an operation on the second setting area, setting an image layout of ultrasound images displayed on the second ultrasound interface; the image layout including the type, quantity and / or position of ultrasound images displayed on the second ultrasound interface;

[0013] A third setting area for the measurement mode; in response to an operation on the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

[0014] In one embodiment, the first setting area of ​​the multimodal image type includes a plurality of selection controls, each selection control corresponds to a modality; the selection control has a selected state and an unselected state; when the selection control is in the selected state, the modality types included in the multimodal joint imaging mode include the modality corresponding to the selection control, and conversely, when the selection control is in the unselected state, the modality types included in the multimodal joint imaging mode do not include the modality corresponding to the selection control;

[0015] In response to an operation on the selection control, the selection control switches between the selected state and the unselected state.

[0016] In one embodiment, the second setting area of ​​the multimodal image layout includes a plurality of modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state;

[0017] Acquire control layout information of the modal image display control in the first state within the setting area, set the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, so as to display the ultrasound image on the second ultrasound interface according to the image layout; in response to the operation on the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the second ultrasound interface accordingly.

[0018] In one embodiment, the measurement mode includes a first measurement mode and a second measurement mode, the first measurement mode is a measurement mode for manually outlining the boundary of the area to be measured, and the second measurement mode is a measurement mode for preset boundary graphics;

[0019] In response to a third setting area operation on the measurement mode, one of the first measurement mode and the second measurement mode is selected as a measurement mode for the ultrasound image displayed on the second ultrasound interface.

[0020] In one embodiment, the multi-modality joint ultrasound imaging method further includes: in the single-modality imaging mode of the first modality, judging whether the single-modality imaging mode of the first modality supports switching to the multi-modality joint imaging mode based on the first modality;

[0021] If supported, displaying the multimodal control on the first operation interface;

[0022] If not supported, the multimodal control will not be displayed, or the multimodal control will be displayed in an unavailable state.

[0023] In one embodiment, the multimodal joint ultrasound imaging method also includes: obtaining the confidence of the ultrasound image corresponding to each modality included in the multimodal joint imaging mode, and generating a credibility map based on the confidence; and superimposing the credibility map on one of the ultrasound images displayed on the second ultrasound interface.

[0024] In one embodiment, a multimodal joint imaging mode corresponding to a currently operating ultrasound probe and / or a current examination mode is obtained so that: in response to an operation on the multimodal control, the multimodal joint imaging mode is entered.

[0025] In one embodiment, the multimodal joint ultrasound imaging method further includes: acquiring imaging parameters in the single-modal imaging mode of the first modality, and setting imaging parameters of the multimodal joint imaging mode according to the imaging parameters in the single-modal imaging mode of the first modality when entering the multimodal joint imaging mode;

[0026] In one embodiment, the imaging parameters in the single-modality imaging mode of the first modality include a region of interest and / or an imaging depth.

[0027] In one embodiment, in the single-modality imaging mode of the first modality, when entering the multi-modality joint imaging mode in response to a first operation on the multi-modality control, the first modality is used as a modality type included in the multi-modality joint imaging mode, and an ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

[0028] In one embodiment, in the multi-modality combined imaging mode, an exit control is also displayed; in response to an operation on the exit control, the multi-modality combined imaging mode is exited and the single-modality imaging mode of the first modality is re-entered.

[0029] In one embodiment, the first mode is B mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, power Doppler imaging mode or ultra-micro blood flow imaging mode.

[0030] In one embodiment, the modality types included in the multi-modal combined imaging mode include at least two of the B mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, energy Doppler imaging mode and ultra-micro blood flow imaging mode.

[0031] In one embodiment, in the multi-modality combined imaging mode, an exit control is also displayed; in response to an operation on the exit control, the multi-modality combined imaging mode is exited and the B-modality imaging mode is entered.

[0032] According to the second aspect, an embodiment provides a multi-modal combined ultrasound imaging method, comprising:

[0033] Displaying a multimodal control on the first operation interface;

[0034] In response to a first operation on the multimodal control, entering a multimodal joint imaging mode;

[0035] In the multi-modality combined imaging mode, performing multi-modality combined ultrasound imaging;

[0036] One or more ultrasound images corresponding to the multi-modality are displayed on the second ultrasound interface.

[0037] In one embodiment, in response to a second operation on the multimodal control, a multimodal joint imaging setting sub-interface is displayed on the second operation interface; the multimodal joint imaging setting sub-interface includes at least one of the following:

[0038] A first setting area for multi-modal image types; in response to an operation on the first setting area, setting the modality types included in the multi-modal joint imaging mode;

[0039] a second setting area for multimodal image layout; in response to an operation on the second setting area, setting an image layout of ultrasound images displayed on the second ultrasound interface; the image layout including the type, quantity and / or position of ultrasound images displayed on the second ultrasound interface;

[0040] A third setting area for the measurement mode; in response to an operation on the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

[0041] According to the third aspect, an embodiment provides an ultrasound imaging system, comprising: an ultrasound probe, a transmitting and receiving control circuit, a processor, and a display; the ultrasound probe is used to transmit ultrasound to a region of interest, and receive corresponding ultrasound echo signals; the transmitting and receiving control circuit is used to control the ultrasound probe to transmit ultrasound and receive ultrasound echo signals; the processor is used to execute the method described in the first aspect.

[0042] According to the multimodal combined ultrasound imaging method of the above-mentioned embodiment, since the multimodal combined ultrasound imaging is directly entered through the multimodal control, there is no need to combine different modalities in functions at different levels, and multimodal combination can be achieved with one click. In the process, the displayed multimodal control not only makes the multimodal combination intuitive, but also eliminates the need to combine the modalities one by one, which greatly improves the multimodal combination efficiency and gives users a better user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 is a schematic structural diagram of an ultrasonic imaging system according to an embodiment;

[0044] Figure 2 is a schematic diagram of a second operation interface of an embodiment;

[0045] Figure 3 is a schematic diagram of a second ultrasonic interface of an embodiment;

[0046] Figure 4 is a schematic diagram of a second ultrasonic interface of another embodiment;

[0047] Figure 5 is a schematic diagram of a second ultrasonic interface of yet another embodiment;

[0048] Figure 6 A flowchart of a multi-modal combined ultrasound imaging method according to an embodiment;

[0049] Figure 7 The present invention is a flowchart of a multi-modal combined ultrasound imaging method according to another embodiment. DETAILED DESCRIPTION

[0050] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0051] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0052] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0053] In the current solution, since each mode of ultrasound imaging is set in a function at a different level, when combining multiple modes, the modes need to be combined one by one in sequence, which requires the user to operate in functions at different levels. For example, in the shear wave elastic mode, it is necessary to first combine the viscous mode and then combine the fatty change detection mode in the advanced function. This process not only makes the combination of multiple modes very unintuitive, but also seriously reduces the efficiency of the combination of multiple modes.

[0054] In some embodiments of the present invention, by displaying a multimodal control on the operation interface, and responding to the operation of the multimodal control, the multimodal joint imaging mode can be directly entered. In this multimodal joint imaging mode, you can directly enter the multimodal joint ultrasound imaging, and display the ultrasound image corresponding to the multimodality on the ultrasound interface. Since the multimodal joint ultrasound imaging is directly entered through the multimodal control, there is no need to combine different modalities in the functions of different levels, and multimodal combination can be achieved with one click. In the process, the displayed multimodal control can not only make the multimodal combination intuitive, but also eliminate the need to combine the modalities one by one, which greatly improves the efficiency of multimodal combination and gives users a better user experience.

[0055] In some embodiments, an ultrasound imaging system is provided, which can quickly combine multiple ultrasound imaging modes during ultrasound imaging to meet the patient's detection needs. Figure 1 The ultrasound imaging system includes an ultrasound probe 10, a transmitting and receiving control circuit, a processor 20, a human-computer interaction device 70 and a memory 80, which will be described in detail below.

[0056] The ultrasonic probe 10 is used to transmit ultrasonic waves to the region of interest and receive corresponding ultrasonic echo signals. The ultrasonic probe 10 includes a transducer (not shown in the figure) composed of a plurality of array elements arranged in an array. The array element is used to transmit ultrasonic waves according to an excitation electrical signal, or to convert received ultrasonic waves into electrical signals. Therefore, each array element can be used to realize the mutual conversion between electrical pulse signals and ultrasonic waves, thereby realizing the transmission of ultrasonic waves to the biological tissue of the scanned object, and it can also be used to receive the echo of the ultrasonic waves reflected back by the tissue.

[0057] The transmitting and receiving control circuit is used to control the probe to transmit ultrasonic waves and receive ultrasonic echo signals. The transmitting and receiving control circuit may include a transmitting circuit 30 and a receiving circuit 40. The transmitting circuit 30 is used to stimulate the ultrasonic probe 10 to transmit ultrasonic waves to the scanned object according to the control of the processor 20. The receiving circuit 40 is used to receive the ultrasonic echo returned from the scanned object through the ultrasonic probe 10 to obtain an ultrasonic echo signal, and can also process the ultrasonic echo signal.

[0058] The human-computer interaction device 70 is used for human-computer interaction, such as outputting visual information and receiving user input. The user input can be received by a keyboard, operation button, mouse, trackball, touchpad, etc., or by a touch screen integrated with a display; the visual information can be output by a display, a touch display, a display screen, a touch display screen, etc. In some embodiments, the display may include two, one of which can be used to display the processing result of the ultrasonic echo signal as a main screen, such as displaying an ultrasonic image, and the other can be used to control the parameters of the ultrasonic imaging system as a sub-screen, such as controlling the selection of the ultrasonic probe 10, the ultrasonic mode, etc. It can be understood that the contents displayed on the main screen and the sub-screen can be exchanged in part or in whole.

[0059] The memory 80 is used to store various types of data.

[0060] Please refer to Figure 1 The ultrasound imaging system may further include a beamforming module 50 and an IQ demodulation module 60 .

[0061] The beamforming module 50 is connected to the receiving circuit 40 signal, and is used to perform beamforming processing such as corresponding delay and weighted summation on the echo signal. Since the distances from the ultrasonic receiving point in the measured tissue to the receiving array element are different, the channel data of the same receiving point output by different receiving array elements have delay differences, and delay processing is required to align the phases and perform weighted summation on the different channel data of the same receiving point to obtain the ultrasound image data after beamforming. The ultrasound image data output by the beamforming module 50 is also called radio frequency data (RF data). The beamforming module 50 outputs the RF data to the IQ demodulation module 60. In some embodiments, the beamforming module 50 may also output the RF data to the memory 80 for caching or storage, or directly output the RF data to the processor 20 for image processing.

[0062] The beamforming module 50 may perform the above functions in the form of hardware, firmware or software. The beamforming module 50 may be integrated in the processor 20 or may be separately provided, which is not limited in the present invention.

[0063] The IQ demodulation module 60 removes the signal carrier through IQ demodulation, extracts the tissue structure information contained in the signal, and performs filtering to remove noise. The signal obtained at this time is called a baseband signal (IQ data pair). The IQ demodulation module 60 outputs the IQ data pair to the processor 20 for image processing. In some embodiments, the IQ demodulation module 60 also outputs the IQ data pair to the memory 80 for caching or storage, so that the processor 20 reads the data from the memory 80 for subsequent image processing.

[0064] The IQ demodulation module 60 may also perform the above functions in the form of hardware, firmware or software. Similarly, the IQ demodulation module 60 may be integrated into the processor 20 or may be separately provided, which is not limited in the present invention.

[0065] The processor 20 is configured to be a central controller circuit (CPU), one or more microprocessors 20, a graphics controller circuit (GPU) or any other electronic component that can process input data according to specific logical instructions. It can control peripheral electronic components according to input instructions or predetermined instructions, or read and / or save data from the memory 80. It can also process the input data by executing the program in the memory 80, for example, performing one or more processing operations on the collected ultrasound data according to one or more working modes. The processing operations include but are not limited to adjusting or limiting the form of ultrasound waves emitted by the ultrasound probe 10, generating various image frames for subsequent display of the human-computer interaction device 70, or adjusting or limiting the content and form displayed on the display, or adjusting one or more image display settings displayed on the display (such as ultrasound images, interface components, and positioning areas of interest).

[0066] As echo signals are received, the acquired ultrasound data may be processed by the processor 20 in real time during scanning, or may be temporarily stored on the memory 80 and processed in quasi-real time in either on-line or off-line operation.

[0067] In this embodiment, the processor 20 controls the operation of the transmitting circuit 30 and the receiving circuit 40, for example, controls the transmitting circuit 30 and the receiving circuit 40 to work alternately or simultaneously. The processor 20 can also determine a suitable working mode according to the user's selection or the setting of the program, form a transmission sequence corresponding to the current working mode, and send the transmission sequence to the transmitting circuit 30, so that the transmitting circuit 30 uses the suitable transmission sequence to control the ultrasound probe 10 to transmit ultrasound waves.

[0068] The above are some descriptions of the ultrasound imaging system. The following is a specific description of the process of the ultrasound imaging system performing multi-modal combined ultrasound imaging.

[0069] The processor 20 enters the single-mode imaging mode of the first mode in response to the first modality imaging instruction. In some embodiments, the first modality imaging instruction can be generated based on the user's operation, such as based on the user's operation of the operation button on the ultrasound imaging system, or based on the user's voice input or gesture input to the ultrasound imaging system, or based on the user's operation of the virtual button of the touch display screen. In some embodiments, the first operation interface can be displayed through the secondary screen in the display, and the first operation interface is at least used to select the currently accessible ultrasound mode to obtain the first modality imaging instruction, thereby entering the single-mode imaging mode of the first mode. In some embodiments, the first mode includes B mode, shear wave elastic mode, viscosity mode, sound velocity mode, strain elastic mode, acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, energy Doppler imaging mode or ultra-micro blood flow imaging mode. The image corresponding to the single mode can include different types of images, such as the shear wave elastic mode includes B image and elastic image, the image corresponding to the viscosity mode can include B image and viscosity image, and the contrast mode includes B image and contrast image. In some embodiments, when the first mode is B mode, the single-mode imaging mode of B mode can be entered directly in response to the first mode imaging instruction. When the first mode is not B mode, such as shear wave elastic mode, the B mode can be entered first, and then the shear wave elastic mode can be entered in response to the first mode imaging instruction. Alternatively, the shear wave elastic mode can be entered directly in response to the first mode imaging instruction (usually, a B image and an elastic map can be generated in this mode). During the ultrasonic imaging process, the B image obtained by the B mode is the result of a two-dimensional grayscale ultrasonic examination, that is, the B image is a grayscale image of the signal strength changes within the scanning range. The grayscale image reflects the anatomical structure inside the tissue, so it can be used for preliminary examination to find the lesion area.

[0070] In the single-modality imaging mode of the first mode, the processor 20 controls the ultrasound probe 10 to perform ultrasound imaging of the first mode through the transmitting and receiving control circuits, and displays the ultrasound image of the first mode on the first ultrasound interface. In some embodiments, the first ultrasound interface can be displayed through the main screen in the display, and the ultrasound image of the first mode can be displayed in the first ultrasound interface. For example, when the first mode is the B mode, the B image is displayed, and when the first mode is the shear wave elastic mode, the shear wave elastic image is displayed. In some embodiments, the first ultrasound interface also displays the imaging parameters in the single-modality imaging mode of the first mode, such as displaying ROI (region of interest, imaging depth, etc. In this embodiment, in the single-modality imaging mode of the first mode, the user can perform an inspection of the ultrasound detection object in this mode based on a single mode, and analyze the lesion area in this mode.

[0071] Please refer to Figure 2, the processor 20 can also control the first operation interface to display a multimodal control E (M-Reference). When the single-modal analysis of the lesion area cannot meet the needs, the processor 20 can respond to the user's first operation on the multimodal control E and enter the multimodal joint imaging mode. The modal types included in the multimodal joint imaging mode include at least two of the B mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, energy Doppler imaging mode and ultra-micro blood flow imaging mode. Among them, the first operation can be the operation of the operation button, the touch and click operation of the multimodal control E, the voice input operation, etc., for example, the user touches and clicks the multimodal control E to enter the multimodal joint imaging mode. In the multimodal joint imaging mode, the processor 20 controls the ultrasound probe 10 to perform multimodal joint ultrasound imaging through the transmission and reception control circuit, such as ultrasound imaging of multiple modes alternately or simultaneously, and can display the second ultrasound interface through the main screen in the display. The second ultrasound interface displays one or more ultrasound images corresponding to the multimodality. Please refer to Figure 3 , for example, an ultrasound image corresponding to one mode in the multi-modality can be displayed, or multiple ultrasound images corresponding to the multi-modality can be displayed simultaneously. In this embodiment, the first ultrasound interface and the second ultrasound interface can be the same interface or different interfaces. For example, after the single-modality imaging mode enters the multi-modality joint imaging mode, the first ultrasound interface can switch the ultrasound image and other display contents to obtain the second ultrasound interface, or the first ultrasound interface can be directly switched to the second ultrasound interface, or the second ultrasound interface can be directly popped up. In this embodiment, when the first mode in the single-modality imaging mode is the B mode, in response to the user's first operation on the multi-modality control E, and entering the multi-modality joint imaging mode, it can be called direct multi-modality joint. When the first mode in the single-modality imaging mode is not the B mode, for example, the first mode is the shear wave elastic mode, since it is generally necessary to enter the B mode before entering the shear wave elastic mode, in response to the user's first operation on the multi-modality control E, and entering the multi-modality joint imaging mode, it can be called indirect / midway multi-modality joint.

[0072] In some embodiments, in the single-modality imaging mode of the first modality, the processor 20 also determines whether the single-modality imaging mode of the first modality supports switching to the multi-modality joint imaging mode based on the first modality. If supported, the processor 20 controls the first operation interface to display the multi-modality control E, or displays the multi-modality control E as an available state. If not supported, the multi-modality control E is not displayed, or the multi-modality control E is displayed as an unavailable state. In some embodiments, when the multi-modality control E is in an available state, the multi-modality control E can be operated or selected, and when it is in an unavailable state, it cannot be operated or selected. At the same time, the available state and unavailable state of the multi-modality control E can also be reflected by different identifiers, such as using different color identifiers or character identifiers. In this embodiment, when the first mode can be combined with at least one other mode, it is judged that the single-mode imaging mode of the first mode supports switching to the multi-modal combined imaging mode. For example, when the first mode is the B mode, it can be combined with other modes such as the shear wave elastic mode, the viscosity mode, the strain elastic mode or the acoustic attenuation mode, so it supports switching to the multi-modal combined imaging mode. On the contrary, when the first mode cannot be combined with at least one other mode, it is judged that the single-modal imaging mode of the first mode does not support switching to the multi-modal combined imaging mode.

[0073] In some embodiments, in the multimodal joint imaging mode, the processor 20 is also used to obtain the confidence of the ultrasound image corresponding to each mode included in the multimodal joint imaging mode, and generate a credibility map based on the confidence, for example, the confidence of each ultrasound image is weighted to obtain a credibility map (RLB Map), and then the credibility map is displayed in the second ultrasound interface. The map can be displayed alone or superimposed on images of other modes, such as superimposed on one of the ultrasound images displayed on the second ultrasound interface. For example, when a B image, a shear wave elasticity image, a viscosity image, a sound velocity image, and an acoustic attenuation image are displayed at the same time, the credibility map can be superimposed on the B image. In one embodiment, five images are displayed at the same time, namely, a B image, a shear wave elasticity image, a viscosity image, a sound velocity image, and an acoustic attenuation image, as well as an image with a B image as the background and a credibility map as the foreground.

[0074] In some embodiments, in the single-modality imaging mode of the first modality, the processor 20 is further used to obtain imaging parameters in the single-modality imaging mode of the first modality, and when entering the multi-modality joint imaging mode, the imaging parameters of the multi-modality joint imaging mode are set according to the imaging parameters in the single-modality imaging mode of the first modality. In this embodiment, since the ultrasound detection object can be inspected in the first modality and the lesion area can be analyzed in the first modality, the imaging parameters in the first modality can be retained as much as possible when entering the multi-modality joint imaging mode, or the imaging parameters in the first modality can be close to the imaging parameters in the first modality, thereby improving the efficiency of entering the multi-modality joint. In some embodiments, the imaging parameters in the single-modality imaging mode of the first modality include a region of interest and an imaging depth. When setting the imaging parameters of the multi-modality joint imaging mode, the region of interest and the imaging depth in the first modality can be directly used as the region of interest and the imaging depth in the multi-modality joint imaging mode. In some embodiments, when setting the imaging parameters of the multi-modal combined imaging mode, it is also necessary to limit them to the largest of the modes included in the multi-modal combined imaging mode, that is, when the imaging parameters under the first modality are used as the imaging parameters under the multi-modal combined imaging mode, the imaging parameters under the first modality cannot exceed the maximum imaging parameters of other modalities. If they exceed, the imaging parameters under the first modality can be adjusted so that the adjusted imaging parameters are limited to the largest imaging parameters of the modes included in the multi-modal combined imaging mode.

[0075] In some embodiments, in the single-modality imaging mode of the first modality, when the processor 20 enters the multi-modality joint imaging mode in response to the first operation on the multi-modality control E, the processor 20 uses the first modality as a modality type included in the multi-modality joint imaging mode, and displays the ultrasound image corresponding to the first modality on the second ultrasound interface. In this embodiment, since it is necessary to first enter the single-modality imaging mode of the first modality before entering the multi-modality joint imaging mode to find the lesion area, when entering the multi-modality joint imaging mode based on the first modality, the first modality is used as a modality type included in the multi-modality joint imaging mode, thereby improving the efficiency of entering the multi-modality combination.

[0076] In some embodiments, when entering the multimodal joint imaging mode in response to the first operation of the multimodal control E, there may be one multimodal joint imaging mode, and the multiple modes included therein may be default or a pre-set modal combination. In some embodiments, there may be multiple multimodal joint imaging modes, and the multiple modes included in each multimodal joint imaging mode may be completely different or partially different, so one may be selected from them when entering the multimodal joint imaging mode. In some embodiments, if there are multiple multimodal joint imaging modes, when entering the multimodal joint imaging mode, the currently working ultrasound probe 10 and / or the current inspection mode may be obtained, and a corresponding multimodal joint imaging mode may be selected. In this embodiment, since the inspection site and target can be basically determined based on the previously working ultrasound probe 10 and / or the current inspection mode, the default multimodal joint imaging mode of the inspection site may be set. For example, when it is determined that the inspection site is the abdomen, the default multimodal joint imaging mode includes B mode, shear wave elastic mode, viscosity mode and acoustic attenuation mode. When it is determined that the inspection site is the breast, its default multimodal combined imaging mode includes B mode, shear wave elastic mode, strain elastic mode and viscous mode. When it is determined that the inspection site is the thyroid gland, its default multimodal combined imaging mode includes B mode, shear wave elastic mode and strain elastic mode. When it is determined that the inspection site is gynecological or prostate, its default multimodal combined imaging mode includes B mode, shear wave elastic mode, viscous mode and strain elastic mode. In this embodiment, by setting the default multimodal combined imaging mode, the user can quickly enter the multimodal combination to improve the efficiency of the multimodal combination.

[0077] From the above, it can be seen that since the multimodal combined ultrasound imaging is directly entered through the multimodal control E, there is no need to combine different modalities in the functions of different levels, and multimodal combination can be achieved with one click. And in this process, in the single-modal imaging mode of the first modality, the first modality is used as a modality type included in the multimodal combined imaging mode, and the imaging parameters of the multimodal combined imaging mode are set according to the imaging parameters in the single-modal imaging mode of the first modality, so as to further improve the multimodal combination efficiency, and by setting the default multimodal combined imaging mode, the user can quickly enter the multimodal combination, so as to greatly improve the multimodal combination efficiency.

[0078] Please refer to Figure 2In some embodiments, the processor 20 may also respond to a second operation on the multimodal control E, and may display a second operation interface through a secondary screen in the display, the second operation interface being at least used to display a multimodal joint imaging setting sub-interface, and the multimodal joint imaging setting sub-interface is used to display relevant information in the multimodal joint imaging mode. In some embodiments, the first operation and the second operation may be the same operation or different operations. In some embodiments, the multimodal joint imaging setting sub-interface includes one or more of a first setting area A of a multimodal image type, a second setting area B of a multimodal image layout, and a third setting area C of a measurement mode. Among them, the first setting area A of the multimodal image type is used to display the modality types included in the modality joint imaging mode. The second setting area B of the multimodal image layout is used to display the layout of the modality types included in the modality joint imaging mode, and the layout of the modality types may correspond to the image layout of the ultrasound image displayed on the second ultrasound interface. The third setting area C of the measurement mode is used to display the measurement mode of the ultrasound image displayed on the second ultrasound interface in the modality joint imaging mode.

[0079] Please refer to Figure 2In some embodiments, the processor 20 can also respond to the operation of the first setting area A to set the modality types included in the multi-modality joint imaging mode, for example, the set modality types include at least two of B mode (B), shear wave elastic mode (STE), viscous mode (STVi), strain elastic mode (STQ) and acoustic attenuation mode (USTA), ultrasonic Doppler blood flow imaging mode (Clolor), power Doppler imaging mode (PW) and ultra-micro blood flow imaging mode (UMA). In some embodiments, the first setting area A of the multi-modality image type includes a plurality of selection controls A1, each of which corresponds to a modality. Each selection control A1 has a selected state and an unselected state. When the selection control A1 is in the selected state, the modality types included in the multi-modality joint imaging mode include the modality corresponding to the selection control A1. Conversely, when the selection control A1 is in the unselected state, the modality corresponding to the selection control A1 is not included. The processor 20 can also control the selection control A1 to switch between a selected state and an unselected state in response to the operation on the selection control A1. For example, the selection control A1 in the selected state can switch to an unselected state in response to the operation on itself. For example, the B mode, the shear wave elastic mode, the viscous mode, the strain elastic mode and the acoustic attenuation mode each correspond to a selection control A1, and the selection control A1 can be a virtual button on a touch screen, and the virtual button can display an unoperated state and an operated state, thereby corresponding to the unselected state and the selected state respectively. For example, the unoperated state and the operated state can be reflected by different colors or different logos. In this embodiment, when the selection control A1 is operated and in the selected state, there is a checked mark on the selection control A1, and when the selection control A1 is operated and in the unselected state, there is no checked mark. For example, when the selection controls A1 corresponding to the B mode and the shear wave elastic mode are selected, they have a checked mark, while other selection controls A1 do not have a checked mark. At this time, the modality types included in the multimodal joint imaging mode include the B mode and the shear wave elastic mode. In some embodiments, when different modalities can be combined, the selection controls A1 corresponding to the different modalities can be selected at the same time. Conversely, when different modalities cannot be combined, only one of the corresponding selection controls A1 can be selected.

[0080] In some embodiments, the processor 20 can also set the image layout of the ultrasound image displayed on the second ultrasound interface in response to the operation of the second setting area B, and the image layout includes the type, number and / or position of the ultrasound image displayed on the second ultrasound interface.

[0081] Please refer to Figure 2In some embodiments, the second setting area B of the multimodal image layout includes a plurality of modal image display controls B1, each modal image display control B1 corresponds to a mode, for example, corresponding to one of the B mode, shear wave elastic mode, viscous mode, strain elastic mode and acoustic attenuation mode. In some embodiments, in the initial state, the modal image display controls B1 included in the second setting area B correspond to the modality types included in the multimodal joint imaging mode set in the first setting area A. For example, if the first setting area A sets the multimodal joint imaging mode to include the B mode and the shear wave elastic mode, then in the initial state, the second setting area B includes the modal image display controls B1 corresponding to the B mode and the shear wave elastic mode. In some embodiments, each modality image display control B1 has a first state and a second state, wherein the first state can be used to indicate that the modality corresponding to the modality image display control B1 is in an open state, and the ultrasound image corresponding to the modality in the open state will be displayed on the second ultrasound interface, whereas the second state can be used to indicate that the modality corresponding to the modality image display control B1 is in a closed state, and the ultrasound image corresponding to it will not be displayed on the second ultrasound interface. In some embodiments, when the modality image display control B1 is in different states, it can be displayed by different identifiers, for example, by different colors, characters, texts, shapes, etc. In some embodiments, the different states of the modality image display control B1 can also be reflected by whether the modality image display control B1 exists in the second setting area B, for example, when the modality image display control B1 exists in the second setting area B, it is in the first state, and vice versa, when it does not exist in the second setting area B, it is in the second state. In this embodiment, when the image display control is in the first state, the image display control will also display the ON identifier, and when it is in the second state, the OFF identifier will also be displayed. In some embodiments, the processor 20 can also respond to the operation of the modal image display control B1 so that the modal image display control B1 can switch between the first state and the second state. For example, the modal image display control B1 in the first state is touched to switch it to the second state, for example, the modal image display control B1 is touched and dragged to make the second setting area B exist or not exist. In some embodiments, the processor 20 can also respond to the operation of the modal image display control B1 to set the mode corresponding to the modal image display control B1. For example, the processor 20 controls the modal image display control B1 to display a drop-down menu in response to the click operation on the modal image display control B1, and the options of the drop-down menu are different modes, for example, the options include B mode, shear wave elastic mode, viscous mode, strain elastic mode and acoustic attenuation mode. In response to the selection operation of the option in the drop-down menu, the processor 20 sets the mode corresponding to the modal image display control B1 to the selected mode.In this embodiment, the modalities corresponding to the various modal image display controls B1 may not be allowed to exist in the same manner. For example, when there is a modal image display control B1 corresponding to the B mode, the modalities corresponding to other modal image display controls B1 cannot select the B mode. The modalities corresponding to the various modal image display controls B1 may also be allowed to exist in the same manner. For example, there are two or more modal image display controls B1 corresponding to the B mode. In some embodiments, the processor 20 may also set the position of the modal image display control B1 in the second setting area B in response to the operation on the modal image display control B1. For example, in response to the drag operation of the modal image display control B1 in the second setting area B, the modal image display control B1 is moved to the corresponding position. For example, in response to the touch operation of the modal image display control B1 in the second setting area B, the modal image display control B1 is moved in the default direction, for example, in one or a combination of the default directions of upward, downward, left and right. In some embodiments, the processor 20 also adaptively adjusts the positions of other modal image display controls B1 according to the position to which the modal image display control B1 is moved. For example, when there are other modal image display controls B1 at the position to which the modal image display control B1 is moved, the other modal image display controls B1 can exchange positions with the moved modal image display control B1, or can move in a default direction or a random direction.

[0082] The above is some description of the modality image display control B1 in the second setting area B. As can be seen from the above, the processor 20 can adjust the state, the corresponding modality and the position in the second setting area B in response to the operation of the modality image display control B1. The following is a specific description of the image layout of the ultrasound image displayed on the second ultrasound interface set by the processor 20 in response to the operation of the second setting area B.

[0083] Please refer to Figure 2 and Figure 3In some embodiments, the processor 20 obtains the control layout information of the modality image display control B1 in the first state in the second setting area B, and then sets the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, and displays the ultrasound image on the second ultrasound interface according to the image layout. In some embodiments, the control layout information includes the modality, quantity, and position relationship corresponding to the modality image display control B1 in the first state in the second setting area B. In this embodiment, the modality, quantity, and position relationship corresponding to the modality image display control B1 have a certain correspondence or logical relationship with the type, quantity, and position of the ultrasound image. For example, when the modality corresponding to the modality image display control B1 corresponds to the type of ultrasound image one-to-one, if the modality corresponding to the modality image display control B1 includes the B mode, the type of ultrasound image displayed on the second ultrasound interface includes the B image. The number of modality image display controls B1 is consistent with the number of ultrasound images, and the position relationship of the modality image display control B1 of the modality image display control B1 corresponds to the position of the ultrasound image one-to-one. Therefore, the control layout information of the modal image display control B1 may have a mapping relationship with the image layout of the ultrasound image. When the processor 20 obtains the control layout information, the image layout of the ultrasound image may be obtained from the control layout information according to the mapping relationship. Figure 2 In some embodiments, the second setting area B has four control positions B2, which are respectively the first position, the second position, the third position and the fourth position, please refer to Figure 3, there are four display areas D on the second ultrasound interface, which are the first display area, the second display area, the third display area and the fourth display area. In this embodiment, the first position, the second position, the third position and the fourth position have a certain correspondence with the first display area, the second display area, the third display area and the fourth display area, so the ultrasound image displayed on the second ultrasound interface can be set according to the control layout information of the modal image display control B1 in the first state, for example, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively, so the processor 20 can be set in each display area D to display the ultrasound image of the modality corresponding to the modality image display control B1 placed on its corresponding control position B2. For example, if there is a modality image display control B1 in the first state at the first position, and its corresponding modality is B mode, then the B image corresponding to the B mode is displayed in the first display area. In some embodiments, the four control positions B2 and the four display areas D are arranged in two rows and two columns. It is understandable that the number of control positions B2 and display areas D can be increased or decreased according to the shape and size of the display, and other forms of arrangement of control positions B2 and display areas D can be adopted. In this embodiment, the control positions B2 and display areas D correspond one to one, and the position arrangement of the display areas D is fixed, which does not change with the number and position relationship of the modal image display controls B1 in the first state.

[0084] In some embodiments, the position arrangement of each display area D can be changed, so that the size of the display area D can be adjusted to adapt to different usage scenarios. In some embodiments, the processor 20 can set the position arrangement of the ultrasound image displayed on the second ultrasound interface according to the number and position relationship of the modal image display controls B1 in the first state. Please refer to Figure 3 In this embodiment, the second setting area B has four control positions B2, and is arranged in two rows and two columns. When the number of modal image display controls B1 in the first state is four or three, and each is located at a control position B2, the processor 20 sets the second ultrasound interface to display four display areas D, and arranges them in two rows and two columns. At this time, the first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The processor 20 is set to display the ultrasound image of the modality corresponding to the modal image display control B1 placed on the corresponding control position B2 in each display area D.

[0085] Please refer to Figure 4In some embodiments, when the number of modal image display controls B1 in the first state is two and they are respectively located at a control position B2, the processor 20 sets two display areas D to be displayed on the second ultrasound interface, and they are arranged left and right, such as the first display area on the left and the second display area on the right. The size of the two display areas D may be smaller or larger than the size of four display areas D, or may be the same size. At this time, the processor 20 is also set to display the ultrasound image of the modality corresponding to the modality of the modal image display control B1 in the front position sequence in the first display area, and the ultrasound image of the modality corresponding to the modality of the modal image display control B1 in the back position sequence in the second display area, wherein the first position, the second position, the third position and the fourth position have a default position sequence, such as the position sequence of the first position, the second position, the third position and the fourth position decreases or increases in sequence. For example, the modal image display control B1 in the first state is respectively located at the first position and the third position, then the first display area displays the ultrasound image of the modality corresponding to the modality of the modal image display control B1 in the first position, and the second display area displays the ultrasound image of the modality corresponding to the modality of the modal image display control B1 in the third position. Please refer to Figure 4 In some embodiments, when the number of modal image display controls B1 in the first state is one and is located at a control position B2, the processor 20 sets two display areas D arranged left and right on the second ultrasound interface, such as a first display area on the left and a second display area on the right, and sets the ultrasound image of the modality corresponding to the modality image display control B1 to be displayed in the first display area. Please refer to Figure 5 In some embodiments, when the number of modal image display controls B1 in the first state is one and is located at a control position B2, the processor 20 sets a display area D to be displayed on the second ultrasound interface, and sets the display area D to display an ultrasound image of the modality corresponding to the modality image display control B1.

[0086] In some embodiments, the processor 20 may also respond to the operation on the second setting area B to update the image layout of the ultrasound image displayed on the second ultrasound interface accordingly when the control layout information of the modal image display control B1 in the first state in the second setting area B changes. For example, when the modal image display control B1 in the first state in the second setting area B is increased or the position is changed, the ultrasound image of the modality corresponding to the modality image display control B1 in the first state will be added and displayed on the second ultrasound interface or the position will be changed accordingly. In this embodiment, the image layout of the ultrasound image can be based on the operation on the second setting area B to achieve real-time updates, thereby meeting the user's real-time layout requirements and layout adjustments.

[0087] As can be seen from the above, the user can adjust the mode, quantity and position relationship corresponding to the modal image display control B1, thereby adjusting the control layout of the image display control, and the control layout of the modal image display control B1 can correspond one-to-one to the image layout of the ultrasound image, so that each display area D is set to display the ultrasound image of the modality corresponding to the modality image display control B1 placed on its corresponding control position B2. It is also possible to readjust the image layout of the ultrasound image according to the change in the quantity and position relationship of the modal image display control B1 in the first state to adapt to different usage scenarios. And when the control layout of the modal image display control B1 changes in real time, the image layout of the ultrasound image can be updated in real time, thereby achieving flexible and efficient image layout adjustment.

[0088] Please refer to Figure 2 In some embodiments, the processor 20 may also set a measurement mode for the ultrasound image displayed on the second ultrasound interface in response to an operation on the third setting area C. The measurement mode includes a first measurement mode (MRefTrace) and a second measurement mode (TMRef). The first measurement mode is a measurement mode for manually outlining the boundary of the area to be measured. In this measurement mode, the user can outline the boundary of the area to be measured based on the user's manual operation, such as outlining based on a trackball operation. The second measurement mode is a measurement mode for a preset boundary graphic. In this measurement mode, the preset boundary graphic is pre-set, such as an ellipse, a circle, or a square. In response to the operation on the third setting area C, the processor 20 selects one of the first measurement mode and the second measurement mode as the measurement mode for the ultrasound image displayed on the second ultrasound interface.

[0089] In some embodiments, in the multimodal joint imaging mode, an exit control is also displayed, for example, the exit control is displayed on the first operation interface or the second operation interface, or the processor 20 can control the secondary screen in the display to display the third operation interface, and display the exit control on the third operation interface. The processor 20 is also used to respond to the operation of the exit control to exit the multimodal joint imaging mode. In this embodiment, after entering the multimodal joint imaging mode, if the user needs to readjust the relevant parameters or complete the current examination, the multimodal joint imaging mode can be exited based on the operation of the exit control. In some embodiments, the multimodal joint imaging mode can also be exited based on the operation of the exit control and re-enter the single-modal imaging mode of the first mode, so as to quickly readjust or perform the next multimodal joint imaging mode. In some embodiments, in the multimodal joint imaging mode, an exit control is also displayed; in response to the operation of the exit control, the multimodal joint imaging mode is exited and the B-mode imaging mode is entered.

[0090] Please refer to Figure 6In some embodiments, a multi-modal combined ultrasound imaging method is provided, which is used in the above-mentioned ultrasound imaging system to quickly combine multiple modes of ultrasound imaging when performing ultrasound imaging, thereby meeting the patient's detection needs. The multi-modal combined ultrasound imaging method may include the following steps:

[0091] Step 100: In response to a first modality imaging instruction, enter a single modality imaging mode of the first modality.

[0092] Step 200: In the single-modality imaging mode of the first modality, ultrasound imaging of the first modality is performed and the ultrasound image of the first modality is displayed on a first ultrasound interface.

[0093] Step 300: Display a multimodal control E on a first operation interface; in response to a first operation on the multimodal control E, enter a multimodal joint imaging mode.

[0094] Step 400: In the multi-modality combined imaging mode, multi-modality combined ultrasound imaging is performed and one or more ultrasound images corresponding to the multi-modality are displayed on a second ultrasound interface.

[0095] In some embodiments, in response to a second operation on the multimodal control E, a multimodal joint imaging setting sub-interface is displayed on the second operation interface; the multimodal joint imaging setting sub-interface includes at least one of the following:

[0096] A first setting area A for multi-modal image types; in response to an operation on the first setting area A, setting the modality types included in the multi-modal joint imaging mode.

[0097] A second setting area B for a multimodal image layout; in response to an operation on the second setting area B, an image layout of ultrasound images displayed on the second ultrasound interface is set; the image layout includes the type, quantity and / or position of ultrasound images displayed on the second ultrasound interface.

[0098] A third setting area C for the measurement mode; in response to an operation on the third setting area C, the measurement mode for the ultrasound image displayed on the second ultrasound interface is set.

[0099] In some embodiments, the first setting area A of the multimodal image type includes multiple selection controls A1, each selection control A1 corresponds to a modality; the selection control A1 has a selected state and an unselected state; when the selection control A1 is in the selected state, the modality types included in the multimodal joint imaging mode include the modality corresponding to the selection control A1, and conversely, when the selection control A1 is in the unselected state, the modality types included in the multimodal joint imaging mode do not include the modality corresponding to the selection control A1; in response to the operation of the selection control A1, the selection control A1 switches between the selected state and the unselected state.

[0100] In some embodiments, the second setting area B of the multimodal image layout includes multiple modal image display controls B1, each modal image display control B1 corresponds to a modality, and the modal image display control B1 has at least a first state; the control layout information of the modal image display control B1 in the setting area that is in the first state is obtained, and the image layout of the ultrasound image displayed on the second ultrasound interface is set according to the control layout information, so as to display the ultrasound image on the second ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control B1 in the first state in the setting area changes, the image layout of the ultrasound image displayed on the second ultrasound interface is updated accordingly.

[0101] In some embodiments, the measurement mode includes a first measurement mode and a second measurement mode, the first measurement mode is a measurement mode for manually outlining the boundary of the area to be measured, and the second measurement mode is a measurement mode for a preset boundary graphic; in response to an operation on the third setting area C of the measurement mode, one of the first measurement mode and the second measurement mode is selected as the measurement mode for the ultrasound image displayed on the second ultrasound interface.

[0102] In some embodiments, the multimodal combined ultrasound imaging method also includes: in the single-modal imaging mode of the first modality, judging based on the first modality whether the single-modal imaging mode of the first modality supports switching to the multimodal combined imaging mode; if supported, displaying the multimodal control E on the first operation interface; if not supported, not displaying the multimodal control E, or displaying the multimodal control E as unavailable.

[0103] In some embodiments, the multimodal joint ultrasound imaging method also includes: obtaining the confidence of the ultrasound image corresponding to each modality included in the multimodal joint imaging mode, and generating a credibility map based on the confidence; and superimposing the credibility map on one of the ultrasound images displayed on the second ultrasound interface.

[0104] In some embodiments, the multimodal combined ultrasound imaging method also includes: obtaining a multimodal combined imaging mode corresponding to the currently working ultrasound probe 10 and / or the current inspection mode, so that: in response to the operation of the multimodal control E, entering the multimodal combined imaging mode.

[0105] In some embodiments, the multimodal combined ultrasound imaging method further includes: acquiring imaging parameters in the single-modal imaging mode of the first modality, and setting the imaging parameters of the multimodal combined imaging mode according to the imaging parameters in the single-modal imaging mode of the first modality when entering the multimodal combined imaging mode. In some embodiments, the imaging parameters in the single-modal imaging mode of the first modality include a region of interest and / or an imaging depth.

[0106] In some embodiments, in the single-modality imaging mode of the first modality, when the multi-modality joint imaging mode is entered in response to a first operation on the multi-modality control E, the first modality is used as a modality type included in the multi-modality joint imaging mode, and an ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

[0107] In some embodiments, in the multi-modality combined imaging mode, an exit control is also displayed; in response to an operation on the exit control, the multi-modality combined imaging mode is exited and the single-modality imaging mode of the first modality is re-entered.

[0108] Please refer to Figure 7 In some embodiments, a multi-modal combined ultrasound imaging method is provided, which is used in the above-mentioned ultrasound imaging system to quickly combine multiple modes of ultrasound imaging when performing ultrasound imaging, thereby meeting the patient's detection needs. The multi-modal combined ultrasound imaging method may include the following steps:

[0109] Step 110: Display a multimodal control E on the first operation interface.

[0110] Step 210: In response to a first operation on the multimodal control E, entering a multimodal joint imaging mode.

[0111] Step 310: In the multi-modality combined imaging mode, perform multi-modality combined ultrasound imaging.

[0112] Step 410: Display one or more ultrasound images corresponding to the multi-modality on the second ultrasound interface.

[0113] It can be seen from the above-mentioned multimodal combined ultrasound imaging method that since the multimodal combined ultrasound imaging is directly entered through the multimodal control E, there is no need to combine different modalities in the functions of different levels, and multimodal combination can be achieved with one click. In this process, the displayed multimodal control E can not only make the multimodal combination intuitive, but also eliminate the need to combine the modalities one by one, which greatly improves the multimodal combination efficiency and gives users a better user experience.

[0114] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, various operating steps and components for performing the operating steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0115] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. In addition, as understood by those skilled in the art, the principles of this article can be reflected in a computer program product on a computer-readable storage medium, which is pre-installed with a computer-readable program code. Any tangible, non-temporary computer-readable storage medium can be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD to ROM, DVD, Blu Ray disks, etc.), flash memory and / or the like. These computer program instructions can be loaded onto a general-purpose computer, a special-purpose computer or other programmable data processing device to form a machine, so that these instructions executed on a computer or other programmable data processing device can generate a device that implements a specified function. These computer program instructions can also be stored in a computer-readable memory, which can instruct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory can form a manufactured product, including an implementation device that implements a specified function. Computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operating steps are performed on a computer or other programmable device to generate a computer-implemented process, so that the instructions executed on a computer or other programmable device can provide steps for implementing a specified function.

[0116] Although the principles of this invention have been shown in various embodiments, many modifications of structures, arrangements, proportions, elements, materials and components particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments will be included in the scope of this invention.

[0117] The foregoing specific description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Therefore, the consideration of the present disclosure will be illustrative rather than restrictive, and all these modifications will be included in its scope. Similarly, the advantages, other advantages and solutions to the problems of various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more clear, should not be interpreted as critical, necessary or necessary. The term "include" and any other variants used in this article are all non-exclusive inclusions, so that the process, method, article or device including the list of elements not only includes these elements, but also includes other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0118] Those skilled in the art will appreciate that many changes may be made to the details of the above-described embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. A multimodal combined ultrasound imaging method, characterized in that: include: In response to the first modality imaging instruction, entering a single-modality imaging mode of the first modality; In the single-modality imaging mode of the first modality, performing ultrasound imaging of the first modality and displaying the ultrasound image of the first modality on a first ultrasound interface; Displaying a multimodal control on a first operation interface; entering a multimodal joint imaging mode in response to a first operation on the multimodal control; In the multi-modality combined imaging mode, multi-modality combined ultrasound imaging is performed and one or more ultrasound images corresponding to the multi-modality are displayed on the second ultrasound interface.

2. The method according to claim 1, characterized in that In response to a second operation on the multimodal control, a multimodal joint imaging setting sub-interface is displayed on the second operation interface; the first operation and the second operation are the same operation or different operations, and the multimodal joint imaging setting sub-interface includes at least one of the following: A first setting area for multi-modal image types; in response to an operation on the first setting area, setting the modality types included in the multi-modal joint imaging mode; a second setting area for multimodal image layout; in response to an operation on the second setting area, setting an image layout of ultrasound images displayed on the second ultrasound interface; the image layout including the type, quantity and / or position of ultrasound images displayed on the second ultrasound interface; A third setting area for the measurement mode; in response to an operation on the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

3. The method according to claim 2, characterized in that The first setting area of ​​the multimodal image type includes a plurality of selection controls, each selection control corresponds to a modality; the selection control has a selected state and an unselected state; when the selection control is in the selected state, the modality types included in the multimodal joint imaging mode include the modality corresponding to the selection control, and conversely, when the selection control is in the unselected state, the modality types included in the multimodal joint imaging mode do not include the modality corresponding to the selection control; In response to an operation on the selection control, the selection control switches between the selected state and the unselected state.

4. The method according to claim 2, characterized in that The second setting area of ​​the multimodal image layout includes a plurality of modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state; Acquire control layout information of the modal image display control in the first state within the setting area, set the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, so as to display the ultrasound image on the second ultrasound interface according to the image layout; in response to the operation on the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the second ultrasound interface accordingly.

5. The method according to claim 2, characterized in that The measurement mode includes a first measurement mode and a second measurement mode, the first measurement mode is a measurement mode for manually outlining the boundary of the area to be measured, and the second measurement mode is a measurement mode for preset boundary graphics; In response to a third setting area operation on the measurement mode, one of the first measurement mode and the second measurement mode is selected as a measurement mode for the ultrasound image displayed on the second ultrasound interface.

6. The method according to claim 1, characterized in that Also includes: In the single-modality imaging mode of the first modality, determining whether the single-modality imaging mode of the first modality supports switching to the multi-modality joint imaging mode based on the first modality; If supported, displaying the multimodal control on the first operation interface; If not supported, the multimodal control will not be displayed, or the multimodal control will be displayed in an unavailable state.

7. The method according to claim 1, characterized in that Also includes: The confidence of the ultrasound image corresponding to each modality included in the multi-modality joint imaging mode is obtained, and a credibility map is generated based on the confidence.

8. The method according to claim 1, characterized in that Also includes: A multimodal joint imaging mode corresponding to the currently operating ultrasound probe and / or the current examination mode is obtained, so that: in response to the operation of the multimodal control, the multimodal joint imaging mode is entered.

9. The method according to claim 1, characterized in that Also includes: Acquiring imaging parameters in the single-modality imaging mode of the first modality, and setting imaging parameters of the multi-modality combined imaging mode according to the imaging parameters in the single-modality imaging mode of the first modality when entering the multi-modality combined imaging mode; Preferably, the imaging parameters in the single-modality imaging mode of the first modality include a region of interest and / or an imaging depth.

10. The method according to claim 1, characterized in that In the single-modality imaging mode of the first modality, when entering the multi-modality joint imaging mode in response to a first operation on the multi-modality control, the first modality is used as a modality type included in the multi-modality joint imaging mode, and an ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

11. The method according to claim 1, characterized in that In the multi-modality joint imaging mode, an exit control is also displayed; in response to an operation on the exit control, the multi-modality joint imaging mode is exited and the single-modality imaging mode of the first modality is re-entered.

12. The method according to claim 1, characterized in that The first mode is B mode, shear wave elastic mode, viscous mode, strain elastic mode, sound velocity mode, sound attenuation mode, ultrasonic Doppler blood flow imaging mode, power Doppler imaging mode or ultra-micro blood flow imaging mode.

13. The method according to claim 1, characterized in that The modality types included in the multi-modality combined imaging mode include at least two of B mode, shear wave elastic mode, viscous mode, strain elastic mode, sound velocity mode, acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, energy Doppler imaging mode and ultra-micro blood flow imaging mode.

14. The method according to claim 1, wherein: In the multi-modality combined imaging mode, an exit control is also displayed; in response to an operation on the exit control, the multi-modality combined imaging mode is exited and the B-modality imaging mode is entered.

15. A multi-modal combined ultrasound imaging method, characterized in that: include: Displaying a multimodal control on the first operation interface; In response to a first operation on the multimodal control, entering a multimodal joint imaging mode; In the multi-modality combined imaging mode, performing multi-modality combined ultrasound imaging; One or more ultrasound images corresponding to the multi-modality are displayed on the second ultrasound interface.

16. The method according to claim 15, characterized in that In response to a second operation on the multimodal control, a multimodal joint imaging setting sub-interface is displayed on the second operation interface; the multimodal joint imaging setting sub-interface includes at least one of the following: A first setting area for multi-modal image types; in response to an operation on the first setting area, setting the modality types included in the multi-modal joint imaging mode; a second setting area for multimodal image layout; in response to an operation on the second setting area, setting an image layout of ultrasound images displayed on the second ultrasound interface; the image layout including the type, quantity and / or position of ultrasound images displayed on the second ultrasound interface; A third setting area for the measurement mode; in response to an operation on the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

17. An ultrasonic imaging system, characterized in that: include: An ultrasonic probe, a transmitting and receiving control circuit, a processor, and a display; the ultrasonic probe is used to transmit ultrasonic waves to a region of interest and receive corresponding ultrasonic echo signals; the transmitting and receiving control circuit is used to control the ultrasonic probe to transmit ultrasonic waves and receive ultrasonic echo signals; the processor is used to execute the method as described in any one of claims 1 to 16.

Images