A multi-modal joint ultrasound imaging method and system

Abstract

A multi-modal combined ultrasound imaging method and ultrasound imaging system, wherein: in response to a first modal imaging instruction, entering a single modal imaging mode of a first modal; in the single modal imaging mode of the first modal, performing ultrasound imaging of the first modal and displaying an ultrasound image of the first modal on a first ultrasound interface; displaying a multi-modal control on the first operation interface; in response to a first operation on the multi-modal control, entering a multi-modal combined imaging mode; in the multi-modal combined imaging mode, performing multi-modal combined ultrasound imaging and displaying one or more ultrasound images corresponding to the multi-modal on a second ultrasound interface. Since the multi-modal combined ultrasound imaging is directly entered through the multi-modal control, it is not necessary to combine different modalities in different levels of functions, greatly improving the efficiency of multi-modal combination and giving users a better use experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of ultrasonic imaging, in particular to a multi-modal joint ultrasonic imaging method and system. BACKGROUND

[0002] Ultrasound imaging is to scan human body tissues and organs by using ultrasonic beams, and to obtain ultrasonic images of the tissues and organs in the body by receiving and processing the reflected signals. There are various modes of ultrasonic imaging, such as B mode, shear wave elasticity mode, viscosity mode, etc. The ultrasonic images obtained in different modes can reflect different characteristics of the tissues and organs. At present, in many clinical scenarios, the ultrasonic images and quantitative parameter evaluation obtained by a single mode are very limited for disease diagnosis and evaluation. For example, the evaluation of the degree of liver fibrosis of hepatitis B is limited by acute inflammation under the influence of shear wave elasticity; the B mode ultrasonic imaging has low sensitivity and cannot find early fatty liver, lacking quantitative evaluation tools; therefore, in order to reflect the multiple characteristics of the tissues and organs from multiple dimensions, real-time joint of multiple modes is needed.

[0003] In the current scheme, when the user performs real-time joint of multiple modes, there are multiple process steps, and the operation is relatively complex, resulting in relatively low efficiency of real-time joint, and therefore a new scheme needs to be proposed. SUMMARY

[0004] The technical problem solved by the present application is the low joint efficiency of multiple modes.

[0005] According to a first aspect, in one embodiment, a multi-modal joint ultrasonic imaging method is provided, comprising:

[0006] In response to a first modality imaging instruction, entering a single modality imaging mode of a first modality;

[0007] In the single modality imaging mode of the first modality, performing ultrasonic imaging of the first modality and displaying an ultrasonic image of the first modality on a first ultrasonic interface;

[0008] Displaying a multi-modality control on a first operation interface; in response to a first operation on the multi-modality control, entering a multi-modality joint imaging mode;

[0009] In the multi-modality joint imaging mode, performing multi-modality joint ultrasonic imaging and displaying one or more ultrasonic images corresponding to the multi-modality on a second ultrasonic interface.

[0010] In one embodiment, in response to a second operation on the multi-modality control, displaying a multi-modality joint imaging setting sub-interface on a second operation interface; the multi-modality joint imaging setting sub-interface includes at least one of the following, and the first operation and the second operation are the same operation or different operations:

[0011] a first setting area of a multi-modal image type; in response to an operation on the first setting area, setting a type of modality included in the multi-modal joint imaging mode;

[0012] a second setting area of a multi-modal image layout; in response to an operation on the second setting area, setting an image layout of the ultrasound images displayed on the second ultrasound interface; the image layout including a type, a number and / or a position of the ultrasound images displayed on the second ultrasound interface;

[0013] a third setting area of a measurement mode; in response to an operation on the third setting area, setting a measurement mode of the ultrasound images displayed on the second ultrasound interface.

[0014] In an embodiment, the first setting area of the multi-modal image type includes a plurality of selection controls, each of which corresponds to a modality; the selection controls have selected and unselected states; when the selection control is in the selected state, the type of modality included in the multi-modal joint imaging mode includes the modality corresponding to the selection control, and vice versa, when the selection control is in the unselected state, the type of modality included in the multi-modal joint imaging mode does not include the modality corresponding to the selection control;

[0015] In response to an operation on the selection control, the selection control switches between the selected and unselected states.

[0016] In an embodiment, the second setting area of the multi-modal image layout includes a plurality of modality image display controls, each of which corresponds to a modality, and the modality image display controls have at least a first state;

[0017] Obtaining control layout information of the modality image display controls in the first state in the setting area, setting an image layout of the ultrasound images displayed on the second ultrasound interface according to the control layout information, and displaying the ultrasound images on the second ultrasound interface according to the image layout; in response to an operation on the setting area, when the control layout information of the modality image display controls in the first state in the setting area changes, the image layout of the ultrasound images displayed on the second ultrasound interface is updated correspondingly.

[0018] In an embodiment, the measurement mode includes a first measurement mode and a second measurement mode, the first measurement mode is a measurement mode of manually outlining a boundary of a region to be measured, and the second measurement mode is a measurement mode of a preset boundary pattern;

[0019] In response to a third setting area operation on the measurement mode, one of the first measurement mode and the second measurement mode is selected as the measurement mode of the ultrasound image displayed on the second ultrasound interface.

[0020] In an embodiment, the multi-modal joint ultrasound imaging method further comprises: in the single-modal imaging mode of the first modality, determining whether the single-modal imaging mode of the first modality supports switching to the multi-modal joint imaging mode based on the first modality;

[0021] If the support exists, the multi-modal control is displayed on the first operation interface;

[0022] If the support does not exist, the multi-modal control is not displayed, or the multi-modal control is displayed in an unavailable state.

[0023] In an embodiment, the multi-modal joint ultrasound imaging method further comprises: acquiring a confidence degree of an ultrasound image corresponding to each modality included in the multi-modal joint imaging mode, and generating a credibility map based on the confidence degree; and superimposing the credibility map on one of the ultrasound images displayed on the second ultrasound interface.

[0024] In an embodiment, a multi-modal joint imaging mode corresponding to a currently working ultrasound probe and / or a current examination mode is acquired, so that in response to an operation on the multi-modal control, the multi-modal joint imaging mode is entered.

[0025] In an embodiment, the multi-modal joint ultrasound imaging method further comprises: acquiring an imaging parameter in the single-modal imaging mode of the first modality, and setting an imaging parameter of the multi-modal joint imaging mode according to the imaging parameter in the single-modal imaging mode of the first modality when the multi-modal joint imaging mode is entered;

[0026] In an embodiment, the imaging parameter in the single-modal imaging mode of the first modality includes a region of interest and / or an imaging depth.

[0027] In an embodiment, in the single-modal imaging mode of the first modality, the first modality is taken as a modality type included in the multi-modal joint imaging mode in response to a first operation on the multi-modal control to enter the multi-modal joint imaging mode, and an ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

[0028] In an embodiment, in the multi-modal joint imaging mode, an exit control is further displayed; and in response to an operation on the exit control, the multi-modal joint imaging mode is exited and the single-modal imaging mode of the first modality is re-entered.

[0029] In an embodiment, the first modality is a B-mode, a shear wave elastography modality, a viscosity modality, a strain elastography modality, an acoustic attenuation modality, an ultrasound Doppler blood flow imaging modality, an energy Doppler imaging modality, or a super micro blood flow imaging modality.

[0030] In an embodiment, the types of modalities included in the multi-modality joint imaging mode include at least two of a B-mode, a shear wave elastography modality, a viscosity modality, a strain elastography modality, an acoustic attenuation modality, an ultrasound Doppler blood flow imaging modality, an energy Doppler imaging modality, and a super micro blood flow imaging modality.

[0031] In an embodiment, in the multi-modality joint imaging mode, a quit control is further displayed; in response to an operation on the quit control, the multi-modality joint imaging mode is exited and a B-mode imaging mode is entered.

[0032] According to a second aspect, an embodiment provides a multi-modality joint ultrasound imaging method, comprising:

[0033] displaying a multi-modality control in a first operation interface;

[0034] in response to a first operation on the multi-modality control, entering a multi-modality joint imaging mode;

[0035] in the multi-modality joint imaging mode, performing multi-modality joint ultrasound imaging;

[0036] displaying one or more ultrasound images corresponding to the multi-modality in a second ultrasound interface.

[0037] In an embodiment, in response to a second operation on the multi-modality control, displaying a multi-modality joint imaging setting sub-interface in a second operation interface; the multi-modality joint imaging setting sub-interface includes at least one of:

[0038] a first setting area of a multi-modality image type; in response to an operation on the first setting area, setting the types of modalities included in the multi-modality joint imaging mode;

[0039] a second setting area of a multi-modality image layout; in response to an operation on the second setting area, setting an image layout of the ultrasound images displayed in the second ultrasound interface; the image layout includes the types, quantities, and / or positions of the ultrasound images displayed in the second ultrasound interface;

[0040] a third setting area of a measurement mode; in response to an operation on the third setting area, setting a measurement mode of the ultrasound images displayed in the second ultrasound interface.

[0041] According to a third aspect, an ultrasound imaging system is provided in an embodiment, comprising: an ultrasound probe, a transmit and receive control circuit, a processor, and a display; the ultrasound probe is configured to transmit ultrasound waves to a region of interest, and receive corresponding ultrasound echo signals; the transmit and receive control circuit is configured to control the ultrasound probe to transmit ultrasound waves and receive ultrasound echo signals; the processor is configured to perform the method according to the first aspect.

[0042] According to the multi-modal joint ultrasound imaging method of the above-mentioned embodiments, since the multi-modal joint ultrasound imaging is directly entered through the multi-modal control, different modalities do not need to be combined in different levels of functions, and one-key multi-modal joint can be achieved. In this process, the multi-modal joint becomes intuitive through the displayed multi-modal control, and there is no need to combine the modalities one by one, which greatly improves the multi-modal joint efficiency and gives users a better use experience. BRIEF DESCRIPTION OF DRAWINGS

[0043] Figure 1 Structure diagram of an ultrasound imaging system according to an embodiment;

[0044] Figure 2 Schematic diagram of a second operation interface according to an embodiment;

[0045] Figure 3 Schematic diagram of a second ultrasound interface according to an embodiment;

[0046] Figure 4 Schematic diagram of a second ultrasound interface according to another embodiment;

[0047] Figure 5 Schematic diagram of a second ultrasound interface according to still another embodiment;

[0048] Figure 6 Flowchart of a multi-modal joint ultrasound imaging method according to an embodiment;

[0049] Figure 7 Flowchart of a multi-modal joint ultrasound imaging method according to another embodiment. DETAILED DESCRIPTION

[0050] The application will be described in further detail below with reference to the drawings. Like elements in different embodiments are denoted by like reference numerals. In the following description, numerous specific details are described to provide a thorough understanding of the application. However, those of skill in the art will recognize that the application can be practiced without one or more of the specific details. In other instances, well-known structures have not been described in order to avoid obscuring the application. The following detailed description is not to be considered in a limiting sense, as the scope of the application is defined by the appended claims.

[0051] In addition, features described in the specification, operation or characteristics can be combined in any appropriate manner to form various embodiments. At the same time, the steps or actions in the method description can also be sequentially adjusted or adjusted in a manner that can be easily seen by those skilled in the art. Therefore, the various sequences in the specification and drawings are only for the purpose of clearly describing a certain embodiment, and do not mean that the sequence is necessary, unless otherwise stated that a certain sequence must be followed.

[0052] The serial numbers of the components in this paper, such as "first", "second", etc., are only used to distinguish the described objects, and do not have any order or technical meaning. The "connection" and "coupling" in this application include direct and indirect connection (coupling) unless otherwise specified.

[0053] In the current scheme, since each modality of ultrasonic imaging enters the function set respectively in different levels, when multiple modalities are combined, each modality needs to be combined in sequence, which leads to the need for the user to operate in different levels of functions, for example, under the shear wave elasticity modality, the viscous modality needs to be combined first, and then the advanced function is combined with the fat change detection modality. This process not only makes the combination of multiple modalities very intuitive, but also seriously reduces the efficiency of the combination of multiple modalities.

[0054] In some embodiments of the present application, a multi-modal control is displayed on the operation interface, and after responding to the operation of the multi-modal control, the multi-modal combined imaging mode can be directly entered. In the multi-modal combined imaging mode, the multi-modal combined ultrasound imaging can be directly entered, and the ultrasound image corresponding to the multi-modal is displayed on the ultrasound interface. Since the multi-modal combined ultrasound imaging is directly entered through the multi-modal control, different modalities do not need to be combined in different levels of functions, and one-key multi-modal combination can be achieved. In this process, the multi-modal combination is made intuitive through the displayed multi-modal control, and there is no need to combine the modalities one by one, which greatly improves the multi-modal combination efficiency and gives users a better use experience.

[0055] Some embodiments provide an ultrasound imaging system for quickly combining multiple modes of ultrasound imaging when performing ultrasound imaging to meet the detection needs of patients. Please refer to Figure 1 The ultrasound imaging system includes an ultrasound probe 10, a transmission and reception control circuit, a processor 20, a human-computer interaction device 70, and a memory 80, which are described in detail below.

[0056] The ultrasound probe 10 is used to transmit ultrasound waves to a region of interest and receive corresponding ultrasound echo signals. The ultrasound probe 10 includes a transducer (not shown in the figure) composed of a plurality of array elements arranged in an array. The array elements are used to transmit ultrasound waves according to excitation electrical signals or convert received ultrasound waves into electrical signals. Therefore, each array element can be used to realize the mutual conversion of electrical pulse signals and ultrasound waves, so as to realize the transmission of ultrasound waves to the biological tissue of the scanned object, and it can also be used to receive the echoes of the ultrasound waves reflected by the tissue.

[0057] The transmission and reception control circuit is used to control the transmission of ultrasound waves and the reception of ultrasound echo signals by the probe. The transmission and reception control circuit can include a transmission circuit 30 and a reception circuit 40. The transmission circuit 30 is used to excite the ultrasound probe 10 to transmit ultrasound waves to the scanned object according to the control of the processor 20, and the reception circuit 40 is used to receive the ultrasound echoes returned from the scanned object through the ultrasound probe 10 to obtain the ultrasound echo signals, and also can process the ultrasound echo signals.

[0058] The human-computer interaction device 70 is configured to perform human-computer interaction, such as outputting visual information and receiving input of a user. The input of the user can be received by a keyboard, an operation button, a mouse, a trackball, a touchpad, or a touch screen integrated with a display; and the visual information can be output by a display, a touch display, a display screen, or a touch display screen. In some embodiments, the display can include two displays, one of which is a main screen configured to display a processing result of an ultrasonic echo signal, such as an ultrasonic image, and the other of which is a sub-screen configured to control parameters of the ultrasonic imaging system, such as selection of the ultrasonic probe 10, selection of an ultrasonic mode, and the like. It can be understood that the content displayed on the main screen and the sub-screen can be exchanged partially or entirely.

[0059] The memory 80 is configured to store various types of data.

[0060] Please refer to Figure 1 The ultrasonic imaging system can further include a beamforming module 50 and an IQ demodulation module 60.

[0061] The beamforming module 50 is connected to the receiving circuit 40 and configured to perform beamforming processing, such as delay and weighted summation, on the echo signal. Because the distances from the ultrasonic receiving points in the measured tissue to the receiving elements are different, the channel data of the same receiving point output by different receiving elements have a delay difference, and thus need to be delayed, phase-aligned, and weighted and summed to obtain ultrasonic image data after beamforming. The ultrasonic image data output by the beamforming module 50 is also referred to as radio frequency (RF) data. The beamforming module 50 outputs the RF data to the IQ demodulation module 60. In some embodiments, the beamforming module 50 can also output the RF data to the memory 80 for buffering or saving, or directly output the RF data to the processor 20 for image processing.

[0062] The beamforming module 50 can perform the above functions in a hardware, firmware, or software manner. The beamforming module 50 can be integrated in the processor 20 or separately arranged, and the present application does not make any limitation.

[0063] The IQ demodulation module 60 removes the signal carrier by IQ demodulation, extracts the tissue structure information contained in the signal, and filters to remove noise. At this time, the obtained signal is referred to as a baseband signal (IQ data pair). The IQ demodulation module 60 outputs the IQ data pair to the processor 20 for image processing. In some embodiments, the IQ demodulation module 60 also outputs the IQ data pair to the memory 80 for buffering or saving, so that the processor 20 reads the data from the memory 80 for subsequent image processing.

[0064] The IQ demodulation module 60 can also perform the above functions in the form of hardware, firmware or software. Similarly, the IQ demodulation module 60 can be integrated in the processor 20 or separately arranged, and the present application is not limited thereto.

[0065] The processor 20 is configured as a central controller circuit (CPU), one or more microprocessors 20, a graphics controller circuit (GPU) or any other electronic component capable of processing input data according to specific logical instructions. It can perform control on peripheral electronic components according to input instructions or predetermined instructions, or perform data reading and / or saving on the memory 80, or process input data by executing programs in the memory 80, such as performing one or more processing operations on collected ultrasonic data according to one or more working modes. The processing operations include but are not limited to adjusting or limiting the form of ultrasonic waves emitted by the ultrasonic probe 10, generating various image frames for subsequent display on the display of the human-computer interaction device 70, or adjusting or limiting the content and form displayed on the display, or adjusting one or more image display settings (such as ultrasonic images, interface components, positioning of regions of interest) displayed on the display.

[0066] When the echo signal is received, the collected ultrasonic data can be processed by the processor 20 in real time during scanning, temporarily stored on the memory 80, and processed in quasi-real time in online or offline operation.

[0067] In the embodiment, the processor 20 controls the operation of the transmitting circuit 30 and the receiving circuit 40, such as controlling the transmitting circuit 30 and the receiving circuit 40 to work alternately or simultaneously. The processor 20 can also determine the appropriate working mode according to the user's selection or the program setting, form a transmission sequence corresponding to the current working mode, and send the transmission sequence to the transmitting circuit 30, so that the transmitting circuit 30 controls the ultrasonic probe 10 to emit ultrasonic waves by using the appropriate transmission sequence.

[0068] The above is a description of some of the ultrasonic imaging systems. The following describes the process of multi-modal joint ultrasonic imaging of the ultrasonic imaging system in detail.

[0069] The processor 20 enters the single modality imaging mode of the first modality in response to the first modality imaging instruction. In some embodiments, the first modality imaging instruction can be generated based on the operation of the user, for example, based on the operation of the user on the operation button on the ultrasound imaging system, or based on the image input of the user to the ultrasound imaging system, such as voice input or gesture, or based on the operation of the user to the virtual button of the touch display screen. In some embodiments, the first operation interface can be displayed on the sub-screen in the display, and the first operation interface is used at least to select the current available ultrasound mode to obtain the first modality imaging instruction to enter the single modality imaging mode of the first modality. In some embodiments, the first modality includes B modality, shear wave elastic modality, viscosity modality, sound velocity modality, strain elastic modality, sound attenuation modality, ultrasound Doppler blood flow imaging modality, energy Doppler imaging modality or ultramicro blood flow imaging modality. The image corresponding to the single modality can contain different types of images, such as B image and elastic image corresponding to the shear wave elastic modality, B image and viscosity image corresponding to the viscosity modality, and B image and contrast image corresponding to the contrast modality. In some embodiments, when the first modality is B modality, the single modality imaging mode of B modality can be directly entered in response to the first modality imaging instruction, and when the first modality is not B modality, for example, shear wave elastic modality, B modality can be entered first, and then the shear wave elastic modality can be entered in response to the first modality imaging instruction, or the shear wave elastic modality can be directly entered in response to the first modality imaging instruction (generally, B image and elastic image can be generated in this modality). Since the B image obtained by B modality is the result of two-dimensional gray-scale ultrasound examination in the process of ultrasound imaging, that is, the B image is a gray-scale image of signal strength change in the scanning range, which reflects the internal anatomical structure of the tissue, and therefore it can be used for preliminary examination to find the lesion area.

[0070] In the single modality imaging mode of the first modality, the processor 20 controls the ultrasound probe 10 to perform ultrasound imaging of the first modality through the transmission and reception control circuit, and displays the ultrasound image of the first modality on the first ultrasound interface. In some embodiments, the first ultrasound interface can be displayed on the main screen in the display, and the ultrasound image of the first modality can be displayed on the first ultrasound interface, for example, the B image is displayed when the first modality is B modality, and the shear wave elastic image is displayed when the first modality is shear wave elastic modality. In some embodiments, the first ultrasound interface further displays the imaging parameters in the single modality imaging mode of the first modality, for example, ROI (region of interest), imaging depth, etc. In this embodiment, in the single modality imaging mode of the first modality, the user can perform examination on the ultrasound detection object in the modality based on a single modality, and analyze the lesion area in the modality.

[0071] Please refer to Figure 2The processor 20 can also control the first operation interface to display a multi-modal control E (M-Reference). When the single-modal analysis of the lesion area cannot meet the requirements, the processor 20 can enter a multi-modal joint imaging mode in response to a first operation of the multi-modal control E by the user. The multi-modal joint imaging mode includes at least two of the following modalities: B modality, shear wave elastic modality, viscosity modality, strain elastic modality, acoustic attenuation modality, ultrasonic Doppler blood flow imaging modality, energy Doppler imaging modality, and super-micro blood flow imaging modality. The first operation can be an operation of a button, a touch click operation of the multi-modal control E, a voice input operation, etc. For example, the user can enter the multi-modal joint imaging mode by touch clicking the multi-modal control E. In the multi-modal joint imaging mode, the processor 20 controls the ultrasonic probe 10 to perform multi-modal joint ultrasonic imaging, for example, multiple modalities are alternately or simultaneously used for ultrasonic imaging. The second ultrasonic interface can be displayed on the main screen of the display to display one or more ultrasonic images corresponding to the multiple modalities. For example, an ultrasonic image corresponding to one modality of the multiple modalities can be displayed, or multiple ultrasonic images corresponding to the multiple modalities can be simultaneously displayed. Figure 3 For example, an ultrasonic image corresponding to one modality of the multiple modalities can be displayed, or multiple ultrasonic images corresponding to the multiple modalities can be simultaneously displayed. In this embodiment, the first ultrasonic interface and the second ultrasonic interface can be the same interface or different interfaces. For example, after the single-modal imaging mode enters the multi-modal joint imaging mode, the first ultrasonic interface can switch the ultrasonic image and other display contents to obtain the second ultrasonic interface. Alternatively, the first ultrasonic interface can be directly switched to the second ultrasonic interface, or the second ultrasonic interface can be directly popped up. In this embodiment, when the first modality in the single-modal imaging mode is the B modality, the multi-modal joint imaging mode is entered in response to the first operation of the multi-modal control E by the user, which can be referred to as direct multi-modal joint. When the first modality in the single-modal imaging mode is not the B modality, for example, the first modality is the shear wave elastic modality, the multi-modal joint imaging mode is entered in response to the first operation of the multi-modal control E by the user, which can be referred to as indirect / intermediate multi-modal joint.

[0072] In some embodiments, in the single modality imaging mode of the first modality, the processor 20 further determines whether the single modality imaging mode of the first modality supports switching to the multi-modality joint imaging mode based on the first modality. If yes, the processor 20 controls the first operation interface to display the multi-modality control E, or displays the multi-modality control E in an available state, and if no, does not display the multi-modality control E, or displays the multi-modality control E in an unavailable state. In some embodiments, when the multi-modality control E is in the available state, the multi-modality control E can be operated or selected, and when in the unavailable state, the multi-modality control E cannot be operated or selected, and the available state and the unavailable state of the multi-modality control E can also be represented by different identifiers, such as different color identifiers or character identifiers, etc. In the present embodiment, when the first modality can be combined with at least one other modality, it is determined that the single modality imaging mode of the first modality supports switching to the multi-modality joint imaging mode. For example, when the first modality is the B modality, it can be combined with other modalities such as the shear wave elastic modality, the viscosity modality, the strain elastic modality, or the acoustic attenuation modality, and thus supports switching to the multi-modality joint imaging mode. Conversely, when the first modality cannot be combined with at least one other modality, it is determined that the single modality imaging mode of the first modality does not support switching to the multi-modality joint imaging mode.

[0073] In some embodiments, in the multi-modality joint imaging mode, the processor 20 is further configured to acquire the confidence of the ultrasound image corresponding to each modality included in the multi-modality joint imaging mode, and generate a reliability map based on the confidence, for example, to obtain a reliability map (RLB Map) by weighting the confidence of each ultrasound image, and then display the reliability map in the second ultrasound interface. The map can be displayed alone or superimposed on the image of other modalities, such as superimposed on one of the ultrasound images displayed in the second ultrasound interface. For example, when the B image, the shear wave elastic image, the viscosity image, the acoustic velocity image, and the acoustic attenuation image are displayed simultaneously, the reliability map can be displayed superimposed on the B image. In an embodiment, five images are displayed simultaneously, i.e., a B image, a shear wave elastic image, a viscosity image, an acoustic velocity image, and an acoustic attenuation image, and an image with a B image background and a reliability map foreground.

[0074] In some embodiments, in the single modality imaging mode of the first modality, the processor 20 is further configured to acquire imaging parameters in the single modality imaging mode of the first modality, and set the imaging parameters of the multi-modality joint imaging mode according to the imaging parameters in the single modality imaging mode of the first modality when entering the multi-modality joint imaging mode. In this embodiment, since the ultrasound detection object can be examined in the first modality and the lesion region can be analyzed in the first modality, the imaging parameters in the first modality can be retained as much as possible or close to the imaging parameters in the first modality when entering the multi-modality joint imaging mode, thereby improving the efficiency of entering the multi-modality joint imaging mode. In some embodiments, the imaging parameters in the single modality imaging mode of the first modality include a region of interest and an imaging depth, and when the imaging parameters of the multi-modality joint imaging mode are set, the region of interest and the imaging depth in the first modality can be directly used as the region of interest and the imaging depth in the multi-modality joint imaging mode. In some embodiments, when the imaging parameters of the multi-modality joint imaging mode are set, it is also necessary to limit the maximum of each modality included in the multi-modality joint imaging mode, that is, the imaging parameters in the first modality cannot exceed the maximum imaging parameters of other modalities when the imaging parameters in the first modality are used as the imaging parameters in the multi-modality joint imaging mode. If it exceeds, the imaging parameters in the first modality can be adjusted so that the adjusted imaging parameters are limited to the maximum imaging parameters of each modality included in the multi-modality joint imaging mode.

[0075] In some embodiments, in the single modality imaging mode of the first modality, when the processor 20 enters the multi-modality joint imaging mode in response to the first operation on the multi-modality control E, the processor 20 takes the first modality as one of the modality types included in the multi-modality joint imaging mode, and displays the ultrasound image corresponding to the first modality on the second ultrasound interface. In this embodiment, since the single modality imaging mode of the first modality needs to be entered before entering the multi-modality joint imaging mode to find the lesion region, the first modality is taken as one of the modality types included in the multi-modality joint imaging mode when the multi-modality joint imaging mode is entered based on the first modality, thereby improving the efficiency of entering the multi-modality joint imaging mode.

[0076] In some embodiments, when entering the multi-modal combined imaging mode in response to the first operation of the multi-modal control E, the multi-modal combined imaging mode can have one kind, and the plurality of modalities included therein can be default or pre-set modality combination. In some embodiments, the multi-modal combined imaging mode can also have multiple kinds, and the plurality of modalities included in each kind of multi-modal combined imaging mode can be all different or partially different, so that one kind can be selected therefrom when entering the multi-modal combined imaging mode. In some embodiments, if the multi-modal combined imaging mode has multiple kinds, the currently working ultrasound probe 10 and / or the current examination mode can be acquired when entering the multi-modal combined imaging mode, and a kind of multi-modal combined imaging mode corresponding thereto can be selected. In this embodiment, since the examination site and target can be basically determined based on the currently working ultrasound probe 10 and / or the current examination mode, the multi-modal combined imaging mode default for the examination site can be set, for example, when the examination site is determined to be the abdomen, the default multi-modal combined imaging mode includes the B mode, the shear wave elastography mode, the viscosity mode and the acoustic attenuation mode. When the examination site is determined to be the breast, the default multi-modal combined imaging mode includes the B mode, the shear wave elastography mode, the strain elastography mode and the viscosity mode. When the examination site is determined to be the thyroid, the default multi-modal combined imaging mode includes the B mode, the shear wave elastography mode and the strain elastography mode. When the examination site is determined to be the gynecology or the prostate, the default multi-modal combined imaging mode includes the B mode, the shear wave elastography mode, the viscosity mode and the strain elastography mode. In this embodiment, by setting the default multi-modal combined imaging mode, the user can quickly enter the multi-modal combination, so as to improve the multi-modal combination efficiency.

[0077] As can be seen from the above, since the multi-modal combined ultrasound imaging is directly entered through the multi-modal control E, different modalities do not need to be combined in different levels of functions, and one key can be used to perform multi-modal combination. In this process, the first modality is taken as one kind of modality type included in the multi-modal combined imaging mode in the single modality imaging mode of the first modality, and the imaging parameters of the multi-modal combined imaging mode are set according to the imaging parameters in the single modality imaging mode of the first modality, so as to further improve the multi-modal combination efficiency, and the user can quickly enter the multi-modal combination by setting the default multi-modal combined imaging mode, so as to greatly improve the multi-modal combination efficiency.

[0078] Please refer to Figure 2In some embodiments, the processor 20 can also respond to the second operation on the multi-modal control E and can display a second operation interface through a sub-screen in the display, the second operation interface being used at least to display a multi-modal joint imaging setting sub-interface, the multi-modal joint imaging setting sub-interface being used to display relevant information in the multi-modal joint imaging mode. In some embodiments, the first operation and the second operation can be the same operation or different operations. In some embodiments, the multi-modal joint imaging setting sub-interface includes one or more of a first setting area A of a multi-modal image type, a second setting area B of a multi-modal image layout, and a third setting area C of a measurement mode. The first setting area A of the multi-modal image type is used to display the modal types contained in the multi-modal joint imaging mode. The second setting area B of the multi-modal image layout is used to display the layout of the modal types contained in the multi-modal joint imaging mode, which can correspond to the image layout of the ultrasound image displayed by the second ultrasound interface. The third setting area C of the measurement mode is used to display the measurement mode of the ultrasound image displayed by the second ultrasound interface in the multi-modal joint imaging mode.

[0079] Please refer to Figure 2In some embodiments, the processor 20 can also set the modality types included in the multi-modality combined imaging mode in response to the operation on the first setting area A, for example, the set modality types include at least two of the B modality (B), the shear wave elastic modality (STE), the viscosity modality (STVi), the strain elastic modality (STQ), and the acoustic attenuation modality (USTA), the ultrasound Doppler blood flow imaging modality (Clolor), the energy Doppler imaging modality (PW), and the ultra-micro blood flow imaging modality (UMA). In some embodiments, the first setting area A of the multi-modality image type includes a plurality of selection controls A1, each of which corresponds to a modality. Each selection control A1 has a selected state and a non-selected state. When the selection control A1 is in the selected state, the modality type included in the multi-modality combined imaging mode includes the modality corresponding to the selection control A1, and vice versa, when the selection control A1 is in the non-selected state, the modality corresponding to the selection control A1 is not included. The processor 20 can also control the selection control A1 to switch between the selected state and the non-selected state in response to the operation on the selection control A1, for example, the selection control A1 in the selected state can switch to the non-selected state in response to the operation thereon. For example, the B modality, the shear wave elastic modality, the viscosity modality, the strain elastic modality, and the acoustic attenuation modality each correspond to a selection control A1, which can be a virtual button on the touch display screen. The virtual button can display an unoperated state and an operated state, thereby corresponding to the non-selected state and the selected state, respectively. For example, the unoperated state and the operated state can be embodied by different colors or different marks. In this embodiment, when the selection control A1 is operated and in the selected state, the selection control A1 has a checked mark, and when the selection control A1 is operated and in the non-selected state, the selection control A1 has no checked mark. For example, when the selection controls A1 corresponding to the B modality and the shear wave elastic modality are selected, they have checked marks, and the other selection controls A1 have no checked marks. At this time, the modality types included in the multi-modality combined imaging mode include the B modality and the shear wave elastic modality. In some embodiments, when different modalities can be combined, the selection controls A1 corresponding to different modalities can be selected simultaneously, and vice versa, when different modalities cannot be combined, only one of the selection controls A1 corresponding to different modalities can be selected.

[0080] In some embodiments, the processor 20 can also set the image layout of the ultrasound image displayed on the second ultrasound interface in response to the operation on the second setting area B. The image layout includes the type, number, and / or position of the ultrasound image displayed on the second ultrasound interface.

[0081] Please refer to Figure 2In some embodiments, the second setting area B of the multi-modal image layout includes a plurality of modal image display controls B1, each of which corresponds to one modality, for example, one of B modality, shear wave elasticity modality, viscosity modality, strain elasticity modality and acoustic attenuation modality. In some embodiments, in the initial state, the modal image display controls B1 included in the second setting area B correspond to the modality types contained in the multi-modal joint imaging mode set by the first setting area A. For example, if the first setting area A sets a multi-modal joint imaging mode containing B modality and shear wave elasticity modality, then in the initial state, the second setting area B includes the modal image display controls B1 corresponding to B modality and shear wave elasticity modality. In some embodiments, each of the modal image display controls B1 has a first state and a second state, wherein the first state can be used to indicate that the modality corresponding to the modal image display control B1 is in an open state, and the ultrasound image corresponding to the modality in the open state is displayed on the second ultrasound interface, and vice versa, the second state can be used to indicate that the modality corresponding to the modal image display control B1 is in a closed state, and the ultrasound image corresponding to the modality is not displayed on the second ultrasound interface. In some embodiments, when the modal image display control B1 is in different states, it can be displayed by different identifiers, for example, by different colors, characters, texts, shapes, etc. In some embodiments, the different states of the modal image display control B1 can also be represented by whether the modal image display control B1 exists in the second setting area B, for example, when the modal image display control B1 exists in the second setting area B, it is in the first state, and vice versa, it is in the second state. In this embodiment, when the image display control is in the first state, the image display control also displays the identifier "ON", and when it is in the second state, it also displays the identifier "OFF". In some embodiments, the processor 20 can also respond to the operation of the modal image display control B1 to enable the modal image display control B1 to switch between the first state and the second state. For example, the touch operation on the modal image display control B1 in the first state switches it to the second state, for example, the touch operation of dragging the modal image display control B1 to make it exist or not exist in the second setting area B. In some embodiments, the processor 20 can also respond to the operation of the modal image display control B1 to set the modality corresponding to the modal image display control B1. For example, the processor 20 responds to the click operation on the modal image display control B1 to control the modal image display control B1 to display a drop-down menu, and the options of the drop-down menu are different modalities, for example, the options include B modality, shear wave elasticity modality, viscosity modality, strain elasticity modality and acoustic attenuation modality. The processor 20 responds to the selection operation on the options in the drop-down menu to set the modality corresponding to the modal image display control B1 to the selected modality.In this embodiment, the modality corresponding to each modality image display control B1 can not allow the same existence, for example, when the modality image display control B1 corresponds to the B modality, other modality image display controls B1 cannot select the B modality. The modality corresponding to each modality image display control B1 can also allow the same existence, for example, two or more modality image display controls B1 can all correspond to the B modality. In some embodiments, the processor 20 can also set the position of the modality image display control B1 in the second setting area B in response to the operation of the modality image display control B1. For example, in response to the drag operation of the modality image display control B1 in the second setting area B, the modality image display control B1 is moved to the corresponding position. For example, in response to the touch operation of the modality image display control B1 in the second setting area B, the modality image display control B1 is moved to the position in the default direction, for example, one or a combination of the default directions of up, down, left and right. In some embodiments, the processor 20 also adaptively adjusts the positions of other modality image display controls B1 according to the position to which the modality image display control B1 is moved. For example, when there is another modality image display control B1 in the position to which the modality image display control B1 is moved, the other modality image display control B1 can exchange positions with the modality image display control B1, or move in the default direction or in a random direction.

[0082] The above is a description of some of the modality image display controls B1 in the second setting area B. As described above, the processor 20 can adjust the state, the corresponding modality and the position in the second setting area B of the modality image display control B1 in response to the operation of the modality image display control B1. The following describes the setting of the image layout of the ultrasound image displayed in the second ultrasound interface by the processor 20 in response to the operation of the second setting area B.

[0083] Please refer to Figure 2 and Figure 3In some embodiments, the processor 20 acquires the control layout information of the modality image display control B1 in the first state in the second setting area B, and then sets the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, and displays the ultrasound image on the second ultrasound interface according to the image layout. In some embodiments, the control layout information includes the modality, quantity and position relationship corresponding to the modality image display control B1 in the first state in the second setting area B. In this embodiment, the modality, quantity and position relationship corresponding to the modality image display control B1 has a certain corresponding relationship or logical relationship with the type, quantity and position of the ultrasound image. For example, when the modality corresponding to the modality image display control B1 corresponds to the type of the ultrasound image one-to-one, if the modality corresponding to the modality image display control B1 includes B modality, then the type of the ultrasound image displayed on the second ultrasound interface includes B image. The quantity of the modality image display control B1 corresponds to the quantity of the ultrasound image, and the position relationship of the modality image display control B1 corresponds to the position of the ultrasound image one-to-one. Therefore, the control layout information of the modality image display control B1 can have a mapping relationship with the image layout of the ultrasound image, and when the processor 20 acquires the control layout information, the image layout of the ultrasound image can be obtained from the control layout information according to the mapping relationship. Please refer to Figure 2 In some embodiments, the second setting area B has four control positions B2, which are respectively a first position, a second position, a third position and a fourth position. Please refer to Figure 3, the second ultrasound interface has four display regions D, which are respectively a first display region, a second display region, a third display region and a fourth display region. In this embodiment, the first position, the second position, the third position and the fourth position have certain corresponding relationship with the first display region, the second display region, the third display region and the fourth display region, so that the processor 20 can set the ultrasound images displayed on the second ultrasound interface according to the control layout information of the modality image display control B1 in the first state. For example, the first display region, the second display region, the third display region and the fourth display region correspond to the first position, the second position, the third position and the fourth position respectively, so that the processor 20 can set the ultrasound images of the modality corresponding to the modality image display control B1 placed on the control position B2 corresponding to each display region D to be displayed in each display region D. For example, the first position has the modality image display control B1 in the first state, and the corresponding modality is B modality, so that the B image corresponding to the B modality is displayed in the first display region. In some embodiments, the four control positions B2 and the four display regions D are arranged in the form of two rows and two columns. It can be understood that the number of control positions B2 and display regions D can be increased or decreased according to the shape and size of the display, and the control positions B2 and display regions D can be arranged in other forms. In this embodiment, the control positions B2 and the display regions D are one-to-one corresponding, and the position arrangement of the display regions D is fixed and does not change with the number and position relationship of the modality image display controls B1 in the first state.

[0084] In some embodiments, the position arrangement of each display region D can be changed, so that the size of the display region D can be adjusted to adapt to different use scenarios. In some embodiments, the processor 20 can set the position arrangement of the ultrasound images displayed on the second ultrasound interface according to the number and position relationship of the modality image display controls B1 in the first state. Please refer to Figure 3 In this embodiment, the second setting region B has four control positions B2 arranged in the form of two rows and two columns. When the number of modality image display controls B1 in the first state is four or three and each is located in one control position B2, the processor 20 sets the second ultrasound interface to display four display regions D arranged in the form of two rows and two columns. At this time, the first display region, the second display region, the third display region and the fourth display region correspond to the first position, the second position, the third position and the fourth position respectively, and the processor 20 sets the ultrasound images of the modality corresponding to the modality image display control B1 placed on the control position B2 corresponding to each display region D to be displayed in each display region D.

[0085] Please refer to Figure 4In some embodiments, when the number of the modality image display controls B1 in the first state is two and located at one control position B2 respectively, the processor 20 sets two display regions D to be displayed on the second ultrasound interface, and arranged in left and right, for example, a first display region on the left and a second display region on the right. The size of the two display regions D can be smaller or larger than the size of the four display regions D, or the same size. At this time, the processor 20 also sets the ultrasound image corresponding to the modality of the modality image display control B1 in the first display region to be displayed in the position sequence in front, and the ultrasound image corresponding to the modality of the modality image display control B1 in the second display region to be displayed in the position sequence behind, wherein the first position, the second position, the third position and the fourth position have a default position sequence, for example, the position sequence of the first position, the second position, the third position and the fourth position decreases or increases in turn. For example, the modality image display controls B1 in the first state are located at the first position and the third position respectively, and the first display region displays the ultrasound image corresponding to the modality of the modality image display control B1 in the first position, and the second display region displays the ultrasound image corresponding to the modality of the modality image display control B1 in the third position. Please refer to Figure 4 In some embodiments, when the number of the modality image display controls B1 in the first state is one and located at one control position B2, the processor 20 sets two display regions D to be displayed on the second ultrasound interface, arranged in left and right, for example, a first display region on the left and a second display region on the right, and sets the ultrasound image corresponding to the modality of the modality image display control B1 to be displayed in the first display region. Please refer to Figure 5 In some embodiments, when the number of the modality image display controls B1 in the first state is one and located at one control position B2, the processor 20 sets one display region D to be displayed on the second ultrasound interface, and sets the ultrasound image corresponding to the modality of the modality image display control B1 to be displayed in the display region D.

[0086] In some embodiments, the processor 20 can also respond to the operation on the second setting region B to update the image layout of the ultrasound image displayed on the second ultrasound interface when the control layout information of the modality image display control B1 in the first state in the second setting region B changes. For example, when the number of the modality image display controls B1 in the first state in the second setting region B increases or the position changes, the ultrasound image corresponding to the modality of the modality image display control B1 in the first state will be displayed or the position will be changed on the second ultrasound interface. In this embodiment, the image layout of the ultrasound image can be updated in real time based on the operation on the second setting region B, so as to meet the real-time layout demand and layout adjustment of the user.

[0087] As known from the above, the user can adjust the modality corresponding to the modality image display control B1, the number and the positional relationship, so as to adjust the control layout of the image display control. The control layout of the modality image display control B1 can correspond to the image layout of the ultrasound image one by one, so as to set the ultrasound image of the modality corresponding to the modality image display control B1 placed on the control position B2 in each display region D. The image layout of the ultrasound image can also be adjusted according to the number and the positional relationship of the modality image display control B1 in the first state, so as to adapt to different use scenarios. Moreover, when the control layout of the modality image display control B1 changes in real time, the image layout of the ultrasound image can be updated in real time, so as to realize flexible and efficient image layout adjustment.

[0088] Please refer to Figure 2 In some embodiments, the processor 20 can also set a measurement mode of the ultrasound image displayed by the second ultrasound interface in response to the operation on the third setting region C. The measurement mode includes a first measurement mode (MRefTrace) and a second measurement mode (TMRef). The first measurement mode is a measurement mode in which the user manually outlines the boundary of the region to be measured, for example, based on the trackball operation. The second measurement mode is a measurement mode in which a preset boundary pattern is used. The preset boundary pattern is pre-set, for example, an ellipse, a circle or a square. The processor 20 selects one of the first measurement mode and the second measurement mode as the measurement mode of the ultrasound image displayed by the second ultrasound interface in response to the operation on the third setting region C.

[0089] In some embodiments, the exit control is also displayed in the multi-modality joint imaging mode, for example, on the first operation interface or the second operation interface, or the processor 20 can control the sub-screen in the display to display the third operation interface and display the exit control on the third operation interface. The processor 20 is also configured to exit the multi-modality joint imaging mode in response to the operation on the exit control. In this embodiment, after entering the multi-modality joint imaging mode, if the user needs to re-adjust the related parameters or complete the current examination, the multi-modality joint imaging mode can be exited based on the operation on the exit control. In some embodiments, the multi-modality joint imaging mode can also be exited based on the operation on the exit control and re-entered into the single-modality imaging mode of the first modality, so as to quickly re-adjust or perform the next multi-modality joint imaging mode. In some embodiments, the exit control is also displayed in the multi-modality joint imaging mode, and the multi-modality joint imaging mode is exited and the B-modality imaging mode is entered in response to the operation on the exit control.

[0090] Please refer to Figure 6In some embodiments, a multi-modal joint ultrasound imaging method is provided for the ultrasound imaging system described above to quickly combine multiple modes of ultrasound imaging when performing ultrasound imaging to meet the detection needs of patients. The multi-modal joint ultrasound imaging method can include the following steps:

[0091] Step 100: Enter a single-mode imaging mode of a first modality in response to a first modality imaging instruction.

[0092] Step 200: Perform ultrasound imaging of the first modality in the single-mode imaging mode of the first modality and display ultrasound images of the first modality on a first ultrasound interface.

[0093] Step 300: Display a multi-modal control E on a first operation interface; enter a multi-modal joint imaging mode in response to a first operation on the multi-modal control E.

[0094] Step 400: Perform multi-modal joint ultrasound imaging in the multi-modal joint imaging mode and display one or more ultrasound images corresponding to the multi-modal on a second ultrasound interface.

[0095] In some embodiments, in response to a second operation on the multi-modal control E, a multi-modal joint imaging setting sub-interface is displayed on a second operation interface; the multi-modal joint imaging setting sub-interface includes at least one of the following:

[0096] A first setting area A of a multi-modal image type; in response to an operation on the first setting area A, a modality type included in the multi-modal joint imaging mode is set.

[0097] A second setting area B of a multi-modal image layout; in response to an operation on the second setting area B, an image layout of ultrasound images displayed on the second ultrasound interface is set; the image layout includes a type, a number, and / or a position of ultrasound images displayed on the second ultrasound interface.

[0098] A third setting area C of a measurement mode; in response to an operation on the third setting area C, a measurement mode of ultrasound images displayed on the second ultrasound interface is set.

[0099] In some embodiments, the first setting area A of the multi-modal image type includes a plurality of selection controls A1, each of which corresponds to a modality; the selection control A1 has a selected state and a non-selected state; when the selection control A1 is in the selected state, the modality type included in the multi-modal joint imaging mode includes the modality corresponding to the selection control A1, and vice versa, when the selection control A1 is in the non-selected state, the modality type included in the multi-modal joint imaging mode does not include the modality corresponding to the selection control A1; in response to the operation on the selection control A1, the selection control A1 is switched between the selected state and the non-selected state.

[0100] In some embodiments, the second setting area B of the multi-modal image layout includes a plurality of modality image display controls B1, each of which corresponds to a modality, and the modality image display control B1 has at least a first state; the control layout information of the modality image display control B1 in the first state in the setting area is acquired, the image layout of the ultrasound image displayed on the second ultrasound interface is set according to the control layout information, and the ultrasound image is displayed on the second ultrasound interface according to the image layout; in response to the operation on the setting area, when the control layout information of the modality image display control B1 in the first state in the setting area changes, the image layout of the ultrasound image displayed on the second ultrasound interface is updated correspondingly.

[0101] In some embodiments, the measurement mode includes a first measurement mode and a second measurement mode, the first measurement mode is a measurement mode of manually outlining the boundary of the region to be measured, and the second measurement mode is a measurement mode of a preset boundary pattern; in response to the operation on the third setting area C of the measurement mode, one of the first measurement mode and the second measurement mode is selected as the measurement mode of the ultrasound image displayed on the second ultrasound interface.

[0102] In some embodiments, the multi-modal joint ultrasound imaging method further includes: in the single modality imaging mode of the first modality, determining whether the single modality imaging mode of the first modality supports switching to the multi-modal joint imaging mode based on the first modality; if it supports, displaying the multi-modal control E on the first operation interface; if it does not support, not displaying the multi-modal control E, or displaying the multi-modal control E in an unavailable state.

[0103] In some embodiments, the multi-modal joint ultrasound imaging method further includes: acquiring the confidence of the ultrasound image corresponding to each modality included in the multi-modal joint imaging mode, and generating a reliability map based on the confidence; and superimposing the reliability map on one of the ultrasound images displayed on the second ultrasound interface.

[0104] In some embodiments, the multi-modal joint ultrasound imaging method further comprises: acquiring a multi-modal joint imaging mode corresponding to the current working ultrasound probe 10 and / or the current examination mode, so that: in response to the operation of the multi-modal control E, entering the multi-modal joint imaging mode.

[0105] In some embodiments, the multi-modal joint ultrasound imaging method further comprises: acquiring imaging parameters in the single modal imaging mode of the first modality, and setting the imaging parameters of the multi-modal joint imaging mode according to the imaging parameters in the single modal imaging mode of the first modality when entering the multi-modal joint imaging mode. In some embodiments, the imaging parameters in the single modal imaging mode of the first modality include a region of interest and / or an imaging depth.

[0106] In some embodiments, in the single modal imaging mode of the first modality, the first modality is taken as a type of modality included in the multi-modal joint imaging mode in response to the first operation of the multi-modal control E to enter the multi-modal joint imaging mode, and the ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

[0107] In some embodiments, in the multi-modal joint imaging mode, a quit control is further displayed; in response to the operation of the quit control, the multi-modal joint imaging mode is exited and the single modal imaging mode of the first modality is re-entered.

[0108] Please refer to Figure 7 In some embodiments, a multi-modal joint ultrasound imaging method is provided, which is used for the above-mentioned ultrasound imaging system to quickly combine multiple modes of ultrasound imaging when performing ultrasound imaging, so as to meet the detection needs of patients. The multi-modal joint ultrasound imaging method can include the following steps:

[0109] Step 110: displaying a multi-modal control E on a first operation interface.

[0110] Step 210: in response to the first operation of the multi-modal control E, entering a multi-modal joint imaging mode.

[0111] Step 310: in the multi-modal joint imaging mode, performing multi-modal joint ultrasound imaging.

[0112] Step 410: displaying one or more ultrasound images corresponding to the multi-modal on a second ultrasound interface.

[0113] From the above multi-modal combined ultrasound imaging method, since the multi-modal combined ultrasound imaging is directly entered through the multi-modal control E, different modalities do not need to be combined in different levels of functions, and one-key multi-modal combination can be achieved, and in the process, the multi-modal combination can be made intuitive through the displayed multi-modal control E, and different modalities do not need to be combined one by one, greatly improving the multi-modal combination efficiency and giving users a better use experience.

[0114] The principles herein are described with reference to various exemplary embodiments. However, one of ordinary skill in the art will recognize that changes and modifications can be made to the exemplary embodiments without departing from the scope hereof. For example, various operational steps and components for carrying out the operational steps can be implemented in different sequences, or omitted, combined with other steps, or modified, depending on the particular application or needs.

[0115] In the above embodiments, all or part can be realized by software, hardware, firmware or any combination thereof. In addition, as understood by those skilled in the art, the principles herein can be reflected in a computer program product on a computer readable storage medium preloaded with computer readable program code. Any tangible, non-transitory computer readable storage medium can be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-ROM, DVD, Blu Ray disk, etc.), flash memory and / or the like. These computer program instructions can be loaded onto a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to form a machine, so that these instructions executed on the computer or other programmable data processing device can generate a device that implements the specified function. These computer program instructions can also be stored in a computer readable storage medium, which can instruct the computer or other programmable data processing device to operate in a specific way, so that the instructions stored in the computer readable storage medium can form a piece of manufacturing product, including an implementation device that implements the specified function. Computer program instructions can also be loaded onto a computer or other programmable data processing device to execute a series of operational steps to generate a computer-implemented process, so that the instructions executed on the computer or other programmable device can provide steps for implementing the specified function.

[0116] Although the principles herein have been shown in various embodiments, many modifications of structure, arrangement, proportion, elements, materials and components particularly suitable for specific environments and operating requirements can be used without departing from the principles and scope of the present disclosure. The above modifications and other changes or modifications will be included in the scope of the principles herein.

[0117] The foregoing detailed description has been presented for purposes of illustration and description. However, various modifications and changes are possible in the implementation of the disclosure. Accordingly, the disclosure is intended to embrace all modifications and alterations within the scope and spirit of the disclosure. Thus, the scope of the disclosure is not intended to be limited to the particular form set forth herein, but includes all features that might be provided within the scope and spirit of the disclosure. Likewise, a variety of advantages and features have been set forth in the description herein with reference to the various embodiments. It is to be understood that not necessarily all advantages can be achieved in accordance with any particular embodiment. Further, solutions to problems can be appreciated by one skilled in the art upon reading the disclosure. Any feature, structure, material, or combination thereof described herein is meant to be illustrative and not restrictive. The scope of the disclosure is, therefore, indicated by the appended claims, rather than by the foregoing description. As used herein, the terms "comprises," "comprising," "includes," "including," "has," "having," "contains," "containing," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, includes, has, contains a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, the term "coupled" and any other variation thereof, as used herein, is intended to mean physically, electrically, magnetically, optically, communicatively, functionally, and / or any other connection.

[0118] Those skilled in the art will recognize that many modifications and variations of the described implementations can be made. It is therefore intended that the scope of the application be limited only by the appended claims.

Claims

1. A multimodal combined ultrasound imaging method, characterized in that, include: In response to the first modal imaging command, it enters the single-modal imaging mode of the first modality; In the single-modal imaging mode of the first modality, ultrasound imaging of the first modality is performed and the ultrasound image of the first modality is displayed on the first ultrasound interface; A multimodal control is displayed on the first operation interface; in response to a first operation on the multimodal control, the multimodal joint imaging mode is entered; In the multimodal joint imaging mode, multimodal joint ultrasound imaging is performed and one or more ultrasound images corresponding to the multimodal imaging are displayed on the second ultrasound interface. In response to a second operation on the multimodal control, a multimodal joint imaging settings sub-interface is displayed on the second operation interface; the first operation and the second operation may be the same operation or different operations, and the multimodal joint imaging settings sub-interface includes a second setting area for the multimodal image layout; in response to an operation on the second setting area, an image layout for the ultrasound images displayed on the second ultrasound interface is set; the image layout includes the type, number, and / or position of the ultrasound images displayed on the second ultrasound interface; The second setting area of ​​the multimodal image layout includes multiple modal image display controls, each modal image display control corresponding to a modality, and each modal image display control having at least a first state; Obtain the control layout information of the modal image display control in the first state within the setting area, and set the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, so as to display the ultrasound image on the second ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the second ultrasound interface accordingly.

2. The method as described in claim 1, characterized in that, The multimodal joint imaging settings sub-interface also includes at least one of the following: A first setting area for multimodal image types; in response to an operation on the first setting area, setting the modal types included in the multimodal joint imaging mode; A third setting area for measurement modes; in response to operation of the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

3. The method as described in claim 2, characterized in that, The first setting area of ​​the multimodal image type includes multiple selection controls, each corresponding to a modality; the selection control has a selected state and an unselected state; when the selection control is in the selected state, the modality type included in the multimodal joint imaging mode includes the modality corresponding to the selection control, and conversely, when the selection control is in the unselected state, the modality type included in the multimodal joint imaging mode does not include the modality corresponding to the selection control; In response to an operation on the selection control, the selection control toggles between the selected state and the unselected state.

4. The method as described in claim 2, characterized in that, The measurement mode includes a first measurement mode and a second measurement mode. The first measurement mode is a measurement mode in which the boundary of the area to be measured is manually outlined, and the second measurement mode is a measurement mode in which a preset boundary graphic is used. In response to a third setting area operation of the measurement mode, one of the first measurement mode and the second measurement mode is selected as the measurement mode for the ultrasound image displayed on the second ultrasound interface.

5. The method as described in claim 1, characterized in that, Also includes: In the single-modal imaging mode of the first modality, it is determined whether the single-modal imaging mode of the first modality supports switching to the multimodal joint imaging mode based on the first modality; If supported, the multimodal control will be displayed on the first operation interface; If not supported, the multimodal control will not be displayed, or the multimodal control will be displayed as unavailable.

6. The method as described in claim 1, characterized in that, Also includes: The confidence level of the ultrasound images corresponding to each modality included in the multimodal joint imaging mode is obtained, and a confidence map is generated based on the confidence level.

7. The method as described in claim 1, characterized in that, Also includes: Acquire a multimodal co-imaging mode corresponding to the currently operating ultrasound probe and / or the current examination mode, such that: in response to operation of the multimodal control, enter the multimodal co-imaging mode.

8. The method as described in claim 1, characterized in that, Also includes: The imaging parameters in the single-modal imaging mode of the first mode are obtained, and when entering the multimodal joint imaging mode, the imaging parameters of the multimodal joint imaging mode are set according to the imaging parameters in the single-modal imaging mode of the first mode. Preferably, the imaging parameters in the single-modal imaging mode of the first mode include the region of interest and / or the imaging depth.

9. The method as described in claim 1, characterized in that, In the single-modal imaging mode of the first modality, in response to the first operation of the multimodal control to enter the multimodal joint imaging mode, the first modality is regarded as a modality type included in the multimodal joint imaging mode, and the ultrasound image corresponding to the first modality is displayed on the second ultrasound interface.

10. The method as described in claim 1, characterized in that, In the multimodal imaging mode, an exit control is also displayed; in response to the operation of the exit control, the multimodal imaging mode is exited and the single-modal imaging mode of the first mode is re-entered.

11. The method as described in claim 1, characterized in that, The first mode is a B mode, a shear wave elastic mode, a viscous mode, a strain elastic mode, a sound velocity mode, or a sound attenuation mode.

12. The method as described in claim 1, characterized in that, The modal types included in the multimodal joint imaging mode include at least two of the following: B mode, shear wave elastic mode, viscous mode, strain elastic mode, sound velocity mode, and sound attenuation mode.

13. The method as described in claim 1, characterized in that, In the multimodal imaging mode, an exit control is also displayed; in response to the operation of the exit control, the multimodal imaging mode is exited and the B-modal imaging mode is entered.

14. A multimodal combined ultrasound imaging method, characterized in that, include: A multimodal control is displayed on the first user interface; In response to a first operation on the multimodal control, the system enters a multimodal joint imaging mode; Multimodal joint imaging is performed under the aforementioned multimodal joint imaging mode; The second ultrasound interface displays one or more ultrasound images corresponding to the multimodal mode. In response to a second operation on the multimodal control, a multimodal co-imaging settings sub-interface is displayed on the second operation interface; the multimodal co-imaging settings sub-interface includes a second setting area for the multimodal image layout; in response to an operation on the second setting area, an image layout for the ultrasound images displayed on the second ultrasound interface is set; the image layout includes the type, number, and / or position of the ultrasound images displayed on the second ultrasound interface; The second setting area of ​​the multimodal image layout includes multiple modal image display controls, each modal image display control corresponding to a modality, and each modal image display control having at least a first state; Obtain the control layout information of the modal image display control in the first state within the setting area, and set the image layout of the ultrasound image displayed on the second ultrasound interface according to the control layout information, so as to display the ultrasound image on the second ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the second ultrasound interface accordingly.

15. The method as described in claim 14, characterized in that, The multimodal joint imaging settings sub-interface also includes at least one of the following: A first setting area for multimodal image types; in response to an operation on the first setting area, setting the modal types included in the multimodal joint imaging mode; A third setting area for measurement modes; in response to operation of the third setting area, setting the measurement mode for the ultrasound image displayed on the second ultrasound interface.

16. An ultrasound imaging system, characterized in that, include: An ultrasonic probe, a transmitting and receiving control circuit, a processor, and a display; the ultrasonic probe is used to transmit ultrasonic waves to a region of interest and to receive corresponding ultrasonic echo signals; the transmitting and receiving control circuit is used to control the ultrasonic probe to transmit ultrasonic waves and receive ultrasonic echo signals; the processor is used to perform the method as described in any one of claims 1 to 15.

Images