A multi-modal joint ultrasound imaging method and system

Abstract

A multi-modal joint ultrasound imaging method and an ultrasound imaging system, wherein: multi-modal joint ultrasound imaging is performed; multi-modal corresponding ultrasound images are displayed on an ultrasound interface; wherein: a setting area displayed on an operation interface includes a plurality of modal image display controls, each modal image display control corresponding to a modal, and the modal image display control at least having a first state; control layout information of the modal image display control in the first state in the setting area is acquired, and an image layout of the ultrasound image displayed on the ultrasound interface is set according to the control layout information; in response to an operation on the setting area, when the control layout information of the modal image display control in the first state in the setting area changes, the image layout of the ultrasound image displayed on the ultrasound interface is updated correspondingly. Since the image layout of the ultrasound image displayed on the ultrasound interface is set based on the layout of the modal image display control, the use habit of the user is met.

Description

Technical Field

[0001] This invention relates to the field of ultrasound imaging technology, and more specifically to a multimodal combined ultrasound imaging method and system. Background Technology

[0002] Ultrasound imaging uses ultrasound beams to scan human tissues and organs. By receiving and processing the reflected signals, it obtains ultrasound images of the internal organs. Ultrasound imaging has various modes, such as B-mode, shear wave elastic mode, and viscous mode. The ultrasound images acquired in different modes can reflect different characteristics of tissues and organs. Currently, in many clinical scenarios, the ultrasound images and quantitative parameter assessments obtained from a single mode are very limited for disease diagnosis and evaluation. For example, due to the influence of acute inflammation, shear wave elasticity is limited in evaluating the degree of liver fibrosis in hepatitis B; B-mode ultrasound has low sensitivity and cannot detect early fatty liver, and lacks quantitative assessment tools. Therefore, in order to reflect the multiple characteristics of tissues and organs from multiple dimensions, it is necessary to combine multiple modes in real time.

[0003] When users perform real-time ensemble analysis of multiple ultrasound modes, they obtain multiple ultrasound images corresponding to those modes. Users typically have their own preferred layout for interpreting these images. However, in current solutions, the positions of the multiple ultrasound images are fixed, which affects user habits and results in a poor user experience. Therefore, a new solution is needed. Summary of the Invention

[0004] The main technical problem solved by this invention is that the layout of multiple ultrasound images cannot meet user needs when multiple modes are combined in real time.

[0005] According to a first aspect, one embodiment provides a multimodal combined ultrasound imaging method, characterized in that it includes:

[0006] Perform multimodal ultrasound imaging;

[0007] The ultrasound interface displays one or more ultrasound images corresponding to the multimodal modes; wherein:

[0008] The operation interface displays a setting area for the multimodal image layout; the setting area includes multiple modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state;

[0009] Obtain the control layout information of the modal image display control in the first state within the setting area, and set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, so as to display the ultrasound image on the ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

[0010] In one embodiment, the control layout information of the modal image display controls in the first state within the setting area includes: the modality, quantity, and positional relationship of the modal image display controls in the first state within the setting area;

[0011] The image layout of the ultrasound images displayed on the ultrasound interface includes: the type, number, and position of the ultrasound images displayed on the ultrasound interface.

[0012] In one embodiment, setting the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information includes:

[0013] For each modality corresponding to the modality image display control in the first state, an ultrasound image of the corresponding modality is set to be displayed on the ultrasound interface;

[0014] Based on the number and positional relationship of the modal image display controls in the first state, the positional arrangement of the ultrasound images displayed on the ultrasound interface is set.

[0015] In one embodiment, the setting area has four control positions arranged in a two-row, two-column configuration: a first position, a second position, a third position, and a fourth position; the control positions are capable of accommodating the modal image display control.

[0016] The step of setting the position arrangement of the ultrasound images displayed on the ultrasound interface according to the number and positional relationship of the modal image display controls in the first state includes:

[0017] When the number of modal image display controls in the first state is four and each is located at one of the control positions, the ultrasound interface is configured to display four display areas arranged in a two-row, two-column format: a first display area, a second display area, a third display area, and a fourth display area. The first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position is displayed in each of the display areas.

[0018] And / or,

[0019] When the number of modal image display controls in the first state is three and each is located at one of the control positions, the ultrasound interface is configured to display four display areas arranged in a two-row, two-column format: a first display area, a second display area, a third display area, and a fourth display area. The first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position is displayed in each of the display areas.

[0020] And / or,

[0021] When there are two modal image display controls in the first state, each located at one of the control positions, two display areas are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the ultrasound image of the modality corresponding to the modal image display control that is displayed first in the first display area, and the ultrasound image of the modal image display control that is displayed later in the second display area; wherein the positions of the first position, the second position, the third position, and the fourth position decrease sequentially.

[0022] And / or,

[0023] When the number of modal image display controls in the first state is one and the control is located in one position, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the first display area;

[0024] And / or,

[0025] When the number of modal image display controls in the first state is one and the control is located at one of the control positions, a display area is set to be displayed on the ultrasound interface, and the ultrasound image of the modality corresponding to the modal image display control is displayed in the display area.

[0026] In one embodiment, the modal image display control further has a second state; when the modal image display control is in the first state, the ultrasound image of the modality corresponding to the modal image display control is displayed on the ultrasound interface; conversely, when the modal image display control is in the second state, the ultrasound image of the modality corresponding to the modal image display control is not displayed on the ultrasound interface.

[0027] In response to an operation on the modal image display control, the modal image display control can switch between a first state and a second state.

[0028] In one embodiment, for each modal image display control, a flag indicating whether the modal image display control is in the first state or the second state is displayed.

[0029] In one embodiment, in response to an operation on the modal image display control, the modality corresponding to the modal image display control is set.

[0030] In one embodiment, setting the modality corresponding to the modal image display control in response to an operation on the modal image display control includes:

[0031] In response to a click operation on the modal image display control, the modal image display control is controlled to display a drop-down menu, the options of which are different modalities;

[0032] In response to the selection operation of the option in the drop-down menu, the modality corresponding to the modal image display control is set to the selected modality.

[0033] In one embodiment, in response to an operation on the modal image display control, the position of the modal image display control within the set area is set.

[0034] In one embodiment, setting the position of the modal image display control within the set area in response to an operation on the modal image display control includes:

[0035] In response to a drag operation on a modal image display control within the set area, the modal image display control is moved to the corresponding position; preferably, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

[0036] In one embodiment, the ultrasound interface is displayed on a monitor, and the operation interface is displayed on a touch screen.

[0037] In one embodiment, the multimodal mode includes at least two of the following: B mode, shear wave elastic mode, viscous mode, strain elastic mode and acoustic attenuation mode, ultrasound Doppler blood flow imaging mode, energy Doppler imaging mode and ultramicro blood flow imaging mode.

[0038] According to a second aspect, one embodiment provides a multimodal combined ultrasound imaging method, comprising:

[0039] Perform multimodal ultrasound imaging;

[0040] One or more image windows are displayed on the ultrasound interface, and one image window can display an ultrasound image corresponding to one mode in the multimodal display; wherein:

[0041] The operation interface displays a setting area for the multimodal image layout; the setting area includes a first control and a second control; the first control corresponds to the number of image windows; the second control is used to switch the position order of the ultrasound images displayed on the ultrasound interface;

[0042] In response to the operation of the first control, the number of image windows corresponding to the first control is set or switched, and a corresponding number of image windows are generated on the ultrasound interface according to the number of image windows set or switched by the first control.

[0043] In response to the operation of the second control, the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface is switched.

[0044] In one embodiment, in response to an operation on the first control, when the ultrasound interface switches from a first number of image windows to a second number of image windows that is less than the first number, the first second number of ultrasound images displayed in the first number of image windows before the switch are selected and displayed in the second number of image windows after the switch.

[0045] In one embodiment, when only one ultrasound image is displayed on the ultrasound interface, in response to the operation of the second control, the next ultrasound image to be displayed is selected to replace the currently displayed ultrasound image.

[0046] In one embodiment, the ultrasound imaging method further includes: acquiring the ultrasound image corresponding to the mode currently to be displayed in the multimodal imaging, and controlling its display in the ultrasound interface.

[0047] According to a third aspect, one embodiment provides an ultrasound imaging system, including: an ultrasound probe, a transmission and reception control circuit, a processor, and a display component; the ultrasound probe is used to transmit ultrasound waves toward a region of interest and to receive corresponding ultrasound echo signals; the transmission and reception control circuit is used to control the probe to transmit ultrasound waves and receive ultrasound echo signals; the processor is used to perform the method as described in the first or second aspect.

[0048] According to the multimodal joint ultrasound imaging method of the above embodiments, since each modal image display control on the operation interface corresponds to one modality, and the image layout of the ultrasound image displayed on the ultrasound interface is set based on the layout of the modal image display control, the ultrasound image layout can be flexible and efficient to meet the user's usage habits and improve the user experience. At the same time, the layout of the ultrasound image can be changed in real time as needed to improve the user's efficiency. Attached Figure Description

[0049] Figure 1 This is a schematic diagram of the structure of an ultrasound imaging system according to one embodiment;

[0050] Figure 2 This is a schematic diagram of the user interface of one embodiment;

[0051] Figure 3 This is a schematic diagram of an ultrasonic interface according to one embodiment;

[0052] Figure 4 A schematic diagram of an ultrasonic interface according to another embodiment;

[0053] Figure 5 This is a schematic diagram of an ultrasonic interface according to yet another embodiment;

[0054] Figure 6 This is a schematic diagram of the user interface for another embodiment;

[0055] Figure 7 This is a schematic diagram of the user interface for yet another embodiment;

[0056] Figure 8 This is a schematic diagram of an ultrasonic interface according to one embodiment;

[0057] Figure 9 A flowchart of a multimodal combined ultrasound imaging method according to one embodiment;

[0058] Figure 10 This is a flowchart of another embodiment of a multimodal combined ultrasound imaging method. Detailed Implementation

[0059] The present invention will now be described in further detail with reference to specific embodiments and accompanying drawings. Similar elements in different embodiments are referred to by associated similar element reference numerals. In the following embodiments, many details are described to facilitate a better understanding of this application. However, those skilled in the art will readily recognize that some features may be omitted in different situations, or may be replaced by other elements, materials, or methods. In some cases, certain operations related to this application are not shown or described in the specification. This is to avoid obscuring the core parts of this application with excessive description. For those skilled in the art, detailed description of these related operations is not necessary; they can fully understand the related operations based on the description in the specification and general technical knowledge in the art.

[0060] Furthermore, the features, operations, or characteristics described in the specification can be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can be rearranged or adjusted in a manner obvious to those skilled in the art. Therefore, the various orders in the specification and drawings are only for the clear description of a particular embodiment and do not imply a necessary order, unless otherwise stated that a particular order must be followed.

[0061] The serial numbers assigned to components in this document, such as "first" and "second," are used only to distinguish the described objects and have no sequential or technical meaning. The terms "connection" and "linkage" used in this application, unless otherwise specified, include both direct and indirect connections (linkages).

[0062] In the current solution, each ultrasound image has a fixed display area. Users typically use one ultrasound image as a base for analysis, comparing it to others, depending on their needs. Therefore, different situations may require different base images. Furthermore, users usually have their preferred ultrasound image layouts for reading; for example, horizontal and vertical comparisons are ideal, while diagonal comparisons are less effective. Therefore, with fixed display areas, users cannot adjust the base image according to different situations, and this also affects their habits. For instance, users accustomed to horizontal comparison find it difficult to adapt to vertical and diagonal comparisons, resulting in a poor user experience and reduced efficiency.

[0063] In some embodiments of the present invention, when a user enters multimodal (mode) combined ultrasound imaging, one or more ultrasound images corresponding to the multimodality are displayed on the ultrasound interface, and multiple modal image display controls are displayed on the operation interface, each modal image display control corresponding to one modality. Then, the image layout of the ultrasound images displayed on the ultrasound interface is set based on the layout of the modal image display controls, and the image layout of the ultrasound images displayed on the ultrasound interface is updated accordingly when the layout of the modal image display controls changes. Therefore, flexible and efficient layout of ultrasound images can be achieved to meet user habits and improve user experience. Furthermore, the layout of the ultrasound images can be changed in real time as needed to improve user efficiency.

[0064] Please refer to Figure 1 In some embodiments, an ultrasound imaging system is provided, which includes an ultrasound probe 10, a transmission and reception control circuit 20, and a processor 40; in some embodiments, it may also include an echo processing module 30 and / or a display component 50. The components are described below.

[0065] An ultrasound probe 10 is used to emit ultrasound waves toward a region of interest and to receive corresponding ultrasound echo signals to obtain ultrasound data, such as two-dimensional or three-dimensional ultrasound data. In some specific embodiments, the ultrasound probe 10 includes multiple array elements for mutual conversion between electrical pulse signals and ultrasound waves, thereby enabling the emission of ultrasound waves toward the region of interest and the reception of corresponding ultrasound echo signals. Array elements can emit ultrasound waves according to excitation electrical signals, or convert received ultrasound waves into electrical signals. Therefore, each array element can be used to emit ultrasound waves toward biological tissue in the region of interest, and can also be used to receive ultrasound echoes returned by the tissue. During ultrasound detection, the emission and reception sequences can be used to control which array elements are used to emit ultrasound waves and which array elements are used to receive ultrasound waves, or the array elements can be controlled to be used in time slots for emitting ultrasound waves or receiving ultrasound echoes. All array elements involved in ultrasound emission can be simultaneously excited by electrical signals to emit ultrasound waves simultaneously; or the array elements involved in ultrasound emission can be excited by several electrical signals with a certain time interval to continuously emit ultrasound waves with a certain time interval.

[0066] The transmit and receive control circuit 20 controls the ultrasound probe 10 to transmit ultrasound waves and receive ultrasound echo signals. For example, the transmit and receive control circuit 20 controls the ultrasound probe 10 to transmit ultrasound waves toward the region of interest, and also controls the ultrasound probe 10 to receive ultrasound echo signals reflected from the region of interest. In some specific embodiments, the transmit and receive control circuit 20 generates transmit and receive sequences and outputs them to the ultrasound probe 10. The transmit sequence controls some or all of the multiple array elements in the ultrasound probe 10 to transmit ultrasound waves toward the biological tissue 60. The parameters of the transmit sequence include the number of array elements for transmission and ultrasound transmission parameters (e.g., amplitude, frequency, number of transmissions, transmission interval, transmission angle, waveform, and / or focusing position). The receive sequence controls some or all of the multiple array elements to receive the echoes of ultrasound waves after they have passed through the tissue. The parameters of the receive sequence include the number of array elements for reception and the reception parameters of the echoes (e.g., reception angle, depth, etc.). The ultrasound parameters in the transmit sequence and the echo parameters in the receive sequence may vary depending on the purpose of the ultrasound echo or the image generated by the ultrasound echo.

[0067] The echo processing module 30 is used to process the ultrasonic echo signal received by the ultrasonic probe 10, such as filtering, amplifying, and beamforming the ultrasonic echo signal to obtain ultrasonic echo data. In a specific embodiment, the echo processing module 30 can output the ultrasonic echo data to the processor 40, or it can store the ultrasonic echo data in a memory first, and the processor 40 reads the ultrasonic echo data from the memory when it needs to perform calculations based on the ultrasonic echo data. Those skilled in the art should understand that in some embodiments, when it is not necessary to filter, amplify, or beamform the ultrasonic echo signal, the echo processing module 30 can be omitted.

[0068] The processor 40 is used to acquire ultrasonic echo data or signals and employ relevant algorithms to obtain the required parameters or images. In some embodiments of the present invention, the processor 40 includes, but is not limited to, devices for interpreting computer instructions and processing data in computer software, such as a central processing unit (CPU), microcontroller unit (MCU), field-programmable gate array (FPGA), and digital signal processing (DSP). In some embodiments, the processor 40 is used to execute various computer applications in the non-transitory computer-readable storage medium, thereby enabling the sample analysis device to perform corresponding detection procedures.

[0069] Display component 50 can be used to display information, such as parameters and images calculated by processor 40. Those skilled in the art will understand that in some embodiments, the ultrasound imaging system itself may not integrate a display module, but instead connect to a computer device (e.g., a computer), displaying information through the computer device's display module (e.g., a display screen). In some embodiments, display component 50 may include two displays, one a main screen for displaying the processing results of ultrasound echo signals, such as displaying ultrasound images, and the other a secondary screen for controlling parameters of the ultrasound imaging system, such as controlling the selection of ultrasound probe 10 and ultrasound mode. It is understood that the content displayed on the main screen and the secondary screen can be partially or completely interchanged, and the displays can be devices with display functions such as touch displays, screens, or touch-screen displays.

[0070] The above is a brief description of the ultrasound imaging system. The following section provides a detailed explanation of the process of multimodal combined ultrasound imaging using this system.

[0071] The ultrasound imaging system first enters the multimodal combined imaging mode based on the user's operation (e.g., the command to enter multimodal imaging), and then performs multimodal combined ultrasound imaging in the multimodal combined imaging mode.

[0072] In some embodiments, the ultrasound imaging system can directly enter a multimodal co-imaging mode. For example, after the user selects multiple modes, or under the default multiple modes, the ultrasound imaging system enters the multimodal co-imaging mode based on the user's operation (e.g., an instruction to enter multimodal imaging). In the multimodal co-imaging mode, the processor 40 controls the ultrasound probe 10 to transmit and receive multimodal ultrasound waves through the transmit and receive control circuit 20, and generates ultrasound images corresponding to each of the multiple modes. For example, the multiple modes may include B-mode, shear wave elastic mode, viscous mode, and acoustic attenuation mode, then the processor 40 can generate and control the display component 50 to display the B-mode image (B image), shear wave elastic mode image (shear wave elastic image), viscous mode image (viscous image), sound velocity image, and acoustic attenuation mode image (acoustic attenuation image).

[0073] In some embodiments, the ultrasound imaging system may first enter a single-modality imaging mode and then enter a multi-modality combined imaging mode. For example, in response to a first-modality imaging command, the processor 40 controls the system to enter a single-modality imaging mode of the first mode. In this mode, the processor 40 controls the ultrasound probe 10 to transmit and receive ultrasound waves of the first mode via the transmit and receive control circuit 20, and generates an ultrasound image of the first mode. For example, the first mode may be mode B, and the corresponding ultrasound image of the first mode is a B-image. The user can observe the B-image and select a region of interest on it. Then, the user switches to the multi-modality combined imaging mode, where the processor 40 controls the ultrasound probe 10 to transmit and receive ultrasound waves of multiple modes via the transmit and receive control circuit 20, and generates ultrasound images corresponding to each mode. For example, when a user switches from single-modal imaging in mode B to multi-modal imaging including mode B, shear wave elastic mode, viscous mode, and acoustic attenuation mode, processor 40 generates and controls display component 50 to display mode B image (B image), shear wave elastic mode image (shear wave elastic image), viscous mode image (viscous image), and acoustic attenuation mode image (acoustic attenuation image). Some modes within a single mode can generate multiple types of images; for example, mode B and elastic images can typically be generated under shear wave elastic mode.

[0074] Please refer to Figure 3 During multimodal ultrasound imaging, the processor 40 controls the display component 50 to display an ultrasound interface, such as a main screen, which displays one or more of the multiple ultrasound images corresponding to the multimodal imaging. In some embodiments, the multimodal imaging includes at least two of the following: B-mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, ultrasound Doppler blood flow imaging mode, energy Doppler imaging mode, and ultramicro blood flow imaging mode. In some embodiments, the multiple ultrasound images displayed on the ultrasound interface include at least one of the following: B-image, elastic image, viscous image, sound velocity image, and acoustic attenuation image.

[0075] Please refer to Figure 2 The processor 40 also controls the control display component 50 to display an operation interface, for example, through a sub-screen. The operation interface displays a setting area B for a multimodal image layout. The setting area B includes multiple modal image display controls B1, each of which corresponds to a mode, such as mode B, shear wave elastic mode, viscous mode, strain elastic mode, or acoustic attenuation mode.

[0076] In some embodiments, each modal image display control B1 has a first state and a second state. The first state can be used to indicate that the modality corresponding to the modal image display control B1 is in an on state, and the ultrasound image corresponding to the on state will be displayed on the ultrasound interface. Conversely, the second state can be used to indicate that the modality corresponding to the modal image display control B1 is in a closed state, and the ultrasound image corresponding to it will not be displayed on the ultrasound interface.

[0077] Please refer to Figure 2 In some embodiments, the modal image display control B1 can be displayed using different markers when it is in different states, such as different colors, characters, text, or shapes. In some embodiments, the different states of the modal image display control B1 can also be indicated by whether or not it exists in the setting area B. For example, when the modal image display control B1 exists in the setting area B, it is in the first state; conversely, when it does not exist in the setting area B, it is in the second state. In this embodiment, when the image display control is in the first state, an "ON" marker is also displayed on the image display control; when it is in the second state, an "OFF" marker is also displayed.

[0078] In some embodiments, the processor 40 may also respond to operations on the modal image display control B1, enabling the modal image display control B1 to switch between a first state and a second state. For example, a touch operation on the modal image display control B1 in the first state switches it to the second state; for example, a touch drag on the modal image display control B1 causes the setting area B to appear or disappear.

[0079] Please refer to Figure 2 In some embodiments, the processor 40 can also set the mode corresponding to the modal image display control B1 in response to an operation on the modal image display control B1. For example, in response to a click operation on the modal image display control B1, the processor 40 controls the modal image display control B1 to display a drop-down menu, the options of which are different modes, such as B mode, shear wave elastic mode, viscous mode, strain elastic mode, and acoustic attenuation mode. In response to a selection operation on an option in the drop-down menu, the processor 40 sets the mode corresponding to the modal image display control B1 to the selected mode. In this embodiment, the modes corresponding to each modal image display control B1 may not be allowed to be the same. For example, if there is a modal image display control B1 corresponding to the B mode, then the modes corresponding to other modal image display controls B1 cannot be selected as the B mode. Alternatively, the modes corresponding to each modal image display control B1 may be allowed to be the same. For example, there may be two or more modal image display controls B1 that both correspond to the B mode.

[0080] In some embodiments, the processor 40 can also set the position of the modal image display control B1 within the setting area B in response to an operation on the modal image display control B1. For example, in response to a drag operation on the modal image display control B1 within the setting area B, the modal image display control B1 is moved to a corresponding position. Alternatively, in response to a touch operation on the modal image display control B1 within the setting area B, the modal image display control B1 is moved in a default direction, such as one or a combination of up, down, left, and right. In some embodiments, the processor 40 also adaptively adjusts the positions of other modal image display controls B1 based on the position to which the modal image display control B1 is moved. For example, if other modal image display controls B1 exist at the position where the modal image display control B1 is moved, these other modal image display controls B1 can exchange positions with the moved modal image display control B1, or they can move in a default direction or a random direction.

[0081] The above is a description of the modal image display control B1 in the setting area B. As can be seen from the above, the processor 40 can respond to the operation of the modal image display control B1 and adjust its state, corresponding modality, and position in the setting area B.

[0082] The processor 40 acquires the control layout information of the modal image display control B1 in the first state within the setting area B, and sets the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, so as to display the ultrasound image on the ultrasound interface according to the image layout.

[0083] In some embodiments, the control layout information includes the modality, quantity, and positional relationship of the modal image display control B1 in the first state within the setting area B. The image layout of the ultrasound image displayed on the ultrasound interface includes the type, quantity, and position of the ultrasound image displayed on the ultrasound interface. In this embodiment, the modality, quantity, and positional relationship of the modal image display control B1 have a certain correspondence or logical relationship with the type, quantity, and position of the ultrasound image. For example, when the modality corresponding to the modal image display control B1 corresponds one-to-one with the type of ultrasound image, if the modality corresponding to the modal image display control B1 includes modality B, then the type of ultrasound image displayed on the ultrasound interface includes image B. The quantity of modal image display controls B1 is consistent with the quantity of ultrasound images, and the positional relationship of the modal image display controls B1 corresponds one-to-one with the position of the ultrasound image. Therefore, the control layout information of the modal image display control B1 can have a mapping relationship with the image layout of the ultrasound image. When the processor 40 obtains the control layout information, it can obtain the image layout of the ultrasound image from the control layout information according to this mapping relationship.

[0084] Please refer to Figure 2 In some embodiments, the setting area B has four control positions B2, which are designated as the first position, the second position, the third position, and the fourth position, respectively. Please refer to [reference needed]. Figure 3 The ultrasound interface has four display areas D, namely the first display area, the second display area, the third display area, and the fourth display area. In this embodiment, the first position, the second position, the third position, and the fourth position have a certain correspondence with the first display area, the second display area, the third display area, and the fourth display area. Therefore, the ultrasound image displayed on the ultrasound interface can be set according to the control layout information of the modal image display control B1 in the first state. For example, the first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. Therefore, the processor 40 can set each display area D to display the ultrasound image of the modality corresponding to the modal image display control B1 placed at its corresponding control position B2. For example, if there is a modal image display control B1 in the first state at the first position, and its corresponding modality is modal B, then the B image corresponding to modal B is displayed in the first display area. In some embodiments, the four control positions B2 and the four display areas D are arranged in a two-row, two-column configuration. It is understood that the number of control positions B2 and display areas D can be increased or decreased, and other arrangements of control positions B2 and display areas D can be used, depending on the shape and size of the display. In this embodiment, the control positions B2 and display areas D correspond one-to-one, and the arrangement of the display areas D is fixed and does not change with the number and positional relationship of the modal image display controls B1 in the first state.

[0085] In some embodiments, the positional arrangement of the various display areas D can be varied, thereby adjusting the size of the display areas D to adapt to different usage scenarios. In some embodiments, the processor 40 can set the positional arrangement of the ultrasound images displayed on the ultrasound interface based on the number and positional relationship of the modal image display controls B1 in the first state. Please refer to... Figure 3 In this embodiment, the setting area B has four control positions B2, arranged in a two-row, two-column format. When the number of modal image display controls B1 in the first state is four or three, and each is located at a control position B2, the processor 40 sets the ultrasound interface to display four display areas D, arranged in a two-row, two-column format. At this time, the first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The processor 40 sets each display area D to display the ultrasound image of the modality corresponding to the modal image display control B1 placed at its corresponding control position B2.

[0086] Please refer to Figure 4 In some embodiments, when there are two modal image display controls B1 in the first state, each located at a control position B2, the processor 40 sets two display areas D to be displayed on the ultrasound interface, arranged horizontally, for example, a first display area on the left and a second display area on the right. The size of the two display areas D can be smaller or larger than the size of four display areas D, or they can be the same size. At this time, the processor 40 also sets the first display area to display the ultrasound image of the modality corresponding to the modal image display control B1 whose position order is earlier, and the second display area to display the ultrasound image of the modality corresponding to the modal image display control B1 whose position order is later. The first, second, third, and fourth positions have a default position order, for example, the position order of the first, second, third, and fourth positions decreases or increases sequentially. For example, if the modal image display controls B1 in the first state are located at the first and third positions respectively, then the first display area displays the ultrasound image of the modal image display control B1 corresponding to the modality at the first position, and the second display area displays the ultrasound image of the modal image display control B1 corresponding to the modality at the third position.

[0087] Please refer to Figure 4 In some embodiments, when the number of modal image display controls B1 in the first state is one and it is located at a control position B2, the processor 40 sets two display areas D arranged left and right on the ultrasound interface, such as a first display area on the left and a second display area on the right, and sets the ultrasound image of the modality corresponding to the modal image display control B1 to be displayed in the first display area.

[0088] Please refer to Figure 5 In some embodiments, when the number of modal image display controls B1 in the first state is one and it is located at a control position B2, the processor 40 sets a display area D to be displayed on the ultrasound interface, and sets the ultrasound image of the modality corresponding to the modal image display control B1 to be displayed in the display area D.

[0089] In some embodiments, the processor 40 can also respond to operations on the setting area B by updating the image layout of the ultrasound image displayed on the ultrasound interface when the control layout information of the modal image display control B1 in the first state within the setting area B changes. For example, when the modal image display control B1 in the first state within the setting area B increases or changes position, the ultrasound image of the modality corresponding to the modal image display control B1 in the first state will be added to the display on the ultrasound interface or its position will change accordingly. In this embodiment, the image layout of the ultrasound image can be updated in real time based on operations on the setting area B, thereby meeting the user's real-time layout needs and adjustments.

[0090] As described above, users can adjust the modality, quantity, and positional relationship of the modal image display controls B1, thereby adjusting the control layout of the image display controls. The control layout of the modal image display controls B1 can correspond one-to-one with the image layout of the ultrasound image, thus setting each display area D to display the ultrasound image of the modality corresponding to the modal image display control B1 placed at its corresponding control position B2. The image layout of the ultrasound image can also be readjusted based on changes in the quantity and positional relationship of the modal image display controls B1 in the first state, adapting to different usage scenarios. Furthermore, when the control layout of the modal image display controls B1 changes in real time, the image layout of the ultrasound image can be updated in real time, achieving flexible and efficient image layout adjustment.

[0091] The above describes one method of multimodal ultrasound imaging using an ultrasound imaging system. The following describes another method of multimodal ultrasound imaging using an ultrasound imaging system, and mainly explains the differences between the two methods.

[0092] Please refer to Figure 8 When performing multimodal ultrasound imaging, the processor 40 controls the display component 50 to display an ultrasound interface, for example, through the main screen. The ultrasound interface displays one or more image windows F, and each image window F can display the ultrasound image corresponding to one mode in the multimodal process.

[0093] Please refer to Figure 6 and 7 The processor 40 also controls the display component 50 to display an operation interface, for example, through a secondary screen. This operation interface displays a setting area B for the multimodal image layout, which includes a first control A and a second control C. The first control A corresponds to the number of image windows F, and the second control C is used to switch the position order of the ultrasound images displayed on the ultrasound interface.

[0094] In response to the operation of the first control A, the processor 40 sets or switches the number of image windows F corresponding to the first control A, and generates a corresponding number of image windows F on the ultrasound interface according to the number of image windows F set or switched by the first control A.

[0095] In some embodiments, during multimodal ultrasound imaging, an initial number of image windows F can be displayed on the ultrasound interface. This initial number of image windows F can be the same as the number of modes corresponding to the multimodal activity. For example, if the multimodal activity includes three modes, then the initial number of image windows F is three. The initial number of image windows F can also be the maximum number of image windows F. For example, if the ultrasound interface can display a maximum of four image windows F, then the initial number of image windows F is four. Please refer to... Figure 6When the processor 40 responds to the operation of the first control A, it can directly switch the number of image windows F. For example, clicking the first control A can increase or decrease the number of image windows F. For example, each click of the first control A can increase or decrease the number of image windows F by one. When the number increases to the maximum or decreases to one, clicking the first control A again will switch the number of image windows F to one or the maximum number.

[0096] In some embodiments, there may be two first controls A, one of which is used to decrease the number of image windows F, and the other is used to increase the number of image windows F.

[0097] Please refer to Figure 7 In some embodiments, when the processor 40 responds to the operation of the first control A, the first control A displays a drop-down menu with options for different numbers of image windows F, such as number 1, number 2, number 3 to number X, where X is the maximum number. In response to the selection operation of the option in the drop-down menu, the processor 40 generates the corresponding number of image windows F on the ultrasound interface.

[0098] The processor 40 also responds to the operation of the second control C by switching the position order of the ultrasound images displayed in the current number of image windows F on the ultrasound interface.

[0099] Please refer to Figure 8In some embodiments, when performing multimodal ultrasound imaging, an initial number of image windows F can be displayed on the ultrasound interface, and the initial number of image windows F and the ultrasound images displayed therein have a certain positional order. For example, when the initial number of image windows F is four or three, they are arranged in a two-row, two-column manner. For example, when the initial number of image windows F is two, they are arranged in a left-right, two-column manner. The multiple ultrasound images corresponding to the multimodal are displayed in one image window F, and each image window F and the ultrasound image therein can have a default position, such as the first position, the second position, the third position, or the fourth position. When the processor 40 responds to the operation of the second control C, it can directly switch the position order of the ultrasound images displayed in the current number of image windows F. For example, clicking the second control C will change the position of each image window F and the position of the ultrasound image within it. For instance, the image window F in the first position and its displayed ultrasound image will move to the second position, the image window F in the second position and its displayed ultrasound image will move to the third position, the image window F in the third position and its displayed ultrasound image will move to the fourth position, and the image window F in the fourth position and its displayed ultrasound image will move back to the first position. When the second control C is clicked again, the position of each image window F will be changed again in the same manner.

[0100] In some embodiments, when the number of image windows F is at its maximum, clicking the second control C can also change the position of the ultrasound image located in each image window F.

[0101] In some embodiments, the positions of each image window F and the ultrasound images therein can be changed sequentially according to the positional order, or they can be moved sequentially without following the positional order. For example, they can be moved sequentially according to the arrangement and combination of the positions of each image window F and the ultrasound images therein. For example, the first position, the second position, and the third position have six possible arrangements and combinations, and each position change selects one of them sequentially.

[0102] In some embodiments, in response to an operation on the first control A, when the ultrasound interface switches from a first number of image windows F to a second number of image windows F (which is less than the first number), the processor 40 selects the first second number of ultrasound images displayed in the first number of image windows F before the switch and displays them in the second number of image windows F after the switch. For example, if the first number of image windows F is three and the second number of image windows F is two, when the number of image windows F switches from three to two, the ultrasound images in the first two image windows F of the three image windows F are displayed in the two image windows F after the switch. The preceding image window F and its ultrasound images can be determined based on the default position of the image window F.

[0103] In some embodiments, when only one ultrasound image is displayed on the ultrasound interface, the processor 40, in response to an operation on the second control C, selects the next ultrasound image to replace the currently displayed ultrasound image. For example, when the number of modes corresponding to the multimodal imaging is three, there are also three corresponding ultrasound images. When only one ultrasound image is displayed on the ultrasound interface, the preceding image window F and its ultrasound image can be determined based on the default position of the image window F. For example, the image window F at the first position and its ultrasound image are displayed. The processor 40, in response to an operation on the second control C, selects the ultrasound image at the second position for display.

[0104] As described above, in some embodiments, during multimodal ultrasound imaging, an initial number of image windows F can be displayed on the ultrasound interface, and the initial number of image windows F can be consistent with the number of modes corresponding to the multimodal imaging. More generally, in some embodiments, the processor 40 also acquires the ultrasound image corresponding to the mode currently to be displayed in the multimodal imaging and controls the display component 50 to display it on the ultrasound interface.

[0105] For example, at the beginning of multimodal ultrasound imaging (i.e., when just entering multimodal ultrasound imaging), the modal that needs to be displayed in the multimodal imaging can be defaulted to all modalities in the multimodal imaging, or the user can select the modalities to be displayed in the multimodal imaging through the operation interface. The user can make the selection through the operation interface before multimodal ultrasound imaging. In such an embodiment, after multimodal ultrasound imaging is performed, the processor 40 first generates a corresponding number of windows according to the number of ultrasound images corresponding to the modal to be displayed. Each window corresponds to an ultrasound image corresponding to a modal to be displayed. The processor 40 then controls the display component 50 to display the ultrasound images corresponding to the corresponding modal on these windows. Then, the user can further set or switch the number of image windows and the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface through the first control A and the second control C.

[0106] After the ultrasound interface displays the image window and ultrasound images, users can still select the mode to be displayed in the multimodal mode through the operation interface to set the ultrasound images displayed on the ultrasound interface.

[0107] In some embodiments, if the user adds ultrasound images of a modality that need to be displayed, the processor 40 can control the addition of new image windows for display. In other embodiments, if the user adds ultrasound images of a modality that need to be displayed, and there are currently empty image windows (i.e., no ultrasound images are displayed), the processor 40 will prioritize displaying the newly added ultrasound images in these empty image windows. If the number of these empty image windows is insufficient, after displaying a portion of the newly added ultrasound images in these empty image windows, the processor 40 will then control the addition of new image windows to display the remaining ultrasound images among the newly added ultrasound images.

[0108] In some embodiments, if the user reduces the number of ultrasound images of a modality that need to be displayed, the processor 40 may delete the corresponding image window, or retain the corresponding image window but not display the corresponding ultrasound image in that image window.

[0109] Please refer to Figure 9 Some embodiments provide a multimodal combined ultrasound imaging method, which is applied to the ultrasound imaging system described above, and may include the following steps.

[0110] Step 100: Perform multimodal ultrasound imaging.

[0111] Step 200: Display one or more ultrasound images corresponding to the multimodal mode on the ultrasound interface.

[0112] Step 300: Display the setting area of ​​the multimodal image layout on the operation interface; the setting area includes multiple modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state.

[0113] Step 400: Obtain the control layout information of the modal image display control in the first state within the setting area, and set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, so as to display the ultrasound image on the ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

[0114] In some embodiments, the control layout information of the modal image display controls in the first state within the setting area includes: the modality, quantity, and positional relationship of the modal image display controls in the first state within the setting area; the image layout of the ultrasound images displayed on the ultrasound interface includes: the type, quantity, and position of the ultrasound images displayed on the ultrasound interface.

[0115] In some embodiments, setting the image layout of the ultrasound images displayed on the ultrasound interface according to the control layout information includes: setting a corresponding ultrasound image to be displayed on the ultrasound interface for each modality corresponding to the modality image display control in the first state; and setting the position arrangement of the ultrasound images displayed on the ultrasound interface according to the number and position relationship of the modality image display controls in the first state.

[0116] In some embodiments, the setting area has four control positions arranged in a two-row, two-column configuration: a first position, a second position, a third position, and a fourth position; the control positions are capable of placing the modal image display controls; the setting of the position arrangement of the ultrasound image displayed on the ultrasound interface according to the number and positional relationship of the modal image display controls in the first state includes: when the number of modal image display controls in the first state is four and each is located in one of the control positions, setting the ultrasound interface to display four display areas arranged in a two-row, two-column configuration: a first display area, a second display area, a third display area, and a fourth display area, wherein the first display area, the second display area, the third display area, the fourth ... The second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively; each display area is configured to display the ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position; and / or, when the number of modal image display controls in the first state is three and each is located at one of the control positions, the ultrasound interface is configured to display four display areas arranged in a two-row, two-column format: a first display area, a second display area, a third display area, and a fourth display area, wherein the first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second display area, the third display area, and the fourth display area, respectively. The first position, the second position, the third position, and the fourth position are described; each display area is configured to display the ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position; and / or, when the number of modal image display controls in the first state is two and each is located at one of the control positions, two display areas arranged left and right are displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the first display area displays the ultrasound image of the modality corresponding to the modal image display control that is in the first position order, and the second display area displays the ultrasound image of the modality corresponding to the modal image display control that is in the second position order; wherein, the first The positions of the first, second, third, and fourth positions decrease sequentially; and / or, when the number of modal image display controls in the first state is one and it is located at one of the control positions, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the first display area; and / or, when the number of modal image display controls in the first state is one and it is located at one of the control positions, a display area is set to be displayed on the ultrasound interface, and the ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the display area.

[0117] In some embodiments, the modal image display control further has a second state; when the modal image display control is in the first state, the ultrasound image of the modality corresponding to the modal image display control is displayed on the ultrasound interface; conversely, when the modal image display control is in the second state, the ultrasound image of the modality corresponding to the modal image display control is not displayed on the ultrasound interface; in response to an operation on the modal image display control, the modal image display control can switch between the first state and the second state.

[0118] In some embodiments, for each modal image display control, a flag indicating whether the modal image display control is in the first state or the second state is displayed.

[0119] In some embodiments, in response to an operation on the modal image display control, the modality corresponding to the modal image display control is set. In some embodiments, setting the modality corresponding to the modal image display control in response to an operation on the modal image display control includes: in response to a click operation on the modal image display control, controlling the modal image display control to display a drop-down menu, the options of the drop-down menu being different modalities; and in response to a selection operation on an option in the drop-down menu, setting the modality corresponding to the modal image display control to the selected modality.

[0120] In some embodiments, in response to an operation on the modal image display control, the position of the modal image display control within the set area is set. In some embodiments, setting the position of the modal image display control within the set area in response to an operation on the modal image display control includes: in response to a drag operation on the modal image display control within the set area, moving the modal image display control to a corresponding position. In some embodiments, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

[0121] Please refer to Figure 10 Some embodiments provide a multimodal combined ultrasound imaging method, which is applied to the ultrasound imaging system described above, and may include the following steps:

[0122] Step 110: Perform multimodal ultrasound imaging.

[0123] Step 210: Display one or more image windows on the ultrasound interface, wherein one image window can display an ultrasound image corresponding to one mode in the multimodal display.

[0124] Step 310: Display the setting area for the multimodal image layout on the operation interface; the setting area includes a first control and a second control; the first control corresponds to the number of image windows; the second control is used to switch the position order of the ultrasound images displayed on the ultrasound interface.

[0125] Step 410: In response to the operation of the first control, set or switch the number of image windows corresponding to the first control, and generate a corresponding number of image windows on the ultrasound interface according to the number of image windows set or switched by the first control; in response to the operation of the second control, switch the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface.

[0126] In some embodiments, in response to an operation on the first control, when the ultrasound interface switches from a first number of image windows to a second number of image windows that is less than the first number, the first second number of ultrasound images displayed in the first number of image windows before the switch are selected and displayed in the second number of image windows after the switch.

[0127] In some embodiments, when only one ultrasound image is displayed on the ultrasound interface, in response to an operation on the second control, the next ultrasound image to be displayed is selected to replace the currently displayed ultrasound image.

[0128] This document describes various exemplary embodiments with reference to them. However, those skilled in the art will recognize that changes and modifications can be made to the exemplary embodiments without departing from the scope of this document. For example, various operational steps and components for performing operational steps can be implemented in different ways depending on the specific application or considering any number of cost functions associated with the operation of the system (e.g., one or more steps can be deleted, modified, or combined with other steps).

[0129] In the above embodiments, implementation can be achieved, in whole or in part, by software, hardware, firmware, or any combination thereof. Furthermore, as those skilled in the art will understand, the principles herein can be reflected in a computer program product on a computer-readable storage medium pre-loaded with computer-readable program code. Any tangible, non-transitory computer-readable storage medium may be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-ROMs, DVDs, Blu-ray discs, etc.), flash memory, and / or the like. These computer program instructions can be loaded onto a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to form a machine, such that instructions executing on the computer or other programmable data processing apparatus can generate means for implementing a specified function. These computer program instructions can also be stored in a computer-readable storage medium that can instruct the computer or other programmable data processing apparatus to operate in a particular manner, such that instructions stored in the computer-readable storage medium can form an article of manufacture including means for implementing the specified function. The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to perform a series of operational steps on the computer or other programmable apparatus to produce a computer-implemented process, such that instructions executing on the computer or other programmable apparatus can provide steps for implementing the specified function.

[0130] While the principles herein have been illustrated in various embodiments, numerous modifications to the structures, arrangements, proportions, elements, materials, and components, particularly suited to specific environments and operational requirements, may be used without departing from the principles and scope of this disclosure. These modifications and other alterations or alterations will be included within the scope of this document.

[0131] The foregoing specific descriptions have been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of this disclosure. Therefore, considerations for this disclosure are to be illustrative rather than restrictive, and all such modifications are to be included within its scope. Similarly, advantages, other advantages, and solutions to problems with respect to various embodiments have been described above. However, benefits, advantages, solutions to problems, and any elements that produce these, or make them more explicit, should not be construed as critical, essential, or necessary. The term “comprising” and any other variations thereof as used herein are non-exclusive inclusion, meaning that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed or not part of the process, method, system, article, or apparatus. Furthermore, the term “coupled” and any other variations thereof as used herein refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and / or any other connections.

[0132] Those skilled in the art will recognize that many changes can be made to the details of the above embodiments without departing from the basic principles of the invention. Therefore, the scope of the invention should be determined only by the claims.

Claims

1. A multimodal combined ultrasound imaging method, characterized in that, include: Perform multimodal ultrasound imaging; The ultrasound interface displays one or more ultrasound images corresponding to the multimodal modes; wherein: The operation interface displays a setting area for the multimodal image layout; the setting area includes multiple modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state; Obtain the control layout information of the modal image display control in the first state within the setting area, and set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, so as to display the ultrasound image on the ultrasound interface according to the image layout; in response to the operation of the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

2. The method as described in claim 1, characterized in that, The control layout information of the modal image display controls in the first state within the setting area includes: the modality, quantity, and positional relationship of the modal image display controls in the first state within the setting area; The image layout of the ultrasound images displayed on the ultrasound interface includes: the type, number, and position of the ultrasound images displayed on the ultrasound interface.

3. The method as described in claim 1 or 2, characterized in that, The step of setting the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information includes: For each modality corresponding to the modality image display control in the first state, an ultrasound image of the corresponding modality is set to be displayed on the ultrasound interface; Based on the number and positional relationship of the modal image display controls in the first state, the positional arrangement of the ultrasound images displayed on the ultrasound interface is set.

4. The method as described in claim 3, characterized in that, The setting area has four control positions arranged in a two-row, two-column configuration: a first position, a second position, a third position, and a fourth position; these control positions are capable of accommodating the modal image display control. The step of setting the position arrangement of the ultrasound images displayed on the ultrasound interface according to the number and positional relationship of the modal image display controls in the first state includes: When the number of modal image display controls in the first state is four and each is located at one of the control positions, the ultrasound interface is configured to display four display areas arranged in a two-row, two-column format: a first display area, a second display area, a third display area, and a fourth display area. The first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position is displayed in each of the display areas. And / or, When the number of modal image display controls in the first state is three and each is located at one of the control positions, the ultrasound interface is configured to display four display areas arranged in a two-row, two-column format: a first display area, a second display area, a third display area, and a fourth display area. The first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position is displayed in each of the display areas. And / or, When there are two modal image display controls in the first state, each located at one of the control positions, two display areas are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the ultrasound image of the modality corresponding to the modal image display control that is displayed first in the first display area, and the ultrasound image of the modal image display control that is displayed later in the second display area; wherein the positions of the first position, the second position, the third position, and the fourth position decrease sequentially. And / or, When the number of modal image display controls in the first state is one and the control is located in one position, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the first display area; And / or, When the number of modal image display controls in the first state is one and the control is located at one of the control positions, a display area is set to be displayed on the ultrasound interface, and the ultrasound image of the modality corresponding to the modal image display control is displayed in the display area.

5. The method as described in claim 1, characterized in that, The modal image display control also has a second state; when the modal image display control is in the first state, the ultrasound image of the modality corresponding to the modal image display control is displayed on the ultrasound interface; conversely, when the modal image display control is in the second state, the ultrasound image of the modality corresponding to the modal image display control is not displayed on the ultrasound interface. In response to an operation on the modal image display control, the modal image display control can switch between a first state and a second state.

6. The method of claim 5, characterized in that, For each of the modal image display controls, a flag indicating whether the modal image display control is in the first state or the second state is displayed.

7. The method as described in claim 1, characterized in that, In response to an operation on the modal image display control, the modality corresponding to the modal image display control is set.

8. The method as described in claim 7, characterized in that, The step of setting the modality corresponding to the modal image display control in response to an operation on the modal image display control includes: In response to a click operation on the modal image display control, the modal image display control is controlled to display a drop-down menu, the options of which are different modalities; In response to the selection operation of the option in the drop-down menu, the modality corresponding to the modal image display control is set to the selected modality.

9. The method as described in claim 1, characterized in that, In response to an operation on the modal image display control, the position of the modal image display control within the set area is set.

10. The method as described in claim 9, characterized in that, The step of setting the position of the modal image display control within the set area in response to an operation on the modal image display control includes: In response to a drag operation on a modal image display control within the set area, the modal image display control is moved to the corresponding position; preferably, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

11. The method as described in claim 1, characterized in that, The ultrasound interface is displayed on a monitor, and the operation interface is displayed on a touch screen.

12. The method as described in claim 1, characterized in that, The multimodal modes include at least two of the following: B-mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, sound velocity mode, ultrasound Doppler blood flow imaging mode, energy Doppler imaging mode, and ultramicro blood flow imaging mode.

13. An ultrasound imaging system, characterized in that, include: An ultrasonic probe, a transmitting and receiving control circuit, a processor, and a display component; the ultrasonic probe is used to transmit ultrasonic waves to a region of interest and to receive corresponding ultrasonic echo signals; the transmitting and receiving control circuit is used to control the probe to transmit ultrasonic waves and receive ultrasonic echo signals; the processor is used to perform the method as described in any one of claims 1 to 12.

Images