Multi-mode combined ultrasonic imaging method and system

Abstract

The invention discloses a multi-modal combined ultrasonic imaging method and an ultrasonic imaging system. The method comprises the following steps: performing multi-modal combined ultrasonic imaging; displaying an ultrasonic image corresponding to multiple modes on an ultrasonic interface; wherein the operation interface display setting area comprises a plurality of modal image display controls, each modal image display control corresponds to one modal, and the modal image display control at least has a first state; acquiring control layout information of a modal image display control in a first state in the setting area, and setting an image layout of an ultrasonic image displayed on the ultrasonic interface according to the control layout information; and in response to the operation on the setting area, when the control layout information of the modal image display control in the first state in the setting area changes, correspondingly updating the image layout of the ultrasonic image displayed on the ultrasonic interface. The image layout of the ultrasonic image displayed on the ultrasonic interface is set based on the layout of the modal image display control, so that the use habit of a user is met.

Description

Technical Field

[0001] The present invention relates to the technical field of ultrasonic imaging, and in particular to a multi-modal combined ultrasonic imaging method and system. Background Art

[0002] Ultrasound imaging uses ultrasonic beams to scan human tissues and organs, and obtains ultrasound images of tissues and organs in the body by receiving and processing reflected signals. Ultrasound imaging has multiple modes, such as B-mode, shear wave elastic mode, and viscosity mode, and ultrasound images obtained in different modes can reflect different characteristics of tissues and organs. Currently, in many clinical scenarios, ultrasound images and quantitative parameter evaluations obtained by a single mode are very limited for disease diagnosis and evaluation. For example, due to acute inflammation, shear wave elasticity is limited in evaluating the degree of hepatitis B liver fibrosis; B-mode ultrasound has low sensitivity and cannot detect early fatty liver, and lacks quantitative evaluation tools; therefore, in order to reflect the various characteristics of tissues and organs from multiple dimensions, multiple modes need to be combined in real time.

[0003] When users perform real-time multi-mode combination, they can obtain multiple ultrasound images corresponding to the multiple modes, and users usually have their own customary ultrasound image layout for reading. However, in the current solution, the positions of multiple ultrasound images are fixed, which affects the user's habits and leads to a poor user experience. Therefore, a new solution is needed. Summary of the invention

[0004] The main technical problem solved by the present invention is that when multiple modes are combined in real time, the layout of multiple ultrasound images cannot meet the needs of users.

[0005] According to the first aspect, an embodiment provides a multi-modal combined ultrasound imaging method, characterized by comprising:

[0006] Perform multimodal combined ultrasound imaging;

[0007] One or more ultrasound images corresponding to the multi-modality are displayed on the ultrasound interface; wherein:

[0008] A setting area for displaying a multimodal image layout on an operation interface; the setting area includes a plurality of modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state;

[0009] Acquire control layout information of the modal image display control in the first state within the setting area, set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, and display the ultrasound image on the ultrasound interface according to the image layout; in response to the operation on the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

[0010] In one embodiment, the control layout information of the modal image display controls in the first state in the setting area includes: the mode, quantity and position relationship corresponding to the modal image display controls in the first state in the setting area;

[0011] The image layout of the ultrasound images displayed on the ultrasound interface includes: the type, quantity and position of the ultrasound images displayed on the ultrasound interface.

[0012] In one embodiment, the image layout of the ultrasound image displayed on the ultrasound interface is set according to the control layout information, including:

[0013] For each modality corresponding to the modality image display control in the first state, an ultrasound image of the corresponding modality is displayed on the ultrasound interface;

[0014] The position arrangement of the ultrasound image displayed on the ultrasound interface is set according to the number and positional relationship of the modal image display controls in the first state.

[0015] In one embodiment, the setting area has four control positions arranged in two rows and two columns: a first position, a second position, a third position and a fourth position; the control positions can be used to place the modal image display control;

[0016] The step of setting the position arrangement of the ultrasound image displayed on the ultrasound interface according to the number and position relationship of the modal image display controls in the first state includes:

[0017] When the number of modal image display controls in the first state is four and each is located at one of the control positions, four display areas arranged in two rows and two columns are displayed on the ultrasound interface: a first display area, a second display area, a third display area and a fourth display area, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively; each of the display areas is configured to display an ultrasound image of a modality corresponding to the modal image display control placed at its corresponding control position;

[0018] and / or,

[0019] When the number of modal image display controls in the first state is three and each is located at one of the control positions, four display areas arranged in two rows and two columns are displayed on the ultrasound interface: a first display area, a second display area, a third display area and a fourth display area, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively; each of the display areas is configured to display an ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position;

[0020] and / or,

[0021] When the number of modal image display controls in the first state is two and they are respectively located at one of the control positions, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; an ultrasound image of a modality corresponding to a modality image display control in a front position sequence is set to be displayed in the first display area, and an ultrasound image of a modality corresponding to a modality image display control in a back position sequence is set to be displayed in the second display area; wherein the positions of the first position, the second position, the third position and the fourth position are sequentially decreased;

[0022] and / or,

[0023] When the number of the modal image display control in the first state is one and is located at one of the control positions, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; and an ultrasound image of the modality corresponding to the modal image display control is displayed in the first display area;

[0024] and / or,

[0025] When the number of the modal image display controls in the first state is one and is located at one of the control positions, a display area is set to be displayed on the ultrasound interface, and an ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the display area.

[0026] In one embodiment, the modality image display control further has a second state; when the modality image display control is in the first state, an ultrasound image of the modality corresponding to the modality image display control is displayed on the ultrasound interface, and conversely, when the modality image display control is in the second state, an ultrasound image of the modality corresponding to the modality image display control is not displayed on the ultrasound interface;

[0027] In response to an operation on the modal image display control, the modal image display control can switch between the first state and the second state.

[0028] In one embodiment, for each of the modal image display controls, a mark is displayed indicating whether the modal image display control is in the first state or the second state.

[0029] In one embodiment, in response to an operation on the modal image display control, a mode corresponding to the modal image display control is set.

[0030] In one embodiment, in response to the operation on the modal image display control, setting the modality corresponding to the modal image display control includes:

[0031] In response to a click operation on the modal image display control, controlling the modal image display control to display a drop-down menu, wherein the options of the drop-down menu are different modes;

[0032] In response to a selection operation on an option in the drop-down menu, the mode corresponding to the modal image display control is set to the selected mode.

[0033] In one embodiment, in response to an operation on the modal image display control, the position of the modal image display control within the setting area is set.

[0034] In one embodiment, in response to the operation on the modal image display control, setting the position of the modal image display control in the setting area includes:

[0035] In response to a dragging operation on the modal image display control within the setting area, the modal image display control is moved to a corresponding position; preferably, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

[0036] In one embodiment, the ultrasound interface is displayed on a display, and the operation interface is displayed on a touch screen.

[0037] In one embodiment, the multi-modality includes at least two of: B-mode, shear wave elastic mode, viscous mode, strain elastic mode and acoustic attenuation mode, ultrasonic Doppler blood flow imaging mode, power Doppler imaging mode and ultra-micro blood flow imaging mode.

[0038] According to the second aspect, an embodiment provides a multi-modal combined ultrasound imaging method, comprising:

[0039] Perform multimodal combined ultrasound imaging;

[0040] One or more image windows are displayed on the ultrasound interface, and one of the image windows can display an ultrasound image corresponding to one of the multiple modalities; wherein:

[0041] A setting area for displaying a multimodal image layout on an operation interface; the setting area includes a first control and a second control; the first control corresponds to the number of image windows; the second control is used to switch the position order of ultrasound images displayed on the ultrasound interface;

[0042] In response to an operation on the first control, the number of image windows corresponding to the first control is set or switched, and a corresponding number of image windows is generated on the ultrasound interface according to the number of image windows set or switched by the first control;

[0043] In response to an operation on the second control, the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface is switched.

[0044] In one embodiment, in response to an operation on the first control, when the ultrasound interface switches from a first number of image windows to a second number of image windows which is smaller than the first number, the first second number of ultrasound images displayed in the first number of image windows before the switching are selected and displayed in the second number of image windows after the switching.

[0045] In one embodiment, when the ultrasound interface displays only one ultrasound image, in response to an operation on the second control, a next ultrasound image of the currently displayed ultrasound image is selected to replace the currently displayed ultrasound image for display.

[0046] In one embodiment, the ultrasound imaging method further includes: acquiring an ultrasound image corresponding to a mode that currently needs to be displayed in the multi-modes, and controlling the display in the ultrasound interface.

[0047] According to the third aspect, an embodiment provides an ultrasound imaging system, comprising: an ultrasound probe, a transmitting and receiving control circuit, a processor, and a display component; the ultrasound probe is used to transmit ultrasound to a region of interest, and receive corresponding ultrasound echo signals; the transmitting and receiving control circuit is used to control the probe to transmit ultrasound and receive ultrasound echo signals; the processor is used to execute the method described in the first aspect or the second aspect.

[0048] According to the multimodal joint ultrasound imaging method of the above embodiment, since each modality image display control displayed on the operation interface corresponds to a modality, and the image layout of the ultrasound image displayed on the ultrasound interface is set based on the layout of the modality image display control, it is possible to achieve a flexible and efficient layout of the ultrasound image to meet the user's usage habits and improve the user's experience. At the same time, the layout of the ultrasound image can be changed in real time according to the needs of the situation to improve the user's efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a schematic structural diagram of an ultrasonic imaging system according to an embodiment;

[0050] Figure 2 is a schematic diagram of an operation interface of an embodiment;

[0051] Figure 3 is a schematic diagram of an ultrasound interface of an embodiment;

[0052] Figure 4 is a schematic diagram of an ultrasound interface of another embodiment;

[0053] Figure 5 is a schematic diagram of an ultrasound interface of yet another embodiment;

[0054] Figure 6 is a schematic diagram of an operation interface of another embodiment;

[0055] Figure 7 is a schematic diagram of an operation interface of yet another embodiment;

[0056] Figure 8 is a schematic diagram of an ultrasound interface of an embodiment;

[0057] Fig. 9 A flowchart of a multi-modal combined ultrasound imaging method according to an embodiment;

[0058] Fig.10 The present invention is a flowchart of a multi-modal combined ultrasound imaging method according to another embodiment. DETAILED DESCRIPTION

[0059] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0060] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0061] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0062] In the current solution, since each ultrasound image has a fixed display area, and users usually use one ultrasound image among multiple ultrasound images as the basis according to the actual needs, and then compare it with other ultrasound images for analysis, different ultrasound images may be needed as the basis in different situations. And users usually have their own habitual ultrasound image layout method for reading. For example, horizontal and vertical comparisons are the most ideal comparison directions, while diagonal comparisons are relatively poor. Therefore, when the display area of ​​ultrasound images is fixed, users cannot adjust different ultrasound images as the basis according to different situations, and it affects the user's habits. For example, users who are accustomed to horizontal comparisons find it difficult to adapt to vertical and diagonal comparisons, which will lead to a poor user experience and affect efficiency.

[0063] In some embodiments of the present invention, when a user enters multi-modal (mode) combined ultrasound imaging, one or more ultrasound images corresponding to the multi-modal are displayed on the ultrasound interface, and multiple modal image display controls are displayed on the operation interface, each modal image display control corresponding to a modality. Then, the image layout of the ultrasound image displayed on the ultrasound interface is set based on the layout of the modal image display control, and when the layout of the modal image display control changes, the image layout of the ultrasound image displayed on the ultrasound interface is updated accordingly, so that a flexible and efficient layout of the ultrasound image can be achieved to meet the user's usage habits and improve the user's experience. At the same time, the layout of the ultrasound image can be changed in real time according to the situation, thereby improving the user's efficiency.

[0064] Please refer to Figure 1 In some embodiments, an ultrasound imaging system is provided, which includes an ultrasound probe 10, a transmission and reception control circuit 20 and a processor 40; in some embodiments, an echo processing module 30 and / or a display component 50 may also be included. Each component is described below.

[0065] The ultrasonic probe 10 is used to transmit ultrasonic waves to the region of interest, and to receive corresponding ultrasonic echo signals to obtain ultrasonic data, such as two-dimensional ultrasonic data or three-dimensional ultrasonic data. In some specific embodiments, the ultrasonic probe 10 includes a plurality of array elements, which are used to realize the mutual conversion between electrical pulse signals and ultrasonic waves, so as to realize the transmission of ultrasonic waves to the region of interest and the reception of corresponding ultrasonic echo signals. The array element can transmit ultrasonic waves according to the excitation electrical signal, or convert the received ultrasonic waves into electrical signals. Therefore, each array element can be used to transmit ultrasonic waves to the biological tissue of the region of interest, and can also be used to receive ultrasonic echoes returned by the tissue. When performing ultrasonic detection, which array elements are used to transmit ultrasonic waves and which array elements are used to receive ultrasonic waves can be controlled by the transmission sequence and the reception sequence, or the array elements can be controlled to transmit ultrasonic waves or receive ultrasonic echoes in time slots. All array elements participating in ultrasonic emission can be simultaneously excited by electrical signals, thereby transmitting ultrasonic waves at the same time; or the array elements participating in ultrasonic emission can also be excited by several electrical signals with a certain time interval, thereby continuously transmitting ultrasonic waves with a certain time interval.

[0066] The transmitting and receiving control circuit 20 is used to control the ultrasonic probe 10 to transmit ultrasonic waves and receive ultrasonic echo signals. For example, the transmitting and receiving control circuit 20 is used to control the ultrasonic probe 10 to transmit ultrasonic waves to the region of interest on the one hand, and to control the ultrasonic probe 10 to receive ultrasonic echo signals reflected by the ultrasonic waves from the region of interest on the other hand. In some specific embodiments, the transmitting and receiving control circuit 20 is used to generate a transmitting sequence and a receiving sequence, and output them to the ultrasonic probe 10. The transmitting sequence is used to control part or all of the multiple array elements in the ultrasonic probe 10 to transmit ultrasonic waves to the biological tissue 60. The parameters of the transmitting sequence include the number of array elements used for transmission and ultrasonic transmission parameters (such as amplitude, frequency, number of wave transmissions, transmission interval, transmission angle, waveform and / or focus position, etc.). The receiving sequence is used to control part or all of the multiple array elements to receive the echo of the ultrasonic wave after passing through the tissue. The parameters of the receiving sequence include the number of array elements used for reception and the receiving parameters of the echo (such as reception angle, depth, etc.). The ultrasonic parameters in the transmitting sequence and the echo parameters in the receiving sequence are different depending on the use of the ultrasonic echo or the image generated according to the ultrasonic echo.

[0067] The echo processing module 30 is used to process the ultrasonic echo signal received by the ultrasonic probe 10, for example, filtering, amplifying, beamforming, etc., to obtain ultrasonic echo data. In a specific embodiment, the echo processing module 30 can output the ultrasonic echo data to the processor 40, or store the ultrasonic echo data in a memory first, and when it is necessary to perform calculations based on the ultrasonic echo data, the processor 40 reads the ultrasonic echo data from the memory. Those skilled in the art should understand that in some embodiments, when it is not necessary to filter, amplify, beamform, etc., the ultrasonic echo signal, the echo processing module 30 can also be omitted.

[0068] The processor 40 is used to obtain ultrasonic echo data or signals, and use relevant algorithms to obtain the required parameters or images. The processor 40 in some embodiments of the present invention includes but is not limited to a central processing unit (CPU), a microcontroller unit (MCU), a field programmable gate array (FPGA), and a digital signal processing (DSP) device for interpreting computer instructions and processing data in computer software. In some embodiments, the processor 40 is used to execute various computer applications in the non-temporary computer-readable storage medium, so that the sample analysis device executes the corresponding detection process.

[0069] The display component 50 can be used to display information, such as displaying parameters and images calculated by the processor 40. Those skilled in the art should understand that in some embodiments, the ultrasound imaging system itself may not integrate a display module, but may be connected to a computer device (such as a computer) to display information through a display module (such as a display screen) of the computer device. In some embodiments, the display component 50 may include two displays, one of which is a main screen that can be used to display the processing results of the ultrasonic echo signal, such as displaying an ultrasonic image, and the other is a sub-screen that can be used to control the parameters of the ultrasound imaging system, such as controlling the selection of the ultrasound probe 10, the ultrasound mode, etc. It is understandable that the contents displayed on the main screen and the sub-screen can be exchanged in part or in whole, and the display can be a device with display function such as a touch display, a display screen, or a touch display screen.

[0070] The above are some descriptions of the ultrasound imaging system. The following is a specific description of the process of the ultrasound imaging system performing multi-modal combined ultrasound imaging.

[0071] The ultrasound imaging system first enters the multimodal joint imaging mode based on the user's operation (eg, an instruction to enter the multimodal imaging mode), and then performs multimodal joint ultrasound imaging in the multimodal joint imaging mode.

[0072] In some embodiments, the ultrasound imaging system can directly enter the multi-modal joint imaging mode. For example, after the user selects multiple modes, or under the default multiple modes, the ultrasound imaging system enters the multi-modal joint imaging mode based on the user's operation (such as the instruction to enter the multi-modal imaging). In the multi-modal joint imaging mode, the processor 40 controls the ultrasound probe 10 to transmit and receive multi-modal ultrasound through the transmission and reception control circuit 20, and generates ultrasound images corresponding to multiple modes. For example, the multiple modes can include B mode, shear wave elastic mode, viscous mode and acoustic attenuation mode, then the processor 40 can generate and control the display component 50 to display B mode image (B image), shear wave elastic mode image (shear wave elastic image), viscous mode image (viscous image), sound velocity image, and acoustic attenuation mode image (acoustic attenuation image).

[0073] In some embodiments, the ultrasound imaging system may also first enter a single-modality imaging mode and then enter a multi-modality joint imaging mode. For example, in response to a first-modality imaging instruction, the processor 40 controls the entry into the single-modality imaging mode of the first modality. In the single-modality imaging mode of the first modality, the processor 40 controls the ultrasound probe 10 to transmit and receive ultrasound waves of the first modality through the transmitting and receiving control circuit 20, and generates an ultrasound image of the first modality. For example, the first modality may be a B-modality, and accordingly, the ultrasound image of the first modality is a B-image. The user may observe through the B-image and select an area of ​​interest on the B-image, and then the user switches to the multi-modality joint imaging mode. The processor 40 controls the ultrasound probe 10 to transmit and receive ultrasound waves of the multi-modality through the transmitting and receiving control circuit 20, and generates ultrasound images corresponding to multiple modalities. For example, the user switches from single-mode imaging of B mode to a multi-mode imaging mode including B mode, shear wave elastic mode, viscous mode and acoustic attenuation mode, and the processor 40 generates and controls the display component 50 to display B mode images (B images), shear wave elastic mode images (shear wave elastic images), viscous mode images (viscous images) and acoustic attenuation mode images (acoustic attenuation images). Some modes in a single mode can generate multiple types of images, such as B images and elastic images can usually be generated under the shear wave elastic mode.

[0074] Please refer to Figure 3 When performing multi-modal combined ultrasound imaging, the processor 40 controls the display component 50 to display an ultrasound interface, for example, the ultrasound interface is displayed through the main screen, and one or more of the multiple ultrasound images corresponding to the multi-modality are displayed on the ultrasound interface. In some embodiments, the multi-modality includes: at least two of: B mode, shear wave elastic mode, viscosity mode, strain elastic mode, acoustic attenuation mode, ultrasound Doppler blood flow imaging mode, energy Doppler imaging mode and ultra-micro blood flow imaging mode. In some embodiments, the multiple ultrasound images displayed on the ultrasound interface include at least one of the following: B image, elastic image, viscosity image, sound velocity image and acoustic attenuation image.

[0075] Please refer to Figure 2 The processor 40 also controls the display component 50 to display an operation interface, for example, the operation interface is displayed through the secondary screen, and the setting area B of the multimodal image layout is displayed on the operation interface. The setting area B includes multiple modal image display controls B1, and each modal image display control B1 corresponds to a mode, for example, corresponding to B mode, shear wave elastic mode, viscous mode, strain elastic mode or acoustic attenuation mode.

[0076] In some embodiments, each modality image display control B1 has a first state and a second state, wherein the first state can be used to indicate that the modality corresponding to the modality image display control B1 is in an on state, and the ultrasound image corresponding to the on-state modality will be displayed on the ultrasound interface, whereas the second state can be used to indicate that the modality corresponding to the modality image display control B1 is in a off state, and the corresponding ultrasound image will not be displayed on the ultrasound interface.

[0077] Please refer to Figure 2 In some embodiments, when the modal image display control B1 is in different states, it can be displayed by different marks, for example, by different colors, characters, texts, shapes, etc. In some embodiments, the different states of the modal image display control B1 can also be reflected by whether the modal image display control B1 exists in the setting area B. For example, when the modal image display control B1 exists in the setting area B, it is in the first state, and vice versa, when it does not exist in the setting area B, it is in the second state. In this embodiment, when the image display control is in the first state, the image display control will also display the ON mark, and when it is in the second state, it will also display the OFF mark.

[0078] In some embodiments, the processor 40 may also respond to an operation on the modal image display control B1 so that the modal image display control B1 can switch between the first state and the second state. For example, the modal image display control B1 in the first state is touched to switch to the second state, for example, the modal image display control B1 is touched and dragged to make the setting area B exist or not exist.

[0079] Please refer to Figure 2 In some embodiments, the processor 40 can also set the mode corresponding to the modal image display control B1 in response to the operation on the modal image display control B1. For example, in response to the click operation on the modal image display control B1, the processor 40 controls the modal image display control B1 to display a drop-down menu, and the options of the drop-down menu are different modes, for example, the options include B mode, shear wave elastic mode, viscous mode, strain elastic mode and acoustic attenuation mode. In response to the selection operation of the option in the drop-down menu, the processor 40 sets the mode corresponding to the modal image display control B1 to the selected mode. In this embodiment, the modes corresponding to each modal image display control B1 may not be allowed to exist in the same way. For example, when there is a modal image display control B1 corresponding to the B mode, the modes corresponding to other modal image display controls B1 cannot select the B mode. The modes corresponding to each modal image display control B1 may also be allowed to exist in the same way. For example, there are two or more modal image display controls B1 corresponding to the B mode.

[0080] In some embodiments, the processor 40 may also set the position of the modal image display control B1 in the setting area B in response to an operation on the modal image display control B1. For example, in response to a drag operation on the modal image display control B1 in the setting area B, the modal image display control B1 is moved to a corresponding position. For example, in response to a touch operation on the modal image display control B1 in the setting area B, the modal image display control B1 is moved in a default direction, such as in one or a combination of the default directions of upward, downward, left, and right. In some embodiments, the processor 40 also adaptively adjusts the positions of other modal image display controls B1 according to the position to which the modal image display control B1 is moved. For example, when there are other modal image display controls B1 at the position to which the modal image display control B1 is moved, the other modal image display controls B1 may exchange positions with the modal image display control B1 being moved, or may be moved in a default direction or in a random direction.

[0081] The above are some explanations of the modal image display control B1 in the setting area B. From the above, it can be seen that the processor 40 can adjust its state, corresponding mode and position in the setting area B in response to the operation of the modal image display control B1.

[0082] The processor 40 obtains the control layout information of the modal image display control B1 in the first state in the setting area B, and sets the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, so as to display the ultrasound image on the ultrasound interface according to the image layout.

[0083] In some embodiments, the control layout information includes the mode, quantity and position relationship corresponding to the modal image display control B1 in the first state in the setting area B, and the image layout of the ultrasound image displayed on the ultrasound interface includes the type, quantity and position of the ultrasound image displayed on the ultrasound interface. In this embodiment, the mode, quantity and position relationship corresponding to the modal image display control B1 have a certain correspondence or logical relationship with the type, quantity and position of the ultrasound image. For example, when the modality corresponding to the modal image display control B1 corresponds to the type of ultrasound image one-to-one, if the modality corresponding to the modal image display control B1 includes the B mode, the type of ultrasound image displayed on the ultrasound interface includes the B image. The number of modal image display controls B1 is consistent with the number of ultrasound images, and the position relationship of the modal image display control B1 of the modal image display control B1 corresponds to the position of the ultrasound image one-to-one. Therefore, the control layout information of the modal image display control B1 can have a mapping relationship with the image layout of the ultrasound image. When the processor 40 obtains the control layout information, the image layout of the ultrasound image can be obtained from the control layout information according to the mapping relationship.

[0084] Please refer to Figure 2 In some embodiments, the setting area B has four control positions B2, which are respectively the first position, the second position, the third position and the fourth position, please refer to Figure 3 , there are four display areas D on the ultrasound interface, which are the first display area, the second display area, the third display area and the fourth display area. In this embodiment, the first position, the second position, the third position and the fourth position have a certain correspondence with the first display area, the second display area, the third display area and the fourth display area, so the ultrasound image displayed on the ultrasound interface can be set according to the control layout information of the modal image display control B1 in the first state, for example, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively, so the processor 40 can be set in each display area D to display the ultrasound image of the modality corresponding to the modality image display control B1 placed on its corresponding control position B2. For example, if there is a modality image display control B1 in the first state at the first position, and its corresponding modality is B mode, then the B image corresponding to the B mode is displayed in the first display area. In some embodiments, the four control positions B2 and the four display areas D are arranged in two rows and two columns. It is understandable that the number of control positions B2 and display areas D can be increased or decreased, and other forms of arrangement of control positions B2 and display areas D can be adopted according to the shape and size of the display. In this embodiment, the control positions B2 and the display areas D correspond one to one, and the position arrangement of the display areas D is fixed, which does not change with the number and position relationship of the modal image display controls B1 in the first state.

[0085] In some embodiments, the position arrangement of each display area D can be changed, so that the size of the display area D can be adjusted to adapt to different usage scenarios. In some embodiments, the processor 40 can set the position arrangement of the ultrasound image displayed on the ultrasound interface according to the number and position relationship of the modal image display controls B1 in the first state. Please refer to Figure 3 In this embodiment, the setting area B has four control positions B2, and is arranged in two rows and two columns. When the number of modal image display controls B1 in the first state is four or three, and each is located at a control position B2, the processor 40 sets the ultrasound interface to display four display areas D, and arranges them in two rows and two columns. At this time, the first display area, the second display area, the third display area, and the fourth display area correspond to the first position, the second position, the third position, and the fourth position, respectively. The processor 40 is set to display the ultrasound image of the modality corresponding to the modal image display control B1 placed on the corresponding control position B2 in each display area D.

[0086] Please refer to Figure 4 In some embodiments, when the number of modal image display controls B1 in the first state is two and they are respectively located at a control position B2, the processor 40 sets two display areas D to be displayed on the ultrasound interface, and they are arranged left and right, such as the first display area on the left and the second display area on the right. Among them, the size of the two display areas D can be smaller or larger than the size when there are four display areas D, or they can be the same size. At this time, the processor 40 is also set to display the ultrasound image of the modality corresponding to the modality of the modality image display control B1 in the first display area, and the ultrasound image of the modality corresponding to the modality image display control B1 in the second display area, wherein the first position, the second position, the third position and the fourth position have a default position order, such as the position order of the first position, the second position, the third position and the fourth position is decreased or increased in sequence. For example, the modal image display control B1 in the first state is respectively located at the first position and the third position, then the first display area displays the ultrasound image of the modality corresponding to the modality of the modality image display control B1 at the first position, and the second display area displays the ultrasound image of the modality corresponding to the modality image display control B1 at the third position.

[0087] Please refer to Figure 4 In some embodiments, when the number of modal image display controls B1 in the first state is one and is located at a control position B2, the processor 40 sets two display areas D arranged on the left and right to be displayed on the ultrasound interface, for example, a first display area on the left and a second display area on the right, and sets the ultrasound image of the modality corresponding to the modality image display control B1 to be displayed in the first display area.

[0088] Please refer to Figure 5 In some embodiments, when the number of modal image display controls B1 in the first state is one and is located at a control position B2, the processor 40 sets a display area D to be displayed on the ultrasound interface, and sets the display area D to display an ultrasound image of the modality corresponding to the modality image display control B1.

[0089] In some embodiments, the processor 40 may also respond to the operation on the setting area B to update the image layout of the ultrasound image displayed on the ultrasound interface accordingly when the control layout information of the modal image display control B1 in the first state in the setting area B changes. For example, when the modal image display control B1 in the first state in the setting area B is increased or the position is changed, the ultrasound image of the modality corresponding to the modality image display control B1 in the first state will be added and displayed on the ultrasound interface or the position will be changed accordingly. In this embodiment, the image layout of the ultrasound image can be updated in real time based on the operation on the setting area B, so as to meet the user's real-time layout requirements and layout adjustments.

[0090] As can be seen from the above, the user can adjust the mode, quantity and position relationship corresponding to the modal image display control B1, thereby adjusting the control layout of the image display control, and the control layout of the modal image display control B1 can correspond one-to-one to the image layout of the ultrasound image, so that each display area D is set to display the ultrasound image of the modality corresponding to the modality image display control B1 placed on its corresponding control position B2. It is also possible to readjust the image layout of the ultrasound image according to the change in the quantity and position relationship of the modal image display control B1 in the first state to adapt to different usage scenarios. And when the control layout of the modal image display control B1 changes in real time, the image layout of the ultrasound image can be updated in real time, thereby achieving flexible and efficient image layout adjustment.

[0091] The above is a description of one of the methods for an ultrasound imaging system to perform multi-modal combined ultrasound imaging. The following is a description of another method for an ultrasound imaging system to perform multi-modal combined ultrasound imaging, and mainly describes the difference between the two methods.

[0092] Please refer to Figure 8 When performing multi-modal combined ultrasound imaging, the processor 40 controls the display component 50 to display an ultrasound interface, for example, the ultrasound interface is displayed through the main screen, and one or more image windows F are displayed on the ultrasound interface, and each image window F can display an ultrasound image corresponding to a mode in the multi-modality.

[0093] Please refer to Figure 6 and 7 The processor 40 also controls the display component 50 to display an operation interface, for example, the operation interface is displayed through the secondary screen, and the setting area B of the multimodal image layout is displayed on the operation interface, and the setting area B includes a first control A and a second control C. Among them, the first control A corresponds to the number of image windows F, and the second control C is used to switch the position order of the ultrasound images displayed on the ultrasound interface.

[0094] In response to the operation on the first control A, the processor 40 sets or switches the number of image windows F corresponding to the first control A, and generates a corresponding number of image windows F on the ultrasound interface according to the number of image windows F set or switched by the first control A.

[0095] In some embodiments, when performing multi-modal ultrasound imaging, an initial number of image windows F may be displayed on the ultrasound interface, and the initial number of image windows F may be consistent with the number of modes corresponding to the multi-modality. For example, if the multi-modality includes three modes, the initial number of image windows F is three. The initial number of image windows F may also be the maximum number of image windows F. For example, if the ultrasound interface can display a maximum of four image windows F, the initial number of image windows F is four. Please refer to Figure 6When the processor 40 responds to the operation of the first control A, the number of image windows F can be directly switched. For example, by clicking on the first control A, the number of image windows F can be increased or decreased. For example, each time the first control A is clicked, the number of image windows F can be increased or decreased by one. When it is increased to the maximum number or decreased to one, clicking on the first control A again will switch the number of image windows F to one or the maximum number.

[0096] In some embodiments, there may be two first controls A, wherein one first control A is used to reduce the number of image windows F, and the other first control A is used to increase the number of image windows F.

[0097] Please refer to Figure 7 In some embodiments, when the processor 40 responds to the operation of the first control A, the first control A displays a drop-down menu, and the options of the drop-down menu are different numbers of image windows F. For example, the options include number 1, number 2, number 3 to number X, where X is the maximum number. The processor 40 generates a corresponding number of image windows F on the ultrasound interface in response to the selection operation of the option in the drop-down menu.

[0098] The processor 40 also switches the position order of the ultrasound images displayed in the current number of image windows F on the ultrasound interface in response to the operation of the second control C.

[0099] Please refer to Figure 8In some embodiments, when performing multimodal combined ultrasound imaging, an initial number of image windows F can be displayed on the ultrasound interface, and the initial number of image windows F and the ultrasound images displayed therein have a certain position order, for example, when the initial number of image windows F is four or three, they are arranged in two rows and two columns, for example, when the initial number of image windows F is two, they are arranged in two columns on the left and right, and multiple ultrasound images corresponding to the multimodality are respectively displayed in one image window F, and each image window F and the ultrasound image therein can have a default position, for example, the first position, the second position, the third position or the fourth position, respectively. When the processor 40 responds to the operation of the second control C, the position order of the ultrasound images displayed in the current number of image windows F can be directly switched. For example, by clicking the second control C, the position of each image window F and the position of the ultrasound image therein can be changed. For example, the image window F at the first position and the ultrasound image displayed therein are moved to the second position, and the image window F at the second position and the ultrasound image displayed therein are moved to the third position, the image window F at the third position and the ultrasound image displayed therein are moved to the fourth position, and the image window F at the fourth position and the ultrasound image displayed therein are moved to the first position. When the second control C is clicked again, the position of each image window F is changed again in the above manner.

[0100] In some embodiments, when the number of image windows F is the maximum, clicking the second control C may also cause only the position of the ultrasound image in each image window F to change.

[0101] In some embodiments, the position of each image window F and the position change of the ultrasound image therein may be moved sequentially in a positional order, or may not be moved sequentially in a positional order, for example, they may be moved sequentially in a sequence of permutations and combinations of the position of each image window F and the ultrasound image therein, for example, the first position, the second position, and the third position have six permutations and combinations, and each position change selects one of them in turn.

[0102] In some embodiments, in response to the operation on the first control A, when the ultrasound interface is switched from the first number of image windows F to the second number of image windows F which is smaller than the first number, the processor 40 selects the first second number of ultrasound images displayed in the first number of image windows F before the switching and displays them in the second number of image windows F after the switching. For example, the first number of image windows F is three, and the second number of image windows F is two, when the number of image windows F is switched from three to two, the ultrasound images in the first two image windows F of the three image windows F are displayed in the two image windows F after the switching, wherein the first image window F and the ultrasound image therein can be determined according to the default position of the image window F.

[0103] In some embodiments, when the ultrasound interface displays only one ultrasound image, the processor 40 selects the next ultrasound image of the currently displayed ultrasound image to replace the currently displayed ultrasound image for display in response to the operation of the second control C. For example, when the number of modalities corresponding to the multimodality is three, the corresponding ultrasound images are also three. When the ultrasound interface displays only one ultrasound image, the image window F in front and the ultrasound image therein can be determined according to the default position of the image window F, for example, the image window F in the first position and the ultrasound image therein are displayed. In response to the operation of the second control C, the processor 40 selects the ultrasound image in the second position for display.

[0104] As described above, in some embodiments, when performing multi-modal combined ultrasound imaging, an initial number of image windows F may be displayed on the ultrasound interface, and the initial number of image windows F may be consistent with the number of modalities corresponding to the multi-modality. More generally, in some embodiments, the processor 40 also obtains the ultrasound image corresponding to the modality currently required to be displayed in the multi-modality, and controls the display component 50 to display it in the ultrasound interface.

[0105] For example, at the beginning of multi-modal ultrasound imaging (i.e., just entering multi-modal ultrasound imaging), the modality currently required to be displayed in the multi-modality can be defaulted to all the modalities in the multi-modality, or the user can also select the modality required to be displayed in the multi-modality through the operation interface, and the user can select it through the operation interface before the multi-modal ultrasound imaging. In such an embodiment, after multi-modal ultrasound imaging is performed, the processor 40 first generates a corresponding number of windows according to the number of ultrasound images corresponding to the modalities to be displayed, each window corresponding to an ultrasound image corresponding to a modality to be displayed, and the processor 40 then controls the display component 50 to display the ultrasound images corresponding to the corresponding modality on these windows; then, the user can further set or switch the number of image windows and the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface through the first control A and the second control C.

[0106] After the image window and the ultrasound image are displayed on the ultrasound interface, the user can still select the mode to be displayed in the multi-mode through the operation interface to set the ultrasound image displayed on the ultrasound interface.

[0107] In some embodiments, if the user adds ultrasound images of a modality that need to be displayed, the processor 40 can control the addition of a new image window for display; in some embodiments, if the user adds ultrasound images of a modality that need to be displayed, when there are currently idle image windows (i.e., no ultrasound images are displayed), the processor 40 preferentially controls the display of the newly added ultrasound images that need to be displayed in these idle image windows; if the number of these idle image windows is insufficient, after displaying a portion of the newly added ultrasound images that need to be displayed in these idle image windows, the processor 40 controls the addition of new image windows to display the remaining ultrasound images of the newly added ultrasound images that need to be displayed.

[0108] In some embodiments, if the user reduces the number of ultrasound images of a modality that need to be displayed, the processor 40 may delete the corresponding image window, or retain the corresponding image window but not display the corresponding ultrasound image in the image window.

[0109] Please refer to Fig. 9 In some embodiments, a multi-modal combined ultrasound imaging method is provided, which is applied to the above-mentioned ultrasound imaging system and may include the following steps.

[0110] Step 100: Perform multi-modality combined ultrasound imaging.

[0111] Step 200: Display one or more ultrasound images corresponding to the multi-modality on the ultrasound interface.

[0112] Step 300: Displaying a setting area for a multimodal image layout on an operation interface; the setting area includes a plurality of modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state.

[0113] Step 400: Obtain control layout information of the modal image display control in the first state within the setting area, set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, and display the ultrasound image on the ultrasound interface according to the image layout; in response to an operation on the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

[0114] In some embodiments, the control layout information of the modal image display controls in the first state within the setting area includes: the modality, quantity and position relationship corresponding to the modal image display controls in the first state within the setting area; the image layout of the ultrasound images displayed on the ultrasound interface includes: the type, quantity and position of the ultrasound images displayed on the ultrasound interface.

[0115] In some embodiments, the image layout of the ultrasound image displayed on the ultrasound interface is set according to the control layout information, including: for each modality corresponding to the modality image display control in the first state, setting an ultrasound image of the corresponding modality to be displayed on the ultrasound interface; and setting the positional arrangement of the ultrasound image displayed on the ultrasound interface according to the number and positional relationship of the modality image display controls in the first state.

[0116] In some embodiments, the setting area has four control positions arranged in two rows and two columns: a first position, a second position, a third position, and a fourth position; the control positions are capable of placing the modal image display control; the position arrangement of the ultrasound image displayed on the ultrasound interface is set according to the number and positional relationship of the modal image display controls in the first state, including: when the number of modal image display controls in the first state is four and each is located at one of the control positions, four display areas arranged in two rows and two columns are set on the ultrasound interface: a first display area, a second display area, a third display area, and a fourth display area, the first display area, the second display area, the third display area, and the fourth display area. The second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively; each of the display areas is arranged to display an ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position; and / or, when the number of modal image display controls in the first state is three and each is located at one of the control positions, four display areas arranged in two rows and two columns are displayed on the ultrasound interface: the first display area, the second display area, the third display area and the fourth display area, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively. The first position, the second position, the third position and the fourth position; each of the display areas is configured to display an ultrasound image of a modality corresponding to the modality image display control placed at its corresponding control position; and / or, when the number of the modality image display controls in the first state is two and each is located at one of the control positions, two display areas arranged left and right are configured to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; the first display area is configured to display an ultrasound image of a modality corresponding to a modality image display control that is in the front position sequence, and the second display area is configured to display an ultrasound image of a modality corresponding to a modality image display control that is in the back position sequence; wherein, the first The position order of the first position, the second position, the third position and the fourth position is successively decreased; and / or, when the number of the modal image display controls in the first state is one and is located at one of the control positions, two display areas arranged left and right are arranged to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; an ultrasound image of the modality corresponding to the modality of the modality image display control is displayed in the first display area; and / or, when the number of the modal image display controls in the first state is one and is located at one of the control positions, a display area is arranged to be displayed on the ultrasound interface, and an ultrasound image of the modality corresponding to the modality image display control is arranged to be displayed in the display area.

[0117] In some embodiments, the modality image display control also has a second state; when the modality image display control is in the first state, the ultrasound image of the modality corresponding to the modality image display control is displayed on the ultrasound interface, conversely, when the modality image display control is in the second state, the ultrasound image of the modality corresponding to the modality image display control is not displayed on the ultrasound interface; in response to operation of the modality image display control, the modality image display control can switch between the first state and the second state.

[0118] In some embodiments, for each of the modal image display controls, a mark is displayed indicating whether the modal image display control is in the first state or the second state.

[0119] In some embodiments, in response to an operation on the modal image display control, the modality corresponding to the modal image display control is set. In some embodiments, in response to an operation on the modal image display control, the modality corresponding to the modal image display control is set, including: in response to a click operation on the modal image display control, controlling the modal image display control to display a drop-down menu, wherein the options of the drop-down menu are different modalities; in response to a selection operation on an option in the drop-down menu, setting the modality corresponding to the modal image display control to the selected modality.

[0120] In some embodiments, in response to the operation of the modal image display control, the position of the modal image display control in the setting area is set. In some embodiments, in response to the operation of the modal image display control, the position of the modal image display control in the setting area is set, including: in response to the drag operation of the modal image display control in the setting area, the modal image display control is moved to a corresponding position. In some embodiments, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

[0121] Please refer to Fig.10 In some embodiments, a multi-modal combined ultrasound imaging method is provided, which is applied to the above-mentioned ultrasound imaging system, and may include the following steps:

[0122] Step 110: Perform multi-modality combined ultrasound imaging.

[0123] Step 210: Display one or more image windows on the ultrasound interface, where one image window can display an ultrasound image corresponding to one of the multiple modalities.

[0124] Step 310: Display a setting area for multimodal image layout on the operation interface; the setting area includes a first control and a second control; the first control corresponds to the number of image windows; the second control is used to switch the position order of ultrasound images displayed on the ultrasound interface.

[0125] Step 410: In response to an operation on the first control, the number of image windows corresponding to the first control is set or switched, and a corresponding number of image windows are generated on the ultrasound interface according to the number of image windows after the first control is set or switched; in response to an operation on the second control, the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface is switched.

[0126] In some embodiments, in response to an operation on the first control, when the ultrasound interface switches from a first number of image windows to a second number of image windows which is smaller than the first number, the first second number of ultrasound images displayed in the first number of image windows before the switch are selected and displayed in the second number of image windows after the switch.

[0127] In some embodiments, when the ultrasound interface displays only one ultrasound image, in response to an operation on the second control, a next ultrasound image of the currently displayed ultrasound image is selected to replace the currently displayed ultrasound image for display.

[0128] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, various operating steps and components for performing the operating steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0129] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. In addition, as understood by those skilled in the art, the principles of this article can be reflected in a computer program product on a computer-readable storage medium, which is pre-installed with a computer-readable program code. Any tangible, non-temporary computer-readable storage medium can be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD to ROM, DVD, Blu Ray disks, etc.), flash memory and / or the like. These computer program instructions can be loaded onto a general-purpose computer, a special-purpose computer or other programmable data processing device to form a machine, so that these instructions executed on a computer or other programmable data processing device can generate a device that implements a specified function. These computer program instructions can also be stored in a computer-readable memory, which can instruct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory can form a manufactured product, including an implementation device that implements a specified function. Computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operating steps are performed on a computer or other programmable device to generate a computer-implemented process, so that the instructions executed on a computer or other programmable device can provide steps for implementing a specified function.

[0130] Although the principles of this invention have been shown in various embodiments, many modifications of structures, arrangements, proportions, elements, materials and components particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments will be included in the scope of this invention.

[0131] The foregoing specific description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Therefore, the consideration of the present disclosure will be illustrative rather than restrictive, and all these modifications will be included in its scope. Similarly, the advantages, other advantages and solutions to the problems of various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more clear, should not be interpreted as critical, necessary or necessary. The term "include" and any other variants used in this article are all non-exclusive inclusions, so that the process, method, article or device including the list of elements not only includes these elements, but also includes other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0132] Those skilled in the art will appreciate that many changes may be made to the details of the above-described embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. A multimodal combined ultrasound imaging method, characterized in that: include: Perform multimodal combined ultrasound imaging; One or more ultrasound images corresponding to the multi-modality are displayed on the ultrasound interface; wherein: A setting area for displaying a multimodal image layout on an operation interface; the setting area includes a plurality of modal image display controls, each modal image display control corresponds to a modality, and the modal image display control has at least a first state; Acquire control layout information of the modal image display control in the first state within the setting area, set the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information, and display the ultrasound image on the ultrasound interface according to the image layout; in response to the operation on the setting area, when the control layout information of the modal image display control in the first state within the setting area changes, update the image layout of the ultrasound image displayed on the ultrasound interface accordingly.

2. The method according to claim 1, characterized in that The control layout information of the modal image display controls in the first state in the setting area includes: the mode, quantity and position relationship corresponding to the modal image display controls in the first state in the setting area; The image layout of the ultrasound images displayed on the ultrasound interface includes: the type, quantity and position of the ultrasound images displayed on the ultrasound interface.

3. The method according to claim 1 or 2, characterized in that The step of setting the image layout of the ultrasound image displayed on the ultrasound interface according to the control layout information includes: For each modality corresponding to the modality image display control in the first state, an ultrasound image of the corresponding modality is displayed on the ultrasound interface; The position arrangement of the ultrasound image displayed on the ultrasound interface is set according to the number and positional relationship of the modal image display controls in the first state.

4. The method according to claim 3, characterized in that The setting area has four control positions arranged in two rows and two columns: a first position, a second position, a third position and a fourth position; the control positions can be used to place the modal image display control; The step of setting the position arrangement of the ultrasound image displayed on the ultrasound interface according to the number and position relationship of the modal image display controls in the first state includes: When the number of modal image display controls in the first state is four and each is located at one of the control positions, four display areas arranged in two rows and two columns are displayed on the ultrasound interface: a first display area, a second display area, a third display area and a fourth display area, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively; each of the display areas is configured to display an ultrasound image of a modality corresponding to the modal image display control placed at its corresponding control position; and / or, When the number of modal image display controls in the first state is three and each is located at one of the control positions, four display areas arranged in two rows and two columns are displayed on the ultrasound interface: a first display area, a second display area, a third display area and a fourth display area, the first display area, the second display area, the third display area and the fourth display area correspond to the first position, the second position, the third position and the fourth position respectively; each of the display areas is configured to display an ultrasound image of the modality corresponding to the modal image display control placed at its corresponding control position; and / or, When the number of modal image display controls in the first state is two and they are respectively located at one of the control positions, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; an ultrasound image of a modality corresponding to a modality image display control in a front position sequence is set to be displayed in the first display area, and an ultrasound image of a modality corresponding to a modality image display control in a back position sequence is set to be displayed in the second display area; wherein the positions of the first position, the second position, the third position and the fourth position are sequentially decreased; and / or, When the number of the modal image display control in the first state is one and is located at one of the control positions, two display areas arranged left and right are set to be displayed on the ultrasound interface: a first display area on the left and a second display area on the right; and an ultrasound image of the modality corresponding to the modal image display control is displayed in the first display area; and / or, When the number of the modal image display controls in the first state is one and is located at one of the control positions, a display area is set to be displayed on the ultrasound interface, and an ultrasound image of the modality corresponding to the modal image display control is set to be displayed in the display area.

5. The method according to claim 1, characterized in that The modality image display control also has a second state; when the modality image display control is in the first state, the ultrasound image of the modality corresponding to the modality image display control is displayed on the ultrasound interface, and conversely, when the modality image display control is in the second state, the ultrasound image of the modality corresponding to the modality image display control is not displayed on the ultrasound interface; In response to an operation on the modal image display control, the modal image display control can switch between the first state and the second state.

6. The method according to claim 5, characterized in that For each of the modal image display controls, a mark indicating whether the modal image display control is in the first state or the second state is displayed.

7. The method according to claim 1, characterized in that In response to an operation on the modal image display control, a mode corresponding to the modal image display control is set.

8. The method according to claim 7, characterized in that The step of setting the mode corresponding to the modal image display control in response to the operation on the modal image display control includes: In response to a click operation on the modal image display control, controlling the modal image display control to display a drop-down menu, wherein the options of the drop-down menu are different modes; In response to a selection operation on an option in the drop-down menu, the mode corresponding to the modal image display control is set to the selected mode.

9. The method according to claim 1, characterized in that In response to an operation on the modal image display control, a position of the modal image display control within the setting area is set.

10. The method according to claim 9, characterized in that The step of setting the position of the modal image display control within the setting area in response to the operation on the modal image display control comprises: In response to a dragging operation on the modal image display control within the setting area, the modal image display control is moved to a corresponding position; preferably, the positions of other modal image display controls are also adaptively adjusted according to the position to which the modal image display control is moved.

11. The method according to claim 1, characterized in that The ultrasound interface is displayed on a display, and the operation interface is displayed on a touch screen.

12. The method according to claim 1, characterized in that The multi-modality includes at least two of: B-mode, shear wave elastic mode, viscous mode, strain elastic mode, acoustic attenuation mode, sound velocity mode, ultrasonic Doppler blood flow imaging mode, power Doppler imaging mode and ultra-micro blood flow imaging mode.

13. A multi-modal combined ultrasound imaging method, characterized in that: include: Perform multimodal combined ultrasound imaging; One or more image windows are displayed on the ultrasound interface, and one of the image windows can display an ultrasound image corresponding to one of the multiple modalities; wherein: A setting area for displaying a multimodal image layout on an operation interface; the setting area includes a first control and a second control; the first control corresponds to the number of image windows; the second control is used to switch the position order of ultrasound images displayed on the ultrasound interface; In response to an operation on the first control, the number of image windows corresponding to the first control is set or switched, and a corresponding number of image windows is generated on the ultrasound interface according to the number of image windows set or switched by the first control; In response to an operation on the second control, the position order of the ultrasound images displayed in the current number of image windows on the ultrasound interface is switched.

14. The ultrasonic imaging method according to claim 13, wherein: In response to the operation of the first control, when the ultrasound interface switches from a first number of image windows to a second number of image windows which is smaller than the first number, the first second number of ultrasound images displayed in the first number of image windows before the switching are selected and displayed in the second number of image windows after the switching.

15. The ultrasonic imaging method according to claim 1, characterized in that: In a case where only one ultrasound image is displayed on the ultrasound interface, in response to an operation on the second control, a next ultrasound image of the currently displayed ultrasound image is selected to replace the currently displayed ultrasound image for display.

16. The ultrasonic imaging method according to claim 13, wherein: Also includes: The ultrasound image corresponding to the mode currently required to be displayed in the multi-mode is obtained, and the display in the ultrasound interface is controlled.

17. An ultrasonic imaging system, characterized in that: include: An ultrasonic probe, a transmitting and receiving control circuit, a processor, and a display component; the ultrasonic probe is used to transmit ultrasonic waves to a region of interest and receive corresponding ultrasonic echo signals; the transmitting and receiving control circuit is used to control the probe to transmit ultrasonic waves and receive ultrasonic echo signals; the processor is used to execute the method as described in any one of claims 1 to 16.

Images