Ultrasonic imaging method combined with physiological signals and electronic equipment

Abstract

An ultrasound imaging method (200) in combination with a physiological signal and an electronic device. The method comprises: acquiring an ultrasound image of a subject acquired by an ultrasound imaging system (100) at a first time (S210); acquiring a physiological signal of the subject acquired by the first monitoring device at a second time, wherein the first time and the second time at least partially coincide (S220); performing time sequence alignment on the ultrasound image and the physiological signal (S230); and displaying the ultrasound image and the physiological signal after time sequence alignment on the same display interface (S240). The ultrasonic image and other physiological signals are displayed on the same display interface after being subjected to time sequence alignment, and comprehensive analysis of the ultrasonic image and the other physiological signals is facilitated.

Description

[0001] This application is a divisional application of the patent application No. 202080104126.7, titled "Ultrasound imaging method and electronic device combined with physiological signals", filed on October 10, 2020. TECHNICAL FIELD

[0002] The present application relates to the technical field of ultrasound imaging, and more particularly to an ultrasound imaging method and electronic device combined with physiological signals. BACKGROUND

[0003] Critical illness patients have complex conditions, changing, cross-disciplinary, high-tech equipment application, involving humanistic and ethical issues, etc. It can be said that critical illness medicine is the product of the integration trend of medical branch discipline development. This integration determines the requirements and challenges of clinical thinking of ICU doctors, and the most prominent one is comprehensive thinking. That is, in the critical scene, the doctor needs to face different organs, different equipment, different means, different time pathological and physiological indicators, parameters, and make comprehensive analysis according to his clinical experience and logical reasoning to judge the current pathological and physiological state of the patient and make appropriate clinical decisions.

[0004] Volume management is one of the important contents of the treatment of critically ill patients, and volume status and volume responsiveness assessment are the core of volume management. When volume management is performed, the user needs to combine ultrasound images and other physiological signals for comprehensive analysis. However, at present, the information of the ultrasound system and other monitoring devices is displayed on their own screens, and the doctor needs to manually export, manually align and analyze the information, which is time-consuming and laborious, and is not convenient for clinical research. SUMMARY

[0005] A series of simplified concepts are introduced in the summary section, which will be further described in detail in the specific embodiments section. The summary section of the present application does not mean to attempt to limit the key features and necessary technical features of the claimed technical solutions, nor to determine the protection scope of the claimed technical solutions.

[0006] The first aspect of the embodiments of the present application provides an ultrasound imaging method combined with physiological signals, the method comprising:

[0007] acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time;

[0008] acquiring a physiological signal of the measured object collected by a first monitoring device at a second time, the first time and the second time at least partially coincide;

[0009] time-aligning the ultrasound image and the physiological signal;

[0010] display the time-aligned ultrasound image and the physiological signal on a same display interface.

[0011] The second aspect of the embodiments of the present application provides an ultrasound imaging method combined with a physiological signal, and the method comprises the following steps:

[0012] acquiring an ultrasound image of a measured object collected by an ultrasound imaging system;

[0013] acquiring a physiological signal of the measured object collected by a first monitoring device;

[0014] comprehensively analyzing time phases of the physiological signal and the ultrasound image, and / or comprehensively analyzing quantitative indexes of the physiological signal and the ultrasound image to obtain a comprehensive analysis result;

[0015] displaying the comprehensive analysis result.

[0016] The third aspect of the embodiments of the present application provides an ultrasound imaging method combined with a physiological signal, and the method is used in an electronic device, wherein the electronic device is a monitoring device or a third-party device other than the ultrasound imaging system and the monitoring device; and the method comprises the following steps:

[0017] acquiring ultrasound data of a measured object collected by an ultrasound imaging system;

[0018] acquiring a physiological signal of the measured object collected by a monitoring device;

[0019] displaying the ultrasound data and the physiological signal on a same display interface of the electronic device.

[0020] The fourth aspect of the embodiments of the present application provides an electronic device, and the electronic device comprises a memory, a processor and a display, wherein the memory stores a computer program which is run by the processor, and the computer program performs the following steps when being run by the processor:

[0021] acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time;

[0022] acquiring a physiological signal of the measured object collected by a first monitoring device at a second time, wherein the first time and the second time at least partially coincide;

[0023] time-aligning the ultrasound image and the physiological signal;

[0024] the display is used for displaying the time-aligned ultrasound image and the physiological signal on a same display interface.

[0025] The fifth aspect of the embodiments of the present application provides an electronic device, the electronic device comprising a memory, a processor and a display, the memory storing a computer program which is run by the processor, and the computer program performs the following steps when being run by the processor:

[0026] acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time;

[0027] acquiring a physiological signal of the measured object collected by a first monitoring device at a second time;

[0028] comprehensively analyzing a time phase of the physiological signal and the ultrasound image, and / or comprehensively analyzing a quantitative index of the physiological signal and the ultrasound image to obtain a comprehensive analysis result;

[0029] the display is configured to display the comprehensive analysis result.

[0030] The sixth aspect of the embodiments of the present application provides an electronic device, the electronic device being a monitoring device or a third-party device other than the ultrasound imaging system and the monitoring device, the electronic device comprising a memory, a processor and a display, the memory storing a computer program which is run by the processor, and the computer program performs the following steps when being run by the processor:

[0031] acquiring ultrasound data of a measured object collected by an ultrasound imaging system;

[0032] acquiring a physiological signal of the measured object collected by a monitoring device;

[0033] the display is configured to display the ultrasound data and the physiological signal on the same display interface.

[0034] The ultrasound imaging method and the electronic device according to the embodiments of the present application display the ultrasound image and other physiological signals on the same display interface after time sequence alignment, which facilitates comprehensive analysis of the two. BRIEF DESCRIPTION OF DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0036] In the drawings:

[0037] Figure 1 a schematic block diagram of an ultrasound imaging system according to an embodiment of the present application is shown;

[0038] Figure 2 Fig. 1 shows a schematic flowchart of an ultrasound imaging method incorporating physiological signals according to an embodiment of the present application;

[0039] Figure 3 Fig. 2 shows a schematic diagram of a timestamp-based timing alignment method according to an embodiment of the present application;

[0040] Figure 4 Fig. 3 shows a schematic diagram of a data transmission time-based timing alignment method according to an embodiment of the present application;

[0041] Figure 5 Fig. 4 shows a schematic diagram of a preset physiological state-based timing alignment method according to an embodiment of the present application;

[0042] Figure 6A Fig. 5 shows a schematic diagram of displaying a timing-aligned M-mode ultrasound image and a respiratory signal on the same display interface according to an embodiment of the present application;

[0043] Figure 6B Fig. 6 shows a schematic diagram of displaying a timing-aligned spectral Doppler PW ultrasound image and a respiratory signal on the same display interface according to an embodiment of the present application;

[0044] Figure 7 Fig. 7 shows a schematic flowchart of an ultrasound imaging method incorporating physiological signals according to another embodiment of the present application;

[0045] Figure 8 Fig. 8 shows a schematic flowchart of an ultrasound imaging method incorporating physiological signals according to yet another embodiment of the present application;

[0046] Figure 9 Fig. 9 shows a schematic block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the objects, technical solutions and advantages of the present application clearer, the following will describe the example embodiments according to the present application in detail with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the example embodiments described herein. Based on the embodiments of the present application described in the present application, all other embodiments obtained by those skilled in the art without creative effort should fall within the protection scope of the present application.

[0048] In the following description, numerous specific details are set forth to provide a more thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present application can be practiced without one or more of these specific details. In other instances, well-known features have not been described in order to avoid obscuring the present application.

[0049] It should be understood that the present application can be carried out in many different forms without necessarily departing from the spirit or scope of the application. Rather, these examples are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the application to those skilled in the art.

[0050] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising", when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. As used herein the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0051] For a thorough understanding of the present application, reference will be made to the following detailed description, taken in conjunction with the accompanying drawings, in which:

[0052] Below, reference will first be made to Figure 1 An ultrasound imaging system according to an embodiment of the present application is described, Figure 1 A schematic block diagram of an ultrasound imaging system 100 according to an embodiment of the present application is shown.

[0053] As Figure 1 is shown, the ultrasound imaging system 100 comprises an ultrasound probe 110, a transmit circuit 112, a receive circuit 114, a processor 116 and a display 118. Further, the ultrasound imaging system can also comprise a transmit / receive selection switch 120 and a beamformer 122, the transmit circuit 112 and the receive circuit 114 can be connected to the ultrasound probe 110 via the transmit / receive selection switch 120.

[0054] The ultrasound probe 110 includes a plurality of transducer elements, which can be arranged in a row to form a linear array, or arranged in a two-dimensional matrix to form a two-dimensional array, or arranged to form a convex array. The transducers are used to emit ultrasound waves according to excitation electrical signals, or convert received ultrasound waves into electrical signals, and thus each element can be used to realize the mutual conversion between electrical pulse signals and ultrasound waves, so as to emit ultrasound waves to the tissue of the target region of the object under test, and also can be used to receive the ultrasound echo reflected by the tissue. When performing ultrasound detection, it can be controlled by a transmission sequence and a receiving sequence which transducers are used to emit ultrasound waves and which transducers are used to receive ultrasound waves, or the transducers are controlled to be used for emitting ultrasound waves or receiving ultrasound echo in time slots. The transducers participating in the emission of ultrasound waves can be excited by electrical signals at the same time, so as to emit ultrasound waves at the same time; or the transducers participating in the emission of ultrasound beams can also be excited by several electrical signals with a time interval, so as to continuously emit ultrasound waves with a time interval.

[0055] In the process of ultrasound imaging, the transmission circuit 112 sends the transmission pulse after delay focusing to the ultrasound probe 110 through the transmission / reception selection switch 120. The ultrasound probe 110 is excited by the transmission pulse to emit an ultrasound beam to the tissue of the target region of the object under test, receives the ultrasound echo with tissue information reflected by the tissue of the target region after a certain time delay, and converts the ultrasound echo into an electrical signal. The receiving circuit 114 receives the electrical signal converted by the ultrasound probe 110, obtains the ultrasound echo signal, and sends the ultrasound echo signal to the beamforming module 122. The beamforming module 122 performs focusing delay, weighting and channel summation on the ultrasound echo data, and then sends the data to the processor 116. The processor 116 performs signal detection, signal enhancement, data conversion, logarithmic compression and other processing on the ultrasound echo signal to form an ultrasound image. The ultrasound image obtained by the processor 116 can be displayed on the display 118, or stored in the memory 124.

[0056] Optionally, the processor 116 can be implemented as software, hardware, firmware or any combination thereof, and can use a single or multiple application specific integrated circuits (ASICs), a single or multiple general purpose integrated circuits, a single or multiple microprocessors, a single or multiple programmable logic devices, or any combination of the foregoing circuits and / or devices, or other suitable circuits or devices. Moreover, the processor 116 can control other components in the ultrasound imaging system 100 to perform the corresponding steps of the method in each embodiment in the present specification.

[0057] The display 118 is connected to the processor 116, and can be a touch display screen, a liquid crystal display, etc. Alternatively, the display 118 can be a liquid crystal display, a television, etc. independent display which is independent of the ultrasound imaging system 100. Alternatively, the display 118 can be a display screen of a smart phone, a tablet computer, etc. electronic device, etc. The number of the display 118 can be one or more. For example, the display 118 can include a main screen and a touch screen, the main screen is mainly used to display the ultrasound image, and the touch screen is mainly used for human-computer interaction.

[0058] The display 118 can display the ultrasound image obtained by the processor 116. In addition, the display 118 can also provide a graphical interface for the user to perform human-computer interaction while displaying the ultrasound image, one or more controlled objects are set on the graphical interface, and the user is provided with an operation instruction input by a human-computer interaction device to control the controlled objects, so as to perform a corresponding control operation. For example, an icon is displayed on the graphical interface, and the icon can be operated by the human-computer interaction device to perform a specific function, such as drawing a region of interest frame on the ultrasound image, etc.

[0059] Optionally, the ultrasound imaging system 100 can also include other human-computer interaction devices other than the display 118, which are connected to the processor 116. For example, the processor 116 can be connected to the human-computer interaction device through an external input / output port, which can be a wireless communication module, a wired communication module, or a combination of the two. The external input / output port can also be implemented based on a USB, a bus protocol such as CAN, and / or a wired network protocol, etc.

[0060] The human-computer interaction device can include an input device for detecting input information of the user, which can be, for example, a control instruction for the ultrasound wave emission / reception timing, an operation input instruction for drawing a point, a line or a frame on the ultrasound image, or can also include other instruction types. The input device can include one or a combination of a keyboard, a mouse, a scroll wheel, a trackball, a mobile input device (such as a mobile device with a touch display screen, a mobile phone, etc.), a multifunctional knob, etc. The human-computer interaction device can also include an output device such as a printer.

[0061] The ultrasound imaging system 100 can also include a memory 124 for storing instructions executed by the processor, storing received ultrasound echoes, storing ultrasound images, etc. The memory can be a flash memory card, a solid state memory, a hard disk, etc. It can be a volatile memory and / or a non-volatile memory, a removable memory and / or a non-removable memory, etc.

[0062] It should be understood that, Figure 1The components included in the illustrated ultrasound imaging system 100 are merely illustrative, and the present application is not limited thereto.

[0063] In the following, an ultrasound imaging method incorporating physiological signals according to an embodiment of the present application will be described. Figure 2 An ultrasound imaging method incorporating physiological signals 200 according to an embodiment of the present application is shown in the flowchart of FIG. 2. Figure 2 An ultrasound imaging method incorporating physiological signals 200 according to an embodiment of the present application is shown in the flowchart of FIG. 2.

[0064] As shown in FIG. 2, the ultrasound imaging method incorporating physiological signals 200 according to an embodiment of the present application comprises the following steps: Figure 2 As shown in FIG. 2, the ultrasound imaging method incorporating physiological signals 200 according to an embodiment of the present application comprises the following steps:

[0065] In step S210, an ultrasound image of a subject is acquired by an ultrasound imaging system at a first time;

[0066] In step S220, a physiological signal of the subject is acquired by a first monitoring device at a second time, the first time at least partially coinciding with the second time;

[0067] In step S230, the ultrasound image and the physiological signal are time-synchronized;

[0068] In step S240, the time-synchronized ultrasound image and the physiological signal are displayed on the same display interface.

[0069] The ultrasound imaging method incorporating physiological signals 200 according to an embodiment of the present application can be applied to an ultrasound imaging system, such as the ultrasound imaging system 100 described with reference to Figure 1 When applied to an ultrasound imaging system, step S210 can be implemented by the ultrasound imaging system acquiring an ultrasound image at a first time; and step S220 can be implemented by the ultrasound imaging system acquiring a physiological signal of the same subject acquired by a first monitoring device at a second time at least partially coinciding with the first time. Exemplarily, the first monitoring device can be a ventilator, and the physiological signal acquired by the first monitoring device can be a respiration signal, which can include at least one of a pressure signal, a flow signal, a flow rate signal, and a carbon dioxide partial pressure signal, respectively representing the changes of pressure, flow, flow rate, and carbon dioxide partial pressure over time. In addition to the respiration signal, the physiological signal acquired by the first monitoring device can also include any type of physiological signal of the subject, such as a blood pressure signal, a blood oxygen signal, a carbon dioxide signal, an electrocardiogram signal, etc., and the first monitoring device can be other monitoring devices for acquiring the above-mentioned physiological signals.

[0070] The ultrasound imaging method 200 combined with physiological signals of the embodiments of the present application can also be applied to a second monitoring device, which is the same as or different from the first monitoring device for collecting physiological signals. For example, when the first monitoring device is a ventilator, the second monitoring device can be the ventilator itself, i.e., the second monitoring device is the same as the first monitoring device; or the second monitoring device can also be a monitor, an anesthesia machine, a central station or a bedside information system, i.e., the second monitoring device is different from the first monitoring device, and the first monitoring device synchronizes the physiological signals collected by it to the second monitoring device.

[0071] When applied to the second monitoring device, step S210 can be implemented as the second monitoring device acquiring the ultrasound images collected by the ultrasound imaging system within the first time; if the second monitoring device is the same as the first monitoring device, step S220 can be implemented as the second monitoring device collecting the physiological signals within the second time which at least partially coincides with the first time; if the second monitoring device is different from the first monitoring device, step S220 can be implemented as the second monitoring device acquiring the physiological signals collected by the first monitoring device within the second time.

[0072] In addition, the ultrasound imaging method 200 combined with physiological signals of the embodiments of the present application can also be applied to a third-party device other than the ultrasound imaging system and the second monitoring device, which is not limited to a monitoring device, for example, the third-party device can be implemented as a computer or a workstation, etc. When applied to the third-party device, step S210 can be implemented as the third-party device acquiring the ultrasound images collected by the ultrasound imaging system within the first time; and step S220 can be implemented as the third-party device acquiring the physiological signals of the same subject collected by the first monitoring device within the second time which at least partially coincides with the first time. When implemented in the third-party device, the user can more conveniently view the ultrasound images and the physiological signals without being limited to viewing on the ultrasound imaging system or the monitoring device.

[0073] Further, the ultrasound images and the physiological signals are transmitted between devices through a network connection, and the method further comprises establishing a network connection between devices to receive an ultrasound image data packet containing the ultrasound images through the network connection or to receive a physiological signal data packet containing the physiological signals through the network connection. The network connection can be a wired network connection or a wireless network connection. For example, devices requiring a wireless network connection (such as the ultrasound imaging system and the second monitoring device, or the ultrasound imaging system, the second monitoring device and the third-party device) can be under the same wireless network hotspot coverage, so as to realize wireless network connection between devices through WiFi. Wireless connection between devices can also be realized through other means, such as through Bluetooth, infrared or other near field communication means, or through 4G, 5G or other mobile communication network connection means.

[0074] Specifically, when the method is applied to the ultrasound imaging system, establishing the network connection comprises establishing a first network connection between the ultrasound imaging system and the second monitoring device, and the ultrasound imaging system receives a physiological signal data packet containing the physiological signal from the second monitoring device through the first network connection. When the method is applied to the second monitoring device, establishing the network connection comprises establishing a second network connection between the ultrasound imaging system and the second monitoring device, and the second monitoring device receives an ultrasound image data packet containing the ultrasound image from the ultrasound imaging system through the second network connection. When the method is applied to the third-party device, the third-party device establishes a third network connection with the ultrasound imaging system and a fourth network connection with the second monitoring device; the third-party device receives an ultrasound image data packet containing the ultrasound image from the ultrasound imaging system through the third network connection and receives a physiological signal data packet containing the physiological signal from the second monitoring device through the fourth network connection.

[0075] Exemplarily, before establishing the network connection, the method further comprises performing security verification on the network connection to ensure the information security of the subject.

[0076] Specifically, when the first network connection is established between the ultrasound imaging system and the second monitoring device, the second monitoring device receives verification information sent by the ultrasound imaging system, or the ultrasound system receives verification information sent by the second monitoring device, and verifies the verification information, and if the verification is passed, the first network connection is established.

[0077] When the second network connection is established between the ultrasound imaging system and the second monitoring device, the second monitoring device receives verification information sent by the ultrasound imaging system, or the ultrasound system receives verification information sent by the second monitoring device, and verifies the verification information, and if the verification is passed, the second network connection is established.

[0078] When the third network connection and the fourth network connection are respectively established between the third-party device and the ultrasound imaging system and the second monitoring device, the ultrasound imaging system receives verification information sent by the third-party device, or the third-party device receives verification information sent by the ultrasound imaging system, and verifies the verification information, and if the verification is passed, the third network connection is established; the third-party device receives verification information sent by the second monitoring device, or the second monitoring device receives verification information sent by the third-party device, and verifies the verification information, and if the verification is passed, the fourth network connection is established.

[0079] The acquired ultrasound image in step S210 can be at least one of a one-dimensional ultrasound image, a two-dimensional ultrasound image, or a three-dimensional ultrasound image. The one-dimensional ultrasound image can be a one-dimensional ultrasound static image or a one-dimensional ultrasound video image; the two-dimensional ultrasound image can be a two-dimensional ultrasound static image or a two-dimensional ultrasound video image; and the three-dimensional ultrasound image can be a three-dimensional ultrasound static image or a three-dimensional ultrasound video image. The physiological signal acquired in step S220 can include a static physiological signal or a dynamic physiological signal.

[0080] The one-dimensional ultrasound image can be an M-mode (Time-motion mode) ultrasound image, which is used to represent the longitudinal motion of the sampled tissue on a one-dimensional sampling line over time. The horizontal axis of the M-mode ultrasound image represents time, and the vertical axis represents the motion amplitude. Alternatively, the M-mode ultrasound image can be obtained based on a B-mode ultrasound image acquired in B-mode. After the ultrasound imaging system acquires the B-mode ultrasound image of the measured object in B-mode, it enters M-mode and acquires the M-mode ultrasound image according to the M-mode sampling line drawn by the user on the B-mode ultrasound image or according to the automatically drawn M-mode sampling line, records the sampling information of the same position on the sampling line at different time points within a certain time period, and outputs it in the form of an image, i.e., obtains the M-mode ultrasound image. Of course, the one-dimensional ultrasound image can also be a spectral Doppler PW image, etc., which is not limited here.

[0081] The two-dimensional ultrasound image can be a B-mode ultrasound image, i.e., a two-dimensional gray-scale ultrasound image. In combination with the above-mentioned one-dimensional ultrasound image, the two-dimensional ultrasound image can be used to obtain the B-mode ultrasound image of the target region of the measured object. Figure 1 The transmitting circuit 112 sends an electric signal with appropriate delay to each transducer element in the ultrasonic probe 110, which is converted into an ultrasonic wave by the transducer and transmitted to the target region of the measured object. The receiving circuit 114 controls the ultrasonic probe 110 to receive the ultrasonic echo of the returned ultrasonic wave of the target region and convert it into an electric signal to obtain a first ultrasonic echo signal, which is transmitted to the beamforming circuit 122 after signal amplification, analog-digital conversion, etc. for beamforming processing. The ultrasonic echo signal after beamforming is then sent to the processor 116, which can perform logarithmic compression, dynamic range adjustment, digital scan conversion, etc. to form a B-mode ultrasound image for embodying the morphological structure of the target region tissue. Alternatively, the two-dimensional ultrasound image can also be a D-mode ultrasound image, i.e., a Doppler color ultrasound image, which is obtained by calculating the blood flow signal from the ultrasonic echo signal and superimposing it in real time on the corresponding B-mode ultrasound image after color encoding. Alternatively, the two-dimensional ultrasound image can also be an elasticity image. The two-dimensional ultrasound video image can be a dynamic ultrasound image composed of a plurality of consecutive two-dimensional ultrasound static images.

[0082] The three-dimensional ultrasound image can be a three-dimensional image obtained by three-dimensional reconstruction of a two-dimensional ultrasound image. The three-dimensional ultrasound image can be acquired by a volume probe, or reconstructed by a three-dimensional ultrasound reconstruction technique based on a convex array or linear array probe with a magnetic navigation device, or acquired by a surface array probe. The three-dimensional ultrasound video image can also be referred to as a four-dimensional ultrasound image, which adds a time dimension parameter to the three-dimensional ultrasound image, that is, a plurality of three-dimensional images are continuously scanned without interruption within a period of time, that is, a four-dimensional image, that is, a three-dimensional ultrasound video image.

[0083] In step S230, the ultrasound image and the physiological signal are time-aligned. Exemplarily, if both the ultrasound image and the physiological signal contain a time dimension, for example, if the ultrasound image is an M-mode ultrasound image and the physiological signal is a respiratory signal, the time alignment includes aligning a plurality of time points one by one. If the ultrasound image does not contain a time dimension and the physiological signal contains a time dimension, for example, if the ultrasound image is a static B-mode ultrasound image and the physiological signal is a respiratory signal, the time alignment includes extracting a time point corresponding to the static B-mode ultrasound image in the physiological signal. By automatically time-aligning the ultrasound image and the physiological signal by the electronic device for implementing the method, the step of manual alignment by the user can be saved, thereby improving the user experience.

[0084] In one embodiment, the ultrasound image and the physiological signal can be time-aligned based on the timestamp. For example, referring to Figure 3 When the method is applied to an ultrasound imaging system, the second monitoring device sends a physiological signal data packet containing a physiological signal to the ultrasound imaging system, the physiological signal data packet also including a timestamp, and the ultrasound imaging system parses the timestamp when receiving the physiological signal data packet, and time-aligns the physiological signal and the ultrasound image according to the timestamp. Exemplarily, when the physiological signal is acquired, the first monitoring device can add a timestamp at each characteristic position of the physiological signal, such as a wave peak, a wave trough, or a zero position.

[0085] Similarly, when the method is applied to the second monitoring device, the ultrasound imaging system sends an ultrasound image data packet containing an ultrasound image to the second monitoring device, the ultrasound image data packet also including a timestamp, and the second monitoring device parses the timestamp when receiving the ultrasound image data packet, and time-aligns the ultrasound image and the physiological signal according to the timestamp. When the method is applied to a third-party device, the third-party device receives an ultrasound image data packet sent by the ultrasound imaging system and a physiological signal data packet sent by the second monitoring device, respectively, parses the timestamp, and time-aligns the ultrasound image and the physiological signal according to the timestamp.

[0086] In another embodiment, when the second monitoring device is equivalent to the first monitoring device, the ultrasound image and the physiological signal can be time-aligned according to the data transmission time, i.e., the time sequence of the physiological signal is delayed according to the transmission time of the ultrasound image data packet, or the time sequence of the ultrasound image is delayed according to the transmission time of the physiological signal data packet.

[0087] Referring to Figure 4 When the method is applied to the ultrasound imaging system, the ultrasound imaging system receives the physiological signal data packet from the second monitoring device through the network connection. The second monitoring device presets the transmission time of the physiological signal data packet as T0 according to the network state. When the ultrasound imaging system parses the physiological signal data packet, the physiological signal and the transmission time T0 are obtained, and the ultrasound image is also delayed by T0, so as to realize the time alignment of the physiological signal and the ultrasound image. Wherein, the ultrasound image and the physiological signal are both collected in real time, and the second monitoring device collects the physiological signal and sends the physiological signal to the ultrasound imaging system in real time.

[0088] Similarly, when the method is applied to the second monitoring device, the second monitoring device receives the ultrasound image data packet from the ultrasound imaging system through the network connection. The ultrasound imaging system presets the transmission time of the ultrasound image data packet according to the network state. When the second monitoring device parses the ultrasound image data packet, the physiological signal is also delayed by a corresponding time, so as to realize the time alignment of the physiological signal and the ultrasound image. When the method is applied to the third party device, the third party device obtains the first transmission time of the ultrasound image data packet and the second transmission time of the physiological signal data packet, delays the ultrasound image by the second transmission time, and delays the physiological signal by the first transmission time, so as to realize the time alignment of the physiological signal and the ultrasound image.

[0089] In another embodiment, the ultrasound image and the physiological signal can be time-aligned based on a preset physiological state. Specifically, a first feature representing a preset physiological state in the physiological signal is identified, and a second feature representing the same preset physiological state in the ultrasound image is identified; the first time corresponding to the first feature in the physiological signal is aligned with the second time corresponding to the second feature in the ultrasound image, so as to realize the time alignment of the ultrasound image and the physiological signal. Wherein, the preset physiological state can be a physiological state that can be represented by both the physiological signal and the ultrasound image. Referring to Figure 5 When the method is applied to the ultrasound imaging system, the physiological signal is a respiratory signal, and the ultrasound image is a one-dimensional ultrasound image, the ultrasound imaging system identifies a first feature representing the end of inspiration in the physiological signal and a second feature representing the end of inspiration in the ultrasound image through an algorithm, and aligns the first time corresponding to the first feature with the second time corresponding to the second feature, so as to realize the time alignment of the ultrasound image and the physiological signal.

[0090] Optionally, the ultrasound image time-aligned with the physiological signal in step S230 can include at least two ultrasound images, and the at least two ultrasound images are respectively time-aligned with the physiological signal. For example, the at least two ultrasound images include, but are not limited to, a B-mode ultrasound image and an M-mode ultrasound image obtained based on the B-mode ultrasound image.

[0091] In step S240, the time-aligned ultrasound image and the physiological signal are displayed on the same display interface. The user can comprehensively analyze the time-aligned ultrasound image and the physiological signal to more accurately determine the pathophysiological state of the measured object.

[0092] For example, when the ultrasound image is a one-dimensional ultrasound static image and the physiological signal is a static physiological signal, displaying the time-aligned ultrasound image and the physiological signal on the same display interface includes displaying a waveform curve of the time-aligned one-dimensional ultrasound static image and a waveform curve of the static physiological signal. For example, the one-dimensional ultrasound static image and the static physiological signal can share the same time axis, so that the amplitude of the one-dimensional ultrasound data corresponds to the amplitude of the static physiological signal in time. The one-dimensional ultrasound static image and the static physiological signal can also be displayed in different coordinate systems, but the time scales on the time axes of the two coordinate systems are aligned.

[0093] For example, referring to Figure 6A , a schematic diagram of displaying the time-aligned M-mode ultrasound image and the respiratory signal on the same display interface is shown. In Figure 6A , the respiratory signal is superimposed on the M-mode ultrasound image, which is conducive to comparative analysis of the two.

[0094] For example, referring to Figure 6B , a schematic diagram of displaying the time-aligned spectral Doppler PW ultrasound image and the respiratory signal on the same display interface is shown. In Figure 6B , the Doppler PW ultrasound image and the respiratory signal share the same time axis, where the vertical axis of the PW ultrasound image is the velocity value, the horizontal axis is the time, the horizontal axis of the respiratory signal is the time, and the vertical axis is the amplitude of the respiratory signal.

[0095] Similarly, when the ultrasound image is a one-dimensional ultrasound dynamic image and the physiological signal is a dynamic physiological signal, displaying the time-aligned ultrasound image and the physiological signal on the same display interface includes displaying a waveform curve of the time-aligned one-dimensional ultrasound dynamic image and a waveform curve of the dynamic physiological signal. The display mode of the one-dimensional ultrasound dynamic image and the dynamic physiological signal is similar to that of the static image, except that the dynamic curve is constantly refreshed at a preset frame rate, and each time it is refreshed, the data at the previous time is moved in a preset direction and new data is added, and the waveform curve presented is moving over time.

[0096] When the ultrasound image is a two-dimensional ultrasound static image or a three-dimensional ultrasound static image, displaying the time-series aligned ultrasound image and the physiological signal on the same display interface can be implemented by displaying the two-dimensional ultrasound static image or the three-dimensional ultrasound static image, simultaneously displaying a waveform curve of the physiological signal, and marking the time point corresponding to the two-dimensional ultrasound static image or the three-dimensional ultrasound static image on the waveform curve of the physiological signal. Since the two-dimensional ultrasound static image or the three-dimensional ultrasound static image corresponds to a single time point, the time point corresponding to the two-dimensional ultrasound static image or the three-dimensional ultrasound static image can be marked on the waveform curve of the physiological signal in the form of a graph or a symbol.

[0097] When the ultrasound image is a two-dimensional ultrasound video image or a three-dimensional ultrasound video image, displaying the time-series aligned ultrasound image and the physiological signal on the same display interface can be implemented by displaying the two-dimensional ultrasound video image or the three-dimensional ultrasound video image, simultaneously displaying a waveform curve of the physiological signal, and marking the time point corresponding to the two-dimensional ultrasound video image or the three-dimensional ultrasound video image displayed at the current time on the waveform curve of the physiological signal. Since the two-dimensional ultrasound video image or the three-dimensional ultrasound video image is a dynamic image changing with time, each frame of the image corresponds to a time point, and thus the time point corresponding to the two-dimensional ultrasound video image or the three-dimensional ultrasound video image displayed at the current time can be marked on the waveform curve of the physiological signal in the form of a graph or a symbol, which moves on the waveform curve with time.

[0098] In another embodiment, the physiological signal can be represented by a numerical value, and displaying the time-series aligned ultrasound image and the physiological signal on the same display interface can be implemented by simultaneously displaying the ultrasound image and the numerical value of the physiological signal at the time point corresponding to the ultrasound image displayed at the current time. If the ultrasound image is a static ultrasound image, the static ultrasound image and the numerical value of the physiological signal at the single time point corresponding to the static ultrasound image are simultaneously displayed. If the ultrasound image is a dynamic ultrasound image, the dynamic ultrasound image is simultaneously displayed, and the numerical value of the physiological signal at the time point corresponding to the current frame of the ultrasound image is displayed while each frame of the ultrasound image is displayed.

[0099] The above-described several ways of displaying the time-series aligned ultrasound image and the physiological signal can also be combined with each other. For example, the waveform curve of the one-dimensional ultrasound image and the waveform curve of the physiological signal after time-series alignment, and the two-dimensional ultrasound image or the three-dimensional ultrasound image after time-series alignment can be simultaneously displayed on the display interface, and the time point corresponding to the two-dimensional ultrasound image or the three-dimensional ultrasound image displayed at the current time can be marked on the waveform curve of the physiological signal in the form of a graph or a symbol.

[0100] In some embodiments, the ultrasound imaging method 200 combining physiological signals according to this application further includes: performing comprehensive analysis on the ultrasound image and the physiological signals to obtain a comprehensive analysis result; and displaying the comprehensive analysis result. Specific details regarding the comprehensive analysis of the ultrasound image and physiological signals can be found in the following description of the ultrasound imaging method 700 for physiological signals.

[0101] Based on the above description, the ultrasound imaging method 200 combining physiological signals of this application displays ultrasound images and other physiological signals on the same display interface after time-series alignment, which facilitates comprehensive analysis of the two.

[0102] Below, we will refer to Figure 7 This application describes an ultrasound imaging method incorporating physiological signals according to another embodiment of the present application. Figure 7 This is a schematic flowchart of an ultrasound imaging method 700 incorporating physiological signals according to an embodiment of this application. Figure 7 As shown, the ultrasound imaging method 700 combining physiological signals includes the following steps:

[0103] In step S710, an ultrasound image of the object under test is acquired by the ultrasound imaging system.

[0104] In step S720, the physiological signals of the subject being tested are acquired by the first monitoring device.

[0105] In step S730, the time phase of the physiological signal and the ultrasound image is comprehensively analyzed, and / or the quantitative indicators of the physiological signal and the ultrasound image are comprehensively analyzed to obtain a comprehensive analysis result.

[0106] In step S740, the comprehensive analysis results are displayed.

[0107] In some possible implementations, step S740 is also included, which displays the ultrasound image, the physiological signal, and the comprehensive analysis results on the same display interface.

[0108] Similar to the ultrasound imaging method 200 combined with a physiological signal described above, the ultrasound imaging method 700 combined with a physiological signal in the embodiments of the present application can be used in an ultrasound imaging system, a second monitoring device, or a third-party device other than the ultrasound imaging system and the second monitoring device, the second monitoring device being the same as or different from the first monitoring device for collecting a physiological signal of a measured object. In an embodiment, the first monitoring device can be a ventilator, and the physiological signal collected by the first monitoring device can be a breathing signal. Exemplarily, the breathing signal includes at least one of a pressure signal, a flow signal, a flow rate signal, and a carbon dioxide partial pressure signal. The physiological signal can also include any other type of physiological signal of the measured object, such as at least one of a carbon dioxide signal, an oxygen signal, a blood pressure signal, and an electrocardiogram signal.

[0109] Steps S710 and S720 are similar to steps S210 and S220 of the ultrasound imaging method 200 combined with a physiological signal, and specific reference can be made to the related description in the above, and for the sake of brevity, the same details are not described here.

[0110] In step S730, the ultrasound image and the physiological signal are comprehensively analyzed to obtain a comprehensive analysis result. Specifically, quantitative parameters can be obtained from the ultrasound image and the physiological signal respectively, and the parameters of the two are comprehensively analyzed to obtain the comprehensive analysis result.

[0111] In an embodiment, the comprehensive analysis of the ultrasound image and the physiological signal includes comprehensive analysis of the time phases of the physiological signal and the ultrasound image. The time phases of the physiological signal and the ultrasound image can be the time phases of various indicators related to cardiopulmonary interaction, and by comprehensively analyzing the time phases, the cardiopulmonary interaction of the measured object can be analyzed, so that the volume status and volume responsiveness of the measured object can be quickly and conveniently determined. The time phases can also be the time phases of other indicators required for volume management.

[0112] Taking the first monitoring device as a ventilator and the physiological signal collected by the first monitoring device as a breathing signal as an example, the comprehensive analysis of the time phases of the physiological signal and the ultrasound image includes: determining a first time corresponding to a ventilation pressure peak in the physiological signal; determining a second time corresponding to an inferior vena cava inner diameter peak in the ultrasound image; and calculating a time difference between the first time and the second time, which can reflect the cardiopulmonary interaction of the measured object.

[0113] In another embodiment, the comprehensive analysis of the ultrasound image and the physiological signal comprises: comprehensive analysis of quantified indexes of the physiological signal and the ultrasound image. The quantified indexes can be quantified indexes of various indications of cardiopulmonary interaction, which can be used for auxiliary diagnosis. For example, the comprehensive analysis of the quantified indexes of the physiological signal and the ultrasound image can comprise at least one of the following: determining a respiratory frequency from the respiratory signal, determining a diaphragm displacement from the ultrasound image, and calculating a ratio between the respiratory frequency and the diaphragm displacement as the comprehensive analysis result, which can also help the doctor to determine whether the ventilator can be removed, for example, if the ratio between the respiratory frequency and the diaphragm displacement is not greater than a certain threshold, the ventilator can be removed, for example, the threshold can be 1.3 times / (minute*mm); and determining a pleural displacement from the ultrasound image, determining a ventilation pressure from the respiratory signal, and calculating a ratio between the pleural displacement and the ventilation pressure as the comprehensive analysis result. The comprehensive analysis can also be a comprehensive analysis of other parameters determined from the ultrasound image and the physiological signal.

[0114] In step S740, the ultrasound image, the physiological signal, and the comprehensive analysis result obtained in step S730 are displayed on the same display interface. In some embodiments, the ultrasound image can be displayed in time sequence alignment with the physiological signal, which can be specifically referred to the related description above.

[0115] Based on the above description, the ultrasound imaging method 700 combined with a physiological signal according to the embodiments of the present application comprehensively analyzes the ultrasound image and other physiological signals, and displays the ultrasound image, the physiological signal, and the comprehensive analysis result on the same display interface, which facilitates the user to determine the physiological state of the measured object.

[0116] In the following, the ultrasound imaging method combined with a physiological signal according to another embodiment of the present application will be described with reference to Figure 8 The ultrasound imaging method combined with a physiological signal according to another embodiment of the present application will be described with reference to Figure 8 is a schematic flowchart of the ultrasound imaging method 800 combined with a physiological signal according to the embodiments of the present application.

[0117] As shown in Figure 8 The ultrasound imaging method 800 combined with a physiological signal according to the embodiments of the present application comprises the following steps:

[0118] In step S810, ultrasound data of a measured object acquired by an ultrasound imaging system is obtained;

[0119] In step S820, a physiological signal of the measured object acquired by a monitoring device is obtained;

[0120] In step S830, the ultrasound data and the physiological signal are displayed on the same display interface of the electronic device.

[0121] According to the ultrasound imaging method 800 combined with a physiological signal in the embodiments of the present application, the ultrasound data collected by the ultrasound imaging system and the physiological signal collected by the monitoring device are acquired by the monitoring device or a third-party device other than the monitoring device or the ultrasound imaging system, and the two are displayed on the same display interface, so that the user can simultaneously view the ultrasound data and the physiological signal on the monitoring device or the third-party device without the ultrasound imaging system.

[0122] Exemplarily, when the method is applied to the monitoring device, step S810 can be implemented by acquiring, by the monitoring device, the ultrasound data collected by the ultrasound imaging system; and step S820 can be implemented by collecting, by the monitoring device itself, the physiological signal of the measured object. When the method is applied to the third-party device, step S810 can be implemented by acquiring, by the third-party device, the ultrasound data collected by the ultrasound imaging system; and step S820 can be implemented by acquiring, by the third-party device, the physiological signal collected by the monitoring device. Exemplarily, the monitoring device includes but is not limited to a ventilator, a monitor, an anesthesia machine, a central station or a bedside information system, and the third-party device is, for example, a computer or a workstation, etc.; and the ultrasound data can be an ultrasound image or quantitative ultrasound data.

[0123] Based on the above description, according to the ultrasound imaging method 800 combined with a physiological signal in the embodiments of the present application, the ultrasound data and the physiological signal are acquired by the monitoring device or the third-party device, and the two are displayed on the same display interface, so as to facilitate the user to simultaneously view the ultrasound data and the physiological signal through the monitoring device or the third-party device.

[0124] With reference to Figure 9 The embodiments of the present application also provide an electronic device 900, which can be used to implement the ultrasound imaging method 200 combined with a physiological signal, the ultrasound imaging method 700 combined with a physiological signal or the ultrasound imaging method 800 combined with a physiological signal described above. Hereinafter, only the main functions of the electronic device 900 are described, and other specific details can be referred to the above. Figure 9 As shown in FIG. 9, the electronic device 900 includes a memory 910, a processor 920 and a display 930, and the memory 910 stores a computer program which is run by the processor 920.

[0125] The processor 920 can be implemented by software, hardware, firmware or any combination thereof, and can be implemented by circuits, one or more application-specific integrated circuits, one or more general-purpose integrated circuits, one or more microprocessors, one or more programmable logic devices, or any combination of the aforementioned circuits and / or devices, or other suitable circuits or devices. The processor 920 can control other components in the electronic device 900 to perform the desired functions.

[0126] The memory 910 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory and / or cache memory. The non-volatile memory may include, for example, read-only memory, hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 920 may execute the program instructions to implement the model training method and / or other various desired functions in the embodiments of the present invention. Various application programs and various data may also be stored in the computer-readable storage medium, such as various data used and / or generated by the application programs.

[0127] When the electronic device 900 can be used to implement the ultrasound imaging method 200 that incorporates physiological signals as described above, it can be implemented as an ultrasound imaging system (e.g., refer to...). Figure 1 The described ultrasound imaging system 100, monitoring equipment, or third-party equipment. Monitoring equipment includes, but is not limited to, ventilators, monitors, anesthesia machines, central stations, or bedside information systems; third-party equipment includes, for example, computers or workstations. At this time, the computer program stored in memory 910 executes the following steps when run by processor 920: acquiring an ultrasound image of the subject acquired by the ultrasound imaging system at a first time; acquiring physiological signals of the subject acquired by the first monitoring equipment at a second time, wherein the first time and the second time at least partially overlap; chronologically aligning the ultrasound image and the physiological signals; and displaying the chronologically aligned ultrasound image and physiological signals on the same display interface.

[0128] When the electronic device 900 can be used to implement the ultrasound imaging method 700 combined with physiological signals as described above, the electronic device 900 can also be implemented as an ultrasound imaging system, a monitoring device or a third-party device. At this time, the computer program stored on the memory 910 performs the following steps when executed by the processor 920: acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time; acquiring a physiological signal of the measured object collected by a first monitoring device at a second time; comprehensively analyzing the ultrasound image and the physiological signal to obtain a comprehensive analysis result; and the display is used to display the ultrasound image, the physiological signal and the comprehensive analysis result on the same display interface.

[0129] When the electronic device 900 can be used to implement the ultrasound imaging method 800 combined with physiological signals as described above, the electronic device 900 can be implemented as a monitoring device or a third-party device other than an ultrasound imaging system and the monitoring device, and the computer program stored on the memory 910 performs the following steps when executed by the processor 920: acquiring ultrasound data of a measured object collected by an ultrasound imaging system; acquiring a physiological signal of the measured object collected by a monitoring device; and the display is used to display the ultrasound data and the physiological signal on the same display interface.

[0130] Based on the above description, the ultrasound imaging method and the ultrasound imaging system combined with physiological signals according to the present embodiment display the ultrasound image and other physiological signals on the same display interface, which facilitates comprehensive analysis of the two.

[0131] Although the example embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the example embodiments are merely exemplary and are not intended to limit the scope of the present application. Those of ordinary skill in the art can make various changes and modifications without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of the present application as claimed in the appended claims.

[0132] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in connection with the embodiments disclosed herein can be realized in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those of ordinary skill in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0133] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and the division of the units is merely a logical function division. In actual implementation, another division manner can be used, for example, a plurality of units or components can be combined or integrated into another device, or some features can be omitted or not executed.

[0134] In the specification provided herein, a large number of specific details are described. However, it can be understood that the embodiments of the present application can be practiced without these specific details. In some examples, well-known methods, structures and techniques are not described in detail in order not to obscure the understanding of the present specification.

[0135] Similarly, it should be understood that, in order to simplify the present application and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present application, various features of the present application are sometimes grouped together in a single embodiment, figure, or description of it. However, the method of the present application should not be interpreted as reflecting an intention that the claimed present application requires more features than the features explicitly recited in each claim. Rather, as reflected by the corresponding claims, the inventive point is that the corresponding technical problem can be solved with fewer features than all the features of a certain disclosed single embodiment. Therefore, the claims following the specific embodiments are hereby expressly incorporated into the specific embodiments, in which each claim itself is a separate embodiment of the present application.

[0136] Those skilled in the art can understand that, except for the mutual exclusion between features, any combination of all features disclosed in the specification (including the accompanying claims, abstract and drawings) and all processes or units of any method or device disclosed in this way can be combined. Unless explicitly stated otherwise, each feature disclosed in the specification (including the accompanying claims, abstract and drawings) can be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0137] In addition, those skilled in the art can understand that, although some embodiments described herein include certain features rather than other features included in other embodiments, the combination of features of different embodiments means that it is within the scope of the present application and forms different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

[0138] Various component embodiments of the present application can be implemented in hardware, or as software modules running in one or more processors, or in combinations thereof. As will be appreciated by persons skilled in the art, a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the functions of some of the modules according to the embodiments of the present application. The present application can also be implemented as a program for executing, in whole or in part, the methods described herein, such as a computer program and a computer program product. Such a program implementing the present application can be stored on a computer readable medium or can be in the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or in any other form.

[0139] It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that one skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The application can be implemented by means of both hardware and software, and any combination thereof. In the claims, the word comprising does not exclude other elements being included in the composition. The word "comprising" does not exclude other elements being present in addition to or instead of those identified. Where an indefinite or definite article is used, such as "an" or "a" or "an" or "the", such article is also not intended to exclude the presence of the species having the identified property. The word "comprising" is intended to mean "consisting at least in part of. Where an indefinite or definite article is used, such as "an" or "a" or "an" or "the", such article is also not intended to exclude the presence of the species having the identified property. The word "a" or "an" preceding an element does not exclude the presence of two or more such elements. The word "or" in reference to a list of two or more terms does not exclude that those terms can be present simultaneously. Where an indefinite or definite article is used, such as "an" or "a" or "an" or "the", such article is also not intended to exclude the presence of the species having the identified property. The word "a" or "an" preceding an element does not exclude the presence of two or more such elements. The word "or" in reference to a list of two or more terms does not exclude that those terms can be present simultaneously. On the contrary, the use of the word "or" should be understood to present "one, some or all" of the elements so described.

[0140] The above description is only specific embodiments of the present application or explanations of specific embodiments, the protection scope of the present application is not limited to this, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application. The protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An ultrasound imaging method incorporating a physiological signal, characterized by, The method comprises: acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time, the ultrasound image comprising a static ultrasound image or a dynamic ultrasound image; acquiring a physiological signal of the measured object collected by a first monitoring device at a second time, the first time at least partially coinciding with the second time; temporally aligning the ultrasound image and the physiological signal; displaying the temporally aligned ultrasound image and the physiological signal on the same display interface, wherein if the ultrasound image is a static ultrasound image, the static ultrasound image and the value of the physiological signal at the corresponding time point are displayed simultaneously, and if the ultrasound image is a dynamic ultrasound image, the value of the physiological signal at the time point corresponding to the current frame ultrasound image is displayed while displaying each frame ultrasound image in the dynamic ultrasound image.

2. An ultrasound imaging method incorporating a physiological signal, characterized by, The method comprises: acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time, the ultrasound image comprising a one-dimensional ultrasound image, the one-dimensional ultrasound image being a one-dimensional ultrasound static image or a one-dimensional ultrasound video image; acquiring a physiological signal of the measured object collected by a first monitoring device at a second time, the first time at least partially coinciding with the second time, the physiological signal comprising a static physiological signal or a dynamic physiological signal; temporally aligning the ultrasound image and the physiological signal; displaying the temporally aligned one-dimensional ultrasound image and the physiological signal on the same display interface, which comprises: displaying the waveform curve of the temporally aligned one-dimensional ultrasound static image and the waveform curve of the static physiological signal, or displaying the waveform curve of the temporally aligned one-dimensional ultrasound video image and the waveform curve of the dynamic physiological signal; wherein the waveform curve of the one-dimensional ultrasound image and the waveform curve of the physiological signal share the same time coordinate axis, or the waveform curve of the one-dimensional ultrasound image and the waveform curve of the physiological signal are displayed in different coordinate systems, and the time scales on the time coordinate axes of the different coordinate systems are aligned and displayed.

3. An ultrasound imaging method incorporating a physiological signal, characterized by, The method comprises: acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time, the ultrasound image comprising a two-dimensional ultrasound static image or a three-dimensional ultrasound static image; acquiring a physiological signal of the measured object collected by a first monitoring device at a second time, the first time at least partially coinciding with the second time; temporally aligning the ultrasound image and the physiological signal; displaying the temporally aligned ultrasound image and the physiological signal on the same display interface, which comprises: displaying the two-dimensional ultrasound static image or the three-dimensional ultrasound static image, simultaneously displaying the waveform curve of the physiological signal, and marking the time point corresponding to the two-dimensional ultrasound static image or the three-dimensional ultrasound static image on the waveform curve of the physiological signal.

4. An ultrasound imaging method incorporating a physiological signal, characterized by, The method comprises: acquiring an ultrasound image of a measured object collected by an ultrasound imaging system at a first time, the ultrasound image comprising a two-dimensional ultrasound dynamic image or a three-dimensional ultrasound dynamic image; acquiring a physiological signal of the subject collected by a first monitoring device at a second time, the first time at least partially coinciding with the second time, the physiological signal comprising a static physiological signal; temporally aligning the ultrasound image and the physiological signal; displaying the temporally aligned ultrasound image and the physiological signal on the same display interface, comprising: displaying the two-dimensional ultrasound video image or the three-dimensional ultrasound video image, while displaying a waveform curve of the physiological signal, and marking a time point corresponding to the two-dimensional ultrasound video image or the three-dimensional ultrasound video image displayed at the current time on the waveform curve of the physiological signal in a graph or a symbol, the graph or the symbol moving on the waveform curve of the physiological signal over time.

5. The ultrasound imaging method of any one of claims 1-4, wherein, The method further comprises: establishing a network connection, so as to receive an ultrasound image data packet containing the ultrasound image through the network connection or receive a physiological signal data packet containing the physiological signal through the network connection.

6. The ultrasound imaging method of claim 5, wherein, Before establishing the network connection, the method further comprises: performing security verification on the network connection.

7. The ultrasound imaging method of claim 5, wherein, The ultrasound image data packet further comprises a timestamp, and the temporally aligning the ultrasound image and the physiological signal comprises: parsing the timestamp of the ultrasound image data packet, and temporally aligning the ultrasound image and the physiological signal according to the timestamp.

8. The ultrasound imaging method of claim 5, wherein, The physiological signal data packet further comprises a timestamp; The temporally aligning the ultrasound image and the physiological signal comprises: parsing the timestamp of the physiological signal data packet, and temporally aligning the ultrasound image and the physiological signal according to the timestamp.

9. The ultrasound imaging method of claim 5, wherein, The temporally aligning the ultrasound image and the physiological signal comprises: delaying the time sequence of the physiological signal according to the transmission time of the ultrasound image data packet, or delaying the time sequence of the ultrasound image according to the transmission time of the physiological signal data packet.

10. The ultrasound imaging method of any one of claims 1-4, wherein, The temporally aligning the ultrasound image and the physiological signal comprises: identifying a first feature in the physiological signal representing a preset physiological state, and identifying a second feature in the ultrasound image representing the same preset physiological state; aligning a first time corresponding to the first feature in the physiological signal with a second time corresponding to the second feature in the ultrasound image.

11. The ultrasound imaging method of any of claims 1-4, wherein, The first monitoring device comprises a ventilator, and the physiological signal comprises a breathing signal.

12. The ultrasound imaging method of claim 11, wherein, The breathing signal comprises at least one of: a pressure signal, a flow signal, a flow rate signal, and a carbon dioxide partial pressure signal.

13. The ultrasound imaging method of any of claims 1-4, wherein, The physiological signal comprises at least one of: a carbon dioxide signal, a blood oxygen signal, a blood pressure signal, and an electrocardiogram signal.

14. The ultrasound imaging method of any one of claims 1-4, wherein, The method is applied to an ultrasound imaging system, a second monitoring device, or a third-party device other than the ultrasound imaging system and the second monitoring device, and the second monitoring device is the same as or different from the first monitoring device.

15. The ultrasonic imaging method of claim 14, wherein, The second monitoring device comprises a ventilator, a monitor, an anesthesia machine, a central station, or a bedside information system.

16. The ultrasound imaging method of any of claims 1-4, wherein, The method further comprises: comprehensively analyzing the ultrasound image and the physiological signal to obtain a comprehensive analysis result; and displaying the comprehensive analysis result.

17. The ultrasonic imaging method of claim 16, wherein, The comprehensive analysis of the ultrasound image and the physiological signal to obtain a comprehensive analysis result comprises: comprehensive analysis of time phases of the physiological signal and the ultrasound image, and / or comprehensive analysis of quantitative indexes of the physiological signal and the ultrasound image to obtain a comprehensive analysis result.

18. The ultrasonic imaging method of claim 17, wherein, The comprehensive analysis of the time phases of the physiological signal and the ultrasound image comprises: determining a first time corresponding to a ventilation pressure peak in the physiological signal; determining a second time corresponding to an inferior vena cava inner diameter peak in the ultrasound image; calculating a time difference between the first time and the second time.

19. The ultrasonic imaging method of claim 17, wherein, The comprehensive analysis of the quantitative indexes of the physiological signal and the ultrasound image comprises at least one of: determining a ratio between a respiratory frequency and a diaphragm displacement; determining a ratio between a pleural displacement and a ventilation pressure.

20. An electronic device, comprising: The electronic device comprises a memory, a processor and a display, the memory stores a computer program which is run by the processor, and the computer program performs the steps of any one of claims 1-19 when being run by the processor; The display is used to display the time-sequentially aligned ultrasound image and physiological signal on the same display interface.

21. The electronic device of claim 20, wherein, The electronic device comprises an ultrasound imaging system, a monitoring device or a third-party device other than the ultrasound imaging system and the monitoring device.

Images