Ultrasonic equipment and ultrasonic three-dimensional holographic imaging method

Abstract

The invention relates to the technical field of holographic imaging, in particular to ultrasonic equipment and an ultrasonic three-dimensional holographic imaging method. According to the ultrasonic equipment and the ultrasonic three-dimensional holographic imaging method provided by the invention, after the three-dimensional model comprising at least one scattering surface is obtained, the gray value of each sampling point on the holographic surface of the preset light transmission model is determined according to the three-dimensional model, and then the holographic surface of the light transmission model is imaged according to the gray value of each sampling point. The method comprises the steps of determining form information of a three-dimensional model according to a plurality of sampling points and distances between each sampling point and a plurality of sub-sampling points in corresponding intersecting light rays, and then performing holographic coding on the form information of the three-dimensional model to obtain a hologram of a target object. By simulating the interaction between the light emitted by the sampling points and the three-dimensional model comprising at least one scattering surface, the effect of scattering illumination can be added in the process of determining the gray value of each sampling point, and the illumination reality sense of the finally formed hologram is increased, so that the reality sense of the ultrasonic three-dimensional holographic image is improved.

Description

Technical Field

[0001] The present application relates to the field of holographic imaging technology, and in particular to an ultrasonic device and an ultrasonic three-dimensional holographic imaging method. Background Art

[0002] With the rapid development of digital holographic technology, the clinical application of ultrasound images has been brought a more realistic three-dimensional visual presentation method.

[0003] Related technologies require three-dimensional reconstruction of the target object's ultrasonic signals, acquired by ultrasound equipment, to produce a three-dimensional model representing the target object's three-dimensional structure. A hologram is then calculated based on the reconstructed three-dimensional model, and a spatial light modulator is used to display the corresponding ultrasonic three-dimensional holographic image.

[0004] However, the realism of ultrasonic three-dimensional holographic images presented by holograms generated based on traditional hologram calculation methods still needs to be improved. Summary of the Invention

[0005] In order to solve the above-mentioned problems in the prior art, the embodiments of the present application provide an ultrasound device and an ultrasound three-dimensional holographic imaging method, which are used to enhance the realism of ultrasound three-dimensional holographic images.

[0006] In a first aspect, an embodiment of the present application provides an ultrasound device, comprising a processor and a spatial light modulator, wherein the processor is configured to:

[0007] Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model; the three-dimensional model is used to characterize the three-dimensional structure of the target object; the three-dimensional model includes at least one scattering surface;

[0008] For each sampling point on a holographic surface of a preset light transmission model, the following operations are performed: simulating light emitted from the sampling point toward the three-dimensional model and determining the intersection of the light and the three-dimensional model; determining the light intensities of multiple sub-sampling points in the intersecting light; the multiple sub-sampling points are the intersection points of the intersecting light and the three-dimensional model; the light intensity of each sub-sampling point is the light intensity of the intersecting light at the corresponding sub-sampling point under the influence of the scattering surface of the three-dimensional model; and determining the grayscale value of the sampling point based on the light intensities of the multiple sub-sampling points in the intersecting light.

[0009] determining morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays;

[0010] Holographically encoding the morphological information of the three-dimensional model to obtain a hologram of the target object, and transmitting the hologram to the spatial light modulator;

[0011] The spatial light modulator is configured to display an ultrasonic three-dimensional holographic image corresponding to the hologram.

[0012] In a possible implementation, the processor is specifically configured to:

[0013] Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain three-dimensional data;

[0014] Determine the components of the three-dimensional data mapped to the X-axis direction, the Y-axis direction, and the Z-axis direction of the coordinate system to obtain three one-dimensional components;

[0015] performing noise suppression processing on each of the three one-dimensional components respectively;

[0016] The three-dimensional model is obtained based on the three one-dimensional components subjected to noise suppression processing.

[0017] In a possible implementation, the processor is specifically configured to:

[0018] The GPU is called to perform noise suppression processing on each of the three one-dimensional components.

[0019] In a possible implementation, the processor is specifically configured to:

[0020] Determining distribution information of complex amplitudes of the plurality of sampling points according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays;

[0021] The morphological information of the three-dimensional model is determined according to the distribution information of the complex amplitudes of the plurality of sampling points.

[0022] In a possible implementation, the processor is specifically configured to:

[0023] determining a shadow intensity of the three-dimensional model based on attribute parameters of the virtual light source of the light transmission model; the shadow intensity is used to represent the degree to which the three-dimensional model blocks light emitted by the virtual light source toward the three-dimensional model;

[0024] The shadow intensity and the distribution information of the complex amplitudes of the plurality of sampling points are fused to obtain morphological information of the three-dimensional model.

[0025] In a possible implementation, the processor is specifically configured to:

[0026] Projecting the three-dimensional model to generate a plurality of two-dimensional images parallel to the holographic surface;

[0027] Determining the shadow intensity corresponding to each two-dimensional image according to the attribute parameters of the virtual light source;

[0028] The shadow intensity corresponding to each of the two-dimensional images is integrated to obtain the shadow intensity of the three-dimensional model.

[0029] In a second aspect, an embodiment of the present application provides an ultrasonic three-dimensional holographic imaging method, which is applied to an ultrasonic device, and the method includes:

[0030] Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model; the three-dimensional model is used to characterize the three-dimensional structure of the target object; the three-dimensional model includes at least one scattering surface;

[0031] For each sampling point on a holographic surface of a preset light transmission model, the following operations are performed: simulating light emitted from the sampling point toward the three-dimensional model and determining the intersection of the light and the three-dimensional model; determining the light intensities of multiple sub-sampling points in the intersecting light; the multiple sub-sampling points are the intersection points of the intersecting light and the three-dimensional model; the light intensity of each sub-sampling point is the light intensity of the intersecting light at the corresponding sub-sampling point under the influence of the scattering surface of the three-dimensional model; and determining the grayscale value of the sampling point based on the light intensities of the multiple sub-sampling points in the intersecting light.

[0032] determining morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays;

[0033] Holographically encoding the morphological information of the three-dimensional model to obtain a hologram of the target object;

[0034] An ultrasonic three-dimensional holographic image corresponding to the hologram is displayed.

[0035] In a possible implementation, performing three-dimensional reconstruction on the ultrasound signal of the target object to obtain a three-dimensional model includes:

[0036] Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain three-dimensional data;

[0037] Determine the components of the three-dimensional data mapped to the X-axis direction, the Y-axis direction, and the Z-axis direction of the coordinate system to obtain three one-dimensional components;

[0038] performing noise suppression processing on each of the three one-dimensional components respectively;

[0039] The three-dimensional model is obtained based on the three one-dimensional components subjected to noise suppression processing.

[0040] In a possible implementation, performing noise suppression processing on each of the three one-dimensional components separately includes:

[0041] The GPU is called to perform noise suppression processing on each of the three one-dimensional components.

[0042] In a possible implementation, determining the morphological information of the three-dimensional model based on the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays includes:

[0043] Determining distribution information of complex amplitudes of the plurality of sampling points according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays;

[0044] The morphological information of the three-dimensional model is determined according to the distribution information of the complex amplitudes of the plurality of sampling points.

[0045] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the ultrasonic three-dimensional holographic imaging method described in the second aspect is implemented.

[0046] An ultrasound device and ultrasonic three-dimensional holographic imaging method provided in embodiments of the present application acquire a three-dimensional model including at least one scattering surface, then determine the grayscale value of each sampling point on the holographic surface of a preset light transmission model based on the three-dimensional model. The morphological information of the three-dimensional model is then determined based on the grayscale value of each sampling point and the distance between each sampling point and multiple sub-sampling points in the corresponding intersecting light rays. The morphological information of the three-dimensional model is then holographically encoded to obtain a hologram of the target object. By simulating the interaction between the light emitted by the sampling points and the three-dimensional model including at least one scattering surface, the effect of scattered illumination can be added to the process of determining the grayscale value of each sampling point, increasing the illumination realism of the resulting hologram and thereby enhancing the realism of the ultrasonic three-dimensional holographic image. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0048] Figure 1A hardware configuration block diagram of an ultrasound device provided in an embodiment of the present application;

[0049] Figure 2 A schematic diagram of an ultrasound device provided in an embodiment of the present application;

[0050] Figure 3 A schematic structural diagram of an ultrasound probe provided in an embodiment of the present application;

[0051] Figure 4 This is a diagram of an application scenario of an ultrasound device provided in an embodiment of the present application;

[0052] Figure 5 A flowchart of an ultrasonic three-dimensional holographic imaging method provided in an embodiment of the present application;

[0053] Figure 6 A flowchart of an ultrasonic three-dimensional holographic imaging method provided in an embodiment of the present application;

[0054] Figure 7 A schematic diagram of mapping three-dimensional data to a coordinate system provided in an embodiment of the present application;

[0055] Figure 8 A flowchart of another ultrasonic three-dimensional holographic imaging method provided in an embodiment of the present application;

[0056] Figure 9 A schematic diagram of simulating optical transmission provided in an embodiment of the present application;

[0057] Figure 10 A schematic diagram of another simulated optical transmission provided in an embodiment of the present application;

[0058] Figure 11 A schematic diagram of another simulated optical transmission provided in an embodiment of the present application;

[0059] Figure 12 A schematic diagram of another simulated optical transmission provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] To make the purpose, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Among them, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0061] Furthermore, in the description of the embodiments of the present application, unless otherwise specified, "and" means or, for example, A / B can mean A or B; "and / or" in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0062] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, features defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0063] Specifically, in the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like to indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. Moreover, the "connection" and "connection" mentioned in the present application, unless otherwise specified, include direct and indirect connections (connections).

[0064] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the described features. Throughout the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0065] like Figure 1 As shown, the embodiment of the present application is Figure 1 A hardware structure diagram of the ultrasound device 10 is illustrated.

[0066] by Figure 1 The hardware structure of the ultrasonic device 10 shown in FIG. 1 is used as an example to describe the embodiment in detail. It should be understood that Figure 1 The hardware structure of the ultrasound apparatus 10 shown is only an example, and the ultrasound apparatus 10 may have a larger hardware structure than that of the ultrasound apparatus 10. Figure 1The more or less components shown in the figure can be combined with two or more components, or can have different component configurations. The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0067] Figure 1 FIG. 1 shows an exemplary hardware configuration block diagram of the ultrasound device 10 in an embodiment of the present application. Figure 1 As shown, the ultrasound device 10 includes: an ultrasound probe 110, a memory 120, a display 130, a control panel 140, a processor 150, a communication interface 160, a power supply 170, and a spatial light modulator 180.

[0068] The ultrasound probe 110 can be used to collect ultrasound image data. During the process of collecting ultrasound image data, the ultrasound probe 110 can convert electrical signals into ultrasound signals and transmit ultrasound waves to the patient's human tissue. In addition, the ultrasound probe 110 receives ultrasound echoes reflected by the human tissue, converts the ultrasound signals into electrical signals, sends the electrical signals to the processor 120 for processing, and displays the corresponding ultrasound images on the display 130. In this embodiment of the present application, the converted electrical signals may be referred to as ultrasound image data.

[0069] The memory 120 can be used to store software programs and data. The processor 150 executes various functions and data processing of the ultrasound device 10 by running the software programs or data stored in the memory 120. The memory 120 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The memory 120 stores the operating system that enables the ultrasound device 10 to operate. In the present application, the memory 120 can store the operating system and various application programs, and may also store code for executing the ultrasonic three-dimensional holographic imaging method described in the embodiments of the present application.

[0070] The display 130 can be used to receive input digital or character information and generate signal input related to user settings and function control of the ultrasound device 10. Specifically, the display 130 may include a touch screen 131 set on the front of the ultrasound device 10, which can collect user touch operations on or near it, such as clicking a button, dragging a scroll box, etc.

[0071] The display 130 may also be used to display information input by the user or information provided to the user, as well as various ultrasound interfaces of the ultrasound device 10. Specifically, the display 130 may include at least one of a touch screen 131 and a display screen 132 disposed on the front of the ultrasound device 10. The display screen 132 may be configured in the form of a liquid crystal display, a light emitting diode, or the like.

[0072] The touch screen 131 can be covered on the display screen 132, or the touch screen 131 and the display screen 132 can be integrated to realize the input and output functions of the ultrasound device 10. The integrated display screen can be simply called a touch screen display. In this application, the display 130 can display applications and corresponding operation steps.

[0073] The control panel 140 may include human-computer interaction components, such as a keyboard 141, a mouse 142, a scroll wheel 143, a trackball 144, a display 145 with a touch screen, or a combination thereof. Specifically, when a user triggers an operation on the human-computer interaction components on the control panel, a signal input related to user settings and function control of the ultrasound device 10 is generated. Based on the generated signal, the processor 150 displays a hologram in the spatial light modulator. When the hologram is illuminated by a coherent light beam, the light waves impinging on it are diffracted and focused to form an ultrasonic three-dimensional holographic image. The keyboard 141 includes multiple keys, and the user triggers different keys to send the corresponding numerical or character information to the processor 150.

[0074] In order to reproduce the interaction process with the real three-dimensional scene, the user can rotate, translate and zoom the ultrasonic three-dimensional holographic image through the human-computer interaction component installed on the control panel 140 to view and analyze the image from different angles. In some embodiments, the user can also measure the distance between target objects in the ultrasonic three-dimensional holographic image or calculate the volume of any target object through the human-computer interaction component installed on the control panel 140. In some embodiments, the user can also adjust the position, brightness and direction of the virtual light source to change the lighting effect of the ultrasonic three-dimensional holographic image to help the user observe the details more clearly. In some embodiments, the user can also adjust the transparency of the target object so that the structure hidden under the surface of the target object can be displayed. In some embodiments, the user can also adjust the color saturation, contrast and hue of the ultrasonic three-dimensional holographic image as needed to obtain a clearer visual effect.

[0075] The processor 150 is the control center of the ultrasound device 10. It connects the various components of the entire ultrasound device 10 using various interfaces and lines. It executes the various functions of the ultrasound device 10 and processes data by running or executing software programs stored in the memory 120 and accessing data stored in the memory 120. In some embodiments, the processor 150 may include one or more processing units. The processor 150 may also integrate an application processor and a baseband processor, wherein the application processor primarily handles the operating system, ultrasound device interface, and application programs, while the baseband processor primarily handles wireless communications. It is understood that the above-mentioned baseband processor may not be integrated into the processor 150. In this application, the processor 150 can run the operating system, application programs, ultrasound device interface display and touch response, as well as the ultrasonic three-dimensional holographic imaging method described in the embodiments of this application. In addition, the processor 150 is coupled to the display 130.

[0076] It should be noted that in the embodiments of the present application, when transmitting audio data to other electronic devices, wired or wireless transmission can be performed with other devices. This application does not limit the transmission method, the number of devices, or the type of other devices. For example, other electronic devices can be ultrasound equipment, personal computers, mobile phones, tablet computers, notebooks, e-book readers, intelligent voice interaction devices, smart homes, car terminals, and other computer devices with certain computing capabilities and running instant messaging software and websites or social networking software and websites.

[0077] The communication interface 160 is used to exchange information with other electronic devices. The communication interface 160 may include one or more of an Ethernet port 161, a WiFi module 162, a Bluetooth module 163, a 4G module 164, and a USB 165. When different communication interfaces 160 are used, corresponding communication methods are used to exchange information with other electronic devices.

[0078] The power supply 170 is used to power the various components of the ultrasound device 10. The power supply 170 can be logically connected to the processor 150 through a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The ultrasound device 10 can also be configured with a power button for turning the ultrasound device on and off and locking the screen.

[0079] The spatial light modulator 180 is used to receive the hologram of the target object and display the corresponding ultrasonic 3D holographic image of the target object. Specifically, when the hologram is displayed on the spatial light modulator and illuminated by a coherent light beam, the light waves that hit it will be diffracted and focused to form the ultrasonic 3D holographic image.

[0080] Spatial light modulators (SLMs) are core components in liquid crystal microdisplay-based systems for real-time optical information processing, optical interconnection, and optical computing. Controlled by electrical or other signals, SLMs can alter the amplitude, intensity, phase, polarization state, and wavelength of spatial light distribution. SLMs can be categorized as reflective or transmissive based on the readout method; optically addressable (OA-SLMs) and electrically addressable (EA-SLMs) based on the input control signal; and phase, amplitude, and complex amplitude modulation based on the modulation mode.

[0081] Optionally, the ultrasound device 10 may not include a spatial light modulator, and only data transmission exists with the spatial light modulator. For example, the spatial light modulator can be connected to the ultrasound device 10 through the communication interface 160, and the ultrasound device 10 transmits the hologram of the target object to the spatial light modulator through the communication interface 160, so that the spatial light modulator displays the ultrasonic three-dimensional holographic image corresponding to the target object.

[0082] Optionally, the hardware structure of the ultrasound device 10 in the embodiment of the present application may further include a camera. In the embodiment of the present application, the camera is connected to the processor, and the camera can be used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the processor 150 for conversion into a digital image signal.

[0083] In addition, the hardware structure of the ultrasound device 10 in the embodiment of the present application may also include an audio circuit. The audio circuit is used to provide an audio interface between the user and the ultrasound device 10, and the audio circuit can be connected to a speaker and a microphone. The audio circuit can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output. The ultrasound device 10 can also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit and converted into audio data, and then the audio data is output to other electronic devices, or the audio data is output to the memory 120 for further processing. In this application, the microphone can obtain the sound in the environment where the ultrasound device 10 is located.

[0084] Based on the hardware structure diagram of the ultrasound device 10, this application implements, for example, Figure 2 Schematic diagram of the ultrasound equipment shown in FIG. Figure 2As shown, the ultrasound device 10 includes an ultrasound probe 110 , a display 130 , a control panel 140 , an ultrasound host 210 , a support device 220 , and a caster control device 230 .

[0085] Among them, the memory 120, processor 150, communication interface 160, power supply 170 and spatial light modulator 180 in the hardware structure corresponding to the ultrasound device 10 can be set on the ultrasound host 210 or at other locations of the ultrasound device 10. This application does not impose any restrictions on this.

[0086] During implementation, the ultrasound probe 110 can be connected to the ultrasound host 210 via a cable, and the ultrasound image data collected by the ultrasound probe 110 can be transmitted to the ultrasound host 210 via the cable. The ultrasound host 210 receives the ultrasound image data transmitted by the ultrasound probe for storage, processing, and analysis.

[0087] In an embodiment of the present application, the display 130 and the control panel 140 can be connected to a supporting device 220, and the display 130 and the control panel 104 are respectively supported by the supporting device 220. In an embodiment of the present application, the respective posture states of the display 130 and the control panel 140 can be adjusted by adjusting the supporting device 220.

[0088] It should be noted that the respective posture states of the display 130 and the control panel 140 include at least height, tilt angle, etc., and this application does not impose any restrictions on this.

[0089] Optional, Figure 2 The ultrasound device 10 may further include a camera. In the embodiment of the present application, the camera may be placed at any position of the ultrasound device 10, or may be placed within the surrounding area of ​​the ultrasound device 10, so as to facilitate the use of the camera to capture appropriate images.

[0090] During implementation, in the embodiment of the present application, the user can move the ultrasound device 10 by adjusting the caster control device 230 .

[0091] In the embodiment of this application, Figure 3 FIG. 1 is a schematic diagram of the structure of an ultrasound probe according to an embodiment of the present application, wherein the ultrasound probe 110 includes an acoustic lens 1101 , a matching layer 1102 , a piezoelectric crystal 1103 , a backing block 1104 and a housing 1105 .

[0092] It should be noted that for Figure 3 In the ultrasound probe 110 , the embodiment of the present application uses the side of the ultrasound probe that contacts the patient as the front side of the ultrasound probe.

[0093] When an ultrasound probe is used to perform an ultrasound scan on a patient, the acoustic lens 1101 is located between the matching layer 1102 of the ultrasound probe and the patient's tissue. It can be used to converge the ultrasound beam and also serve as a protective layer for the ultrasound probe 110. When the sound velocity of the lens material corresponding to the acoustic lens 1101 is greater than the sound velocity of the surrounding medium, the ultrasound beam converges.

[0094] Matching layer 1102 is one or more layers of acoustic material located in front of the piezoelectric crystal. It is used to achieve impedance matching between the high-acoustic-impedance piezoelectric transducer and the low-acoustic-impedance human tissue, thereby maximizing the transmission efficiency of acoustic energy. For example, in this embodiment of the present application, matching layer 1102 can be configured to have a thickness of one-quarter wavelength.

[0095] The piezoelectric chip 1103 is used to convert electrical signals into ultrasonic signals, and to convert received ultrasonic echoes into electrical signals.

[0096] It should be noted that applying mechanical pressure or vibration to the piezoelectric chip 1103 generates an electric charge on its surface. This phenomenon of converting mechanical energy into electrical energy is called the direct piezoelectric effect. Applying an alternating electric field to the piezoelectric chip 1103 causes the chip to deform and generate corresponding mechanical vibrations. This phenomenon of converting electrical energy into mechanical energy is called the inverse piezoelectric effect. The embodiments of the present application generate ultrasonic waves using the inverse piezoelectric effect and receive echoes using the direct piezoelectric effect.

[0097] The backing block 1104 is a sound-absorbing material filled on the back side of the piezoelectric crystal 1103, which is used to absorb backward ultrasound and play a damping role, generating short ultrasonic pulses and improving longitudinal resolution.

[0098] Based on Figure 3 The ultrasonic probe shown in the figure performs ultrasonic scanning. In the embodiment of the present application, the front side of the ultrasonic probe is placed on the surface of the patient's body or into the body of the patient, and ultrasonic image data of the human body is collected by emitting ultrasonic waves to the patient's body tissue through the ultrasonic probe. As the ultrasonic probe moves, the ultrasonic image data within the ultrasonic range sent by the ultrasonic probe is sent to the ultrasonic host for processing. Based on the processed ultrasonic image data, the corresponding ultrasonic image is displayed on the display, which is convenient for the user to obtain the status of the lesion in the patient's body and the environment around the lesion. Figure 4 As shown, taking the ultrasound probe placed on the patient's body surface as an example, this is a schematic diagram of an application scenario of an ultrasound device in an embodiment of the present application.

[0099] Many different embodiments or examples are provided above to implement different structures of the present application. In order to simplify the content of the embodiments of the present application, only the components and settings of specific examples are described above. Of course, they are merely examples and are not intended to limit the present application.

[0100] The rapid development of digital holographic technology has brought a more realistic three-dimensional visual presentation to the clinical application of ultrasound imaging. Ultrasound 3D holographic visualization technology is more advanced than traditional 3D image reconstruction and can display more realistic tissue and organ information.

[0101] Related technologies require three-dimensional reconstruction of the target object's ultrasonic signals, acquired by ultrasound equipment, to produce a three-dimensional model representing the target object's three-dimensional structure. A hologram is then calculated based on the reconstructed three-dimensional model, and a spatial light modulator is used to display the corresponding ultrasonic three-dimensional holographic image.

[0102] However, the realism of ultrasound 3D holographic images generated by traditional holographic calculation methods needs to be improved. Furthermore, traditional ultrasound 3D holographic imaging methods suffer from low ultrasound holographic image resolution and high computational complexity, which cannot meet the real-time requirements of clinical applications.

[0103] Based on this, the present invention provides an ultrasonic three-dimensional holographic imaging method, which can be applied to Figure 1 In the processor of the ultrasound device shown, Figure 5 As shown, the method may include the following steps:

[0104] Step S501 : Perform three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model.

[0105] In an alternative embodiment, the Figure 6 The method shown performs three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model. The method may include the following steps:

[0106] Step S601 : Perform three-dimensional reconstruction on the ultrasonic signal of the target object to obtain three-dimensional data.

[0107] The target object can be a specific part or organ that doctors or researchers need to observe and analyze in detail. For example, the target object can be a tumor, blood vessel, heart, brain structure, etc.

[0108] The three-dimensional data is medical digital image data, wherein the three-dimensional data can be obtained by performing CT scanning on the target object or by performing MRI scanning on the target object. This application does not limit the method of obtaining the three-dimensional data.

[0109] In an optional embodiment, to reduce the computational effort required for subsequent ultrasonic 3D holographic imaging, image information of a 2D slice of the current target object can be pre-acquired. The position and size of the region of interest (ROI) can then be set based on the image information of the 2D slice. Based on the position and size of the ROI, the position of the target object corresponding to the ROI can then be scanned using an ultrasonic probe, and 3D data of the ROI position can be received.

[0110] Step S602 : determining the components of the three-dimensional data mapped to the X-axis direction, the Y-axis direction, and the Z-axis direction of the coordinate system respectively, and obtaining three one-dimensional components.

[0111] The reconstructed 3D data can represent the 3D structure of the target object. However, due to the introduction of electronic noise, acoustic artifacts from the transducer, and other interfering signals, the 3D data requires post-processing. Commonly used algorithms for processing 2D data include Gaussian smoothing, bilateral filtering, anisotropic filtering, and adaptive median filtering. However, when extended to 3D data processing, the computational time is extremely high, making it difficult for ultrasonic 3D holographic imaging to meet real-time requirements.

[0112] Therefore, after obtaining the three-dimensional data of the target object, the three-dimensional data of the target object can be mapped to Figure 7 The components in the X-axis direction, Y-axis direction and Z-axis direction of the coordinate system shown are used to obtain the one-dimensional component in the X-axis direction, the one-dimensional component in the Y-axis direction and the one-dimensional component in the Z-axis direction of the three-dimensional data of the target object respectively.

[0113] Step S603 : performing noise suppression processing on each of the three one-dimensional components.

[0114] In an optional implementation, after obtaining the three one-dimensional components, a suitable noise suppression processing algorithm may be selected to perform noise suppression processing on each one-dimensional component respectively.

[0115] By mapping three-dimensional data into three one-dimensional components and performing noise suppression processing on each component, the noise suppression efficiency of the three-dimensional data can be improved, so that ultrasonic three-dimensional holographic imaging can meet real-time requirements.

[0116] In another optional implementation, in order to improve the real-time performance of ultrasonic three-dimensional holographic imaging, three-dimensional texture filtering may be used to perform filtering processing on the three-dimensional data of the target object.

[0117] In another optional implementation, in order to improve the real-time performance of ultrasonic three-dimensional holographic imaging, the three-dimensional data of the target object may be filtered in a block-by-block parallel manner.

[0118] In some embodiments, in order to further improve the noise suppression efficiency of three-dimensional data, a GPU may be called to perform noise suppression processing on each of the three one-dimensional components.

[0119] Step S604: obtaining a three-dimensional model based on the three one-dimensional components that have undergone noise suppression processing.

[0120] After noise suppression processing, these three one-dimensional components can be combined into a three-dimensional model.

[0121] Specifically, a grid structure may be created first, and then the data values ​​corresponding to the three one-dimensional components after noise suppression processing are determined in the grid structure. Next, based on the data values ​​corresponding to the three one-dimensional components in the grid structure, the grid points are connected to form a three-dimensional model.

[0122] Figure 8 A flowchart of another method for performing three-dimensional reconstruction of an ultrasonic signal of a target object to obtain a three-dimensional model is provided in an embodiment of the present application. Figure 8 As shown, the step S603 of suppressing noise of each one-dimensional component of the three one-dimensional components shown in the dotted box can be processed by calling the graphics processing unit GPU.

[0123] Specifically, the data of each of the three one-dimensional components can be loaded into the GPU memory, thereby achieving a quick read effect. Then, the three one-dimensional components are subjected to noise suppression processing by utilizing the acceleration capability of parallel computing of the GPU.

[0124] Using the acceleration capability of GPU parallel computing to perform noise suppression on the three one-dimensional components makes it easier to combine with computer graphics rendering technology, which is beneficial to improving the computational efficiency of the entire ultrasonic three-dimensional holographic imaging process, thereby further improving the real-time performance of ultrasonic three-dimensional holographic imaging.

[0125] In step S502, for each sampling point on the holographic surface of the preset light transmission model, the following operations are performed: light rays emitted from the sampling point to the three-dimensional model are simulated, and the intersection of the light rays with the three-dimensional model is determined, and the light intensities of multiple sub-sampling points in the intersecting rays are determined; and the grayscale value of the sampling point is determined based on the light intensities of the multiple sub-sampling points in the intersecting rays.

[0126] The multiple sub-sampling points are intersection points of the intersecting light and the three-dimensional model, and the light intensity of each sub-sampling point is the light intensity at the corresponding sub-sampling point under the action of the intersecting light on the scattering surface of the three-dimensional model.

[0127] When light interacts with an object, it produces various optical effects. Generally, these effects include absorption only, emission only, absorption and emission, scattering, shading / shadowing, and multiple scattering. Furthermore, due to the wave-particle duality of light, light transmission is affected not only by geometric optics (reflection and refraction) but also by other models (diffraction and deflection). Therefore, choosing an appropriate light transmission model is crucial when simulating the optical effects produced by the interaction of light with a 3D model corresponding to the target object.

[0128] The light transmission model selected in this application is the multiple scattering model. The target objects scanned by the ultrasound equipment are usually human tissues and organs. Due to the high optical depth of human skin and the transmission phenomenon caused by its translucent properties, the subsurface multiple scattering model can be used to simulate the optical effects produced when the light emitted from the sampling point interacts with the three-dimensional model.

[0129] Furthermore, after setting the light transport model, the sampling points in the multiple scattering model will emit light toward the three-dimensional model of the target object, such as Figure 9 As shown, the point where the light hits the three-dimensional model is the intersection point. Each intersection point in the three-dimensional model will produce optical effects such as absorption, refraction, reflection, and scattering. In order to reduce the amount of calculation for generating the hologram, random sampling can be performed at each intersection point, and some intersection points can be used as sub-sampling points.

[0130] Furthermore, the grayscale value of each sampling point can be determined according to the light intensity of each sub-sampling point in the three-dimensional model.

[0131] In some embodiments, for each sampling point on the holographic surface, the grayscale value of the sampling point can be determined according to the light intensity of each sub-sampling point after absorption, reflection, refraction and scattering by each scattering surface of the three-dimensional model of the target object.

[0132] In other embodiments, due to the high resolution of the 3D model in ultrasonic 3D holographic imaging, to further improve the real-time performance of ultrasonic 3D holographic imaging, when determining the grayscale value of each sampling point, the 3D model can be downsampled according to multiple predetermined resolutions. This results in multiple reference models, each of which includes at least one scattering surface. Next, for each sampling point on the holographic surface, the following operations can be performed: based on the light intensity at each sub-sampling point after absorption, reflection, refraction, and scattering by each scattering surface of each reference model, the grayscale value to be fused corresponding to each reference model is determined. Finally, the color values ​​to be fused corresponding to each reference model are fused to obtain the grayscale value of the sampling point.

[0133] Step S503 : determining the morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays.

[0134] After determining the grayscale values ​​of each sampling point on the holographic surface, the distribution of the complex amplitudes at these sampling points can be determined based on the grayscale values ​​of each sampling point and the distances between each sampling point and the corresponding sub-sampling points in the intersecting light rays. Based on the Fresnel diffraction principle, the distribution of the complex amplitudes at these sampling points can be calculated by superimposing the complex amplitudes of all light rays reaching the holographic surface.

[0135] The total distribution of complex amplitude of the holographic surface can be expressed by formula (1):

[0136]

[0137] Among them, (x, y) represents the coordinates of a sampling point on the holographic surface, I j (x,y) represents the calculated grayscale value of the sampling point, d j It represents the distance between the sampling point and the jth sub-sampling point of the target object, N represents the number of sub-sampling points, and k represents the wave number of free space.

[0138] After the distribution information of the complex amplitudes of the multiple sampling points is obtained, the morphological information of the three-dimensional model can be determined according to the distribution information of the complex amplitudes of the multiple sampling points.

[0139] Specifically, the shadow intensity of the three-dimensional model may be determined first according to the attribute parameters of the virtual light source.

[0140] The shadow intensity is used to represent the degree to which the three-dimensional model blocks the light emitted by the virtual light source to the three-dimensional model. Figure 10 As shown, when the virtual light source emits light to the three-dimensional model, the area blocked by the three-dimensional model is the shadow area. According to the position of the virtual light source and the holographic surface, the shadow intensity of the shadow area of ​​the three-dimensional model of the target object can be determined.

[0141] Furthermore, the shadow intensity of the three-dimensional model and the distribution information of the complex amplitudes of multiple sampling points may be fused to obtain the morphological information of the three-dimensional model.

[0142] However, due to the large amount of 3D data, calculating the shadow intensity of each particle under the light source is computationally intensive. To improve real-time performance, when determining the shadow intensity of a 3D model, the 3D model can be projected to generate multiple 2D images parallel to the holographic surface. The shadow intensity corresponding to each 2D image is then determined based on the attribute parameters of the virtual light source. The shadow intensities corresponding to each 2D image are then integrated to obtain the shadow intensity of the 3D model.

[0143] It should be noted that in order to improve the authenticity of ultrasound 3D holographic imaging, users can adjust the position, brightness and direction of the virtual light source to change the lighting effect of the ultrasound 3D holographic image. For example, users can adjust the virtual light source from Figure 10 Position A shown moves to Figure 11 Position B shown.

[0144] In some embodiments, in order to improve the authenticity of ultrasonic three-dimensional holographic imaging, the user can also set multiple virtual light sources, for example, Figure 12 As shown, two virtual light sources may be set, or more virtual light sources may be set.

[0145] Step S504: Holographically encode the morphological information of the three-dimensional model to obtain a hologram of the target object.

[0146] Specifically, the morphological information of the three-dimensional model, ie, the distribution of the complex amplitude of the hologram, can be converted into a hologram corresponding to the target object through the two-dimensional transmittance function distribution.

[0147] Step S505 : Displaying the ultrasonic three-dimensional holographic image corresponding to the hologram.

[0148] After the hologram of the target object is obtained, the hologram of the target object can be transmitted to a spatial light modulator, and the spatial light modulator displays an ultrasonic three-dimensional holographic image of the target object.

[0149] A spatial light modulator is a convenient carrier for recording holograms. Under the control of an electrical drive signal or other signal, it can change the amplitude or intensity, phase, polarization state, etc. of the spatial light distribution, or convert incoherent light into coherent light, thereby modulating the spatial distribution of light waves.

[0150] Furthermore, a spatial light modulator is used to effectively modulate the light field distribution of the obtained hologram of the target object, and thus a three-dimensional holographic effect of the target object can be observed.

[0151] An embodiment of the present application further provides a computer storage medium, in which computer executable instructions are stored. The computer executable instructions are used to implement the ultrasonic three-dimensional holographic imaging method described in any embodiment of the present application.

[0152] In the description of this application, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood broadly. For example, they can refer to fixed connections, removable connections, or integral connections. They can refer to mechanical connections or electrical connections. They can refer to direct connections or indirect connections through an intermediary. They can refer to internal communication between two components or interactions between two components. Those skilled in the art will understand the specific meanings of these terms in the present invention based on specific circumstances.

[0153] In addition, in the description of this application, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this application, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any appropriate manner in any one or more embodiments or examples.

[0154] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0155] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0156] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0157] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0158] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. An ultrasonic device, characterized in that The ultrasound device includes a processor and a spatial light modulator, wherein the processor is configured to: Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model; the three-dimensional model is used to characterize the three-dimensional structure of the target object; the three-dimensional model includes at least one scattering surface; For each sampling point on a holographic surface of a preset light transmission model, the following operations are performed: simulating light emitted from the sampling point toward the three-dimensional model and determining the intersection of the light and the three-dimensional model; determining the light intensities of multiple sub-sampling points in the intersecting light; the multiple sub-sampling points are the intersection points of the intersecting light and the three-dimensional model; the light intensity of each sub-sampling point is the light intensity of the intersecting light at the corresponding sub-sampling point under the influence of the scattering surface of the three-dimensional model; and determining the grayscale value of the sampling point based on the light intensities of the multiple sub-sampling points in the intersecting light. determining morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays; Holographically encoding the morphological information of the three-dimensional model to obtain a hologram of the target object, and transmitting the hologram to the spatial light modulator; The spatial light modulator is configured to display an ultrasonic three-dimensional holographic image corresponding to the hologram.

2. The ultrasonic device according to claim 1, wherein The processor is specifically configured to: Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain three-dimensional data; Determine the components of the three-dimensional data mapped to the X-axis direction, the Y-axis direction, and the Z-axis direction of the coordinate system to obtain three one-dimensional components; performing noise suppression processing on each of the three one-dimensional components respectively; The three-dimensional model is obtained based on the three one-dimensional components subjected to noise suppression processing.

3. The ultrasonic device according to claim 2, wherein The processor is specifically configured to: The GPU is called to perform noise suppression processing on each of the three one-dimensional components.

4. The ultrasonic device according to claim 1, wherein The processor is specifically configured to: Determining distribution information of complex amplitudes of the plurality of sampling points according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays; The morphological information of the three-dimensional model is determined according to the distribution information of the complex amplitudes of the plurality of sampling points.

5. The ultrasonic device according to claim 4, characterized in that The processor is specifically configured to: determining a shadow intensity of the three-dimensional model based on attribute parameters of the virtual light source of the light transmission model; the shadow intensity is used to represent the degree to which the three-dimensional model blocks light emitted by the virtual light source toward the three-dimensional model; The shadow intensity and the distribution information of the complex amplitudes of the plurality of sampling points are fused to obtain morphological information of the three-dimensional model.

6. The ultrasonic device according to claim 5, characterized in that The processor is specifically configured to: Projecting the three-dimensional model to generate a plurality of two-dimensional images parallel to the holographic surface; Determining the shadow intensity corresponding to each two-dimensional image according to the attribute parameters of the virtual light source; The shadow intensity corresponding to each of the two-dimensional images is integrated to obtain the shadow intensity of the three-dimensional model.

7. An ultrasonic three-dimensional holographic imaging method, characterized in that: The method comprises: Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain a three-dimensional model; the three-dimensional model is used to characterize the three-dimensional structure of the target object; the three-dimensional model includes at least one scattering surface; For each sampling point on a holographic surface of a preset light transmission model, the following operations are performed: simulating light emitted from the sampling point toward the three-dimensional model and determining the intersection of the light and the three-dimensional model; determining the light intensities of multiple sub-sampling points in the intersecting light; the multiple sub-sampling points are the intersection points of the intersecting light and the three-dimensional model; the light intensity of each sub-sampling point is the light intensity of the intersecting light at the corresponding sub-sampling point under the influence of the scattering surface of the three-dimensional model; and determining the grayscale value of the sampling point based on the light intensities of the multiple sub-sampling points in the intersecting light. determining morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays; Holographically encoding the morphological information of the three-dimensional model to obtain a hologram of the target object; An ultrasonic three-dimensional holographic image corresponding to the hologram is displayed.

8. The method according to claim 7, characterized in that The three-dimensional reconstruction of the ultrasonic signal of the target object to obtain a three-dimensional model includes: Performing three-dimensional reconstruction on the ultrasonic signal of the target object to obtain three-dimensional data; Determine the components of the three-dimensional data mapped to the X-axis direction, the Y-axis direction, and the Z-axis direction of the coordinate system to obtain three one-dimensional components; performing noise suppression processing on each of the three one-dimensional components respectively; The three-dimensional model is obtained based on the three one-dimensional components subjected to noise suppression processing.

9. The method according to claim 8, characterized in that The performing noise suppression processing on each of the three one-dimensional components respectively includes: The GPU is called to perform noise suppression processing on each of the three one-dimensional components.

10. The method according to claim 7, characterized in that Determining the morphological information of the three-dimensional model according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays includes: Determining distribution information of complex amplitudes of the plurality of sampling points according to the grayscale value of each sampling point on the holographic surface and the distance between each sampling point and a plurality of sub-sampling points in the corresponding intersecting light rays; The morphological information of the three-dimensional model is determined according to the distribution information of the complex amplitudes of the plurality of sampling points.

Images