Image processing method, device, and computer equipment
By acquiring texture and height parameters to generate a 3D enhanced image and fusing it with a B-image, the problem of traditional color ultrasound blood flow imaging being unable to display multi-dimensional information is solved. This enables the synchronous display and flexible configuration of multi-dimensional information, meeting the clinical observation needs of users.
Patent Information
- Application Number
- CN202211181387.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-27
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2042-09-27
AI Technical Summary
Traditional color Doppler ultrasound flow imaging can only display one type of information: blood flow velocity distribution. This cannot meet users' needs for viewing multi-dimensional information, and the switching between different information cannot be displayed synchronously.
By acquiring texture and height parameters, a 3D enhanced image of the region of interest is generated. Combined with B-image fusion, at least two types of physiological information are displayed. Users can flexibly configure the display mode to achieve synchronous display of multi-dimensional information.
It enables the simultaneous display of multi-dimensional information such as blood flow velocity and variance, meeting users' clinical observation needs and improving the flexibility and three-dimensional effect of image display.
Smart Images

Figure CN115530876B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of medical imaging technology, and in particular to an image processing method, apparatus, computer device, and computer-readable storage medium. Background Technology
[0002] Color flow mapping (CFM) maps the detected blood flow velocity to color codes and then overlays the color-coded images onto B-mode images, providing a more intuitive reflection of the spatial distribution and dynamic changes of blood flow.
[0003] However, traditional color Doppler ultrasound blood flow imaging only displays one type of velocity distribution, which does not match the user's need for multi-dimensional information. Summary of the Invention
[0004] Therefore, it is necessary to provide an image processing method, apparatus, computer device, and computer-readable storage medium that can provide users with multi-dimensional data display in response to the above-mentioned technical problems.
[0005] In a first aspect, this application provides an image processing method, the method comprising:
[0006] Get the texture and height parameters;
[0007] Based on the scanned images, texture parameters, and height parameters generated by medical imaging equipment, a three-dimensional enhanced image of the region of interest is obtained; the three-dimensional enhanced image displays at least two types of physiological information about the region of interest.
[0008] The imaging results are displayed, including 3D enhanced images.
[0009] In one embodiment, prior to the step of displaying the imaging results, the following is included:
[0010] The imaging result is obtained by fusing the 3D enhanced image and the B image; the B image is an image including the region of interest generated based on the scan data in the B imaging mode.
[0011] In one embodiment, obtaining texture parameters and height parameters includes:
[0012] In response to configuration operations on texture configuration parameters and height configuration parameters, obtain the texture parameters and height parameters.
[0013] In one embodiment, the texture configuration parameters include a first physical quantity; the height configuration parameters include a second physical quantity;
[0014] In response to configuration operations on texture and height configuration parameters, obtain the texture and height parameters, including:
[0015] In response to configuration operations for a first physical quantity and a second physical quantity, obtain the first target physical quantity and the second target physical quantity;
[0016] The first target physical quantity and the second target physical quantity are different.
[0017] In one embodiment, the texture configuration parameters further include: a first display attribute; the first display attribute includes: color and / or brightness.
[0018] In one embodiment, the height configuration parameter further includes: a second display attribute; the second display attribute includes: reflected light intensity.
[0019] In one embodiment, the image processing method further includes:
[0020] In response to a triggering operation on the configuration adjustment controls on the imaging results display interface, a configuration interface is displayed, which shows texture configuration parameters and height configuration parameters.
[0021] In one embodiment, the image processing method further includes:
[0022] In response to the startup operation of the imaging device, a configuration interface is displayed, which shows the texture configuration parameters and height configuration parameters.
[0023] In one embodiment, the image processing method further includes:
[0024] In response to a configuration operation for display effect configuration parameters, determine the display effect parameters; the display effect parameters include material parameters and / or lighting parameters;
[0025] Based on the scanned images, texture parameters, and height parameters generated by medical imaging equipment, a 3D enhanced image of the region of interest is obtained, including:
[0026] Based on the display effect parameters, scanned image, texture parameters, and height parameters, a 3D enhanced image of the region of interest is obtained.
[0027] Secondly, an image processing apparatus is provided, the apparatus comprising:
[0028] The parameter acquisition module is used to obtain the fixed texture parameters and height parameters;
[0029] The image enhancement module is used to obtain a three-dimensional enhanced image of the region of interest based on the scanned image, texture parameters, and height parameters generated by medical imaging equipment; the three-dimensional enhanced image displays at least two kinds of physiological information about the region of interest.
[0030] The imaging results display module is used to display the imaging results, including 3D enhanced images.
[0031] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the above-described image processing method.
[0032] The above-mentioned image processing method, apparatus, computer equipment, and computer-readable storage medium have at least the following beneficial effects:
[0033] By acquiring texture and height parameters, and based on the scanned image generated by the medical imaging equipment, a three-dimensional enhanced image of the region of interest (ROI) is obtained. The enhanced 3D image displays at least two types of physiological information about the ROI, showcasing the imaging results, which include the enhanced 3D image. Users can switch the combination of physical quantities to be observed in real time as needed, making the display of medical imaging results more flexible and better meeting users' clinical observation needs. Attached Figure Description
[0034] Figure 1 This is an application environment diagram of an image processing method in one embodiment;
[0035] Figure 2 This is a flowchart illustrating an image processing method in one embodiment;
[0036] Figures 3.1-3.3 This is a schematic diagram of the configuration interface for the image processing method in one or more embodiments;
[0037] Figure 4 This is a schematic diagram of a 3D enhanced image in one embodiment;
[0038] Figure 5 This is a flowchart illustrating the image processing method in another embodiment;
[0039] Figure 6 This is a schematic diagram of the imaging result display interface in one embodiment;
[0040] Figure 7 This is a structural block diagram of an image processing device in one embodiment;
[0041] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0042] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0043] Traditional ultrasound imaging devices mostly use red-blue coding to display blood flow velocity, resulting in a two-dimensional image that can only display one type of velocity distribution. To display information such as energy and variance, ultrasound imaging devices are also equipped with energy and variance modes. However, during implementation, the applicant discovered that each mode can only display one type of information. Users who want to compare different information changes, such as velocity and energy distributions, must constantly switch modes. Even with rapid mode switching, the images seen are not simultaneous and cannot synchronously display multi-dimensional information such as velocity and energy.
[0044] The image processing method provided in this application embodiment can be applied to, for example... Figure 1 In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the data that server 104 needs to process. The data storage system can be integrated onto server 104 or placed in the cloud or on another network server. Terminal 102 acquires scan images generated by medical imaging equipment based on scan data and displays a configuration interface. Users can configure the display method and physical quantities they want to observe on this interface. Terminal 102 responds to configuration operations for texture and height parameters on the configuration interface, determining the texture and height parameters. Then, based on the scan images generated by the medical imaging equipment, the texture parameters, and the height parameters, the background obtains a three-dimensional enhanced image of the region of interest. This three-dimensional enhanced image can display at least two types of physiological information about the region of interest, such as blood flow velocity and blood flow variance. The imaging results, including this three-dimensional enhanced image, are displayed, providing users with a multi-dimensional display of physiological information.
[0045] The terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, medical imaging equipment, etc., and the server 104 can be implemented by a standalone server or a server cluster composed of multiple servers.
[0046] In one embodiment, such as Figure 2 As shown, an image processing method is provided, which is applied to... Figure 1 Taking terminal 104 as an example, the explanation includes the following steps:
[0047] S202, Obtain texture and height parameters. Texture and height parameters are guiding data for 3D enhancement of scanned images generated by medical imaging equipment. They determine the display method of the 3D enhanced image and the dimensions of the displayed physiological information. Texture and height parameters can be flexibly configured by the user to match their observation needs for medical images. Alternatively, default data can be provided, which can be pre-configured based on statistical data, selecting the texture and height parameters with the highest user frequency, thus reducing the frequency and workload of data configuration when using medical imaging equipment.
[0048] In one embodiment, step S202 includes:
[0049] In response to configuration operations on texture configuration parameters and height configuration parameters, obtain the texture parameters and height parameters.
[0050] The texture configuration parameters determine the two-dimensional image display of at least one dimension of physiological information, using textures such as color and brightness, when imaging the region of interest. The height configuration parameters determine the additional dimension of physiological information added to the two-dimensional information display of the scanned image based on the texture configuration parameters, and the format in which this information is displayed. Both texture and height configuration parameters can be displayed on the monitor screen or in the configuration interface for user selection and configuration. Configuration can be performed by the user interacting with virtual controls on the interface, for example... Figures 3.1-3.3 As shown, texture and height configuration parameters are selected via input devices such as a mouse, keyboard, or touchscreen on the configuration interface, or configured via hardware such as knobs or buttons on terminal 102. For example, the knob is engraved with scales showing blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, and tissue peak time. The user can rotate the knob, and the scale value aligned with the knob pointer represents the configured texture configuration parameter. The button implementation can switch between texture and height parameters with each press. The button can also work in conjunction with the display screen; when a button is pressed, the texture or height parameter displayed on the screen changes. Texture and height configuration parameters can each correspond to a separate button for individual user operation, improving operational efficiency.
[0051] S204. Based on the scanned image, texture parameters, and height parameters generated by the medical imaging equipment, a three-dimensional enhanced image of the region of interest is obtained; the three-dimensional enhanced image displays at least two types of physiological information about the region of interest. The scanned image refers to the image generated by the medical imaging equipment based on scan data; it can be a two-dimensional image, such as a B-image, or a three-dimensional image. When the scanned image is two-dimensional, a height surface can be added by defining a height parameter. In addition to displaying some dimensions of physiological information in the two-dimensional image, other dimensions of physiological information can be displayed on the height surface, increasing the diversity of physiological information presented to the user.
[0052] The process of generating a 3D enhanced image involves first drawing a height surface based on height parameters to establish a 3D space. Then, within this 3D space, based on the scanned image and texture parameters, the texture pattern mapped onto the height surface is determined, thus generating the 3D enhanced image. Physiological information refers to information that reflects the health status of the region of interest (ROI) of the examined object. For example, physiological information may include data reflecting blood flow movement and distribution, such as blood flow velocity and acceleration, as well as other dimensions of physiological data, such as Doppler energy. The selection of physiological data can be based on the user's choice of the first and second physical quantities to be displayed. The region of interest (ROI) refers to the area that the user intends to emphasize during scanning. For example, if the user wants to observe blood flow at the heart location, the ROI would be the location of the heart's blood vessels. It should be noted that the ROI can be part or all of the scanned image; the user can set the ROI according to their actual observation needs. There are various ways to set the ROI. For example, in ultrasound imaging, a ROI can be set on the ultrasound imaging device, with the area within the ROI being the region of interest and the area outside the ROI being the non-ROI. Optionally, the ROI can be set in the color Doppler imaging mode of the ultrasound imaging device.
[0053] S206, Displaying the imaging results, including a 3D enhanced image. By displaying the imaging results including this 3D enhanced image, users are provided with more dimensional physiological information, and can configure texture and height parameters to meet their observation needs for different dimensions of physiological information in different scenarios. For example, as... Figure 4 As shown, the user configures the height parameter as Doppler energy and the texture parameter as grayscale display representing blood flow velocity. Lower grayscale values indicate slower blood flow velocity, while higher grayscale values indicate faster blood flow velocity. Based on the scan data corresponding to the scanned image, a height surface is formed along the Z-axis. Then, the blood flow velocity at any point on the XY plane is determined based on the scan data, and the corresponding grayscale value is determined. Finally, the grayscale value is mapped onto this height surface to obtain the result. Figure 4 The image shown is a 3D enhanced image of the region of interest. To facilitate the fusion and display of this 3D enhanced image on 2D images such as B-images, the height value along the Z-axis can be displayed as the intensity of reflected light at various points on the height surface.
[0054] In one embodiment, prior to step S202, the method further includes:
[0055] The configuration interface can be displayed in several ways, including when the user starts the medical imaging device, or by triggering controls on the imaging results display interface. It can also be triggered via voice commands. The configuration interface can be a single screen on the monitor or multiple screens.
[0056] In one embodiment, before step S208 of displaying the imaging results, such as Figure 5 As shown, it also includes:
[0057] The S502 imager fuses 3D enhanced images and B-images to obtain the final imaging result. The B-image is an image including the region of interest, generated based on scan data from B-mode imaging. B-mode imaging (Brightness-mode Ultrasound) uses an ultrasound probe to emit ultrasound waves to an object, recording the echoes of the object's internal structure. These echoes are then processed to form a grayscale image, reflecting the object's internal structure. Therefore, B-images can clearly display various cross-sectional images of organs and surrounding structures, providing users with tissue structure information. By fusing 3D enhanced images and B-images, the tissue structure of the examined area can be observed simultaneously, as well as 3D enhanced images of regions of interest such as blood vessels, to understand physical quantities such as blood flow velocity, acceleration, blood flow variance, and Doppler energy.
[0058] One approach is to fuse 3D enhanced images and B-images. This can be achieved by extracting features from both the 3D enhanced image and the B-image, and then matching the feature points of both images. For example, a coordinate system can be defined for the area being examined. The scan data is determined based on this coordinate system. During the generation of 3D enhanced images and B-images from the scan data, the coordinates of each point in both images can be obtained. Based on coordinate point matching, the fusion of the 3D enhanced images and B-images can be achieved.
[0059] In one embodiment, Figure 3.2As shown, the texture configuration parameters include a first physical quantity. In one embodiment, the texture configuration parameters may further include a first display attribute. The first physical quantity refers to at least one dimension of physiological information of interest to the user, which may be a parameter characterizing blood flow or tissue movement, or other types of parameters. Understandably, when the first physical quantity is displayed on the interface, multiple options of at least one physical quantity may be selected, and the selected first physical quantity is the first target physical quantity. For applications such as ultrasound imaging, the first physical quantity may include at least one of the following: blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, or tissue peak time. For example, it may include blood flow direction, and may also include blood flow velocity or blood flow acceleration. Of course, it may also include only one dimension of physical quantity, tissue displacement. The first display attribute may include color and / or brightness. The first display attribute refers to the display parameters of the selected first physical quantity (i.e., the first target physical quantity). For example, when configuring the first target physical quantity as blood flow direction and blood flow velocity, the first display attribute corresponding to the blood flow direction can be configured as color, with red representing flow towards the probe and blue representing flow away from the probe (such as an ultrasound probe). The first display attribute corresponding to the blood flow velocity is brightness; the faster the blood flow velocity, the brighter the red and blue colors, and vice versa.
[0060] In one embodiment, the height configuration parameter includes a second physical quantity. In another embodiment, the height configuration parameter may also include a second display attribute. The second physical quantity refers to physiological information of at least one dimension that the user is concerned with. The understanding of the second physical quantity can refer to the first physical quantity. When displayed on the interface, the first physical quantity may include at least one selectable physical quantity option, and the selected second physical quantity is the second target physical quantity. The second physical quantity may include at least one of the following: blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, or tissue peak time. The second display attribute may include: reflected light intensity. The second display attribute determines the display presentation method of the selected second physical quantity (i.e., the second target physical quantity) and the meaning represented by the presentation result. For example, when the second physical quantity is selected as Doppler energy, the second display attribute corresponding to the Doppler energy can be configured as reflected light intensity. Due to the lighting effect, the light projected onto the screen... Figure 4When viewed on the height plane, the intensity of reflected light varies at different locations. Looking down along the Z-axis, Doppler energy can also be displayed through the intensity of reflected light. That is, when the 3D enhanced image is projected onto the XY plane along the Z-axis, the displayed image still retains a stereoscopic effect because it can display other dimensions of physiological information, such as Doppler energy, through differences in reflected light intensity. It also facilitates overlay display with 2D images such as B-images, and the stereoscopic effect is still maintained after overlay. The first and second target physical quantities are different; based on this constraint, more dimensions of physiological information can be displayed.
[0061] In one embodiment, the first target physical quantity and the second target physical quantity are different, which can be implemented in the configuration operation response stage.
[0062] In one embodiment, the step of obtaining a first target physical quantity and a second target physical quantity in response to a configuration operation for a first physical quantity and a configuration operation for a second physical quantity includes:
[0063] In response to a configuration operation for a first physical quantity, obtain the first target physical quantity;
[0064] If the second physical quantity includes the first target physical quantity, then configure the first target physical quantity in the second physical quantity to be in an inoperable state;
[0065] In response to a configuration operation for a second physical quantity in an operable state, the second target physical quantity is acquired.
[0066] In one embodiment, the step of obtaining a first target physical quantity and a second target physical quantity in response to a configuration operation for a first physical quantity and a configuration operation for a second physical quantity includes:
[0067] In response to the configuration operation for the second physical quantity, the second target physical quantity is obtained;
[0068] If the first physical quantity includes the second target physical quantity, then configure the second target physical quantity in the first physical quantity as an inoperable state;
[0069] In response to a configuration operation for a first physical quantity in an operable state, the first target physical quantity is acquired.
[0070] Users can flexibly choose whether to configure the first or second physical quantity first.
[0071] To better assist those skilled in the art in understanding the implementation process of the methods in the embodiments of this application, a three-dimensional enhanced image of the region of interest is used as an example of a blood flow image for illustration:
[0072] In some embodiments, texture parameters can be configured based on red-blue color Doppler imaging, and then Doppler energy can be configured as a second target physical quantity for displaying the blood flow image. The magnitude of the second target physical quantity can be characterized by the intensity of reflected light on the height surface. In this way, users can not only distinguish the direction and magnitude of blood flow velocity by blood flow color and brightness, but also distinguish the energy magnitude of blood flow by reflected light intensity.
[0073] In some embodiments, blood flow variance can also be used as a height parameter for displaying blood flow images. The magnitude of variance indicates the degree of blood flow disorder and can be used to identify complex blood flows such as eddies. A higher variance value indicates more disordered blood flow and more drastic velocity changes in that area. By using variance values as height information for displaying blood flow images, 3D enhanced images become more intuitive and easier for doctors to simultaneously observe real-time changes in blood flow velocity and variance.
[0074] In some embodiments, blood flow acceleration can also be used as a height parameter for displaying the blood flow image. Blood flow acceleration refers to the difference between the flow velocity in the previous frame and the flow velocity in the next frame, divided by the time interval between the two frames. For example, in tissues and organs with rapid changes in blood flow, such as the heart, blood flow acceleration can reflect the heart's pumping capacity. Based on this configuration, and with texture parameters configured based on red-blue color Doppler imaging, the resulting three-dimensional enhanced image can simultaneously display blood flow velocity and acceleration, allowing users to observe both the blood flow velocity image and its acceleration information.
[0075] In some embodiments, in addition to blood flow images, the image processing method provided in this application can also be used in tissue Doppler imaging. The motion of myocardial tissue is complex and diverse. To allow doctors to more intuitively observe the motion patterns of myocardial tissue and obtain more accurate judgments, tissue Doppler imaging has various modes, such as tissue tracking imaging (TTI, which can be used to display the displacement of myocardial tissue over a certain time period), tissue synchronization imaging (TSI, which can be used to display the time it takes for myocardial tissue to reach peak velocity), strain / strain rate imaging, etc. By configuring texture and height parameters, these physical quantities in various Doppler imaging modes can be projected onto a height plane and displayed together with tissue velocity images.
[0076] Of course, users can also switch the combination of physical quantities to be observed in real time through physical / virtual buttons as needed (i.e., configure the first target physical quantity and the second target physical quantity) to achieve the most desired observation purpose, such as the [Doppler energy-blood flow variance] combination and the [blood flow variance-blood flow acceleration] combination, to meet the diverse observation and clinical needs of users.
[0077] In some embodiments, the first target physical quantity in the texture parameters can be configured as Doppler energy, and the first display attribute is color brightness, which represents the magnitude of the energy. Simultaneously, the second target physical quantity is configured as blood flow variance, and the second display attribute is height value. With this configuration, the user can observe physiological information in both energy and variance dimensions simultaneously in an imaging result image. It is understandable that the combination of blood flow variance and Doppler energy can also be implemented where blood flow variance is used as the first target physical quantity, its magnitude represented by color brightness, and the second target physical quantity is configured as Doppler energy, represented by height value.
[0078] In some embodiments, the first target physical quantity in the texture parameters can be configured as tissue displacement (TTI), and the first display attribute is color. Different colors can be configured to represent different displacement amounts. At the same time, the second target physical quantity can be configured as tissue peak time (TSI), represented by a height value (second display attribute). With this setting, users can more accurately observe the relationship between displacement and peak time, thereby making more reasonable pathological diagnoses.
[0079] In one embodiment, the image processing method further includes:
[0080] In response to a triggered operation on the configuration adjustment controls on the imaging results display interface, a configuration interface is displayed. This interface shows texture configuration parameters and height configuration parameters. Configuration adjustment controls are provided on the imaging results display interface, for example... Figure 6 The imaging results display interface shows a partially hidden configuration adjustment control. When this control is activated, such as by hovering the mouse over it or clicking it, the configuration interface expands and can be overlaid on the imaging results display interface without obscuring the imaging results display area, allowing users to easily adjust parameters while viewing the interface. Users can adjust texture and height configuration parameters in the configuration parameter adjustment area, and the background system updates the imaging results in real time based on the scanned image and the updated texture and height parameters, making the operation convenient.
[0081] In one embodiment, the image processing method further includes displaying a configuration interface in response to a startup operation of the imaging device. For ultrasound imaging devices, users often use them immediately after startup; therefore, the configuration interface can be displayed when startup is detected, allowing users to configure parameters. Alternatively, the configuration interface can default to displaying the last configured texture and height parameters, which users can directly click "Confirm" to complete the parameter configuration if no adjustments are needed.
[0082] In one embodiment, prior to the step of configuring parameters for the display effect on the configuration interface, the image processing method further includes:
[0083] Based on preset texture and height parameters and the scanned image, a 3D enhanced image is obtained and displayed.
[0084] Based on historical usage data of the imaging equipment or observation needs in actual application scenarios, texture and height parameters can be preset to meet the observation requirements in most scenarios. When users start using the imaging equipment, they can obtain and display a 3D enhanced image based on the preset texture and height parameters and the scanned image, without needing to configure the texture and height parameters each time. When other physiological information beyond the preset parameters needs to be observed during the examination, users can then configure the texture and height parameters according to the observation requirements.
[0085] In one embodiment, the image processing method further includes:
[0086] In response to configuration operations on display effect parameters in the configuration interface, the display effect parameters are determined; these parameters include material parameters and / or lighting parameters. For the image to have good visual effects, the material and lighting of the height surfaces also need to be set. Material parameters can include the material's reflectivity to various types of light, such as specular reflectivity, diffuse reflectivity, and specular index. Lighting parameters can include: light intensity and color, and light direction.
[0087] Based on the configuration of display effect parameters, and using the scanned image, texture parameters, and height parameters generated by the medical imaging equipment, a 3D enhanced image of the region of interest is obtained, including:
[0088] Based on display effect parameters, scanned image, texture parameters, and height parameters, a 3D enhanced image of the region of interest is obtained. Users can adjust the display effect parameters to make the presentation of the 3D enhanced image more match their own sensitivity to light intensity, etc.
[0089] To better illustrate the implementation of this application, the image processing method is described here using color ultrasound blood flow imaging as an example. The processing and display of blood flow images can be divided into four parts: height surface generation, material / lighting / texture settings, normal calculation, and rendered image generation.
[0090] Specifically, height planes are drawn based on the height parameters configured by the user before or during the scanning process. If no configuration process is performed, the height planes can be generated based on predetermined height values. The height plane drawing referred to here can be applied to areas requiring color encoding, such as the blood vessel section shown in the figure, while the height value of the B-image portion outside this area is set to 0. After color encoding and B-image overlay, the blood flow distribution and flow conditions of the illustrated blood vessel section can be highlighted.
[0091] To achieve good visual effects, at least one of the following parameters for the height surface can be set: material parameters, lighting parameters, or texture parameters. Material parameters can include the material's reflectivity to various types of light, such as specular reflectivity, diffuse reflectivity, and specular index. Lighting parameters can include light intensity and color, as well as light direction. Texture parameters refer to the color mapped onto the height surface; a color-coded RGB image can be overlaid as a texture on the height surface to display a two-dimensional texture.
[0092] After the elevation plane is drawn, to achieve differentiated display of parameters such as blood flow energy (Doppler energy) on the elevation plane, the normal direction of each point on the elevation plane can be calculated using the parameters of the elevation plane (the energy values corresponding to each position on the two-dimensional plane determined by X and Y). (The normal of each point on the plane can be understood as the normal of the tangent plane passing through that point). Combined with the lighting direction (this process is a simulation calculation and does not require the projection of a real light beam), the intensity and distribution of reflected light on the elevation plane can be calculated, ultimately producing a three-dimensional image. As shown in the figure, the higher the energy of a point on the elevation plane, the higher the reflection intensity, and the greater the brightness of the image.
[0093] The resulting 3D blood flow image is superimposed onto the B image to generate the final image, which is then displayed on a monitor. This result can be shown in a designated imaging display area on the screen. This superposition process can be implemented using coordinate matching, image feature extraction and feature point matching, or other image superposition and fusion algorithms; all of these fall within the scope of this application. Other implementation methods are not exhaustively described here.
[0094] As shown in the figure, this is a rendered image of carotid artery blood flow. The texture of the blood flow portion is red and blue (color not shown) to represent its blood flow velocity value (brightness) and direction (red indicates flow towards the probe, and blue indicates flow away from the probe). By performing the steps of the above image processing method, the blood flow portion presents a three-dimensional effect, and its height value is its Doppler energy value. In one image, the user can simultaneously observe information in both the velocity dimension and the energy dimension.
[0095] Medical imaging equipment using this image processing method can switch the additional physical quantities to be displayed or set the combination of observed physical quantities at any time through input methods such as physical knobs or virtual buttons, which greatly meets the observation and clinical needs of users.
[0096] For example, a configuration parameter adjustment control can be displayed on the imaging results display interface. By responding to the user's selection of this control, an adjustment area can be displayed on the interface. The user can view the imaging results in real time while adjusting the configuration parameters. Depending on actual needs, the height configuration parameter can be adjusted individually to determine the additional physical quantity displayed by the height. Alternatively, both texture and height configuration parameters can be adjusted, allowing for arbitrary combinations of observed physical quantities.
[0097] The image processing method provided in this application presents a two-dimensional blood flow image in a three-dimensional form, enhancing its stereoscopic effect. Furthermore, the height information displayed as part of the blood flow velocity image is a physical quantity related to blood flow, allowing users to observe other blood flow information simultaneously with the blood flow velocity image. In addition, users can switch the combination of physical quantities they wish to observe in real time as needed, making the display of the blood flow image more flexible and better meeting their clinical diagnostic needs.
[0098] It should be noted that the height value of the elevation surface can represent parameters such as Doppler energy value and variance value. However, in practical applications, other parameters can also be used as the height value to meet the user's personalized observation requirements. For example, blood flow velocity value can also be set as the height value, and texture can be set to other physical quantities besides velocity. Users can set the above configuration parameters according to their display effect preferences and needs.
[0099] The examples provided here are primarily to help those skilled in the art understand the implementation process and display method of the aforementioned image processing method. However, it should be understood that the image processing method provided in this application is not limited to blood flow image processing, but can also be used for tissue Doppler, elastography, and angiography, among other imaging modes. The parameters of interest often differ under different imaging modes. It should be understood that the texture configuration parameters and height configuration parameters are selected from the parameters of interest to the user under the chosen imaging mode. That is, those skilled in the art should understand that the available options for texture configuration parameters and height configuration parameters may differ under different imaging modes.
[0100] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.
[0101] Based on the same inventive concept, this application also provides an image processing apparatus for implementing the image processing method described above. The solution provided by this apparatus is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more image processing apparatus embodiments provided below can be found in the limitations of the image processing method described above, and will not be repeated here.
[0102] In one embodiment, such as Figure 7 As shown, an image processing apparatus is provided, including: a parameter acquisition module 702, an image enhancement module 704, and an imaging result display module 706, wherein:
[0103] The parameter acquisition module 702 is used to acquire texture parameters and height parameters. The image enhancement module 704 is used to obtain a three-dimensional enhanced image of the region of interest based on the scanned image generated by the medical imaging equipment, the texture parameters, and the height parameters. The three-dimensional enhanced image displays at least two kinds of physiological information about the region of interest. The imaging result display module 706 is used to display the imaging results, which include the three-dimensional enhanced image.
[0104] In one embodiment, the device further includes:
[0105] The configuration interface display module is used to display the configuration interface.
[0106] In one embodiment, the device further includes:
[0107] The image fusion module is used to fuse 3D enhanced images and B-images to obtain imaging results.
[0108] In one embodiment, the parameter acquisition module 702 includes:
[0109] The parameter acquisition unit is used to acquire texture parameters and height parameters in response to configuration operations for texture configuration parameters and height configuration parameters.
[0110] In one embodiment, the texture configuration parameters include a first physical quantity; the height configuration parameters include a second physical quantity; the parameter acquisition unit includes:
[0111] The target physical quantity acquisition unit is used to acquire a first target physical quantity and a second target physical quantity in response to a configuration operation for a first physical quantity and a configuration operation for a second physical quantity; wherein the first target physical quantity and the second target physical quantity are different.
[0112] In one embodiment, the texture configuration parameters further include: a first display attribute; the first display attribute includes: color and / or brightness.
[0113] In one embodiment, the image processing apparatus further includes:
[0114] The interface display module is adjusted to respond to the triggering operation of the configuration adjustment controls on the imaging result display interface, and to display the configuration interface, which is used to display texture configuration parameters and height configuration parameters.
[0115] In one embodiment, the image processing apparatus further includes:
[0116] The startup configuration module is used to display the configuration interface in response to startup operations on the imaging device.
[0117] In one embodiment, the image processing apparatus further includes:
[0118] The pre-display module is used to obtain and display a 3D enhanced image based on preset texture and height parameters and the scanned image.
[0119] In one embodiment, the image processing apparatus further includes:
[0120] The display effect parameter configuration module is used to determine the display effect parameters in response to configuration operations on the display effect configuration parameters on the configuration interface; the display effect parameters include material parameters and / or lighting parameters.
[0121] The imaging results display module 706 includes:
[0122] The optimized display unit is used to obtain a 3D enhanced image of the region of interest based on display effect parameters, scanned image, texture parameters, and height parameters.
[0123] Each module in the aforementioned image processing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.
[0124] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements an image processing method. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.
[0125] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0126] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.
[0127] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0128] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.
[0129] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.
[0130] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0131] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0132] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.
Claims
1. An image processing method, characterized in that, Applied to ultrasound imaging equipment, the method includes: Obtain texture parameters and height parameters; the texture parameters include at least one of blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, and tissue peak time; the height parameters include at least one of blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, and tissue peak time; the texture parameters are different from the height parameters; Based on the scanned image generated by the medical imaging equipment, the texture parameters, and the height parameters, a three-dimensional enhanced image of the region of interest is obtained; the three-dimensional enhanced image displays at least two types of physiological information about the region of interest. The imaging results are displayed, including the three-dimensional enhanced image.
2. The method according to claim 1, characterized in that, Prior to the step of displaying the imaging results, the following is included: The imaging result is obtained by fusing the enhanced 3D image and the B image; the B image is an image including the region of interest generated based on the scan data in the B imaging mode.
3. The method according to claim 1, characterized in that, The acquisition of texture parameters and height parameters includes: In response to a configuration operation for texture configuration parameters and height configuration parameters, the texture parameters and the height parameters are obtained.
4. The method according to claim 3, characterized in that, The texture configuration parameters include a first physical quantity; the height configuration parameters include a second physical quantity. The step of obtaining the texture parameters and the height parameters in response to a configuration operation for the texture configuration parameters and the height configuration parameters includes: In response to configuration operations for the first physical quantity and configuration operations for the second physical quantity, the first target physical quantity and the second target physical quantity are obtained; The first target physical quantity and the second target physical quantity are different.
5. The method according to claim 4, characterized in that, The texture configuration parameters further include: a first display attribute; the first display attribute includes: color and / or brightness.
6. The method according to claim 4, characterized in that, The height configuration parameters also include: a second display attribute; the second display attribute includes: reflected light intensity.
7. The method according to claim 1, characterized in that, Also includes: In response to a triggering operation of the configuration adjustment controls on the display interface of the imaging results, a configuration interface is displayed, which is used to display the texture configuration parameters and the height configuration parameters.
8. The method according to claim 1, characterized in that, The method further includes: In response to a configuration operation for display effect configuration parameters, display effect parameters are determined; the display effect parameters include material parameters and / or lighting parameters. The scanned image generated by the medical imaging equipment, the texture parameters, and the height parameters are used to obtain a three-dimensional enhanced image of the region of interest, including: Based on the display effect parameters, the scanned image, the texture parameters, and the height parameters, a three-dimensional enhanced image of the region of interest is obtained.
9. An image processing apparatus, characterized in that, The device is used in ultrasound imaging equipment and includes: A parameter acquisition module is used to acquire texture parameters and height parameters; the texture parameters include at least one of blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, and tissue peak time; the height parameters include at least one of blood flow direction, blood flow velocity, blood flow variance, blood flow acceleration, Doppler energy, tissue displacement, and tissue peak time; the texture parameters are different from the height parameters. The image enhancement module is used to obtain a three-dimensional enhanced image of the region of interest based on the scanned image generated by the medical imaging equipment, the texture parameters, and the height parameters; the three-dimensional enhanced image displays at least two kinds of physiological information about the region of interest; An imaging result display module is used to display imaging results, including the three-dimensional enhanced image.
10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Imaging method, and ultrasonic imaging device
CN112654298A
Method for extracting region of interest in mammary gland image based on palpation and ultrasonic data
CN114943688A