Blood vessel image correction method, apparatus and system, and medium
By acquiring and correcting the pixel position information of marking points in the intravascular ultrasound imaging system, and calculating and adjusting the offset, the vascular image distortion problem caused by uneven rotation of the spinning wire in the intravascular ultrasound imaging system is solved, and the accuracy of the vascular image is improved Spend.
Patent Information
- Application Number
- PCT/CN2023/131005
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-17
- Filing Date
- 2023-11-10
- Publication Date
- 2024-11-21
AI Technical Summary
The uneven rotation of the spinning wire in the intravascular ultrasound imaging system causes distortion of the blood vessel image, which cannot accurately reflect the true vascular morphology.
By obtaining the blood vessel image to be corrected, determining whether it contains a marking point, extracting the actual pixel position information of the marking point, and calculating the offset information based on the marking point reference pixel position information, correcting the blood vessel image, and adjusting the image to reflect the real blood vessel morphology .
It improves the accuracy of blood vessel morphology in vascular images and solves the problem of image distortion caused by uneven rotation of wire.
Smart Images

Figure CN2023131005_21112024_PF_FP_ABST
Abstract
Description
Vascular image correction method, device, system and medium
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 17, 2023, with application number 202310560611.0, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of medical image processing technology, for example, to a method, device, system and medium for vascular image correction. Background Art
[0003] An intravascular ultrasound (IVUS) imaging system includes a special catheter with an ultrasound probe connected to its distal end. By inserting the ultrasound probe into the cardiovascular cavity, at least one of the cardiovascular cross-sectional morphology and blood flow pattern can be displayed.
[0004] Due to the complex vascular structure, the performance of the rotating wire or sheath in the intravascular ultrasound imaging system may be impaired during the rotation and retraction process. The rotating wire rotates unevenly, causing the obtained vascular image to be distorted and unable to reflect the true vascular morphology.
[0005] Summary of the Invention
[0006] The present application provides a vascular image correction method, device, system and medium, which improve the accuracy of vascular morphology in vascular images acquired by an intravascular ultrasound imaging system.
[0007] According to one aspect of the present application, a blood vessel image correction method is provided, comprising:
[0008] Acquire a blood vessel image to be corrected, and determine whether the blood vessel image to be corrected contains a set of marking points;
[0009] In response to the blood vessel image to be corrected containing a group of marker points, extracting actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected;
[0010] Determine the offset information of the plurality of marking points based on the actual marking point pixel position information and the marking point reference pixel position information;
[0011] The blood vessel image to be corrected is corrected according to the offset information to obtain a target blood vessel image.
[0012] According to another aspect of the present application, a blood vessel image correction device is provided, comprising:
[0013] a blood vessel image acquisition module configured to acquire a blood vessel image to be corrected and determine whether the blood vessel image to be corrected contains a set of marking points;
[0014] a marker pixel position information extraction module configured to extract actual marker pixel position information of a group of markers in the vascular image to be corrected in response to the group of markers in the vascular image to be corrected;
[0015] a marker point offset information determination module configured to determine offset information of a plurality of marker points based on actual marker point pixel position information and marker point reference pixel position information;
[0016] The blood vessel image correction module is configured to correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.
[0017] According to another aspect of the present application, a blood vessel image correction system is provided, comprising:
[0018] an ultrasound catheter configured to acquire an image of a blood vessel to be corrected;
[0019] At least one developing marking component is provided on the sheath wall of the ultrasonic catheter, and can cause pixel information of a group of marking points to be presented at the position corresponding to the developing marking component in the image of the blood vessel to be corrected;
[0020] at least one processor; and
[0021] a memory communicatively connected to at least one processor; wherein,
[0022] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the blood vessel image correction method of any embodiment of the present application.
[0023] According to another aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, which enables a processor to implement the blood vessel image correction method of any embodiment of the present application when executed. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] FIG1 is a flow chart of a blood vessel image correction method according to an embodiment of the present application;
[0025] FIG2 is a schematic diagram of a developing ring provided according to an embodiment of the present application;
[0026] FIG3 is a schematic structural diagram of an intravascular ultrasound imaging system provided according to an embodiment of the present application;
[0027] FIG4 is a schematic diagram of a blood vessel image to be corrected according to an embodiment of the present application;
[0028] FIG5 is a schematic diagram of an actual sector-shaped area provided according to an embodiment of the present application;
[0029] FIG6 is a schematic diagram of a marker reference image provided according to an embodiment of the present application;
[0030] FIG7 is a schematic diagram of a reference sector area provided according to an embodiment of the present application;
[0031] FIG8 is a flow chart of another blood vessel image correction method provided according to an embodiment of the present application;
[0032] FIG9 is a structural block diagram of a blood vessel image correction device according to an embodiment of the present application;
[0033] FIG10 is a structural block diagram of a blood vessel image correction system provided according to an embodiment of the present application. DETAILED DESCRIPTION
[0034] It should be noted that the terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0035] FIG1 is a flowchart of a vascular image correction method according to an embodiment of the present application. This embodiment is applicable to an intravascular ultrasound imaging system equipped with marker points. The method can be performed by a vascular image correction device, which can be implemented in at least one of hardware and software and configured in a processor of the vascular image correction system.
[0036] As shown in FIG1 , the blood vessel image correction method of this embodiment includes the following steps:
[0037] S110 , obtaining a blood vessel image to be corrected, and determining whether the blood vessel image to be corrected contains a set of marking points.
[0038] The blood vessel image to be corrected is a blood vessel cross-sectional image of an imaging component (rotating wire) of the IVUS imaging system at any actual position in the blood vessel.
[0039] The marking points may be of any shape and size, as long as they can be presented as a group of marking points in the blood vessel image and do not excessively block the blood vessel imaging.
[0040] Typically, the wire rotates unevenly, and the cross-sectional image of the blood vessel may not reflect the actual blood vessel structure. Therefore, in one embodiment, an ultrasound catheter is used to acquire the image of the blood vessel to be corrected, wherein a development marking component is provided on the sheath wall of the ultrasound catheter so that pixel information of a group of marking points is presented at the position of the development marking component in the image of the blood vessel to be corrected.
[0041] It is understandable that when imaging a cross-section of a blood vessel at a location corresponding to the placement of a development marker component, the development marker component will obstruct the vessel, affecting the imaging result of the vessel at that location. Therefore, the number of development marker components should be limited. For example, due to the material properties of the development marker component, when imaging a cross-section of a blood vessel at a location corresponding to the placement of the development marker component, the ultrasound signal at that location will be affected, causing the brightness of the image at that location in the imaging result to be lower than that of an image without the development marker component, thereby affecting the imaging result of the vessel at that location. Therefore, in practical applications, the material of the development marker component can be selected to reduce ultrasonic attenuation, thereby achieving an imaging result in which the development marker component does not completely obstruct the vessel at that location.
[0042] In one embodiment, due to the material properties of the development marker component, when a cross-sectional image of a blood vessel at the location corresponding to the placement of the development marker component is captured, the development marker component obscures the blood vessel image, resulting in pixel information of a group of marker points in the cross-sectional image of the blood vessel appearing as high-grayscale pixels. For example, when pixel information of a group of marker points obscuring the blood vessel exists in the image of the blood vessel to be corrected, the image of the blood vessel to be corrected includes a group of marker points; when pixel information of a group of marker points obscuring the blood vessel does not exist in the image of the blood vessel to be corrected, the image of the blood vessel to be corrected does not include a group of marker points.
[0043] When a cross-section of a blood vessel at any actual position in the imaging position of the blood vessel image is located at the blood vessel position corresponding to the position where the development marker component is set, a cross-section image of the blood vessel at that actual position is acquired by the rotating wire. The cross-section image of the blood vessel includes pixel information of a group of marker points, wherein the rotating wire is located in the ultrasound catheter. It is understood that because the rotating wire acquires a cross-section image of the blood vessel, the cross-section image of the blood vessel will only include pixel information of a group of marker points at most.
[0044] S120 , in response to the blood vessel image to be corrected containing a group of marker points, extracting actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected.
[0045] The actual pixel position information of the marker points may be the coordinates of the pixels of a group of marker points in the blood vessel image to be corrected or other information used to represent the positions of a group of marker points in the blood vessel image to be corrected.
[0046] Exemplarily, when there is a group of marking points of a developed marking component in the image of the blood vessel to be corrected, the group of marking points presents a group of pixel information of the marking points in the image of the blood vessel to be corrected, and the coordinates of the pixel information of the group of marking points in the image of the blood vessel to be corrected are determined to obtain the actual pixel position information of the marking points of the group of marking points.
[0047] S130 : Determine offset information of multiple marking points based on actual marking point pixel position information and marking point reference pixel position information.
[0048] The reference pixel position information of the marking points is the coordinates of a group of marking point pixels in the blood vessel cross-sectional image at the position of the development marking component in the blood vessel when the rotating wire rotates uniformly, or other information used to represent the position of a group of marking points in the blood vessel cross-sectional image.
[0049] The offset information may include at least one of the following: the difference between the distance between the actual marker point pixel position information and the adjacent marker point pixels determined by the marker point reference pixel position information; the difference in the area occupied by the pixels of each marker point; the difference in the central angle of the fan-shaped area occupied by the pixels corresponding to each marker point, and may also include the difference between other quantitative indicators calculated based on the pixel distance, area or central angle corresponding to each marker point.
[0050] Optionally, an image segmentation algorithm or a target detection algorithm or a trained image processing model based on related technologies is used to identify actual pixel position information of a group of marker points in the blood vessel image to be corrected.
[0051] Exemplarily, determining the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information includes:
[0052] Based on the pixel position information of the actual marking point, the actual sector area corresponding to each marking point is divided in the blood vessel image to be corrected.
[0053] Each actual sector area includes pixel information of a marking point in the image of the blood vessel to be corrected and pixel information corresponding to the blood vessel adjacent to the pixel information.
[0054] In one embodiment, as shown in FIG2 , the developing marking component is a developing ring, which is set on the sheath of the IVUS imaging system (see FIG3 ). FIG4 is an image of the blood vessel to be corrected corresponding to the developing ring at its set position. The blood vessel image to be corrected includes pixel information of a group (24) of marking points. The coordinates of the marking point pixels in the group of marking points in the blood vessel image to be corrected are extracted as the actual marking point pixel position information. As shown in FIG4 , the pixel information of the marking point of the developing ring in the blood vessel image to be corrected is the black part, and the white part in the same circle as the black part is the pixel information of the blood vessel. Based on the actual marking point pixel position information of the marking point of the developing ring in the blood vessel image to be corrected, the position of the leftmost pixel point of each actual marking point pixel position information is used as the starting point of each sector area, and the sector area is divided as shown in FIG5 , and the sector area where each marking point is located is obtained as the actual sector area.
[0055] Optionally, the sector-shaped areas are divided by taking the position of the rightmost pixel point of each actual marking point pixel position information as the starting point of each sector-shaped area, which is not limited in this embodiment.
[0056] The reference image of each marker point is divided into a reference sector area corresponding to each marker point based on the reference pixel position information of the marker point.
[0057] The marking point reference image is a blood vessel image in which the marking points in the development marking component are evenly distributed.
[0058] Optionally, the marker reference image may not include pixel information of blood vessels, as long as all markers are evenly distributed around the circumference.
[0059] Each reference sector area includes pixel information of a marker point in the marker point reference image and pixel information of a blood vessel adjacent to the pixel information.
[0060] In one embodiment, the marker reference image is shown in FIG6 , in which the pixels of the marker points of the developer ring in the marker reference image are black. Based on the marker reference pixel position information of the developer ring in the marker reference image, the sector-shaped region is divided as shown in FIG7 , with the position of the leftmost pixel of each marker reference pixel position information as the starting point of each sector-shaped region. The sector-shaped region where each marker point is located is obtained as the reference sector-shaped region.
[0061] Optionally, the sector area is divided by taking the position of the rightmost pixel point of each marker point reference pixel position information as the starting point of each sector area, as long as the division rules of the reference sector area and the actual sector area are consistent.
[0062] The offset information of each marking point is determined according to the actual sector area and the reference sector area.
[0063] Exemplarily, the difference between the central angle of the fan-shaped area occupied by the pixel information of each marking point in the actual fan-shaped area and the reference fan-shaped area is used as the offset information of each marking point.
[0064] Optionally, the difference in sector area or arc length between the actual sector area and the reference sector area may be used as the offset information of each marking point.
[0065] S140 , correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.
[0066] Exemplarily, if the offset information is not 0, the actual marker pixel position information in the blood vessel image to be corrected is adjusted to be consistent with the marker reference pixel position information based on the offset information, that is, the distance between adjacent marker pixels in the blood vessel image to be corrected is adjusted to the distance between adjacent marker pixels corresponding to the marker reference pixel position information; or, the area occupied by all pixels of each marker in the blood vessel image to be corrected is adjusted to the area occupied by all pixels of each marker in the marker reference pixel position information.
[0067] In one embodiment, the central angle of the corresponding actual sector is adjusted based on each offset information to obtain the target vessel image. For example, if the offset of the marker point is not zero, the central angle of the actual sector is adjusted to the central angle of the reference sector, and the image after the adjustment is used as the target vessel image. This approach has the advantage of identifying the marker point and adjusting the sector where the marker point is located, thereby correcting the pixels corresponding to the blood vessels in the same sector to obtain the target vessel image.
[0068] Optionally, since the marker points in the reference vascular image are evenly distributed, it is also possible not to obtain a marker point reference image. Instead, based on the number of marker points, the angle of the central angle corresponding to the reference sector area is obtained by calculating (360° / number of marker points), and the angle of the central angle is used as the marker point reference pixel position information to correct the vascular image to be corrected.
[0069] The technical solution of the embodiment of the present application obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image to be corrected is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. The technical solution of the embodiment of the present application solves the problem of vascular image distortion caused by uneven rotation of the spinning wire and improves the accuracy of vascular morphology in the vascular image.
[0070] Figure 8 is a flowchart of another vascular image correction method according to an embodiment of the present application. This embodiment shares the same concept as the vascular image correction method described above and exemplarily describes the process of performing vascular image correction on a vascular image to be corrected when the image lacks marker pixel position information. This method can be performed by a vascular image correction device, which can be implemented using at least one of software and hardware and is configured in a vascular image correction system processor.
[0071] As shown in FIG8 , the blood vessel image correction method of this embodiment includes the following steps:
[0072] S210 , obtaining a blood vessel image to be corrected, and determining whether the blood vessel image to be corrected contains a set of marking points.
[0073] S220 : In response to the blood vessel image to be corrected containing a group of marker points, extract actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected.
[0074] S230 : Determine the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information.
[0075] S240 , correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.
[0076] S250 : In response to the fact that the blood vessel image to be corrected does not contain pixel information of the marker point, obtain a correction reference blood vessel image adjacent to the blood vessel image to be corrected and containing pixel information of the marker point.
[0077] After S210 , if the blood vessel image to be corrected includes a set of marker points, S220 , S230 , and S240 are executed; if the blood vessel image to be corrected does not include a set of marker points, S250 and S260 are executed.
[0078] When only one development marking component is set in the IVUS imaging system, the imaging position of the correction reference blood vessel image is adjacent to the imaging position of the blood vessel image to be corrected, and the imaging position of the correction reference blood vessel image is closest to the imaging position of the blood vessel image to be corrected. The correction reference blood vessel image includes a blood vessel cross-sectional image corresponding to the setting position of the development marking component.
[0079] When multiple imaging marker components are installed at a set distance in an IVUS imaging system, and the imaging component's rotating wire is positioned between two adjacent imaging marker components, the image of the vessel to be corrected at the imaging position of the vessel image does not include the marker pixel information. A correction reference vessel image is adjacent to the vessel to be corrected, and the imaging position of the correction reference vessel image includes the imaging position of the imaging marker component. The correction reference vessel image includes the vessel cross-sectional images corresponding to the imaging marker component locations. Exemplarily, the correction reference vessel image is adjacent to the vessel to be corrected, and the imaging position of the correction reference vessel image includes two vessel cross-sectional images corresponding to the two adjacent imaging marker component locations. It is understood that when the imaging component's rotating wire is positioned before the first imaging marker component, the image of the vessel to be corrected at the imaging position of the correction reference vessel image does not include the marker pixel information. The imaging position of the correction reference vessel image is adjacent to the imaging position of the vessel to be corrected, and the imaging position of the correction reference vessel image includes the imaging position of the first imaging marker component. The correction reference vessel image includes the vessel cross-sectional image corresponding to the first imaging marker component location.
[0080] Similarly, when the imaging component's rotating wire is positioned after the last developed marker component, the vessel image to be corrected at that imaging position also does not include the marker pixel information. The correction reference vessel image is adjacent to the vessel image to be corrected, and the imaging position of the correction reference vessel image includes the last developed marker component setting position. The correction reference vessel image includes the vessel cross-sectional image corresponding to the last developed marker component setting position.
[0081] In addition, the first and last development marking components can also be directly set at the two end points of the sheath of the vascular imaging system, so that the blood vessel positions corresponding to all blood vessel images to be corrected that do not include the marking points are located at the blood vessel positions between the two development marking components, that is, each blood vessel image to be corrected that does not include the pixel information of the marking points has a correction reference blood vessel image.
[0082] S260 , correcting the vascular image to be corrected based on the offset information of the marking points in the corrected reference vascular image to obtain a target vascular image.
[0083] The actual marker point pixel position information of the marker point in the correction reference vascular image is extracted, and the offset information of each marker point in the correction reference vascular image is determined based on the actual marker point pixel position information and the marker point reference pixel position information; the weight of the offset information of each marker point in the correction reference vascular image is determined based on the distance between the vascular position corresponding to the vascular image to be corrected and the vascular position corresponding to the correction reference vascular image; the vascular image to be corrected is corrected based on the offset information of each marker point in the correction reference vascular image and its weight, to obtain a target vascular image.
[0084] When only one development marking component is provided in the IVUS imaging system, each to-be-corrected blood vessel image that does not contain pixel position information of the marking point is corrected according to the offset information of the marking point in the correction reference blood vessel image.
[0085] Optionally, a distance threshold may be set. When the distance between the blood vessel position corresponding to the to-be-corrected blood vessel image and the blood vessel position corresponding to the corrected reference blood vessel image is less than or equal to the distance threshold, the to-be-corrected blood vessel image is corrected based on the offset information of the marker points in the corrected reference blood vessel image. It will be appreciated that the distance between two adjacent marker components may also be set to be less than or equal to the distance threshold when the marker components are provided.
[0086] Exemplarily, the correction reference vascular image includes a first correction reference vascular image acquired before the vascular image to be corrected is acquired and a second correction reference vascular image acquired after the vascular image to be corrected is acquired. Correcting the vascular image to be corrected based on offset information of marker points in the correction reference vascular image includes:
[0087] First offset information of each marking point in the first corrected reference blood vessel image and second offset information of each marking point in the second corrected reference blood vessel image are acquired.
[0088] Exemplarily, when the blood vessel position corresponding to the correction reference blood vessel image is between the blood vessel positions corresponding to two development marking components, based on the movement direction of the imaging component, the blood vessel cross-sectional image corresponding to the development marking component setting position that the imaging component passed first is used as the first correction reference blood vessel image, and the blood vessel cross-sectional image corresponding to the development marking component setting position that the imaging component passed later is used as the second correction reference blood vessel image.
[0089] Based on the actual marker point pixel position information and the marker point reference pixel position information of each marker point in the first corrected reference vascular image, the offset information of each marker point in the first corrected reference vascular image is determined as the first offset information; at the same time, based on the actual marker point pixel position information and the marker point reference pixel position information of each marker point in the second corrected reference vascular image, the offset information of each marker point in the second corrected reference vascular image is determined as the second offset information.
[0090] The weight values of the first offset information and the second offset information are determined according to the distances between the blood vessel position corresponding to the to-be-corrected blood vessel image and the blood vessel positions corresponding to the first and second corrected reference blood vessel images.
[0091] Exemplarily, the distance between the blood vessel cross-section position corresponding to the blood vessel image to be corrected and the blood vessel cross-section position corresponding to the first correction reference blood vessel image is determined as the first distance; at the same time, the distance between the blood vessel cross-section position corresponding to the blood vessel image to be corrected and the blood vessel cross-section position corresponding to the second correction reference blood vessel image is determined as the second distance; the sum of the first distance and the second distance is determined, that is, the distance between two adjacent development marking components at the blood vessel cross-section position corresponding to the blood vessel image to be corrected; the ratio of the first distance to the distance sum is used as the weight value of the second offset information, and the ratio of the second distance to the distance sum is used as the weight value of the first offset information.
[0092] Target offset information is determined based on the first offset information, the second offset information, and the weight value, and the blood vessel image to be corrected is corrected based on the target offset information.
[0093] Exemplarily, the sum of the multiplication of the offset information and the corresponding weight value is used as the target offset information of the vascular image to be corrected, that is, the first offset information and the weight value of the first offset information are multiplied to obtain the first initial offset information, the second offset information and the weight value of the second offset information are multiplied to obtain the second initial offset information, and the first initial offset information and the second initial offset information are added to obtain the target offset information; the vascular image to be corrected is corrected according to the target offset information in the corrected reference vascular image to obtain the target vascular image.
[0094] In one embodiment, based on the first frame data of the corresponding blood vessel cross-sectional image obtained when the wire is rotated, the first marking point closest to the first frame data in the first correction reference blood vessel image and the second correction reference blood vessel image and the corresponding point of the blood vessel image to be corrected are respectively determined as the starting point of blood vessel image correction; the difference between the central angle of the actual sector area of the first marking point in the first correction reference blood vessel image and the central angle of the reference sector area is used as the first offset information of the starting point; at the same time, the difference between the central angle of the actual sector area of the first marking point in the second correction reference blood vessel image and the central angle of the reference sector area is used as the second offset information of the starting point; based on the blood vessel image to be corrected The weight values of the first and second offset information of the starting point are determined based on the distances between the corresponding blood vessel positions and the corresponding blood vessel positions in the first and second corrected reference blood vessel images, respectively. The weighted sum of the first and second offset information is used as the target offset information of the starting point. If the target offset information of the starting point is not zero, the central angle of the target offset information of the starting point is determined. In the blood vessel image to be corrected, the first actual sector-shaped area at the starting point is determined to be the sum of the central angle of the reference sector-shaped area and the central angle of the target offset information of the starting point. The central angle of the actual sector-shaped area is adjusted to the central angle of the reference sector-shaped area. Based on the marker point offset information of the actual sector-shaped area of the second marker point in the first and second corrected reference blood vessel images, the target offset information corresponding to the sector-shaped area adjacent to the first actual sector-shaped area in the blood vessel image to be corrected is determined. The second actual sector-shaped area in the blood vessel image to be corrected is corrected based on the target offset information. Similarly, all sector-shaped areas in the blood vessel image to be corrected are corrected based on the offset information of all marker points in the corrected reference blood vessel images to obtain the target blood vessel image.
[0095] The technical solution of this embodiment obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. Furthermore, if the image to be corrected does not contain the marker pixel information, a correction reference vascular image adjacent to the image to be corrected, i.e., one containing the marker pixel information, is obtained. The image to be corrected is corrected based on the offset information of the marker points in the correction reference vascular image to obtain a target vascular image. The technical solution of this embodiment solves the problem of vascular image distortion caused by uneven wire rotation and improves the accuracy of vascular morphology in the vascular image.
[0096] FIG9 is a block diagram of a vascular image correction device according to an embodiment of the present application. This embodiment is applicable to scenarios where vascular image correction is performed in an intravascular ultrasonic imaging system that is provided with marker pixel information. The device can be implemented using at least one of software and hardware and integrated into a vascular image correction system with application development capabilities.
[0097] As shown in FIG9 , the blood vessel image correction device includes: a blood vessel image acquisition module 401 , a marker pixel position information extraction module 402 , a marker offset information determination module 403 , and a blood vessel image correction module 404 .
[0098] The vascular image acquisition module 401 is configured to acquire a vascular image to be corrected and determine whether the vascular image to be corrected contains a set of marker points. The marker point pixel position information extraction module 402 is configured to extract actual marker point pixel position information of a set of marker points in the vascular image to be corrected in response to the presence of a set of marker points in the vascular image to be corrected. The marker point offset information determination module 403 is configured to determine offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information. The vascular image correction module 404 is configured to correct the vascular image to be corrected based on the offset information to obtain a target vascular image.
[0099] The technical solution of this embodiment obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. This technical solution solves the problem of vascular image distortion caused by uneven rotation of the wire and improves the accuracy of vascular morphology in the vascular image.
[0100] Optionally, the vascular image acquisition module is further configured to: collect the vascular image to be corrected through an ultrasonic catheter, wherein a development marking component is provided on the sheath wall of the ultrasonic catheter, and the development marking component causes the pixel information of a group of marking points to be presented at the position corresponding to the development marking component in the vascular image to be corrected.
[0101] Optionally, the marking point offset information determining module 403 is further configured to:
[0102] Based on the pixel position information of the actual marker point, the actual sector area corresponding to each marker point is divided in the blood vessel image to be corrected;
[0103] Divide the reference sector area corresponding to each marker point in the marker point reference image based on the reference pixel position information of the marker point;
[0104] The offset information of each marking point is determined according to the actual sector area and the reference sector area.
[0105] Optionally, the marker offset information determination module 403 further includes a sector area central angle adjustment unit, which is configured to adjust the central angle of the corresponding actual sector area according to each offset information to obtain the target blood vessel image.
[0106] Optionally, the vascular image correction device further includes a correction reference vascular image acquisition module, and the correction reference vascular image acquisition module is configured to:
[0107] Acquire a correction reference blood vessel image containing pixel information of a marker point adjacent to the blood vessel image to be corrected;
[0108] The blood vessel image to be corrected is corrected based on the offset information of the marker points in the corrected reference blood vessel image.
[0109] Optionally, the corrected reference blood vessel image acquisition module includes a corrected reference blood vessel image offset determination unit, and the corrected reference blood vessel image offset determination unit is configured to:
[0110] Acquire first offset information of each marking point in the first corrected reference blood vessel image and second offset information of multiple marking points in the second corrected reference blood vessel image;
[0111] determining weight values of the first offset information and the second offset information according to distances between a blood vessel position corresponding to the to-be-corrected blood vessel image and blood vessel positions corresponding to the first and second correction reference blood vessel images;
[0112] Target offset information is determined based on the first offset information, the second offset information, and the weight value, and the blood vessel image to be corrected is corrected based on the target offset information.
[0113] The vascular image correction device provided in the embodiments of the present application can execute the vascular image correction method provided in any embodiment of the present application, and has the corresponding functional modules and effects of the execution method.
[0114] FIG10 is a block diagram of a vascular image correction system according to an embodiment of the present application. This embodiment is applicable to scenarios where marker pixel information is set for vascular image correction. The system can be implemented by at least one of software and hardware.
[0115] The components shown herein, their connections and relationships, and their functions, are examples only, and are not meant to limit implementations of the application described or claimed herein.
[0116] As shown in FIG10 , the vascular image correction system 10 includes: an ultrasonic catheter 501 configured to acquire vascular images; at least one development marking component 502 configured to develop pixel information of a set of marking points in the vascular image corresponding to the location where the development marking component is set; at least one processor 11, and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11.
[0117] In one embodiment, the imaging marking component 502 is a developing ring (see FIG2 ) or a filament made of a metal material. The filament can be set on the inner wall of the sheath of the ultrasonic catheter 501. The filament will not excessively block the vascular image of the imaging component at the corresponding vascular cross-section position, and the metal material has strong acoustic wave reflectivity, ensuring clear imaging of the marking point. For example, when making the sheath, 24 metal wires are evenly buried in the sheath, so that the image of the blood vessel to be corrected obtained by the imaging component during the rotation and retraction process always includes a set of marking points. For example, the image of the blood vessel to be corrected is corrected based on the offset information of the marking point to obtain the target blood vessel image.
[0118] The memory stores computer programs executable by at least one processor. Processor 11 can perform various appropriate actions and processes based on computer programs stored in read-only memory (ROM) 12 or loaded from storage unit 18 into random access memory (RAM) 13. RAM 13 may also store various programs and data required for the operation of vascular image correction system 10. Processor 11, ROM 12, and RAM 13 are interconnected via bus 14. An input / output (I / O) interface 15 is also connected to bus 14.
[0119] Multiple components in the vascular image correction system 10 are connected to an I / O interface 15, including an input unit 16, such as a keyboard and mouse; an output unit 17, such as various types of displays and speakers; a storage unit 18, such as a magnetic disk and optical disk; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the vascular image correction system 10 to exchange information or data with other devices via a computer network such as the Internet or various telecommunication networks.
[0120] Processor 11 can be any general-purpose or specialized processing component with processing and computing capabilities. Examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, or microcontroller. Processor 11 executes the methods and processes described above, such as the vascular image correction method.
[0121] In some embodiments, the vascular image correction method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded or installed into the vascular image correction system 10 via the ROM 12 or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, at least one step of the vascular image correction method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the vascular image correction method in any other suitable manner (e.g., via firmware).
[0122] Various embodiments of the systems and techniques described herein can be implemented in the following systems or combinations thereof: digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard parts (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, and software. These various embodiments can include being implemented in at least one computer program that can be executed or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0123] The computer programs for implementing the methods of the present application may be written in any combination of at least one programming language. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions or operations specified in the flowchart or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0124] The technical solution of the embodiment of the present application obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image to be corrected is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of the multiple marker points is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. The technical solution of the embodiment of the present application solves the problem of vascular image distortion caused by uneven wire rotation and improves the accuracy of vascular morphology in the vascular image.
[0125] The vascular image correction system provided in the embodiments of the present application can execute the vascular image correction method provided in any embodiment of the present application, and has the corresponding effect of executing the method.
[0126] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable storage medium. Examples of machine-readable storage media can include an electrical connection based on at least one line, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0127] To provide user interaction, the devices and techniques described herein can be implemented on a vascular image correction system having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the vascular image correction system. Other types of devices can also provide user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0128] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0129] A computing system may include a client and a server. The client and server are generally remote from each other and typically interact via a communication network. The client-server relationship arises through computer programs running on the respective computers and establishing a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, a host product within a cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosts and virtual private server (VPS) services.
Claims
1. A blood vessel image correction method, comprising: Acquire a blood vessel image to be corrected, and determine whether the blood vessel image to be corrected contains a set of marking points; In response to the blood vessel image to be corrected containing a group of marking points, extracting actual marking point pixel position information of the group of marking points in the blood vessel image to be corrected; Determine the offset information of each of the marking points based on the actual marking point pixel position information and the marking point reference pixel position information; The blood vessel image to be corrected is corrected according to the offset information to obtain a target blood vessel image.
2. The method according to claim 1, wherein: The obtaining of the blood vessel image to be corrected comprises: The blood vessel image to be corrected is collected by an ultrasonic catheter, wherein a development marking component is provided on the sheath wall of the ultrasonic catheter, and the development marking component causes the pixel information of the group of marking points to be presented at positions corresponding to the development marking component in the blood vessel image to be corrected.
3. The method according to claim 1, wherein: The step of determining the offset information of each of the marking points based on the actual marking point pixel position information and the marking point reference pixel position information includes: Based on the pixel position information of the actual marking point, dividing the actual sector-shaped area corresponding to each marking point in the blood vessel image to be corrected; Dividing the reference sector area corresponding to each marking point in the marking point reference image based on the reference pixel position information of the marking point; The offset information of each marking point is determined according to the actual fan-shaped area and the reference fan-shaped area.
4. The method according to claim 3, wherein: The step of correcting the to-be-corrected blood vessel image according to the offset information to obtain a target blood vessel image includes: According to each piece of offset information, the central angle of the corresponding actual sector area is adjusted to obtain a target blood vessel image.
5. The method according to claim 1, wherein: In response to the blood vessel image to be corrected not containing the pixel information of the marker point, the method further includes: Acquire a correction reference blood vessel image containing pixel information of a marker point adjacent to the blood vessel image to be corrected; The blood vessel image to be corrected is corrected based on the offset information of the marking points in the corrected reference blood vessel image.
6. The method according to claim 5, wherein: The correction reference blood vessel image includes a first correction reference blood vessel image acquired before the blood vessel image to be corrected is acquired and a second correction reference blood vessel image acquired after the blood vessel image to be corrected is acquired, and the correction of the blood vessel image to be corrected based on the offset information of the marking points in the correction reference blood vessel image includes: Acquire first offset information of each marking point in the first corrected reference blood vessel image and second offset information of each marking point in the second corrected reference blood vessel image; determining weight values of the first offset information and the second offset information according to distances between a blood vessel position corresponding to the to-be-corrected blood vessel image and blood vessel positions corresponding to the first corrected reference blood vessel image and the second corrected reference blood vessel image; Target offset information is determined based on the first offset information, the second offset information, and the weight value, and the to-be-corrected blood vessel image is corrected based on the target offset information.
7. A blood vessel image correction device, comprising: A blood vessel image acquisition module, configured to acquire a blood vessel image to be corrected and determine whether the blood vessel image to be corrected contains a set of marking points; a marking point pixel position information extraction module, configured to extract actual marking point pixel position information of a group of marking points in the blood vessel image to be corrected in response to the blood vessel image to be corrected containing a group of marking points; A marking point offset information determination module, configured to determine the offset information of each marking point based on the actual marking point pixel position information and the marking point reference pixel position information; The blood vessel image correction module is configured to correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.
8. The device according to claim 7, wherein: The blood vessel image acquisition module is configured as follows: The image of the blood vessel to be corrected is collected by an ultrasound catheter, wherein a developing marking component is provided on the sheath wall of the ultrasound catheter, and the developing marking component makes the image of the blood vessel to be corrected correspond to the The pixel information of the group of marking points is presented at the position of the developed marking component.
9. A blood vessel image correction system, comprising: an ultrasound catheter configured to acquire an image of a blood vessel to be corrected; At least one developing marking component is arranged on the sheath wall of the ultrasonic catheter, and can make the pixel information of a group of marking points appear at the position corresponding to the developing marking component in the image of the blood vessel to be corrected; at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the blood vessel image correction method according to any one of claims 1 to 6.
10. The system according to claim 9, wherein: The developing mark component is a developing ring or a filament made of metal material.
11. A computer-readable storage medium storing a computer program, wherein the computer program enables a processor to implement the blood vessel image correction method according to any one of claims 1 to 6 when executed.
Citation Information
Patent Citations
Blood vessel image correction method and device, medium and equipment
CN115861132A
Blood vessel image correction method, device, system and medium
CN116523796A
Marking device
WO2016006587A1
Laser projection device, and correction method for projected image
WO2023071256A1
