Vascular image correction method, apparatus, system, and medium

Abstract

Embodiments of the present application disclose a blood vessel image correction method, device, system and medium, wherein the method comprises: acquiring a to-be-corrected blood vessel image, and determining whether the to-be-corrected blood vessel image contains a set of marker points; when the to-be-corrected blood vessel image contains a set of marker points, extracting actual marker point pixel position information of the set of marker points in the to-be-corrected blood vessel image; determining offset information of each marker point based on the actual marker point pixel position information and reference marker point pixel position information; and correcting the to-be-corrected blood vessel image according to the offset information to obtain a target blood vessel image. Embodiments of the present application solve the problem of blood vessel image distortion caused by uneven rotation of a rotating wire, and improve the accuracy of blood vessel morphology in a blood vessel image.

Description

Technical Field

[0001] The present invention relates to the technical field of medical image processing, and in particular to a method, device, system and medium for correcting blood vessel images. Background Art

[0002] An intravascular ultrasound (IVUS) imaging system consists of a special catheter with an ultrasound probe attached to its end. By inserting the ultrasound probe into the cardiovascular cavity, the cross-sectional morphology of the cardiovascular system and / or blood flow patterns can be displayed.

[0003] Due to the complex vascular structure, the performance of the rotating wire / sheath in the intravascular ultrasound imaging system may be impaired during the rotation and retraction process. The rotating wire rotates unevenly, causing the obtained vascular image to be distorted and unable to reflect the true vascular morphology. Summary of the Invention

[0004] The present invention provides a blood vessel image correction method, device, system and medium, which improve the accuracy of blood vessel morphology in blood vessel images collected by an intravascular ultrasonic imaging system.

[0005] According to one aspect of the present invention, a blood vessel image correction method is provided, the method comprising:

[0006] Acquire a blood vessel image to be corrected, and determine whether the blood vessel image to be corrected contains a set of marking points;

[0007] When the blood vessel image to be corrected contains a group of marker points, extracting actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected;

[0008] Determine the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information;

[0009] The blood vessel image to be corrected is corrected according to the offset information to obtain a target blood vessel image.

[0010] According to another aspect of the present invention, there is provided a blood vessel image correction device, the device comprising:

[0011] A blood vessel image acquisition module is used to acquire the blood vessel image to be corrected and determine whether the blood vessel image to be corrected contains a set of marking points;

[0012] a marker pixel position information extraction module, configured to extract actual marker pixel position information of a group of markers in the vascular image to be corrected when the vascular image to be corrected contains a group of markers;

[0013] A marker point offset information determination module is used to determine the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information;

[0014] The blood vessel image correction module is used to correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.

[0015] According to another aspect of the present invention, a blood vessel image correction system is provided, the system comprising:

[0016] an ultrasound catheter, used for acquiring images of blood vessels to be corrected;

[0017] At least one developing marking component is provided on the sheath wall of the ultrasonic catheter, and can cause pixel information of a group of marking points to be presented at the position corresponding to the developing marking component in the image of the blood vessel to be corrected;

[0018] at least one processor; and

[0019] a memory communicatively connected to at least one processor; wherein,

[0020] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the blood vessel image correction method according to any embodiment of the present invention.

[0021] According to another aspect of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions, which are used to enable a processor to implement the blood vessel image correction method according to any embodiment of the present invention when executed.

[0022] The technical solution of the embodiment of the present invention obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. The technical solution of the embodiment of the present invention solves the problem of vascular image distortion caused by uneven rotation of the spinning wire and improves the accuracy of vascular morphology in the vascular image.

[0023] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 is a flow chart of a blood vessel image correction method provided according to an embodiment of the present invention;

[0026] Figure 2 is a schematic diagram of a developing ring provided according to an embodiment of the present invention;

[0027] Figure 3 is a structural schematic diagram of an intravascular ultrasonic imaging system provided according to an embodiment of the present invention;

[0028] Figure 4 is a schematic diagram of a blood vessel image to be corrected according to an embodiment of the present invention;

[0029] Figure 5 is a schematic diagram of an actual sector-shaped area provided according to an embodiment of the present invention;

[0030] Figure 6 is a schematic diagram of a marker reference image provided according to an embodiment of the present invention;

[0031] Figure 7 is a schematic diagram of a reference sector area provided according to an embodiment of the present invention;

[0032] Figure 8 is a flow chart of another blood vessel image correction method provided according to an embodiment of the present invention;

[0033] Figure 9 is a structural block diagram of a blood vessel image correction device provided according to an embodiment of the present invention;

[0034] Figure 10 4 is a structural block diagram of a blood vessel image correction system provided according to an embodiment of the present invention. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0036] It should be noted that the terms "first" and "second" and the like in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the numbers used in this way are interchangeable where appropriate so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatus.

[0037] Figure 1 This is a flowchart of a vascular image correction method provided according to an embodiment of the present invention. This embodiment is applicable to an intravascular ultrasound imaging system with set marker points. The method can be performed by a vascular image correction device. The vascular image correction device can be implemented in the form of hardware and / or software and configured in a processor of the vascular image correction system.

[0038] like Figure 1 As shown, the blood vessel image correction method of this embodiment includes the following steps:

[0039] S110 , obtaining a blood vessel image to be corrected, and determining whether the blood vessel image to be corrected contains a set of marking points.

[0040] The blood vessel image to be corrected is a blood vessel cross-sectional image of an imaging component (rotating wire) of the IVUS imaging system at any actual position in the blood vessel.

[0041] The marking points may be of any shape and size, as long as they can be presented as a group of marking points in the blood vessel image and do not excessively block the blood vessel imaging.

[0042] Typically, the wire rotates unevenly, and the cross-sectional image of the blood vessel may not reflect the actual blood vessel structure. Therefore, in a specific embodiment, an ultrasound catheter is used to collect the image of the blood vessel to be corrected, wherein a development marking component is provided on the sheath wall of the ultrasound catheter so that pixel information of a group of marking points is presented at the position of the development marking component in the image of the blood vessel to be corrected.

[0043] It is understandable that when imaging a cross-section of a blood vessel at the location corresponding to the placement of the development marker component, the development marker component will obstruct the vessel, affecting the imaging results of the vessel at that location. Therefore, the number of development marker components should not be too large. Specifically, due to the material properties of the development marker component, when imaging a cross-section of a blood vessel at the location corresponding to the placement of the development marker component, the ultrasound signal at that location will be affected, causing the brightness of the image at that location in the imaging result to be lower than the brightness of the image at a location without the development marker component, thereby affecting the imaging results of the vessel at that location. Therefore, in practical applications, the material of the development marker component can be selected to reduce ultrasonic attenuation, thereby obtaining an imaging result in which the development marker component does not completely obstruct the vessel at that location.

[0044] In one embodiment, due to the material properties of the developed marker component, when a cross-sectional image of a blood vessel at the location corresponding to the placement of the developed marker component is captured, the developed marker component obscures the blood vessel image, resulting in pixel information of a group of marker points in the cross-sectional image of the blood vessel appearing as high-grayscale pixels. Specifically, when pixel information of a group of marker points obscuring the blood vessel exists in the image of the blood vessel to be corrected, the image of the blood vessel to be corrected includes the group of marker points; when pixel information of a group of marker points obscuring the blood vessel does not exist in the image of the blood vessel to be corrected, the image of the blood vessel to be corrected does not include the group of marker points.

[0045] When a cross-section of a blood vessel at any actual position in the imaging position of the blood vessel image is located at the blood vessel position corresponding to the position where the development marker component is set, a cross-section image of the blood vessel at that actual position is acquired by the rotating wire. The cross-section image of the blood vessel includes pixel information of a group of marker points, wherein the rotating wire is located in the ultrasound catheter. It is understood that because the rotating wire acquires a cross-section image of the blood vessel, the cross-section image of the blood vessel will only include pixel information of a group of marker points at most.

[0046] S120 : When the blood vessel image to be corrected contains a group of marker points, extract actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected.

[0047] The actual pixel position information of the marker points may be the coordinates of the pixels of a group of marker points in the blood vessel image to be corrected or other information used to represent the positions of a group of marker points in the blood vessel image to be corrected.

[0048] Specifically, when there is a group of marking points of a developed marking component in the image of the blood vessel to be corrected, the group of marking points presents a group of pixel information of the marking points in the image of the blood vessel to be corrected, and the coordinates of the pixel information of the group of marking points in the image of the blood vessel to be corrected are determined to obtain the actual pixel position information of the marking points of the group of marking points.

[0049] S130 : Determine offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information.

[0050] The reference pixel position information of the marking points is the coordinates of a group of marking point pixels in the blood vessel cross-sectional image at the position of the development marking component in the blood vessel when the rotating wire rotates uniformly, or other information used to represent the position of a group of marking points in the blood vessel cross-sectional image.

[0051] The offset information may include the difference between the distance between the adjacent marker point pixels determined by the actual marker point pixel position information and the marker point reference pixel position information / the difference in the area occupied by the pixels of each marker point / the difference in the central angle of the fan-shaped area occupied by the pixels corresponding to each marker point, and may also include the difference between other quantitative indicators calculated based on the distance / area / central angle.

[0052] Optionally, an existing image segmentation / target detection-based algorithm or a trained image processing model is used to identify actual pixel position information of a group of marker points in the blood vessel image to be corrected.

[0053] Furthermore, based on the actual marking point pixel position information and the marking point reference pixel position information, determining the offset information of each marking point includes:

[0054] First, based on the actual pixel position information of the marker points, the actual sector-shaped area corresponding to each marker point is divided in the blood vessel image to be corrected.

[0055] Each actual sector area includes pixel information of a marked point in the blood vessel image and pixel information corresponding to a blood vessel adjacent to the pixel information.

[0056] In a specific embodiment, Figure 2 As shown, the developing marking component is a developing ring, such as Figure 3 As shown, the developing ring 77 is provided on the sheath 88 of the imaging component (rotating wire) 66 of the IVUS imaging system. Figure 4 The image of the blood vessel to be corrected corresponds to the position of the developing ring at which it is set. The image of the blood vessel to be corrected includes pixel information of a group (24) of marking points. The coordinates of the pixels of the marking points in the image of the blood vessel to be corrected are extracted as the actual pixel position information of the marking points. Figure 4 As shown in the figure, the pixel information of the marker point of the development ring in the image of the blood vessel to be corrected is the black part, and the white part in the same circle as the black part is the pixel information of the blood vessel. Based on the actual marker point pixel position information of the marker point of the development ring in the image of the blood vessel to be corrected, the position of the leftmost pixel point of each actual marker point pixel position information is taken as the starting point of each sector area, and the following is performed: Figure 5 The sector-shaped area shown is divided to obtain the sector-shaped area where each marking point is located as the actual sector-shaped area.

[0057] Optionally, the sector-shaped areas are divided by taking the position of the rightmost pixel point of each actual marking point pixel position information as the starting point of each sector-shaped area, which is not specifically limited in this embodiment.

[0058] Then, based on the reference pixel position information of the marker points, the marker point reference image is divided into reference sector areas corresponding to the marker points.

[0059] The marking point reference image is a blood vessel image in which the marking points in the development marking component are evenly distributed.

[0060] Optionally, the marker reference image may not include pixel information of blood vessels, as long as all markers are evenly distributed around the circumference.

[0061] Each reference sector area includes pixel information of a marking point in the to-be-corrected blood vessel image and pixel information of blood vessels adjacent to the pixel information.

[0062] In a specific embodiment, the marker reference image is as follows: Figure 6 As shown in the figure, the pixels of the marker points of the development ring in the marker point reference image are black. Based on the marker point reference pixel position information of the development ring in the marker point reference image, the position of the leftmost pixel of each reference marker point pixel position information is used as the starting point of each sector area, and the following is performed: Figure 7 The sector-shaped area shown is divided to obtain the sector-shaped area where each marking point is located as the reference sector-shaped area.

[0063] Optionally, the sector area is divided using the rightmost pixel point of each reference marker pixel position information as the starting point of each sector area, as long as the division rules of the reference sector area and the actual sector area are consistent.

[0064] Finally, the offset information of each marking point is determined according to the actual sector area and the reference sector area.

[0065] Specifically, the difference between the central angle of the corresponding fan-shaped area occupied by the pixel information of each marking point in the actual fan-shaped area and the reference fan-shaped area is used as the offset information of each marking point.

[0066] Optionally, the difference in sector area or arc length between the actual sector area and the reference sector area may be used as the offset information of each marking point.

[0067] S140 , correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.

[0068] Specifically, if the offset information is not zero, the actual marker pixel position information in the to-be-corrected blood vessel image is adjusted to be consistent with the marker reference pixel position information based on the offset information, that is, the distance between adjacent marker pixels in the to-be-corrected blood vessel image is adjusted to the distance between adjacent marker pixels corresponding to the marker reference pixel position information; or, the area occupied by all pixels of each marker in the to-be-corrected blood vessel image is adjusted to the area occupied by all pixels of each marker in the marker reference pixel position information.

[0069] In one specific embodiment, the central angles of the corresponding actual sector-shaped areas are adjusted according to the offset information to obtain the target vessel image. Specifically, if the offset of the marker point is not zero, the central angles of the actual sector-shaped areas are adjusted to match the central angle of the reference sector-shaped area, and the image after the adjustment is used as the target vessel image. This approach has the advantage of identifying the marker point and adjusting the sector-shaped area where the marker point is located, thereby correcting the pixels corresponding to the blood vessels in the same sector-shaped area to obtain the target vessel image.

[0070] Optionally, since the marker points in the reference vascular image are evenly distributed, it is also possible not to obtain a reference vascular image with marker points. Instead, based on the number of marker points, the angle of the central angle corresponding to the reference sector area is obtained by calculating (360° / number of marker points), and the angle of the central angle is used as the reference pixel position information of the marker points to correct the vascular image to be corrected.

[0071] The technical solution of the embodiment of the present invention obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. The technical solution of the embodiment of the present invention solves the problem of vascular image distortion caused by uneven rotation of the spinning wire and improves the accuracy of vascular morphology in the vascular image.

[0072] Figure 8 This is a flowchart of another vascular image correction method according to an embodiment of the present invention. This embodiment shares the same inventive concept as the vascular image correction method described in the previous embodiment and further describes the process of performing vascular image correction on a vascular image to be corrected when the image lacks marker pixel position information. This method can be performed by a vascular image correction device, which can be implemented using software and / or hardware and configured in a processor of a vascular image correction system.

[0073] like Figure 8As shown, the blood vessel image correction method of this embodiment includes the following steps:

[0074] S210 , obtaining a blood vessel image to be corrected, and determining whether the blood vessel image to be corrected contains a set of marking points.

[0075] S220 : When the blood vessel image to be corrected contains a group of marker points, extract actual marker point pixel position information of the group of marker points in the blood vessel image to be corrected.

[0076] S230 : Determine offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information.

[0077] S240 , correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image.

[0078] S250 : When the blood vessel image to be corrected does not contain pixel information of the marker point, obtain a correction reference blood vessel image adjacent to the blood vessel image to be corrected and containing pixel information of the marker point.

[0079] After S210 , if the blood vessel image to be corrected includes a set of marker points, S220 , S230 , and S240 are executed; if the blood vessel image to be corrected does not include a set of marker points, S250 and S260 are executed.

[0080] When only one development marking component is set in the IVUS imaging system, the imaging position of the correction reference blood vessel image is adjacent to the imaging position of the blood vessel image to be corrected, and the imaging position is closest to the imaging position of the blood vessel image to be corrected. The correction reference blood vessel image includes a blood vessel cross-sectional image corresponding to the setting position of the development marking component.

[0081] When multiple imaging marker components are installed at a set distance in an IVUS imaging system, and the imaging component's rotating wire is positioned between two adjacent imaging marker components, the image of the vessel to be corrected at the imaging position of the vessel image does not include the marker pixel information. A correction reference vessel image is adjacent to the vessel to be corrected, and the imaging position of the correction reference vessel image includes the imaging position of the imaging marker component. The correction reference vessel image includes the vessel cross-sectional images corresponding to the imaging marker component locations. Exemplarily, the correction reference vessel image is adjacent to the vessel to be corrected, and the imaging position of the correction reference vessel image includes two vessel cross-sectional images corresponding to the two adjacent imaging marker component locations. It is understood that when the imaging component's rotating wire is positioned before the first imaging marker component, the image of the vessel to be corrected at the imaging position of the correction reference vessel image does not include the marker pixel information. The imaging position of the correction reference vessel image is adjacent to the imaging position of the vessel to be corrected, and the imaging position of the correction reference vessel image includes the imaging position of the first imaging marker component. The correction reference vessel image includes the vessel cross-sectional image corresponding to the first imaging marker component location.

[0082] Similarly, when the imaging component's rotating wire is positioned after the last developed marker component, the vessel image to be corrected at that imaging position also does not include the marker pixel information. The correction reference vessel image is adjacent to the vessel image to be corrected, and the imaging position of the correction reference vessel image includes the last developed marker component setting position. The correction reference vessel image includes the vessel cross-sectional image corresponding to the last developed marker component setting position.

[0083] In addition, the first and last development marking components can also be directly set at the two end points of the sheath of the vascular imaging system, so that the blood vessel positions corresponding to all blood vessel images to be corrected that do not include the marking points are located at the blood vessel positions between the two development marking components, that is, each blood vessel image to be corrected that does not include the pixel position information of the marking points has a correction reference blood vessel image.

[0084] S260 , correcting the vascular image to be corrected based on the offset information of the marking points in the corrected reference vascular image to obtain a target vascular image.

[0085] First, the actual pixel position information of the marker points in the correction reference vascular image is extracted, and the offset information of each marker point in the correction reference image is determined based on the actual pixel position information of the marker points and the reference pixel position information of the marker points. Then, the weight of the offset information of each marker point in the correction reference image is determined based on the distance between the vascular position corresponding to the vascular image to be corrected and the vascular position corresponding to the correction reference image. Finally, the vascular image to be corrected is corrected based on the offset information of each marker point in the correction reference image and its weight to obtain the target vascular image.

[0086] When only one development marking component is provided in the IVUS imaging system, each to-be-corrected blood vessel image that does not contain pixel position information of the marking point is corrected according to the offset information of the marking point in the correction reference blood vessel image.

[0087] Optionally, a distance threshold may be set. When the distance between the blood vessel position corresponding to the to-be-corrected blood vessel image and the blood vessel position corresponding to the correction reference image is less than or equal to the distance threshold, the to-be-corrected blood vessel image is corrected based on the offset information of the marker points in the correction reference blood vessel image. It will be appreciated that the distance between two adjacent development marker components may also be set to be less than or equal to the distance threshold when the development marker components are provided.

[0088] Furthermore, the corrected reference vascular image includes correcting the vascular image to be corrected based on offset information of marker points in the corrected reference vascular image when a first corrected reference vascular image acquired before the vascular image to be corrected and a second corrected reference vascular image acquired after the vascular image to be corrected is acquired, including:

[0089] First, first offset information of each marker point in the first corrected reference blood vessel image and second offset information of each marker point in the second corrected reference blood vessel image are obtained.

[0090] Specifically, when the blood vessel position corresponding to the correction reference blood vessel image is between the blood vessel positions corresponding to two development marking components, based on the movement direction of the imaging component, the blood vessel cross-sectional image corresponding to the development marking component setting position that the imaging component passed first is used as the first correction reference blood vessel image, and the blood vessel cross-sectional image corresponding to the development marking component setting position that the imaging component passed later is used as the second correction reference blood vessel image.

[0091] Based on the actual marker point pixel position information and the marker point reference pixel position information of each marker point in the first corrected reference blood vessel image, the offset information of each marker point in the first corrected reference blood vessel is determined as the first offset information. Simultaneously, based on the actual marker point pixel position information and the marker point reference pixel position information of each marker point in the second corrected reference blood vessel image, the offset information of each marker point in the second corrected reference blood vessel is determined as the second offset information.

[0092] Then, the weight values ​​of the first offset information and the second offset information are determined according to the distances between the blood vessel position corresponding to the to-be-corrected blood vessel image and the blood vessel positions corresponding to the first and second corrected reference blood vessel images.

[0093] Specifically, the distance between the blood vessel cross-section position corresponding to the to-be-corrected blood vessel image and the blood vessel cross-section position corresponding to the first corrected reference blood vessel image is determined as the first distance; simultaneously, the distance between the blood vessel cross-section position corresponding to the to-be-corrected blood vessel image and the blood vessel cross-section position corresponding to the second corrected reference blood vessel image is determined as the second distance; secondly, the sum of the first distance and the second distance is determined, that is, the distance between two adjacent development marking components at the blood vessel cross-section position corresponding to the to-be-corrected blood vessel image; and then, the ratio of the first distance to the sum of the distances is used as the weight value of the first offset information, and the ratio of the second distance to the sum of the distances is used as the weight value of the second offset information.

[0094] Finally, target offset information is determined based on the first offset information, the second offset information, and the weight value, and the blood vessel image to be corrected is corrected based on the target offset information.

[0095] Specifically, the sum of the multiplication of the offset information and the corresponding weight value is used as the target offset information of the vascular image to be corrected. That is, the first offset information and the weight value of the first offset information are multiplied to obtain the first initial offset information, and the second offset information and the weight value of the second offset information are multiplied to obtain the second initial offset information. Then, the first initial offset information and the second initial offset information are added to obtain the target offset information. Finally, the vascular image to be corrected is corrected according to the target offset information in the corrected reference vascular image to obtain the target vascular image.

[0096] In a specific embodiment, based on the first frame data of the corresponding blood vessel cross-sectional image obtained when the wire is rotated, the first marking point closest to the first frame data in the first correction reference blood vessel image and the second correction reference blood vessel image and the starting point of the blood vessel image to be corrected are respectively determined; the difference between the center angle of the actual sector area of ​​the first marking point in the first correction reference blood vessel image and the center angle of the reference sector area is used as the first offset information of the starting point; at the same time, the difference between the center angle of the actual sector area of ​​the first marking point in the second correction reference blood vessel image and the center angle of the reference sector area is used as the second offset information of the starting point; then, based on the blood vessel image to be corrected, the first marking point is used as the starting point of the correction. The weight values ​​of the first and second offset information of the starting point are determined based on the distance between the corresponding blood vessel position and the corresponding blood vessel positions in the first and second corrected reference blood vessel images, respectively. The weighted sum of the first and second offset information of the starting point is used as the target offset information of the starting point. If the target offset information of the starting point is not zero, the difference between the central angle of the target offset information of the starting point and the central angle of the corresponding reference sector is determined. In the blood vessel image to be corrected, the sector corresponding to the difference starting from the starting point is determined as the first actual sector at the starting point, and the central angle of the actual sector is adjusted to the central angle of the reference sector. Then, based on the marker point offset information of the actual sector of the second marker point in the first and second corrected reference images, the target offset information corresponding to the sector adjacent to the first actual sector in the blood vessel image to be corrected is determined. The first actual sector in the blood vessel image to be corrected is corrected based on the target offset information. Similarly, all sectors in the blood vessel image to be corrected are corrected based on the offset information of all marker points in the corrected reference blood vessel images to obtain the target blood vessel image.

[0097] The technical solution of this embodiment obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. Furthermore, if the image to be corrected does not contain marker pixel information, a correction reference vascular image adjacent to the image to be corrected, i.e., one containing marker pixel information, is obtained. The image to be corrected is corrected based on the offset information of the marker points in the correction reference vascular image to obtain a target vascular image. The technical solution of this embodiment solves the problem of vascular image distortion caused by uneven wire rotation and further improves the accuracy of vascular morphology in the vascular image.

[0098] Figure 9This is a block diagram of a vascular image correction device according to an embodiment of the present invention. This embodiment is applicable to scenarios where vascular image correction is performed in an intravascular ultrasonic imaging system equipped with marker pixel information. The device can be implemented using software and / or hardware and integrated into a vascular image correction system with application development capabilities.

[0099] like Figure 9 As shown, the blood vessel image correction device includes: a blood vessel image acquisition module 401, a marker pixel position information extraction module 402, a marker offset information determination module 403 and a blood vessel image correction module 404.

[0100] The vascular image acquisition module 401 is used to acquire a vascular image to be corrected and determine whether the vascular image to be corrected contains a set of marker points. The marker point pixel position information extraction module 402 is used to extract the actual marker point pixel position information of the set of marker points in the vascular image to be corrected when the vascular image to be corrected contains a set of marker points. The marker point offset information determination module 403 is used to determine the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information. The vascular image correction module 404 is used to correct the vascular image to be corrected based on the offset information to obtain a target vascular image.

[0101] The technical solution of this embodiment obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. This technical solution solves the problem of vascular image distortion caused by uneven rotation of the wire and improves the accuracy of vascular morphology in the vascular image.

[0102] Optionally, the vascular image acquisition module is also used to: collect the vascular image to be corrected through an ultrasonic catheter, wherein a development marking component is provided on the sheath wall of the ultrasonic catheter, and the development marking component causes the pixel information of a group of marking points to be presented at the position corresponding to the development marking component in the vascular image to be corrected.

[0103] Optionally, the marking point offset information determining module 403 is further configured to:

[0104] Based on the pixel position information of the actual marker points, the actual sector-shaped area corresponding to each marker point is divided in the blood vessel image to be corrected;

[0105] Divide the reference sector area corresponding to each marker point in the marker point reference image based on the reference pixel position information of the marker point;

[0106] The offset information of each marking point is determined according to the actual sector area and the reference sector area.

[0107] Optionally, the marker offset information determination module 403 further includes a sector area center angle adjustment unit, which is specifically configured to adjust the center angle of each corresponding actual sector area according to each offset information to obtain a target blood vessel image.

[0108] Optionally, the vascular image correction device further includes a correction reference vascular image acquisition module, wherein the correction reference vascular image acquisition module is configured to:

[0109] Acquire a correction reference blood vessel image containing pixel information of a marker point adjacent to the blood vessel image to be corrected;

[0110] The blood vessel image to be corrected is corrected based on the offset information of the marker points in the corrected reference blood vessel image.

[0111] Optionally, the corrected reference blood vessel image acquisition module includes a corrected reference blood vessel image offset determination unit, and the corrected reference blood vessel image offset determination unit is configured to:

[0112] Acquire first offset information of each marker point in the first corrected reference blood vessel image and second offset information of each marker point in the second corrected reference blood vessel image;

[0113] determining weight values ​​of the first offset information and the second offset information according to distances between a blood vessel position corresponding to the to-be-corrected blood vessel image and blood vessel positions corresponding to the first and second correction reference blood vessel images;

[0114] Target offset information is determined based on the first offset information, the second offset information, and the weight value, and the blood vessel image to be corrected is corrected based on the target offset information.

[0115] The vascular image correction device provided by the embodiment of the present invention can execute the vascular image correction method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0116] Figure 10 This is a structural block diagram of a vascular image correction system provided according to an embodiment of the present invention. This embodiment is applicable to scenarios where marker point pixel information is set for vascular image correction. The system can be implemented by software and / or hardware.

[0117] The components shown herein, their connections and relationships, and their functions, are examples only, and are not meant to limit implementations of the inventions described and / or claimed herein.

[0118] like Figure 10 As shown, Figure 10 As shown, the vascular image correction system 10 includes: an ultrasonic catheter 501 for acquiring vascular images; at least one development marking component 502 for developing pixel information of a group of marking points in the vascular image corresponding to the setting position of the development marking component; at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc.

[0119] In a specific embodiment, the developer marking member 502 is a developer ring (see Figure 2 ) or filaments made of metal materials. The filaments can be arranged on the inner wall of the sheath of the ultrasound catheter 501. The filaments will not excessively obstruct the vascular image of the imaging component at the corresponding vascular cross-section position, and the metal material has strong acoustic wave reflectivity, ensuring clear imaging of the marker points. For example, when manufacturing the sheath, 24 metal wires are evenly embedded in the sheath, so that the image of the vascular to be corrected obtained by the imaging component during the rotation and retraction process always includes a set of marker points. Furthermore, the vascular image to be corrected is corrected based on the offset information of the marker points to obtain the target vascular image.

[0120] The memory stores computer programs executable by at least one processor. Processor 11 can perform various appropriate actions and processes based on computer programs stored in read-only memory (ROM) 12 or loaded from storage unit 18 into random access memory (RAM) 13. RAM 13 may also store various programs and data required for the operation of vascular image correction system 10. Processor 11, ROM 12, and RAM 13 are interconnected via bus 14. An input / output (I / O) interface 15 is also connected to bus 14.

[0121] Multiple components in the vascular image correction system 10 are connected to an I / O interface 15, including an input unit 16, such as a keyboard and mouse; an output unit 17, such as various types of displays and speakers; a storage unit 18, such as a magnetic disk and optical disk; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the vascular image correction system 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0122] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the vascular image correction method.

[0123] In some embodiments, the vascular image correction method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed into the vascular image correction system 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the vascular image correction method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the vascular image correction method in any other suitable manner (e.g., via firmware).

[0124] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0125] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0126] The technical solution of the embodiment of the present invention obtains a vascular image to be corrected and determines whether the image contains a set of marker points. If the image contains a set of marker points, the actual marker pixel position information of the set of marker points in the image is extracted. Based on the actual marker pixel position information and the marker reference pixel position information, the offset information of each marker point is determined. The image to be corrected is corrected based on the offset information to obtain a target vascular image. The technical solution of the embodiment of the present invention solves the problem of vascular image distortion caused by uneven wire rotation and improves the accuracy of vascular morphology in the vascular image.

[0127] The vascular image correction system provided by the embodiment of the present invention can execute the vascular image correction method provided by any embodiment of the present invention, and has the corresponding beneficial effects of executing the method.

[0128] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0129] To provide user interaction, the devices and techniques described herein can be implemented on a vascular image correction system that includes: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the vascular image correction system. Other types of devices can also be used to provide user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic input, voice input, or tactile input.

[0130] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0131] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0132] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0133] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A blood vessel image correction method, characterized in that: The method comprises: Acquire a blood vessel image to be corrected, and determine whether the blood vessel image to be corrected contains a set of marking points; When the blood vessel image to be corrected contains a group of marking points, extracting actual marking point pixel position information of the group of marking points in the blood vessel image to be corrected; Determining offset information of each of the marking points based on the actual marking point pixel position information and the marking point reference pixel position information; Correcting the to-be-corrected blood vessel image according to the offset information to obtain a target blood vessel image; The acquiring of the blood vessel image to be corrected comprises: The image of the blood vessel to be corrected is collected by an ultrasound catheter, wherein a development marking component is provided on the sheath wall of the ultrasound catheter, and the development marking component causes pixel information of the group of marking points to be presented at positions corresponding to the development marking component in the image of the blood vessel to be corrected.

2. The method according to claim 1, characterized in that The determining the offset information of each marker point based on the actual marker point pixel position information and the marker point reference pixel position information includes: Based on the pixel position information of the actual marking points, dividing the actual sector-shaped area corresponding to each of the marking points in the blood vessel image to be corrected; Dividing the reference sector area corresponding to each marker point in the marker point reference image based on the marker point reference pixel position information; The offset information of each marking point is determined according to the actual sector-shaped area and the reference sector-shaped area.

3. The method according to claim 2, characterized in that Correcting the to-be-corrected blood vessel image according to the offset information to obtain a target blood vessel image includes: According to the offset information, the central angle of each corresponding actual sector area is adjusted to obtain a target blood vessel image.

4. The method according to claim 1, wherein When the blood vessel image to be corrected does not contain pixel information of the marker point, the method further includes: Acquire a correction reference blood vessel image adjacent to the blood vessel image to be corrected and containing pixel information of a marker point; The blood vessel image to be corrected is corrected based on the offset information of the marking points in the corrected reference blood vessel image.

5. The method according to claim 4, characterized in that When the corrected reference vascular image includes a first corrected reference vascular image acquired before and a second corrected reference vascular image acquired after the vascular image to be corrected, correcting the vascular image to be corrected based on offset information of marker points in the corrected reference vascular image includes: Acquire first offset information of each marker point in the first corrected reference blood vessel image and second offset information of each marker point in the second corrected reference blood vessel image; determining weight values ​​of the first offset information and the second offset information according to distances between a blood vessel position corresponding to the to-be-corrected blood vessel image and blood vessel positions corresponding to the first corrected reference blood vessel image and the second corrected reference blood vessel image; Target offset information is determined based on the first offset information, the second offset information, and the weight value, and the to-be-corrected blood vessel image is corrected based on the target offset information.

6. A blood vessel image correction device, characterized in that: include: a blood vessel image acquisition module, configured to acquire a blood vessel image to be corrected and determine whether the blood vessel image to be corrected contains a set of marking points; a marker pixel position information extraction module, configured to extract actual marker pixel position information of a group of markers in the vascular image to be corrected when the vascular image to be corrected contains a group of markers; a marking point offset information determining module, configured to determine the offset information of each marking point based on the actual marking point pixel position information and the marking point reference pixel position information; a blood vessel image correction module, configured to correct the blood vessel image to be corrected according to the offset information to obtain a target blood vessel image; The blood vessel image acquisition module is used for: The image of the blood vessel to be corrected is collected by an ultrasound catheter, wherein a development marking component is provided on the sheath wall of the ultrasound catheter, and the development marking component causes pixel information of the group of marking points to be presented at positions corresponding to the development marking component in the image of the blood vessel to be corrected.

7. A blood vessel image correction system, characterized in that: The system comprises: an ultrasound catheter, used for acquiring images of blood vessels to be corrected; At least one developing marking component is provided on the sheath wall of the ultrasonic catheter, and can cause pixel information of a group of marking points to be presented at a position corresponding to the developing marking component in the image of the blood vessel to be corrected; at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the blood vessel image correction method according to any one of claims 1 to 5.

8. The system according to claim 7, characterized in that The developing mark component is a developing ring or a filament made of metal material.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the blood vessel image correction method according to any one of claims 1 to 5 when executed.

Images