Heart electrophysiological imaging enhancement method and system based on cursor measurement

By collecting electric signals and calcium transient signal images, the core area of ​​RGB single channel is determined, and histogram equalization is carried out in combination with coupling, which solves the color distortion and details caused by the enhancement method of cursor cardiac electrophysiological image in the prior art. Loss problem improves image enhancement effect.

CN118941486AActive Publication Date: 2024-11-12PEVI INSTR LTD HENAN
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411250827.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-06
Publication Date
2024-11-12
Estimated Expiration
2044-09-06

AI Technical Summary

Technical Problem

The existing cursor-based electrophysiological image enhancement method for heart measurement is color distortion and details lost due to RGB three-channel equalization during histogram equalization, which affects the image enhancement effect.

Method used

By collecting the electric signal change image and the calcium transient signal image, the first core area to be enhanced and the second core area to be enhanced in the RGB single channel are determined respectively. Combining the coupling between the electric signal and the calcium transient, a histogram is performed. Equalize and merge processes to preserve the color and details of the image.

Benefits of technology

Improve image enhancement effect, avoid color distortion and detail loss, and ensure accurate interpretation of the electrophysiological activity information of cardiomyocytes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941486A_ABST
    Figure CN118941486A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of image data processing, in particular to a heart electrophysiological imaging enhancement method and system based on cursor measurement, and the method comprises the steps: collecting an electric signal change image and a calcium transient signal image, determining a first to-be-enhanced core region of each RGB single channel according to the electric signal change image, and determining a second to-be-enhanced core region of each RGB single channel according to the calcium transient signal image; determining a second to-be-enhanced core area of each RGB single channel, determining a first final core area in the electric signal change image and a second final core area in the calcium transient signal image according to the first to-be-enhanced core area and the second to-be-enhanced core area, and determining the first final core area in the electric signal change image and the second final core area in the calcium transient signal image by considering the coupling between the electric signal and the calcium transient in the cursor measurement. A first final core region and a second final core region are determined more accurately; therefore, histogram equalization and merging processing are carried out according to the first final core region and the second final core region, so that the color and detail parts of the image can be reserved, and the final image enhancement effect is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image data processing, and in particular to a cardiac electrophysiological imaging enhancement method and system based on cursor measurement. Background Art

[0002] Cursor electrometry is an imaging technology used to record cardiac electrophysiological activity. It uses fluorescent probes and high-speed cameras to provide detailed understanding of cardiac activity and arrhythmias. In cursor electrometry, the images obtained often have problems such as low contrast, noise interference, and non-specific binding of fluorescent dyes. These problems will cause the key information in the image to be not prominent enough, thus affecting the accurate interpretation of the electrophysiological activity of myocardial cells.

[0003] In view of the above problems, color images are usually enhanced. In the process of enhancing cardiac electrophysiological images, the existing image enhancement method directly performs equalization on all RGB channels of the color image when performing histogram equalization on the color image. However, due to the special imaging characteristics of the cursor measurement technology, the degree values ​​of the target pixels that actually need to be enhanced in the RGB three-channel image are different. Therefore, directly performing histogram equalization on the RGB three-channel image will cause the color of the original image to be distorted and the details of the image to be lost, resulting in poor image enhancement effect. Summary of the invention

[0004] In order to solve the above technical problems, the purpose of the present invention is to provide a method and system for enhancing cardiac electrophysiological imaging based on cursor measurement, and the technical solutions adopted are as follows:

[0005] In a first aspect, an embodiment of the present invention provides a method for enhancing cardiac electrophysiological imaging based on cursor measurement, comprising:

[0006] Collect electrical signal change images and calcium transient signal images;

[0007] Determine a first core region to be enhanced for each RGB single channel according to the electrical signal change image, and determine a second core region to be enhanced for each RGB single channel according to the calcium transient signal image;

[0008] Determining a first final core region in the electrical signal change image and a second final core region in the calcium transient signal image according to the first core region to be enhanced and the second core region to be enhanced;

[0009] Histogram equalization and merging processing are performed according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

[0010] In one embodiment, collecting electrical signal change images and calcium transient signal images includes:

[0011] The cardiac cell membrane is stained with voltage-sensitive dyes, the heart is illuminated with excitation light, and the emission light of the voltage-sensitive dye is collected with a high-speed camera to obtain an image of the electrical signal changes;

[0012] The calcium ions in the heart cells are labeled with calcium-sensitive dyes, the heart is irradiated with excitation light, and the emission light of the calcium-sensitive dye is collected by a high-speed camera to obtain a calcium transient signal image.

[0013] In one implementation, determining the first core area to be enhanced for each RGB single channel according to the electrical signal change image includes:

[0014] Determine first single-channel images corresponding to RGB channels respectively according to the electrical signal change image, and divide each of the first single-channel images into a plurality of first small blocks of preset sizes;

[0015] Determine the possibility of destruction of the fluctuation continuity of each row of pixel points in each of the first small blocks;

[0016] According to each of the destruction possibilities, determining the possibility that each of the first small blocks is a first core area to be enhanced;

[0017] According to the possibility that each of the first small blocks is the first core area to be enhanced and the possibility threshold, the first core area to be enhanced of each of the first single-channel images is determined to obtain the first core area to be enhanced of each RGB single channel.

[0018] In one implementation, determining the possibility of destruction of the fluctuation continuity of each row of pixels in each of the first small blocks includes:

[0019] Determine the gray value fluctuation curve of each row of pixels in each of the first small blocks respectively;

[0020] Determine the extreme value points of each of the gray value fluctuation curves respectively, and use every two adjacent extreme value points to determine a sub-curve segment, to obtain the number of sub-curve segments corresponding to each of the gray value fluctuation curves;

[0021] A first difference between the number of each sub-curve segment and a preset number is calculated respectively, and the possibility of destruction of the fluctuation continuity of each row of pixel points in each first small block is obtained according to the first difference and a normalization function.

[0022] In one embodiment, determining the possibility that each of the first small blocks is the first core area to be enhanced according to each of the destruction possibilities includes:

[0023] Sum each of the destruction possibilities of each of the first small blocks respectively, and calculate the sum of the destruction possibilities corresponding to each of the first small blocks;

[0024] Calculating the ratio of the total number of destruction probabilities corresponding to the first small blocks to the number of pixel rows of the first small blocks respectively, to obtain the probability that each of the first small blocks is the first core area to be enhanced;

[0025] The possibility of the first core area to be enhanced is characterized by the probability of the area where pathological changes occur.

[0026] In one embodiment, determining the second core area to be enhanced for each RGB single channel according to the calcium transient signal image comprises:

[0027] According to the calcium transient signal image, second single-channel images corresponding to the RGB channels are determined respectively, and each of the second single-channel images is divided into a plurality of second small blocks of preset sizes;

[0028] Determine the mean grayscale value of each of the second small blocks according to the grayscale values ​​of all pixels in each of the second small blocks;

[0029] Calculating the absolute value of the second difference between each gray value mean and the gray value standard value respectively, and determining the gray value non-uniformity of each second small block according to the ratio of the absolute value to the gray value standard value;

[0030] Compare the grayscale value non-uniformity of each of the second small blocks with a non-uniformity threshold, and take the second small block whose grayscale value non-uniformity is greater than the non-uniformity threshold as the target second small block;

[0031] According to the second small blocks of the target corresponding to each of the second single-channel images, second core regions to be enhanced corresponding to each of the second single-channel images are constructed to obtain second core regions to be enhanced for each of the RGB single channels.

[0032] In one embodiment, determining the first final core area in the electrical signal change image and the second final core area in the calcium transient signal image according to the first core area to be enhanced and the second core area to be enhanced includes:

[0033] Respectively determine, in the same single channel, a first target area where the first core area to be enhanced is the same as the second core area to be enhanced and a second target area where the first core area to be enhanced is different from the second core area to be enhanced;

[0034] Determine a core small block of the second target area, where the core small block includes a first small block and a second small block within the second target area;

[0035] Calculate the score value of each core block as the enhanced area, and take the core block with a score value less than the score threshold as the final core block to be enhanced;

[0036] The first final core area in the electrical signal change image is determined based on the first target area in each of the first core areas to be enhanced and the corresponding final core block to be enhanced, and the second final core area in the calcium transient signal image is determined based on the first target area in each of the second core areas to be enhanced and the corresponding final core block to be enhanced.

[0037] In one embodiment, calculating the score value of each core block as an enhanced area includes:

[0038] Determine a first target small block belonging to the first small block and a second target small block belonging to the second small block from all the core small blocks;

[0039] Calculate the first distance value between each of the first target small blocks and each of the second target small blocks respectively, and use the minimum first distance value corresponding to each of the first target small blocks as the first target distance value respectively, and calculate the second distance value between each of the second target small blocks and each of the first target small blocks respectively, and use the minimum second distance value corresponding to each of the second target small blocks as the second target distance value respectively;

[0040] Determining a distance threshold according to the longest side length of the electrical signal change image;

[0041] The score value of each first target small block is determined according to the difference between the first target distance value and the distance threshold, and the score value of each second target small block is determined according to the difference between the second target distance value and the distance threshold.

[0042] In one embodiment, performing histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image includes:

[0043] According to the first final core area and the second final core area, a target final core area of ​​each RGB single channel is correspondingly constituted, and an area outside the target final core area is used as a remaining core area of ​​each RGB single channel;

[0044] Performing histogram equalization according to the final core area and the remaining core area respectively, to obtain a first enhanced single-channel image of each RGB single channel of the electrical signal change image and a second enhanced single-channel image of each RGB single channel of the calcium transient signal image;

[0045] The first enhanced single-channel images are merged to obtain an enhanced target electrical signal change image, and the second enhanced single-channel images are merged to obtain an enhanced target calcium transient signal image.

[0046] In a second aspect, an embodiment of the present invention provides a cardiac electrophysiological imaging enhancement system based on cursor measurement, comprising:

[0047] An acquisition module, used for acquiring electrical signal change images and calcium transient signal images;

[0048] A first determination module is used to determine a first core area to be enhanced for each RGB single channel according to the electrical signal change image, and to determine a second core area to be enhanced for each RGB single channel according to the calcium transient signal image;

[0049] A second determination module is used to determine a first final core area in the electrical signal change image and a second final core area in the calcium transient signal image according to the first core area to be enhanced and the second core area to be enhanced;

[0050] The enhancement module is used to perform histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

[0051] The present invention has the following beneficial effects:

[0052] By collecting the electrical signal change image and the calcium transient signal image, the first core area to be enhanced of each RGB single channel is determined according to the electrical signal change image, and the second core area to be enhanced of each RGB single channel is determined according to the calcium transient signal image, and the first final core area in the electrical signal change image and the second final core area in the calcium transient signal image are determined according to the first core area to be enhanced and the second core area to be enhanced, and the first final core area and the second final core area are determined more accurately by considering the coupling between the electrical signal and the calcium transient measured by the cursor; therefore, histogram equalization and merging processing are performed according to the first final core area and the second final core area, which is conducive to retaining the color and details of the image and ensuring the final image enhancement effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0054] Figure 1 A schematic flow chart of the steps of a cardiac electrophysiological imaging enhancement method based on cursor measurement provided by one embodiment of the present invention;

[0055] Figure 2 It is a schematic diagram of a normal electrical signal change image;

[0056] Figure 3 This is a schematic diagram of the image of electrical signal changes in myocardial infarction;

[0057] Figure 4 Schematic diagram of a normal calcium transient signal image;

[0058] Figure 5 This is a schematic diagram of calcium transient signal images of myocardial infarction;

[0059] Figure 6 A schematic diagram of a first single-channel image corresponding to a channel R provided by an embodiment of the present invention;

[0060] Figure 7 A schematic diagram of a first single-channel image corresponding to a channel G provided by an embodiment of the present invention;

[0061] Figure 8 A schematic diagram of a first single-channel image corresponding to channel B provided by an embodiment of the present invention;

[0062] Fig. 9 A schematic diagram of a second single-channel image corresponding to a channel R provided by an embodiment of the present invention;

[0063] Fig.10 A schematic diagram of a second single-channel image corresponding to a channel G provided by an embodiment of the present invention;

[0064] Fig.11 A schematic diagram of a second single-channel image corresponding to channel B provided by an embodiment of the present invention;

[0065] Fig.12 A schematic diagram of an electrical signal change image before enhancement provided by an embodiment of the present invention;

[0066] Fig.13 A schematic diagram of an enhanced target electrical signal change image provided by an embodiment of the present invention;

[0067] Fig.14 A schematic diagram of a calcium transient signal image before enhancement provided by an embodiment of the present invention;

[0068] Fig.15 A schematic diagram of an enhanced target calcium transient signal image provided by one embodiment of the present invention;

[0069] Fig.16 A structural block diagram of a cardiac electrophysiological imaging enhancement system based on cursor measurement provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0070] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following is a detailed description of the specific implementation, structure, features and effects of a cardiac electrophysiological imaging enhancement method and system based on cursor measurement proposed by the present invention in combination with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.

[0071] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0072] The specific scheme of a cardiac electrophysiological imaging enhancement method and system based on cursor measurement provided by the present invention is described in detail below in conjunction with the accompanying drawings.

[0073] See also Figure 1 , which shows a flow chart of a cardiac electrophysiological imaging enhancement method based on cursor measurement provided by an embodiment of the present invention. The cardiac electrophysiological imaging enhancement method based on cursor measurement may at least include steps S100-S400:

[0074] S100, collecting electrical signal change images and calcium transient signal images.

[0075] S200 , determining a first core region to be enhanced for each RGB single channel according to the electrical signal change image, and determining a second core region to be enhanced for each RGB single channel according to the calcium transient signal image.

[0076] S300 , determining a first final core region in the electrical signal change image and a second final core region in the calcium transient signal image according to the first core region to be enhanced and the second core region to be enhanced.

[0077] S400 , performing histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

[0078] The technical solution of the embodiment of the present invention collects an electrical signal change image and a calcium transient signal image, determines the first core area to be enhanced of each RGB single channel according to the electrical signal change image, and determines the second core area to be enhanced of each RGB single channel according to the calcium transient signal image, determines the first final core area in the electrical signal change image and the second final core area in the calcium transient signal image according to the first core area to be enhanced and the second core area to be enhanced, considers the coupling between the electrical signal and the calcium transient measured by the cursor, and more accurately determines the first final core area and the second final core area; therefore, histogram equalization and merging processing are performed according to the first final core area and the second final core area, which is beneficial to retaining the color and detail parts of the image and ensuring the final image enhancement effect.

[0079] In the embodiment of the present invention, electrical signals and calcium changes play a vital role in the electrophysiological activities of the heart and are closely coupled. Therefore, electrical signal change images and calcium transient signal images are collected for analysis to observe the overall changes of ECG signals and calcium signals before and after arrhythmia, thereby promoting in-depth analysis of cardiac electrophysiological research.

[0080] In one embodiment, voltage-sensitive dyes, i.e., bipolar molecules, are used to stably bind to the phospholipid bilayer of the cardiac cell membrane. They can sense changes in the electric field inside and outside the cell membrane and make adaptive structural changes. Under the action of excitation light, this structure will cause its fluorescence intensity to change, thereby accurately reflecting changes in membrane potential. Therefore, in step S100, the cardiac cell membrane is stained with voltage-sensitive dyes, and after staining, the heart is irradiated with 530nm excitation light, and the emission light of the voltage-sensitive dye is collected by an EMCCD high-speed camera, thereby obtaining an instantaneous membrane potential signal, i.e., an electrical signal change image. In addition, based on a similar principle, calcium ions in cardiac cells are labeled with calcium-sensitive dyes, and the heart is irradiated with 530nm excitation light and the emission light of the calcium-sensitive dye is collected by an EMCCD high-speed camera to obtain a calcium transient signal image; the electrical signal change image and the calcium transient signal image are collectively referred to as a cardiac electrophysiological image. Figure 2 , Figure 3 , Figure 4 and Figure 5As shown, the electrical signal change images and calcium transient signal images corresponding to normal and abnormal conditions are shown, respectively. It can be seen that the action potential of the normal electrical signal change image of the heart has uniform conduction, while the pathological electrical signal change image will destroy this uniform conduction; at the same time, the release of calcium ions in the normal calcium transient signal image is consistent, while the pathological calcium transient signal image will destroy this consistency. Since there is actually a precise coupling between the electrical signal and the calcium transient signal, the embodiment of the present invention combines the cardiac electrophysiological images of the two signals to enhance the electrical signal change image and the calcium transient signal image.

[0081] In one embodiment, in step S200, determining the first core area to be enhanced of each RGB single channel according to the electrical signal change image includes steps S201-S204:

[0082] S201 . Determine first single-channel images corresponding to RGB channels respectively according to the electrical signal change image, and divide each first single-channel image into a plurality of first small blocks of preset sizes respectively.

[0083] First, the electrical signal change image is separated to determine the first single-channel image corresponding to the RGB channels, that is, the first single-channel image corresponding to the R channel, the first single-channel image corresponding to the G channel, and the first single-channel image corresponding to the B channel, such as Figure 6 , Figure 7 and Figure 8 As shown, it can be seen that the areas that destroy the uniformity of conduction are different in different channels. Therefore, in order to improve the accuracy, it is necessary to separately calculate the first core area to be enhanced in the first single-channel image corresponding to each RGB channel of the electrical signal change image. The first core area to be enhanced represents the area that destroys the uniformity of conduction.

[0084] Then, for the first single-channel image corresponding to each RGB channel of the electrical signal change image, in order to better extract the local features of the image, the image is divided into blocks. For the embodiment of the present invention, the local features are manifested as areas where pathological changes may occur, that is, the first core area to be enhanced. Therefore, taking the preset size of 3*3 as an example, other sizes can be used in other embodiments, and each first single-channel image is divided into a plurality of first small blocks of preset sizes.

[0085] S202, determining the possibility of destruction of the fluctuation continuity of each row of pixel points in each first small block.

[0086] Optionally, suppose that each first single-channel image has a total of I first small blocks. For the i-th first small block, since the normal cardiac electrical signal change image has the characteristic of uniform conduction, the grayscale value of each row of pixels in the i-th first small block normally presents an increasing or decreasing change, or a change of increasing first and then decreasing, or a change of decreasing first and then increasing. This feature is recorded as fluctuation continuity in the embodiment of the present invention. Therefore, if pathological changes occur in the i-th first small block, the corresponding change characteristics of the grayscale value of each row of pixels will be destroyed.

[0087] Based on this principle, firstly, the original gray value fluctuation curve of each row of pixels in each first small block is determined respectively, and the determination method is the existing method; since there will be noise pixels in the original gray value fluctuation curve, the least squares method is used to fit the original gray value fluctuation curve to obtain the fitted curve, that is, the gray value fluctuation curve, so as to determine the gray value fluctuation curve of each row of pixels in each first small block.

[0088] Secondly, the extreme points of each gray value fluctuation curve are determined by Newton's method, and the gray value of the first pixel point and the gray value of the last pixel point in each gray value fluctuation curve are taken as extreme points by default; then a sub-curve segment is determined using every two adjacent extreme points, and the number of sub-curve segments is counted to obtain the number of sub-curve segments corresponding to each gray value fluctuation curve.

[0089] Then, the preset number is the maximum number of sub-curve segments in the gray value fluctuation curve under ideal conditions. Taking the preset number of 2 as an example, the first difference S between the number of each sub-curve segment and the preset number is calculated respectively. i -2, according to the first difference S ij -2 and the normalization function norm(), we get the probability α of the destruction of the fluctuation continuity of each row of pixels in each first small block ij , so the calculation formula is:

[0090] α ij =norm(S ij -2)

[0091] In the formula, S ij Indicates the number of sub-curve segments corresponding to the gray value fluctuation curve of the j-th row of pixels in the i-th first small block, α ij represents the possibility of destruction of the fluctuation continuity of the j-th row of pixels in the i-th first small block, α ij The larger the value of , the greater the possibility that the fluctuation continuity of the j-th row of pixels in the i-th first small block will be destroyed.

[0092] S203: Determine the possibility that each first small block is the first core area to be enhanced according to each possibility of being destroyed.

[0093] First, sum up the destruction possibilities of each first small block and calculate the total destruction possibilities of each first small block. J represents the total number of rows of pixels in the i-th first small block.

[0094] Secondly, the ratio of the total number of destroyed possibilities corresponding to the first small block to the number of pixel rows of the first small block is calculated to obtain the probability τ of each first small block being the first core area to be enhanced. i :

[0095]

[0096] In the formula, τ i It represents the possibility that the i-th first small block is the first core area to be enhanced, J represents the number of rows of pixels in the i-th first small block, and the possibility of the first core area to be enhanced is characterized by the probability of the area where pathological changes occur. The higher the possibility, the higher the probability of the area where pathological changes occur.

[0097] S204 , determining the first core region to be enhanced of each first single-channel image according to the possibility that each first small block is the first core region to be enhanced and the possibility threshold, and obtaining the first core region to be enhanced of each RGB single channel.

[0098] Optionally, the possibility threshold is set based on actual conditions, for example, the possibility threshold is set to 0.5; when the possibility that the first small block is the first core area to be enhanced is greater than 0.5, the first small block is recorded as the first core small block to be enhanced, and the area composed of all the first core small blocks to be enhanced of a first single-channel image is used as the first core area to be enhanced of the first single-channel image, thereby obtaining the first core area to be enhanced of each first single-channel image, which is equivalent to the first core area to be enhanced of each RGB single channel, including the first core area to be enhanced of the R channel, the first core area to be enhanced of the G channel, and the first core area to be enhanced of the B channel.

[0099] In one embodiment, determining the second core area to be enhanced of each RGB single channel according to the calcium transient signal image in step S200 includes steps S205-S209:

[0100] S205 . Determine second single-channel images corresponding to the RGB channels respectively according to the calcium transient signal image, and divide each second single-channel image into a plurality of second small blocks of preset sizes respectively.

[0101] Similarly, similar to step S01, the calcium transient signal image is separated to determine the second single-channel image corresponding to the RGB channels, that is, the second single-channel image corresponding to the R channel, the second single-channel image corresponding to the G channel, and the second single-channel image corresponding to the B channel, such as Fig. 9 , Fig.10 and Fig.11 As shown, it can be seen that the distribution of gray values ​​in the calcium transient signal image under normal conditions is relatively uniform, while in the calcium transient signal image with pathological changes, due to myocardial ischemia and other conditions, the amplitude of calcium transients will be reduced, so it is manifested as an increase in the inhomogeneity of gray values ​​in the calcium transient signal image. Therefore, the core area to be enhanced in the calcium transient signal image, i.e., the second core area to be enhanced, is determined by analyzing the gray value inhomogeneity area in the three-channel image in the calcium transient signal image. Then, taking the preset size of 3*3 as an example, other sizes can be used in other embodiments, and each second single-channel image is divided into a plurality of second small blocks of preset sizes; and the size of the electrical signal change image and the calcium transient signal image is the same, so it is assumed that the same I second small blocks can be obtained.

[0102] S206 , determining a mean grayscale value of each second small block according to the grayscale values ​​of all pixels in each second small block.

[0103] Optionally, the grayscale values ​​of all pixels in each second small block are determined, and then the grayscale values ​​of all pixels in each second small block are summed and then divided by the total number of pixels in each second small block to determine the average grayscale value of each second small block.

[0104] S207 , respectively calculating the absolute value of the second difference between each gray value mean and the gray value standard value, and determining the gray value non-uniformity of each second small block according to the ratio of the absolute value to the gray value standard value.

[0105] Optionally, the grayscale value standard value represents the grayscale value mean of all pixels in each corresponding second single-channel image in a normal calcium transient signal image. Specifically, the grayscale value mean μ is calculated respectively. i Gray value standard value The absolute value of the second difference And according to the absolute value Gray value standard value The ratio of the gray value inhomogeneity of each second small block ∈ i , the formula is:

[0106]

[0107] In the formula, ∈ i Indicates the gray value inhomogeneity of the second small block in the i-th calcium transient signal image, μi represents the mean grayscale value of all pixels in the second small block of the i-th pixel, and || represents the absolute value function; The smaller the value of indicates that the mean gray value of the second small block of the ith calcium transient signal image is closer to the standard value, ∈ i The smaller the value of , the smaller the gray value inhomogeneity of the second i-th small block in the calcium transient signal image.

[0108] S208 , comparing the grayscale value non-uniformity of each second small block with the non-uniformity threshold, and taking the second small block whose grayscale value non-uniformity is greater than the non-uniformity threshold as the target second small block.

[0109] Optionally, in the embodiment of the present invention, the unevenness threshold is 0.5 as an example, and other values ​​may be used in other embodiments. Specifically, the gray value unevenness of each second small block ∈ i Compare with the unevenness threshold 0.5 and calculate the gray value unevenness ∈ i The second small block whose gray value is greater than the unevenness threshold of 0.5 is taken as the target second small block, that is, the second core small block to be enhanced, indicating that the gray value unevenness at the target second small block is too large, and it is very likely to be a small block with pathological changes.

[0110] S209 , constructing second core regions to be enhanced corresponding to each second single-channel image according to the second small blocks of the target corresponding to each second single-channel image, and obtaining second core regions to be enhanced for each RGB single channel.

[0111] Optionally, an area constituted by all target second small blocks of a second single-channel image is used as the second core area to be enhanced of the second single-channel image, thereby obtaining the second core area to be enhanced of each second single-channel image, which is equivalent to the second core area to be enhanced of each RGB single channel, including the second core area to be enhanced of the R channel, the second core area to be enhanced of the G channel, and the second core area to be enhanced of the B channel.

[0112] In one implementation, step S300 includes steps S301-S304:

[0113] S301 , respectively determining a first target region that is the same as the first core region to be enhanced and a second target region that is different from the second core region to be enhanced in the same single channel.

[0114] It should be noted that due to the coupling relationship between electrical signals and calcium transient signals, specifically, the electrical signals of the heart are transmitted through the action potential of myocardial cells. When myocardial cells are activated by electrical signals, L-type calcium channels open, allowing calcium ions to flow into the cells, resulting in an instantaneous increase in intracellular calcium concentration. Therefore, in order to more obviously enhance the area where pathological changes occur, the overall core area to be enhanced is optimized by analyzing the distribution of the core area to be enhanced in the same RGB single-channel image in the electrical signal change image and the calcium transient signal image.

[0115] For example, taking the single-channel R channel as an example, determine the first core area to be enhanced of the R channel and the first target area that is the same as the second core area to be enhanced of the R channel. Specifically, when the encoding is the same, it is determined to be the same. For example, the first small block of the first core area to be enhanced is encoded as 1st, 3rd, and 4th in the first single-channel image of the R channel, that is, the 1st first small block, the 3rd first small block, and the 4th first small block. The second small block of the second core area to be enhanced is encoded as 1st, 2nd, and 4th in the second single-channel image of the R channel, that is, the 1st second small block, the 2nd second small block, and the 4th second small block. At this time, the 1st first small block is the same as the 1st second small block, and the area of ​​the 1st first small block and the 4th first small block is a part of the first target area of ​​the first single-channel image of the R channel. Based on the above principle, all first target areas of the first single-channel image of the R channel can be determined, and the area of ​​the 1st second small block and the 4th second small block is a part of the first target area of ​​the second single-channel image of the R channel. Based on the above principle, all first target areas of the second single-channel image of the R channel can be determined. It is understandable that, if the second first small block is different from the second second small block, the third first small block is different from the third second small block, and the areas of the second first small block, the second second small block, the third first small block, and the third second small block are all classified as part of different second target areas. Therefore, based on the above principle, all different second target areas can be determined, and the first target area and the second target area of ​​the G channel and the first target area and the second target area of ​​the B channel can also be determined respectively, and finally the first target area that is the same as the second core area to be enhanced and the different second target areas in the same single channel are determined.

[0116] S302: Determine a core block of the second target area.

[0117] It should be noted that all first small blocks and all second small blocks constituting the second target area are recorded as core small blocks, and it is assumed that there are R core small blocks in total.

[0118] S303: Calculate the score of each core block as the enhanced area, and use the core blocks with scores less than the score threshold as the final core blocks to be enhanced.

[0119] First, a first target small block belonging to the first small block and a second target small block belonging to the second small block are determined from all core small blocks.

[0120] Secondly, the first distance value between each first target block and each second target block is calculated respectively, and the minimum first distance value corresponding to each first target block is used as the first target distance value. For example, there are 8 first target blocks and 8 second target blocks. The first distance value between the first target block and the 8 second target blocks (i.e., the distance between the center point of the first target block and the center point of the second target block) is calculated respectively, and then the calculated minimum first distance value is used as the first target distance value of the first target block. Similarly, the first target distance value of each first target block can be calculated. Similarly, based on the above principle, the second distance value between each second target block and each first target block is calculated respectively, and the minimum second distance value corresponding to each second target block is used as the second target distance value.

[0121] Furthermore, the length of the longest side of the electrical signal change image is determined to be Large. For example, when the length is greater than the width, the length is the longest side, and its length is Large. Then, the preset value is For example, in other embodiments, other values ​​may be used, according to the longest side length Large of the image changed by the electrical signal and the preset value The product of

[0122] Then, the score value of each first target block is determined according to the difference between the first target distance value and the distance threshold, and the score value of each second target block is determined according to the difference between the second target distance value and the distance threshold. The specific formula is:

[0123]

[0124] Wherein, Value(r) represents the score value of the r-th core block (which can be the first target block or the second target block) as the enhanced area, ED(r,else) represents the target distance value corresponding to the r-th core block (that is, the first target distance value or the second target distance value), and min represents the minimum value function.

[0125] Optionally, assuming that the score threshold is 0, when the value of Value(r) is less than the score threshold 0, it means that the distance between the r-th core block and the core block of another image is within a normal range, and the corresponding r-th core block is the final core block to be enhanced, otherwise it is not the final core block to be enhanced.

[0126] S304, determining the first final core area in the electrical signal change image according to the first target area in each first core area to be enhanced and the corresponding final core block to be enhanced, and determining the second final core area in the calcium transient signal image according to the first target area in each second core area to be enhanced and the corresponding final core block to be enhanced.

[0127] Optionally, the first target area in each first core area to be enhanced and the corresponding final core block to be enhanced (i.e., the final core block to be enhanced belonging to the electrical signal change image) are used to form the first final core area in the electrical signal change image, which is respectively composed of the first final core areas of the first single-channel image corresponding to each RGB single channel; and the first target area in each second core area to be enhanced and the corresponding final core block to be enhanced (i.e., the final core block to be enhanced belonging to the calcium transient signal image) are used to form the second final core area in the calcium transient signal image, which is respectively composed of the second final core areas of the second single-channel image corresponding to each RGB single channel.

[0128] In one implementation, step S400 includes steps S401-S403:

[0129] S401 , according to the first final core area and the second final core area, corresponding target final core areas of each RGB single channel are constituted, and areas outside the target final core areas are used as remaining core areas of each RGB single channel.

[0130] Optionally, all first final core areas and second final core areas of each RGB single channel are taken as a union to constitute the target final core area of ​​each RGB single channel, and the area where all pixel points outside the target final core area are located is used as the remaining core area of ​​each RGB single channel.

[0131] S402 , performing histogram equalization according to the final core area and the remaining core area, respectively, to obtain first enhanced single channel images of each RGB single channel of the electrical signal change image and second enhanced single channel images of each RGB single channel of the calcium transient signal image.

[0132] Optionally, the final core area and the remaining core areas are respectively subjected to histogram equalization to obtain first enhanced single-channel images of each RGB single channel of the electrical signal change image, i.e., the first enhanced single-channel image of the R channel after the first single-channel image corresponding to the R channel is enhanced, the first enhanced single-channel image of the G channel after the first single-channel image corresponding to the G channel is enhanced, and the first enhanced single-channel image of the B channel after the first single-channel image corresponding to the B channel is enhanced; at the same time, second enhanced single-channel images of each RGB single channel of the calcium transient signal image are obtained, i.e., the second enhanced single-channel image of the R channel after the second single-channel image corresponding to the R channel is enhanced, the second enhanced single-channel image of the G channel after the second single-channel image corresponding to the G channel is enhanced, and the second enhanced single-channel image of the B channel after the second single-channel image corresponding to the B channel is enhanced.

[0133] S403, merging each of the first enhanced single-channel images to obtain an enhanced target electrical signal change image, and merging each of the second enhanced single-channel images to obtain an enhanced target calcium transient signal image.

[0134] like Fig.12 , Fig.13 , Fig.14 and Fig.15 As shown, finally, the first enhanced single-channel image of the R channel, the first enhanced single-channel image of the G channel, and the first enhanced single-channel image of the B channel are merged to obtain an enhanced target electrical signal change image; the second enhanced single-channel image of the R channel, the second enhanced single-channel image of the G channel, and the second enhanced single-channel image of the B channel are merged to obtain an enhanced target calcium transient signal image.

[0135] By using the method of the embodiment of the present invention, for the first single-channel image corresponding to the electric signal change image, the first core area to be enhanced in the electric signal change image can be calculated according to the conduction uniformity, and for the second single-channel image corresponding to the calcium transient signal image, the second core area to be enhanced in the calcium transient signal image can be calculated according to the distribution uniformity; then, the first core area to be enhanced and the second core area to be enhanced are comprehensively analyzed according to the coupling of the electric signal and the calcium transient signal to obtain the first final core area and the second final core area to be enhanced, and the target final core area and the remaining core area are divided for histogram equalization and merging processing, and finally an enhanced target electric signal change image and an enhanced target calcium transient signal image are obtained, thereby avoiding the situation where the overall enhancement effect of the image is poor due to the different distribution areas of pathological changes in the RGB three-channel images of the electric signal change image and the calcium transient signal image, and improving the overall effect of image enhancement.

[0136] Reference Fig.16, shows a structural block diagram of a cardiac electrophysiological imaging enhancement system based on cursor measurement according to an embodiment of the present application, the system may include:

[0137] An acquisition module, used for acquiring electrical signal change images and calcium transient signal images;

[0138] A first determination module is used to determine a first core area to be enhanced for each RGB single channel according to the electrical signal change image, and to determine a second core area to be enhanced for each RGB single channel according to the calcium transient signal image;

[0139] A second determination module is used to determine a first final core area in the electrical signal change image and a second final core area in the calcium transient signal image according to the first core area to be enhanced and the second core area to be enhanced;

[0140] The enhancement module is used to perform histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

[0141] In the embodiment of the present invention, the functions of each module in the system can refer to the corresponding description in the above method, which will not be repeated here.

[0142] It should be noted that the sequence of the above embodiments of the present invention is only for description and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0143] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

Claims

1. A method for enhancing cardiac electrophysiological imaging based on cursor measurement. It is characterized in that The method comprises: Collect electrical signal change images and calcium transient signal images; Determine a first core region to be enhanced for each RGB single channel according to the electrical signal change image, and determine a second core region to be enhanced for each RGB single channel according to the calcium transient signal image; Determining a first final core region in the electrical signal change image and a second final core region in the calcium transient signal image according to the first core region to be enhanced and the second core region to be enhanced; Histogram equalization and merging processing are performed according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

2. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 1, It is characterized in that The collecting of electrical signal change images and calcium transient signal images comprises: The cardiac cell membrane is stained with voltage-sensitive dyes, the heart is illuminated with excitation light, and the emission light of the voltage-sensitive dye is collected with a high-speed camera to obtain an image of the electrical signal changes; The calcium ions in the heart cells are labeled with calcium-sensitive dyes, the heart is irradiated with excitation light, and the emission light of the calcium-sensitive dye is collected by a high-speed camera to obtain a calcium transient signal image.

3. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 1 or 2, It is characterized in that The determining, according to the electrical signal change image, the first core area to be enhanced of each RGB single channel comprises: Determine first single-channel images corresponding to RGB channels respectively according to the electrical signal change image, and divide each of the first single-channel images into a plurality of first small blocks of preset sizes; Determine the possibility of destruction of the fluctuation continuity of each row of pixel points in each of the first small blocks; According to each of the destruction possibilities, determining the possibility that each of the first small blocks is a first core area to be enhanced; According to the possibility that each of the first small blocks is the first core area to be enhanced and the possibility threshold, the first core area to be enhanced of each of the first single-channel images is determined to obtain the first core area to be enhanced of each RGB single channel.

4. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 3, It is characterized in that The determining of the possibility of destruction of the fluctuation continuity of each row of pixel points in each of the first small blocks comprises: Determine the gray value fluctuation curve of each row of pixels in each of the first small blocks respectively; Determine the extreme value points of each of the gray value fluctuation curves respectively, and use every two adjacent extreme value points to determine a sub-curve segment, to obtain the number of sub-curve segments corresponding to each of the gray value fluctuation curves; A first difference between the number of each sub-curve segment and a preset number is calculated respectively, and the possibility of destruction of the fluctuation continuity of each row of pixel points in each first small block is obtained according to the first difference and a normalization function.

5. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 3, It is characterized in that The determining, according to each of the destruction possibilities, the possibility that each of the first small blocks is the first core area to be enhanced includes: Sum each of the destruction possibilities of each of the first small blocks respectively, and calculate the sum of the destruction possibilities corresponding to each of the first small blocks; Calculating the ratio of the total number of destruction probabilities corresponding to the first small blocks to the number of pixel rows of the first small blocks respectively, to obtain the probability that each of the first small blocks is the first core area to be enhanced; The possibility of the first core area to be enhanced is characterized by the probability of the area where pathological changes occur.

6. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 3, It is characterized in that Determining the second core area to be enhanced of each RGB single channel according to the calcium transient signal image comprises: According to the calcium transient signal image, second single-channel images corresponding to the RGB channels are determined respectively, and each of the second single-channel images is divided into a plurality of second small blocks of preset sizes; Determine the mean grayscale value of each of the second small blocks according to the grayscale values ​​of all pixels in each of the second small blocks; Calculating the absolute value of the second difference between each gray value mean and the gray value standard value respectively, and determining the gray value non-uniformity of each second small block according to the ratio of the absolute value to the gray value standard value; Compare the grayscale value non-uniformity of each of the second small blocks with a non-uniformity threshold, and take the second small block whose grayscale value non-uniformity is greater than the non-uniformity threshold as the target second small block; According to the second small blocks of the target corresponding to each of the second single-channel images, second core regions to be enhanced corresponding to each of the second single-channel images are constructed to obtain second core regions to be enhanced for each of the RGB single channels.

7. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 6, It is characterized in that The determining, according to the first core region to be enhanced and the second core region to be enhanced, a first final core region in the electrical signal change image and a second final core region in the calcium transient signal image comprises: Respectively determine, in the same single channel, a first target area where the first core area to be enhanced is the same as the second core area to be enhanced and a second target area where the first core area to be enhanced is different from the second core area to be enhanced; Determine a core small block of the second target area, where the core small block includes a first small block and a second small block within the second target area; Calculate the score value of each core block as the enhanced area, and take the core block with a score value less than a score threshold as the final core block to be enhanced; The first final core area in the electrical signal change image is determined based on the first target area in each of the first core areas to be enhanced and the corresponding final core block to be enhanced, and the second final core area in the calcium transient signal image is determined based on the first target area in each of the second core areas to be enhanced and the corresponding final core block to be enhanced.

8. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 7, It is characterized in that The calculating of the score value of each core block as an enhanced area comprises: Determine a first target small block belonging to the first small block and a second target small block belonging to the second small block from all the core small blocks; Calculate the first distance value between each of the first target small blocks and each of the second target small blocks respectively, and use the minimum first distance value corresponding to each of the first target small blocks as the first target distance value respectively, and calculate the second distance value between each of the second target small blocks and each of the first target small blocks respectively, and use the minimum second distance value corresponding to each of the second target small blocks as the second target distance value respectively; Determining a distance threshold according to the longest side length of the electrical signal change image; The score value of each first target small block is determined according to the difference between the first target distance value and the distance threshold, and the score value of each second target small block is determined according to the difference between the second target distance value and the distance threshold.

9. The method for enhancing cardiac electrophysiological imaging based on cursor measurement according to claim 1 or 2, It is characterized in that The step of performing histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image comprises: According to the first final core area and the second final core area, a target final core area of ​​each RGB single channel is correspondingly constituted, and an area outside the target final core area is used as a remaining core area of ​​each RGB single channel; Performing histogram equalization according to the final core area and the remaining core area respectively, to obtain a first enhanced single-channel image of each RGB single channel of the electrical signal change image and a second enhanced single-channel image of each RGB single channel of the calcium transient signal image; The first enhanced single-channel images are merged to obtain an enhanced target electrical signal change image, and the second enhanced single-channel images are merged to obtain an enhanced target calcium transient signal image.

10. A cardiac electrophysiological imaging enhancement system based on cursor measurement, It is characterized in that include: An acquisition module, used for acquiring electrical signal change images and calcium transient signal images; A first determination module is used to determine a first core area to be enhanced for each RGB single channel according to the electrical signal change image, and to determine a second core area to be enhanced for each RGB single channel according to the calcium transient signal image; A second determination module is used to determine a first final core area in the electrical signal change image and a second final core area in the calcium transient signal image according to the first core area to be enhanced and the second core area to be enhanced; The enhancement module is used to perform histogram equalization and merging processing according to the first final core area and the second final core area to obtain an enhanced target electrical signal change image and an enhanced target calcium transient signal image.

Citation Information

Patent Citations

  • Underwater image enhancement method based on color correction and three-interval histogram stretching

    CN112419210A

  • Noise aware edge enhancement in a pulsed hyperspectral, fluorescence, and laser mapping imaging system

    CN114025656A

  • Underwater image enhancement method based on multi-interval sub-histogram equalization

    CN114240793A

  • Local self-adaptive enhancement method for angiocardiography image

    CN117237243A

  • Heart ultrasound image optimization enhancement method

    CN117474775A