Fiber core point cloud positioning method based on brightness gradient and related equipment

Through the core point cloud positioning method based on brightness gradient, the problem of inaccurate core point cloud positioning in micro-endoscopes is solved, higher quality image processing and analysis are achieved, and micro lesions and early cancer detection is improved accuracy.

CN118941618AActive Publication Date: 2024-11-12BIOPSEE (SUZHOU) MEDICAL TECH CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
CN202410981245.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2024-11-12
Estimated Expiration
2044-07-22

AI Technical Summary

Technical Problem

The electronic components characteristics of the resonant mirror and galvometer galvanometer in microscopes change with temperature, resulting in inaccurate positioning of the core point cloud, affecting image quality.

Method used

The core point cloud positioning method based on brightness gradient is used to determine the core coordinates and signal intensity through multi-frame image data set fusion, optical fiber positioning, basic area of ​​interest analysis and brightness gradient calculation, and then an accurate core point cloud is generated.

Benefits of technology

Improve the signal contrast and detail clarity of the image, ensure accurate positioning of the core position, especially when the equipment temperature changes, ensure the consistency and accuracy of imaging, provide more comprehensive diagnostic information, and improve early cancer and Diagnostic accuracy of gastrointestinal lesions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941618A_ABST
    Figure CN118941618A_ABST
Patent Text Reader

Abstract

The invention discloses a fiber core point cloud positioning method based on brightness gradient and related equipment, and relates to the field of image processing, and the method comprises the steps: carrying out the fusion operation based on N frames of original image data sets, so as to obtain a fused image; performing optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal intensity set; traversing all optical fibers on the fused image through the fiber core coordinate set to obtain a basic region of interest of each optical fiber; acquiring the minimum brightness value of the basic region of interest and the signal intensity of the optical fiber center point; acquiring brightness gradient values of other points except the optical fiber center point in the basic region of interest; determining a gradient region of interest based on all the brightness gradient values; determining a brightness threshold value in the gradient region of interest based on the signal intensity of the optical fiber center point and the brightness minimum value of the basic region of interest; and determining the point cloud of each optical fiber in the gradient region of interest according to the magnitude relationship between the brightness threshold and the brightness value of each point in the region.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing, and more specifically, to a fiber core point cloud positioning method based on brightness gradient and related equipment. Background Art

[0002] A microendoscope is a medical device that can be inserted into the human body through channels such as gastroscopes and colonoscopes to obtain local histological images to achieve accurate diagnosis of tiny lesions, gastrointestinal lesions, and early gastrointestinal cancer. There are two important components in the scanning control module of a microendoscope: a resonant mirror and a galvanometer galvanometer. The function of the resonant mirror is to make the light scan rapidly in the horizontal direction, so it is also called an X-galvanometer. The function of the galvanometer galvanometer is to make the light scan vertically, so it is also called a Y-galvanometer. The two work together to obtain a two-dimensional image.

[0003] The resonant mirror and galvanometer galvanometer mirror contain precise electronic components, and the characteristics of these electronic components will change with the change of the working environment temperature. During the imaging process, each image is based on the predetermined core position and generates a core point cloud. Due to the change of the galvanometer characteristics, the core position changes during the imaging process, which leads to inaccurate core point cloud positioning, resulting in image quality degradation. Therefore, it is necessary to propose a more accurate core point cloud positioning method. Summary of the invention

[0004] A series of simplified concepts are introduced in the Summary of the Invention section, which will be further described in detail in the Detailed Description of the Invention section. The Summary of the Invention section of this application does not mean to attempt to define the key features and essential technical features of the claimed technical solution, nor does it mean to attempt to determine the scope of protection of the claimed technical solution.

[0005] In a first aspect, the present application proposes a fiber core point cloud positioning method based on brightness gradient, the method comprising:

[0006] Perform a fusion operation based on N frames of original image data sets to obtain a fused image;

[0007] Performing an optical fiber positioning operation on the above fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core;

[0008] Traversing all optical fibers on the fused image by using the fiber core coordinate set to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the end face of the optical fiber centered at the fiber core position;

[0009] Obtain the minimum brightness value of the above basic area of ​​interest and the signal strength of the optical fiber center point;

[0010] Obtaining brightness gradient values ​​of the remaining points in the basic region of interest except the optical fiber center point;

[0011] Determine a gradient region of interest based on all brightness gradient values;

[0012] Determine a brightness threshold within the gradient region of interest based on the signal intensity at the optical fiber center point and the minimum brightness value of the basic region of interest;

[0013] In the above gradient region of interest, the point cloud of each optical fiber is determined according to the magnitude relationship between the above brightness threshold and the brightness value of each point in the region.

[0014] In a feasible implementation manner, performing the optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal strength set includes:

[0015] A local maximum algorithm is used to perform an optical fiber positioning operation on the fused image to obtain the fiber core coordinate set and the fiber core signal intensity set.

[0016] In a feasible implementation manner, the step of obtaining the brightness gradient values ​​of the remaining points in the basic region of interest except the optical fiber center point includes:

[0017] Based on the above basic area of ​​interest, a plurality of regions of interest are divided based on the optical fiber center point, wherein each adjacent region of interest is in a nested relationship with each other;

[0018] The brightness gradient values ​​of the remaining points except the optical fiber center point are calculated based on each of the above-mentioned regions of interest.

[0019] In a feasible implementation manner, the above-mentioned calculation of the brightness gradient values ​​of the remaining points except the above-mentioned optical fiber center point based on each of the above-mentioned regions of interest includes:

[0020] In each of the above-mentioned focus areas, the brightness difference between the current point's own brightness value and the adjacent brightness value of the nearest point is used as the brightness gradient of each point to obtain the brightness gradient values ​​of the remaining points except the above-mentioned optical fiber center point.

[0021] In a feasible implementation manner, the above-mentioned determination of the gradient region of interest based on all brightness gradient values ​​includes:

[0022] When the brightness gradient value is greater than 0, the pixel value corresponding to the point is set to zero;

[0023] When the brightness gradient value is less than or equal to 0, the original pixel value is retained;

[0024] The smallest circumscribed square with pixel values ​​greater than 0 is determined as the above-mentioned gradient region of interest.

[0025] In a feasible implementation manner, determining the brightness threshold in the gradient region of interest based on the signal intensity at the optical fiber center point and the minimum brightness value of the basic region of interest includes:

[0026] The brightness threshold Threshold_i is determined according to the following formula:

[0027] Threshold_i=(Value_actual_i-Min_value_i) / M)+Min_value_i

[0028] Wherein, Value_actual_i is the signal strength of the optical fiber center point, Min_value_i is the minimum brightness of the basic area of ​​interest, and M is a positive integer.

[0029] In a feasible implementation manner, determining the point cloud of each optical fiber in the gradient region of interest according to the magnitude relationship between the brightness threshold and the brightness value of each point in the region includes:

[0030] In each of the above gradient regions of interest, points whose point brightness values ​​are greater than the above brightness threshold are determined as points of the fiber core cloud of the optical fiber, so as to determine the point cloud of each optical fiber.

[0031] In a second aspect, an embodiment of the present application provides a core point cloud positioning device based on brightness gradient, comprising:

[0032] A first acquisition unit, configured to perform a fusion operation based on the N frames of original image data set to acquire a fused image;

[0033] A second acquisition unit is used to perform an optical fiber positioning operation on the above fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core;

[0034] A third acquisition unit is used to traverse all optical fibers through the fiber core coordinate set on the fused image to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the end face of the optical fiber centered at the fiber core position;

[0035] A fourth acquisition unit, used to acquire the minimum brightness value of the basic area of ​​interest and the signal strength of the optical fiber center point;

[0036] A fifth acquisition unit, used to acquire brightness gradient values ​​of other points in the basic region of interest except the optical fiber center point;

[0037] A first determining unit, configured to determine a gradient region of interest based on all brightness gradient values;

[0038] A second determining unit is used to determine a brightness threshold value in the gradient region of interest based on the signal intensity of the optical fiber center point and the minimum brightness value of the basic region of interest;

[0039] The third determining unit is used to determine the point cloud of each optical fiber in the above-mentioned gradient region of interest according to the magnitude relationship between the above-mentioned brightness threshold and the brightness value of each point in the region.

[0040] In a third aspect, an electronic device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor is used to implement the steps of the brightness gradient-based fiber core point cloud positioning method as described in any one of the first aspects above when executing the computer program stored in the memory.

[0041] In a fourth aspect, the present application further proposes a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the brightness gradient-based fiber core point cloud positioning method of any one of the first aspects is implemented.

[0042] In summary, the method proposed in the embodiment of the present application can significantly enhance the signal contrast and detail clarity in the image through the fusion operation of multiple frame image data sets. The precise position of each fiber core is located by advanced image analysis technology, and its signal strength is measured. This precise positioning technology ensures the consistency and accuracy of imaging, especially when the position of the fiber core may change slightly due to temperature changes inside the device. By defining the basic region of interest (ROI) of each optical fiber and further analyzing the minimum brightness, signal intensity and brightness gradient of these regions, it is helpful to better understand the signal changes inside the optical fiber, and can also be used to discover and describe small tissue structure changes. Based on the gradient region of interest and brightness threshold, this solution can accurately determine the point cloud of each optical fiber. These point clouds not only provide accurate two-dimensional images of optical fibers, but can also be used to generate three-dimensional representations, thereby providing doctors with a more comprehensive view and more diagnostic information. Accurate image processing and analysis technology can improve the diagnostic accuracy of early cancer and other gastrointestinal lesions. This is of great significance for improving treatment effects, selecting the best treatment method and monitoring lesion progression. The fiber core end face positioning method of the present application can quickly and accurately locate the fiber core end face area, ensuring that the positioning of the fiber core is carried out in the correct area. The fiber core point cloud computing method in this solution can obtain the point cloud area of ​​each fiber core, ensuring that each fiber core can extract an accurate brightness value. By providing higher quality images, more accurate data analysis and more advanced technical means, the application effect of microendoscopes in the detection of tiny lesions and early cancers has been significantly improved. This technological advancement provides a more powerful tool for medical diagnosis, making early diagnosis and treatment possible.

[0043] The fiber core point cloud positioning method based on brightness gradient proposed in this application and other advantages, objectives and features of this application will be partially reflected through the following description, and will also be partially understood by technical personnel in this field through research and practice of this application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present specification. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0045] Figure 1 A schematic diagram of the process of a fiber core point cloud positioning method based on brightness gradient provided in an embodiment of the present application;

[0046] Figure 2 A partially enlarged schematic diagram of a fiber core before positioning provided in an embodiment of the present application;

[0047] Figure 3 A partially enlarged schematic diagram of a fiber core after positioning provided in an embodiment of the present application;

[0048] Figure 4 A basic region of interest schematic diagram provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of a region of interest provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of a brightness gradient calculation principle provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of a gradient region of interest provided in an embodiment of the present application;

[0052] Figure 8 A schematic diagram of a fiber point cloud provided in an embodiment of the present application;

[0053] Fig. 9 A partially enlarged view of a core point cloud positioning provided in an embodiment of the present application.

[0054] Fig.10 A structural schematic diagram of a fiber core point cloud positioning device based on brightness gradient provided in an embodiment of the present application;

[0055] Fig.11 A schematic diagram of the structure of a fiber core point cloud positioning electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0057] See also Figure 1, which is a schematic diagram of the process of a fiber core point cloud positioning method based on brightness gradient provided in an embodiment of the present application, which may specifically include:

[0058] S110, performing a fusion operation based on the N frames of original image data set to obtain a fused image;

[0059] Exemplarily, N frames of original image data sets are used for fusion operation. The purpose is to improve the quality and information content of the image by combining multiple frames of images together, so as to better identify and analyze the optical fiber. Fusion technology includes but is not limited to image overlay, multi-frame integration or high dynamic range (HDR) technology to enhance the visibility and signal contrast of the optical fiber in the image.

[0060] Specifically, under the premise of clear focus and correct configuration parameters, N frames of confocal raw image data and raw sequence image data are collected, which are recorded as S. All images in S are selected for fusion, and the fused image is recorded as Img_fusion. For the way of fusion image, this method adopts the mean fusion method, that is, the average value of the corresponding pixel points in the sequence image is taken as the pixel value of the corresponding point of the fusion image, and then the fusion image Img_fusion of the group of images is obtained.

[0061] S120, performing an optical fiber positioning operation on the above fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core;

[0062] Exemplarily, the fused image is used to perform an optical fiber positioning operation. The specific position of each fiber core (fiber core coordinate set) and the signal strength value of each fiber core (fiber core signal strength set) are identified. The center of each fiber core is accurately located and its signal strength is measured through image analysis techniques such as edge detection or pattern recognition.

[0063] S130, traversing all optical fibers on the fused image using the fiber core coordinate set to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the optical fiber end face centered at the fiber core position;

[0064] Exemplarily, after obtaining the position and signal strength of each optical fiber, the basic region of interest (ROI) of each optical fiber is defined next. These regions are usually fixed-size pixel areas around the fiber core position for further analysis and processing.

[0065] S140, obtaining the minimum brightness value of the basic area of ​​interest and the signal strength of the optical fiber center point;

[0066] Exemplarily, each basic region of interest is analyzed to obtain the minimum brightness value in the region and the signal strength at the center of the optical fiber, so as to determine the brightness threshold and the gradient region of interest.

[0067] Specifically, all optical fibers are traversed through the fiber core coordinate set Coord on the fusion image Img_fusion, and for a single optical fiber i, an MxN region centered on the optical fiber coordinate is first extracted and recorded as a basic region of interest ROI_i. The basic region of interest ROI_i is as follows: Figure 4 As shown, the minimum brightness value of the area is extracted and recorded as Min_value_i, and the signal strength of the optical fiber center point is recorded as Value_actual_i.

[0068] S150, obtaining brightness gradient values ​​of the remaining points in the basic region of interest except the optical fiber center point;

[0069] Exemplarily, in addition to the optical fiber center point, the brightness gradient values ​​of other points in the basic region of interest are calculated. The brightness gradient reflects the speed of brightness change in the image and is a key indicator for identifying edge and texture information.

[0070] S160, determining a gradient region of interest based on all brightness gradient values;

[0071] Exemplarily, based on the calculated brightness gradient values, gradient regions of interest are determined, which include portions where brightness changes are most obvious, corresponding to edges or other key features of the optical fiber.

[0072] S170, determining a brightness threshold in the gradient region of interest based on the signal intensity at the optical fiber center point and the minimum brightness value of the basic region of interest;

[0073] Exemplarily, within the gradient region of interest, an appropriate brightness threshold is determined based on the signal intensity at the center of the optical fiber and the minimum brightness value of the basic region of interest. This threshold is used to further analyze and extract detailed features of the optical fiber.

[0074] S180, determining a point cloud of each optical fiber in the gradient region of interest according to a magnitude relationship between the brightness threshold and the brightness value of each point in the region.

[0075] For example, within the gradient region of interest, the point cloud of each optical fiber is determined according to the set brightness threshold and the magnitude relationship of the brightness values ​​of each point. The point cloud can be used to form a three-dimensional representation of the optical fiber or perform other forms.

[0076] In summary, the method proposed in the embodiment of the present application can significantly enhance the signal contrast and detail clarity in the image through the fusion operation of multiple frame image data sets. The precise position of each fiber core is located by advanced image analysis technology, and its signal strength is measured. This precise positioning technology ensures the consistency and accuracy of imaging, especially when the position of the fiber core may change slightly due to temperature changes inside the device. By defining the basic region of interest (ROI) of each optical fiber and further analyzing the minimum brightness, signal intensity and brightness gradient of these regions, it is helpful to better understand the signal changes inside the optical fiber, and can also be used to discover and describe small tissue structure changes. Based on the gradient region of interest and brightness threshold, this solution can accurately determine the point cloud of each optical fiber. These point clouds not only provide accurate two-dimensional images of optical fibers, but can also be used to generate three-dimensional representations, thereby providing doctors with a more comprehensive view and more diagnostic information. Accurate image processing and analysis technology can improve the diagnostic accuracy of early cancer and other gastrointestinal lesions. This is of great significance for improving treatment effects, selecting the best treatment method and monitoring lesion progression. The fiber core end face positioning method of the present application can quickly and accurately locate the fiber core end face area, ensuring that the positioning of the fiber core is carried out in the correct area. The fiber core point cloud computing method in this solution can obtain the point cloud area of ​​each fiber core, ensuring that each fiber core can extract an accurate brightness value. By providing higher quality images, more accurate data analysis and more advanced technical means, the application effect of microendoscopes in the detection of tiny lesions and early cancers has been significantly improved. This technological advancement provides a more powerful tool for medical diagnosis, making early diagnosis and treatment possible.

[0077] In some examples, performing the optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal strength set includes:

[0078] A local maximum algorithm is used to perform an optical fiber positioning operation on the fused image to obtain the fiber core coordinate set and the fiber core signal intensity set.

[0079] Exemplarily, a local maximum algorithm is used to identify significant feature points in an image. The algorithm identifies points in the image where the brightness or color intensity reaches a local maximum, which usually represents the core position of the optical fiber. The local maximum can be the maximum value relative to the surrounding neighborhood.

[0080] Specifically, the optical fiber positioning is performed on the fused image, that is, the optical fiber coordinate parameters are found using the local maximum algorithm, and the obtained fiber core coordinate set Coord and the fiber core signal strength set are recorded as Value_actual.

[0081] The detailed steps for locating optical fibers are as follows: first, a 3x3 anchor frame is preset, and the entire image is traversed with a step size of 1. Each time the anchor frame moves, it is determined whether the maximum value in the anchor frame is equal to the pixel value of the center point of the anchor frame. If they are equal, the point is recorded as the optical fiber center coordinate point. If not, it continues to move, and finally the entire image is traversed to locate all optical fibers. The local enlarged image before and after locating the fiber core on the fusion image Img_fusion is shown in the figure below: Figure 2 and Figure 3 shown.

[0082] The local maximum algorithm can accurately identify the location of the fiber core, especially when there is a sharp contrast between the fiber and the background. This process can be fully automated, reducing human error and subjectivity. Compared with manual marking or more complex image analysis methods, the local maximum algorithm is computationally simpler and faster.

[0083] In some examples, the step of obtaining the brightness gradient values ​​of the remaining points in the basic region of interest except the optical fiber center point includes:

[0084] Based on the above basic area of ​​interest, a plurality of regions of interest are divided based on the optical fiber center point, wherein each adjacent region of interest is in a nested relationship with each other;

[0085] The brightness gradient values ​​of the remaining points except the optical fiber center point are calculated based on each of the above-mentioned regions of interest.

[0086] For example, a plurality of circular or rectangular regions of interest are divided based on the center point of the optical fiber. Each new region of interest has a larger range than the previous region inside, thereby forming a nested relationship. This division strategy can be uniformly expanded, that is, each region is slightly larger than the previous one, or the size of the region is gradually increased according to a specific algorithm. Figure 5 As shown, it is a schematic diagram of a focus area division scenario, where 1 to 5 are 5 focus areas.

[0087] The brightness gradient is a measure of the brightness change of each point in the image, usually obtained by calculating the brightness difference between the point and its surrounding neighbors. In each region of interest, the brightness gradient value of each point except the center point of the fiber is calculated.

[0088] In some examples, the step of calculating the brightness gradient values ​​of the remaining points except the optical fiber center point based on each of the above-mentioned regions of interest includes:

[0089] In each of the above-mentioned focus areas, the brightness difference between the current point's own brightness value and the adjacent brightness value of the nearest point is used as the brightness gradient of each point to obtain the brightness gradient values ​​of the remaining points except the above-mentioned optical fiber center point.

[0090] For example, Figure 6The figure shows a schematic diagram of the principle of brightness gradient calculation. The brightness gradient value calculation method is to subtract the pixel value of the point closest to L_k-1 from each point in L_k (k>2) to obtain the brightness gradient value of each element in L_k. Figure 6 As described above, the starting position in the direction of the arrow minus the ending position is the brightness gradient of the point.

[0091] In some examples, determining the gradient region of interest based on all brightness gradient values ​​includes:

[0092] When the brightness gradient value is greater than 0, the pixel value corresponding to the point is set to zero;

[0093] When the brightness gradient value is less than or equal to 0, the original pixel value is retained;

[0094] The smallest circumscribed square with pixel values ​​greater than 0 is determined as the above-mentioned gradient region of interest.

[0095] For example, when the brightness gradient value of a pixel is greater than 0, it indicates that the brightness of the pixel is increasing relative to its neighboring points. In this case, in order to highlight the areas where the brightness decreases or changes little, the pixel values ​​of these points where the brightness increases are set to zero. This can eliminate or ignore the interference of the brightness increase and focus on those areas where the brightness changes little or decreases.

[0096] For points with a brightness gradient value less than or equal to 0, retain their original pixel values. These points may represent boundaries or feature points in the image, because a decrease or no change in the brightness gradient may indicate an important image feature. After the above processing, many pixel values ​​in the image will be set to zero, and the remaining non-zero pixels will mark areas that may contain important image information.

[0097] To determine the region of interest, find the smallest circumscribed square of all non-zero pixel values. This square area contains all points that retain the original pixel values, that is, those areas with gradient values ​​less than or equal to 0, which are considered to be the most critical parts of the gradient change in the image.

[0098] Specifically, Figure 7 The figure shows a schematic diagram of the gradient region of interest. Except for the center point, each point in the basic region of interest ROI_i obtains a brightness gradient value. According to the obtained brightness gradient value, if the brightness gradient value corresponding to the point in the ROI_i region is greater than 0, the pixel value of the point is set to 0, and finally the gradient region of interest Gradient_ROI_i is obtained.

[0099] In some examples, determining the brightness threshold in the gradient region of interest based on the optical fiber center point signal strength and the minimum brightness value of the basic region of interest includes:

[0100] The brightness threshold Threshold_i is determined according to the following formula:

[0101] Threshold_i=(Value_actual_i-Min_value_i) / M)+Min_value_i

[0102] Wherein, Value_actual_i is the signal strength of the optical fiber center point, Min_value_i is the minimum brightness of the basic area of ​​interest, and M is a positive integer.

[0103] Exemplarily, the difference between the signal intensity at the center of the optical fiber and the minimum brightness of the basic area of ​​interest (Value_actual_i-Min_value_i) is calculated. This difference represents the brightness range from the darkest to the brightest. The above difference is divided by M to narrow the brightness range so that the threshold is not too close to the high brightness of the center point, while being sufficiently higher than the darkest brightness to ensure that the threshold can effectively separate the center of the optical fiber from its surrounding area. M can be set based on experience, such as 3, 5, or 8.

[0104] The calculated result is added to the minimum brightness value Min_value_i. This is done to ensure that the brightness threshold is at least higher than the brightness of the darkest area, so that the area around the center point that is slightly brighter than the background can be more accurately identified.

[0105] The method proposed in this embodiment adaptively determines a suitable brightness threshold according to the signal strength of the optical fiber center point and the minimum brightness of the basic area of ​​interest. This ensures that the threshold is neither too high to ignore important boundary information nor too low to effectively distinguish the optical fiber center point from the background.

[0106] In some examples, the point cloud of each optical fiber is determined within the gradient region of interest according to the magnitude relationship between the brightness threshold and the brightness value of each point in the region.

[0107] In each of the above gradient regions of interest, points whose point brightness values ​​are greater than the above brightness threshold are determined as points of the fiber core cloud of the optical fiber, so as to determine the point cloud of each optical fiber.

[0108] For example, the pixel value of each point in the gradient region of interest Gradient_ROI_i is compared with its corresponding brightness threshold. If the point is greater than or equal to the threshold, it is recorded as the point of the fiber core cloud. The point cloud obtained for this fiber is as follows: Figure 8 In addition, in order to compensate for part of the optical fiber, the points in the neighborhood of the optical fiber center point 8 can be set by default as the points of the optical fiber core point cloud. Fig. 9This is a local enlarged image of the fiber core point cloud positioning on the fused image Img_fusion. It can be seen that the positioning effect is good.

[0109] See also Fig.10 , a structural schematic diagram of a fiber core point cloud positioning device based on brightness gradient provided in an embodiment of the present application may include:

[0110] A first acquisition unit 21 is used to perform a fusion operation based on N frames of original image data sets to obtain a fused image;

[0111] A second acquisition unit 22 is used to perform an optical fiber positioning operation on the above fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core;

[0112] A third acquisition unit 23 is used to traverse all optical fibers through the fiber core coordinate set on the fused image to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the optical fiber end face centered at the fiber core position;

[0113] A fourth acquisition unit 24 is used to acquire the minimum brightness value of the basic region of interest and the signal strength of the optical fiber center point;

[0114] A fifth acquisition unit 25 is used to acquire brightness gradient values ​​of other points in the basic region of interest except the optical fiber center point;

[0115] A first determining unit 26, configured to determine a gradient region of interest based on all brightness gradient values;

[0116] A second determination unit 27 is used to determine a brightness threshold value in the gradient region of interest based on the signal intensity of the optical fiber center point and the minimum brightness value of the basic region of interest;

[0117] The third determining unit 28 is used to determine the point cloud of each optical fiber in the above-mentioned gradient region of interest according to the magnitude relationship between the above-mentioned brightness threshold and the brightness value of each point in the region.

[0118] like Fig.11 As shown, an embodiment of the present application also provides an electronic device 300, including a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor, and when the processor 320 executes the computer program 311, the steps of any of the above-mentioned methods for core point cloud positioning are implemented.

[0119] Since the electronic device introduced in this embodiment is a device used to implement a fiber core point cloud positioning device based on brightness gradient in the embodiment of the present application, based on the method introduced in the embodiment of the present application, the technical personnel in this field can understand the specific implementation mode of the electronic device of this embodiment and its various variations. Therefore, how the electronic device implements the method in the embodiment of the present application is not introduced in detail here. As long as the equipment adopted by the technical personnel in this field to implement the method in the embodiment of the present application is within the scope of protection of this application.

[0120] In the specific implementation process, when the computer program 311 is executed by the processor, it can achieve Figure 1 Any implementation manner in the corresponding embodiments.

[0121] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0122] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0123] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0124] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0125] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0126] The embodiment of the present application further provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device executes the process of core point cloud positioning in the corresponding embodiment.

[0127] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.

[0128] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0129] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0130] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0131] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0132] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0133] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some of the technical features therein by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A fiber core point cloud positioning method based on brightness gradient, characterized in that: include: Perform a fusion operation based on N frames of original image data sets to obtain a fused image; Performing an optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core; Traversing all optical fibers on the fused image by using the fiber core coordinate set to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the end face of the optical fiber centered at the fiber core position; Obtaining the minimum brightness value of the basic area of ​​interest and the signal strength of the optical fiber center point; Obtaining brightness gradient values ​​of the remaining points in the basic region of interest except the optical fiber center point; Determine a gradient region of interest based on all brightness gradient values; Determine a brightness threshold in the gradient region of interest based on the signal intensity at the optical fiber center point and the minimum brightness value of the basic region of interest; In the gradient region of interest, the point cloud of each optical fiber is determined according to the magnitude relationship between the brightness threshold and the brightness value of each point in the region.

2. The fiber core point cloud positioning method based on brightness gradient according to claim 1, characterized in that: The performing of the optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal strength set includes: A fiber positioning operation is performed on the fused image using a local maximum algorithm to obtain the fiber core coordinate set and the fiber core signal intensity set.

3. The fiber core point cloud positioning method based on brightness gradient according to claim 1, characterized in that: The step of obtaining brightness gradient values ​​of points other than the optical fiber center point within the basic region of interest includes: Dividing a plurality of regions of interest based on the optical fiber center point in the basic region of interest, wherein each adjacent region of interest is in a nested relationship with each other; The brightness gradient values ​​of the remaining points except the center point of the optical fiber are calculated based on each of the focus areas.

4. The fiber core point cloud positioning method based on brightness gradient according to claim 3 is characterized in that: The step of calculating the brightness gradient values ​​of the remaining points except the center point of the optical fiber based on each of the focus areas comprises: In each of the focus areas, the brightness difference between the brightness value of the current point itself and the brightness value of the nearest point is used as the brightness gradient of each point to obtain the brightness gradient values ​​of the remaining points except the center point of the optical fiber.

5. The fiber core point cloud positioning method based on brightness gradient according to claim 1, characterized in that: The step of determining the gradient region of interest based on all brightness gradient values ​​comprises: When the brightness gradient value is greater than 0, the pixel value corresponding to the point is set to zero; When the brightness gradient value is less than or equal to 0, the original pixel value is retained; The smallest circumscribed square whose pixel value is greater than 0 is determined as the gradient region of interest.

6. The fiber core point cloud positioning method based on brightness gradient according to claim 1, characterized in that: Determining the brightness threshold in the gradient region of interest based on the optical fiber center point signal intensity and the minimum brightness value of the basic region of interest includes: The brightness threshold Threshold_i is determined according to the following formula: Threshold_i=(Value_actual_i-Min_value_i) / M)+Min_value_i, wherein Value_actual_i is the signal strength at the center point of the optical fiber, Min_value_i is the minimum brightness of the basic area of ​​interest, and M is a positive integer.

7. The fiber core point cloud positioning method based on brightness gradient according to claim 1 is characterized in that: Determining the point cloud of each optical fiber according to the magnitude relationship between the brightness threshold and the brightness value of each point in the gradient region of interest includes: In each of the gradient regions of interest, points whose point brightness values ​​are greater than the brightness threshold are determined as points of the fiber core cloud of the optical fiber, so as to determine the point cloud of each optical fiber.

8. A fiber core point cloud positioning device based on brightness gradient, characterized in that: include: A first acquisition unit, configured to perform a fusion operation based on the N frames of original image data set to acquire a fused image; A second acquisition unit is used to perform an optical fiber positioning operation on the fused image to obtain a fiber core coordinate set and a fiber core signal strength set, wherein the fiber core coordinate set includes a fiber core coordinate value of each fiber core, and the fiber core signal strength set includes a fiber core signal strength value of each fiber core; A third acquisition unit is used to traverse all optical fibers through the fiber core coordinate set on the fused image to obtain a basic region of interest for each optical fiber, wherein the region of interest is a pixel value region covering the end face of the optical fiber centered at the fiber core position; A fourth acquisition unit, used to acquire the minimum brightness value of the basic region of interest and the signal strength of the optical fiber center point; A fifth acquisition unit, used to acquire brightness gradient values ​​of other points in the basic region of interest except the optical fiber center point; A first determining unit, configured to determine a gradient region of interest based on all brightness gradient values; A second determining unit, configured to determine a brightness threshold within the gradient region of interest based on the signal intensity at the optical fiber center point and a minimum brightness value of the basic region of interest; The third determining unit is used to determine the point cloud of each optical fiber according to the magnitude relationship between the brightness threshold and the brightness value of each point in the gradient region of interest.

9. An electronic device, comprising: A memory and a processor, wherein the processor is used to implement the steps of the brightness gradient-based core point cloud positioning method as described in any one of claims 1 to 7 when executing the computer program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the brightness gradient-based fiber core point cloud positioning method as described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Image processing device, endoscope system, image processing method, and image processing program

    CN107708521A

  • Image processing device, image processing method, and program

    CN110139609A

  • Image processing method, image processing device, terminal and storage medium

    CN115423733A

  • Three-dimensional point cloud image fusion method based on computer vision

    CN116071283A

  • Method and device for collecting test image of electronic endoscope and intelligent terminal

    CN116506995A