Specialized light-quantitative imaging methods and endoscope systems for endoscopes
By acquiring special light image signals through an endoscopic system for quantitative evaluation, generating quantitative images and displaying quantitative labels, the problem of ordinary light imaging being difficult to identify lesions and the high false positive rate of indocyanine green fluorescence imaging is solved. This achieves accuracy in tumor identification and objectivity in blood supply assessment, and improves the precision of minimally invasive surgery.
Patent Information
- Application Number
- CN202310019965.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-01-28
- Filing Date
- 2023-01-06
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-01-06
AI Technical Summary
Existing endoscopic systems have difficulty identifying lesions in conventional light imaging, and indocyanine green fluorescence imaging technology has a high false positive rate in tumor identification and is difficult to objectively quantify blood supply assessment, which limits the precision of minimally invasive surgery.
By acquiring special light image signals, performing quantitative evaluation, generating special light quantized images and simultaneously displaying quantization labels, and using quantization parameters and color relationships to characterize differences in image regions, a quantitative evaluation of tissues can be achieved.
It provides richer diagnostic references, improves the accuracy of tumor identification and the objectivity of blood supply assessment, and enhances the precision of minimally invasive surgery.
Smart Images

Figure CN116671846B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of medical devices, and more specifically to a special optical quantization imaging method and endoscope system for endoscopes. Background Technology
[0002] Endoscopic systems, capable of observing tissues inside living organisms, are increasingly widely used in the medical field. Specifically, an endoscope system generally has a structure that can be inserted into the body. After being inserted into the body through the mouth or other natural orifices, or through a small surgical incision, this structure acquires image information of the body's interior, transmits it, and displays it on a monitor.
[0003] Endoscopic systems typically perform ordinary light imaging, meaning they can image the interior of a living organism under normal light. However, ordinary light images have limitations; for example, some lesions are difficult to identify in ordinary light. Therefore, specialized light imaging techniques for endoscopy have been developed. These techniques can provide observers with information that cannot be discerned by ordinary light imaging, thus offering richer reference information for diagnosis and treatment.
[0004] For example, in recent years, intraoperative navigation endoscopy based on indocyanine green (ICG) has been widely used in minimally invasive surgery. Leveraging its near-infrared fluorescence, the fluorescence-guided endoscopic system can perform functions such as lymph node localization, lesion marking, and vascular tracing in various surgical procedures (e.g., gynecology, hepatobiliary, gastrointestinal, thoracic surgery), greatly facilitating minimally invasive surgery. However, current indocyanine green molecular fluorescence imaging technology still faces significant clinical limitations. For instance, because ICG lacks tumor specificity, surgeons in liver resection can only distinguish tumors from normal tissue based on experience, leading to a high false-positive rate for tumor identification. Furthermore, in intestinal anastomosis, intraoperative assessment of blood supply can only be based on fluorescence intensity, making it difficult to obtain objective and quantitative evaluations. Therefore, quantitative endoscopic optical navigation technology is of great significance for further advancing precision surgery. Summary of the Invention
[0005] The summary section introduces a series of simplified concepts, which will be further explained in detail in the detailed description section. The summary section of this invention is not intended to limit the key features and essential technical features of the claimed technical solution, nor is it intended to determine the scope of protection of the claimed technical solution.
[0006] The first aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0007] Acquire special light image signals when performing special light imaging on tissues;
[0008] Quantization evaluation is performed based on the specific light image signal to obtain specific light quantization parameters for different image regions;
[0009] Generate special light quantization images based on the special light quantization parameters of the different image regions;
[0010] The special light quantization image and quantization label are output synchronously. The quantization label is used to characterize the correspondence between the color of the special light quantization image and the special light quantization parameters.
[0011] In one embodiment, the quantization label includes a color bar that displays the color of the special light quantization image and the numerical values of the special light quantization parameter corresponding to different colors.
[0012] In one embodiment, the colors displayed in the color bar are either continuously gradient colors or discrete colors.
[0013] In one embodiment, the quantization label includes a value of a specific light quantization parameter displayed at the target location in the specific light quantization image.
[0014] In one embodiment, the quantization label further includes a graphic marker displayed at the target location, the graphic marker being displayed in association with the value of the specific light quantization parameter.
[0015] In one embodiment, the method further includes adjusting the correspondence between the special light quantization parameter and the color of the special light quantization image according to the received operation instruction, and displaying the adjusted special light quantization image and quantization label.
[0016] In one embodiment, the step of performing quantization evaluation based on the specific light image signal to obtain specific light quantization parameters for different image regions includes:
[0017] The grayscale values of the special light image signal are normalized to obtain the special light quantization parameters.
[0018] In one embodiment, normalizing the grayscale values of the special light image signal to obtain the special light quantization parameters includes:
[0019] Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region;
[0020] Select a target grayscale distribution interval from the plurality of grayscale distribution intervals, and obtain a reference grayscale value based on the grayscale values distributed in the target grayscale distribution interval;
[0021] The grayscale value of the special light image signal is normalized based on the reference grayscale value to obtain the special light quantization parameter.
[0022] In one embodiment, the step of performing quantization evaluation based on the specific light image signal to obtain specific light quantization parameters for different image regions includes:
[0023] Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region;
[0024] By statistically analyzing the gray values distributed in each gray-level distribution interval, the relationship between the gray values of each image region and time is obtained.
[0025] Based on the relationship between the grayscale value and time, the blood supply assessment parameters corresponding to each image region are obtained;
[0026] The blood supply assessment parameters are normalized to obtain the specific light quantization parameters corresponding to each image region.
[0027] In one embodiment, the method further includes displaying a statistical graph showing the relationship between the grayscale values of at least one image region and time, and marking the position corresponding to the displayed statistical graph in the special light quantization image.
[0028] In one embodiment, when displaying the statistical charts corresponding to at least two image regions, the statistical charts corresponding to the at least two image regions are displayed independently or superimposed.
[0029] In one embodiment, the blood supply assessment parameters are obtained based on at least one of the following characteristics of the relationship between the gray value and time: start time of rise, time to peak, peak gray value, and area under the curve.
[0030] In one embodiment, the method further includes selecting the quantization evaluation method according to the received operation instruction, wherein the quantization evaluation method includes: normalizing the grayscale value of the special light image signal to obtain the special light quantization parameter; or, performing blood supply evaluation based on the special light image signal to obtain the special light quantization parameter.
[0031] In one embodiment, the method further includes, prior to quantization evaluation based on the specific optical image signal:
[0032] The contrast of the special optical image signal is amplified, including adaptive amplification or amplification based on received operation instructions.
[0033] In one embodiment, generating a special light quantization image based on the special light quantization parameters of the different image regions includes: mapping the special light quantization parameters to corresponding color values to obtain the special light quantization image;
[0034] The method further includes: determining the mapping relationship between the special light quantization parameter and the color value based on the received operation instruction.
[0035] In one embodiment, the special optical imaging includes fluorescence imaging, laser speckle imaging, narrowband light reflection imaging, or optical coherence tomography.
[0036] A second aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0037] Acquire special light image signals when performing special light imaging on tissues;
[0038] Multiple image regions are determined based on the special light image signal, and the grayscale value of different image regions changes over time.
[0039] Blood supply assessment parameters for different image regions are obtained based on the relationship between grayscale values and time.
[0040] A special optical quantization image is generated based on the blood supply assessment parameters;
[0041] Output a statistical graph showing the relationship between the grayscale value of the special light-quantized image and at least one image region over time.
[0042] In one embodiment, obtaining the relationship between the grayscale values of different image regions and time includes:
[0043] Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region;
[0044] By statistically analyzing the gray values distributed in each gray-level range, the relationship between the gray values of each image region and time is obtained.
[0045] In one embodiment, generating a special light quantization image based on the blood supply assessment parameters includes:
[0046] The blood supply assessment parameters for different image regions are normalized to obtain specific light quantization parameters for each image region.
[0047] The special light quantization image is generated based on the special light quantization parameters.
[0048] In one embodiment, generating the special light quantization image based on the special light quantization parameters includes: mapping different special light quantization parameters to corresponding color values to obtain the special light quantization image;
[0049] The method further includes: determining the mapping relationship between the special light quantization parameter and the color value based on the received operation instruction.
[0050] In one embodiment, the blood supply assessment parameters are obtained based on at least one of the following characteristics of the relationship between the gray value and time: start time of rise, time to peak, peak gray value, and area under the curve.
[0051] In one embodiment, the method further includes synchronously displaying a statistical graph showing the relationship between the blood supply assessment parameters or the feature values and the grayscale values over time.
[0052] In one embodiment, the method further includes determining the starting time point of a statistical graph showing the relationship between the grayscale value and time based on the received operation instructions.
[0053] In one embodiment, determining the starting time point of the statistical graph showing the relationship between grayscale values and time based on the received operation instruction includes:
[0054] When an instruction is received to display a statistical chart showing the relationship between the grayscale values and time, the statistical chart is generated and displayed with the instruction receiving time as the starting time point.
[0055] A third aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0056] Acquire special light image signals when performing special light imaging on tissues;
[0057] Quantization evaluation is performed based on the specific light image signal to obtain specific light quantization parameters for different image regions;
[0058] The special light quantization parameters are mapped to the corresponding color values to generate a first special light quantization image;
[0059] Obtain a color threshold range, and process the color values in the first special light quantization image that are outside the color threshold range to obtain a second special light quantization image;
[0060] Display the second special light quantization image.
[0061] In one embodiment, obtaining the color threshold range includes obtaining a pre-stored color threshold range or determining the color threshold range according to a received operation instruction.
[0062] In one embodiment, the method further includes synchronously displaying the first special light quantization image and the second special light quantization image.
[0063] A fourth aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0064] Acquire special light image signals when performing special light imaging on tissues;
[0065] Multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region;
[0066] Select a target grayscale distribution interval from the plurality of grayscale distribution intervals, and obtain a reference grayscale value based on the grayscale values distributed in the target grayscale distribution interval;
[0067] The gray values of the special light image signal are normalized based on the reference gray values to obtain special light quantization parameters;
[0068] A special light quantization image is generated based on the special light quantization parameters;
[0069] Output the special light quantization image.
[0070] A fifth aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0071] Acquire special light image signals when performing special light imaging on tissues;
[0072] Multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region;
[0073] The relationship between grayscale values and time in different grayscale distribution ranges is obtained based on the special optical image signal.
[0074] Blood supply assessment parameters for different image regions are obtained based on the relationship between grayscale values and time.
[0075] The blood supply assessment parameters for different image regions are normalized to obtain specific light quantization parameters for each image region.
[0076] A special light quantization image is generated based on the special light quantization parameters;
[0077] Output the special light quantization image.
[0078] A sixth aspect of this invention provides a special light quantization imaging method for endoscopes, the method comprising:
[0079] Acquire special light image signals when performing special light imaging on tissues;
[0080] Obtain an operation instruction to select a quantization evaluation method, and determine a quantization evaluation method for the special optical image signal based on the operation instruction;
[0081] When the quantization evaluation method is determined to be the first quantization evaluation method, the gray value of the special light image signal is normalized to obtain the special light quantization parameter. When the quantization evaluation method is determined to be the second quantization evaluation method, blood supply evaluation is performed based on the special light image signal to obtain the special light quantization parameter.
[0082] A special light quantization image is generated based on the special light quantization parameters;
[0083] Output the special light quantization image.
[0084] A seventh aspect of the present invention provides an endoscope system, comprising:
[0085] Light source section;
[0086] A light source control unit is used to control the light source unit to provide the light required for special light imaging.
[0087] An endoscope, comprising an insertion portion capable of being inserted into a living organism and at least one sensor for acquiring image signals;
[0088] A processor for performing the method described above to obtain a special light quantization image; and a display for displaying the special light quantization image.
[0089] According to embodiments of the present invention, a special light quantization imaging method and endoscope system for endoscopes perform quantization evaluation based on special light image signals to generate special light quantization images. These special light quantization images can present quantization differences in different regions, and quantization labels displayed synchronously with the special light quantization images can quantitatively indicate these differences. Furthermore, the process of generating special light quantization images does not require manual intervention, has strong real-time performance, and a simple operation process. Attached Figure Description
[0090] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0091] In the attached diagram:
[0092] Figure 1A schematic block diagram of an endoscope system according to an embodiment of the present invention is shown.
[0093] Figure 2 A schematic flowchart illustrating a special light quantization imaging method for an endoscope according to an embodiment of the present invention is shown.
[0094] Figure 3 A schematic diagram illustrating the division of multiple grayscale distribution intervals according to an embodiment of the present invention is shown;
[0095] Figure 4 A schematic diagram illustrating the relationship between grayscale values and time according to an embodiment of the present invention is shown.
[0096] Figure 5 A schematic diagram illustrating a special light quantization image and quantization label according to an embodiment of the present invention is shown;
[0097] Figure 6 A schematic diagram illustrating a special light quantization image and quantization label according to another embodiment of the present invention;
[0098] Figure 7 A schematic diagram illustrating a special light quantization image and quantization label according to another embodiment of the present invention;
[0099] Figure 8 A schematic diagram showing a special light quantization image and grayscale value change curve over time according to an embodiment of the present invention;
[0100] Figure 9 A schematic diagram illustrating a special light-quantized image and grayscale value change curve over time according to another embodiment of the present invention;
[0101] Figure 10 A schematic flowchart illustrating a special light quantization imaging method for an endoscope according to another embodiment of the present invention is shown.
[0102] Figure 11 A schematic flowchart illustrating a special light quantization imaging method for an endoscope according to another embodiment of the present invention is shown.
[0103] Figure 12 A schematic flowchart illustrating a special light quantization imaging method for an endoscope according to another embodiment of the present invention is shown.
[0104] Figure 13 A schematic flowchart of a special light quantization imaging method for an endoscope according to an embodiment of the present invention is shown.
[0105] Figure 14 A schematic flowchart illustrating a special light quantization imaging method for an endoscope according to another embodiment of the present invention is shown. Detailed Implementation
[0106] To make the objectives, technical solutions, and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are merely a part of the embodiments of the present invention, and not all of the embodiments of the present invention. It should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments of the present invention described herein, all other embodiments obtained by those skilled in the art without inventive effort should fall within the protection scope of the present invention.
[0107] In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the invention. However, it will be apparent to those skilled in the art that the invention can be practiced without one or more of these details. In other instances, certain technical features well-known in the art have not been described in order to avoid obscuring the invention.
[0108] It should be understood that the invention can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein. Rather, providing these embodiments will make the disclosure thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
[0109] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. When used herein, the singular forms “a,” “an,” and “the” are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the terms “comprising” and / or “including,” when used in this specification, identify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups. When used herein, the term “and / or” includes any and all combinations of the associated listed items.
[0110] To fully understand this invention, a detailed structure will be presented in the following description to illustrate the technical solution proposed by this invention. Optional embodiments of the invention are described in detail below; however, in addition to these detailed descriptions, the invention may have other embodiments.
[0111] Figure 1 A partial structural schematic diagram of an endoscope system according to an embodiment of the present invention is shown, including a light source unit 110, a light source control unit 120, an endoscope 130, a processor 140, and a display 150.
[0112] The light source unit 110 is used to provide illumination to the area 100 to be observed. In one embodiment, the light source unit 110 includes a general light source required for ordinary light imaging and a special light source required for special light imaging. The special light source includes, but is not limited to, a laser light source corresponding to a fluorescent reagent. The general light source can provide visible light, specifically including an LED light source. In one embodiment, the general light source can provide multiple monochromatic lights of different wavelength ranges, such as blue light, green light, red light, etc. In other embodiments, the general light source can also provide a combination of the multiple monochromatic lights, or a broadband white light source. The wavelength range of the monochromatic light is approximately 400 nm to 700 nm. The laser light source is used to generate laser light, such as near-infrared light. The peak wavelength of the laser light is at least one value within the range of 780 nm or 808 nm.
[0113] Since the light source unit 110 can simultaneously provide continuous ordinary light and special light to the area to be observed, the sensor's acquisition efficiency of ordinary light image signals and special light image signals reflected by the area to be observed 100 is improved. The light source control unit 120 is used to control the light source unit 110, for example, to control the light source unit 110 to provide the light required for ordinary light imaging, and to control the light source unit 110 to provide the light required for special light imaging.
[0114] For example, the light source unit 110 also includes a dichroic mirror. The dichroic mirror is disposed at the intersection of the light paths of the ordinary light source and the special light source. The dichroic mirror has a first surface and a second surface facing each other. The first surface faces the ordinary light source and has a preset tilt angle with the light emitted by the ordinary light source. The second surface faces the special light source and has a preset tilt angle with the light emitted by the special light source. Ordinary light emitted by the ordinary light source can be transmitted through the dichroic mirror, and special light emitted by the special light source can be reflected by the dichroic mirror, so that the light paths of the ordinary light and the special light are combined into a single light path; and vice versa.
[0115] In some embodiments, the light source unit 110 may further include a coupling mirror. The coupling mirror is disposed between the dichroic mirror and the light guide port of the beam guide. The coupling mirror can focus the light transmitted from the dichroic mirror, thereby better guiding it into the beam guide and minimizing light loss, thus improving the overall illumination quality of the endoscope system 100. The light path combining effect of the dichroic mirror and the focusing effect of the coupling mirror can both better guide the light into the beam guide (e.g., into the optical fiber). At the same time, the use of the dichroic mirror can make the overall structure of the light source unit 110 more compact and the light propagation path shorter.
[0116] Exemplarily, the endoscope 130 includes an insertion section and at least one sensor for image signal acquisition. In some embodiments, the insertion section can be inserted into a living organism; for example, the insertion section is part of the endoscope body and can be inserted into the organism by an operator. The insertion section can transmit light generated by the light source 110 to the area to be observed through a guide section (which may be a light-guiding optical fiber). In some embodiments, the front end of the insertion section is provided with at least one sensor as an image acquisition device. Under normal lighting conditions, this at least one sensor acquires a normal light image signal and sends the normal light image signal to the processor 140 for processing to generate a normal light image; under special lighting conditions, the at least one sensor acquires a special light image signal and sends the special light image signal to the processor 140 for processing to generate a special light image or a special light quantized image.
[0117] In some embodiments, the endoscope 130 may contain only one sensor, specifically a color sensor, also referred to as a color sensor, color recognition sensor, or color sensor. The color sensor detects color by comparing the color of an object with a previously taught reference color. When the two colors match within a certain error range, the detection result is output for color perception and judgment. In an example where the endoscope 130 includes only one color sensor, the processor 140 generates a normal light image based on the image signal acquired by the color sensor when the light source 110 provides the light required for normal light imaging, and converts the image signal acquired by the color sensor into a grayscale image signal when the light source 110 provides the light required for special light imaging, and generates a special light quantized image based on the grayscale image signal.
[0118] In some embodiments, the endoscope 130 may contain two sensors, one a color sensor and the other a grayscale sensor. The processor 140 generates a normal light image based on the color image signal acquired by the color sensor when the light source 110 provides light required for normal light imaging, and generates a special light quantized image based on the grayscale image signal acquired by the grayscale sensor when the light source 110 provides light required for special light imaging. In some embodiments, the endoscope 130 may contain one or more sensors, all of which are grayscale sensors.
[0119] The above describes some examples of how the processor 140 generates a normal light image based on a normal light image signal acquired by at least one sensor when the light source unit 110 provides light required for normal light imaging, and generates a special light quantized image based on a special light image signal acquired by at least one sensor when the light source unit 110 provides light required for special light imaging. After generating the normal light image and the special light quantized image, the processor 140 can also combine the two into a composite image and output it to the display 150 for display. For example, the processor 140 can generate the composite image by layer overlay or by adding pixel values.
[0120] For example, processor 140 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor, or it may be any conventional processor. Processor 140 is the control center of the endoscope system 100, connecting various parts of the endoscope system 100 via various interfaces and lines. Processor 90 is also used to perform various steps in the following special light quantization imaging method.
[0121] In one embodiment, the endoscope system 100 further includes a memory. The memory can be used to store images generated by the processor 140. The memory can also be used to store program code, by which the processor 140 performs various functions of the endoscope system 100 by running or executing the program code stored in the memory and by calling data stored in the memory.
[0122] It should be noted that, Figure 1 These are merely examples of endoscopic systems and do not constitute a limitation on endoscopic systems. Endoscopic systems can include, but are not limited to, those described above. Figure 1 The system may include more or fewer components, or combinations of certain components, or different components. For example, an endoscope system may also include one or more of the following: dilator, smoke control device, input / output device, network access device, etc.
[0123] This invention provides a special light quantization imaging method for endoscopes, wherein the endoscope system involved in the method can be the endoscope system 100 described above. (Refer to the following...) Figure 2This invention describes a special light quantization imaging method for endoscopes according to embodiments of the present invention. Figure 2 This is a schematic flowchart of a special light quantization imaging method 200 for endoscopes, which specifically includes the following steps:
[0124] In step S210, a special light image signal is acquired when performing special light imaging on the tissue;
[0125] In step S220, a quantization evaluation is performed based on the special light image signal to obtain special light quantization parameters for different image regions;
[0126] In step S230, a special light quantization image is generated based on the special light quantization parameters of the different image regions;
[0127] In step S240, the special light quantization image and quantization label are output synchronously. The quantization label is used to characterize the correspondence between the color of the special light quantization image and the special light quantization parameters.
[0128] The special light quantization imaging method 200 for endoscopes in this embodiment of the invention performs quantization evaluation based on special light image signals to generate special light quantization images. These special light quantization images can present quantization differences in different regions, and quantization labels displayed synchronously with the special light quantization images can quantitatively indicate these differences. Furthermore, the process of generating special light quantization images does not require manual intervention, has strong real-time performance, and a simple operation process.
[0129] For example, in step S210, when the light required for special light imaging is provided to the light source section of the endoscope system, a grayscale image signal is acquired by a sensor, which is the special light image signal. Special light imaging includes fluorescence imaging, laser speckle imaging, narrowband light reflection imaging, or optical coherence tomography. The following description primarily uses fluorescence imaging as an example; correspondingly, the special light image signal acquired during fluorescence imaging is a fluorescence signal. In some embodiments, fluorescence imaging includes infrared fluorescence imaging, ultraviolet fluorescence imaging, near-infrared fluorescence imaging, visible light fluorescence imaging, etc.
[0130] When the special light imaging is fluorescence imaging, a contrast agent, such as indocyanine green (ICG), is first introduced into the site of observation via intravenous or subcutaneous injection before imaging with an endoscopic system. This allows for imaging of tissue structures and functions (such as blood, lymph, and bile in blood vessels) that are not easily visible using standard visible light imaging techniques. The sites of observation include, but are not limited to, the circulatory system, lymphatic system, and tumor tissue. When the contrast agent in the site of observation absorbs the laser light corresponding to the fluorescent reagent generated by the laser source, fluorescence is produced. The fluorescence signal can be acquired by sensors in the endoscopic system.
[0131] In step S220, a quantization evaluation is performed based on the special light image signal to obtain special light quantization parameters for different image regions. Quantization evaluation is the process of extracting the spatial distribution differences or time-varying response differences of special light signals in different regions. The special light quantization parameters can intuitively characterize these differences.
[0132] In one embodiment, the specific light quantization parameter characterizes the spatial distribution differences of specific light signals, used to distinguish different tissue regions. The quantization evaluation process mainly includes normalizing the grayscale values of the specific light image signal. Normalizing the grayscale values can amplify the differences in grayscale values between different tissues, which is beneficial for distinguishing different tissues. The normalized grayscale value is the specific light quantization parameter.
[0133] For example, the normalization process includes first dividing the grayscale distribution of the special light image signal into multiple grayscale distribution intervals, each corresponding to an image region. That is, each image region consists of pixels falling within the corresponding grayscale distribution interval; the pixels in the same image region can be continuous or scattered. Next, a target grayscale distribution interval is selected from the multiple grayscale distribution intervals, and a reference grayscale value is obtained based on the grayscale values distributed within the target grayscale distribution interval. For example, the grayscale values of all pixels falling within the target grayscale distribution interval can be statistically analyzed to obtain the reference grayscale value; the statistical method includes, but is not limited to, averaging the grayscale values of all pixels. Then, the grayscale values of the special light image signal are normalized based on the reference grayscale value to obtain special light quantization parameters; mapping the normalized special light quantization parameters to a specific color yields the special light quantization image.
[0134] The target grayscale distribution range can be the grayscale distribution range with the smallest grayscale value. Since the grayscale value of the special optical signal of normal tissue is usually small, the grayscale distribution range with the smallest grayscale value usually corresponds to the normal tissue area. Normalization based on the reference grayscale value of this area can highlight the difference between normal tissue area and abnormal tissue area while ensuring the stability of normal tissue area, making it easier to identify abnormal tissue in image.
[0135] In another embodiment, quantitative evaluation based on special light image signals includes blood supply quantitative evaluation of special light image signals. The special light quantification parameters indicate the differences in blood supply in different tissue regions. Compared with conventional special light images, special light quantification images generated based on the results of blood supply evaluation can present objective and quantitative blood supply evaluation results.
[0136] Similar to the normalization method, the blood supply assessment process first divides the image signal into multiple gray-level distribution intervals based on the gray-level distribution of the specific optical image signal, with each interval corresponding to an image region. Then, blood supply assessment is performed on each image region separately, based on the differences in gray-level values over time. Specifically, the gray-level values distributed in each gray-level distribution interval are statistically analyzed to obtain the relationship between the gray-level values of each interval and time, i.e., the relationship between the gray-level values of the corresponding image region and time. This relationship can be represented as a curve. Next, the blood supply assessment parameters for each image region are obtained based on the relationship between the gray-level values of each region and time. Finally, the blood supply assessment parameters for all image regions are normalized to obtain the specific optical quantization parameters for each image region.
[0137] For example, see Figure 3 ,exist Figure 3 In the example, AF represents different grayscale distribution intervals. The pixels of tissue I are mainly distributed in intervals B and C, while the pixels of tissue II are mainly distributed in intervals D and E. The curves of grayscale values changing over time are different for different grayscale distribution intervals, meaning that the grayscale values respond differently over time. This difference is mainly due to the different blood supply. Therefore, blood supply assessment parameters can be extracted from the curves of grayscale values changing over time for each grayscale distribution interval.
[0138] See Figure 4 Blood supply assessment parameters include, but are not limited to, the time to the start of the curve's ascent (T0). onset Time to rise to peak (T) max Peak grayscale (I) max ), the area under the curve (AUC), and other characteristic parameters derived therefrom, such as T. p =(T max -T onset ).
[0139] Then, using the blood supply assessment parameters of one image region as a benchmark, the blood supply assessment parameters of each image region can be normalized to the blood supply assessment parameters of that image region, resulting in specific light quantization parameters corresponding to each image region. Mapping the normalized specific light quantization parameters to a specific color yields a specific light quantization image. In some embodiments, the blood supply assessment parameters can also be directly used as specific light quantization parameters, or other operations can be performed on the blood supply assessment parameters to obtain specific light quantization parameters.
[0140] In one embodiment, before quantizing the special optical image signal, the contrast of the special optical image signal can be amplified. This amplification can be achieved through adaptive amplification or amplification based on received operational instructions, i.e., manual amplification. Amplifying the contrast can increase the difference in grayscale intensity between different tissues. Subsequently, when dividing the grayscale distribution intervals, multiple different grayscale distribution intervals are defined based on the grayscale values after the contrast amplification. Specifically, the contrast can be increased by adjusting the grayscale distribution histogram of the special optical image signal, thereby increasing the difference in fluorescence intensity between different tissues, and multiple different grayscale intervals are defined based on the adjusted histogram. Statistical graphs can also include curves, pie charts, etc.
[0141] The above section introduced two quantitative assessment methods. The gray-scale normalization-based method can amplify the gradient differences in fluorescent agent (e.g., ICG) concentrations across different tissues. The blood supply-based method can automatically segment different tissue regions for blood supply assessment and present the results without requiring manual selection of reference and test areas. Both methods consume fewer computational resources and offer high real-time performance.
[0142] In some embodiments, an operation instruction to select a quantization evaluation method can be obtained first, and the quantization evaluation method for the special light image signal can be determined based on the received operation instruction. When the quantization evaluation method is determined to be the first quantization evaluation method, the special light quantization parameters are obtained by normalizing the grayscale values of the special light image signal as described above; when the quantization evaluation method is determined to be the second quantization evaluation method, the special light quantization parameters are obtained by blood supply evaluation based on the special light image signal as described above. One of the two quantization evaluation methods can be set as the default quantization evaluation method. For example, if the method of normalizing the grayscale values of the special light image signal is set as the default quantization evaluation method, then the blood supply evaluation method is used for quantization evaluation when an operation instruction for blood supply evaluation is received; otherwise, the method of normalizing grayscale values is used by default. Optionally, two different forms of quantization evaluation can be performed simultaneously, and two different special light quantized images can be displayed.
[0143] In addition to the two methods mentioned above, other feasible methods can be used for quantitative evaluation based on special optical image signals, as long as the characteristics of the tissue can be quantitatively characterized based on special optical image signals. This embodiment of the invention does not limit this.
[0144] After obtaining the specific light quantization parameters, in step S230, a specific light quantization image is generated based on the specific light quantization parameters of different image regions. Specifically, the specific light quantization parameters can be mapped to color values according to the mapping relationship between the specific light quantization parameters and color values, thereby obtaining the specific light quantization image. The color selection can be a continuous gradient color, for example, the color gradually changes from blue to yellow as the specific light quantization parameters increase; or, the mapped color can be multiple discontinuous monochrome colors, for example, the specific light quantization parameters within a certain range correspond to the same color.
[0145] Furthermore, the correspondence between specific light quantization parameters and the colors of the specific light quantization image can be adjusted according to received operation instructions; that is, the mapping relationship between specific light quantization parameters and color values can be adjusted. For example, a user can specify a particular range of specific light quantization parameters corresponding to a specific color to highlight the image area corresponding to that range. Alternatively, when a user adjusts the contrast of the specific light quantization image, the difference between the color values corresponding to different specific light quantization parameters can be increased.
[0146] In step S240, a special light quantization image and a quantization label are output synchronously. The quantization label is used to characterize the correspondence between the colors of the special light quantization image and the special light quantization parameters. The quantization label includes at least a numerical value related to the special light quantization parameters. This value can be in pure numerical form, such as 1-10, with different numbers corresponding to different colors; or it can be in percentage form, such as 0-100%, with different percentages corresponding to different colors. This quantization label can quantitatively present the differences in quantization parameters in different regions, thereby quantitatively characterizing the special light quantization image.
[0147] In one embodiment, the quantization label includes a color bar that displays the colors of a specific light quantization image and the numerical values of specific light quantization parameters corresponding to different colors. See also Figure 5 and Figure 6 The color displayed on the color bar matches the color of the special light quantization image. If the special light quantization image is generated by mapping special light quantization parameters to a continuous color between blue and yellow, then the color bar will be a gradient from yellow to blue. If the special light quantization image is generated by mapping special light quantization parameters to multiple monochrome colors, then the color bar will also display the corresponding number of monochrome colors. The value of the special light quantization parameter is displayed near the corresponding color on the color bar to indicate the mapping relationship between the two. This value can be... Figure 5 The pure numbers shown can also be Figure 6 The percentages shown. The color bars can be as follows: Figure 5 and Figure 6 The overlay shown can be displayed on a special light quantization image or outside of a special light quantization image.
[0148] As an alternative implementation, the quantization label includes the numerical value of a specific light quantization parameter displayed at the target location in the specially quantized light image. See also Figure 7 The values displayed at the corresponding locations provide a more targeted indication of the specific light quantization parameters at the target location. Users can refer to these values to determine the specific light quantization parameters at the target location. Similarly, the values of the specific light quantization parameters displayed on the specific light quantization image can be in purely numerical form or, as shown in the image, can be... Figure 7 The percentages shown are in the form of percentages.
[0149] For example, the target location for displaying the value of a specific light quantization parameter can be determined according to user instructions. For instance, if a user clicks on a location in the image with the specific light quantization parameter, that location will be used as the target location to display the corresponding value of the specific light quantization parameter. Alternatively, the target location can be automatically determined according to preset rules, including but not limited to the location with the maximum specific light quantization parameter and the location with the minimum specific light quantization parameter.
[0150] Furthermore, in addition to displaying the numerical value of the specific light quantization parameter at the target location, the quantization label may also include a graphic marker displayed at the target location, which is displayed in association with the numerical value of the specific light quantization parameter. (Continue to refer to...) Figure 7 , Figure 7 The graphic marker shown is a rectangle displayed at the target location, with the value of the special light quantization parameter displayed on one side of the rectangle. The graphic marker can also be a circle, triangle, or other arbitrary shape. In some embodiments, the graphic marker may be omitted.
[0151] In some embodiments, the two types of quantization labels can be used in combination. For example, a color bar is displayed by default on a special light quantization image, and when the user clicks on a certain part of the image, the value of the special light quantization parameter at the corresponding location and the graphic marker are displayed.
[0152] Furthermore, when the correspondence between the special light quantization parameters and the color of the special light quantization image is adjusted according to the received operation command, in addition to the special light quantization image changing with the adjustment command, the quantization label also changes accordingly, and the display shows the adjusted special light quantization image and quantization label.
[0153] Furthermore, if special light quantization parameters and images are generated using a blood supply assessment method, a statistical graph showing the change of grayscale values over time for at least one image region during the blood supply assessment process can be displayed, and the location corresponding to the displayed statistical graph can be marked in the special light quantization image. For example, when a user clicks on a location in the image, the image region or grayscale distribution range corresponding to that location is determined based on the received operation command, and a statistical graph showing the change of the corresponding grayscale values over time is displayed. This statistical graph can be implemented in the form of a curve. See also... Figure 8 and Figure 9 The statistical chart can be as follows: Figure 8 The images shown are displayed independently from the special light quantization images, for example, side by side, to avoid obscuring the images; or they can be displayed as follows: Figure 9 The overlay shown is displayed on a special light quantization image, making the interface layout more compact. Furthermore, since the special light quantization image is a pseudo-color image, brightness or fluorescence brightness can be used instead of grayscale when displaying statistical charts.
[0154] In one embodiment, when displaying statistical charts corresponding to at least two image regions, the statistical charts corresponding to the at least two image regions can be displayed independently or superimposed. Figure 8 The statistical charts for positions 1 and 2 are displayed independently, that is, in two different coordinate systems, thus providing a clearer view. Figure 9 The statistical charts for positions 1 and 2 are overlaid on the same coordinate system. This display method is beneficial for comparing and analyzing the change curves at different positions.
[0155] For example, when displaying a chart, the quantification labels can be hidden, or the chart can be displayed simultaneously with the quantification labels.
[0156] Based on the above description, the special light quantization imaging method 200 for endoscopes in this embodiment of the invention performs quantization evaluation on special light image signals to generate special light quantization images. The special light quantization images present the quantization differences in different regions and quantitatively indicate these differences through quantization labels. Moreover, the process of generating special light quantization images does not require manual intervention, has strong real-time performance, and has a simple operation process.
[0157] Figure 10 This is a schematic flowchart of a special light quantization imaging method 1000 for endoscopes according to an embodiment of the present invention, which specifically includes the following steps:
[0158] In step S1010, a special light image signal is acquired when performing special light imaging on the tissue;
[0159] In step S1020, multiple image regions are determined based on the special light image signal, and the grayscale value of different image regions changes over time.
[0160] In step S1030, blood supply assessment parameters for different image regions are obtained based on the relationship between the grayscale values and time.
[0161] In step S1040, a special light quantization image is generated based on the blood supply assessment parameters;
[0162] In step S1050, a statistical graph showing the relationship between the grayscale value of the special light quantization image and at least one image region and the change over time is output.
[0163] The special light quantization imaging method 1000 for endoscopes in this embodiment of the invention is similar to the method for generating special light quantization images by blood supply assessment described in method 200. The main difference is that the special light quantization imaging method 1000 is not limited to displaying the special light quantization image and quantization label synchronously. It only needs to display the statistical graph of the change relationship between the gray values of at least one image region and time synchronously with the special light quantization image.
[0164] The process of obtaining the relationship between grayscale values of different image regions and time includes: dividing the grayscale distribution of a special light image signal into multiple grayscale distribution intervals, each corresponding to an image region; and statistically analyzing the grayscale values distributed in each grayscale distribution interval to obtain the relationship between the grayscale values of each image region and time.
[0165] After obtaining the relationship between grayscale values and time in different image regions, blood supply assessment parameters for the corresponding image regions can be obtained based on this relationship. For example, the blood supply assessment parameters are obtained based on at least one of the following features related to the relationship between grayscale values and time: start-up time, time to peak value, peak grayscale value, and area under the curve. In one embodiment, a statistical graph can also be displayed synchronously with the blood supply assessment parameters or features obtained based on the statistical graph.
[0166] In one embodiment, the starting time point for the statistical chart of the grayscale value change over time can also be determined based on the received operation instruction. For example, the time when the user presses a specified key can be used as the starting time point for drawing the statistical chart. In one example, the function of setting the start time point can be coupled to the key that enables the curve display function. That is, when an instruction to display the statistical chart of the grayscale value change over time is received, the statistical chart is generated and displayed with the instruction receiving time as the starting time point.
[0167] After obtaining the blood supply assessment parameters, these parameters are normalized for different image regions to obtain specific light quantization parameters for each region. A specific light quantization image is then generated based on these parameters. Specifically, generating the specific light quantization image involves mapping different specific light quantization parameters to corresponding color values. Furthermore, the mapping relationship between the specific light quantization parameters and color values can be determined based on received operation instructions, thereby adjusting the color of the specific light quantization image.
[0168] The special light quantization imaging method 1000 for endoscopes in this embodiment of the invention has many similar or identical contents to the special light quantization imaging method 200 for endoscopes described above. For details, please refer to the above text, which will not be repeated here.
[0169] Figure 11 This is a schematic flowchart of a special light quantization imaging method 1100 for endoscopes according to an embodiment of the present invention, which specifically includes the following steps:
[0170] In step S1110, a special light image signal is acquired when performing special light imaging on the tissue;
[0171] In step S1120, a quantization evaluation is performed based on the special light image signal to obtain special light quantization parameters for different image regions;
[0172] In step S1130, the special light quantization parameters are mapped to the corresponding color values to generate a first special light quantization image;
[0173] In step S1140, a color threshold range is obtained, and color values in the first special light quantization image that are outside the color threshold range are processed to obtain a second special light quantization image.
[0174] In step S1150, the second special light quantization image is displayed.
[0175] In the special light quantization imaging method 1100 for endoscopy, a first special light quantization image is first generated based on any of the methods described above. Then, overly bright areas (e.g., liver fluorescence in biliary tract fluorescence applications) or overly dark areas (e.g., initially unstained areas in the parenchyma after liver resection) in the first special light quantization image are processed, for example, by not displaying areas exceeding a color threshold range to avoid affecting the overall image display effect. The color threshold range can be a pre-stored fixed color threshold range, or a color threshold range determined according to received operation instructions, i.e., a color threshold range manually set by the user.
[0176] In one embodiment, the first special light quantization image and the second special light quantization image can also be displayed synchronously, for example, the first special light quantization image can be displayed in a small window for user reference.
[0177] The special light quantization imaging method 1100 for endoscopes in this embodiment of the invention has many similar or identical contents to the special light quantization imaging method 200 for endoscopes described above. For details, please refer to the above text, which will not be repeated here.
[0178] Figure 12This is a schematic flowchart of a special light quantization imaging method 1200 for endoscopes according to an embodiment of the present invention, which specifically includes the following steps:
[0179] In step S1210, a special light image signal is acquired when performing special light imaging on the tissue;
[0180] In step S1220, multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region;
[0181] In step S1230, a target grayscale distribution interval is selected from the plurality of grayscale distribution intervals, and a reference grayscale value is obtained based on the grayscale values distributed in the target grayscale distribution interval.
[0182] In step S1240, the grayscale value of the special light image signal is normalized according to the reference grayscale value to obtain the special light quantization parameter;
[0183] In step S1250, a special light quantization image is generated based on the special light quantization parameters;
[0184] In step S1260, the special light quantization image is output.
[0185] The special light quantization imaging method 1200 for endoscopes in this embodiment is similar to the method 200 for generating special light quantization images by normalizing grayscale values. The main difference is that when outputting the special light quantization image, it is not limited to displaying the special light quantization image and quantization label simultaneously; the special light quantization image can also be displayed separately. Other specific details of the special light quantization imaging method 1200 can be found in the relevant description of the special light quantization imaging method 200, and will not be repeated here.
[0186] Figure 13 This is a schematic flowchart of a special light quantization imaging method 1300 for endoscopes according to an embodiment of the present invention, which specifically includes the following steps:
[0187] In step S1310, a special light image signal is acquired when performing special light imaging on the tissue;
[0188] In step S1320, multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region;
[0189] In step S1330, the gray value variation relationship with time in different gray distribution ranges is obtained based on the special light image signal;
[0190] In step S1340, blood supply assessment parameters for different image regions are obtained based on the relationship between the grayscale values and time.
[0191] In step S1350, the blood supply assessment parameters for different image regions are normalized to obtain specific light quantization parameters corresponding to each image region.
[0192] In step S1360, a special light quantization image is generated based on the special light quantization parameters;
[0193] In step S1370, the special light quantization image is output.
[0194] The special light quantization imaging method 1300 for endoscopes in this embodiment is similar to the method for generating special light quantization images in method 200, which assesses blood supply. The main difference is that when outputting the special light quantization image, it is not limited to displaying the special light quantization image and quantization label simultaneously; the special light quantization image can also be displayed separately. Other specific details of the special light quantization imaging method 1300 can be found in the relevant description of the special light quantization imaging method 200, and will not be repeated here.
[0195] Figure 14 This is a schematic flowchart of a special light quantization imaging method 1400 for endoscopes according to an embodiment of the present invention, which specifically includes the following steps:
[0196] In step S1410, a special light image signal is acquired when performing special light imaging on the tissue;
[0197] In step S1420, an operation instruction for selecting a quantization evaluation method is obtained, and a quantization evaluation method for the special optical image signal is determined according to the operation instruction.
[0198] In step S1430, when the quantization evaluation method is determined to be the first quantization evaluation method, the gray value of the special light image signal is normalized to obtain the special light quantization parameter; when the quantization evaluation method is determined to be the second quantization evaluation method, blood supply evaluation is performed based on the special light image signal to obtain the special light quantization parameter.
[0199] In step S1440, a special light quantization image is generated based on the special light quantization parameters;
[0200] In step S1450, the special light quantization image is output.
[0201] The special optical quantization imaging method 1400 for endoscopy in this embodiment of the invention can provide switching between two quantization methods. The gray-value normalization-based quantization assessment method can amplify the gradient differences in fluorescent agent (e.g., ICG) concentrations in different tissues; the blood supply assessment-based quantization assessment method can automatically divide different tissue regions for blood supply assessment and present the results without requiring manual selection of reference and test areas. Both quantization assessment methods consume relatively few computational resources, have high real-time performance, and can perform corresponding quantization assessments according to user operation commands, providing corresponding special optical quantization images. The special optical quantization imaging method 1400 for endoscopy in this embodiment of the invention shares many similarities with the special optical quantization imaging method 200 for endoscopy described above, which can be referred to above for details and will not be repeated here.
[0202] This invention also provides an endoscope system, revisited from [previous version]. Figure 1 The endoscope system 100 includes: a light source unit 110; a light source control unit 120 for controlling the light source unit 110 to provide light required for special light imaging; an endoscope 130 including an insertion part capable of being inserted into a living organism and at least one sensor for acquiring image signals; a processor 140 for executing the above method to obtain a special light quantized image; and a display 150 for displaying the special light quantized image. The specific structure of the endoscope system 100 and the method executed by the processor 140 have been described above and will not be repeated here.
[0203] Please refer to Figure 5-6 This application provides a method for displaying endoscopic fluorescence images, comprising:
[0204] Step 1: Display the endoscopic fluorescence image of the area to be observed on the patient.
[0205] Step 2: Generate and display a fluorescence brightness indicator based on the fluorescence brightness in the fluorescence image.
[0206] Step 3: Based on the fluorescence brightness of the fluorescence image, display a corresponding numerical label near the fluorescence brightness indicator, the numerical label identifying the fluorescence brightness level in the fluorescence brightness indicator.
[0207] In this embodiment, the method for obtaining the endoscopic fluorescence image and the fluorescence brightness level in the fluorescence image can refer to the description in the above embodiment, and will not be repeated here.
[0208] In one embodiment, the fluorescence brightness indicator may be Figure 5-6 The color bars shown correspond to the fluorescence brightness of the fluorescence image, for example, they are gradient color bars corresponding to the fluorescence brightness.
[0209] In one embodiment, the numerical label can be as follows: Figure 5 The natural number values shown, or as Figure 6 The percentage values shown.
[0210] Please refer to Figure 7 This application provides another method for displaying endoscopic fluorescence images, including:
[0211] Step 1: Display the endoscopic fluorescence image of the area to be observed on the patient.
[0212] Step 2: Based on the fluorescence brightness in the fluorescence image, generate a numerical label that identifies the fluorescence brightness level.
[0213] Step 3: Identify the corresponding numerical labels for image regions with different fluorescence brightness in the fluorescence image.
[0214] In this embodiment, the method for obtaining the endoscopic fluorescence image and the fluorescence brightness level in the fluorescence image can refer to the description in the above embodiment, and will not be repeated here.
[0215] In one embodiment, such as Figure 7 As shown, the numerical label can be a percentage value, and the image area of fluorescence brightness corresponding to the numerical label can be marked with a box. The numerical label is displayed near the box or inside the box.
[0216] Please refer to Figure 8-9 This application provides another method for displaying endoscopic fluorescence images, including:
[0217] Step 1: Display the endoscopic fluorescence image of the area to be observed on the patient.
[0218] Step 2: Determine at least one image region in the fluorescence image, and acquire and display the trend information of the fluorescence brightness of the image region over time.
[0219] In this embodiment, the method for obtaining endoscopic fluorescence images can be referred to the description in the above embodiment, and will not be repeated here.
[0220] In one embodiment, the trend information of fluorescence brightness variation of an image region over time can be displayed using a trend graph with horizontal and vertical axes. The trend graphs for multiple image regions can be displayed using... Figure 8 The method of displaying it separately in the middle can also be adopted. Figure 9 The trend graph can be displayed in a combined manner. It can be overlaid on the fluorescence image or displayed in a split-screen format. Alternatively, in other embodiments, the trend information of fluorescence brightness changes over time in the image area can also be presented using a trend table. Figure 7-8 The two selected image regions are shown separately, each marked with a box.
[0221] Although exemplary embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above exemplary embodiments are merely illustrative and are not intended to limit the scope of the invention thereto. Various changes and modifications can be made therein by those skilled in the art without departing from the scope and spirit of the invention. All such changes and modifications are intended to be included within the scope of the invention as claimed in the appended claims.
[0222] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
[0223] In the several embodiments provided by this invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed.
[0224] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.
[0225] Similarly, it should be understood that, in order to streamline the invention and aid in understanding one or more of the various aspects of the invention, features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof in the description of exemplary embodiments of the invention. However, this approach should not be construed as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as reflected in the corresponding claims, its inventive point lies in solving the corresponding technical problem with fewer features than all of those in a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of the invention.
[0226] Those skilled in the art will understand that, apart from the mutual exclusion of features, all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or apparatus so disclosed can be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.
[0227] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features but not others included in other embodiments, combinations of features from different embodiments are intended to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments can be used in any combination.
[0228] The various component embodiments of the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some modules according to embodiments of the present invention. The present invention can also be implemented as an apparatus program (e.g., a computer program and computer program product) for performing some or all of the methods described herein. Such programs implementing the present invention can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
[0229] It should be noted that the above embodiments are illustrative of the invention and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.
[0230] The above description is merely a specific embodiment of the present invention or an explanation of that embodiment. The scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. The scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; The special light image signal is quantitatively evaluated to obtain special light quantization parameters for different image regions. The quantization evaluation includes extracting the spatial distribution differences or time response differences of the special light signals in different image regions. The special light quantization parameters are used to characterize the spatial distribution differences or time response differences. Generate special light quantization images based on the special light quantization parameters of the different image regions; The special light quantization image and quantization label are output synchronously. The quantization label is used to characterize the correspondence between the color of the special light quantization image and the special light quantization parameters.
2. The method as described in claim 1, characterized in that, The quantization label includes a color bar that displays the color of the special light quantization image and the numerical values of the special light quantization parameter corresponding to different colors.
3. The method as described in claim 2, characterized in that, The colors displayed in the color bar are either continuously gradient colors or discrete colors.
4. The method as described in claim 1, characterized in that, The quantization label includes the value of a special light quantization parameter displayed at the target location in the special light quantization image.
5. The method as described in claim 4, characterized in that, The quantization label also includes a graphic marker displayed at the target location, the graphic marker being displayed in association with the value of the special light quantization parameter.
6. The method as described in claim 1, characterized in that, It also includes adjusting the correspondence between the special light quantization parameters and the colors of the special light quantization image according to the received operation instructions, and displaying the adjusted special light quantization image and quantization label.
7. The method as described in claim 1, characterized in that, The step of quantizing and evaluating the specific light image signal to obtain specific light quantization parameters for different image regions includes: The grayscale values of the special light image signal are normalized to obtain the special light quantization parameters.
8. The method as described in claim 7, characterized in that, The normalization of the grayscale values of the special light image signal to obtain the special light quantization parameters includes: Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region; Select a target grayscale distribution interval from the plurality of grayscale distribution intervals, and obtain a reference grayscale value based on the grayscale values distributed in the target grayscale distribution interval; The grayscale value of the special light image signal is normalized based on the reference grayscale value to obtain the special light quantization parameter.
9. The method according to claim 1, characterized in that, The step of quantizing and evaluating the specific light image signal to obtain specific light quantization parameters for different image regions includes: Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region; By statistically analyzing the gray values distributed in each gray-level distribution interval, the relationship between the gray values of each image region and time is obtained. Based on the relationship between the grayscale value and time, the blood supply assessment parameters corresponding to each image region are obtained; The blood supply assessment parameters are normalized to obtain the specific light quantization parameters corresponding to each image region.
10. The method according to claim 9, characterized in that, It also includes a statistical graph showing the relationship between the grayscale value corresponding to at least one image region and time, and marking the position corresponding to the displayed statistical graph in the special light quantization image.
11. The method according to claim 10, characterized in that, When displaying the statistical charts corresponding to at least two image regions, the statistical charts corresponding to the at least two image regions are displayed independently or superimposed.
12. The method according to claim 9, characterized in that, The blood supply assessment parameters are obtained based on at least one of the following characteristics of the relationship between the gray value and time: start time of rise, time to rise to peak, peak gray value, and area under the curve.
13. The method as described in claim 1, characterized in that, It also includes selecting the quantization evaluation method according to the received operation instruction. The quantization evaluation method includes: normalizing the grayscale value of the special light image signal to obtain the special light quantization parameter; or, performing blood supply evaluation based on the special light image signal to obtain the special light quantization parameter.
14. The method according to claim 1, characterized in that, Before performing a quantization evaluation based on the specific optical image signal, the method further includes: The contrast of the special optical image signal is amplified, including adaptive amplification or amplification based on received operation instructions.
15. The method as described in claim 1, characterized in that, The step of generating a special light quantization image based on the special light quantization parameters of the different image regions includes: mapping the special light quantization parameters to corresponding color values to obtain the special light quantization image; The method further includes: determining the mapping relationship between the special light quantization parameter and the color value based on the received operation instruction.
16. The method as described in claim 1, characterized in that, The special optical imaging includes fluorescence imaging, laser speckle imaging, narrowband light reflection imaging, or optical coherence tomography.
17. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; Multiple image regions are determined based on the special light image signal, and the grayscale value of different image regions changes over time. Blood supply assessment parameters for different image regions are obtained based on the relationship between grayscale values and time. A special optical quantization image is generated based on the blood supply assessment parameters; Output a statistical graph showing the relationship between the grayscale value of the special light-quantized image and at least one image region over time.
18. The method as described in claim 17, characterized in that, The process of obtaining the relationship between grayscale values of different image regions and time includes: Based on the grayscale distribution of the special light image signal, multiple grayscale distribution intervals are divided, and each grayscale distribution interval corresponds to an image region; By statistically analyzing the gray values distributed in each gray-level range, the relationship between the gray values of each image region and time is obtained.
19. The method as described in claim 17 or 18, characterized in that, The step of generating a special light quantization image based on the blood supply assessment parameters includes: The blood supply assessment parameters for different image regions are normalized to obtain specific light quantization parameters for each image region. The special light quantization image is generated based on the special light quantization parameters.
20. The method as described in claim 19, characterized in that, The step of generating the special light quantization image based on the special light quantization parameters includes: mapping different special light quantization parameters to corresponding color values to obtain the special light quantization image; The method further includes: determining the mapping relationship between the special light quantization parameter and the color value based on the received operation instruction.
21. The method as described in claim 17, characterized in that, The blood supply assessment parameters are obtained based on at least one of the following characteristics of the relationship between the gray value and time: start time of rise, time to rise to peak, peak gray value, and area under the curve.
22. The method as described in claim 21, characterized in that, It also includes synchronously displaying a statistical graph showing the relationship between the blood supply assessment parameters or the feature values and the grayscale values over time.
23. The method as described in claim 18, characterized in that, It also includes the starting time point of a statistical graph that determines the relationship between the grayscale value and time based on the received operation instructions.
24. The method as described in claim 23, characterized in that, The step of determining the starting time point of the statistical graph showing the relationship between grayscale values and time based on the received operation instructions includes: When an instruction is received to display a statistical chart showing the relationship between the grayscale values and time, the statistical chart is generated and displayed with the instruction receiving time as the starting time point.
25. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; The special light image signal is quantitatively evaluated to obtain special light quantization parameters for different image regions. The quantization evaluation includes extracting the spatial distribution differences or time response differences of the special light signals in different image regions. The special light quantization parameters are used to characterize the spatial distribution differences or time response differences. The special light quantization parameters are mapped to the corresponding color values to generate a first special light quantization image; Obtain a color threshold range, and process the color values in the first special light quantization image that are outside the color threshold range to obtain a second special light quantization image; Display the second special light quantization image.
26. The method as described in claim 25, characterized in that, The acquisition of the color threshold range includes acquiring a pre-stored color threshold range or determining the color threshold range according to a received operation instruction.
27. The method as described in claim 25, characterized in that, It also includes displaying the first special light quantization image and the second special light quantization image synchronously.
28. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; Multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region; Select a target grayscale distribution interval from the plurality of grayscale distribution intervals, and obtain a reference grayscale value based on the grayscale values distributed in the target grayscale distribution interval; The gray values of the special light image signal are normalized based on the reference gray values to obtain special light quantization parameters; A special light quantization image is generated based on the special light quantization parameters; Output the special light quantization image.
29. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; Multiple gray-scale distribution intervals are divided according to the gray-scale distribution of the special light image signal, and each gray-scale distribution interval corresponds to an image region; The relationship between grayscale values and time in different grayscale distribution ranges is obtained based on the special optical image signal. Blood supply assessment parameters for different image regions are obtained based on the relationship between grayscale values and time. The blood supply assessment parameters for different image regions are normalized to obtain specific light quantization parameters for each image region. A special light quantization image is generated based on the special light quantization parameters; Output the special light quantization image.
30. A special light quantization imaging method for endoscopes, characterized in that, The method includes: Acquire special light image signals when performing special light imaging on tissues; Obtain an operation instruction to select a quantization evaluation method, and determine a quantization evaluation method for the special optical image signal based on the operation instruction; When the quantization evaluation method is determined to be the first quantization evaluation method, the gray value of the special light image signal is normalized to obtain the special light quantization parameter. When the quantization evaluation method is determined to be the second quantization evaluation method, blood supply evaluation is performed based on the special light image signal to obtain the special light quantization parameter. A special light quantization image is generated based on the special light quantization parameters; Output the special light quantization image.
31. An endoscope system, characterized in that, include: Light source section; A light source control unit is used to control the light source unit to provide the light required for special light imaging. An endoscope, comprising an insertion portion capable of being inserted into a living organism and at least one sensor for acquiring image signals; A processor for performing the method of any one of claims 1-30 to obtain a special light quantization image; as well as A display for showing the special light quantization image.
Citation Information
Patent Citations
Fluorescent observation device
CN104853666A
Endoscope system and imaging method thereof
CN111449611A
