Medical electronic endoscope image processing control system and method

Abstract

The application relates to the field of endoscopes, and discloses a medical electronic endoscope image processing control system and method, which combines multiple optical imaging technologies in the same endoscope device, adjusts combined light for observing a lesion, and can more clearly observe the problem of the lesion. The system comprises a light source illumination adjuster, an endoscope system controller, an image sensor, and multiple memories. The light source illumination adjuster is controlled by the endoscope system controller to sequentially output first combined light, second combined light, and third combined light. The image sensor saves the brightness images corresponding to the combined light into corresponding memories respectively. The first, second, and third memories extract the brightness images to constitute a complete image. The first brightness image constitutes a red channel of the complete image, the second brightness image constitutes a green channel of the complete image, and the third brightness image constitutes a blue channel of the complete image.

Description

Technical Field

[0001] This application relates to the field of endoscopy, specifically to a medical electronic endoscope image processing control system and method. Background Technology

[0002] This section is intended to provide background or context for the embodiments of this application as set forth in the claims. The description herein is not intended to imply that it is prior art that has been disclosed, simply because it is included in this section.

[0003] In recent years, medical electronic endoscope illumination and image processing technologies have developed rapidly. From narrow-band imaging (NBI) using xenon lamps with narrow-band filters a decade ago, to the current widespread use of multispectral LED illumination combined with linked image processing, NBI uses optical filters to eliminate red light and select blue and green wavelengths, thereby emphasizing mucosal surface structures and vascular imaging. It has been reported that NBI significantly improves the contrast between lesions and normal mucosa. Following NBI, blue light imaging (BLI) and linked color imaging (LCI) have become new image enhancement modes. BLI and LCI illuminate the mucosa with short-wavelength narrow-band light, utilizing multispectral LED illumination with multiple different color radiations without the need for optical filters. Furthermore, the acquired color information is reassigned to different colors similar to the mucosal color, thus improving the performance of vascular depiction. Its enhanced red-color image processing allows for clear visualization of red vessels and white pits in LCI. The recently released Texture and Color Enhancement Imaging (TXI) is a novel method for enhancing images. TXI aims to enhance three image factors in white-lit images: texture, brightness, and color. TXI's color enhancement algorithm aims to widen the color difference between red and white tones in the image. In addition, there is Autofluorescence Imaging (AFI), a diagnostic technique designed to enhance the contrast between tumor margins and normal mucosa, helping doctors to more easily detect tumors. RDI technology enhances the observation of hemorrhage, aiming to more easily locate bleeding sites during endoscopic treatment.

[0004] Autofluorescence imaging (AFI) is currently recognized as one of the best methods for diagnosing precancerous lesions. However, the widely used AFI technology, while touted as an image enhancement technique for human autofluorescence, has three problems: First, it requires a dedicated endoscope with two CCD camera modules. This device can only be used on the same patient after a routine endoscopic examination, which is inconvenient and increases patient discomfort. Second, because it uses a xenon lamp illuminated by blue and green filters, the illumination intensity is far from sufficient to excite the body's own fluorescence emission, resulting in more red fluorescence and unclear lesion differentiation. Third, in AFI, green light is never filtered out. This means that a large portion of the green in the final image is mucosal reflection of the initial green light. While this improves image brightness and clarity, this green light significantly affects the weak green fluorescence, greatly impacting diagnostic sensitivity and specificity. Therefore, AFI technology has not been widely adopted.

[0005] Another long-standing problem in endoscopic diagnosis and treatment is that when significant bleeding occurs during endoscopic diagnosis and treatment, it is difficult to locate the bleeding point and perform hemostasis. Under white light illumination, blood absorbs light very significantly, resulting in a darkened image, making it even more difficult to observe the bleeding point. Inexperienced physicians may fail to achieve hemostasis. Therefore, improving the imaging of bleeding points (especially in cases of significant bleeding) under endoscopy has become one of the problems that medical endoscopes need to solve. Summary of the Invention

[0006] The purpose of this application is to provide a medical electronic endoscope image processing control system and method that combines multiple optical imaging technologies in the same endoscope device, adjusts the combined light for observing lesions, and can more clearly observe the lesions.

[0007] This application discloses a medical electronic endoscope image processing and control system, including: a light source illumination regulator, an endoscope system controller, an image sensor, and multiple memories;

[0008] The light source illumination regulator is configured to be controlled by the endoscope system controller to sequentially output a first combination of light, a second combination of light, and a third combination of light;

[0009] The image sensor is configured to save a first brightness image corresponding to a first combination of light to a first memory, save a second brightness image corresponding to a second combination of light to a second memory, and save a third brightness image corresponding to a third combination of light to a third memory.

[0010] The first memory, the second memory, and the third memory are configured to extract luminance images to form a complete image; wherein the first luminance image constitutes the red channel of the complete image, the second luminance image constitutes the green channel of the complete image, and the third luminance image constitutes the blue channel of the complete image.

[0011] Furthermore, at least one of the following conditions must be met: the first combination of light includes light of other colors that are not red; the second combination of light includes light of other colors that are not green; and the third combination of light includes light of other colors that are not blue.

[0012] In a preferred embodiment, the first combination of light includes 630nm light and 720nm light, the second combination of light includes white light and 525nm light, and the third combination of light includes 415nm light and 450nm light.

[0013] In a preferred embodiment, an image processor and an image generator are also included;

[0014] The image processor is configured to perform digital enhancement processing on the luminance image simultaneously output by the memory;

[0015] The image generator is configured to combine a digitally enhanced brightness image with an endoscopic image and output it to a display.

[0016] In a preferred embodiment, an image signal processing allocation unit is also included;

[0017] The image signal processing and allocation unit is configured to receive the first brightness image, the second brightness image, and the third brightness image and allocate them to the red channel, the green channel, and the blue channel, respectively.

[0018] In a preferred embodiment, the light source illumination regulator includes a light source composite module, a first dichroic mirror, a second dichroic mirror, a first light source module, a second light source module, and a light guide rod;

[0019] The endoscope system controller controls the light source composite module, the first light source module and / or the second light source module to combine to form the first combined light, the second combined light and the third combined light;

[0020] The emitted light from the light source composite module passes through the first dichroic mirror and the second dichroic mirror to reach the light guide rod;

[0021] The light emitted from the first light source module is reflected by the first dichroic mirror and then reaches the light guide rod through the second dichroic mirror. The light emitted from the second light source module is reflected by the second dichroic mirror and then reaches the light guide rod.

[0022] In a preferred embodiment, the light source composite module emits white light of 400-760nm, violet-blue light of 415nm, blue light of 450nm, green light of 525nm, red light of 630nm, and red light of 720nm; the first light source module emits 405nm light; and the second light source module emits 850nm light.

[0023] This application also discloses a method for image processing and control of a medical electronic endoscope, including:

[0024] The control light source lighting regulator outputs a first combination of light, and the image sensor saves the first brightness image corresponding to the first combination of light to the first memory.

[0025] The control light source illumination regulator outputs a second combination of light, and the image sensor saves the second brightness image corresponding to the second combination of light to a second memory.

[0026] The control light source lighting regulator outputs a third combination of light, and the image sensor saves the third brightness image corresponding to the third combination of light to the third memory;

[0027] A complete image is constructed by extracting luminance images from the first memory, the second memory, and the third memory; wherein, the first luminance image constitutes the red channel of the complete image, the second luminance image constitutes the green channel of the complete image, and the third luminance image constitutes the blue channel of the complete image.

[0028] Furthermore, at least one of the following conditions must be met:

[0029] The first combination of light includes light of other colors that are not red.

[0030] The second combination of light includes light of other colors that are not green.

[0031] The third combination of light includes light of other colors that are not blue.

[0032] In a preferred embodiment, after extracting the brightness images from the first memory, the second memory, and the third memory to form a complete image, the process further includes:

[0033] The image processor performs digital enhancement processing on the brightness image simultaneously output from the memory and outputs it to the image generator;

[0034] The image generator combines the digitally enhanced brightness image with the endoscopic image and outputs it to the display.

[0035] In a preferred embodiment, it also includes:

[0036] The image signal processing and allocation unit receives the first brightness image, the second brightness image, and the third brightness image and allocates them to the first memory, the second memory, and the third memory, respectively.

[0037] This application also discloses a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the method described above.

[0038] In the embodiments of this application, by controlling the light source illumination regulator to output combined light to the corresponding memory in sequence, color imaging is completed by the brightness image signals obtained by the three memory after the cyclic illumination. Moreover, the combined light includes light of other colors that do not belong to the pure color of the combined light, thereby meeting the need to use different light sources to irradiate different lesions, and the observation effect is clearer.

[0039] Furthermore, the first light source module of this application uses 405nm laser illumination, which is introduced through the endoscope to irradiate the lesion. Under the induction of 405nm light, the tumor tissue produces strong red fluorescence and very weak green fluorescence, while the normal tissue produces very weak red fluorescence and very strong green fluorescence. In order to highlight the contrast between the tumor tissue and the normal mucosa, the present invention uses 680-730nm low-brightness red light illumination by combining the light source composite module, which can enhance the imaging contrast between the tumor tissue and the normal mucosa tissue.

[0040] Furthermore, the second light source module of this application uses 850nm near-infrared light illumination. Hemoglobin in blood vessels has a strong absorption peak at 850nm in the near-infrared spectrum (760-1100nm), so clear blood flow and blood oxygenation images can be obtained, thereby helping doctors to objectively analyze the blood supply status of the surrounding blood vessels of the diseased tissue and assisting in the diagnosis of tumors, inflammation, edema, polyps, etc.

[0041] Furthermore, the image processor of this application can perform linked processing of images under different chromatographic illuminations according to the controller's instructions, thereby processing the observed lesion images as needed.

[0042] The various technical features disclosed in the above-described invention, the various technical features disclosed in the following embodiments and examples, and the various technical features disclosed in the accompanying drawings can be freely combined to form various new technical solutions (all of which should be considered as having been recorded in this specification), unless such a combination of technical features is technically infeasible. For example, in one example, feature A+B+C is disclosed, and in another example, feature A+B+D+E is disclosed. Features C and D are equivalent technical means that serve the same function, and technically only one needs to be used; it is impossible to use both simultaneously. Feature E can be technically combined with feature C. Therefore, the solution A+B+C+D should not be considered as having been recorded because it is technically infeasible, while the solution A+B+C+E should be considered as having been recorded. Attached Figure Description

[0043] Figure 1 This is a schematic diagram of a system structure according to one embodiment of this application;

[0044] Figure 2 This is a flowchart illustrating one embodiment of this application;

[0045] Figure 3 This is a timing diagram according to one embodiment of this application;

[0046] Figure 4 This is a timing diagram according to one embodiment of this application;

[0047] Figure 5 This is a timing diagram according to one embodiment of this application;

[0048] Figure 6 This is a timing diagram according to one embodiment of this application;

[0049] Figure 7 This is a timing diagram according to one embodiment of this application;

[0050] Figure 8 This is a timing diagram according to one embodiment of this application;

[0051] Figure 9 This is a timing diagram according to one embodiment of this application. Detailed Implementation

[0052] In the following description, many technical details are presented to help the reader better understand this application. However, those skilled in the art will understand that the technical solutions claimed in this application can be implemented even without these technical details and various variations and modifications based on the following embodiments.

[0053] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0054] The first embodiment of this application relates to a medical electronic endoscope image processing and control system, the structural diagram of which is shown below. Figure 1 As shown, the system includes: a light source illumination regulator, an endoscope system controller, an image sensor, and multiple memory units;

[0055] The light source illumination modulator is configured to be controlled by the endoscope system controller to sequentially output a first combination of light, a second combination of light, and a third combination of light;

[0056] The image sensor is configured to save a first brightness image corresponding to a first combination of light to a first memory, save a second brightness image corresponding to a second combination of light to a second memory, and save a third brightness image corresponding to a third combination of light to a third memory.

[0057] The first memory, the second memory, and the third memory are configured to extract luminance images to form a complete image; wherein the first luminance image constitutes the red channel of the complete image, the second luminance image constitutes the green channel of the complete image, and the third luminance image constitutes the blue channel of the complete image.

[0058] Furthermore, at least one of the following conditions must be met: the first combination of light includes light of other colors that are not red; the second combination of light includes light of other colors that are not green; and the third combination of light includes light of other colors that are not blue.

[0059] Optionally, the first combination of light may include 630nm light and 720nm light, the second combination of light may include white light and 525nm light, and the third combination of light may include 415nm light and 450nm light.

[0060] Optionally, the system may also include an image processor and an image generator. The image processor is configured to digitally enhance the brightness image simultaneously output from the memory, improving the edge and tissue details of the image, performing noise reduction, wide dynamic range processing, and contrast enhancement. It can also perform linked processing of images under different chromatographic illuminations according to instructions from the endoscope system controller. The image generator is configured to synthesize the digitally enhanced brightness image with the endoscopic image and output it to a display.

[0061] Optionally, the system may further include an image signal processing and distribution unit. The image signal processing and distribution unit is configured to receive a first brightness image, a second brightness image, and a third brightness image and distribute them to the red channel, green channel, and blue channel, respectively.

[0062] Optionally, the light source illumination regulator may include a light source composite module, a first dichroic mirror, a second dichroic mirror, a first light source module, a second light source module, and a light guide rod. The endoscope system controller can control the combination of the light source composite module, the first light source module, and / or the second light source module to form a first combined light, a second combined light, and a third combined light. The light emitted from the light source composite module passes through the first and second dichroic mirrors to reach the light guide rod. The light emitted from the first light source module is reflected by the first dichroic mirror and then passes through the second dichroic mirror to reach the light guide rod; the light emitted from the second light source module is reflected by the second dichroic mirror to reach the light guide rod.

[0063] Optionally, the light source illumination regulator may also include a dimming wheel located between the light guide rod and the second dichroic mirror. The dimming wheel can be used to receive instructions from the endoscope system controller to adjust the illumination brightness, or the illumination brightness can be adjusted by manually operating the dimming wheel.

[0064] Optionally, the light source composite module can emit white light of 400-760nm, violet-blue light of 415nm, blue light of 450nm, green light of 525nm, red light of 630nm, and red light of 720nm. The first light source module can emit 405nm light, and the second light source module can emit 850nm light.

[0065] The second embodiment of this application relates to a medical electronic endoscope image processing control method, the flowchart of which is shown below. Figure 2 As shown:

[0066] In step S201, the light source illumination regulator is controlled to output the first combination light, and the image sensor saves the first brightness image corresponding to the first combination light to the first memory.

[0067] In step S202, the control light source illumination regulator outputs the second combination light, and the image sensor saves the second brightness image corresponding to the second combination light to the second memory.

[0068] In step S203, the control light source illumination regulator outputs a third combination of light, and the image sensor saves the third brightness image corresponding to the third combination of light to the third memory.

[0069] In step S204, brightness images are extracted from the first memory, the second memory, and the third memory to form a complete image; wherein, the first brightness image constitutes the red channel of the complete image, the second brightness image constitutes the green channel of the complete image, and the third brightness image constitutes the blue channel of the complete image.

[0070] Furthermore, in steps S201 to S204 above, at least one of the following conditions must be met:

[0071] The first combination of light includes light of other colors that are not red.

[0072] The second combination of light includes light of other colors that are not green.

[0073] The third combination of light includes light of other colors that are not blue.

[0074] Optionally, the following steps may be included after step S204:

[0075] In step S205, the image processor performs digital enhancement processing on the brightness image simultaneously output from the memory and outputs it to the image generator.

[0076] In step S206, the image generator combines the digitally enhanced brightness image with the endoscopic image and outputs it to the display.

[0077] Optionally, the method may further include: an image signal processing and allocation unit receiving a first brightness image, a second brightness image, and a third brightness image and allocating them to a first memory, a second memory, and a third memory, respectively.

[0078] This embodiment is a method embodiment corresponding to the first embodiment. The technical details in the first embodiment can be applied to this embodiment, and the technical details in this embodiment can also be applied to the first embodiment.

[0079] To better understand the technical solution of this application, several specific examples are provided below. The details listed in these examples are mainly for ease of understanding and are not intended to limit the scope of protection of this application.

[0080] Example 1: White Light Mode

[0081] Clock period T:

[0082] The first combination of light consists of 100% brightness 630nm red light + 50% brightness 720nm red light; the second combination of light consists of 60% white light + 100% brightness 525nm green light; the third combination of light consists of 40% brightness 415nm blue-violet light + 100% brightness 450nm blue light.

[0083] like Figure 3 The figure shown is a timing diagram in white light mode. At any given moment, the endoscope system controller controls the light source composite module to emit the first combined light and stores it in the first memory. At any given moment, the endoscope system controller controls the light source composite module to emit a second combination of light and stores it in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit a third combination of light and store it in the third memory.

[0084] The signal of the first brightness image obtained by the first combination of illumination is sent to the first memory (red); the signal of the second brightness image obtained by the second combination of illumination is sent to the second memory (green); and the signal of the third brightness image obtained by the third combination of illumination is sent to the third memory (blue). The image processor obtains the signals of the first brightness image, the second brightness image, and the third brightness image from the first memory, the second memory, and the third memory, respectively. After performing image enhancement processing, the signals are sent to the image generator to generate a digital video output signal for display on the monitor.

[0085] This mode employs a method of alternating illumination with first, second, and third combined light sources while incorporating other monochromatic or white light illumination. Adding monochromatic or white light illumination in each color separation sequence compensates for the insufficient spectral width of monochromatic LEDs. It primarily utilizes the LED's emission spectrum distribution to enhance the representation of red inflammatory areas, blue blood vessels, and the contours of lesions in the image. This spectral combination method improves upon the color defects encountered when using red, green, and blue monochromatic LEDs alone, and enhances the image's color gamut performance in white light illumination mode.

[0086] Example 2: Narrow-band illumination mode for blood vessels and lesion edges

[0087] Clock period T:

[0088] The first combination of light is 525nm green light; the second combination of light is 415nm violet-blue light; and the third combination of light is 405nm laser light.

[0089] The narrow-band illumination mode at the edges of blood vessels and lesions can enhance the contrast between the edges of small lesions in blood vessels and mucous membranes and normal mucous membranes during endoscopic examination.

[0090] like Figure 4 The image shown is a time-series diagram under a narrow-band illumination pattern of the blood vessel and lesion margin. At any given time, the endoscope system controller controls the first light source module to emit a third combination of light, which is stored in the third memory, and controls the light source composite module to emit a second combination of light, which is stored in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit the first combination of light and store it in the first memory.

[0091] The signal of the first brightness image (green narrowband image) obtained by the first combination of illumination is sent to the first memory (red); the signal of the second brightness image obtained by the second combination of illumination and the signal of the third brightness image obtained by the third combination of illumination are simultaneously sent to the second memory (green) and the third memory (blue). The image processor obtains the signals of the first brightness image, the second brightness image, and the third brightness image from the first memory, the second memory, and the third memory, respectively. After image enhancement processing by the image processor, the signals are sent to the image generator to generate a digital video output signal for display. This allows the displayed image to clearly distinguish the superficial and deep blood vessels under the mucosa and the edges of tiny lesions.

[0092] Example 3: Independent Fluorescence Imaging Display Mode

[0093] Clock period T:

[0094] The first combination of light is 720nm light; the second combination of light is 405nm laser light; and the third combination of light is 415nm light.

[0095] like Figure 5 The image shown is a timeline diagram in the standalone fluorescence imaging display mode. At any given time, the endoscope system controller controls the first light source module to emit a second combination of light, which is stored in the second memory, and controls the light source composite module to emit a third combination of light, which is also stored in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit the first combination of light and store it in the first memory.

[0096] The signal of the first brightness image obtained by the first combination of illumination is sent to the first memory (red); the signal of the second brightness image obtained by the second combination of illumination and the signal of the third brightness image obtained by the third combination of illumination are simultaneously sent to the second memory (green). The image processor obtains the signals of the first brightness image and the second brightness image from the first memory and the second memory respectively, and after performing image enhancement processing, sends them to the image generator to generate a digital video output signal for display.

[0097] This mode uses 405nm and 415nm to excite the intrinsic fluorescence of human tissue. Combining it with 720nm light can improve the image brightness and the image contrast between the edge of the lesion and normal tissue.

[0098] Example 4: Dual Display Mode for Comparison of Self-contained Fluorescent and White Light Images

[0099] Clock period T:

[0100] This mode is a side-by-side comparison display mode of Embodiments 1 and 3. In the image generator's processing, the output display interface has two image display areas: the first image display area is in white light mode, and the second image display area is in its own fluorescence mode. In the first image area, the first combination of light is 100% brightness 630nm red light + 50% brightness 720nm red light; the second combination of light is 60% white light + 100% brightness 525nm green light; and the third combination of light is 40% brightness 415nm blue-violet light + 100% brightness 450nm blue light. In the second image area, the first combination of light is 720nm light; the second combination of light is 405nm laser light; and the third combination of light is 415nm light.

[0101] like Figure 6 The image shown is a timing diagram in a dual-display mode comparing proprietary fluorescence and white light images, from 0 to... At any given moment, the endoscope system controller controls the light source composite module to emit the first combined light and stores it in the first memory. At any given moment, the endoscope system controller controls the light source composite module to emit a second combination of light and stores it in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit a third combination of light and stores it in the third memory. The brightness image at any given moment is displayed in the first image display area of ​​the monitor via an image generator. At any given moment, the endoscope system controller controls the first light source module to emit the second combined light and controls the light source composite module to emit the third combined light, both of which are stored in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit the first combined light and stores it in the first memory. The brightness image at any given moment is displayed in the second image display area of ​​the monitor via an image generator. The white light mode image and the intrinsic fluorescence mode image are displayed in their respective display areas. The frame rate is displayed alternately.

[0102] Example 5: Hybrid Illumination Imaging Mode of Fluorescent Marker Illumination and White Light Mode

[0103] Clock period T:

[0104] This mode is based on Example 1, incorporating a 405nm laser that excites GNNT nanoprobe materials (fluorescent markers) to emit light in tumor cells. The first combination of light is 100% brightness 630nm red light + 50% brightness 720nm red light; the second combination of light is 60% white light + 100% brightness 525nm green light + 405nm laser; the third combination of light is 40% brightness 415nm blue-violet light + 100% brightness 450nm blue light.

[0105] like Figure 7 The image shown is a time-series diagram under fluorescent marker illumination and white light mixed illumination imaging modes. At any given moment, the endoscope system controller controls the light source composite module to emit the first combined light and stores it in the first memory. At any given moment, the endoscope system controller controls the light source composite module to emit 60% white light + 100% brightness 525nm green light, and simultaneously controls the first light source module to emit 405nm laser light, which is stored in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit a third combination of light and stores it in the third memory. The image processor obtains signals from the first brightness image, the second brightness image, and the third brightness image from the first memory, the second memory, and the third memory, respectively. After image enhancement processing by the image processor, these signals are sent to the image generator to generate a digital video output signal for display on the monitor.

[0106] Example 6: Enhanced mode for displaying bleeding

[0107] Clock period T:

[0108] The first combination of light is 525nm light + 850nm light; the second combination of light is 630nm light; and the third combination of light is 720nm light.

[0109] When there is a lot of bleeding, the thermal imaging effect of 850nm near-infrared illumination is used. The temperature of the bleeding point is higher than that of the surrounding tissue. In image processing, this bright spot is highlighted to show the depth of the bleeding point.

[0110] like Figure 8 The figure shown is a timing diagram in the enhanced bleeding display mode. At any given moment, the endoscope system controller controls the light source composite module to emit 525nm light and simultaneously controls the second light source module to emit 850nm light, storing the data in the second memory. At any given time, the endoscope system controller controls the light source composite module to emit 630nm, 720nm, and 525nm light, which are then stored in the first memory. The image processor obtains signals from the first and second brightness images from the first and second memories, respectively. After image enhancement processing, the signals are sent to the image generator to produce a digital video output signal for display.

[0111] Example 7: Blood Flow Imaging Mode

[0112] Clock period T:

[0113] This mode is the side-by-side comparison display mode of Example 1 and vascular images. In the image generator's processing, the output display interface has two image display areas: the first image display area is in white light mode, and the second image display area is in intrinsic fluorescence mode. In the first image area, the first combined light is 100% brightness 630nm red light + 50% brightness 720nm red light; the second combined light is 60% white light + 100% brightness 525nm green light; and the third combined light is 40% brightness 415nm blue-violet light + 100% brightness 450nm blue light. The combined light in the second image area is 850nm near-infrared light.

[0114] like Figure 9 The image shown is a time-series diagram in blood flow imaging mode. At any given moment, the endoscope system controller controls the light source composite module to emit the first combined light and stores it in the first memory. At any given moment, the endoscope system controller controls the light source composite module to emit a second combination of light and stores it in the second memory. At any given moment, the endoscope system controller controls the light source composite module to emit a third combination of light and stores it in the third memory. The brightness image at any given moment is displayed in the first image display area of ​​the monitor via an image generator. At any given moment, the endoscope system controller controls the emission of 850nm light, and the endoscope system controller controls it to... At any given moment, 850nm light is stored in the first memory. At any given moment, 850nm light is stored in the second memory. At that moment, the 850nm light is stored in the third memory. The brightness image at any given time is displayed in the second image display area of ​​the monitor via an image generator. The white light mode image and the blood vessel image are displayed in their respective display areas. The frame rate is displayed alternately.

[0115] Accordingly, embodiments of this application also provide a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the various method embodiments of this application. Computer-readable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device. As defined herein, computer-readable storage media does not include transient media, such as modulated data signals and carrier waves.

[0116] It should be noted that in this application, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. In this application, if it refers to performing an action according to an element, it means performing the action at least according to that element, including two cases: performing the action only according to that element, and performing the action according to that element and other elements. Expressions such as "multiple," "repeatedly," and "various" include two, two times, two kinds, and more than two, more than two times, and more than two kinds.

[0117] The numbering used in describing the steps of a method does not inherently limit the order of these steps. For example, a step with a higher number does not necessarily have to be executed after a step with a lower number; it can be executed first and then second, or even in parallel, as long as this execution order is reasonable to someone skilled in the art. Similarly, multiple steps with consecutively numbered sequences (e.g., step 101, step 102, step 103, etc.) do not restrict other steps from being executed between them; for example, there can be other steps between step 101 and step 102.

[0118] This specification includes combinations of various embodiments described herein. Individual references to embodiments are made (e.g., "one embodiment," "some embodiments," or "preferred embodiments"); however, these embodiments are not mutually exclusive unless indicated to be mutually exclusive or are readily apparent to those skilled in the art. It should be noted that the word "or" is used in a non-exclusive sense throughout this specification unless the context explicitly indicates or requires it.

[0119] All references to this specification are considered to be incorporated integrally into the disclosure of this application so that they can serve as the basis for modifications if necessary. Furthermore, it should be understood that the above descriptions are merely preferred embodiments of this specification and are not intended to limit the scope of protection of this specification. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of one or more embodiments of this specification should be included within the scope of protection of one or more embodiments of this specification.

[0120] In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Claims

1. A medical electronic endoscope image processing and control system, characterized in that, include: Light source illumination regulator, endoscope system controller, image sensor, and multiple memory units; The light source illumination regulator is configured to be controlled by the endoscope system controller to sequentially output a first combination of light, a second combination of light, and a third combination of light; The image sensor is configured to save a first brightness image corresponding to a first combination of light to a first memory, save a second brightness image corresponding to a second combination of light to a second memory, and save a third brightness image corresponding to a third combination of light to a third memory. The first memory, the second memory, and the third memory are configured to extract brightness images after time-sequential illumination to form a complete image; wherein, the first brightness image constitutes the red channel of the complete image, the second brightness image constitutes the green channel of the complete image, and the third brightness image constitutes the blue channel of the complete image. Furthermore, at least one of the following conditions must be met: the first combination of light includes light of colors other than red; the second combination of light includes light of colors other than green; and the third combination of light includes light of colors other than blue, in order to meet the need for different light sources when observing different lesions. The first combination of light includes 630nm light and 720nm light, the second combination of light includes white light and 525nm light, and the third combination of light includes 415nm light and 450nm light.

2. The medical electronic endoscope image processing and control system as described in claim 1, characterized in that, It also includes image processors and image generators; The image processor is configured to perform digital enhancement processing on the luminance image simultaneously output by the memory; The image generator is configured to combine a digitally enhanced brightness image with an endoscopic image and output it to a display.

3. The medical electronic endoscope image processing and control system as described in claim 1, characterized in that, It also includes an image signal processing and allocation unit; The image signal processing and allocation unit is configured to receive the first brightness image, the second brightness image, and the third brightness image and allocate them to the red channel, the green channel, and the blue channel, respectively.

4. The medical electronic endoscope image processing and control system as described in claim 1, characterized in that, The light source illumination regulator includes a light source composite module, a first dichroic mirror, a second dichroic mirror, a first light source module, a second light source module, and a light guide rod; The endoscope system controller controls the light source composite module, the first light source module and / or the second light source module to combine to form the first combined light, the second combined light and the third combined light; The emitted light from the light source composite module passes through the first dichroic mirror and the second dichroic mirror to reach the light guide rod; The light emitted from the first light source module is reflected by the first dichroic mirror and then reaches the light guide rod through the second dichroic mirror. The light emitted from the second light source module is reflected by the second dichroic mirror and then reaches the light guide rod.

5. The medical electronic endoscope image processing and control system as described in claim 4, characterized in that, The light source composite module emits white light of 400-760nm, violet-blue light of 415nm, blue light of 450nm, green light of 525nm, red light of 630nm, and red light of 720nm. The first light source module emits 405nm light, and the second light source module emits 850nm light.

6. A method for image processing and control of a medical electronic endoscope, characterized in that, include: The control light source lighting regulator outputs a first combination of light, and the image sensor saves the first brightness image corresponding to the first combination of light to the first memory. The control light source illumination regulator outputs a second combination of light, and the image sensor saves the second brightness image corresponding to the second combination of light to a second memory. The control light source lighting regulator outputs a third combination of light, and the image sensor saves the third brightness image corresponding to the third combination of light to the third memory; A complete image is formed by extracting brightness images after sequential illumination from the first memory, the second memory, and the third memory; wherein, the first brightness image constitutes the red channel of the complete image, the second brightness image constitutes the green channel of the complete image, and the third brightness image constitutes the blue channel of the complete image. Furthermore, at least one of the following conditions must be met: The first combination of light includes light of other colors that are not red. The second combination of light includes light of other colors that are not green. The third combination of light includes light of other colors that are not blue light; To meet the need for different light sources when observing different lesions; The first combination of light includes 630nm light and 720nm light, the second combination of light includes white light and 525nm light, and the third combination of light includes 415nm light and 450nm light.

7. The medical electronic endoscope image processing and control method as described in claim 6, characterized in that, After extracting the brightness images from the first memory, the second memory, and the third memory to form a complete image, the process further includes: The image processor performs digital enhancement processing on the brightness image simultaneously output from the memory and outputs it to the image generator; The image generator combines the digitally enhanced brightness image with the endoscopic image and outputs it to the display.

8. The medical electronic endoscope image processing and control method as described in claim 6, characterized in that, Also includes: The image signal processing and allocation unit receives the first brightness image, the second brightness image, and the third brightness image and allocates them to the first memory, the second memory, and the third memory, respectively.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 6 to 8.

Images