Endoscopic device

Abstract

The present invention provides an endoscope device, comprising: an illumination unit for emitting illumination light; an imaging unit for collecting light returned from a target tissue after being irradiated by the illumination light and forming an initial image signal; an image output unit for outputting a first image signal and a second image signal based on the initial image signal, wherein the first image signal is a response signal corresponding to a first frequency band light, and the second image signal is a response signal corresponding to a second frequency band light, the peak wavelength of the first frequency band light is within a band range of 500nm to 550nm, and the peak wavelength of the second frequency band light is within a band range of 550nm to 600nm; a display unit for generating and displaying an endoscopic image according to the first image signal and the second image signal; wherein the frequency band light corresponding to each image signal for generating the endoscopic image is within a band range of more than 450nm. The endoscope device can improve the convenience of minimally invasive treatment under endoscopy and reduce the possibility of accidentally injuring large blood vessels under the mucosa and thus causing the wound to be difficult to heal.

Description

Technical Field

[0001] The present invention relates to the technical field of medical equipment, and in particular to an endoscope device. Background Art

[0002] An endoscope is a medical electronic optical instrument that integrates optical, mechanical, and electrical technologies. It is used to illuminate and image the body's internal cavity, and the image of the body's internal cavity can be output on a display for observation. With the development of endoscopic technology, it is increasingly helping people make medical diagnoses. Early detection and early diagnosis are the key to improving the clinical treatment of cancer. To this end, a variety of imaging modes that can highlight superficial microstructures and the morphology of superficial mucosal blood vessels have been proposed in related technologies to assist doctors in quickly identifying early lesions.

[0003] With the increasing popularity of endoscopic equipment, the methods of performing minimally invasive treatment of diseased tissues by extending medical instruments from the forceps channel of the endoscope have gradually become more diverse, such as endoscopic mucosal resection (EMR), endoscopic en bloc mucosal resection (ESD), endoscopic full-thickness resection (EFTR), etc.

[0004] However, in actual application, the endoscopic images obtained by the endoscopic device mainly focus on the enhanced imaging of the superficial microvascular structure. During the process of minimally invasive treatment under the microscope, when the doctor refers to the above endoscopic images to perform treatment operations (for example, removing lesions), it is easy to accidentally injure the large blood vessels under the mucosa, which makes the wound difficult to heal. Summary of the invention

[0005] The present invention has been made in view of the above-mentioned problems.

[0006] According to one aspect of the present invention, there is provided an endoscopic device, comprising:

[0007] An illumination unit, used for emitting illumination light to a target tissue;

[0008] An imaging unit, used for collecting light returned from the target tissue after being irradiated by the illumination light, and forming an initial image signal;

[0009] an image output unit, configured to output a first image signal and a second image signal based on the initial image signal, wherein the first image signal is a response signal corresponding to light in a first frequency band, the second image signal is a response signal corresponding to light in a second frequency band, the peak wavelength of light in the first frequency band is within a wavelength range of 500 nm to 550 nm, and the peak wavelength of light in the second frequency band is within a wavelength range of 550 nm to 600 nm;

[0010] The display unit is used to generate an endoscopic image based on the first image signal and the second image signal, and display the endoscopic image; wherein the frequency band light corresponding to each image signal used to generate the endoscopic image is within a wavelength range above 450nm.

[0011] Exemplarily, the wavelength range of the first frequency band light is greater than or equal to 30 nm, and / or the wavelength range of the second frequency band light is greater than or equal to 30 nm.

[0012] Exemplarily, the first frequency band light has a continuous spectrum within a wavelength range of 500-550 nm, and the second frequency band light has a continuous spectrum within a wavelength range of 550-600 nm.

[0013] Exemplarily, the half-peak widths of the first frequency band light and the second frequency band light are between 25 nm and 50 nm.

[0014] Exemplarily, the image output unit is further used to output a third image signal based on the initial image signal, the third image signal being a response signal corresponding to light in a third frequency band, and a peak wavelength of the light in the third frequency band being greater than 600 nm;

[0015] The display unit is used to generate the endoscopic image based on the first image signal, the second image signal, and the third image signal.

[0016] For example,

[0017] The imaging unit comprises a first signal channel and a second signal channel, wherein the first signal channel and the second signal channel are respectively used to collect light returned from the target tissue after being irradiated by the illumination light, and form a first initial image signal and a second initial image signal;

[0018] The system spectral response curve of the first signal channel corresponds to the wavelength band of the first target frequency band light, the system spectral response curve of the second signal channel covers the wavelength band of the second target frequency band light, the first target frequency band light is one of the first frequency band light and the second frequency band light, and the second target frequency band light is the other of the first frequency band light and the second frequency band light;

[0019] The image output unit is used to output the first initial image signal as a response signal of the first image signal and the second image signal corresponding to the first target frequency band light, and output a response signal of the first image signal and the second image signal corresponding to the second target frequency band light based on the second initial image signal.

[0020] Exemplarily, the illumination light includes green broadband light, and the green broadband light has the following spectral characteristics: cut-off within a wavelength range less than or equal to 450 nm, a peak wavelength within a wavelength range of 500 nm to 600 nm, and a continuous spectrum within the wavelength range of 500 nm to 600 nm;

[0021] The camera unit includes a color image sensor with a Bayer filter, and a blue channel, a green channel, and a red channel of the color image sensor respectively collect light returned from the target tissue after being irradiated by the illumination light to form a blue initial image signal, a green initial image signal, and a red initial image signal;

[0022] The image output unit is configured to output the blue initial image signal as the first image signal, and output the second image signal according to the green initial image signal.

[0023] Exemplarily, the illumination light further includes red broadband light, and the red broadband light has the following spectral characteristics: having a peak wavelength in a wavelength band range of 600nm to 650nm, and having a continuous spectrum in a wavelength band range of 600nm to 650nm;

[0024] The image output unit is further used to output a third image signal according to the red initial image signal;

[0025] The display unit is specifically configured to generate an endoscopic image according to the first image signal, the second image signal, and the third image signal, and display the endoscopic image.

[0026] For example,

[0027] The lighting unit comprises a light combining component and at least two light sources, and the light emitted by the at least two light sources is combined by the light combining component to form the lighting light;

[0028] or,

[0029] The illumination unit includes a white light source and one or more filters. The white light emitted by the white light source passes through the one or more filters to form the illumination light.

[0030] Exemplarily, the illumination light has a continuous spectrum within a wavelength range of 500nm to 600nm;

[0031] The first signal channel has a spectral response sensitivity curve corresponding to the first frequency band light, and is used to collect light returned from the target tissue and located in the wavelength range of the first frequency band light to form the first initial image signal;

[0032] The second signal channel has a spectral response sensitivity curve corresponding to the second frequency band light, and is used to collect light returned from the target tissue and located in the wavelength range of the second frequency band light to form the second initial image signal;

[0033] The image output unit is configured to output the first initial image signal as the first image signal, and output the second initial image signal as the second image signal.

[0034] Exemplarily, the illumination light includes the first frequency band light and the second frequency band light, and the illumination unit is used to emit the first frequency band light and the second frequency band light in a time-sharing manner;

[0035] Wherein, when the illumination unit emits the first frequency band light, the imaging unit is used to collect the light returned from the target tissue after being irradiated by the first frequency band light, and form a fourth initial image signal; when the illumination unit emits the second frequency band light, the imaging unit is used to collect the light returned from the target tissue after being irradiated by the second frequency band light, and form a fifth initial image signal;

[0036] The image output unit is configured to output the fourth initial image signal as the first image signal, and output the fifth initial image signal as the second image signal.

[0037] In the above-mentioned endoscope device, the first image signal corresponding to the wavelength band of 500nm~550nm and the second image signal corresponding to the wavelength band of 550nm~600nm are determined respectively according to the light returned from the target tissue after being irradiated by the illumination light, and the frequency band light corresponding to each image signal used to generate the endoscopic image is all located in the wavelength band above 450nm, and then the endoscopic image is generated according to the first image signal and the second image signal. The endoscopic image generated by the endoscopic device can avoid the information interference of the superficial mucosal microvessels, accurately obtain the information of the middle and deep biological tissues, which is conducive to the medical staff to judge the location of the middle and deep blood vessels, and then help to perform treatment operations accordingly.

[0038] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The above and other purposes, features and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0040] Figure 1 A schematic block diagram of an endoscope device according to an embodiment of the present invention is shown;

[0041] Figure 2 A schematic diagram showing the blood spectrum absorption characteristics according to an embodiment of the present invention;

[0042] Figure 3 A schematic diagram showing a spectral response sensitivity curve of each signal channel of a camera unit according to an embodiment of the present invention;

[0043] Figure 4 A schematic block diagram of an endoscope device according to an embodiment of the present invention is shown;

[0044] Figure 5 A schematic diagram showing the spectrum of illumination light after beam combination according to an embodiment of the present invention is shown;

[0045] Figure 6 A schematic diagram showing system spectral response curves of various signal channels of a camera unit according to an embodiment of the present invention is shown;

[0046] Figure 7 A schematic diagram showing a green channel desired system spectral response curve according to an embodiment of the present invention is shown;

[0047] Figure 8 A schematic diagram showing an illumination light spectrum according to yet another embodiment of the present invention;

[0048] Fig. 9 A schematic diagram showing system spectral response curves of various signal channels of a camera unit according to an embodiment of the present invention; and

[0049] Fig.10 A schematic diagram of a green channel desired system spectral response curve according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical scheme and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.

[0051] In order to achieve early detection and early diagnosis of various types of cancer, current endoscopic imaging mainly focuses on enhanced imaging of superficial microstructures and blood vessels. However, during minimally invasive treatment under the microscope, when doctors refer to the above endoscopic images to perform treatment operations (for example, resection of lesions), it is easy to accidentally injure large blood vessels under the mucosa, which makes it difficult for the wound to heal. Therefore, existing endoscopic imaging is not suitable for minimally invasive treatment under the microscope.

[0052] In this regard, the inventor of the present application has found that the main reason for the above situation is that the area that needs to be treated is usually the area where the lesion is located, and the area where the lesion is located and its surrounding areas usually have rich microvascular texture information, which will block the information of the middle and deep tissues in the area and its surrounding areas, making it difficult for doctors to obtain the information of the middle and deep tissues in the area where the lesion is located and its surrounding areas. However, when doctors perform treatment operations such as resection, they will inevitably touch the middle and deep tissue structures in the area where the lesion is located and its surrounding areas, and the submucosal large blood vessels are usually distributed in the middle layer (about 2mm) and deep layer (about 3mm) of the tissue, so when doctors refer to the above endoscopic images to perform treatment operations, it is difficult to notice the location of the blood vessels in the middle and deep layers in the area where the lesion is located and its surrounding areas, and it is difficult to determine the depth of the large blood vessels, and then it is easy to accidentally injure the submucosal large blood vessels when performing treatment operations such as resection. The submucosal large blood vessels are usually thicker and relatively difficult to stop bleeding, so once they rupture, the wound will be difficult to heal.

[0053] In view of this, an embodiment of the present application provides an endoscopic device, which generates an endoscopic image for a doctor to view based on a first image signal corresponding to a peak wavelength in a band range of 500nm~550nm and a second image signal corresponding to a peak wavelength in a band range of 550nm~600nm. The first image signal can be used to highlight the location of the middle-layer blood vessels, and the second image signal can be used to highlight the location of the deep-layer blood vessels. At the same time, since the frequency band lights corresponding to the various image signals used to generate the endoscopic image for the doctor to view are all within the band range above 450nm, the contrast of the superficial microvessels in the generated endoscopic image is greatly weakened, making it basically consistent with the color tone of other tissues such as the superficial mucosa, which can avoid the superficial microvessel texture information in the area to be treated and its surrounding areas from interfering with the deep tissue information therein, so that the vascular structures presented in the generated endoscopic image are all middle-layer and / or deep-layer vascular structures, which makes it easy for doctors to clearly identify the location of the submucosal large blood vessels in the area to be treated and its surrounding areas, and to reasonably plan the treatment path to avoid damaging the large blood vessels and causing wound bleeding.

[0054] The endoscope device provided in the embodiments of the present application will be described in detail below with reference to the accompanying drawings of the specification.

[0055] Figure 1 FIG. 2 shows a schematic block diagram of an endoscope device according to an embodiment of the present invention. Figure 1 As shown, the endoscope device may include an illumination unit 100 , an imaging unit 200 , an image output unit 300 , and a display unit 400 .

[0056] Illustratively, the illumination unit 100 is used to emit illumination light to a target tissue.

[0057] The target tissue can be any part of the cavity to be examined, such as the digestive tract such as the esophagus and colorectum, the bladder and urethra, the nasal cavity and the throat, etc. It can be understood that the illumination light emitted by the illumination unit 100 directly irradiates the surface of the target tissue, but the target tissue usually has a certain light transmittance, so the illumination light can pass through the target tissue and irradiate a certain depth under the epidermis of the target tissue. According to the distance between the biological tissue and the epidermis of the target tissue, the biological tissue can be roughly divided into shallow, middle, deep and deeper biological tissues. Among them, the biological tissue in the middle layer can be the biological tissue about 2mm below the epidermis of the biological tissue irradiated by the endoscope body during the use of the endoscope device. The deep biological tissue can be the biological tissue about 3mm below the epidermis of the biological tissue irradiated by the endoscope body during the use of the endoscope device. The biological tissue between the middle biological tissue and the epidermis of the biological tissue can be called shallow biological tissue, and the biological tissue farther away from the epidermis of the biological tissue than the deep biological tissue can be called deeper biological tissue.

[0058] The illumination light may be a fixed spectrum illumination light or an adjustable spectrum illumination light. It is understandable that the illumination unit 100 with a relatively simple structure may be used to emit a fixed spectrum illumination light, thereby reducing the use cost of the endoscope. When the illumination light is an adjustable spectrum illumination light, the illumination unit 100 may be controlled by the control system of the endoscope to adjust the illumination light to obtain the desired spectrum illumination light. The control system of the endoscope may be arranged inside the above-mentioned endoscope device. The illumination unit 100 may include at least one light emitting light source, and the illumination unit 100 may determine the illumination light emitted by the above-mentioned endoscope device to the target tissue based on the illumination light emitted by the at least one light emitting light source. For example, when the illumination unit 100 includes only a single light emitting light source, the illumination light emitted by the single light emitting light source may be directly used as the illumination light emitted by the above-mentioned endoscope device to the target tissue. When the illumination unit 100 includes multiple light emitting light sources, the illumination unit 100 may combine the illumination lights emitted by the multiple light emitting light sources to obtain the combined illumination light as the illumination light emitted by the above-mentioned endoscope device to the target tissue.

[0059] It can be understood that after obtaining the combined illumination light or the illumination light emitted by the single light source, the combined illumination light or the illumination light emitted by the single light source can be spectrally processed to remove the illumination light in an unnecessary wavelength range, and then the spectrally processed illumination light is used as the illumination light emitted by the endoscope device to the target tissue. For example, the spectral processing can be a processing method such as filtering using a filter in the illumination unit 100 to filter out the illumination light in an unnecessary wavelength range.

[0060] The imaging unit 200 is used to collect light returning from the target tissue after being irradiated by the illumination light and form an initial image signal.

[0061] When the illumination light irradiates the target tissue, the corresponding light will be returned from the target tissue according to the spectral absorption characteristics of the target tissue and the influence of the surrounding environment. A photoelectric sensor can be set in the camera unit 200, which can convert the received light signal into a corresponding electrical signal. In an embodiment of the present application, the photoelectric sensor can collect the light returned from the target tissue after being irradiated by the illumination light, and generate a corresponding initial image signal based on the light returned from the target tissue, and the initial image signal includes the structural information of the target tissue. The photoelectric sensor may include at least one signal channel, each signal channel can respond to light within a given wavelength band and generate a corresponding initial image signal (that is, each signal channel has a different spectral sensitivity response characteristic). Therefore, one or more initial image signals can be formed according to the number of signal channels.

[0062] For example, Figure 1As shown, the endoscope device may further include a control unit 500, and both the illumination unit and the camera unit 200 may be connected to the control unit 500. The control unit 500 may control the illumination unit 100 to emit illumination light to the target tissue. The control unit 500 may also control the camera unit 200 to collect light returned from the target tissue after being irradiated by the illumination light, and form an initial image signal.

[0063] The image output unit 300 is used to output a first image signal and a second image signal based on the initial image signal. The image output unit 300 can be connected between the camera unit 200 and the display unit 400, and receives the initial image signal from the camera unit 200, and generates the first image signal and the second image signal based on the initial image signal. The first image signal is a response signal corresponding to the first frequency band light, and the second image signal is a response signal corresponding to the second frequency band light. The peak wavelength of the first frequency band light is within the wavelength range of 500nm~550nm, and the peak wavelength of the second frequency band light is within the wavelength range of 550nm~600nm. The first image signal can represent the information of the middle-layer biological tissue, especially the location of the middle-layer blood vessels; and the second image signal can represent the information of the deep-layer biological tissue, especially the location of the deep-layer blood vessels.

[0064] Different objects (such as blood, mucous membrane, etc.) in the target tissue have different absorption characteristics for illumination light of different spectra, which will result in different optical signal characteristics of light in different wavelength ranges returned from the target tissue. The optical signal characteristics may include optical signal intensity, etc. Figure 2A schematic diagram of the blood spectral absorption characteristics according to an embodiment of the present invention is shown. As shown in Figure 2, the relative absorption coefficient of blood for illumination light with a wavelength of 400nm-450nm is relatively high, which will result in a high energy loss of illumination light with a wavelength of 400nm-450nm, making it difficult for illumination light with a wavelength of 400nm-450nm to penetrate shallow biological tissues and effectively irradiate middle or deep biological tissues. At this time, the camera unit 200 may not be able to obtain an initial image signal that more accurately characterizes the information of middle or deep biological tissues based on the light with a wavelength of 400nm-450nm returned from the target tissue, and the light of 400-450nm can significantly enhance the contrast between the shallow blood vessels and the surrounding tissues, making the texture of the shallow microvessels more obvious, blocking the information of the middle or deep biological tissues, thereby affecting the presentation of the information of the middle or deep biological tissues contained in the endoscopic image generated by the endoscopic device. The relative absorption coefficient of blood for illumination light with a wavelength of more than 600nm is low, so blood absorbs less light above 600nm and reflects more light above 600nm. Therefore, irradiating red light with a wavelength of more than 600nm can increase the intensity of the light signal received by the camera unit 200 to increase the brightness of the endoscopic image. Illumination light with a wavelength of 500nm to 550nm can penetrate biological tissues at a depth of about 2mm (middle-layer biological tissues), so the light in this band returned from the target tissue can reflect the information of the middle-layer biological tissues in the target tissue area. Illumination light with a wavelength of 550nm to 600nm can penetrate biological tissues at a depth of about 3mm (deep-layer biological tissues), so the light in this band returned from the target tissue can reflect the information of the deep-layer biological tissues in the target tissue area. In addition, blood has small absorption peaks in the range of 500nm~550nm and 550nm~600nm. The optical signal in this band returned by the blood-containing part of the tissue is relatively weak, so it can contrast with other biological tissues, thereby highlighting biological tissues with blood as the main body, such as blood vessels.

[0065] When the peak wavelength of the first band light is within the wavelength range of 500nm~550nm, the energy distribution of the band light is mainly concentrated within the wavelength range of 500nm~550nm, and the first image signal will also contribute to the endoscopic imaging of the middle biological tissue. When the peak wavelength of the second band light is within the wavelength range of 550nm~600nm, the energy distribution of the band light is mainly concentrated within the wavelength range of 550nm~600nm, and the second image signal will also contribute to the endoscopic imaging of the deep biological tissue.

[0066] Exemplarily, the wavelength range of the first frequency band light is greater than or equal to 30nm. In other words, the difference between the wavelength of the light with the longest wavelength in the first frequency band light and the light with the shortest wavelength in the first frequency band light is greater than or equal to 30nm, that is, the span of the wavelength range of the wavelength of the first frequency band light is greater than or equal to 30mm. When the wavelength range of the first frequency band light is too small, the information of the biological tissue in the middle layer in the first image signal may be less. Therefore, the wavelength range of the first frequency band light can be greater than or equal to 30nm to ensure that the first image signal contains sufficient information of the biological tissue in the middle layer and reduce the omission of information of the biological tissue in the middle layer. As a result, more abundant biological tissue information in the middle layer can be provided in the endoscopic image, such as mucosal stratification, elastic fibers, minimally invasive openings, etc., so as to facilitate doctors to clearly understand the texture characteristics of various biological tissues in the middle layer in the area to be treated and its surrounding areas, so as to more accurately perform microscopic lesion distribution diagnosis and treatment.

[0067] Exemplarily, the wavelength range of the second frequency band light is greater than or equal to 30nm. In other words, the difference between the wavelength of the light with the longest wavelength in the second frequency band light and the light with the shortest wavelength in the second frequency band light is greater than or equal to 30nm, that is, the span of the wavelength range of the wavelength of the second frequency band light is greater than or equal to 30mm. When the wavelength range of the second frequency band light is too small, the information of the deep biological tissue in the second image signal may be less. Therefore, the wavelength range of the second frequency band light can be greater than or equal to 30nm to ensure that the second image signal contains sufficient information of the deep biological tissue and reduce the omission of information of the deep biological tissue. As a result, more abundant deep biological tissue information can be provided in the endoscopic image, such as mucosal stratification, elastic fibers, minimally invasive openings, etc., so as to facilitate doctors to clearly understand the texture characteristics of various biological tissues located deep in the area to be treated and its surrounding areas, so as to more accurately perform microscopic lesion distribution diagnosis and treatment.

[0068] Exemplarily, the first band light has a continuous spectrum in the wavelength range of 500-550nm, and the second band light has a continuous spectrum in the wavelength range of 550-600nm. The first band light has a continuous spectrum in the wavelength range of 500-550nm, that is, the wavelength range of the first band light should cover 500-550nm, which can avoid the omission of information of the biological tissue in the middle layer of the first image signal. For example, when the first band light is in the wavelength range of 500-530nm, the information of the light returned from the target tissue in the wavelength range of 530-550nm will be missing in the first image signal, which will cause the omission of part of the information of the biological tissue in the middle layer of the first image signal, affecting the accuracy of the information of the biological tissue in the middle layer of the final generated endoscopic image. Similarly, the second band light has a continuous spectrum in the wavelength range of 550-600nm, that is, the wavelength range of the second band light should cover 550-600nm, which can avoid the omission of information of the biological tissue in the deep layer of the second image signal. For example, when the second frequency band light is in the wavelength range of 550-580nm, the second image signal will lack the information of the light returned from the target tissue in the wavelength range of 580nm-600nm, which will cause the omission of some information of the deep biological tissue of the second image signal, affecting the accuracy of the information of the deep biological tissue of the final generated endoscopic image. In addition, the first image signal and the second image signal are wide spectrum signals, which are easier to obtain higher illumination brightness than narrow spectrum signals, which is conducive to improving image quality.

[0069] Exemplarily, the half-peak widths of the first band light and the second band light are between 25nm and 50nm. The half-peak width of the first band light being not less than 25nm can make the first image signal contain more information about the biological tissue in the middle layer, and the half-peak width of the second band light being not less than 25nm can make the second image signal contain more information about the biological tissue in the deep layer. The half-peak width of the first band light being not greater than 50nm can reduce the interference of the light signal outside the expected band range on the information about the biological tissue in the middle layer in the endoscopic image, and the half-peak width of the second band light being not greater than 50nm can reduce the interference of the light signal outside the expected band range on the information about the biological tissue in the deep layer in the endoscopic image. For example, when the peak wavelength of the first band light is 525nm, if the half-peak width of the first band light is 60nm, the band range of the first band light may exceed the expected band range, and the first image signal may contain more information about the light signal in the band range of 550~560nm. The information of the light signal in the band range of 550~560nm will interfere with the information of the biological tissue in the middle layer. Therefore, setting the half-peak width of the first band light and the second band light between 25nm and 50nm can not only ensure that the image signal used to generate the endoscopic image contains sufficient information of the middle and deep biological tissues, but also reduce the interference of noise signals, and better distinguish the information of the middle and deep biological tissues in the endoscopic image.

[0070] The display unit 400 is used to generate an endoscopic image based on the first image signal and the second image signal, and display the endoscopic image. The display unit 400 can map the first image signal and the second image signal to each color channel for displaying the endoscopic image to determine the color value of each color channel, and then generate and display the corresponding endoscopic image based on the color value of each color channel. Exemplarily, the first image signal and the second image signal can be respectively assigned to different color channels for displaying the endoscopic image, thereby distinguishing the biological tissue information of the middle layer and the biological tissue information of the deep layer through the different tones in the generated image.

[0071] The frequency band lights corresponding to the image signals used to generate endoscopic images, such as the first image signal and the second image signal mentioned above, are all within the wavelength range above 450nm. This can greatly weaken the contrast of the superficial microvessels, making them consistent with the color tone of other superficial tissues, and can prevent the superficial microvessel texture information in the area to be treated and its surrounding areas from interfering with the deep tissue information therein, so that the vascular structures presented in the generated endoscopic images are all middle and / or deep vascular structures, thereby facilitating doctors to clearly identify the locations of the submucosal large blood vessels in the area to be treated and its surrounding areas, rationally plan the treatment path, and avoid damaging the large blood vessels and causing wound bleeding.

[0072] In the above-mentioned endoscope device, the first image signal corresponding to the wavelength band of 500nm~550nm and the second image signal corresponding to the wavelength band of 550nm~600nm are determined respectively according to the light returned from the target tissue after being irradiated by the illumination light, and the frequency band light corresponding to each image signal used to generate the endoscopic image is all within the wavelength band above 450nm, and then the endoscopic image is generated according to the first image signal and the second image signal. The endoscopic image displayed by the endoscope device can avoid the information interference of the superficial mucosal microvessels, accurately obtain the information of the middle and deep biological tissues, which is conducive to the medical staff to judge the location of the middle and deep blood vessels, and then help to perform treatment operations accordingly.

[0073] Exemplarily, the image output unit 300 is also used to output a third image signal based on the initial image signal, and the third image signal is a response signal corresponding to the third frequency band light, and the peak wavelength of the third frequency band light is greater than 600nm. If the peak wavelength of the third frequency band light is greater than 600nm, it means that the energy distribution of the third frequency band light is concentrated in the band range above 600nm. As mentioned above, the relative absorption coefficient of blood tissue for illumination light with a band range of more than 600nm is relatively low, and blood will also reflect more light above 600nm, and the penetration depth of light above 600nm in the target tissue is also deeper, which can reflect the information of deeper biological tissues. Therefore, the third frequency band light above 600nm can enhance the intensity of the light signal received by the camera unit 200, so as to enhance the signal intensity of the image signal output by the image output unit, and then enhance the brightness of the endoscopic image. Therefore, the third image signal corresponding to the third frequency band light with a peak wavelength greater than 600nm can be obtained to generate the background image in the endoscopic image and enhance the overall brightness of the endoscopic image.

[0074] The display unit 400 is used to generate an endoscopic image based on the first image signal, the second image signal, and the third image signal. The display unit 400 can not only map the first image signal and the second image signal to the respective color channels for displaying the endoscopic image to determine the color value of each color channel, and then generate and display the corresponding endoscopic image according to the color value of each color channel. The display unit 400 can also simultaneously map the first image signal, the second image signal, and the third image signal to the respective color channels for displaying the endoscopic image to determine the color value of each color channel, and then generate and display the corresponding endoscopic image according to the color value of each color channel.

[0075] In the above-mentioned endoscope device, the third image signal is obtained by the image output unit 300, and the endoscope image is generated by the display unit 400 according to the first image signal, the second image signal and the third image signal. It can highlight the biological tissues in the middle and deep layers, provide richer background information, and enhance the brightness of the image.

[0076] The following is a detailed description of a specific implementation of extracting image signals (eg, the first image signal, the second image signal, and the third image signal) for generating an endoscopic image to be displayed.

[0077] It can be understood that the camera unit 200 may include any type of photoelectric sensor to collect light returned from the target tissue after being irradiated by the illumination light to form an initial image signal, such as an RGB sensor, a CMOS color sensor, etc. In order to obtain image signals corresponding to light of different frequency bands, the camera unit 200 may include two or more signal channels, each of which is used to collect light returned from the target tissue after being irradiated by the illumination light and form a corresponding initial image signal. Each signal channel of the camera unit 200 has a corresponding spectral response sensitivity curve, and the image response I of any signal channel (i.e., the initial image signal formed by the signal channel) can be determined according to the following formula 1:

[0078]

[0079] Wherein, L(λ) represents the illumination spectrum, Rflex(λ) represents the object surface reflectance, and Sensitivity(λ) represents the spectral response sensitivity curve of the signal channel. The image response I is the initial image signal formed by the signal channel according to the light returned from the surface of the target object. As can be seen from Formula 1, the image response I will be affected by the spectral response sensitivity curve of the signal channel and the illumination spectrum. In addition, since the illumination spectrum L(λ) and the spectral response sensitivity curve of the signal channel Sensitivity(λ) are both known characteristics of the endoscope system, and the object surface reflectance Rflex(λ) is mainly affected by the imaging environment, the system spectral response curve Spectrum Response(λ) of each signal channel of the camera unit 200 can be defined according to the following Formula 2:

[0080]

[0081] Wherein, L(λ) represents the illumination spectrum of the illumination light emitted by the illumination unit 100, and Sensitivity(λ) represents the spectral response sensitivity curve of any signal channel of the imaging unit 200. According to Formula 2, the system spectral response curve of each signal channel of the imaging unit 200 can be obtained. The system spectral response curve corresponding to each signal channel can roughly reflect the spectral characteristics of the return light actually sensed by the signal channel, so as to more accurately reflect the actual spectral characteristics corresponding to the initial image signal generated by the signal channel. Therefore, in practical applications, the system spectral response curve of each signal channel of the imaging unit 200 can be determined according to the spectral response sensitivity curve of each signal channel of the imaging unit 200 and the illumination spectrum of the illumination light, and then the spectral characteristics of the initial image signal output by each signal channel of the imaging unit 200 can be determined. This also helps to screen and adjust the initial image signal that does not meet the expectations, so as to obtain the desired image signal for generating the endoscopic image.

[0082] In view of this, in order to extract the first image signal corresponding to the wavelength band of 500nm~550nm and the second image signal corresponding to the wavelength band of 550nm~600nm, in some embodiments, the camera unit 200 may include a first signal channel and a second signal channel, the first signal channel and the second signal channel are respectively used to collect the light returned from the target tissue after being irradiated by the illumination light, and form a first initial image signal and a second initial image signal, wherein the system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located, and the system spectral response curve of the second signal channel covers the wavelength band where the second target frequency band light is located, the first target frequency band light is one of the first frequency band light and the second frequency band light, and the second target frequency band light is the other of the first frequency band light and the second frequency band light. Thus, the image output unit 300 can output the first initial image signal as a response signal corresponding to the first target frequency band light in the first image signal and the second image signal, and output the response signal corresponding to the second target frequency band light in the first image signal and the second image signal according to the second initial image signal.

[0083] Among them, when the proportion of the sum of the responses of the first signal channel in the wavelength band where the first target frequency band light is located in the sum of the system spectral responses of the first signal channel is not less than the preset response threshold, it can be regarded that the system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located. For example, when the first target frequency band light is the first frequency band light, the wavelength band where it is located is 500nm~550nm, and the preset response threshold is 70%, if the proportion of the sum of the responses of the first signal channel in the wavelength band range of 500nm~550nm in the sum of the total system spectral responses of the first signal channel is not less than 70%, it can be regarded that the system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located. The same applies when the first target frequency band light is the second frequency band light.

[0084] Alternatively, when the proportion of the wavelength band where the first target frequency band light is located in the wavelength band where the system spectrum response of the first signal channel is located that is not less than 0 is not less than a preset proportion threshold, it can also be considered that the system spectrum response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located. For example, if the system spectrum response of a certain signal channel is not less than 0 in the wavelength band of 500nm~600nm (that is, the system spectrum of the signal channel has a response in the wavelength band range of 500nm~600nm), and the wavelength band where the target frequency band light is located is 500nm~580nm, at this time, the proportion of 500nm~580nm in 500nm~600nm is not less than 70%, it can also be considered that the system spectrum response curve of the signal channel corresponds to the wavelength band where the target frequency band light is located.

[0085] When the wavelength of the second target frequency band light is within the wavelength of the part of the second signal channel where the system spectrum response is not 0 (that is, when the second signal channel responds to light within the wavelength range of the second target frequency band light), it can be considered that the system spectrum response curve of the second signal channel covers the wavelength of the second target frequency band light. For example, when the part of the second signal channel where the system spectrum response is not 0 is 550nm~610nm, and the wavelength of the second target frequency band light is 550nm~600nm, the system spectrum response curve of the second signal channel covers the wavelength of the second target frequency band light.

[0086] When the system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located, it means that the system spectral response curve of the first channel meets expectations, the first initial image signal contains sufficient information of the middle or deep biological tissue, and has less signal interference, so the image output unit 300 can directly output the first initial image signal as the response signal corresponding to the first target frequency band light in the first image signal and the second image signal. For example, when the first target frequency band light is the first frequency band light, the first initial image signal can be output as the first image signal; when the first target frequency band light is the second frequency band light, the first initial image signal can be output as the second image signal.

[0087] The system spectral response curve of the second signal channel covers the wavelength band where the second target frequency band light is located, and the response signal corresponding to the second target frequency band light can be extracted therefrom. Therefore, the image output unit 300 can output the response signal corresponding to the second target frequency band light in the first image signal and the second image signal according to the second initial image signal. In some embodiments, since the system spectral response curve of the second signal channel may also cover other wavelength bands, the second initial image signal may introduce more interference information due to the presence of signals in other non-desired wavelength bands, making it difficult to obtain a better image contrast. Therefore, the image output unit 300 can also use other related initial image signals, such as the first initial image signal, to adjust the second initial image signal so that the adjusted second initial image signal corresponds to the second target frequency band light, and output the adjusted second initial image signal as the response signal corresponding to the second target frequency band light in the first image signal and the second image signal.

[0088] In the above-mentioned endoscope device, by reasonably designing the system spectral response curves of each signal channel in the camera unit 200, a first image signal corresponding to the first frequency band light and a second image signal corresponding to the second frequency band light can be extracted by simply calculating the initial image signals output by each signal channel, thereby reducing the complexity of signal extraction and separation.

[0089] Exemplarily, in order to extract a first image signal corresponding to the first frequency band light and a second image signal corresponding to the second frequency band light, while minimizing the impact on the existing endoscope hardware system, the illumination light may include green broadband light. When the illumination light includes green broadband light, compared with green narrowband light, the camera unit 200 is able to capture return light with a more sufficient amount of light, and can provide sufficient display brightness for the endoscope device in the display of the endoscopic image. For example, the half-peak width of the green broadband light may be greater than 50nm. The green broadband light has the following spectral characteristics: cut-off within a band range less than or equal to 450nm, the peak wavelength is within a band range of 500nm to 600nm, and has a continuous spectrum within a band range of 500nm to 600nm. The illumination unit 100 emits green broadband light with this spectral characteristic, which can reduce the interference of light of other wavelength bands on endoscopic imaging, and can make the light returned from the target tissue after irradiation by the illumination light contain the information of the first frequency band light and the second frequency band light returned from the target tissue, so that the initial image signal formed by the camera unit 200 contains the information of the middle and deep biological tissues. Afterwards, the image output unit 300 can output the first image signal corresponding to the first frequency band light and the second image signal corresponding to the second frequency band light respectively according to the initial image signal. It can be understood that broadband green light has lower hardware requirements for the illumination light source than narrowband light, is easy to obtain, and is a commonly used illumination light. For example, conventional endoscopes also use broadband green light in white light imaging mode. Therefore, for most conventional endoscope light sources, there is no need to introduce other additional lighting devices. It is only necessary to set the illumination spectrum of the endoscope device in advance and switch the illumination mode to emit broadband green light to meet the requirements for the illumination spectrum.

[0090] The camera unit 200 includes a color image sensor with a Bayer filter. The blue channel, green channel and red channel of the color image sensor respectively collect the light returned from the target tissue after being irradiated by the illumination light, and form a blue initial image signal, a green initial image signal and a red initial image signal. The Bayer filter can selectively absorb light of different wavelengths, so it can selectively filter the incident light in a specific wavelength band. One of the R Bayer filter, the G Bayer filter and the B Bayer filter can be set on the channel of each pixel point of the image sensor, so that the pixel points of the image sensor form an arrangement similar to RGBG, GRGB, or RGGB, etc., and each pixel point obtains the intensity value of the light filtered by the corresponding Bayer filter to obtain the initial image signal formed by each channel. Among them, for the above-mentioned color image sensor, the blue channel forms a blue initial image signal, the green channel forms a green initial image signal, and the red channel forms a red initial image signal.

[0091] Figure 3FIG. 1 is a schematic diagram showing the spectral response sensitivity curves of each signal channel of the camera unit 200 according to an embodiment of the present invention. The spectral response sensitivity curve of each channel of the camera unit 200 may be different due to the Bayer filter set in the channel. For example, the R channel may be provided with an R Bayer filter, the G channel may be provided with a G Bayer filter, and the B channel may be provided with a B Bayer filter. Figure 3 As shown, the spectral response sensitivity curves of the R channel (R), G channel (G) and B channel (B) will be different.

[0092] The image output unit 300 is used to output the blue initial image signal as the first image signal, and output the second image signal according to the green initial image signal.

[0093] Here, according to the processing process of the image output unit 300 for the first target frequency band light and the second target frequency band light, the blue initial image signal can be used as the first initial image signal, and the green initial image signal can be used as the second initial image signal for subsequent processing, which will not be described in detail here. It can be understood that the camera unit 200 uses a conventional color image sensor, and the first image signal corresponding to the first frequency band light and the second image signal corresponding to the second frequency band light can be obtained without changing the hardware and structure of the existing endoscope, so as to obtain the information of the middle layer biological tissue and the information of the deep layer biological tissue.

[0094] In the above-mentioned endoscope device, the illumination unit 100 is used to emit illumination light including green broadband light to the target tissue, the camera unit 200 includes a color image sensor with a Bayer filter, each channel of which is used to form a blue initial image signal, a green initial image signal and a red initial image signal, and then the image output unit 300 is used to output the blue initial image signal as the first image signal, and output the second image signal according to the green initial image signal. The endoscope device can obtain accurate endoscopic images containing information of middle and deep biological tissues, which is convenient for doctors to perform corresponding treatment operations, and has high compatibility with existing endoscope devices in hardware design, which can reduce the improvement cost of the endoscope device.

[0095] Exemplarily, the illumination light may also include red broadband light, which has the following spectral characteristics: a peak wavelength in the wavelength range of 600nm to 650nm, and a continuous spectrum in the wavelength range of 600nm to 650nm. The image output unit 300 is also used to output a third image signal according to the red initial image signal. The display unit 400 is specifically used to generate an endoscopic image according to the first image signal, the second image signal and the third image signal, and display the endoscopic image. On the basis of the illumination light including the above-mentioned broadband green light, the red broadband light is added, and the camera unit 200 can capture the return light with a more sufficient light quantity, and can provide sufficient display brightness for the endoscopic image generated by the endoscopic device. And the third image signal output according to the red initial image signal can be used to generate the background image in the above-mentioned endoscopic image. At this time, the endoscopic image finally generated by the display unit 400 will include the background image generated according to the third image signal and the foreground image generated according to the first image signal and the second image signal, which can enhance the display brightness of the endoscopic image when highlighting the middle and deep biological tissues.

[0096] Figure 4 FIG. 4 is a schematic block diagram of an endoscope device according to an embodiment of the present invention. Figure 4 As shown, the lighting unit 100 includes a light combining component 110 and at least two light sources (a first light source 101, a second light source 102, ... an Nth light source), and the light emitted by the at least two light sources is combined by the light combining component 110 to form the lighting light. Each light source can be used to emit light of different or same wavelength bands. For example, when the lighting unit 100 includes the first light source 101 and the second light source 102, the first light source 101 can be used to emit the above-mentioned green broadband light, and the second light source 102 can be used to emit the above-mentioned red broadband light. Figure 5 FIG. 1 is a schematic diagram showing the spectrum of illumination light after beam combination according to an embodiment of the present invention. When the first light source 101 is used to emit the above green broadband light, and the second light source 102 is used to emit the above red broadband light, the light combining component 110 can combine the green broadband light emitted by the first light source 101 and the red broadband light emitted by the second light source 102 to form a beam as shown in FIG. Figure 5The combined illumination light shown. Among them, the spectrum of the illumination light formed by the combined beam can be changed by controlling each light source separately to meet actual needs. For example, when the illumination unit 100 includes the above-mentioned first light source 101 and the above-mentioned second light source 102, the first light source 101 can be turned off and only the second light source 102 emits red broadband light, so that the illumination light is the above-mentioned red broadband light, or the second light source 102 can be turned off and only the first light source 101 emits green broadband light, so that the illumination light is the above-mentioned green broadband light, and the first light source 101 and the second light source 102 can also be turned on at the same time, and the relative spectrum of the illumination light formed by the combined beam (that is, the energy distribution of each band of light in the spectrum) can be adjusted by controlling the ratio of the light output of the first light source 101 and the second light source 102.

[0097] In the endoscope device, the light emitted by at least two light sources of the illumination unit 100 is combined by the light combining assembly 110 to form illumination light. The spectrum of the illumination light can be flexibly changed to obtain illumination light that meets the requirements, so as to indirectly adjust the system spectral response curve of the imaging unit 200 to meet the requirements.

[0098] Figure 6 FIG. 1 is a schematic diagram showing the system spectral response curves of each signal channel of the camera unit according to an embodiment of the present invention. For example, when the spectrum of the illumination light is Figure 5 The spectral response sensitivity curve of each signal channel of the camera unit 200 is Figure 3 When the spectral response sensitivity curve is shown, according to the above formula 2, the following can be obtained: Figure 6 The system spectral response curves corresponding to the blue channel (B), green channel (G) and red channel (G) of the camera unit 200 are shown.

[0099] according to Figure 6 It can be known that at this time, the system spectral response curve of the blue channel of the camera unit 200 corresponds to the wavelength band where the first frequency band light is located, so the blue initial image signal formed by the blue channel can basically be considered as a response signal corresponding to the first frequency band light, so that the image output unit 300 can output the blue initial image signal as the first image signal. The system spectral response curve of the green channel not only covers the wavelength band where the second frequency band light is located (550nm~600nm), but also covers the wavelength band where the first frequency band light is located (500nm~550nm) and the wavelength band above 600nm. Therefore, the green initial image signal formed by the green channel contains more signal interference, and it is not appropriate to directly output the green initial image signal as the second image signal. Therefore, the green initial image signal can be adjusted according to the blue initial image signal and the red initial image signal to reduce the signal interference in the green initial image, so that the adjusted green initial image signal meets the requirements as the second image signal.

[0100] For example, the correction coefficients corresponding to the blue initial image signal and the red initial image signal may be determined, and then the adjusted green initial image signal may be determined according to the following formula 3:

[0101]

[0102] Wherein, G′ represents the adjusted green initial image signal as the second image signal, G represents the unadjusted green initial image signal, and k B represents the correction coefficient corresponding to the blue initial image signal, B represents the blue initial image signal, k R represents the correction coefficient corresponding to the red initial image signal, and R represents the red initial image signal.

[0103] For example, the system spectral response curve of the green channel can be adjusted according to the system spectral response curve of the blue channel and the system spectral response curve of the red channel through artificial test simulation, and the correction coefficient corresponding to the system spectral response curve of the blue channel and the correction coefficient corresponding to the system spectral response curve of the red channel during the adjustment process can be recorded. When the adjusted system spectral response curve of the green channel corresponds to the wavelength band where the second frequency band light is located, the correction coefficient corresponding to the system spectral response curve of the blue channel during the adjustment process can be used as k in the above formula 3. B The correction coefficient corresponding to the system spectral response curve of the red channel is used as k in the above formula 3 R For example, the system spectral response curve for the adjusted green channel can be Figure 7 The desired system spectral response curve for the green channel is shown.

[0104] The process of determining whether the adjusted system spectral response curve of the green channel corresponds to the wavelength band where the second frequency band light is located is similar to the process of determining whether the system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located. For example, when the proportion of the sum of the responses of the green signal channel in the wavelength band where the second frequency band light is located in the sum of the system spectral responses of the adjusted green channel is not less than a preset response threshold, it can be considered that the adjusted system spectral response curve of the green channel corresponds to the wavelength band where the second frequency band light is located. Alternatively, when the proportion of the wavelength band where the second frequency band light is located in the wavelength band where the system spectral response of the adjusted green channel is not less than 0 is not less than a preset proportion threshold, it can also be considered that the adjusted system spectral response curve of the green channel corresponds to the wavelength band where the second frequency band light is located.

[0105] It can be understood that any system spectral response curve corresponding to the wavelength band where the second frequency band light is located can be used as the expected spectral response of the green channel. The difference between the system spectral response curve of the green channel and the expected system spectral response curve represents the error between the current green initial image signal and the actually required adjusted green initial image signal. By compensating for this part of the error, the signal interference in the green initial image can be reduced, so that the adjusted green initial image signal meets the requirements as the second image signal. Figure 7 A schematic diagram of a green channel desired system spectral response curve according to an embodiment of the present invention is shown.

[0106] Therefore, alternatively, one can first determine Figure 7 The desired system spectral response curve of the green channel corresponding to the wavelength band of the second band light is shown, and then the image output unit 300 can adjust the green initial image signal according to the difference between the system spectral response curve of the green channel and the desired system spectral response curve, the blue initial image signal and the red initial signal, and use the adjusted green initial image signal as the second image signal. Among them, the correction coefficients corresponding to the blue initial image signal and the red initial signal can be determined according to the difference between the system spectral response curve of the green channel and the desired system spectral response curve, and then the adjusted green initial image signal is determined according to the above formula 3.

[0107] After the display unit 400 obtains the first image signal and the second image signal, the foreground image of the endoscopic image can be generated and displayed according to the first image signal and the second image signal. The image output unit 300 can also output a third image signal according to the red initial image signal, for example, output the red initial image signal as the third image signal or adjust the red initial image signal with the green initial image signal and then output the adjusted red initial image signal as the third image signal. The display unit 400 can also generate and display the background image of the endoscopic image according to the third image signal.

[0108] Figure 8 FIG. 1 shows a schematic diagram of an illumination light spectrum according to another embodiment of the present invention. Exemplarily, the illumination unit 100 includes a white light source and one or more filters. The white light emitted by the white light source passes through the one or more filters to form illumination light. The white light source can be any light source that can emit white light, such as a fluorescent lamp, a white light LED, a xenon lamp, etc. At least one of the one or more filters can be used to filter out light in a wavelength range below 450nm in the white light to obtain a wavelength of 450nm or less. Figure 8 In order to meet actual needs, at least one of the one or more filters can be used to filter out light within a wavelength range below 450nm, 650nm or above 760nm.

[0109] In the above-mentioned endoscope device, one or more filters are used to filter the white light emitted by the white light source, which has relatively low requirements on the light source, can reduce the complexity of the lighting unit 100, so as to reduce the cost of the endoscope device, and can obtain lighting light that meets the requirements, so as to indirectly adjust the system spectral response curve of the camera unit 200 to meet the requirements.

[0110] Fig. 9 FIG. 1 is a schematic diagram showing the system spectral response curves of each signal channel of the camera unit according to an embodiment of the present invention. For example, when the spectrum of the illumination light is Figure 8 The illumination light spectrum in the image pickup unit 200 has a spectral response sensitivity curve of each channel: Figure 3 When the spectral response sensitivity curve is shown, according to the above formula 2, the following can be obtained: Fig. 9 The system spectral response curves corresponding to the blue channel (B), green channel (G) and red channel (G) of the camera unit 200 are shown.

[0111] according to Fig. 9 It can be seen that at this time, the system spectral response curve of the blue channel of the camera unit 200 corresponds to the first frequency band light, so the blue initial image signal formed by the blue channel meets the requirements, and the image output unit 300 can be used to output the blue initial image signal as the first image signal. The system spectral response curve of the green channel covers other bands in addition to the band where the second frequency band light is located (550nm~600mn), so the green initial image signal formed by the green channel contains more signal interference, and it is not appropriate to directly output the green initial image signal as the second image signal.

[0112] Fig.10 A schematic diagram of an expected system spectral response curve for a green channel according to an embodiment of the present invention is shown. For example, the system spectral response curve for the green channel can be adjusted according to the system spectral response curve for the blue channel and the system spectral response curve for the red channel through artificial test simulation, and the correction coefficient corresponding to the system spectral response curve for the blue channel and the correction coefficient corresponding to the system spectral response curve for the red channel during the adjustment process are recorded. When the adjusted system spectral response curve for the green channel corresponds to the wavelength band where the second frequency band light is located, the correction coefficient corresponding to the system spectral response curve for the blue channel during the adjustment process can be used as k in the above formula 3. B The correction coefficient corresponding to the system spectral response curve of the red channel is used as k in the above formula 3 R For example, the system spectral response curve for the adjusted green channel can be Fig.10 The desired system spectral response curve for the green channel is shown.

[0113] Alternatively, one can first determine if Fig.10The desired system spectral response curve of the green channel corresponding to the wavelength band of the second band light is shown, and then the image output unit 300 can be used to adjust the green initial image signal according to the difference between the system spectral response curve of the green channel and the desired system spectral response curve, the blue initial image signal and the red initial signal, and use the adjusted green initial image signal as the second image signal. For example, the image output unit 300 can be used to determine the correction coefficients corresponding to the blue initial image signal and the red initial signal respectively according to the difference between the system spectral response curve of the green channel and the desired system spectral response curve at this time, and then determine the adjusted green initial image signal according to the above formula 3 as the second image signal.

[0114] After the display unit 400 obtains the first image signal and the second image signal, the foreground image of the endoscope image can be generated and displayed according to the first image signal and the second image signal. The image output unit 300 can also output a third image signal according to the red initial image signal, for example, outputting the red initial image signal as the third image signal or adjusting the red initial image signal using the green initial image signal and then outputting the adjusted red initial image signal as the third image signal. The display unit 400 can also generate and display the background image of the endoscope image according to the third image signal.

[0115] Exemplarily, in order to extract a first image signal corresponding to the first frequency band light and a second image signal corresponding to the second frequency band light, in another embodiment, the illumination light has a continuous spectrum within a wavelength range of 500nm to 600nm. The first signal channel has a spectral response sensitivity curve corresponding to the first frequency band light, and is used to collect light returned from the target tissue and located in the wavelength range of the first frequency band light to form a first initial image signal. The second signal channel has a spectral response sensitivity curve corresponding to the second frequency band light, and is used to collect light returned from the target tissue and located in the wavelength range of the second frequency band light to form a second initial image signal. The image output unit 300 is used to output the first initial image signal as a first image signal, and output the second initial image signal as a second image signal.

[0116] Among them, the judgment process of whether the system spectral response curve of the first signal channel corresponds to the wavelength band of the first target frequency band light can be referred to to determine whether the first signal channel has a spectral response sensitivity curve corresponding to the first frequency band light, and whether the second signal channel has a spectral response sensitivity curve corresponding to the second frequency band light, which will not be described in detail here. In practical applications, an image sensor that meets the requirements can be directly selected as a component of the camera unit 200, so that the first signal channel of the camera unit 200 has a spectral response sensitivity curve corresponding to the first frequency band light, and the second signal channel of the camera unit 200 has a spectral response sensitivity curve corresponding to the second frequency band light.

[0117] Because the illumination light has a continuous spectrum within the wavelength range of 500nm to 600nm, the first signal channel has a spectral response sensitivity curve corresponding to the first frequency band light, and the second signal channel has a spectral response sensitivity curve corresponding to the second frequency band light. Therefore, the first initial image signal is the response signal of the first frequency band light, and the second initial image signal is the response signal of the second frequency band light, so that the first initial image signal can be directly output as the first image signal, and the second initial image signal can be output as the second image signal.

[0118] In the above-mentioned endoscope device, the image output unit 300 can directly output the first initial image signal as the first image signal, and output the second initial image signal as the second image signal. This can reduce the processing process of the endoscope on the initial image signal, reduce the information error in the generated endoscopic image, and improve the accuracy of the endoscopic image.

[0119] Exemplarily, in order to extract the first image signal corresponding to the first frequency band light and the second image signal corresponding to the second frequency band light, in another embodiment, the illumination light includes the first frequency band light and the second frequency band light, and the illumination unit 100 is used to emit the first frequency band light and the second frequency band light in time-sharing. The illumination unit 100 may include a plurality of light sources, which may emit the first frequency band light and the second frequency band light respectively at different times. The illumination unit 100 may also include only a single light source with adjustable emission light spectrum, so that when the illumination light is required to be the first frequency band light, the spectrum of the emission light is adjusted to the first frequency band light, and when the illumination light is required to be the first frequency band light, the spectrum of the emission light is adjusted to the second frequency band light. The illumination unit 100 may emit the first frequency band light and the second frequency band light alternately at a predetermined time interval, so as to achieve the time-sharing emission of the first frequency band light and the second frequency band light.

[0120] Optionally, you can use Figure 4 The lighting unit 100 in the embodiment emits the first frequency band light and the second frequency band light in a time-sharing manner. For example, the lighting unit 100 can be turned off at the first moment. Figure 4 The other light sources in the lighting unit 100 except the first light source 101 are turned on, that is, only the first light source 101 is turned on. At this time, the lighting light emitted by the lighting unit 100 after the light combining component 110 combines the light is the first frequency band light. Figure 4 In the illumination unit 100, other light sources except the second light source 102 are turned on, that is, only the second light source 102 is turned on, and the illumination light emitted by the illumination unit 100 after the light combining component 110 combines the light is the second frequency band light. Thus, the illumination unit 100 can emit the first frequency band light at the first moment, and emit the second frequency band light at the second moment.

[0121] When the illumination unit 100 emits light of the first frequency band, the imaging unit 200 is used to collect light returned from the target tissue after being irradiated by the light of the first frequency band, and form a fourth initial image signal. When the illumination unit 100 emits light of the second frequency band, the imaging unit 200 is used to collect light returned from the target tissue after being irradiated by the light of the second frequency band, and form a fifth initial image signal.

[0122] The image output unit 300 is used to output the fourth initial image signal as the first image signal, and to output the fifth initial image signal as the second image signal. It can be understood that when the illumination unit 100 emits the first frequency band light, the light returned from the target usually only contains the first frequency band light, so the fourth initial image signal only contains the information of the middle layer of biological tissue, and there will be no other signal interference. Similarly, when the illumination unit 100 emits the second frequency band light, the light returned from the target usually only contains the second frequency band light, so the fifth initial image signal only contains the information of the deep layer of biological tissue, and there will be no other signal interference. Therefore, the image output unit 300 can be used to output the fourth initial image signal as the first image signal, and to output the fifth initial image signal as the second image signal. At this time, the first image signal is the response signal corresponding to the first frequency band light, and the second image signal is the response signal corresponding to the second frequency band light.

[0123] In the above-mentioned endoscope device, the illumination unit 100 is used to emit the first frequency band light and the second frequency band light in time division, the camera unit 200 collects the light returned from the target tissue after being irradiated by the first frequency band light or the second frequency band light to form a fourth initial image signal or a fifth initial image signal, and the image output unit 300 is used to output the fourth initial image signal as the first image signal and output the fifth initial image signal as the second image signal. The endoscope device can reduce unnecessary signal interference in the image signal to improve the accuracy of the information of the middle or deep biological tissue of the endoscopic image.

[0124] For example, when a doctor uses the above-mentioned endoscopic device to identify a lesion in a target tissue, he or she can first identify the location of the lesion in a narrow-band imaging mode (i.e., using a narrow-band blue light image signal near 415nm and a narrow-band green light image signal near 540nm to generate an endoscopic image for highlighting the texture information of the superficial microvessels), and then switch to the imaging mode corresponding to the endoscopic device in the present application (i.e., using an image signal of a band light corresponding to a wavelength range above 450nm to generate an endoscopic image, wherein the image signal includes a first image signal and a second image signal for highlighting the information of the middle and deep biological tissues and reducing the interference of the texture information of the superficial microvessels) to perform an operation of removing the lesion, and before performing the removal operation Before or during the operation, the doctor can identify the location of the lesion through the structural features of the lesion area in the endoscopic image generated by the endoscopic device in the present application, and at the same time, identify the location of the middle and deep blood vessels near the lesion, and then mark or determine the cutting range that can avoid the large blood vessels under the mucosa to reduce wound bleeding. In the process of performing the resection operation, the doctor does not pay attention to the morphology of the superficial blood vessels. Therefore, the endoscopic image generated by the above-mentioned endoscopic device reduces the presentation of information on the superficial blood vessels, which will not only not affect the doctor's observation, but also reduce the interference of the doctor's confirmation of the location of the middle and deep blood vessels, and can improve the convenience of endoscopic minimally invasive treatment, and reduce the possibility of accidentally injuring the large blood vessels under the mucosa and causing the wound to be difficult to heal. In addition, it is also found in clinical applications that the endoscopic image generated by the endoscopic device provided by the implementation of the present application can also reduce the impact of bleeding on structural observation during the doctor's treatment operation, so that the doctor can quickly locate the rupture point of the blood vessel and stop bleeding in time.

[0125] A person of ordinary skill in the art can understand the specific implementation and beneficial effects of the above-mentioned endoscope device by reading the above-mentioned detailed description of the endoscope device, and for the sake of brevity, it will not be repeated here.

[0126] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as required by the appended claims.

[0127] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0128] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0129] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0130] Similarly, it should be understood that in order to streamline the present invention and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be interpreted as reflecting the following intention: the claimed invention requires more features than the features explicitly stated in each claim. More specifically, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.

[0131] Those skilled in the art will understand that, except for mutually exclusive features, all features disclosed in this specification (including the accompanying claims, abstract and drawings) and all processes or units of any method or device disclosed in this specification may be combined in any combination. Unless otherwise explicitly stated, each feature disclosed in this specification (including the accompanying claims, abstract and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0132] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.

[0133] The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some modules in an endoscopic device according to an embodiment of the present invention. The present invention may also be implemented as a device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0134] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0135] The above is only a specific embodiment of the present invention or an explanation of a specific embodiment. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. An endoscope device, characterized in that: include: An illumination unit, used for emitting illumination light to a target tissue; An imaging unit, used for collecting light returned from the target tissue after being irradiated by the illumination light, and forming an initial image signal, wherein the imaging unit comprises a first signal channel and a second signal channel, and the first signal channel and the second signal channel are respectively used for collecting light returned from the target tissue after being irradiated by the illumination light, and forming a first initial image signal and a second initial image signal; The image output unit is used to output a first image signal and a second image signal based on the initial image signal, wherein the first image signal is a response signal corresponding to a first frequency band light, and the second image signal is a response signal corresponding to a second frequency band light, the peak wavelength of the first frequency band light is located in a waveband range of 500nm~550nm and has a continuous spectrum in the waveband range of 500~550nm, and the peak wavelength of the second frequency band light is located in a waveband range of 550nm~600nm and has a continuous spectrum in the waveband range of 550~600nm; the system spectral response curve of the first signal channel corresponds to the first target frequency band. the wavelength band where the second target frequency band light is located, the system spectral response curve of the second signal channel covers the wavelength band where the second target frequency band light is located, the first target frequency band light is one of the first frequency band light and the second frequency band light, the second target frequency band light is the other of the first frequency band light and the second frequency band light, the image output unit is used to output the first initial image signal as a response signal of the first image signal and the second image signal corresponding to the first target frequency band light, and use the first initial image signal to adjust the second initial image signal to output the response signal of the first image signal and the second image signal corresponding to the second target frequency band light; A display unit, used to generate an endoscopic image according to the first image signal and the second image signal, and display the endoscopic image; wherein the frequency band light corresponding to each image signal used to generate the endoscopic image is within a wavelength range above 450nm; The system spectral response curve of each signal channel of the camera unit is determined according to the spectral response sensitivity curve of each signal channel and the illumination spectrum of the illumination light; The system spectral response curve of the first signal channel corresponds to the wavelength band where the first target frequency band light is located and includes: The proportion of the sum of the responses of the first signal channel in the wavelength band where the first target frequency band light is located in the sum of the system spectral responses of the first signal channel is not less than a preset response threshold, or the proportion of the wavelength band where the first target frequency band light is located in the wavelength band where the system spectral responses of the first signal channel are located that is not less than 0 is not less than a preset proportion threshold; The system spectral response curve of the second signal channel covers the wavelength band where the second target frequency band light is located, including: the wavelength band where the second target frequency band light is located is within the wavelength band where a part of the system spectral response of the second signal channel is not zero.

2. The endoscope device according to claim 1, characterized in that The half-peak widths of the first frequency band light and the second frequency band light are between 25 nm and 50 nm.

3. The endoscope device according to claim 1 or 2, characterized in that: The image output unit is further used to output a third image signal based on the initial image signal, wherein the third image signal is a response signal corresponding to light in a third frequency band, and a peak wavelength of the light in the third frequency band is greater than 600 nm; The display unit is used to generate the endoscopic image based on the first image signal, the second image signal, and the third image signal.

4. The endoscope device according to claim 1, characterized in that: The illumination light comprises green broadband light, and the green broadband light has the following spectral characteristics: cut-off within a wavelength range less than or equal to 450 nm, a peak wavelength within a wavelength range of 500 nm to 600 nm, and a continuous spectrum within the wavelength range of 500 nm to 600 nm; The camera unit includes a color image sensor with a Bayer filter, and a blue channel, a green channel, and a red channel of the color image sensor respectively collect light returned from the target tissue after being irradiated by the illumination light to form a blue initial image signal, a green initial image signal, and a red initial image signal; The image output unit is configured to output the blue initial image signal as the first image signal, and output the second image signal according to the green initial image signal.

5. The endoscope device according to claim 4, characterized in that: The illumination light further includes red broadband light, and the red broadband light has the following spectral characteristics: a peak wavelength in the wavelength range of 600nm to 650nm, and a continuous spectrum in the wavelength range of 600nm to 650nm; The image output unit is further used to output a third image signal according to the red initial image signal; The display unit is specifically configured to generate an endoscopic image according to the first image signal, the second image signal, and the third image signal, and display the endoscopic image.

6. The endoscope device according to claim 4, characterized in that: The lighting unit comprises a light combining component and at least two light sources, and the light emitted by the at least two light sources is combined by the light combining component to form the lighting light; or, The illumination unit includes a white light source and one or more filters. The white light emitted by the white light source passes through the one or more filters to form the illumination light.

Images