Endoscope, procedure and information processing method
By introducing a light quantity control unit into the endoscope, metering values corresponding to different light output units are derived based on the shooting data and adjusting the light quantity, the problem that the existing endoscope cannot effectively dim the light, and the lighting effect is improved.
Patent Information
- Application Number
- CN202180011661.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-09-25
- Filing Date
- 2021-07-28
- Publication Date
- 2025-04-04
- Estimated Expiration
- 2041-07-28
AI Technical Summary
The existing endoscope device has failed to effectively consider the dimming problem corresponding to the respective metering values of white light and narrowband light.
An endoscope is designed, equipped with a photographing unit, a first light output unit, a second light output unit and a light quantity control unit. The shooting data of the observation part output by the photographing unit is derived, and the metered light values corresponding to the angle range of the first light output part and the second light output part are derived, and the respective light amounts are derived based on these metered values, and the light amount output by the first light output part and the second light output part is controlled by the light amount control unit.
Dimming according to the respective metering values of illumination lights of different wavelength ranges is achieved, and the observation effect of the endoscope under different illumination conditions is improved.
Smart Images

Figure CN115003205B_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to an endoscope, a program and an information processing method.
[0002] This application claims the benefit of priority based on Japanese Application No. 2020-160962, filed on September 25, 2020, and incorporates by reference all the disclosures disclosed in the Japanese Application. Background Art
[0003] An endoscope is a medical device that can be inserted into a body cavity of a subject to observe and treat a desired part, and includes: a photographing unit that is embedded in the front end of an insertion tube inserted into the body cavity; and a lighting device that illuminates the photographing field of the photographing unit. Patent document 1 discloses an endoscope that includes a lighting device that can achieve illumination over a wide angle range of 180° or more and that can perform wide-angle observation.
[0004] In addition, in recent years, an endoscope that can not only observe under white light but also enhance the observation of images obtained under illumination with narrow-band light (purple light, green light, etc.) has become popular. Patent document 2 discloses an endoscope device that obtains images by alternately irradiating white light and narrow-band light.
[0005] Prior art literature
[0006] Patent Literature
[0007] Patent Document 1: Japanese Patent Application Publication No. 2015-16021
[0008] Patent Document 2: Japanese Patent Application Publication No. 2016-128024 SUMMARY OF THE INVENTION
[0009] Problems to be solved by the invention
[0010] However, the endoscope device described in Document 2 has a problem in that it does not take into account the dimming corresponding to the respective photometric values of white light and narrow-band light.
[0011] On the one hand, an object of the present invention is to provide an endoscope or the like which can adjust the light according to the respective photometric values of illumination lights in different wavelength ranges.
[0012] Technical solutions to solve problems
[0013] An endoscope in one embodiment of the present disclosure comprises: a photographing unit, which is assembled in the front end portion of the insertion tube and photographs the observation part via the objective lens; a first light output unit, which is arranged around the objective lens and outputs a first illumination light for illuminating the observation part; a second light output unit, which is arranged around the objective lens and outputs a second illumination light within a larger angle range than the first light output unit, the second illumination light illuminating the observation part within a wider wavelength range than the first illumination light; and a light quantity control unit, which controls the light quantities output by the first light output unit and the second light output unit; wherein the light quantity control unit derives a photometric value in an area of the observation part corresponding to the angle ranges of the first light output unit and the second light output unit, respectively, based on the photographing data of the observation part output from the photographing unit, derives the light quantities of each of the first light output unit and the second light output unit based on the derived photometric values, and uses the derived light quantities to cause the first light output unit and the second light output unit to output illumination light.
[0014] A program in one embodiment of the present disclosure causes a computer to perform the following processing: based on shooting data of the observation part output from a shooting unit that shoots the observation part through the objective lens, deriving metering values in areas of the observation part corresponding to the angle ranges of the first light output unit and the second light output unit, respectively, based on the derived metering values, deriving the light quantities of the first light output unit and the second light output unit, respectively, and using the derived light quantities to cause the first light output unit and the second light output unit to output illumination light; wherein the computer is used to control the light quantities output by the following components: a first light output unit, which is arranged around the objective lens and outputs first illumination light for illuminating the observation part; and a second light output unit, which is arranged around the objective lens and outputs second illumination light within a larger angle range than the first light output unit, and the second illumination light illuminates the observation part within a wider wavelength range than the first illumination light.
[0015] In one embodiment of the present disclosure, an information processing method enables a computer to perform the following processing: based on the shooting data of the observation part output from the shooting unit that shoots the observation part through the objective lens, derive the metering values in the area of the observation part corresponding to the angle ranges of the first light output unit and the second light output unit respectively; based on the derived metering values, derive the light quantities of the first light output unit and the second light output unit respectively; and use the derived light quantities to make the first light output unit and the second light output unit output illumination light; wherein the computer is used to control the light quantities output by the following components: a first light output unit, which is arranged around the objective lens and outputs a first illumination light for illuminating the observation part; and a second light output unit, which is arranged around the objective lens and outputs a second illumination light within a larger angle range than the first light output unit, and the second illumination light illuminates the observation part within a wider wavelength range than the first illumination light.
[0016] Effects of the Invention
[0017] According to the present disclosure, there is provided an endoscope or the like capable of dimming according to respective photometric values of illumination light in different wavelength ranges. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 This is an external view of the endoscope according to the first embodiment.
[0019] Figure 2 This is an enlarged view of the front end of the insertion tube.
[0020] Figure 3 1 is a plan view showing a configuration example of a first LED (narrow-band light LED) and a second LED (white LED).
[0021] Figure 4 It is a block diagram of an endoscope device.
[0022] Figure 5 It is an explanatory diagram showing an example of a lookup table for deriving the light amount.
[0023] Figure 6 It is an explanatory diagram showing an observation area (photometric area) when illuminated by the first light output unit (narrow-band LED).
[0024] Figure 7 It is an explanatory diagram showing the observation area (photometric area) when illuminated by the second light output unit (white LED).
[0025] Figure 8 This is a flowchart showing an example of a processing procedure executed by the light intensity control unit of the endoscope.
[0026] Fig. 9This is an explanatory diagram showing an observation area (photometric area) when illuminated by the second light output unit (white LED) according to the second embodiment.
[0027] Fig.10 This is a flowchart showing an example of a processing procedure executed by the light intensity control unit of the endoscope. DETAILED DESCRIPTION
[0028] (Implementation Method 1)
[0029] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings showing embodiments thereof. Figure 1 1 is an external view of an endoscope 1 according to Embodiment 1. The endoscope 1 includes an insertion tube 2, an operating portion 3, a universal tube 4, and a connector portion 5. The insertion tube 2 is a portion inserted into a body cavity, and includes a long flexible portion 20 and a front end portion 22, wherein the front end portion 22 is connected to one end of the flexible portion 20 via a curved portion 21. The other end of the flexible portion 20 is connected to the operating portion 3 via a cylindrical connecting portion 23. One end of the universal tube 4 is connected to the operating portion 3 and extends in a direction different from that of the insertion tube 2, and the connector portion 5 is connected to the other end of the universal tube 4.
[0030] The operation portion 3 is provided for the convenience of the user (operator) of the endoscope 1 such as a doctor to grasp and perform various operations, and includes a bending operation knob 30, a plurality of operation buttons 31, etc. The bending operation knob 30 is connected to the bending portion 21 through a wire (not shown) that passes through the connection portion 23 and the inside of the flexible portion 20. The bending portion 21 is bent in two directions orthogonal to each other in the axial cross section according to the operation of the bending operation knob 30, and the direction of the front end portion 22 inserted into the body cavity is changed.
[0031] Figure 2 It is an enlarged view of the front end portion 22 of the insertion tube 2. Figure 3 2 is a plan view showing an example of the configuration of the first LED 71 (narrow-band light LED) and the second LED 72 (white LED). The front end portion 22 has a tubular housing 24 with one side fixed to the curved portion 21. The other side of the housing 24 is covered by a central objective lens 25 and an annular light distribution lens 26 surrounding the objective lens 25. Inside the housing 24, a photographing unit 6 is assembled on the inner side facing the objective lens 25. That is, the photographing unit 6 photographs an observation object (subject) such as a body cavity or other internal body part via the objective lens 25. The objective lens 25 is embedded in the inner frame of the hole portion provided on the front end portion 22 of the insertion tube 2, and functions as an observation window. The lighting unit 7 is assembled on the inner side facing the light distribution lens 26.
[0032] The imaging unit 6 includes an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) and an optical system for forming an image on the imaging surface of the imaging element, and images the inside of the body cavity through an objective lens 25. The objective lens 25 is, for example, a wide-angle lens, and the imaging unit 6 is configured to be able to perform imaging at a viewing angle of 180° or more according to the setting of the optical system including the objective lens 25. Figure 2 The double-dashed line in represents the photographing field of view of the photographing unit 6. The photographing unit 6 outputs the photographing data (image signal) of the photographed observation object (subject) to the receiving circuit 61. The photographing data (image signal) output by the photographing unit 6 is pre-processed by the receiving circuit 61 and the gain circuit 62 such as AD conversion or white balance correction, and is output to the signal processing circuit 12 of the processor device 10.
[0033] The lighting unit 7 includes an annular substrate 70 surrounding the camera unit 6, and a first LED 71 (narrowband LED) and a second LED 72 (white LED) mounted on one surface of the substrate 70 facing the light distribution lens 26. A plurality of the first LEDs 71 and the second LEDs 72 are provided (eight in the figure), and the first LEDs 71 are arranged at substantially equal intervals on the inner circumference of the annular substrate 70 (the side close to the camera unit 6), and the second LEDs 72 are arranged at substantially equal intervals outside the arrangement area of the first LEDs 71. Figure 3 The positions of the imaging unit 6 and the objective lens 25 are indicated by two-dot chain lines.
[0034] Figure 2 The lower half of shows a cross section of the configuration position of the first LED 71, Figure 2 The upper half of the figure shows a cross section of the configuration position of the second LED 72. The light distribution lens 26 is a tubular lens, extending outward from the peripheral portion of the objective lens 25 and connected to the surrounding tube walls of the housing 24 through a curved portion. The emitted light of the first LED 71 or the second LED 72 is emitted through the light distribution lens 26 to illuminate the shooting field of the shooting unit 6.
[0035] Figure 2The dotted lines in the figure show the light distribution ranges of the first LED 71 (narrowband LED) and the second LED 72 (white LED). The light emitted by the first LED 71 located on the inner side is incident on the extended part of the light distribution lens 26, and is concentratedly distributed to the central part of the shooting field of view of the shooting unit 6. On the other hand, the light emitted by the second LED 72 located on the outer side is incident on a large range from the extended part to the curved part of the light distribution lens 26 and further diffused, and is distributed to the entire range of the shooting field of view of the shooting unit 6. In addition, a recess is provided near the curved part of the inner surface of the light distribution lens 26. Under the action of the recess, the light distribution of the second LED 72 is irradiated to a larger range than the light distribution of the first LED 71. In other words, the irradiation range of the light of the second LED 72 is larger than the irradiation range of the light of the first LED 71. That is, the light distribution characteristics of the first LED 71 (narrowband LED) and the second LED 72 (white LED) are different according to the wavelength range (spectral bandwidth) of the first LED 71 (narrowband LED) and the second LED 72 (white LED). The first LED 71 and the second LED 72 are arranged so that the irradiation range of the first LED 71 (narrow-band LED) having a narrow wavelength range is narrower than the irradiation range of the second LED 72 (white LED) having a wide wavelength range.
[0036] The first LED 71 (narrow-band LED) emits narrow-band light including the purple and green wavelength ranges. For example, among the eight first LEDs 71, four of them are green LED chips that emit green light, and the remaining four are purple LED chips that emit ultraviolet light. These eight first LEDs 71 and the light distribution lens 26 constitute a first light output unit that outputs narrow-band light.
[0037] The second LED 72 is a white LED that emits white light, for example, a blue LED chip that emits blue light is covered with a yellow phosphor. The second LED 72 and the light distribution lens 26 constitute a second light output unit that outputs white light. In addition, the first LED 71 and the second LED 72 can also be other light-emitting elements such as LD.
[0038] The shooting of the shooting unit 6 is carried out under the illumination of the narrowband light output by the first light output unit, or the white light output by the second light output unit. The light distribution angle of white light is larger than the light distribution angle of narrowband light, and is preferably substantially equal to the viewing angle of the shooting unit 6, and more preferably greater than the viewing angle of the shooting unit 6, so that shooting can be performed with a sufficient amount of light within the entire field of view. The spectrum of narrowband light is limited, but the light distribution angle of narrowband light is smaller than that of white light, so the light distribution range of narrowband light becomes smaller (narrower) than that of white light. Therefore, in the amount of light per unit area in the light distribution range (photometric amount), shooting can be performed under the same amount of light in the light distribution range of narrowband light and the light distribution range of white light.
[0039] As described above, the first LED 71 (narrowband LED) and the second LED 72 (white LED) are arranged on a circumference centered on the objective lens 25. Since the second LED 72 (white LED) is arranged at a position closer to the outside (peripheral side) than the first LED 71 (narrowband LED) relative to the objective lens 25, the circle formed by configuring the second LED 72 (white LED) is larger than the circle formed by configuring the first LED 71 (narrowband LED). These first LED 71 and the second LED 72 are arranged corresponding to each of the multiple areas divided in the image captured by the camera 6. When the image captured by the camera 6 is divided into, for example, four parts, the first LED 71 and the second LED 72 are arranged corresponding to each area of the four divided parts.
[0040] In the present embodiment, as shown in the figure, when eight first LEDs 71 and eight second LEDs 72 are provided, the LEDs (two first LEDs 71 and two second LEDs 72) whose main light distribution range is the area of the upper right (area 1) in the image are arranged in a range where the central angle is greater than 0° and less than 45°. In addition, the LEDs (two first LEDs 71 and two second LEDs 72) whose main light distribution range is the area of the lower right (area 4) in the image are arranged in a range where the central angle is greater than 45° and less than 90°. In addition, the LEDs (two first LEDs 71 and two second LEDs 72) whose main light distribution range is the area of the lower left (area 3) in the image are arranged in a range where the central angle is greater than 90° and less than 270°. In addition, the LEDs (two first LEDs 71 and two second LEDs 72) whose main light distribution range is the area of the upper left (area 2) in the image are arranged in a range where the central angle is greater than 270° and less than 360°. In this way, by setting each first LED 71 and second LED 72 corresponding to each area into which the image is divided by the camera unit 6, the light amount of each first LED 71 and second LED 72 corresponding to each of these areas can be derived according to the light metering value in each area. Moreover, each first LED 71 and second LED 72 can be controlled with different light amounts in each area. In the present embodiment, when the image captured by the camera unit 6 is divided (divided) into a plurality of areas, the number of divisions (number of divisions) is set to 4, but it is not limited thereto. The number of the plurality of divided areas (number of divisions) may also be the same as the number of the first LED 71 and second LED 72 (8 in the present embodiment). By setting the number of divisions (number of divisions) corresponding to the number of the first LED 71 and second LED 72, each first LED 71 and second LED 72 can be controlled more finely with different light amounts in each area. In the present embodiment, when the image captured by the camera unit 6 is divided (split) into a plurality of regions, the number of divisions (number of divisions) is such that the number of divisions in the first LED 71 (narrow-band LED) is the same as the number of divisions in the second LED 72 (white LED) (4 in the present embodiment), but the present invention is not limited thereto. The number of divisions in the first LED 71 (narrow-band LED) and the number of divisions in the second LED 72 (white LED) may be different numbers. For example, the number of divisions in the second LED 72 (white LED) may be set to 8, the number of divisions in the first LED 71 (narrow-band LED) may be set to 4, and the number of divisions in the second LED 72 (white LED) having a wide irradiation range may be set to a number greater than the number of divisions in the first LED 71 (narrow-band LED) having a narrow irradiation range.
[0041] Figure 4 It is a block diagram of the endoscope 1 device. Figure 51 is an explanatory diagram showing an example of a lookup table for deriving the light amount. The endoscope 1 is connected to the processor device 10 via the connector portion 5 and is used as an endoscope 1 device. The processor device 10 includes a control unit 11, a signal processing circuit 12, a static processing unit 15 for performing still image processing, and an additional processing circuit 13. These control unit 11, signal processing circuit 12, static processing unit 15, and additional processing circuit 13 are communicatively connected via an internal bus. The control unit 11 includes a CPU, ROM, and RAM. The CPU operates according to the control program stored in the ROM, and in this way, the endoscope 1 device is comprehensively controlled.
[0042] The endoscope 1 includes an imaging drive unit 60 for driving the imaging unit 6 and an illumination drive unit 73 for driving the illumination unit 7. The imaging drive unit 60 drives the imaging unit 6 in a rolling shutter manner according to a control command issued by the control unit 11. The output signal of the imaging drive unit 60 is transmitted to the gain circuit 62 via the receiving circuit 61 in units of one frame, and after a predetermined pre-processing such as white balance processing is performed, the imaging data (image signal) is output to the signal processing circuit 12 of the processor device 10. The pre-processing of the gain circuit 62 uses the gain value provided by the imaging drive unit 60.
[0043] The illumination driving section 73 drives the illumination section 7 according to the control command issued by the control section 11, and selectively or alternately makes the first LED 71 and the second LED 72 emit light. The shooting operation of the shooting section 6 is performed synchronously with the driving of the illumination section 7, and the image output obtained under the illumination of the narrow-band light of the first LED 71 or the white light of the second LED 72 is continuously or alternately input to the signal processing circuit 12. The operation mode of the illumination section 7 can be selected by operating the operation button 31 provided on the operation section 3. That is, the operation mode of the illumination section 7 includes an observation mode (white mode) using the second LED 72 (white LED) and an observation mode (narrow-band mode) using the first LED 71 (narrow-band LED).
[0044] The signal processing circuit 12 performs image processing such as gamma correction and interpolation processing on the input shooting data (image signal) and outputs the image to the additional processing circuit 13. The signal processing circuit 12 may also output the input image after performing these image processing to the additional processing circuit 13 via the static processing unit 15 that performs static image processing. For example, the static processing unit 15 may use DDR RAM (Double Date Rate Random Access Memory) as a buffer area to perform static image processing.
[0045] The additional processing circuit 13 performs mask processing on the peripheral part, and also performs zoom processing on the image under narrow-band light, and then converts it into an image that meets the prescribed standard through various text and image overlap processing, and then outputs it to the external monitor 14. In addition, the image under narrow-band light can enlarge the area where the mask processing is performed without zoom processing. The monitor 14 is a display device such as a liquid crystal display, an organic EL display, etc., and displays the image captured by the imaging unit 6 according to the image signal output by the processor device 10. The user of the endoscope 1 can observe the desired part in the body cavity under the illumination of narrow-band light or white light through the display of the monitor 14.
[0046] The endoscope 1 further includes a light intensity control unit 8 including a photometric circuit 81, an automatic light adjustment control unit 82, and a light intensity control circuit 83. The light intensity control unit 8 may be mounted on the substrate 70 similarly to the first LED 71 (narrow band LED) and the second LED 72 (white LED).
[0047] The light quantity control unit 8 is connected to the gain circuit 62 and the like in a communicative manner through a branch bus branched from an internal bus for connecting the gain circuit 62 and the signal processing circuit 12 of the processor device 10. The light quantity control unit 8 can also be connected to the control unit 11 of the processor device 10 in a communicative manner through the internal bus. The light quantity control unit 8 obtains the shooting data (image signal) output from the gain circuit 62, and derives the photometric value of the observation part based on the obtained shooting data. The light quantity control unit 8 derives the light quantity of the first LED 71 (narrow band LED) and the second LED 72 (white LED) based on the photometric value, and controls the light quantity of the first LED 71 and the second LED 72 based on the derived light quantity.
[0048] The photometric value is derived by the photometric circuit 81. The photometric circuit 81 is composed of, for example, an FPGA or an ASIC, and derives the photometric value in the photometric area corresponding to each of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) from the shooting data (image signal) output from the gain circuit 62. As described above, the irradiation range (light distribution range) of the first LED 71 (narrow-band LED) is different from the irradiation range (light distribution range) of the second LED 72 (white LED). Each of these irradiation ranges (light distribution ranges) is equivalent to (corresponds to) the photometric area of the first LED 71 (narrow-band LED) and the second LED 72 (white LED). Since the irradiation range of the first LED 71 (narrow-band LED) is smaller (narrower) than the irradiation range of the second LED 72 (white LED), the photometric area of the first LED 71 (first photometric area) is smaller (narrower) than the photometric area of the second LED 72 (second photometric area).
[0049] The area information for determining the photometric area (first photometric area) of the first LED 71 and the photometric area (second photometric area) of the second LED 72 is stored in a memory such as a RAM included in an FPGA or the like for constituting the photometric circuit 81. The area information of these photometric areas may also be defined by the range of the image coordinate system in the image captured by the imaging unit 6, or the range of pixel numbers, etc. In the case where the captured data (image signal) output by the gain circuit 62 is data in an array form, the area information of the photometric areas may also be defined by the range of the array numbers.
[0050] The photometric circuit 81 determines the photometric area (first photometric area) of the first LED 71 or the photometric area (second photometric area) of the second LED 72 according to the observation mode. The photometric circuit 81 is linked with the illumination driving unit 73 for driving the first LED 71 and the second LED 72 according to the observation mode, and the observation mode can be obtained through the linkage. That is, the photometric circuit 81, like the illumination driving unit 73, determines whether the observation mode is the white mode using the second LED 72 (white LED) or the narrow-band mode using the first LED 71 (narrow-band LED) according to the control instruction provided by the control unit 11 of the processor device 10. When the observation mode is the white mode, the photometric circuit 81 obtains the area information of the photometric area (second photometric area) of the second LED 72 (white LED). When the observation mode is the narrow-band mode, the photometric circuit 81 obtains the area information of the photometric area (first photometric area) of the first LED 71 (narrow-band LED).
[0051] In any observation mode, the exposure outside the irradiation range becomes low, and the screen becomes dark brown, which is not an area where the observed part can be clearly reflected. In contrast, since the photometric value is derived in the irradiation range (photometric area) corresponding to the first LED 71 (narrow-band LED) and the second LED 72 (white LED) respectively having different light distribution characteristics, in either case, the outer area (dark brown area caused by low exposure) of the irradiation range (photometric area) can be removed from the area used to derive the photometric value. Therefore, it is possible to derive an appropriate photometric value according to the irradiation range (light distribution characteristics) of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) having different light distribution characteristics.
[0052] When deriving the photometric values in these photometric areas, the photometric circuit 81 may also derive the average value (average photometric value) of the photometric values in the entire photometric area. By deriving the average photometric value, it is possible to control so that the brightness of the entire image (endoscopic image) is constant. Alternatively, the photometric circuit 81 may also derive the maximum value (peak photometric value) of the photometric values in the entire photometric area. By deriving the peak photometric value, it is possible to control so that the brightness of the bright part of the image (endoscopic image) is constant.
[0053] When the image captured by the imaging unit 6 is divided into four parts (areas 1 to 4) such as top, bottom, left and right and divided into a plurality of areas, that is, when the observation part includes the plurality of divided areas, the photometric circuit 81 can also derive the photometric value of each of the plurality of divided areas. In this case, the photometric circuit 81 derives the photometric value in the upper right photometric area, the photometric value in the lower right photometric area, the photometric value in the lower left photometric area, and the photometric value in the upper left photometric area according to the respective observation modes (white mode, narrow band mode). Since each of the first LED 71 (narrow band LED) and the second LED 72 (white LED) is arranged corresponding to each of the plurality of divided areas, each of the photometric values of each of the plurality of divided areas can be used to derive the light amount of each of these LEDs. Therefore, in any observation mode (white mode, narrowband mode), even if a halo, for example, occurs in any area divided into a plurality of areas, the light amount of the LED (first LED 71, second LED 72) corresponding to the division where the halo occurs can be properly derived, and each of the divided areas can be illuminated with an appropriate amount of light.
[0054] The automatic light adjustment control unit 82 is composed of, for example, a microcomputer, and derives the light amount of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) based on the photometric value output from the photometric circuit 81. When the photometric value of each of the divided multiple areas is output from the photometric circuit 81, the light amount of each of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) provided corresponding to each of the multiple areas is derived based on the photometric value of each of the multiple areas.
[0055] A lookup table for deriving the light amount from the photometric value is stored in advance in a memory such as a RAM included in a microcomputer or the like constituting the automatic light adjustment control unit 82. In the lookup table, for example, the light amount of the first LED 71 (narrowband LED) and the second LED 72 (white LED) corresponding to the range of the photometric value are defined according to the observation mode. The parameters of the light amount defined by the lookup table are determined, for example, based on the sensitivity characteristics of the imaging unit 6 or the light emission characteristics of the first LED 71 (narrowband LED) and the second LED 72 (white LED) as product specifications.
[0056] The automatic dimming control unit 82 derives the light amount of each of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) provided corresponding to the area according to the light measurement value of each of the divided multiple areas, for example, by referring to a lookup table stored in a memory included in the microcomputer constituting the main unit. The automatic dimming control unit 82 derives the light amount of either the first LED 71 (narrow-band LED) or the second LED 72 (white LED) according to the light emission mode. That is, when the light emission mode is the white mode, the automatic dimming control unit 82 derives the light amount of the second LED 72 (white LED). When the light emission mode is the narrow-band mode, the automatic dimming control unit 82 derives the light amount of the first LED 71 (narrow-band LED).
[0057] The automatic dimming control unit 82 outputs information or signals related to the derived light amounts to the light amount control circuit 83. The information related to the light amount may include, for example, LED current values flowing through the first LED 71 (narrow-band LED) and the second LED 72 (white LED).
[0058] The light quantity control circuit 83 is constituted by, for example, an FPGA or an ASIC, and is electrically connected to the first LED 71 (narrow-band LED) and the second LED 72 (white LED) through wires or pads on the substrate 70. The light quantity control circuit 83 causes current to flow through the first LED 71 (narrow-band LED) and the second LED 72 (white LED) based on information or signals related to light quantity such as the LED current value output from the automatic dimming control unit 82. Thus, it is possible to output illumination light of appropriate light quantity to each of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) arranged corresponding to the divided multiple areas.
[0059] In the present embodiment, the light quantity control unit 8 includes a photometric circuit 81 and a light quantity control circuit 83 formed by a HW processing unit such as FPGA or ASCI, and an automatic light adjustment control unit 82 formed by a SW processing unit such as a microcomputer, but is not limited to this. The photometric circuit 81, the automatic light adjustment control unit 82, and the light quantity control circuit 83 included in the light quantity control unit 8 can also be integrally formed by, for example, SoC (System-on-a-chip) or the like. In the present embodiment, the light quantity control unit 8 and the lighting drive unit 73 are described as separate functional modules, but are not limited to this. The light quantity control unit 8 and the lighting drive unit 73 that perform control related to the lighting unit 7 can also be functional modules integrated by SoC or the like.
[0060] Figure 6 It is an explanatory diagram showing an observation area (photometric area) when illuminated by the first light output unit (narrow-band LED). Figure 7It is an explanatory diagram showing the observation area (photometric area) when illuminated by the second light output unit (white LED).
[0061] As shown in the figure in this embodiment, the observation area (photometric area) when illuminated by the first light output unit (narrow-band LED) is smaller (narrower) than the observation area (photometric area) when illuminated by the second light output unit (white LED). This phenomenon occurs because the light distribution range of the first LED 71 (narrow-band LED) is smaller (narrower) than the light distribution range of the second LED 72 (white LED).
[0062] In this way, when the same photometric area is set in the first light output unit (narrow-band LED) and the second light output unit (white LED) having different light distribution characteristics, the photometric area and the light distribution range in any LED are greatly different, and there is a concern that an appropriate photometric value cannot be derived. In contrast, according to the light distribution characteristics of the first light output unit (narrow-band LED) and the second light output unit (white LED), by using different photometric areas, respective photometric values can be appropriately derived in any observation mode, and automatic dimming control can be performed to make the light amount of the first light output unit (narrow-band LED) and the second light output unit (white LED) appropriate.
[0063] Figure 8 1 is a flowchart showing an example of a processing procedure executed by the light intensity control unit 8 of the endoscope 1. The light intensity control unit 8 of the endoscope 1 starts the processing of the flowchart in response to an operation of the operation button 31 by the operator, for example.
[0064] The light intensity control unit 8 acquires the observation mode (S101). The light intensity control unit 8 acquires, for example, a control instruction provided from the control unit 11 of the processor device 10. The control instruction is an instruction for controlling the illumination driving unit 73, and includes information related to the observation mode.
[0065] The light quantity control unit 8 determines whether the observation mode is the narrow-band light mode (S102). The light quantity control unit 8 determines whether the observation mode is the white mode using the second LED 72 (white LED) or the narrow-band mode using the first LED 71 (narrow-band LED) according to the control instruction obtained from the control unit 11 of the processor device 10.
[0066] When the observation mode is the narrow-band light mode (S102: YES), the light quantity control unit 8 determines the photometric area (first photometric area) corresponding to the angle range of the first LED 71 (narrow-band LED). The light quantity control unit 8 determines the photometric area (first photometric area) corresponding to the angle range of the first LED 71 (narrow-band LED) by, for example, referring to a memory of a microcomputer or the like constituting the main unit (S103).
[0067] When the observation mode is not the narrow-band light mode (S102: NO), that is, when the observation mode is the white light mode, the light quantity control unit 8 determines the photometric area (second photometric area) corresponding to the angle range of the second LED 72 (white LED). The light quantity control unit 8 determines the photometric area (second photometric area) corresponding to the angle range of the second LED 72 (white LED) by, for example, referring to a memory of a microcomputer or the like constituting the main unit (S1021). When determining the first photometric area and the second photometric area, the area information of these photometric areas (first photometric area and second photometric area) is defined, for example, by the range of the image coordinate system in the image captured by the imaging unit 6 or the range of the pixel number.
[0068] The light amount control unit 8 acquires the imaging data output from the imaging unit 6 (S104). The light amount control unit 8 acquires the imaging data (image signal) output from the imaging unit 6 via the receiving circuit 61 and the gain circuit 62 that perform preprocessing such as AD conversion or white balance correction, for example.
[0069] The light quantity control section 8 derives the photometric value in the determined photometric area from the acquired shooting data (S105). The light quantity control section 8 derives the photometric value in any one of the photometric areas (first photometric area) corresponding to the angle range of the first LED 71 (narrow-band LED) determined according to the observation mode or the photometric area (second photometric area) corresponding to the angle range of the second LED 72 (white LED) from the shooting data (image signal) acquired from the shooting section 6. When the observation mode is the white mode, the light quantity control section 8 derives the photometric value in the photometric area (second photometric area) of the second LED 72 (white LED). When the observation mode is the narrow-band mode, the light quantity control section 8 derives the photometric value in the photometric area (first photometric area) of the first LED 71 (narrow-band LED). The light quantity control section 8 derives the photometric value by using the photometric circuit 81 constituting the main unit. The photometric value may be a value of an average value (average photometric value) of the photometric values in the entire photometric areas (first photometric area, second photometric area), or a value of a maximum value (peak photometric value) of the photometric values. As described above, the photometric area (first photometric area) corresponding to the angle range of the first LED 71 (narrowband LED) and the photometric area (second photometric area) corresponding to the angle range of the second LED 72 (white LED) are divided into, for example, four parts (areas 1 to 4) in the upper, lower, left and right directions, and divided into a plurality of areas. When divided in this way, the light quantity control unit 8 derives the photometric value of each division according to each observation mode (white mode, narrowband mode), that is, the photometric value in the photometric area of the upper right (area 1), the photometric value in the photometric area of the lower right (area 4), the photometric value in the photometric area of the lower left (area 3), and the photometric value in the photometric area of the upper left (area 2). Therefore, the light amount control unit 8 may derive the photometric value of each segment (each of the plurality of segmented areas) in each observation mode (white mode, narrow-band mode).
[0070] The light quantity control unit 8 derives the light quantity based on the derived light metering value (S106). The light quantity control unit 8 derives the light quantity based on the light metering value, for example, by referring to a lookup table stored in a memory such as a microcomputer constituting the main unit. The light quantity control unit 8 may also derive the light quantity for each division based on the light metering value derived for each division (each of the divided regions).
[0071] The light quantity control unit 8 controls the light quantity of the LED according to the derived light quantity (S107). The light quantity control unit 8 controls the light quantity of the LED (first LED 71 (narrow-band LED)) and the second LED 72 (white LED) of the lighting unit 7 by outputting the LED current value to the light quantity control circuit 83 as information related to the derived light quantity. The light quantity control unit 8 may also control the light quantity of each divided LED (first LED 71, second LED 72) according to the light quantity derived according to each division (each of the divided multiple regions). Since each of the first LED 71 (narrow-band LED) and the second LED 72 (white LED) is arranged corresponding to each of the divided multiple regions, the light quantity of each of these LEDs (first LED 71, second LED 72) can be controlled according to the light measurement value of each of the divided multiple regions.
[0072] According to the present embodiment, the light quantity control unit 8 of the endoscope 1 derives the photometric value of the observation part of the internal body part such as the body cavity based on the shooting data (image signal) from the shooting unit 6, and derives the light quantity of each of the first light output unit and the second light output unit based on the derived photometric value. Since the area of the observation part that becomes the object when deriving the photometric value is the area (photometric area) corresponding to each of the angle ranges (light distribution ranges) of the first light output unit and the second light output unit, it is possible to derive the light quantity of the area corresponding to the angle range (light distribution range) of the first light output unit and the second light output unit. The light quantity control unit 8 controls the first light output unit and the second light output unit with each derived light quantity, so that the illumination light generated by each of these light quantities is output to the first light output unit and the second light output unit. Therefore, it is possible to effectively perform dimming corresponding to each of the photometric values of the illumination light in different wavelength ranges.
[0073] According to the present embodiment, the angular range (light distribution range) of the second light output unit is larger than the angular range of the first light output unit. Therefore, with respect to the area (photometric area) that is the object when the light quantity is derived by the light quantity control unit 8, by making the area of the observation part corresponding to the angular range of the first light output unit narrower than the area of the observation part corresponding to the angular range of the second light output unit, it is possible to derive the photometric values corresponding to the light distribution characteristics of the first light output unit and the second light output unit, and the accuracy of each photometric value can be improved.
[0074] According to the present embodiment, the observation part photographed by the photographing unit 6 is divided into a plurality of regions, and each of the plurality of first light output units and second light output units is configured corresponding to each of the plurality of regions. Since the light quantity control unit 8 derives the light quantity of the first light output unit and the second light output unit based on the photometric value of each of the plurality of regions, it is possible to obtain a suitable image (endoscopic image) corresponding to the first light output unit and the second light output unit for each of the plurality of regions.
[0075] (Implementation Method 2)
[0076] Fig. 9 This is an explanatory diagram showing the observation part (photometric area) when illuminated by the second light output unit (white LED) involved in Embodiment 2. As shown in the figure in this embodiment, depending on the model of the endoscope 1, when illuminated by the second light output unit (white LED), for example, a predetermined position such as the lower left of the observation part (photometric area) includes a portion of the front end portion 22 including a nozzle or a portion further protruding from the front end portion 22.
[0077] In this case, in particular, if the photometric area includes a metal part with high reflectivity such as a nozzle, a local halo will be generated, and it will be difficult to properly derive the photometric value in the photometric area. In this way, for example, according to the model of the endoscope 1, for a part such as a nozzle that is included in a certain position on the screen and photographed, the position is pre-set as an exclusion area, and the photometric area (remaining area) other than the exclusion area is taken as the object, thereby making it possible to properly derive the photometric value.
[0078] Fig.10 1 is a flowchart showing an example of a processing procedure executed by the light intensity control unit 8 of the endoscope 1. The light intensity control unit 8 of the endoscope 1 starts the processing of the flowchart in response to an operation of the operation button 31 by the operator, for example.
[0079] The light quantity control unit 8 acquires the observation mode (S201). The light quantity control unit 8 determines whether the observation mode is the narrow-band light mode (S202). When the observation mode is the narrow-band light mode (S202: YES), the light measurement area (first light measurement area) corresponding to the angle range of the first LED 71 (narrow-band LED) is determined (S203). When the observation mode is not the narrow-band light mode (S202: NO), that is, when the observation mode is the white light mode, the light measurement area (second light measurement area) corresponding to the angle range of the second LED 72 (white LED) is determined (S2021). The light quantity control unit 8 performs the processing of S201 to S2021 and S203 in the same manner as S101 to S1021 and S103 of Embodiment 1.
[0080] The light quantity control unit 8 determines the exclusion area (S204). The light quantity control unit 8 determines the exclusion area by referring to the memory of the microcomputer or the like constituting the main unit. The exclusion area may be a common area in any observation mode, or may be an area that is different according to these observation modes. The area information of the exclusion area may be defined, for example, by the range of the image coordinate system in the image captured by the imaging unit 6, or the range of the pixel number, etc.
[0081] The light amount control unit 8 acquires the imaging data output from the imaging unit 6 (S205). The light amount control unit 8 performs the process of S205 in the same manner as S104 in the first embodiment.
[0082] The light quantity control unit 8 derives the photometric value in the photometric area excluding the exclusion area from the acquired shooting data (S206). Similar to S105 of the first embodiment, when deriving the photometric value in the photometric area (first photometric area, second photometric area) determined according to the observation mode, the light quantity control unit 8 derives the photometric value in the photometric area (remaining area) excluding the exclusion area from these photometric areas.
[0083] The light quantity control unit 8 derives the light quantity based on the derived photometric value (S207). The light quantity control unit 8 controls the light quantity of the LED based on the derived light quantity (S208). The light quantity control unit 8 performs the processing of S207 and S208 similarly to S106 and S107 of the first embodiment.
[0084] According to the present embodiment, when the light quantity control unit 8 sets an exclusion area in an arbitrary area (photometric area), the photometric value in the area (remaining area) other than the exclusion area is derived. The area information related to the exclusion area is stored in a storage area such as a RAM built into the light quantity control unit 8 and accessible from the light quantity control unit 8, and the light quantity control unit 8 can obtain the area information related to the exclusion area by referring to the RAM, etc. The exclusion area is set, for example, corresponding to a predetermined area of the captured image that always includes the nozzle, etc. provided at the front end 22. That is, the nozzle, etc. is always included in the predetermined area of the captured image corresponding to the exclusion area. Since the reflectivity of the nozzle is relatively high, the illumination light tends to be excessively reflected and generate halo. In contrast, when the exclusion area is set in any one of the plurality of areas, the light quantity control unit 8 derives the light quantity of each of the first light output unit and the second light output unit based on the photometric value in the area (remaining area) excluding the exclusion area in the arbitrary area. Therefore, even when local halation occurs due to reflection from the nozzle or the like, it is possible to appropriately derive the light amounts of the first light output unit and the second light output unit and control the first light output unit and the second light output unit.
[0085] It should be understood that the embodiments disclosed herein are illustrative in all aspects and not restrictive. The technical features described in the various embodiments may be combined with each other, and all changes within the meaning and scope of the equivalent elements of the claims are intended to be included within the scope of the present invention.
[0086] Explanation of symbols
[0087] 1 Endoscope
[0088] 2 Insertion tube
[0089] 20 Flexible part
[0090] 21 Bending part
[0091] 22 Front end
[0092] 23 Connection
[0093] 24 Shell
[0094] 25 Objective lens
[0095] 26 Optical lenses
[0096] 3 Operation section
[0097] 30 Bend operating knob
[0098] 31 Operation buttons
[0099] 4 universal tubes
[0100] 5 Connector
[0101] 6. Filming Department
[0102] 60 Shooting drive unit
[0103] 61 Receiving Circuit
[0104] 62 Gain Circuit
[0105] 7 Lighting Department
[0106] 70 substrate
[0107] 71 first LED (first light emitting element, narrow band LED)
[0108] 72 Second LED (second light emitting element, white LED)
[0109] 73 Lighting drive unit
[0110] 8 Light intensity control unit
[0111] 81 Photometry circuit
[0112] 82 Automatic dimming control unit
[0113] 83 Light control circuit
[0114] 10 Processor device
[0115] 11. Control Unit
[0116] 12 Signal Processing Circuit
[0117] 13 Additional processing circuit
[0118] 14 Monitor
[0119] 15 Static processing unit.
Claims
1. An endoscope comprising: an imaging unit that is assembled in the front end portion of the insertion tube and that images the observation site via the objective lens; a first light output unit, which is arranged around the objective lens and outputs a first illumination light for illuminating the observation part; a second light output unit disposed around the objective lens and outputting second illumination light within a wider angular range than the first light output unit, the second illumination light illuminating an observation site within a wider wavelength range than the first illumination light; and a light quantity control unit that controls the quantity of light output by the first light output unit and the second light output unit; in, The light quantity control unit derives the photometric value in the area of the observation part corresponding to the angular ranges of the first light output unit and the second light output unit, based on the imaging data of the observation part outputted from the imaging unit. deriving the light amounts of each of the first light output unit and the second light output unit based on the derived photometric value, and using the derived light quantity, causing the first light output unit and the second light output unit to output illumination light, The light amount control unit derives a photometric value in a region other than the exclusion region when an exclusion region is set in the region of the observation site.
2. The endoscope according to claim 1, wherein: An area of an observation site corresponding to an angle range of the first light output section from which the light quantity control section derives a photometric value is narrower than an area of an observation site corresponding to an angle range of the second light output section.
3. The endoscope according to claim 1 or 2, wherein: The imaging data includes first imaging data of the observation site illuminated by the first illumination light and second imaging data of the observation site illuminated by the second illumination light, The light metering value includes a first light metering value derived from the first shooting data and a second light metering value derived from the second shooting data. The light quantity control unit deriving the light quantity of the first light output unit based on the first photometric value, The light quantity of the second light output section is derived based on the second photometric value.
4. The endoscope according to claim 1 or 2, wherein: The observation area photographed by the photographing unit includes a plurality of divided areas. The first light output unit and the second light output unit are each provided in plurality corresponding to the plurality of regions. The light quantity control unit derives a light measurement value for each of the plurality of areas. deriving the light amounts of the first light output unit and the second light output unit corresponding to each of the plurality of regions based on the derived light measurement value, The first light output section and the second light output section are caused to output illumination light with the derived light amount.
5. The endoscope according to claim 1 or 2, wherein: The angle range of the second illumination light output by the second light output unit is greater than the viewing angle of the imaging unit.
6. The endoscope according to claim 1 or 2, wherein: The photographing unit has a viewing angle of more than 180°.
7. The endoscope according to claim 1 or 2, wherein: The first illumination light is narrow-band light, and the second illumination light is white light.
8. A storage medium storing a program for causing a computer to execute the following processing: The light measurement value in the region of the observation part corresponding to the angular range of the first light output part and the second light output part is derived based on the imaging data of the observation part outputted from the imaging part that images the observation part through the objective lens. deriving the light amounts of the first light output unit and the second light output unit based on the derived light measurement value, and using the derived light quantity, causing the first light output unit and the second light output unit to output illumination light, When an exclusion area is set in the area of the observation site, deriving a photometric value in an area other than the exclusion area; in, The computer is used to control the amount of light output by the following components: the first light output unit, which is arranged around the objective lens and outputs a first illumination light for illuminating an observation area; the second light output unit, which is arranged around the objective lens and outputs a second illumination light within a larger angle range than the first light output unit, and the second illumination light illuminates the observation area within a wider wavelength range than the first illumination light.
9. An information processing method, the method causing a computer to perform the following processing: The light measurement value in the region of the observation part corresponding to the angular range of the first light output part and the second light output part is derived based on the imaging data of the observation part outputted from the imaging part that images the observation part through the objective lens. deriving the light amounts of the first light output unit and the second light output unit based on the derived light measurement value, and using the derived light quantity, causing the first light output unit and the second light output unit to output illumination light, When an exclusion area is set in the area of the observation site, deriving a photometric value in an area other than the exclusion area; in, The computer is used to control the amount of light output by the following components: the first light output unit, which is arranged around the objective lens and outputs a first illumination light for illuminating an observation area; the second light output unit, which is arranged around the objective lens and outputs a second illumination light within a larger angle range than the first light output unit, and the second illumination light illuminates the observation area within a wider wavelength range than the first illumination light.
Citation Information
Patent Citations
Luminaire
JP2015016021A
Imaging module, and endoscope device
JP2016128024A
Manufacturing cost management device, manufacturing cost management method, and manufacturing cost management program
JP2020160962A
Endoscope device
JP2003116783A
Electronic endoscope
JP2012139435A