Endoscope light source device and system
By setting two light-controlling dials in the endoscope light source device and controlling their relative positions and states, the exposure timing of the Global Shutter Sensor is generated, which solves the problem of insufficient exposure timing of the Rolling Shutter Sensor and improves compatibility and imaging quality.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHANGHAI AOHUA PHOTOELECTRICITY ENDOSCOPE
- Filing Date
- 2021-11-18
- Publication Date
- 2026-05-08
AI Technical Summary
Existing endoscopic light source devices cannot generate full-spectrum light sources, and the exposure sequence of Rolling Shutter Sensors has problems such as overexposure, deformation, or uneven color. In particular, the design complexity and practicality of Global Shutter Sensors are insufficient in Rolling Shutter Sensors.
Two light control dials are set in the light source optical path. By controlling the relative position and state of the dials, a 101010 light transmission pattern is achieved to generate an exposure sequence that matches the Global Shutter Sensor. The second dial is combined with the adjustment of the light characteristics in the optical path to meet the exposure requirements of the Rolling Shutter Sensor.
It improves the exposure timing of the Rolling Shutter Sensor, is compatible with the exposure requirements of the Global Shutter Sensor, enhances the stability and practicality of endoscopic imaging, and reduces overexposure, distortion, and color inhomogeneity of image data.
Smart Images

Figure CN114052627B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of endoscopy technology, and more specifically to endoscopic imaging technology. Background Technology
[0002] Because different tissues and organs have different colors, structures, and compositions, they require different light source spectra. Therefore, it is necessary to design the light source spectrum according to the actual needs of different tissues and organs for different spectra. In recent years, endoscopic imaging technology has made great strides, with significant improvements in image clarity and contrast. Under ordinary white light illumination, lesions with obvious changes in shape and color (such as raised masses and depressed ulcers) can be clearly visualized. Small, flat early cancerous changes and dysplasia are difficult to diagnose and may even be missed. In recent years, endoscopic companies have extensively adopted technologies such as chromoendoscopy, electronic spectrophotometry, narrow-band imaging, optical biopsy, and fluorescence imaging, greatly improving the diagnostic level of early cancerous changes.
[0003] Currently, most endoscopic light source products only produce light in a few specific wavelengths, unable to generate a full-spectrum light source. A small number of light sources can produce hyperspectral light by passing the illumination light through filters of different wavelengths, projecting light of different wavelengths. The mechanical structure consists of these filters arranged in a circle on a freely rotating disk. A motor controls the rotating disk to change the filters through which light passes, thus achieving the function of selecting the output wavelength. (See structural diagram below.) Figure 1 As shown:
[0004] Illuminating tissues and organs with a special light source requires the image sensor and the light source to work together to achieve optimal exposure. The shutter speed primarily controls the effective exposure time of the camera sensor. Generally, a wider shutter speed range is better. A lower shutter speed is suitable for shooting moving objects; however, when shooting nighttime traffic, a longer shutter speed is needed. The silky smooth water effect commonly seen in photographs also requires a slow shutter speed.
[0005] Currently, there are two main types of exposure shutter technology: Rolling Shutter and Global Shutter.
[0006] Regarding Rolling Shutter exposure technology:
[0007] See Figure 2 The exposure of the Rolling Shutter sensor is achieved through line-by-line exposure. At the start of exposure, the sensor scans and exposes line by line until all pixels are exposed. All of this is completed in a very short time. The exposure time differs for pixels in different rows.
[0008] Regarding Global Shutter exposure technology:
[0009] See Figure 3 Unlike Rolling Shutter, this method achieves simultaneous exposure of the entire image. All pixels of the camera sensor sense light at the same time and are exposed simultaneously. The sensor reads out the same image at the same time.
[0010] Global Shutter offers shorter exposure times but increases RMS readout noise. Rolling Shutter can achieve higher frame rates, but when exposure is inappropriate or the object is moving quickly, it can cause partial exposure, sloping patterns, and blurring. The tiny displacement of a rapidly moving object within the exposure time causes partial exposure, sloping patterns, and blurring; this phenomenon observed with Rolling Shutter is known as the rolling shutter effect. Global Shutter is suitable for applications with short exposure times (e.g., <500μs), while Rolling Shutter offers lower noise and frame rates for longer exposure times (e.g., >500μs).
[0011] See Figures 4-5 This serves as an example of the principles behind two exposure techniques. Figure 4 It uses the Rolling Shutter exposure method, scanning line by line. Figure 5 This is the exposure method of Global Shutter, where all pixels are exposed together.
[0012] Furthermore, the Rolling Shutter imaging process during photography is shown in the following image:
[0013] Figure 6 It's a common scene (fan above, car below). Rolling Shutter scanned it line by line, and the resulting image is as follows. Figure 7 When dealing with a moving object, Rolling Shutter exposes and captures the image line by line, resulting in severe distortion. Global Shutter, on the other hand, exposes all pixels simultaneously, thus eliminating this distortion.
[0014] As can be seen from the above, if the rolling shutter's movement speed could reach the level of a mechanical focal plane shutter, it would eliminate the reliance on a mechanical shutter. This means the data readout speed must be increased. The main bottleneck in this speed lies in the time required for charge to transfer from the column amplifier to the common data line; specifically, it's the process of charging a capacitor through an operational amplifier. Increasing this speed can only be achieved by either increasing the operational amplifier speed or decreasing the capacitor value. The former increases power consumption and noise, while the latter is directly proportional to the number of rows on the sensor; therefore, the more pixels, the slower the readout speed. In the short term, the rolling shutter speed cannot yet reach the level of a mechanical focal plane shutter.
[0015] The reason why Global Shutter can achieve global exposure, compared to Rolling Shutter, is that... (See...) Figure 8 The main reason is that Global Shutter adds a storage unit to each pixel, which allows all pixels to be exposed simultaneously.
[0016] The main difference between Rolling Shutter and Rolling Shutter is the addition of a sample-and-hold unit at each pixel. After a specified time has elapsed, the data is sampled and then read out sequentially. In this way, although the pixels read out later are still exposed, the data stored in the sample-and-hold unit remains unchanged.
[0017] The main drawback of this mechanism is that it increases the number of elements per pixel, reducing the fill factor and making it difficult to design high-pixel-count sensors. Additionally, the sample-and-hold unit introduces new noise sources. Compared to RollingShutter technology, Global Shutter technology effectively addresses the following issues:
[0018] 1. High-speed object deformation, see Figures 9-10 , Figure 8 Images taken with SmartSens SC132GS for Global Shutter technology. Figure 9 Image taken for Rolling Shutter Sensor.
[0019] It is clearly visible that when a high-speed moving fan is photographed using a Rolling Shutter Sensor, the object will be distorted.
[0020] 2. Light and shadow phenomena, see Figures 11-12 , Figure 10 Images taken with the SC132GS featuring Global Shutter technology. Figure 11 This image was taken using HDR technology.
[0021] Furthermore, existing technologies mainly use a single color wheel. As described above, when using a RollingShutter Sensor, image data increases in the filter's entry area, is uniform in the filter's transparent area, and decreases in the filter's exit area. This results in only the image data in the filter's transparent area being valid, while the image data in other areas will exhibit overexposure, distortion, or uneven color.
[0022] Therefore, for this kind of image data timing, an image sensor needs to be matched. Currently, there are two types of image acquisition timing sensors: Global Shutter Sensor and Rolling Shutter Sensor.
[0023] Sampling timing for the Global Shutter Sensor:
[0024] This is achieved by exposing the entire scene simultaneously. All pixels of the sensor collect light at the same time and are exposed simultaneously. That is, the sensor starts collecting light at the beginning of the exposure; at the end of the exposure, the light-collecting circuit is cut off. Then the sensor value is read out, which is a photograph. CCD uses Global Shutter mode. All pixels are exposed simultaneously. If the subject is moving at high speed relative to the camera, and the exposure time is too long when shooting in Global Shutter mode, the photo will produce a blurry (trailing) effect.
[0025] For the sampling timing of the Rolling Shutter Sensor:
[0026] Most CMOS sensors currently use a rolling shutter. For any given pixel, it is reset to zero at the start of exposure, and then the signal value is read out after the exposure time has elapsed. Because data readout is serial, the reset / exposure / readout process must also be performed line by line, typically from top to bottom, much like a mechanical focal plane shutter. Like mechanical focal plane shutters, this produces noticeable distortion for fast-moving objects. Moreover, because its scanning speed is slower than that of a mechanical focal plane shutter, the distortion is even more pronounced. For example, if the data readout rate is 20 frames per second, the difference in exposure time between the top and bottom of the image can be as much as 50 milliseconds.
[0027] To compensate for the defects of overexposure, distortion, or uneven color in Rolling Shutter Sensor images, a mechanical shutter is used. At the beginning of the exposure, the entire image sensor is zeroed (most current sensors have a fast zeroing function, which can complete the zeroing of the entire sensor within a few clock cycles), then the mechanical shutter is opened, and after the exposure is completed, the mechanical shutter is closed, and the data is read out sequentially.
[0028] Mechanical shutter: Using mechanical springs or electronic / electromagnetic means, the opening and closing of several blades is controlled, or two curtains "slide" across the image field window with a certain width of gaps, like a stage curtain, allowing the window to have a "sight of light" for a specified period of time. This is the common concept of "mechanical shutter". In other words, like a traditional camera, image exposure is accomplished by the "limited opening and closing" of a physically existing "gate".
[0029] Patent application CN109068966A discloses a processor and system for an electronic endoscope. This solution uses a bandpass filter turntable to generate special illumination light. To address the sampling timing matching issue of the Rolling Shutter Sensor, it employs a method where the sampling frequency of the Rolling Shutter Sensor matches the pulse flicker frequency of the light source, thus achieving the exposure timing of the Global Shutter Sensor and preventing overexposure, distortion, or uneven color in the image. However, this method places high demands on the circuit design of the light source, requiring specific circuitry and a specific light source, resulting in poor practicality.
[0030] Patent application CN103070658A discloses an endoscope system and light source device. This solution uses a white light source, with a rotating filter and a bandpass filter arbitrarily inserted / retracted along the optical path. The rotating filter separates the white light into three colors: B, G, and R, while the bandpass filter separates a narrow-band light N from the white light. The bandpass filter is used to generate oxygen saturation measurement light for measuring the oxygen saturation of hemoglobin in blood. It allows the transmission of two narrow-band lights N11 and N12, whose absorption coefficients are similar for oxidized and deoxidized hemoglobin. While this solution uses two rotating filters to alter the optical characteristics of the light path, this approach is only suitable for global shutter sensors and not for rolling shutter sensors.
[0031] Therefore, it is evident that providing a simple and universal light source control technology that can improve the exposure timing of the Rolling Shutter Sensor is a problem that needs to be solved in this field. Summary of the Invention
[0032] To address the shortcomings of the exposure timing of the Rolling Shutter Sensor in existing endoscopic imaging technologies, the present invention aims to provide an endoscopic light source device that can generate an exposure timing that matches the Global Shutter Sensor, thus effectively overcoming the technical problems existing in the prior art; and further provides an endoscopic imaging system accordingly.
[0033] To achieve the above objectives, the present invention provides an endoscope light source device, including a light source, a first turntable and a driving component. The first turntable has at least one pair of first light-blocking areas and at least one pair of first light-transmitting areas arranged opposite to each other. The first turntable can be rotated to cut its first light-transmitting area or first light-blocking area into the light path generated by the light source.
[0034] The driving component drives the first turntable to rotate relative to the light path generated by the light source, and causes the first light-transmitting area or the first light-blocking area on it to cut into the light path of the light source to form a 101010 light-transmitting pattern, thereby generating the exposure timing of the GlobalShutter Sensor, where 1 represents light transmission and 0 represents complete light blocking.
[0035] Furthermore, the light source device also includes a second turntable; the second turntable is provided with a plurality of second light-transmitting areas, and each second light-transmitting area is provided with a filter of a corresponding wavelength to form a corresponding filter area, and the non-light-transmitting area on the second turntable forms a second light-blocking area; the second turntable is arranged relative to the first turntable, and can be rotated to sequentially cut its second light-transmitting area or second light-blocking area into the light path generated by the light source.
[0036] Furthermore, the driving component can be adjusted in conjunction with the working state of the endoscope imaging module to form a 101010 light transmission pattern in terms of time and frequency, where 1 corresponds to the exposure area of the imaging module and 0 corresponds to the area outside the exposure area of the imaging module.
[0037] Furthermore, the first light-blocking area on the first turntable is fan-shaped.
[0038] Furthermore, a neutral grayscale film or grid can be set in the first light-transmitting area on the first turntable to change the intensity of the light.
[0039] Furthermore, a filter can be provided in the first light-transmitting area on the first turntable, which works in conjunction with the second turntable to selectively change the spectrum of the transmitted light.
[0040] Furthermore, a grid of neutral grayscale film or grid can be set in the second light-transmitting area on the second turntable to change the intensity of light.
[0041] Furthermore, several second light-transmitting areas are sequentially distributed along the circumference of the second turntable, and the interval between adjacent second light-transmitting areas constitutes a second light-blocking area.
[0042] Furthermore, the drive assembly includes a drive unit and a control unit;
[0043] The drive unit drives the first turntable and the second turntable to rotate respectively, and at the same time provides real-time feedback on the rotation position information of the first turntable and the second turntable;
[0044] The control unit determines the relative position between the first and second turntables based on the rotational position information of the first and second turntables fed back by the drive unit, and controls the drive unit to simultaneously overlap the first light-transmitting area of the first turntable and one of the multiple filter areas of the second turntable to achieve simultaneous light transmission of the first and second turntables relative to the optical path; and to simultaneously overlap the first light-blocking area on the first turntable and the second light-blocking area on the second turntable that is not located by a filter to achieve simultaneous complete light blocking of the first and second turntables relative to the optical path.
[0045] To achieve the above objectives, the present invention provides an endoscopic imaging system, including the aforementioned light source device, light guide element, and image sensor Rolling Shutter Sensor or Global Shutter Sensor; one end of the light guide element is configured to cooperate with the light source device, and the other end is configured to cooperate with the image sensor Rolling Shutter Sensor or Global Shutter Sensor.
[0046] The endoscope light source solution provided by the present invention controls the position or state of the corresponding turntable relative to the optical path. For example, by controlling the rotation of the first turntable to form a 101010 light transmission pattern, the exposure timing of the Global Shutter Sensor is generated. At the same time, the second turntable cooperates with the first turntable to adjust the light characteristics in the optical path.
[0047] The solution provided by this invention can not only meet the exposure requirements of the Global Shutter Sensor, but also the exposure requirements of the Rolling Shutter Sensor, thus improving the practicality of the solution. Attached Figure Description
[0048] The present invention will be further described below with reference to the accompanying drawings and specific embodiments.
[0049] Figure 1 This is a schematic diagram of the structure of an existing endoscope light source system;
[0050] Figure 2 Example diagram of the sensor exposure structure for an existing Rolling Shutter;
[0051] Figure 3 Example diagram of the exposure structure of the existing Global Shutter sensor;
[0052] Figure 4 Example image showing the exposure method of an existing Rolling Shutter;
[0053] Figure 5 Example image showing the current exposure method of Global Shutter;
[0054] Figure 6 Example images of common scenes captured by the existing Global Shutter;
[0055] Figure 7 Example images of common scenes captured by existing Rolling Shutters
[0056] Figure 8 Example diagram of the pixel structure of an existing Global Shutter;
[0057] Figure 9 Example image taken with the SmartSensor SC132GS, which uses existing Global Shutter technology;
[0058] Figure 10 Example image taken with an existing Rolling Shutter Sensor;
[0059] Figure 11 Example image taken with the SmartSensor SC132GS, which uses existing Global Shutter technology;
[0060] Figure 12 Example images taken using existing HDR technology;
[0061] Figure 13 This is a schematic diagram of the endoscope light source device.
[0062] Figure 14 This is a schematic diagram of the structure of the first turntable in this light source device;
[0063] Figure 15 This is a schematic diagram of the structure of the second turntable in this light source device;
[0064] Figure 16 This is a schematic diagram of the emergency stop and start structure of the motor in this light source system;
[0065] Figure 17 A schematic diagram showing the position of the turntable that enables light transmission in this light source device;
[0066] Figure 18 A schematic diagram showing the position of the turntable to achieve complete light blocking in this light source device;
[0067] Figure 19 This is a timing diagram illustrating the exposure of the two rotating disks of this light source device in conjunction with the Rolling Shutter Sensor.
[0068] Figure 20 This is a schematic diagram of the control flow of an endoscopic imaging system using this light source device;
[0069] Figure 21 This is an example diagram showing the working state of an endoscope using the Rolling Shutter Sensor that employs this light source system. Detailed Implementation
[0070] To make the technical means, creative features, objectives and effects of this invention easier to understand, the invention will be further described below with reference to specific illustrations.
[0071] To address the shortcomings of the exposure timing of the Rolling Shutter Sensor in existing technologies, this paper proposes to improve the exposure timing of the Rolling Shutter Sensor by setting two light control dials in the light source optical path and coordinating the position and state of the relative optical paths of the two light control dials.
[0072] In this scheme, the position of the first turntable relative to the optical path is controlled to achieve a 101010 light transmission pattern, thereby generating the exposure timing of the Global Shutter Sensor. At the same time, the second turntable is controlled to adjust the light characteristics in the optical path in coordination with the first turntable.
[0073] See Figure 13 The figure shows an example of the configuration of the endoscope light source device provided in this solution. As can be seen from the figure, the light source device in this example is mainly composed of a light source 600, a first turntable 100, a second turntable 200, a drive assembly, and a power supply 900.
[0074] The first turntable 100 and the second turntable 200 are arranged in a series of opposite positions in the light path 700 generated by the light source 600. The position and state of the relative light path of the two turntables are controlled by the driving component to achieve a 101010 light transmission form, thereby generating a light source that matches the optimal exposure timing for image data acquisition by the Rolling Shutter Sensor. Here, 1 represents complete light transmission and 0 represents complete light blocking.
[0075] See Figure 14 The diagram shows an example of the configuration of the first turntable 100 in this scheme.
[0076] As shown in the figure, the first turntable 100 includes at least one pair of opposing first light-blocking areas 120 and at least one pair of opposing first light-transmitting areas 110.
[0077] It should be noted that, in specific implementation, there is no limit to the number of the first light-blocking zones set for the first turntable 110.
[0078] As an example, the first turntable 100 in the illustrated scheme includes a pair of opposing first light-blocking areas 120, which together form a pair of opposing first light-transmitting areas 110.
[0079] It should be noted that in this scheme, the size of the light-blocking area and the light-transmitting area on the first turntable 100 is not limited. If they are set to be the same size, the same exposure time will be generated in one cycle. If they are set to be different sizes, different exposure times will be generated.
[0080] Thus, in some specific embodiments of this example, the first turntable 100 is divided into four parts of the same size, that is, the first turntable 100 is in the shape of a disc, and two fan-shaped areas are symmetrically cut out on it, leaving two fan-shaped areas.
[0081] The area formed by removing the two symmetrical fan-shaped regions is the first light-transmitting area 110; the remaining two fan-shaped regions are the first light-blocking areas 120. The first light-blocking area 120 and the first light-transmitting area 110 of the first turntable are the same size, so that the same exposure time can be generated in one cycle.
[0082] The first turntable 100 thus formed is positioned relative to the light path 700 generated by the light source 600. By rotating it, its fan-shaped light-transmitting area 110 or light-blocking area 120 can be inserted into the light path generated by the light source 600. The light transmission of the light path in the completely light-blocking area 120 of the first turntable 100 is 0; the light transmission of the light path in the completely light-transmitting area 110 of the first turntable 100 is 1. In this way, by driving the first turntable 100 to rotate relative to the light path generated by the light source through the driving component, a 101010 light transmission pattern is achieved, thereby generating the exposure timing of the Global Shutter Sensor.
[0083] Based on this, the solution further adds a second turntable 200, which is positioned in the light path generated by the light source 600 relative to the first turntable 100 and located behind the first turntable 100. The characteristics of the light in the light path are adjusted by rotating in conjunction with the first turntable 100.
[0084] See Figure 15The figure shows an example of the configuration of the second turntable 200 given in this example. As can be seen from the figure, the second turntable 200 is provided with a plurality of second light-transmitting areas 210, and filters of corresponding wavelengths are set in the second light-transmitting areas 210 to form corresponding filter areas; at the same time, the areas on the second turntable 200 that are not where the filters are located constitute the corresponding second light-blocking areas 220.
[0085] The second turntable 200, with this structure, is positioned after the first turntable 100 and within the propagation direction of the light path 700 generated by the light source 600. The second turntable 200 can be rotated to sequentially insert its second light-transmitting area 210 or second light-blocking area 220 into the light path 700 generated by the light source 600. The light transmittance of the second light-transmitting area 210 of the second turntable 200 is 1, and the light transmittance of the second light-blocking area 220 of the second turntable 200 is 0.
[0086] In some specific embodiments of this example, the second turntable 200 is generally circular, and several second light-transmitting areas 210 are distributed sequentially along the circumference of the second turntable 200. The interval between adjacent second light-transmitting areas constitutes a second light-blocking area 220.
[0087] Preferably, a plurality of second light-transmitting areas 210 on the second turntable 200 are distributed equidistantly along the circumference of the second turntable 200. The equidistant distribution of the plurality of second light-transmitting areas 210 can reduce the difficulty of signal processing.
[0088] It should be noted that this solution does not limit the number of second light-transmitting zones 210 on the second turntable 200; the number can be determined based on actual conditions. A greater number of filters allows for the generation of more light bands and stronger functionality, but also requires higher control precision and presents greater control challenges.
[0089] Therefore, in practical applications, in order to improve the information acquisition speed, the number of filters should be reduced as much as possible while meeting the functional requirements.
[0090] To further improve the acquisition speed, custom filters can be made so that each filter can output two different wavelengths, which can reduce the number of filters required.
[0091] Also see Figure 13 The driving components in this endoscope light source device include a driving unit and a control unit 500.
[0092] The drive unit drives the first turntable 100 and the second turntable 200 to rotate respectively, and at the same time provides real-time feedback on the rotation position information of the first turntable 100 and the second turntable 200.
[0093] The drive unit includes a motor drive board 800, a first motor 300, and a second motor 400. The motor drive board 800 is connected to the control unit 500; the first motor 300 and the second motor 400 are respectively connected to the motor drive board 800.
[0094] The first motor 300 and the second motor 400 are respectively driven and connected to the first turntable 100 and the second turntable 200 through corresponding transmission mechanisms, and can respectively drive the first turntable 100 and the second turntable 200 to rotate relative to the light source 600 to generate the light path 700.
[0095] Secondly, in this example, stroke sensors can be further installed on the first motor 300 and the second motor 400 respectively. These stroke sensors can provide real-time feedback on the position and rotation state of the first turntable 100 and the second turntable 200 relative to the light path 700 generated by the light source 600, thereby determining the relative position between the first turntable 100 and the second turntable 200. This ensures the accuracy of the rotation switching between the first turntable 100 and the second turntable 200.
[0096] See Figure 16 This is an example of the timing sequence for completing the coordination of the first turntable 100 and the second turntable 200, as given in this example.
[0097] In this example scheme, the first motor 300 and the second motor 400 corresponding to the first turntable 100 and the second turntable 200 are to realize the functions of emergency stop and emergency start, quickly start rotating to stop at a specified angle; and when controlling the rotation angle of the turntable, the position of the turntable can be detected by the stroke sensor on the first motor 300 and the second motor 400, thereby ensuring the accuracy of the position.
[0098] In this scheme, the control unit 500 can determine the relative position between the first turntable 100 and the second turntable 200 based on the rotation position information of the first turntable 100 and the second turntable 200 fed back by the drive unit, and control the drive unit to drive the first light-transmitting area 110 of the first turntable 100 and one of the multiple filter areas of the second turntable 200 to rotate into the optical path respectively, and simultaneously overlap to realize that the first turntable 100 and the second turntable 200 transmit light to the optical path at the same time;
[0099] Correspondingly, the control unit 500 in this solution can also control the drive unit to drive the first light-blocking area 120 on the first turntable 100 and the second light-blocking area 220 on the second turntable (where the filter is located) to enter the optical path respectively, and simultaneously overlap to achieve simultaneous light blocking of the optical path by the first turntable 100 and the second turntable 200.
[0100] In accordance with this, the first turntable 100 and the second turntable 200 are controlled to form a 101010 light transmission pattern in the optical path.
[0101] Meanwhile, the power supply 900 in this endoscope light source device is used to provide a stable operating current for the light source 600 and the driving components. The specific configuration is not limited here.
[0102] Regarding the aforementioned endoscopic light source device solution, further improvement schemes are also provided here to further enhance performance and practicality.
[0103] Furthermore, in this example, a neutral grayscale film or grid can be set in the first light-transmitting area on the first turntable 100 to change the intensity of the light.
[0104] Meanwhile, a filter can also be set in the first light-transmitting area on the first turntable 100, so that it can be used in conjunction with the second turntable to selectively change the spectrum of the transmitted light.
[0105] Furthermore, in this example, a grid of neutral grayscale films or grids can be set in several second light-transmitting areas on the second turntable to change the intensity of the light.
[0106] Based on the aforementioned light source device, this solution also provides an endoscopic imaging system, which includes the aforementioned light source device, light guide element, and image sensor (Rolling Shutter Sensor).
[0107] The light guide element is used to guide the illumination light provided by the light source 600 to the light source device. One end of the light guide element is configured to cooperate with the light source device, and the other end is configured to cooperate with the image sensor Rolling Shutter Sensor.
[0108] In the resulting endoscopic imaging system, the first rotating disk 100, the second rotating disk 200, and the image sensor Rolling Shutter Sensor work together in a sequential manner to achieve the desired result. The image sensor Rolling Shutter Sensor needs to switch filters sequentially for each frame of image it acquires, using multiple different wavelengths of light to collect more spectral information about the same object.
[0109] See Figures 17-19 In this system, the image sensor Rolling Shutter Sensor switches the light-transmitting area 210 and the light-blocking area 220 of the second turntable 200 with the light-transmitting area 110 and the light-blocking area 120 of the first turntable for each frame of data, so that the image sensor Rolling Shutter Sensor is fully exposed in the effective part of data acquisition and is not exposed in the invalid part of data acquisition.
[0110] In specific implementation, on the acquisition optical path of the Rolling Shutter Sensor, when the Rolling Shutter Sensor is in the effective data acquisition phase, the first motor 300 in the light source device drives the first turntable 100 to switch to the fully transparent region 110 relative to the optical path, that is, to switch the fully transparent region 110 on the first turntable 100 into the optical path. At the same time, the second motor 400 drives the second turntable 200 to switch to the transparent region 210 relative to the optical path, that is, to switch the transparent region 210 on the second turntable 200 into the optical path. This ensures that the transparent region 110 of the first turntable 100 and the transparent region 210 where the filter of the second turntable 200 is located coincide in the optical path emission direction, achieving light transmission for both the first turntable 100 and the second turntable 200.
[0111] During this process, the light-transmitting area 110 on the first turntable 100 and the light-transmitting area 210 where the filter is located on the second turntable 200 need to be switched synchronously. After the switch, the light-transmitting area 110 of the first turntable 100 and the light-transmitting area 210 where the filter is located on the second turntable 200 remain relatively stationary. The light path formed by the light guide element passes through the light-transmitting area 110 of the first turntable 100 and the light-transmitting area 210 where the filter is located on the second turntable 200 in sequence, and reaches the image sensor Rolling Shutter Sensor. In this way, the image sensor Rolling Shutter Sensor senses the light source and performs image acquisition.
[0112] After the light-transmitting area 110 of the first turntable 100 and the light-transmitting area 210 where the filter of the second turntable 200 is located remain relatively still for a period of time, the first turntable 100 and the second turntable 200 will then perform the next round of synchronous rotation switching.
[0113] This allows the Rolling Shutter Sensor to sequentially switch all filters for each frame of image acquired, enabling the acquisition of more spectral information from the same object using light from multiple different wavelengths.
[0114] In the optical path of the Rolling Shutter Sensor, when the Rolling Shutter Sensor is in an invalid part of data acquisition, the first motor 300 drives the first turntable 100 to switch to the light-blocking area 120 or to be in a switching state relative to the optical path, and the second motor 400 drives the second turntable 200 to switch the filter relative to the optical path, switching to the light-blocking area 220. The light-blocking area 120 of the first turntable 100 and the light-blocking area 220 where the filter of the second turntable 200 is located must overlap to achieve light blocking by the first turntable 100 and the second turntable 200.
[0115] In practice, the light-blocking area 120 of the first turntable 100 and the light-blocking area 220 of the second turntable 200 need to switch synchronously, and the light-blocking area 220 of the second turntable 200 needs to complete the switching and position adjustment within the light-blocking area 120 of the first turntable 100. After the switching, the light-blocking area 120 of the first turntable 100 and the light-blocking area 220 of the second turntable 200 remain relatively stationary. At this time, the image sensor stops shooting when no light source penetrates.
[0116] After the light-blocking area 120 of the first turntable 100 and the light-blocking area 220 of the second turntable 200 remain relatively still for a period of time, the first turntable 100 and the second turntable 200 will then perform the next round of synchronous rotation switching.
[0117] The following example illustrates the working process of this endoscopic imaging system in a specific application:
[0118] For ease of description, the light-transmitting state of the light path is described as "light transmission 1", and the light-blocking state of the light path is described as "light blocking 0".
[0119] Therefore, the endoscopic imaging system provided in this solution can be used with the Rolling ShutterSensor endoscope in specific applications.
[0120] The drive components (such as the control unit) in the endoscope adjust the time and frequency of the light transmission pattern 101010 according to the working state of the endoscope imaging module (such as the image sensor RollingShutter Sensor), where 1 corresponds to the exposure area of the imaging module and 0 corresponds to the area outside the exposure area of the imaging module, in which the light path is completely blocked.
[0121] like Figure 21 As shown, T represents the complete exposure cycle of the imaging module, and t1 represents the working status signal of the imaging module. Thus, in conjunction with the working status signal of the endoscope imaging module (such as an image sensor, Rolling Shutter Sensor), a 101010 light transmission pattern with the expected time and frequency coordination is formed. In the system, the first rotating disk of the light source device is 1 (transparent in the optical path) during the time interval Δt, and 0 (blocked in the optical path) for the rest of the time. Correspondingly, the second rotating disk is also 1 during the time interval Δt, and 0 for the rest of the time, where 1 represents light transmission and 0 represents complete blockage. The second rotating disk has multiple transparent areas, and the state of the second transparent area can be controlled by the driving component.
[0122] In this operating mode, when the endoscopic imaging system is working with the Rolling Shutter Sensor endoscope, the entire process is as follows: Figure 20 As shown:
[0123] First, turn on the light source 600 to illuminate the light source device.
[0124] At this time, the control unit 500 receives the turntable drive command and sends a rotation command to the motor drive board 800. The motor drive board 800 controls the first motor 300 and the second motor 400 to drive the light-transmitting area 110 of the first turntable 100 and the light-transmitting area 210 of the second turntable 200 to synchronously switch and overlap to form the light-transmitting state 1 of the light path.
[0125] After a set time, the motor drive board 800 controls the first motor 300 and the second motor 400 to drive the light-blocking area 120 of the first turntable 100 and the light-blocking area 220 of the second turntable 200 to synchronously switch and overlap to form the light-blocking 0 state of the optical path.
[0126] The light-transmitting state 1 and the light-blocking state 0 are switched synchronously in the form of 101010 to form a light source that matches the optimal exposure timing for image data acquisition by the RollingShutter Sensor.
[0127] The Rolling Shutter Sensor acquires image information based on sequential exposures, and then performs subsequent processing on the acquired image data.
[0128] The endoscope light source device and system constructed by the above scheme can not only meet the exposure requirements of Global Sensor, but also meet the exposure requirements of Rolling Shutter Sensor, and is compatible with various types of image sensors, such as Global Shutter Sensor; thus improving the stability and applicability of the device.
[0129] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of this invention is defined by the appended claims and their equivalents.
Claims
1. An endoscope light source device compatible with both global shutter image sensors and rolling shutter image sensors, comprising a light source, characterized in that, It also includes a first turntable, a second turntable, and a driving component, wherein the first turntable and the second turntable are arranged in a sequentially opposite manner in the light path generated by the light source; The first turntable has at least one pair of oppositely distributed first light-blocking areas and at least one pair of oppositely distributed first light-transmitting areas. The first turntable can be rotated to cut its first light-transmitting area or first light-blocking area into the light path generated by the light source, so as to form a 101010 light transmission pattern, thereby generating the exposure timing of the global shutter and forming a light source that matches the optimal exposure timing for image data acquisition by the rolling shutter image sensor. The light transmittance of the first light-blocking area of the first turntable is 0; the light transmittance of the first light-transmitting area of the first turntable is 1. The second turntable has several second light-transmitting areas, and filters of corresponding wavelengths are set in the second light-transmitting areas to form corresponding filter regions. At the same time, the areas on the second turntable that are not where the filters are located constitute corresponding second light-blocking areas. The second turntable is set after the first turntable and located in the light path generated by the light source along the propagation direction of the light path generated by the light source. The second turntable can rotate to sequentially insert its second light-transmitting areas or second light-blocking areas into the light path generated by the light source, so as to cooperate with the first turntable to adjust the light characteristics in the light path. The light transmittance of the second light-transmitting area of the second turntable is 1, and the light transmittance of the second light-blocking area of the second turntable is 0. The driving assembly includes a driving unit and a control unit. The driving unit drives the first turntable and the second turntable to rotate, and simultaneously provides real-time feedback on the rotational position information of the first and second turntables. The control unit determines the relative position between the first and second turntables based on the rotational position information fed back by the driving unit, and controls the driving unit to drive the first light-transmitting area of the first turntable and one of the multiple filter areas of the second turntable to enter the optical path, and simultaneously overlap to achieve simultaneous light transmission of the first and second turntables to the optical path. This allows the image sensor to sequentially switch all filters to collect information about the same object using multiple different wavelengths of light for each frame of image acquired. Correspondingly, the control unit controls the driving unit to drive the first light-blocking area on the first turntable and the second light-blocking area on the second turntable (where no filter is located) to enter the optical path, and simultaneously overlap to achieve simultaneous light blocking of the optical path by the first and second turntables. The second light-blocking area of the second turntable needs to complete the switching and position adjustment within the first light-blocking area of the first turntable. After switching, the first light-blocking area and the second light-blocking area remain relatively stationary.
2. The endoscope light source device according to claim 1, characterized in that, The driving component can be adjusted in conjunction with the working state of the endoscope imaging module to form a 101010 light transmission pattern in terms of time and frequency, where 1 corresponds to the exposure area of the imaging module and 0 corresponds to the area outside the exposure of the imaging module.
3. The endoscope light source device according to claim 1, characterized in that, The first light-blocking area on the first turntable is fan-shaped.
4. The endoscope light source device according to claim 1, characterized in that, A neutral grayscale film or grid can be set in the first light-transmitting area on the first turntable.
5. An endoscope light source device according to claim 1, characterized in that, A filter can be placed in the first light-transmitting area on the first turntable, which works in conjunction with the second turntable to selectively change the spectrum of the transmitted light.
6. An endoscope light source device according to claim 1, characterized in that, A neutral grayscale film or grid can be set in the second light-transmitting area on the second turntable.
7. An endoscope light source device according to claim 1, characterized in that, Several second light-transmitting areas are distributed sequentially along the circumference of the second turntable, and the interval between adjacent second light-transmitting areas constitutes a second light-blocking area.
8. An endoscopic imaging system, characterized in that, It includes a light source device, a light guide element, and an image sensor as described in any one of claims 1-7; one end of the light guide element is configured to cooperate with the light source device, and the other end is configured to cooperate with the image sensor, wherein the image sensor is a global shutter image sensor or a rolling shutter image sensor.
Citation Information
Patent Citations
Endoscope system and light source device
CN103070658A
Electronic endoscope system
CN106455954A
Electronic endoscope processor and electronic endoscope system
CN109068966A
Image acquisition device and image acquisition method
CN111586264A
Electronic endoscopic equipment, electronic endoscopic system and shutter mechanism
JP2003190090A