Image sensing element, image and light source synchronization method thereof and endoscope device
By using image sensing elements and their synchronization methods, the problem of image position deviation caused by light source switching during endoscopic examinations has been solved, and image synchronization during light source switching has been achieved, thus improving the accuracy of lesion detection.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-09
- Publication Date
- 2026-03-10
AI Technical Summary
During endoscopic examinations, the switching of light sources causes different image positions, affecting the doctor's accurate judgment of lesions.
By employing image sensing elements and their synchronization methods, the light source device and image sensor are synchronously controlled through a timing control module, so that images under different light sources remain synchronized during switching. The image signal is then processed by an image processor.
This technology enables images to appear continuous to the human eye under different light sources, improving the accuracy of doctors' detection and analysis of lesions in the tested areas.
Smart Images
Figure CN121644967A_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This application claims priority to U.S. Patent Application No. 63 / 690,813, filed on September 5, 2024, which is incorporated herein by reference in its entirety.
[0003] This application claims priority to Taiwan Patent Application No. 114107547, filed on February 27, 2025, which is incorporated herein by reference in its entirety. Technical Field
[0004] This application relates to an image sensing element, more particularly to an image sensing element that enables the synchronization of an image and a light source, a method for synchronizing the image and the light source, and an endoscope device having said image sensing element. Background Technology
[0005] The incidence of esophageal and head and neck cancers is increasing year by year. When symptoms occur and a diagnosis is made, doctors will first use a white light source for endoscopy. If a suspected lesion is found, the white light source will be switched to a narrow-band light source for further confirmation. Therefore, at any given time, only one light source image is available for doctors to interpret. Summary of the Invention
[0006] During an endoscopic examination, the endoscope may move during the procedure, causing the relative positions of the images taken with different light sources to differ. This makes it difficult to accurately obtain a narrow-band light image of the corresponding white light image for the suspected lesion, leading to a deviation in the doctor's judgment of the lesion.
[0007] In view of the shortcomings of existing technology, the applicant devoted his efforts to research and development, and thus developed an image sensing element and a method for synchronizing images and light sources, which can achieve the purpose of synchronizing the operation of images and light sources.
[0008] Another objective of this application is to provide an image sensing element and a method for synchronizing the image and light source, wherein several image frames generated under different light sources can appear as a continuous image to the human eye.
[0009] To achieve the above and other objectives, one aspect of this application provides an image sensing element suitable for coupling with an image processor and a light source device, the light source device being used to emit at least two light sources and illuminate a part to be measured. The image sensing element includes: an image sensor electrically connected to the image processor, the image sensor being used to sense reflected light generated by the part to be measured under the illumination of the light source device, and converting the light signal corresponding to the reflected light into an image signal and transmitting it to the image processor; and a timing control module electrically connected to the image sensor, the timing control module using a synchronization signal to synchronously control the light source device and the image sensor, and synchronously controlling the light source device to switch and activate the light sources according to the different light sources required by the image sensor in each frame, so that the image sensor generates different image signals corresponding to different light sources.
[0010] In one embodiment, the light source emitted by the light source device is at least two of the following: white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrowband light.
[0011] In one embodiment, the timing control module integrates a register for storing opcodes, which are used to set the clock cycle of each of the light sources emitted by the light source device.
[0012] In one embodiment, the timing control module integrating the register is also externally connected to or integrated with an external memory, which is electrically connected to the register, and the register obtains the opcode by reading the external memory.
[0013] In one embodiment, the image sensor transmits the image signal and the clock cycle of the light source to the image processor via a port, the port being a mobile industrial processor interface.
[0014] In one embodiment, the image sensor sets corresponding exposure parameters based on the different light sources required in each frame.
[0015] In one embodiment, the exposure parameters include shutter speed and gain value.
[0016] In one embodiment, the image sensing element of this application further includes an optical filter disposed in front of the image sensor to filter out some wavelengths of light.
[0017] To achieve the above and other objectives, another aspect of this application provides an endoscope device adapted to be combined with a light source device, the endoscope device comprising: an insertion tube having a proximal end and a distal end relative to the proximal end; an imaging assembly including a lens assembly located near the distal end of the insertion tube, and the aforementioned image sensing element located within the insertion tube and engaged with the lens assembly; and a light guide located near the distal end of the insertion tube and adjacent to the lens assembly, wherein the light source device is adapted to be located within the insertion tube and near the light guide.
[0018] In one embodiment, the endoscope device of this application further includes an optical filter disposed in front of the image sensing element.
[0019] To achieve the above and other objectives, another aspect of this application provides a method for synchronizing an image and a light source in an image sensing element, comprising the following steps: providing a light source device for emitting at least two light sources; providing an image sensing element comprising an image sensor and a timing control module, the timing control module being electrically connected to the image sensor; transmitting a synchronization signal to the timing control module; and the timing control module using the synchronization signal to synchronously control the light source device and the image sensor, and synchronously controlling the light source device to switch and activate the light sources according to the different light sources required by the image sensor in each frame, thereby causing the image sensor to generate different image signals corresponding to different light sources.
[0020] In one embodiment, the light source emitted by the light source device is at least two of the following: white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrowband light.
[0021] In one embodiment, the timing control module integrates a register for storing opcodes, which are used to set the clock cycle of each of the light sources emitted by the light source device.
[0022] In one embodiment, the timing control module integrating the register is also externally connected to or integrated with an external memory, which is electrically connected to the register, and the register obtains the opcode by reading the external memory.
[0023] In one embodiment, the image sensor transmits the image signal and the clock cycle of the light source to the image processor via a port, the port being a mobile industrial processor interface.
[0024] In one embodiment, the image sensor sets corresponding exposure parameters based on the different light sources required in each frame.
[0025] In one embodiment, the exposure parameters include shutter speed and gain value.
[0026] In one embodiment, the light source device emits fluorescent excitation light toward the part to be tested, causing the part to emit a fluorescent reaction. The fluorescent reaction includes fluorescent light of a specific wavelength. The optical filter receives the fluorescent reaction and filters out the wavelength signal of the fluorescent excitation light in the fluorescent reaction to obtain the fluorescent light of the specific wavelength.
[0027] Therefore, the image sensing element and the method for synchronizing the image and light source, as well as the endoscope device of this application embodiment, can simultaneously control the image sensor to start operating when the light source device is controlled to start operating and illuminate the area to be tested with a set light source. This can avoid image shift during the switching process of images generated under different light sources. Furthermore, in the asynchronous processing method of switching light sources and then capturing images, when the images generated under different light sources are displayed on the screen, multiple images cannot exist simultaneously in the human eye. That is, at the same time, the doctor can only view the image generated by one type of light source. However, when the images generated in this application are displayed on corresponding screens, due to the persistence of human vision, the images appear as continuous when the doctor views them on each screen. Therefore, at the same time, the doctor can view the images generated by several different light sources, which improves the accuracy of the doctor's detection and analysis of whether there are lesions in the area to be tested. Attached Figure Description
[0028] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0029] Figure 1 This is a block diagram of the first embodiment of the image sensing element of this application.
[0030] Figure 2 This is a timing diagram of the first embodiment of the image sensing element of this application.
[0031] Figure 3 This is a timing diagram of a second embodiment of the image sensing element of this application.
[0032] Figure 4 This is a timing diagram of the third embodiment of the image sensing element of this application.
[0033] Figure 5 This is a timing diagram of the fourth embodiment of the image sensing element of this application.
[0034] Figure 6 This is a block diagram of a second embodiment of the image sensing element of this application.
[0035] Figure 7 This is a block diagram of a third embodiment of the image sensing element of this application.
[0036] Figure 8 This is a block diagram of the fourth embodiment of the image sensing element of this application.
[0037] Figure 9 This is a partial enlarged view of the endoscopic device of this application.
[0038] Figure 10 This is a flowchart of the steps of the method for synchronizing the image and the light source of the image sensing element in this application.
[0039] Figure Labels
[0040] 1 Image sensor
[0041] 2. Timing Control Module
[0042] 3 Registers
[0043] 4. External memory
[0044] 5 Optical filters
[0045] 6. Insertion tube
[0046] 61 Proximal
[0047] 62 Remote
[0048] 7 Imaging Components
[0049] 71 lens groups
[0050] 8 Light guide components
[0051] 10 Image sensing elements
[0052] E Endoscopic device
[0053] L Light Source Device
[0054] L1 First Light-Emitting Element
[0055] L2 Second Light-Emitting Element
[0056] L3 Third Light-Emitting Element
[0057] L4 Fourth Light-Emitting Element
[0058] L5 Fifth Light-Emitting Element
[0059] P Image Processor
[0060] CLK0, CLK1, CLK2, CLK3, CLK4, CLK5 timing signals
[0061] Steps S10, S20, S30, S40 Detailed Implementation
[0062] To fully understand the purpose, features, and effects of this application, the following specific embodiments, in conjunction with the accompanying drawings, will be used to provide a detailed description of this application, as follows:
[0063] Please see Figure 1 This is a block diagram of the first embodiment of the image sensing element of this application, suitable for coupling with an image processor P and a light source device L. The light source device L is used to emit at least two light sources and illuminate the area to be tested. The image sensing element 10 includes: an image sensor 1 and a timing control module 2. The image sensor 1 is electrically connected to the image processor P, and the timing control module 2 is electrically connected to the image sensor 1. The area to be tested is the location of a suspected lesion in the human body, such as the esophagus or the inside of the neck, but is not limited thereto.
[0064] In a specific embodiment, the image processor P may have image processing functions such as color correction, conversion, and gamma correction, and be used to output an image frame. In this embodiment, the image frame may contain information such as image and light source.
[0065] In a specific embodiment, the light source device L can be a combination of a halogen lamp and several filters or several light-emitting diodes (LEDs) to emit light sources of different colors.
[0066] Preferably, the light source emitted by the light source device L can be at least two of the following: white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrow-band imaging (NBI) light, thereby providing images under several different light source illuminations. For example, white light can be generated by a white light-emitting diode, while narrow-band light can be generated by a blue light-emitting diode, a green light-emitting diode, or a combination thereof.
[0067] In a specific embodiment, the image sensor 1 is used to sense the reflected light generated by the light source device L on the part to be measured, and convert the light signal corresponding to the reflected light into an image signal and transmit it to the image processor P.
[0068] Preferably, the image sensor 1 can transmit the image signal and the clock cycle of the light source to the image processor P via a port. Preferably, the port can be a Mobile Industry Processor Interface (MIPI), which enables the image processor to understand the light source information switched by the light source device. Preferably, the image sensor 1 can be a Complementary Metal Oxide Semiconductor (CMOS).
[0069] Preferably, the image sensor 1 can set corresponding exposure parameters, such as shutter speed and gain, according to the different light sources required in each frame. For example, when the light source device L switches the light source to white light, the image sensor 1 will simultaneously set the shutter speed and gain relative to white light.
[0070] In a specific embodiment, preferably, the timing control module 2 can be a microcontroller unit (MCU). Specifically, the timing control module 2 uses a frame synchronization pulse (F_sync) to synchronously control the light source device L and the image sensor 1. Based on the different light sources required by the image sensor 1 in each frame, it synchronously controls the light source device L to switch and activate the light sources, thereby enabling the image sensor 1 to generate different image signals corresponding to different light sources.
[0071] Preferably, the switching time of the light source can be shorter than the human visual persistence time (e.g., 1 / 16 of a second). It is worth mentioning that, preferably, the timing control module 2 uses a switch controller (e.g., an open collector circuit) to control the light source device L to perform the light source switching action, which can reduce the power consumption of the image sensing element. Furthermore, since the timing control module 2 is integrated into the image sensing element 10, when the image sensing element 10 is placed in an endoscope device, especially a disposable endoscope device, the configuration of transmission lines can be reduced, thereby reducing the space used and simplifying the circuit configuration.
[0072] Please see Figure 2This is a timing diagram of the first embodiment of the image sensing element of this application, wherein the 0th frame is from t0 to t1, the 1st frame is from t1 to t2, the 2nd frame is from t2 to t3, the 3rd frame is from t3 to t4, the 4th frame is from t4 to t5, the 5th frame is from t5 to t6, the 6th frame is from t6 to t7, and the 7th frame is from t7 to t8.
[0073] In this embodiment, the synchronization signal (timing signal CLK0) controls the image sensor 1 to remain at a high level and operate continuously during periods t0 to t8, and controls the first light-emitting element L1 (timing signal CLK1) of the light source device L for emitting white light to remain at a high level during periods t0 to t2, t3 to t5, and t6 to t8, and to remain at a low level during the remaining periods; and controls the second light-emitting element L2 (timing signal CLK2) of the light source device L for emitting structured light to remain at a high level during periods t2 to t3 and t5 to t6, and to remain at a low level during the remaining periods; or controls the third light-emitting element L3 (timing signal CLK3) of the light source device L for emitting narrowband light to remain at a high level during periods t2 to t3 and t5 to t6, and to remain at a low level during the remaining periods. Therefore, the reflected light sensed by the image sensor 1 during periods t0 to t2, t3 to t5, and t6 to t8 is generated by white light illuminating the part to be measured, and the reflected light sensed by the image sensor 1 during periods t2 to t3 and t5 to t6 is generated by structured light or narrowband light illuminating the part to be measured, thereby sequentially generating image signals corresponding to different light sources such as white light, white light, structured light or narrowband light, white light, white light, structured light or narrowband light, white light, and white light.
[0074] Please see Figure 3 This is a timing diagram of the second embodiment of the image sensing element of this application, wherein the 0th frame is from t0 to t1, the 1st frame is from t1 to t2, the 2nd frame is from t2 to t3, the 3rd frame is from t3 to t4, the 4th frame is from t4 to t5, the 5th frame is from t5 to t6, the 6th frame is from t6 to t7, and the 7th frame is from t7 to t8.
[0075] In this embodiment, the synchronization signal (timing signal CLK0) controls the image sensor 1 to remain at a high level and operate continuously during periods t0 to t8, and controls the first light-emitting element L1 (timing signal CLK1) of the light source device L for emitting white light to remain at a high level during periods t0 to t2, t3 to t5, and t6 to t8, and to remain at a low level during the remaining periods. It also controls the second light-emitting element L2 (timing signal CLK2) of the light source device L for emitting structured light to remain at a high level during periods t2 to t3, and to remain at a low level during the remaining periods. Furthermore, it controls the third light-emitting element L3 (timing signal CLK3) of the light source device L for emitting narrowband light to remain at a high level during periods t5 to t6, and to remain at a low level during the remaining periods. Therefore, the reflected light sensed by image sensor 1 during t0 to t2, t3 to t5, and t6 to t8 is generated by white light illuminating the area under test; the reflected light sensed by image sensor 1 during t2 to t3 is generated by structured light illuminating the area under test; and the reflected light sensed by image sensor 1 during t5 to t6 is generated by narrowband light illuminating the area under test, thus sequentially generating image signals from different light sources, such as white light, white light, structured light, white light, white light, narrowband light, white light, and white light. Preferably, this embodiment can be applied to a 30fps frame rate, conforming to most existing screen specifications, achieving smooth and low-latency display while maintaining low power consumption.
[0076] Please see Figure 4 This is a timing diagram of the third embodiment of the image sensing element of this application, wherein the 0th frame is from t0 to t1, the 1st frame is from t1 to t2, the 2nd frame is from t2 to t3, the 3rd frame is from t3 to t4, the 4th frame is from t4 to t5, the 5th frame is from t5 to t6, the 6th frame is from t6 to t7, and the 7th frame is from t7 to t8.
[0077] In this embodiment, the synchronization signal (timing signal CLK0) controls the image sensor 1 to remain at a high level and operate continuously during periods t0 to t8, and controls the first light-emitting element L1 (timing signal CLK1) of the light source device L for emitting white light to remain at a high level during periods t0 to t1, t2 to t3, t4 to t5, and t6 to t7, and to remain at a low level during the remaining periods; controls the second light-emitting element L2 (timing signal CLK2) of the light source device L for emitting structured light to remain at a high level during periods t1 to t2 and t5 to t6, and to remain at a low level during the remaining periods; and controls the third light-emitting element L3 (timing signal CLK3) of the light source device L for emitting narrowband light to remain at a high level during periods t3 to t4 and t7 to t8, and to remain at a low level during the remaining periods. Therefore, the reflected light sensed by the image sensor 1 during periods t0 to t1, t2 to t3, t4 to t5, and t6 to t7 is generated by white light illuminating the area under test; the reflected light sensed by the image sensor 1 during periods t1 to t2 and t5 to t6 is generated by structured light illuminating the area under test; and the reflected light sensed by the image sensor 1 during periods t3 to t4 and t7 to t8 is generated by narrowband light illuminating the area under test. This sequentially generates image signals from different light sources, including white light, structured light, white light, narrowband light, white light, structured light, white light, and narrowband light. Preferably, this embodiment is applicable to a 60fps frame rate, allowing for the simultaneous display of smoother and more fluid images on the screen, preventing screen stuttering when doctors view white light, structured light, and narrowband light images.
[0078] Please see Figure 5 This is a timing diagram of the fourth embodiment of the image sensing element of this application, wherein the 0th frame is from t0 to t1, the 1st frame is from t1 to t2, the 2nd frame is from t2 to t3, the 3rd frame is from t3 to t4, the 4th frame is from t4 to t5, the 5th frame is from t5 to t6, the 6th frame is from t6 to t7, and the 7th frame is from t7 to t8.
[0079] In this embodiment, the synchronization signal (timing signal CLK0) controls the image sensor 1 to remain at a high level and operate continuously during periods t0 to t8, and controls the first light-emitting element L1 (timing signal CLK1) of the light source device L for emitting white light to remain at a high level during periods t0 to t1, t2 to t3, t4 to t5, and t6 to t7, and to remain at a low level during the remaining periods; controls the fourth light-emitting element L4 (timing signal CLK4) of the light source device L for emitting blue light to remain at a high level during periods t1 to t2 and t7 to t8, and to remain at a low level during the remaining periods; controls the fifth light-emitting element L5 (timing signal CLK5) of the light source device L for emitting green light to remain at a high level during periods t3 to t4, and to remain at a low level during the remaining periods; and controls the second light-emitting element L2 (timing signal CLK2) of the light source device L for emitting structured light to remain at a high level during periods t5 to t6, and to remain at a low level during the remaining periods. Therefore, the reflected light sensed by image sensor 1 during periods t0 to t1, t2 to t3, t4 to t5, and t6 to t7 is generated by white light illuminating the area under test; the reflected light sensed by image sensor 1 during periods t1 to t2 and t7 to t8 is generated by blue light illuminating the area under test; the reflected light sensed by image sensor 1 during periods t3 to t4 is generated by green light illuminating the area under test; and the reflected light sensed by image sensor 1 during periods t5 to t6 is generated by structured light illuminating the area under test, thus sequentially generating image signals from different light sources such as white light, blue light, white light, green light, white light, structured light, white light, and blue light. Preferably, this embodiment can be applied to a 120fps frame rate, allowing for the simultaneous display of a more detailed image on the screen, enabling physicians to more clearly observe whether the area under test has lesions.
[0080] Please see Figure 6 This is a block diagram of a second embodiment of the image sensing element of this application. The timing control module 2 may integrate a register 3 to store opcodes, which are used to set the clock cycle of each light source emitted by the light source device L. Therefore, the light source device can be directly controlled by the image sensing element, thus reducing the number of signal lines used to control the light source device.
[0081] Please see Figure 7This is a block diagram of the third embodiment of the image sensing element of this application. The timing control module 2, which integrates the register 3, can also be externally connected to or integrated with an external memory 4 (e.g., an erasable programmable read-only memory (EPROM)). The external memory 4 is electrically connected to the register 3. The register 3 obtains the opcode by reading the external memory 4. Therefore, when the image sensing element 10 is installed in an endoscope device, especially a disposable endoscope device, no additional external circuitry is required, which reduces the space used and has the effect of reducing circuit complexity.
[0082] Please see Figure 8 This is a block diagram of a fourth embodiment of the image sensing element of this application. Compared to the first embodiment, it may further include an optical filter 5 disposed in front of the image sensor 1 to filter out certain wavelengths of light. Specifically, the light source device L can emit fluorescent excitation light toward the area to be measured, causing the area to emit a fluorescent reaction, wherein the fluorescent reaction includes fluorescent light of a specific wavelength. The optical filter 5 receives the fluorescent reaction and filters out the wavelength signal of the fluorescent excitation light in the fluorescent reaction to obtain the fluorescent light of the specific wavelength.
[0083] For example, this embodiment can provide indocyanine green (ICG) development functionality. Specifically, indocyanine green is a non-radioactive fluorescent dye with a main absorption wavelength of approximately 720-810 nm and a main fluorescence response wavelength of approximately 810-900 nm after absorption. Therefore, the optical filter 5 is selected to at least filter out wavelengths of 700-810 nm, and the light source device L emits fluorescent excitation light with a center wavelength between 750-810 nm toward the area to be measured, so that the image sensor 1 can convert the fluorescent light with a wavelength between approximately 815-880 nm into a corresponding image signal.
[0084] Please see Figure 9 The image shown is a partial enlarged view of a specific embodiment of the endoscope device of this application. The endoscope device E is adapted to be combined with the light source device L described above. The endoscope device E includes: an insertion tube 6, an imaging component 7, and a light guide 8, wherein the imaging component 7 and the light guide 8 are respectively disposed in the insertion tube 6.
[0085] In a specific embodiment, the insertion tube 6 has a proximal end 61 and a distal end 62 relative to the proximal end 61, wherein the proximal end 61 of the insertion tube 6 can be connected to an operating handle, and the distal end 62 of the insertion tube 6 can be inserted into the patient's body.
[0086] In a specific embodiment, the imaging assembly 7 includes a lens group 71 and the aforementioned image sensing element 10, wherein the lens group 71 is located near the distal end 62 of the insertion tube 6, and the image sensing element 10 is located inside the insertion tube 6 and engaged with the lens group 71.
[0087] In a specific embodiment, the light guide 8 is located near the distal end 62 of the insertion tube 6 and next to the lens group 71 to guide the light source emitted by the light source device L into the patient's body. For example, but not limited to, the light guide 8 can be an optical fiber bundle.
[0088] Preferably, the endoscope device of this application may further include the aforementioned optical filter 5, which is disposed in front of the image sensing element 10 to filter out some wavelengths of light.
[0089] Please see Figure 10 This is a flowchart illustrating the steps of the image and light source synchronization method of the image sensing element of this application, which includes the following steps:
[0090] The aforementioned light source device L is provided to emit at least two light sources (step S10). Preferably, the light sources emitted by the light source device L when illuminating the test area can be at least two of the following: white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrowband light. For example, white light can be generated by a white light-emitting diode, while narrowband light can be generated by a blue light-emitting diode, a green light-emitting diode, or a combination thereof. The test area is the location of a suspected lesion in the human body, such as the esophagus or the inside of the neck, but is not limited thereto.
[0091] An image sensing element 10 is provided, comprising the aforementioned image sensor 1 and the aforementioned timing control module 2, wherein the timing control module 2 is electrically connected to the image sensor 1 (step S20). The image sensor 1 can transmit the image signal and the clock cycle of the light source to the aforementioned image processor P via the aforementioned port.
[0092] Transmit a synchronization signal to the timing control module 2 (step S30).
[0093] The timing control module 2 uses the synchronization signal to synchronously control the light source device L and the image sensor 1, and synchronously controls the light source device L to switch and activate the light sources according to the different light sources required by the image sensor 1 in each frame, so that the image sensor 1 generates different image signals corresponding to different light sources (step S40).
[0094] In detail, the image sensor 1 can be used to sense the reflected light generated by the measured part under the illumination of the light source device L, and convert the light signal corresponding to the reflected light into the image signal and transmit it to the image processor P. Preferably, the image sensor 1 can be a complementary metal-oxide-semiconductor (CMOS) semiconductor.
[0095] Preferably, the image sensor 1 can set corresponding exposure parameters according to the different light sources required in each frame, and the exposure parameters may include shutter speed and gain value.
[0096] Preferably, the timing control module 2 may integrate the aforementioned register 3 to store opcodes, which are used to set the clock cycle of each light source emitted by the light source device L. Furthermore, the timing control module 2 integrating the register 3 may also be externally connected to or integrated with the aforementioned external memory 4. The external memory 4 is electrically connected to the register 3, and the register 3 obtains the opcodes by reading from the external memory 4.
[0097] Preferably, the aforementioned optical filter 5 can also filter out some wavelengths of light. Specifically, the light source device L can emit fluorescent excitation light toward the test area, causing the test area to emit a fluorescent reaction, wherein the fluorescent reaction includes fluorescent light of a specific wavelength. The optical filter 5 receives the fluorescent reaction and filters out the wavelength signal of the fluorescent excitation light in the fluorescent reaction to obtain the fluorescent light of the specific wavelength.
[0098] In summary, the image sensing element, the method for synchronizing the image and the light source, and the endoscope device of this application can simultaneously control the image sensor to start operating when the light source device is controlled to start operating and illuminate the area to be tested with a set light source. This can avoid image shift during the switching process caused by different light sources. Furthermore, in asynchronous processing methods where images are captured after switching light sources, multiple images cannot exist simultaneously in the human eye when they are displayed on the screen. That is, at the same time, the physician can only view the image produced by one type of light source. However, when the images produced in this application are displayed on corresponding screens, due to the persistence of human vision, the images appear as continuous when viewed by the physician on each screen. Therefore, at the same time, the physician can view the images produced by several different light sources, which improves the accuracy of the physician's detection and analysis of whether there are lesions in the area to be tested.
[0099] This application has been disclosed above with reference to the described embodiments. However, those skilled in the art should understand that the described embodiments are only used to depict this application and should not be construed as limiting the scope of this application. It should be noted that all variations and substitutions equivalent to the described embodiments should be included within the scope of this application. Therefore, the scope of protection of this application shall be determined by the claims.
Claims
1. An image sensing device, adapted to be coupled to an image processor and a light source device, the light source device being configured to emit at least two light sources and to irradiate a subject, characterized in that, The image sensing element comprises: an image sensor electrically connected to the image processor, the image sensor being configured to sense reflected light generated by the object under test under illumination of the light source device and to convert the reflected light into an image signal corresponding to the reflected light and transmit the image signal to the image processor; and a timing control module electrically connected to the image sensor, the timing control module being configured to use a synchronization signal to synchronously control the light source device and the image sensor, and to synchronously control the light source device to switch and activate between the light sources according to different light sources required by the image sensor in each frame, so that the image sensor generates different image signals corresponding to different light sources.
2. The image sensing device according to claim 1, wherein The light source device emits at least two light sources selected from white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrow-band light.
3. The image sensing device according to claim 1, wherein The timing control module is integrated with a register configured to store an operation code, the operation code being configured to set a clock period of each of the light sources emitted by the light source device.
4. The image sensing device according to claim 3, wherein The timing control module integrated with the register is further connected with or integrated with an external memory, the external memory being electrically connected to the register, and the register being configured to obtain the operation code by reading the external memory.
5. The image sensing device according to claim 3, wherein The image sensor transmits the image signal and the clock period of each of the light sources to the image processor via a port, and the port adopts a mobile industry processor interface.
6. The image sensing device according to claim 1, wherein The image sensor sets corresponding exposure parameters according to different light sources required in each frame.
7. The image sensing device according to claim 6, wherein The exposure parameters include shutter time and gain value.
8. The image sensing device according to claim 1, wherein An optical filter is further included and disposed in front of the image sensor to filter out some wavelengths of light.
9. An endoscope device adapted to be used in conjunction with a light source device, characterized by: The endoscope device comprises: a tube having a proximal end and a distal end opposite to the proximal end; an imaging assembly including a lens group located near the distal end of the tube, and the image sensing element as claimed in any one of claims 1 to 8 located in the tube and clamped to the lens group; and a light guide located near the distal end of the tube and beside the lens group, wherein the light source device is adapted to be located in the tube and near the light guide.
10. The endoscope device of claim 9, wherein An optical filter is further included and disposed in front of the image sensing element.
11. A method of synchronizing an image and a light source for an image sensing device, comprising: detecting a light source; and synchronizing an image with the light source. The method comprises the following steps: providing a light source device configured to emit at least two light sources; providing an image sensing element comprising an image sensor and a timing control module electrically connected to the image sensor; transmitting a synchronization signal to the timing control module; and the timing control module uses the synchronization signal to synchronously control the light source device and the image sensor, and synchronously controls the light source device to switch and activate between the light sources according to different light sources required by the image sensor in each frame, so that the image sensor generates different image signals corresponding to different light sources.
12. The method of claim 11, wherein The light source device emits at least two light sources selected from white light, structured light, infrared light, ultraviolet light, fluorescent excitation light, and narrow-band light.
13. The method of claim 11, wherein the image sensor element is a complementary metal-oxide-semiconductor (CMOS) image sensor element. The timing control module is integrated with a register for storing an operation code for setting the respective timing period of the light source emitted by the light source device.
14. The method of claim 13, wherein The timing control module integrated with the register is further connected with or integrated with an external memory, which is electrically connected with the register, and the register reads the operation code from the external memory.
15. The method of claim 13, wherein the method further comprises: The image sensor transmits the image signal and the respective timing period of the light source to an image processor via a port, which adopts a mobile industry processor interface.
16. The method of claim 11, wherein The image sensor sets a corresponding exposure parameter according to different light sources required in each frame.
17. The method of claim 16, wherein the image sensor element is a complementary metal-oxide-semiconductor (CMOS) image sensor element. The exposure parameter includes a shutter time and a gain value.
18. The method of claim 11, wherein, The light source device emits fluorescent excitation light to a to-be-tested part, so that the to-be-tested part emits a fluorescent reaction, the fluorescent reaction includes fluorescent light of a specific wavelength, the optical filter receives the fluorescent reaction, filters out the wavelength signal of the fluorescent excitation light in the fluorescent reaction, and obtains the fluorescent light of the specific wavelength.