Endoscope system
By combining visible light and near-infrared light sources in the endoscope system, images are acquired, processed, and fused, solving the imaging problem of endoscopes in special situations, achieving higher clarity and recognizability, and adapting to more application scenarios.
Patent Information
- Application Number
- CN202322371054.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-31
- Publication Date
- 2026-02-03
- Estimated Expiration
- 2033-08-31
AI Technical Summary
Existing endoscopes have insufficient imaging clarity and discernibility under certain circumstances, leading to reduced surgical efficiency and increased patient risk.
The target scene is illuminated by visible light and near-infrared light sources respectively. The camera captures images of the scene in visible light and near-infrared light. The host processes and fuses the images. Near-infrared light in the 820nm-1100nm band penetrates blood and water mist, improving image clarity and recognizability.
In complex scenarios and under poor imaging conditions, it significantly improves the imaging clarity and recognizability of endoscopes, reduces surgical time, and lowers patient risks.
Smart Images

Figure CN223860825U_ABST
Abstract
Description
Technical Field
[0001] This utility model relates to the field of medical endoscope technology, and in particular to an endoscope system. Background Technology
[0002] With the continuous development of medical technology, endoscopes have become an indispensable medical auxiliary instrument in hospitals for the examination, diagnosis, and treatment of patients' diseases. During the examination and diagnosis of patients' diseases, endoscopes allow for clear observation of diseased tissues, playing a crucial supporting role in the doctor's diagnosis. Furthermore, during surgical treatment of patients, the real-time images provided by endoscopes enable doctors to treat patients more efficiently.
[0003] While some 4K endoscopes or fluorescence endoscopes are currently available on the market, their performance is generally acceptable in ordinary scenarios. However, their performance falls short in certain special situations, such as when tissue bleeding obstructs the view, when the lens fogs up, when insufficient light makes it difficult to see details in dark areas, or when vascular patterns are unclear. These special situations can interfere with the surgeon's work, reducing surgical efficiency and increasing the risks to the patient.
[0004] The above content is only used to help understand the technical solution of this utility model and does not represent an admission that the above content is prior art. Utility Model Content
[0005] The main purpose of this invention is to provide an endoscope system that improves the clarity and recognizability of images captured by the endoscope in complex scenarios and under poor imaging conditions during surgery.
[0006] To achieve the above objectives, this utility model provides an endoscope system, which includes: a light source, a camera, and a main unit; the camera is connected to the main unit, wherein:
[0007] The light source includes a visible light source and a near-infrared light source, which are used to illuminate objects in the target scene, respectively forming reflected light from the visible light illuminating the objects and reflected light from the near-infrared light illuminating the objects, which are then transmitted to the camera.
[0008] The camera is used to capture visible light scene images and near-infrared light scene images. The near-infrared light scene images are obtained by capturing near-infrared light within a preset wavelength range.
[0009] The host computer is used to output a fused image of the processed visible light scene image and near-infrared light scene image.
[0010] Optionally, the endoscope system further includes a lens, which is connected to the light source and the camera respectively. The camera includes: a beam splitter prism arranged along the light path transmission direction, a visible light image sensor, and a near-infrared light image sensor; wherein:
[0011] The visible light source and the near-infrared light source are also used to illuminate objects in the target scene through the lens;
[0012] The beam splitter is used to receive the reflected light after the visible light source and the near-infrared light source illuminate the object in the target scene through the lens, and to change the optical path of the reflected light from the visible light illuminating the object and the reflected light from the near-infrared light illuminating the object, thus forming a visible light optical path and a near-infrared light optical path.
[0013] The visible light image sensor is used to receive visible light from the visible light path and generate a visible light scene image;
[0014] The near-infrared light image sensor is used to receive near-infrared light from the near-infrared light path and generate a near-infrared light scene image.
[0015] Optionally, the camera further includes a light filter;
[0016] The filter is used to filter the near-infrared light in the near-infrared optical path to obtain the reflected light of the object irradiated by near-infrared light within a preset wavelength range.
[0017] The near-infrared light image sensor is also used to receive near-infrared light filtered by the filter, and near-infrared light scene images.
[0018] Optionally, the host includes: a dual FPGA component module, the dual FPGA component module including: a first FPGA chip and a second FPGA chip, the first FPGA chip and the second FPGA chip being connected via a high-speed transmission interface; wherein:
[0019] The first FPGA chip is used to process and fuse the visible light scene image and the near-infrared light scene image to obtain the processed visible light scene image, the near-infrared light scene image and the fused image. The processed visible light scene image, the near-infrared light scene image and the fused image are transmitted to the second FPGA chip through the high-speed transmission interface. The processing includes at least wide dynamic range processing and / or detail enhancement processing.
[0020] The second FPGA chip is used to transmit the processed visible light scene image, near-infrared light scene image, and fused image to peripheral devices.
[0021] Optionally, the preset wavelength range is between 820nm and 1100nm; the processing further includes one or more of the following: decoding, defect correction, metering, noise filtering, white balance, color restoration, color correction, saturation correction, gamma correction, color space conversion, contrast correction, and sharpness correction of the visible light scene image; and decoding, defect correction, and noise filtering of the near-infrared light scene image.
[0022] Optionally, the host further includes a power drive module for supplying power to the entire host system.
[0023] Optionally, the host further includes one or more of the following: a FLASH flash memory module, an eMMC module, an SD module, a USB transmission module, a DDR4 storage module, a SATA module, a DP module, an HDMI module, and a WIFI module; wherein:
[0024] The FLASH module, EMMC module, and SD module are used for program storage and booting;
[0025] The USB module is used for image capture, video recording, and program storage and upgrades.
[0026] DDR4 storage module, used for image access and freezing;
[0027] SATA module, used for image capture and video recording;
[0028] The DP module is used for DP1.2 standard video transmission and display, and includes the SN75DP130 interface chip and the DP1.2 standard interface;
[0029] The HDMI module is used for HDMI 2.0 standard video transmission and display, and includes a TMDS181 interface chip and an HDMI 2.0 standard interface.
[0030] The WIFI module is used to transmit image data to the mobile terminal in real time for storage and display, as well as for interaction with the host system.
[0031] Optionally, the host further includes a communication module for communication with peripheral devices.
[0032] Optionally, the camera further includes a control module, which is connected to the visible light image sensor and the near-infrared light image sensor, and is used to provide the driving voltage required for the two image sensors to transmit image data and to issue related control commands.
[0033] Optionally, the peripheral device includes a display and / or a mobile terminal, wherein the display is connected to the second FPGA chip via a DP interface or an HDMI interface, and the mobile terminal is wirelessly connected to the second FPGA chip, wherein:
[0034] The second FPGA chip is also used to send images to the display for display via a DP interface or an HDMI interface, and to interact with the mobile terminal, receive configuration commands sent by the mobile terminal, and send the configuration commands to the first FPGA chip.
[0035] The first FPGA chip is also used to adjust image parameters according to the configuration instructions.
[0036] The endoscope system proposed in this invention acquires visible light scene images via a camera and near-infrared light scene images by collecting near-infrared light within a preset wavelength range. The host processes the visible light scene images and near-infrared light scene images to obtain processed visible light scene images and near-infrared light scene images. The processed visible light scene images and near-infrared light scene images are then fused to obtain a fused image. Because the near-infrared light scene images are formed using near-infrared light within a preset wavelength range (e.g., between 820nm and 1100nm), this invention improves the clarity and recognizability of endoscope imaging in complex scenes and / or under poor imaging conditions, enabling the system to adapt to more scenarios. Attached Figure Description
[0037] Figure 1 This is a schematic diagram of the structure of an embodiment of the endoscope system of this utility model;
[0038] Figure 2 This is a schematic diagram of the components of the light source assembly module in an embodiment of the endoscope system of this utility model;
[0039] Figure 3 This is a schematic diagram of the components of the camera assembly module in an embodiment of the endoscope system of this utility model;
[0040] Figure 4 This is a schematic diagram of the components of the camera host module in an embodiment of the endoscope system of this utility model.
[0041] The realization of the purpose, functional features and advantages of this utility model will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0042] It should be understood that the specific embodiments described herein are merely illustrative of the present invention and are not intended to limit the present invention.
[0043] It should be understood that the specific embodiments described herein are merely illustrative of the present invention and are not intended to limit the present invention.
[0044] The main solution of this utility model embodiment:
[0045] The endoscopic system includes a light source, a camera, and a host unit. The camera is connected to the host unit. The light source includes a visible light source and a near-infrared light source, which illuminate objects within the target scene, forming reflected light from the visible light and near-infrared light, respectively, which are received by the camera. The camera acquires visible light and near-infrared light scene images, with the near-infrared image obtained by acquiring near-infrared light within a preset wavelength range. The host unit outputs a fused image of the processed visible light and near-infrared light scene images. By using near-infrared light within a preset wavelength range to form the near-infrared scene image, this invention improves the clarity and recognizability of images captured by the endoscope in complex scenes and / or under poor imaging conditions during surgery. This invention not only facilitates faster diagnosis and treatment of patients by medical personnel but also allows for timely and effective handling of unexpected situations during surgery, greatly saving surgical time and reducing patient suffering.
[0046] Reference Figure 1 This invention proposes a preferred embodiment of an endoscope system, comprising: a light source, a camera, and a main unit; the camera is connected to the main unit, wherein:
[0047] The light source includes a visible light source and a near-infrared light source, which are used to illuminate objects in the target scene, respectively forming reflected light from the visible light illuminating the objects and reflected light from the near-infrared light illuminating the objects, which are then transmitted to the camera.
[0048] The camera is used to acquire visible light scene images and near-infrared light scene images. The near-infrared light scene images are obtained by collecting near-infrared light within a preset wavelength range.
[0049] The host computer is used to process the visible light scene image and the near-infrared light scene image to obtain the processed visible light scene image and the near-infrared light scene image, and to fuse the processed visible light scene image and the near-infrared light scene image to obtain a fused image.
[0050] Specifically, in this embodiment, the visible light and near-infrared light reflected from an object after it is illuminated are collected by a camera and converted to obtain visible light scene images and near-infrared light scene images.
[0051] Before acquiring the near-infrared light scene image, the reflected near-infrared light needs to be processed to obtain reflected near-infrared light within a preset wavelength range. Then, based on the reflected near-infrared light within the wavelength range, the near-infrared light scene image is acquired.
[0052] In this embodiment, the preset wavelength range can be between 820nm and 1100nm.
[0053] It is important to note that, compared to fluorescence endoscopy, which operates in the 760-805nm wavelength range, the near-infrared light in this embodiment, with a wavelength range of 820nm-1100nm, can effectively penetrate visible light and blood and water mist that fluorescence cannot penetrate, obtaining the desired clear image. This is primarily due to the physical properties of near-infrared light in this wavelength range: firstly, its absorption rate in blood and water mist is low, resulting in less interference; secondly, its longer wavelength and higher energy provide stronger penetrating power. Furthermore, fluorescence endoscopy requires the pre-injection of contrast agents into the tissue for imaging in the fluorescence band, while this application does not require contrast agent injection, and its purpose is not for imaging, but rather to penetrate blood and water mist for clear imaging.
[0054] Therefore, in this embodiment, near-infrared light in this wavelength range can effectively penetrate blood and water mist that visible light cannot penetrate, thereby obtaining the desired clear image.
[0055] To obtain images with clearer details and more significant effective information, the acquired visible light scene images and near-infrared light scene images need to be further processed and fused by the host computer. Fusing the two images after host processing improves the clarity and recognizability of the final image, helping users better cope with complex and changing surgical environments. In this embodiment, the specific methods for fusing visible light scene images and near-infrared light scene images include, but are not limited to, the following two:
[0056] Method 1: Generally speaking, near-infrared scene images are non-full-color images (such as black and white images), but they have high clarity and recognizability in special environments. Visible scene images are full-color images (RGB images). After fusing the visible light scene image and the near-infrared scene image, the resulting fused image is a full-color image with clarity and recognizability in special environments.
[0057] Method 2 involves merging visible light scene images and near-infrared light scene images into a single display screen. Specifically, this can be achieved through two separate display windows, a picture-in-picture display, or by switching between the two separate display screens. These methods are not exhaustive here.
[0058] Furthermore, the endoscope system also includes a light source and a lens, the lens being connected between the light source and the camera, respectively.
[0059] Specifically, the lens can be composed of a lens barrel, an objective lens, and an eyepiece. The lens barrel is a cylindrical structure used to house optical elements. The objective lens is a lens located at the front end of the lens barrel, used to focus light and magnify the observed object. The eyepiece is a lens located at the rear end of the lens barrel, used to observe and magnify the object imaged by the objective lens.
[0060] like Figure 2 As shown, the light source includes a visible light source and a near-infrared light source. In this embodiment, the light source integrates a visible light source and a near-infrared light source; in another embodiment, two different devices, a visible light source and a near-infrared light source, are used together as a light source.
[0061] like Figure 3 As shown, in one embodiment, the camera includes: a beam-splitting prism, a visible light image sensor, and a near-infrared light image sensor arranged along the optical path transmission direction; wherein:
[0062] The visible light source and the near-infrared light source are used to illuminate objects in the target scene through the lens of the endoscope, respectively forming reflected light from the visible light illuminating the objects and reflected light from the near-infrared light illuminating the objects, and are transmitted through the lens to the camera of the endoscope to acquire visible light scene images and near-infrared light scene images.
[0063] The beam splitter is used to receive the reflected light after the visible light source and the near-infrared light source illuminate the object in the target scene through the lens, and to change the optical path of the reflected light from the visible light illuminating the object and the reflected light from the near-infrared light illuminating the object, thus forming a visible light optical path and a near-infrared light optical path.
[0064] The visible light image sensor is used to receive visible light from the visible light path and generate a visible light scene image;
[0065] The near-infrared light image sensor is used to receive near-infrared light from the near-infrared light path and generate a near-infrared light scene image.
[0066] Furthermore, the camera also includes a filter, which is disposed between the beam splitter and the near-infrared image sensor;
[0067] The filter is used to filter the near-infrared light in the near-infrared optical path to obtain the reflected light of the object irradiated by near-infrared light within a preset wavelength range.
[0068] The near-infrared light image sensor is also used to receive near-infrared light filtered by the filter and generate a near-infrared light scene image.
[0069] Specifically, such as Figure 2 As shown, the light source also includes components such as LED lights, power supply, light source controller, and beam guide. These components work together to ensure that the light source system provides the light source required for the specific application.
[0070] The light source controller controls various parameters of the light source, such as light source type, light source intensity, and color temperature; the LED light provides light; the power supply provides power to the light source system; and the beam guide transmits light to the objective lens in the lens.
[0071] In this embodiment, the light source controller controls the light source to provide visible light and near-infrared light. The light is transmitted to the objective lens through the beam guide in the lens and emitted, illuminating the objects in the target scene. The reflected light from the illuminated objects then passes through the lens to the camera.
[0072] like Figure 3 As shown, after the reflected light from the object is illuminated enters the camera, it first passes through a beam splitter. The beam splitter changes the light paths of the reflected light from the visible light illuminating the object and the reflected light from the near-infrared light illuminating the object, forming a visible light path and a near-infrared light path.
[0073] Then, the near-infrared light transmitted through the near-infrared optical path is filtered by a filter to obtain the reflected light of the object irradiated by near-infrared light within a preset wavelength range.
[0074] Subsequently, the image sensor receives reflected visible light and reflected near-infrared light to generate visible light scene images and near-infrared light scene images. Specifically, the visible light image sensor can receive visible light from the visible light path to generate a visible light scene image, and the near-infrared light image sensor can receive near-infrared light from the near-infrared light path and filtered by a filter to generate a near-infrared light scene image.
[0075] Furthermore, the camera also includes a control module, which is connected to the visible light image sensor and the near-infrared light image sensor, and is used to provide the driving voltage required for the two image sensors to transmit image data and to issue related control commands.
[0076] As one implementation method, such as Figure 4 As shown, the host includes: a dual FPGA component module, the dual FPGA component module including: a first FPGA chip (i.e. Figure 4 Chip A shown) and the second FPGA chip (i.e. Figure 4 Chip B is shown, and the first FPGA chip and the second FPGA chip are connected via a high-speed transmission interface; wherein:
[0077] The first FPGA chip is used to process and / or fuse the visible light scene image and the near-infrared light scene image to obtain the processed visible light scene image, the near-infrared light scene image, and / or the fused image. The processed visible light scene image, the near-infrared light scene image, and the fused image are transmitted to the second FPGA chip through a high-speed transmission interface. The processing includes at least wide dynamic range processing and / or detail enhancement processing.
[0078] Specifically, in this embodiment, after acquiring the visible light scene image and the near-infrared light scene image through the camera, the system transmits the images to the first FPGA chip of the host. The first FPGA chip performs image processing on the visible light scene image and the near-infrared light scene image. The specific processing can be as follows:
[0079] First, the scene image data is decoded, and the decoded images are used for subsequent image processing. The images include visible light scene images and near-infrared light scene images.
[0080] Then, when the depth of field is insufficient to distinguish the dark areas of the image, the scene image can be processed by the wide dynamic range module in the first FPGA chip to improve the brightness of the scene image and make the dark areas of the image clearer.
[0081] Wide dynamic range processing is used to display details in both bright and dark areas of an image. It can preserve details with a wide range of brightness differences in an image, thus obtaining more information-rich images even under complex lighting conditions.
[0082] Meanwhile, when the details of the image are not clear enough, such as the texture of blood vessels, the detail enhancement module in the first FPGA chip can be used to enhance the details of the scene image, which can effectively enhance the texture. When there is an overexposed scene, the metering module can be used to solve the overexposed phenomenon.
[0083] Finally, after the first FPGA chip processes and fuses the visible light scene image and the near-infrared light scene image, it transmits the two processed images and / or fused images to the second FPGA chip through the high-speed transmission interface.
[0084] The second FPGA chip is used to transmit the processed visible light scene image and near-infrared light scene image, and / or fused image to peripheral devices.
[0085] Specifically, firstly, the second FPGA chip receives the processed visible light image, the processed near-infrared light image, and the fused image transmitted from the first FPGA chip via the high-speed transmission interface.
[0086] Then, the second FPGA chip can transmit the three images or a portion of the three images to a peripheral device (such as a monitor) for display via a DP or HDMI interface. In addition, the second FPGA chip can also be used for image compression and storage, menu composition, human-computer interaction, and issuing configuration commands.
[0087] Further processing of the visible light scene image and the near-infrared light scene image may include one or more of the following: decoding, defect correction, metering, noise filtering, white balance, color restoration, color correction, saturation correction, gamma correction, color space conversion, contrast correction, and sharpness correction of the visible light scene image; and decoding, defect correction, and noise filtering of the near-infrared light scene image.
[0088] Furthermore, such as Figure 4 As shown, the host also includes a power drive module for supplying power to the entire host system.
[0089] Furthermore, the host also includes one or more of the following: a FLASH flash memory module, an eMMC module, an SD module, a USB transmission module, a DDR4 storage module, a SATA module, a DP module, an HDMI module, a WIFI module, and a communication module; wherein:
[0090] The FLASH module, EMMC module, and SD module are used for program storage and booting;
[0091] The USB module is used for image capture, video recording, and program storage and upgrades.
[0092] DDR4 storage module, used for image access and freezing;
[0093] SATA module, used for image capture and video recording;
[0094] The DP module is used for DP1.2 standard video transmission and display. It includes an SN75DP130 interface chip and a DP1.2 standard interface to realize DP1.2 standard video transmission and display.
[0095] The HDMI module is used for HDMI 2.0 standard video transmission and display. It includes a TMDS181 interface chip and an HDMI 2.0 standard interface to realize HDMI 2.0 standard video transmission and display.
[0096] The WIFI module is used to transmit image data to the mobile terminal in real time for storage and display, as well as for interaction with the host system;
[0097] The communication module is used for communication with peripheral devices, including SPI communication, UART communication, I2C communication, and Ethernet communication.
[0098] Furthermore, as one implementation, the peripheral device includes a display and a mobile terminal. The display is connected to the second FPGA chip via a DP interface or an HDMI interface, and the mobile terminal is wirelessly connected to the second FPGA chip, wherein:
[0099] The monitor can be a 4K ultra-high-definition display, used to display images transmitted by the host system in real time.
[0100] The second FPGA chip is also used to send images to the display for display via a DP interface or an HDMI interface, and to interact with the mobile terminal, receive configuration commands sent by the mobile terminal, and send the configuration commands to the first FPGA chip.
[0101] The first FPGA chip is also used to adjust image parameters according to the configuration instructions.
[0102] Specifically, in this embodiment, the second FPGA chip receives a configuration command from the mobile terminal via a wireless connection and sends the configuration command to the first FPGA chip. The first FPGA chip adjusts the specific image processing functions according to the command. In this embodiment, the configuration command can be a specific image processing selected by the user on the mobile terminal, such as the aforementioned image wide dynamic range, image detail enhancement, image fusion, etc. The user can select one or more of these processing functions to enable or disable. After the user makes a selection, the mobile terminal will generate the corresponding configuration command in real time and send it to the host system via a wireless connection. The host system makes corresponding adjustments to the image based on the configuration command.
[0103] This embodiment proposes an endoscope system based on the above-described scheme. It acquires visible light scene images via a camera and near-infrared light within a preset wavelength range to obtain near-infrared scene images. The host computer processes these visible light and near-infrared scene images to obtain processed visible light and near-infrared scene images. These processed images are then fused to obtain a fused image. Because near-infrared light within a preset wavelength range (e.g., between 820nm and 1100nm) is used to form the near-infrared scene images, this invention improves the clarity and recognizability of endoscope imaging in complex scenes and / or under poor imaging conditions, enabling the system to adapt to more scenarios.
[0104] The endoscope system proposed in this invention acquires visible light scene images via a camera and near-infrared light scene images by collecting near-infrared light within a preset wavelength range. The visible light and near-infrared light scene images are then processed to obtain processed visible light and near-infrared light scene images. These processed images are then fused to obtain a fused image. Because the near-infrared light scene images are formed using near-infrared light within a preset wavelength range (e.g., between 820nm and 1100nm), this invention improves the clarity and recognizability of endoscope imaging in complex scenes and / or under poor imaging conditions, enabling the system to adapt to more scenarios.
[0105] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, article, or system. Without further limitations, an element defined by the phrase "comprising an endoscopic camera" does not exclude the presence of other identical elements in the process, article, or system that includes that element.
[0106] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0107] The above are merely preferred embodiments of this utility model and do not limit the patent scope of this utility model. Any equivalent structural or procedural transformations made based on the description and drawings of this utility model, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this utility model.
Claims
1. An endoscope system, characterized in that, The endoscope system includes: a light source, a camera, and a main unit; the camera is connected to the main unit, wherein: The light source includes a visible light source and a near-infrared light source, which are used to illuminate objects within the target scene. The camera is used to capture visible light scene images and near-infrared light scene images. The near-infrared light scene images are obtained by capturing near-infrared light within a preset wavelength range. The host computer is used to output a fused image of the processed visible light scene image and near-infrared light scene image.
2. The endoscope system according to claim 1, characterized in that, The endoscope system further includes a lens, which is connected to both the light source and the camera. The camera includes: a beam splitter prism arranged along the optical path transmission direction, a visible light image sensor, and a near-infrared light image sensor; wherein: The visible light source and the near-infrared light source are also used to illuminate objects in the target scene through the lens; The beam splitter is used to receive the reflected light after the visible light source and the near-infrared light source illuminate the object in the target scene through the lens, and to change the optical path of the reflected light from the visible light illuminating the object and the reflected light from the near-infrared light illuminating the object, thus forming a visible light optical path and a near-infrared light optical path. The visible light image sensor is used to receive visible light from the visible light path and generate a visible light scene image; The near-infrared light image sensor is used to receive near-infrared light from the near-infrared light path and generate a near-infrared light scene image.
3. The endoscope system according to claim 2, characterized in that, The camera also includes a light filter; The filter is used to filter the near-infrared light in the near-infrared optical path to obtain the reflected light of the object irradiated by near-infrared light within a preset wavelength range. The near-infrared light image sensor is also used to receive near-infrared light filtered by the filter, and near-infrared light scene images.
4. The endoscope system according to claim 1, characterized in that, The host includes a dual FPGA component module, which comprises a first FPGA chip and a second FPGA chip, the first FPGA chip and the second FPGA chip being connected via a high-speed transmission interface; wherein: The first FPGA chip is used to process and fuse the visible light scene image and the near-infrared light scene image to obtain the processed visible light scene image, the near-infrared light scene image and the fused image. The processed visible light scene image, the near-infrared light scene image and the fused image are transmitted to the second FPGA chip through the transmission interface. The processing includes at least wide dynamic range processing and / or detail enhancement processing. The second FPGA chip is used to transmit the processed visible light scene image, near-infrared light scene image, and fused image to peripheral devices.
5. The endoscope system according to claim 4, characterized in that, The preset wavelength range is between 820nm and 1100nm.
6. The endoscope system according to claim 5, characterized in that, The host also includes a power drive module for supplying power to the entire host system.
7. The endoscope system according to claim 6, characterized in that, The host also includes one or more of the following: a FLASH flash memory module, an eMMC module, an SD module, a USB transmission module, a DDR4 storage module, a SATA module, a DP module, an HDMI module, and a WIFI module; wherein: The FLASH module, EMMC module, and SD module are used for program storage and booting; The USB module is used for image capture, video recording, and program storage and upgrades. DDR4 storage module, used for image access and freezing; SATA module, used for image capture and video recording; The DP module is used for DP1.2 standard video transmission and display, and includes the SN75DP130 interface chip and the DP1.2 standard interface; The HDMI module is used for HDMI 2.0 standard video transmission and display, and includes a TMDS181 interface chip and an HDMI 2.0 standard interface. The WIFI module is used to transmit image data to the mobile terminal in real time for storage and display, as well as for interaction with the host system.
8. The endoscope system according to claim 6, characterized in that, The host also includes: The communication module is used for communication with peripheral devices.
9. The endoscope system according to any one of claims 2-8, characterized in that, The camera also includes a control module, which is connected to the visible light image sensor and the near-infrared light image sensor, and is used to provide the driving voltage required for the two image sensors to transmit image data and to issue related control commands.
10. The endoscope system according to claim 4, characterized in that, The peripheral devices include a display and / or a mobile terminal. The display is connected to the second FPGA chip via a DP interface or an HDMI interface, and the mobile terminal is wirelessly connected to the second FPGA chip, wherein: The second FPGA chip is also used to send images to the display for display via a DP interface or an HDMI interface, and to interact with the mobile terminal, receive configuration commands sent by the mobile terminal, and send the configuration commands to the first FPGA chip. The first FPGA chip is also used to adjust image parameters according to the configuration instructions.