Endoscope system
By employing FPGA image processing algorithms, global rolling shutter automatic exposure, and polymer material extrusion weaving technology, the gap in imaging performance and cost control between disposable endoscopes has been overcome, achieving video image processing effects comparable to reusable endoscopes and eliminating the risk of cross-infection.
Patent Information
- Application Number
- PCT/CN2023/107155
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-25
- Filing Date
- 2023-07-13
- Publication Date
- 2025-01-02
AI Technical Summary
Existing disposable endoscopes lag behind traditional reusable endoscopes in terms of user experience, imaging performance, and cost control, making them unable to replace reusable products in the market, and the risk of cross-infection has not been effectively eliminated.
Employing FPGA-based endoscopic image processing algorithms, global rolling shutter automatic exposure technology, differential data phase dynamic adjustment, and polymer material extrusion weaving process, combined with a sterile barrier method, ensures stable video signal transmission and cost control.
It improves the video image processing performance of endoscopes, reduces costs, avoids the rolling shutter effect, improves the imaging signal-to-noise ratio, and completely eliminates the threat of cross-infection.
Smart Images

Figure CN2023107155_02012025_PF_FP_ABST
Abstract
Description
Endoscope system Technical Field
[0001] The present application relates to the technical field of disposable endoscopes, and in particular to an endoscope system. Background Art
[0002] Endoscopic systems combine traditional optics, ergonomics, precision mechanics, modern electronics, mathematics, and software technologies, providing doctors with a crucial tool for examining, diagnosing, and performing surgery on patients' internal cavities. They are widely used in respiratory, digestive, urological, otolaryngological, and gynecological specialties. Since its invention, the endoscope has undergone multiple rounds of technological evolution, with flexible endoscopes replacing rigid endoscopes, electronic endoscopes replacing traditional optical endoscopes, and CMOS replacing CCD endoscopes. Its application has also expanded to multiple specialties, including urology, digestive, respiratory, and minimally invasive surgery. Traditional endoscopes have always been reusable products. Used endoscopes undergo high-level disinfection or sterilization before being reused. However, the risk of cross-infection with endoscopes has become widely recognized in recent years due to a series of accidents. As a solution to completely eliminate this risk, the standardization of endoscope consumables has become a key development direction for the endoscopy industry.
[0003] Many companies are currently launching disposable endoscopes for the digestive and respiratory systems. However, compared to traditional reusable endoscopes, disposable endoscopes still lag behind in user experience and imaging performance. As a result, disposable endoscopes remain a useful supplement to the overall endoscope market and have yet to gain a dominant position. Current disposable endoscopes face the following challenges: First, there is a significant performance gap. Most manufacturers of disposable endoscopes lack traditional reusable endoscopes. Limited by their experience and capabilities in professional endoscopic image processing and limited knowledge of meeting clinical needs, their products lag significantly behind traditional reusable endoscopes in terms of image processing expertise and clinical user experience. Second, there is a significant gap between cost control and market expectations. The shift from reusable endoscopes to disposable endoscopes increases the cost of consumables for each examination or diagnosis. This increased cost significantly impacts market acceptance and affordability, hindering the progress of endoscope consumable replacement. These problems limit the progress of disposable endoscope products replacing reusable products, making such products still only a beneficial supplement to the endoscope market. In most scenarios, patients still have to bear the threat of cross-infection.
[0004] Summary of the Invention
[0005] In view of the above problems, the present specification is proposed to provide an endoscope system that overcomes the above problems or at least partially solves the above problems.
[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by practice of the present disclosure.
[0007] In a first aspect, an embodiment of the present application provides an endoscope system, comprising an endoscope, a connecting cable and an image processor, wherein the endoscope is connected to the image processor via a connecting cable; the connecting cable and the image processor are sterilized using a sterile barrier method; the endoscope includes an endoscope head end, which is integrated with a camera lens module, and the camera lens module is used to image the imaging scene according to the control signal sent by the image processor, and to stably transmit the collected video signal using differential data phase dynamic adjustment technology, and send it to the image processor via the connecting cable; the connecting cable is used to send the video signal collected by the camera lens module to the image processor for post-processing, and to configure the camera lens module, control the camera lens module to collect images according to the global rolling shutter automatic exposure control method, and forward the user button request on the connecting cable for the image processor to respond; the image processor is used to control the endoscope handle; receive the user operation signal sent by the connecting cable; respond to the user operation according to the user operation signal, and send the control signal to the endoscope handle via the connecting cable; receive the video signal sent by the endoscope head end via the connecting cable, and perform image processing on the video signal.
[0008] In some embodiments, the connecting line is provided with a connecting line FPGA module; the image processor includes an AC / DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip, and the core main board includes an FPGA image processing module, an isolated power supply and a video output module; the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module, and the FPGA image processing module is connected to the connecting line FPGA module to transmit video signals; the video output module includes several video output interfaces; the isolated power supply is used to power the connecting line and the endoscope handle; the controller transmits control signals by connecting to the connecting line FPGA module.
[0009] In some embodiments, the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.
[0010] In some embodiments, the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.
[0011] In some embodiments, the endoscope also includes an endoscope handle, which includes an instrument Luer connector, an infusion and suction Luer connector, and a multi-lumen tube. A clamp channel tube is provided in the multi-lumen tube, and one end of the multi-lumen tube is provided with a clamp channel hole adapted to the size of the clamp channel tube; the other end of the multi-lumen tube is respectively connected to the instrument Luer connector and the infusion and suction Luer connector through the clamp channel tube.
[0012] In some embodiments, the multi-lumen tube is connected to a serpentine structure, which is provided with a wire rope hole. A wire rope is passed through the wire rope hole. The wire rope is fixed at the end of the endoscope head. The serpentine structure is pulled by the wire rope to drive the end of the endoscope head to bend and swing.
[0013] In some embodiments, the snake-bone structure is located in the insertion portion, the endoscope head end is located at the head end of the insertion portion, and the insertion portion is composed of a multi-lumen tube integrally formed by an extrusion braiding process.
[0014] In some embodiments, the camera lens module includes a lens, an image sensor, and several illumination LEDs.
[0015] In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, digital-to-analog converting and data outputting each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens through the connecting wire FPGA module in the connecting wire to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor.
[0016] In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.
[0017] The present invention uses an FPGA-based endoscope system for image processing algorithms, and combines white light illumination-based early cancer screening and global rolling shutter automatic exposure technology to effectively improve the video image processing performance of endoscope products. At the same time, the present invention uses a polymer material extrusion and weaving process to replace the complex structure of the traditional endoscope insertion part, adopts a sterile barrier method to enable the host connection cable to be reused, and adopts differential data phase dynamic adjustment technology to ensure the stable transmission of high-speed video signals on low-cost transmission lines. Through the above innovative designs, the present invention achieves product performance indicators of disposable endoscopes comparable to those of multiplexed endoscopes on the basis of improved cost control. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0019] FIG1 is a schematic diagram of the product structure of an endoscope system provided in an embodiment of the present application;
[0020] FIG2 is a schematic diagram of a top view of the endoscope provided in an embodiment of the present application;
[0021] FIG3 is a side view schematic diagram of the endoscope provided in an embodiment of the present application;
[0022] FIG4 is a schematic structural diagram of a snake-bone structure provided in an embodiment of the present application;
[0023] FIG5 is a schematic diagram of the structure of an image processor provided in an embodiment of the present application;
[0024] FIG6 is a schematic diagram of the module structure of the endoscope system provided in an embodiment of the present application.
[0025] 100. Endoscope; 101. Endoscope handle; 101a. Instrument Luer connector; 101b. Irrigation and suction Luer connector; 101c. Multi-lumen tubing; 101d. Clamp channel hole; 101e. Snake structure; 101e-1. Wire rope hole; 101e-2. Clamp channel position; 101e-3. Wire position; 110. Connecting cable; 120. Image processor. DETAILED DESCRIPTION
[0026] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.
[0027] An embodiment of the present application provides an endoscope system.
[0028] In an embodiment of the present application, as shown in Figures 1 and 6, the endoscope system includes an endoscope 100, a connecting line 110 and an image processor 120. The endoscope 100 is connected to the image processor 120 via the connecting line 110; the connecting line 110 and the image processor 120 are aseptically treated using a sterile barrier method; the endoscope 100 includes an endoscope head end, which is integrated with a camera lens module. The camera lens module is used to image the imaging scene according to the control signal sent by the image processor, and uses differential data phase dynamic adjustment technology to stably transmit the collected video signal and send it to the image processor through the connecting line.
[0029] In some embodiments, as shown in Figures 2 and 3, the endoscope 100 also includes an endoscope handle 101, which includes an instrument Luer connector 101a, an irrigation and suction Luer connector 101b, and a multi-lumen tube 101c. A clamp channel tube is provided in the multi-lumen tube 101c, and a clamp channel hole 101d adapted to the size of the clamp channel tube is provided at one end of the multi-lumen tube 101c; the other end of the multi-lumen tube 101c is respectively connected to the instrument Luer connector 101a and the irrigation and suction Luer connector 101b through the clamp channel tube.
[0030] In an embodiment of the present application, the instrument Luer connector 101a and the irrigation and suction Luer connector 101b cross and converge to dock with the clamp channel tube in the multi-lumen tube 101c, and are ultimately led out of the clamp channel hole at the end of the multi-lumen tube 101c. The embodiment of the present application utilizes this structure to insert instruments such as biopsy forceps, lithotripsy optical fibers, and stone removal baskets from the instrument Luer connector 101a, and then perform biopsy sampling, radiofrequency ablation, and laser ablation through the clamp channel tube and the clamp channel hole in the multi-lumen tube 101c. The embodiment of the present application can also connect a suction machine or a carbon dioxide gas delivery machine through the irrigation and suction Luer connector 101b, and perform irrigation and suction, carbon dioxide gas injection, and other operations on the endoscope head end through the clamp channel tube and the clamp channel hole in the multi-lumen tube. The endoscope of the present application can form various channels through the multi-lumen tube, such as a working channel, a water vapor channel, and the like.
[0031] In some embodiments, as shown in Figure 4, a multi-lumen tube 101c is connected to a serpentine structure 101e. Serpentine structure 101e is contained within an insert, with the endoscope head located at the tip of the insert. The insert is formed from a multi-lumen tube integrally formed using an extrusion and braiding process. Serpentine structure 101e is provided with a wire rope hole 101e-1, through which a wire rope is passed. The wire rope is secured to the endoscope head. Serpentine structure 101e is pulled by the wire rope, causing the endoscope head to flex and swing.
[0032] Specifically, in this embodiment of the present application, wire rope holes 101e-1 are provided on both sides of the snake-bone structure 101e. Two wire ropes can be passed through the wire rope holes 101e-1 on both sides and then fixed to the endoscope head end. By pulling the wire ropes left and right, the snake-bone structure 101e can drive the endoscope head end to bend and swing.
[0033] In the embodiment of the present application, the serpentine structure 101e also reserves a clamp channel position 101e-2 and a wire position 101e-3 for the clamp channel tube and the wire. Since the clamp channel tube and the wire are made of flexible materials, the serpentine structure 101e can drive the end of the endoscope head to bend as a whole through the drive of the steel wire rope, and can make the lower half of the endoscope handle 101 swing in multiple directions, thereby realizing image acquisition, perfusion suction, biopsy sampling, radiofrequency ablation and laser ablation and other functions in multiple directions.
[0034] In the embodiment of the present application, the multi-lumen tube of the insertion portion is made by an integrally formed extrusion braiding process.
[0035] The embodiment of the present application adopts a polymer material extrusion and weaving process to replace the complex structure of the traditional endoscope insertion part. The polymer material extrusion and weaving process forms the outer tube and inner cavity of the insertion part in one step, providing a working platform for the endoscope working channel, suction channel, signal line, traction wire and other functions. Compared with the traditional process of nesting multiple lumens in the endoscope insertion part, the embodiment of the present application greatly reduces material costs and production costs.
[0036] In some embodiments, the camera lens module includes a camera, an image sensor, and several lighting LEDs.
[0037] This application implements an endoscope lens end integrated with a camera lens module, which can image the scene in front of the endoscope lens end. The endoscope lens end can integrate two lighting LEDs, which are used to illuminate the scene in front of the endoscope lens end. During the image processor startup process, the image processor will power the connecting cable and the endoscope handle. Thereafter, the FPGA image processing module in the image processor and the connecting cable FPGA module in the connecting cable can configure the camera via the IIC bus. After configuration, the camera can perform normal image acquisition functions according to the control method of the global rolling shutter.
[0038] In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, digital-to-analog converting and data outputting each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens through the connecting wire FPGA module in the connecting wire to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor.
[0039] In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.
[0040] In the embodiment of the present application, a global rolling shutter automatic exposure control method is used for image acquisition. The exposure time of the rolling shutter sensor is set to the maximum. Each row of pixels is exposed, converted to analog, and output with a fixed time difference to form an image. During the exposure process of the sensor, the FPGA image processing module on the image processor analyzes the overall brightness of the previously captured image. This brightness value is further converted into the lighting time of the endoscope lens end. Finally, the FPGA module in the connecting line controls the LED light source on the endoscope lens end to illuminate the imaging scene during the time interval between the start of exposure of the last row of the sensor and the end of exposure of the first row.
[0041] Since during the endoscopic examination, the internal environment is solely illuminated by the LED light source at the end of the endoscope handle, and during this time, all pixel units of the sensor are simultaneously exposed to external light, the rolling shutter automatic exposure control method adopted in the embodiment of the present application is consistent with the global shutter exposure effect. Therefore, the embodiment of the present application implements a global shutter function on the rolling shutter image sensor, avoiding the jello effect and other problems that are not conducive to real-time imaging in the rolling shutter image sensor. In addition, the present application analyzes the overall brightness of the previously collected image and further converts it into the lighting time of the illumination LED at the end of the endoscope head. Since the LED is not continuously lit during the lighting process, the present application reduces the lighting heat at the head end, which is beneficial to improving the signal-to-noise ratio of the head end image sensor.
[0042] In some embodiments, the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.
[0043] In some embodiments, the connecting line is used to send the video signal captured by the camera lens module to the image processor for post-processing, configure the camera lens module, control the camera lens module to capture images according to the global rolling shutter automatic exposure control method, and forward the user button request on the connecting line for the image processor to respond.
[0044] In an embodiment of the present application, the connecting line converts the signal collected by the image sensor at the end of the endoscope lens into a format suitable for long-distance transmission and sends it to the image processor for post-processing. It can also configure the camera lens module, control the lighting LED and imaging sensor to complete the automatic exposure function and forward the user button request on the connecting line for the image processor to respond.
[0045] In some embodiments, as shown in Figure 5, the image processor is used to control the endoscope handle; receive user operation signals sent by the connecting line; respond to user operations based on the user operation signals, and send control signals to the endoscope handle through the connecting line; receive video signals sent by the endoscope head end through the connecting line, and perform image processing on the video signals.
[0046] In some embodiments, as shown in Figure 6, the connecting line is provided with a connecting line FPGA module; the image processor includes an AC / DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip. The AC / DC high and low voltage conversion board is connected to the AC220V input power supply, and the core main board includes an FPGA image processing module, an isolated power supply and a video output module; the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module, and the FPGA image processing module is connected to the connecting line FPGA module to transmit video signals; the video output module includes several video output interfaces; the isolated power supply is used to power the connecting line and the endoscope handle; the controller can be an IIC controller, and the controller transmits control signals by connecting to the connecting line FPGA module.
[0047] In some embodiments, the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.
[0048] Specifically, the connecting cable and the image processor front panel of the embodiment of the present application include multiple buttons. The connecting cable includes four buttons, and the functions of buttons 1, 2, and 3 can be customized by the user. They can be set to one of multiple functions, including taking photos, special spectral imaging, magnification, metering mode adjustment, structure enhancement, hemoglobin enhancement, light source on / off, and 90° image rotation. Button 4 calls out a prompt bar displaying information such as the current function, timer, endoscope type, and customized buttons.
[0049] The image processor's front panel includes 11 buttons. Two function buttons are used to adjust the structure enhancement level and the image brightness evaluation method for the auto-exposure function, respectively. In addition, nine buttons are arranged in a 3x3 array: User Defined Button 1, White Balance / Up Button, Back Button, Electronic Zoom / Left Button, Menu Button, Photo View / Right Button, User Defined Button 2, Photo / Down Button, and Confirm Button. User Defined Buttons 1 and 2 can be assigned functions such as light source on / off, special spectral imaging, hemoglobin enhancement, and 90° image rotation. When not in the menu, the White Balance / Up, Electronic Zoom / Left, Photo View / Right, and Photo / Down buttons perform white balance, electronic zoom, photo view, and photo capture functions. When in the menu, these buttons perform the up, left, right, and down functions, respectively, during menu operations. The Menu button calls out the menu. The Confirm and Back buttons select and return from the menu, respectively.
[0050] In the embodiment of the present application, when a button on the connecting line is clicked, the FPGA module within the connecting line will first receive the key request. It will then send this request to the IIC controller within the image processor via the IIC bus within the connecting line, and ultimately send it to the FPGA image processing module to respond to the corresponding function. When a front panel button is clicked, the key expansion board will generate a corresponding key request, which will be further transmitted to the IIC controller and ultimately sent to the FPGA image processing module to respond to the function selection.
[0051] In this embodiment of the application, a USB interface is designed on each of the front and rear panels of the image processor. The USB interface is connected to a USB PHY chip (corresponding to an external signal interface chip), which in turn is ultimately connected to the FPGA image processing module. Users can insert storage devices such as USB flash drives into the USB interface, as well as input devices such as keyboards. Users can also choose to store captured images on a USB flash drive or use the keyboard to operate the interface and input characters.
[0052] In an embodiment of the present application, a video signal sent from the endoscope head end is received through a connecting line, and image processing is performed on the video signal, including characteristic spectral color conversion processing under white light illumination and hemoglobin enhancement processing under white light illumination on the collected image.
[0053] Among them, in the process of transforming the characteristic spectrum color of the collected image under white light illumination, the calculation Get the b channel pixel value after color conversion and calculate Get the pixel value of the g channel after color conversion and calculate Get the r channel pixel value after color conversion. Represent the grayscale values of green, blue, and red after color conversion, and They represent the quantum conversion efficiency of the sensor for 540nm and 415nm light, respectively. and Respectively represent the relative luminous flux of the light source at 540nm and 415nm, V 540 and V 415 Indicates the flux power conversion ratio of 540nm and 415nm light, GV g and GV b represents the grayscale values of green and blue pixels recovered from the CMOS sensor (corresponding to the image sensor) after FPGA processing (i.e., the blue and green grayscale values of the image obtained after interpolation of the original image data), λ l λ h are the highest and lowest wavelengths of the light source, Q e is the relative quantum efficiency of the current pixel for light of a specific wavelength, φ s is the relative luminous flux of light of a specific wavelength in the light source, V λ is the flux-to-power conversion coefficient for light of a specific wavelength.
[0054] In an embodiment of the present application, an endoscope is connected to an image processor via a connecting cable. The endoscope can perform functions such as lighting and control, high-definition video image acquisition, perfusion and aspiration, and provide access for other surgical instruments, such as biopsy sampling, radiofrequency ablation, and laser ablation. The endoscope's head can be controlled and bent to traverse various angles of the human body cavity used in clinical practice. The connecting cable converts the signals collected by the imaging sensor at the tip into a format suitable for long-distance transmission and sends them to the image processor for post-processing. The connecting cable also configures the tip sensor, controls the tip LED and imaging sensor for automatic exposure, and forwards user key presses on the connecting cable for the image processor to respond to. The image processor controls the various modules of the endoscope, receiving video signals and user operation signals transmitted by the connecting cable, performing image processing on the video signals, responding to user operations, and sending control signals to the endoscope handle. After processing, the video signal is ultimately output to a screen in a specific format by the output module. The image processor also provides stable power to all components of the endoscope, ensuring that each component meets relevant medical device safety standards. The image signal is collected by the head-end image sensor and transmitted to the image processor via the connecting line. The FPGA image processing module receives the collected image signal and performs image processing to complete functions such as denoising, enhancement, and sharpening, and finally forms a video image signal that meets the requirements of endoscopic detection.
[0055] The endoscope head incorporates a camera lens module that captures images of the scene in front of it. The head can also incorporate two integrated illumination LEDs to illuminate the scene in front of it. During image processor startup, the host computer supplies power to the connecting cable and handle. The FPGA module in the host computer and connecting cable then configures the camera via the IIC bus. Once configured, the camera performs normal image acquisition functions using a global rolling shutter control scheme.
[0056] In an embodiment of the present application, the signal collected by the camera is first transmitted to the FPGA module in the connecting line through the connecting line or FPC (flexible circuit board) in the multi-lumen tube. The module will convert the signal to a level more suitable for long-distance transmission and transmit it to the image processor through the signal line in the connecting line. Due to the long distance of the transmission line, the stable transmission of high-speed video signals needs to rely on high-quality and high-cost signal transmission lines, especially the impedance accuracy of the differential signal line has high requirements. This is inconsistent with the original intention of low cost of disposable endoscopes. To solve this problem, the present application targets possible receiving end error sampling caused by high-speed signal distortion. The image processor dynamically adjusts the phase difference between the signal clock and the data, and receives and evaluates the receiving error rate under the phase difference in real time, thereby obtaining stable signal reception and ensuring the quality of image signal transmission.
[0057] This application realizes global rolling shutter automatic exposure control, perfusion suction, biopsy sampling, radio frequency and laser ablation, image acquisition and image signal transmission, image processing, video output, button and interface response and other functions through the design of materials engineering, production process, electronics, software, optical engineering, image processing and other fields. Compared with the disposable endoscope products on the current market, the endoscope system provided by this application adopts FPGA-based endoscope image processing algorithms, white light illumination-based early cancer screening, global rolling shutter automatic exposure and other technologies, which effectively improves the video image processing performance of endoscope products. At the same time, a polymer material extrusion and weaving process is used to replace the complex structure of the traditional endoscope insertion part, a sterile barrier method is used to enable the reuse of the cable connecting to the host, and the differential data phase dynamic adjustment technology is used to ensure the stable transmission of high-speed video signals on low-cost transmission lines.
[0058] Furthermore, this application utilizes a polymer extrusion and braiding process to replace the complex structure of the traditional endoscope insertion portion, employs a sterile barrier method to allow for reuse of the host connection cable, and employs differential data phase dynamic adjustment technology to ensure stable transmission of high-speed video signals over low-cost transmission lines. This further reduces the product's material and production costs while ensuring performance indicators.
[0059] Furthermore, this application utilizes technologies such as an FPGA-based endoscopic image processing algorithm, white light illumination-based early cancer screening, and global rolling shutter automatic exposure to effectively improve the video image processing performance of endoscope products, avoid problems such as the jello effect, reduce the impact of illumination on head-end temperature, and improve the imaging signal-to-noise ratio. These measures elevate the core performance of endoscope products—video image processing—to the level of mainstream multiplexed endoscopes in the market, laying a solid foundation for disposable endoscopes to replace multiplexed products and completely eliminate the threat of cross-infection.
[0060] The above is a detailed introduction to an endoscope system provided in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for those skilled in the art, based on the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. An endoscope system, characterized in that: It includes an endoscope, a connecting line and an image processor, wherein the endoscope is connected to the image processor via the connecting line; The endoscope comprises an endoscope head end, the endoscope head end is integrated with a camera lens module, the camera lens module is used to image an imaging scene according to a control signal sent by the image processor, and adopts a differential data phase dynamic adjustment technology to stably transmit the collected video signal and send it to the image processor through the connecting line; The connecting line is used to send the video signal collected by the camera lens module to the image processor for post-processing, configure the camera lens module, control the camera lens module to collect images according to the global rolling shutter automatic exposure control method, and forward the user key request on the connecting line for the image processor to respond; The image processor is used to control the endoscope handle; receive the user operation signal sent by the connecting line; respond to the user operation according to the user operation signal and send the control signal to the endoscope handle through the connecting line; receive the video signal sent by the endoscope head end through the connecting line and perform image processing on the video signal.
2. The endoscope system according to claim 1, wherein: The connecting line is provided with a connecting line FPGA module; the image processor includes an AC / DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip, and the core main board includes an FPGA image processing module, an isolated power supply and a video output module; the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module, and the FPGA image processing module is connected to the connecting line FPGA module to transmit the video signal; the video output module includes several video output interfaces; the isolated power supply is used to power the connecting line and the endoscope handle; the controller is connected to the connecting line FPGA module to transmit the control signal.
3. The endoscope system according to claim 2, characterized in that: The key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and the several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.
4. The endoscope system according to claim 3, characterized in that: The FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.
5. The endoscope system according to claim 1 or 4, characterized in that: The endoscope also includes an endoscope handle, which includes an instrument Luer connector, an infusion and suction Luer connector and a multi-lumen tube. A clamp channel tube is provided in the multi-lumen tube, and a clamp channel hole corresponding to the size of the clamp channel tube is provided at one end of the multi-lumen tube; the other end of the multi-lumen tube is respectively connected to the instrument Luer connector and the infusion and suction Luer connector through the clamp channel tube.
6. The endoscope system according to claim 5, characterized in that: The multi-lumen tube is connected with a snake-bone structure, the snake-bone structure is provided with a wire rope hole, a wire rope is passed through the wire rope hole, the wire rope is fixed at the end of the endoscope head, and the snake-bone structure is pulled by the wire rope to drive the end of the endoscope head to bend and swing.
7. The endoscope system according to claim 6, characterized in that: The snake-bone structure is located in the insertion part, the endoscope head end is located at the head end of the insertion part, and the insertion part is composed of a multi-lumen tube integrally formed by an extrusion weaving process.
8. The endoscope system according to claim 1, wherein: The camera lens module includes a lens, an image sensor and a plurality of lighting LEDs.
9. The endoscope system according to claim 8, characterized in that: The camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, including: Setting the exposure time of the rolling shutter sensor; Based on the exposure time, each row of pixels collected by the rolling shutter sensor is exposed, converted into digital-to-analog, and output as data in a fixed preset time difference sequence; The FPGA module in the connecting wire controls the illumination LED on the end of the endoscope head through the connecting wire to illuminate the imaging scene during the time interval from the start of the last row of exposure to the end of the first row of exposure of the rolling shutter sensor.
10. The endoscope system according to claim 9, characterized in that: The camera lens module performs image acquisition according to the global rolling shutter automatic exposure control method, and further includes: During the exposure process of each row of pixels collected by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical collected image, and converts the overall brightness of the historical collected image into the lighting time of the illumination LED at the end of the endoscope head.
Citation Information
Patent Citations
Ultra-high-definition image enhancement system and method of medical endoscope
CN113079361A
Endoscope assembly
CN115916026A
Endoscope device and method for adjusting automatic exposure and realizing global rolling shutter
CN116055889A
Binocular stereoscopic endoscope system based on FPGA
CN204377054U
Electrocision auxiliary system based on FPGA
CN211187504U
