Photoacoustic capsule endoscope and imaging method
The combination of MEMS scanning micromirrors and multi-angle imaging probes solves the problems of large size and single application scenarios in photoacoustic endoscopy systems, achieves high-resolution imaging of multiple types of cavities with high degrees of freedom, and reduces imaging costs and cross-infection risks.
Patent Information
- Application Number
- CN202510002390.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-02
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2045-01-02
AI Technical Summary
The imaging probes in existing photoacoustic endoscopy systems are large in size, have a single application scenario, and have motion artifacts, making it impossible to achieve high-degree-of-freedom imaging of multiple types of cavities.
The MEMS scanning micromirror is combined with a miniaturized internal scanning component and a multi-angle imaging probe. Through optical fiber components, optical path folding components and optical modulation components, the miniaturization and high-resolution imaging of the capsule endoscope are achieved, and the convenient replacement of multi-angle probes is supported.
It achieves high-degree-of-freedom imaging in narrow cavities, obtains distortion-free high-resolution photoacoustic images, supports full-space imaging of multiple types of cavities, and reduces imaging costs and cross-infection risks.
Smart Images

Figure CN119586953B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of medical equipment and methods, and in particular relates to a photoacoustic capsule endoscope and an imaging method. Background Art
[0002] Capsule endoscopy is a clinical endoscopy technology that has gradually emerged in recent years. Unlike traditional endoscopy technology, capsule endoscopes have the characteristics of small size, high freedom of movement, and wide imaging range. Although it is widely used in clinical gastrointestinal endoscopy, it is limited by the characteristics of white light endoscopy and can only observe the surface structure information of the cavity, but cannot obtain deep structure and function information.
[0003] As an emerging non-invasive and non-ionizing imaging technology, photoacoustic imaging can simultaneously achieve high-resolution imaging of deep biological tissues through optical scanning and ultrasonic detection. In order to combine photoacoustic microscopy with capsule endoscopic imaging technology, it is necessary to solve the problem of how to reduce the size of the imaging probe, reduce image misalignment and distortion during movement, and achieve coupling between the probe port and tissue for different types of cavities in the body. To solve the above problems, Ntziachristos of the Technical University of Munich in Germany designed a photoacoustic endoscope with a diameter of 16 mm. By using unfocused light, he reduced the impact of changes in the distance between the imaging port and the tissue on image quality; Guan Baiou of Jinan University developed a photoacoustic endoscope based on a fiber optic ultrasound detector. By miniaturizing the fiber optic ultrasound detector, the diameter of the photoacoustic endoscope was reduced, and its axial hard length was 105 mm. All of the above methods use a fixed light beam and a point-focused ultrasonic transducer. To complete the scanning imaging of the pulsed laser, it is necessary to rotate the entire probe and continuously pull it back mechanically. This inevitably causes a loss of imaging field of view and produces artifacts due to motion, greatly affecting the imaging quality. The fiber-optic ultrasonic detector can only shorten the transverse diameter of the photoacoustic capsule endoscope, but cannot shorten its axial hard length, making it impossible for the photoacoustic capsule endoscope to achieve high-degree-of-freedom imaging inside the cavity, limiting the imaging range and imaging cavity type. At the same time, the use of non-focused light will significantly reduce the imaging resolution, making it impossible to achieve high-sensitivity diagnosis of early diseases.
[0004] The present invention aims to provide a new photoacoustic capsule endoscope and imaging method. The capsule endoscope can reach a diameter of 5 mm and a rigid length of 15 mm, enabling high-degree-of-freedom imaging in narrow cavities. The miniaturized internal scanning component can achieve no relative motion between the imaging probe and the imaged tissue during the imaging process, thereby obtaining full-space high-resolution photoacoustic microscopic images of different types of cavities. Summary of the Invention
[0005] (1) Technical issues to be resolved
[0006] The problems to be solved by the present invention include: existing photoacoustic endoscopy systems generally use external rotation and mechanical pullback driven by a stepper motor to achieve full-space imaging, but since the external rotation motor and mechanical pullback cannot be synchronized with the imaging process, motion artifacts will be caused; the existing technology generally uses an imaging probe, which has only one specific imaging port angle. Since photoacoustic coupling requires the imaging probe port to fit the tissue surface, it is impossible to simultaneously achieve imaging of multiple types of cavities in the body, such as the intestines, uterus and throat; the existing technology is limited by the size of the internal components of the imaging probe and cannot effectively reduce the overall volume of the probe.
[0007] In response to the problems of large imaging probes, single application scenarios, and misalignment and distortion in in vivo imaging in existing photoacoustic endoscopy technology, the present invention provides a photoacoustic capsule endoscope and imaging method that combines fast and high-resolution scanning with a MEMS scanning micromirror, a miniaturized imaging device, conveniently replaceable mounting components, and replaceable multi-angle imaging probes. At the same time, it achieves high-degree-of-freedom full-space imaging of multiple types of cavities, and can obtain distortion-free, high-resolution photoacoustic images.
[0008] (2) Technical solution
[0009] In order to solve the technical problem, the present invention provides a photoacoustic capsule endoscope and an imaging method, and the specific technical solutions are as follows.
[0010] A photoacoustic capsule endoscope comprises a capsule shell, a capsule base, and an optical fiber assembly, an optical path folding assembly, an optical modulation assembly, a miniaturized internal scanning assembly, a port connection assembly, and a multi-angle imaging probe located at the front end, which are arranged in sequence from the rear end to the front end of the capsule shell.
[0011] The optical fiber assembly is located at the rear end of the capsule shell and is used to emit laser light;
[0012] The optical path folding component is located at the front end of the optical fiber component and is used to spatially fold the laser emitted by the optical fiber;
[0013] The optical modulation component is located at the front end of the optical path folding component, and includes a collimating lens and a focusing lens placed in sequence from the rear end to the front end;
[0014] The miniaturized internal scanning component is located at the front end of the optical modulation component, and includes a MEMS scanning micromirror lens and a flexible PCB connected thereto, wherein the MEMS scanning micromirror lens package is connected to the flexible PCB;
[0015] The multi-angle imaging probe assembly is located at the front end of the photoacoustic capsule endoscope and includes a set of detachable and replaceable imaging probes, which can be installed with an oblique imaging probe, a direct imaging probe, or a side-view imaging probe as needed to detect the cavity to be tested;
[0016] The port connection component is located between the miniaturized internal scanning component and the multi-angle imaging probe component, and includes a mechanical fixing component and a magnetic fixing component placed in parallel;
[0017] The capsule base is located at the bottom of the capsule shell and is used to fix various component units inside the capsule shell.
[0018] Preferably, the capsule base fixes the various component units inside the capsule shell in the following manner: the optical fiber is fixed by inserting the annular hollow fixture at the rear end of the capsule base, the optical path folding component is fixed by inserting the conical fitting groove provided in the capsule base, the optical modulation component is fixed by a semicircular slide provided in the capsule base, and the MEMS scanning micromirror is fixed by a groove body and a backing substrate base provided in the capsule base.
[0019] Preferably, the optical path folding component includes three identical aluminum-coated mirrors, the first reflector and the second reflector are connected at a first bonding point at an angle of 135°, the second reflector and the third reflector are connected at a second bonding point at an angle of 45°, and the third reflector is connected to the first reflector at a third bonding point at an angle of 45°. The first reflector and the second reflector are placed in an azimuth relationship of 180° staggered with each other in the xy plane, the second reflector and the third reflector are placed in an azimuth relationship of 180° staggered with each other in the yz plane, and the first reflector and the third reflector are placed in an azimuth relationship of 180° staggered with each other in the xz plane, so that the incident pulse nanosecond laser is reflected by the first reflector and then enters the surface of the second reflector, and then reflected by it and enters the surface of the third reflector, and then is emitted parallel to the y-axis.
[0020] Preferably, the collimating lens of the optical modulation component is an aspheric mirror, the laser incident side is a flat surface, the laser exit side is a convex surface, and its focal plane is located at the optical fiber port; the focusing lens is a plano-convex lens, the laser incident side is a flat surface, the laser exit side is a convex surface, and the collimated nanosecond laser passes through the focusing lens plane and is focused and emitted by the convex surface, with its focus located at the imaging port.
[0021] Preferably, the MEMS scanning micromirror lens of the miniaturized internal scanning component is electrically connected to the flexible PCB by gold wire bonding; a high-transmittance glass sheet is bonded to the first pin and the second pin on the surface of the MEMS scanning micromirror, and the MEMS scanning micromirror is connected to the FR4 epoxy glass fiber board at the end of the flexible PCB by ultraviolet photosensitive adhesive; an analog voltage signal is input into the first pin and the second pin of the MEMS scanning micromirror through the third pin and the fourth pin through the internal circuit of the flexible PCB, so that the analog voltage signal can control the MEMS scanning micromirror lens to perform two-dimensional plane scanning.
[0022] Preferably, the strabismus imaging probe in the multi-angle imaging probe includes: a fourth reflector, a first probe base; a first light-transmitting component, a first light-transmitting anti-sound component, a first patch ultrasonic transducer, and a first light-transmitting and sound-transmitting film; the fourth reflector is located at the rear end of the strabismus imaging probe, with an angle of 30° to the horizontal direction, and is bonded to the square groove of the first probe base; the first light-transmitting component is located at the front end of the fourth reflector, with an angle of 60° to the horizontal direction, and is bonded to the circular groove of the first probe base; the first light-transmitting and sound-transmitting component is located at the front end of the first light-transmitting component, with an angle of 75° to the horizontal direction, and is bonded to the protrusion of the first probe base; the first light-transmitting and sound-transmitting film is bonded to the front end of the strabismus imaging probe; the first patch ultrasonic transducer is located in the square groove of the first probe base; the strabismus imaging probe is connected to the capsule base through the mechanical fixing and magnetic fixing components.
[0023] Preferably, the direct-view imaging probe in the multi-angle imaging probe includes: a fifth reflector, a second probe base; a second light-transmitting component, a second light-transmitting anti-sound component, a second patch ultrasonic transducer, and a second light-transmitting and sound-transmitting film; the fifth reflector is located at the rear end of the direct-view imaging probe, with an angle of 45° to the horizontal direction, and is bonded to the square groove of the second probe base; the second light-transmitting component is located at the front end of the fifth reflector, with an angle of 90° to the horizontal direction, and is bonded to the circular groove of the second probe base; the second light-transmitting and sound-transmitting component is located at the front end of the second light-transmitting component, with an angle of 45° to the horizontal direction, and is bonded to the protrusion of the second probe base; the second light-transmitting and sound-transmitting film is bonded to the front end of the direct-view imaging probe; the second patch ultrasonic transducer is located in the square groove of the second probe base; the direct-view imaging probe is connected to the capsule base through the mechanical fixing and magnetic fixing components.
[0024] Preferably, the side-view imaging probe in the multi-angle imaging probe includes: a sixth reflector, a third probe base; a third light-transmitting component, a seventh reflector, a third light-transmitting anti-sound component, a third patch ultrasonic transducer, and a third light-transmitting and sound-transmitting film; the sixth reflector is located at the rear end of the side-view imaging probe, with an angle of 45° to the horizontal direction, and is bonded to the square groove of the third probe base; the seventh reflector is located at the front end of the sixth reflector, with an angle of 135° to the horizontal direction, and is bonded to the square groove of the third probe base; the third light-transmitting component is located on the side of the seventh reflector, is placed parallel to the horizontal direction, and is bonded to the circular groove of the third probe base; the third light-transmitting and sound-transmitting component is located on the side of the third light-transmitting component, with an angle of 45° to the horizontal direction, and is bonded to the protrusion of the third probe base; the third light-transmitting and sound-transmitting film is bonded to the front end of the side-view imaging probe; the third patch ultrasonic transducer is located in the square groove of the third probe base; and the side-view imaging probe is connected to the capsule base via the mechanical fixing and magnetic fixing components.
[0025] Preferably, the mechanical fixing component in the port connection component includes: a first gasket, a first sealing ring, an inserted cylindrical carrier, a first cylindrical hole, a second sealing ring, a second gasket, a screw, a second cylindrical hole, and an internal thread; the first cylindrical hole is located at the bottom end of the middle part of the multi-angle imaging probe, and a slot is provided at the bottom thereof, and the gasket is inserted into the bottom of the first cylindrical hole and is engaged with the slot; the first sealing ring is placed between the inserted cylindrical carrier and the first cylindrical hole; the second cylindrical hole is located at the bottom end of the outer side of the multi-angle imaging probe, and the inner wall thereof is provided with the internal thread and the bottom is provided with a slot, and the second gasket is placed into the bottom of the second cylindrical hole and its protrusion is engaged with the slot; the second sealing ring is placed between the screw and the second cylindrical hole; the external thread of the screw cooperates with the internal thread and is screwed into the second cylindrical hole; so that the inserted cylindrical carrier is fixed between the second gasket and the side wall of the multi-angle imaging probe.
[0026] Preferably, the magnetic fixing component in the port connection component includes: a first magnet, a second magnet, a third sealing ring, a third cylindrical hole, a fourth cylindrical hole, a third magnet, a fourth magnet, a fourth sealing ring, a fifth cylindrical hole, and a sixth cylindrical hole; the first magnet is embedded in the third cylindrical hole at the inner bottom end of the multi-angle imaging probe, the second magnet is embedded in the fourth cylindrical hole inside the capsule base, and the third sealing ring is placed between the first magnet and the third cylindrical hole; the first magnet is bonded to the third cylindrical hole, and the second magnet is bonded to the fourth cylindrical hole inside the capsule base; the third magnet is embedded in the fifth cylindrical hole at the inner bottom end of the multi-angle imaging probe, the third magnet is embedded in the sixth cylindrical hole inside the capsule base, and the fourth sealing ring is placed between the fourth magnet and the fifth cylindrical hole; the third magnet is bonded to the fifth cylindrical hole; the third magnet is bonded to the fourth cylindrical hole inside the capsule base.
[0027] The present invention also discloses a photoacoustic capsule endoscopy imaging method, which uses the aforementioned photoacoustic capsule endoscopy to obtain endoscopic microscopic images of cavity structures including the human esophagus, stomach, uterus, vagina, and intestines. The specific steps are as follows:
[0028] Step S1, selecting a required multi-angle imaging probe based on the target imaging cavity, and detachably connecting and fixing it to the capsule base;
[0029] Step S2, injecting ultrasonic coupling liquid into the interior of the multi-angle imaging probe through the imaging port, and sealing the multi-angle imaging probe port with a first light-transmitting and sound-transmitting film;
[0030] Step S3, injecting ultrasonic coupling liquid into the cavity to be imaged, and inserting the photoacoustic capsule endoscope into the cavity to be imaged;
[0031] Step S4: The nanosecond pulse laser emits nanosecond pulse laser, and performs a two-dimensional plane scan on the imaging port surface under the control of the MEMS scanning micromirror;
[0032] Step S5, controlling the multi-angle imaging probe to perform translation and three-dimensional rotation in the region of interest, acquiring imaging data of a specific position in the cavity, and reconstructing the image based on the acquired data to achieve high-degree-of-freedom full-space imaging.
[0033] Preferably, in step S1, when the multi-angle imaging probe is disassembled, the screws are first unscrewed, the first magnet and the second magnet are separated, and the third magnet and the fourth magnet are separated, so that the imaging probe can be disassembled; when replacing the imaging probe, the first magnet and the second magnet are first connected, the third magnet and the fourth magnet are connected, and then the screws are tightened to achieve the installation of the imaging probe.
[0034] (3) Beneficial effects
[0035] Compared with the prior art, the present invention has significantly positive technical effects, and its beneficial effects are at least reflected in the following aspects.
[0036] (1) The present invention greatly reduces the overall diameter and hard length of the endoscope by designing the internal structure of the photoacoustic capsule endoscope and innovatively introducing independently designed optical folding components and miniaturized internal scanning components. Photoacoustic endoscopic imaging requires that the imaging port and the imaging area fit tightly together so that the imaging area is within the focal plane of the pulsed laser to obtain a high-resolution image. Therefore, in order to achieve full-space high-resolution imaging in the human body cavity, the imaging port needs to be able to rotate 360° in a relatively narrow cavity. Compared with the existing photoacoustic endoscope with a hard length of more than 30 mm, the present invention finally achieved a diameter of 5 mm and a hard length of 15 mm, realizing high-degree-of-freedom imaging inside a narrow cavity.
[0037] (2) The present invention can simultaneously realize multi-cavity and multi-angle endoscopic imaging by innovatively proposing a multi-angle imaging probe and a conveniently detachable and replaceable port connection method. Compared with the existing technology that only includes an imaging probe of one angle, it is impossible to keep the imaging port and the imaging area in cavities of different diameters and shapes, which greatly affects the resolution and field of view of the image obtained, thereby limiting the application of photoacoustic endoscopes in clinical practice. The present invention uses only one capsule endoscope body, and through the port connection component, it can integrate three imaging probes of different angles. The installation and replacement of the multi-angle imaging probe can be achieved through simple operations, so that it can cover various human cavities at the ports of tubular cavities represented by the digestive tract and rectum, spherical cavities represented by the uterus and stomach, and cervix and throat. In addition, the detachable and replaceable port connection method makes it possible to easily replace the imaging port in clinical applications, prevent cross infection during the diagnosis process, and reduce the cost of use and the consumption of disposable medical resources.
[0038] (3) The present invention proposes a new MEMS scanning micromirror packaging method, which greatly reduces the volume of a single scanning component, so that the internal scanning function can still be realized in a smaller space. Compared with the existing technology that only rotates a fixed focused light externally, since the rotation of the fixed light can only form a scanning line, in order to form a two-dimensional image, it is necessary to cooperate with the mechanical pullback action, which will introduce motion artifacts and image distortion. In the present invention, the MEMS scanning micromirror is driven by an analog voltage signal to perform fast two-dimensional scanning, which can achieve 12 Hz real-time video frame rate imaging, avoiding the process that may cause motion artifacts during the imaging process, thereby greatly improving the image quality of endoscopic microscopic imaging. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 It is a schematic diagram of the overall structure of the photoacoustic capsule endoscope and the direct-view imaging probe, the oblique-view imaging probe and the side-view imaging probe of the present invention.
[0040] Figure 2 Schematic diagram of the internal structure of the photoacoustic capsule endoscope.
[0041] Figure 3 Schematic diagram of the optical path folding component.
[0042] Figure 4 Schematic diagram of MEMS scanning micromirror and its packaging method.
[0043] Figure 5 Schematic diagram of the capsule shell.
[0044] Figure 6 Schematic diagram of the multi-angle imaging probe.
[0045] Figure 7 It is a schematic diagram of the structure of the mechanical fixing component and the magnetic fixing component.
[0046] Figure 8 This is a schematic diagram of the imaging planes corresponding to the direct-view imaging probe, oblique-view imaging probe, and side-view imaging probe in the multi-angle imaging probe.
[0047] The reference numerals and corresponding names in the figure are: 1-1 optical fiber, 1-2 capsule base, 1-3 annular hollow holder, 1-4 optical fiber assembly, 1-5 optical path folding assembly, 1-5-1 first reflector, 1-5-2 second reflector, 1-5-3 third reflector, 1-6 collimating lens, 1-7 focusing lens, 1-8 flexible PCB, 1-9 MEMS scanning micromirror, 1-9-1 third pin, 1-9-2 FR4 epoxy glass fiber board, 1-9-3 fourth pin, 1-9-4 MEMS scanning micromirror lens, 1-9-5 first pin, 1-9-6 second pin, 1-10 capsule shell, 1-10-1 second square trough, 1-10-2 circular trough, 1-10-3 first square trough, 2-1 first magnet, 2-2 second magnet, 2-3 inserted cylindrical carrier, 2-4 third magnet, 2-5 fourth magnet, 2-6 First sealing ring, 2-7 First gasket, 2-8 Third sealing ring, 2-9 Fourth sealing ring, 2-10 Second gasket, 2-11 Second sealing ring, 2-12 Screw, 2-13 Internal thread, 2-14 Second cylindrical hole, 2-15 Fifth cylindrical hole, 2-16 First cylindrical hole, 2-17 Third cylindrical hole, 2-18 Fourth cylindrical hole, 2-19 Sixth cylindrical hole, 3 Oblique imaging probe, 3-1 Fourth reflector, 3-2 First probe base, 3-3 First light-transmitting component, 3-4 First light-transmitting anti-acoustic component, 3-5 First patch ultrasonic transducer, 3-6 First light-transmitting and acoustically transparent membrane, 4 Direct imaging probe, 4-1 Fifth reflector, 4-2 Second probe base, 4-3 Second light-transmitting component, 4-4 Second light-transmitting and acoustically transparent component, 4-5 Second patch ultrasonic transducer, 4-6 Second light-transmitting and acoustically transparent membrane, 5 Side imaging probe, 5-1 Sixth reflector, 5-2 Third probe base, 5-3 Third light-transmitting component, 5-4 Seventh reflector, 5-5 Third light-transmitting and sound-transmitting film, 5-6 Third light-transmitting and sound-reflecting component, 5-7 Third patch ultrasonic transducer, 6-1 Vertical plane, 6-2 Oblique viewing plane, 6-3 Horizontal plane. DETAILED DESCRIPTION
[0048] In order to solve the technical problem, the present invention provides a photoacoustic capsule endoscope and imaging method. The technical solution of the present invention is further described below through specific embodiments in conjunction with the accompanying drawings.
[0049] The present invention proposes a photoacoustic capsule endoscope, specifically, Figure 1-2 As shown, the device includes a capsule base (1-2), an optical fiber component (1-4), an optical path folding component (1-5), an optical modulation component, a miniaturized internal scanning component, a multi-angle imaging probe component, a port connection component, and a capsule shell (1-10).
[0050] like Figure 2 As shown, the capsule base (1-2) fixes the optical fiber component (1-4), the optical path folding component (1-5), the optical modulation component, and the miniaturized internal scanning component in corresponding positions by providing a groove body and a backing.
[0051] like Figure 2 As shown, the optical fiber assembly (1-4) is located in the annular hollow fixture (1-3) and connected to the optical fiber (1-1).
[0052] like Figure 2 As shown, the optical modulation component includes a collimating lens (1-6) and a focusing lens (1-7) placed in sequence from the rear end to the front end.
[0053] like Figure 2 As shown, the miniaturized internal scanning component includes a MEMS scanning micromirror (1-9) and a flexible PCB (1-8) connected thereto.
[0054] like Figure 2 As shown, the port connection component includes a mechanical fixing component and a magnetic fixing component placed in parallel.
[0055] Figure 3-Figure 7 The optical path folding component (1-5), the miniaturized internal scanning component, the capsule shell (1-10), the multi-angle imaging probe and the port connection component are displayed separately.
[0056] like Figure 3 As shown, the optical path folding component (1-5) includes three identical aluminum-coated reflectors. The first reflector (1-5-1) and the second reflector (1-5-2) are connected at a first bonding point (1-5-7) at an angle of 135°, the second reflector (1-5-2) and the third reflector (1-5-3) are connected at a second bonding point (1-5-8) at an angle of 45°, and the third reflector (1-5-3) and the first reflector (1-5-1) are connected at a third bonding point (1-5-6) at an angle of 45°, so that the incident pulsed nanosecond laser (1-5-4) is first reflected by the first reflector (1-5-1), and the reflected light (1-5-5) is then incident on the surface of the second reflector (1-5-2), and after being reflected by the second reflector (1-5-2), enters the third reflector (1-5-3) and is finally emitted parallel to the y-axis direction. The optical path folding component shortens the horizontal length of the optical path without affecting the diameter of the photoacoustic capsule endoscope, thereby shortening the hard length of the photoacoustic capsule endoscope.
[0057] like Figure 4As shown, the MEMS scanning micromirror (1-9) in the miniaturized internal scanning component is electrically connected to the flexible PCB (1-8) by gold wire bonding. A first pin (1-9-5) for controlling the two-dimensional translation of the MEMS scanning micromirror lens (1-9-4) is connected to a third pin (1-9-1) on the flexible PCB (1-8), and a second pin (1-9-6) for controlling the spatial rotation of the MEMS scanning micromirror lens (1-9-4) is connected to a fourth pin (1-9-3) on the flexible PCB (1-8). A high-transmittance glass sheet is bonded to the pin surface of the MEMS scanning micromirror lens (1-9-4), and the MEMS scanning micromirror (1-9) is connected to an FR4 epoxy glass fiber board (1-9-2) at the end of the flexible PCB (1-8) by ultraviolet photosensitive adhesive. A polyimide film is bonded to the inner circuit surface of the flexible PCB (1-8). The analog voltage signal output by external control is input into the control pin of the MEMS scanning micromirror lens (1-9-4) through the line inside the flexible PCB (1-8), thereby controlling it to perform two-dimensional plane scanning.
[0058] like Figure 5 As shown, the capsule shell (1-10) includes a circular slot (1-10-2) embedded in the hollow fixture (1-3), a first square slot (1-10-3) embedded in the flexible PCB (1-8), and a second square slot (1-10-1) embedded in the patch ultrasonic transducer signal line;
[0059] like Figure 6 As shown, the multi-angle imaging probe includes an oblique imaging probe (3), a direct imaging probe (4) and a side imaging probe (5); the oblique imaging probe (3) in the multi-angle imaging probe includes: a fourth reflector (3-1), a first probe base (3-2); a first light-transmitting component (3-3), a first light-transmitting anti-sound component (3-4), a first patch ultrasonic transducer (3-5), and a first light-transmitting and sound-transmitting film (3-6); the direct imaging probe (4) in the multi-angle imaging probe includes: a fifth reflector (4-1) , a second probe base (4-2); a second light-transmitting component (4-3), a second light-transmitting anti-sound component (4-4), a second patch ultrasonic transducer (4-5), and a second light-transmitting and sound-transmitting film (4-6); the side-view imaging probe (5) in the multi-angle imaging probe comprises: a sixth reflector (5-1), a third probe base (5-2); a third light-transmitting component (5-3), a seventh reflector (5-4), a third light-transmitting and sound-transmitting component (5-6), a third patch ultrasonic transducer (5-7), and a third light-transmitting and sound-transmitting film (5-5).
[0060] Photoacoustic capsule endoscopic imaging is achieved in the following way.
[0061] like Figure 2As shown, the nanosecond pulse laser emitted by the optical fiber (1-1) passes through the optical fiber component (1-4) and enters the optical path folding component (1-5) to perform three-dimensional optical path folding. After being optically modulated by the collimating lens (1-6) and the focusing lens (1-7), it is emitted into the MEMS scanning micromirror (1-9) and enters the interior of the multi-angle imaging probe after being reflected by the MEMS scanning micromirror. The analog voltage signal is input into the MEMS scanning micromirror (1-9) controller through the flexible PCB (1-8) to perform two-dimensional plane scanning.
[0062] like Figure 6 As shown, in the squint imaging probe (3) in the multi-angle imaging probe, the focused light controlled by the MEMS scanning micromirror (1-9) is reflected by the fourth reflector (3-1) placed at an angle of 60° to the horizontal direction, enters the ultrasonic coupling liquid inside the squint imaging probe (3) through the first light-transmitting component (3-3) perpendicular to the main optical axis of the reflected light, and then passes through the first light-transmitting anti-sound component (3-4) at an angle of 75° to the horizontal direction to reach the straight imaging port for two-dimensional plane scanning. The ultrasonic wave generated by the interaction between the nanosecond pulse laser and the biological tissue passes through the first light-transmitting and anti-sounding film (3-6) and is reflected by the first light-transmitting and anti-sounding component (3-4) and then propagates vertically to the surface of the first patch ultrasonic transducer (3-5) inside the squint imaging probe (3). The ultrasonic signal is stored in a computer after being amplified and filtered, and the photoacoustic image of the imaging area is obtained by image reconstruction.
[0063] like Figure 6 As shown, in the direct-view imaging probe (4) in the multi-angle imaging probe, the focused light controlled by the MEMS scanning micromirror (1-9) is reflected by the fifth reflector (4-1) placed at an angle of 45° to the horizontal direction, enters the ultrasonic coupling liquid inside the direct-view imaging probe (4) through the second light-transmitting component (4-3) perpendicular to the main optical axis of the reflected light, and then passes through the second light-transmitting anti-sound component (4-4) at an angle of 90° to the horizontal direction to reach the straight imaging port for two-dimensional plane scanning. The ultrasonic wave generated by the interaction between the nanosecond pulse laser and the biological tissue passes through the second light-transmitting anti-sound component (4-6) and is reflected by the second light-transmitting anti-sound component (4-4) and then propagates vertically to the surface of the second patch ultrasonic transducer (4-5) inside the direct-view imaging probe (4). The ultrasonic signal is stored in a computer after being amplified and filtered, and a photoacoustic image of the imaging area is obtained by image reconstruction.
[0064] like Figure 6As shown, the side-view imaging probe (5) in the multi-angle imaging probe is controlled by the MEMS scanning micromirror (1-9), which reflects the focused light from the sixth reflector (5-1) placed at an angle of 45° to the horizontal direction, and then reflects the seventh reflector (5-4) placed at an angle of 135° to the horizontal direction, and enters the ultrasonic coupling liquid inside the side-view imaging probe (5) through the third light-transmitting component (5-3) perpendicular to the main optical axis of the reflected light, and then passes through the third light-transmitting anti-sound component (5-6) at an angle of 45° to the horizontal direction to reach the straight imaging port for two-dimensional plane scanning. The ultrasonic wave generated by the interaction between the nanosecond pulse laser and the biological tissue passes through the third light-transmitting anti-sound component (5-6) and is reflected by the third light-transmitting anti-sound component (5-6) and then propagates vertically to the surface of the third patch ultrasonic transducer (5-7) inside the side-view imaging probe (5). The ultrasonic signal is stored in a computer after amplification and filtering, and the photoacoustic image of the imaging area is obtained by image reconstruction.
[0065] The multi-angle imaging probe is installed as follows.
[0066] like Figure 7 As shown, the selected imaging port is connected to the capsule base (1-2) through a port connection assembly, the first magnet (2-1) and the second magnet (2-2) are respectively bonded to the third cylindrical hole (2-17) and the fourth cylindrical hole (2-18), and the third sealing ring (2-8) is embedded in the inner wall of the third cylindrical hole (2-17); the third magnet (2-4) and the fourth magnet (2-5) are respectively bonded to the fifth cylindrical hole (2-15) and the sixth cylindrical hole (2-19), and the fourth sealing ring (2-9) is embedded in the inner wall of the fifth cylindrical hole (2-15); the first gasket (2-7) is placed at the bottom of the first cylindrical hole (2-16) The first sealing ring (2-6) is placed on the inner wall of the first cylindrical hole (2-16), and the inserted cylindrical carrier (2-3) is inserted into the first cylindrical hole; the second gasket is placed on the bottom of the second cylindrical hole (2-14), and its protruding portion is engaged with the card slot, and the second sealing ring (2-11) is placed on the inner wall of the second cylindrical hole (2-14), and the screw (2-12) is matched with the internal thread (2-13), and the screw (2-12) is screwed into the second cylindrical hole (2-14), and the mechanical fixing component and the magnetic fixing component work together to achieve complete connection and fixation between the multi-angle imaging probe and the capsule base (1-2).
[0067] like Figure 7As shown, the multi-angle imaging probe can be disassembled in the following manner: first, the screw (2-12) is unscrewed, the first magnet (2-1) and the second magnet (2-2) are separated, and the third magnet (2-4) and the fourth magnet (2-5) are separated, and the imaging probe can be disassembled.
[0068] The oblique imaging probe 3 , the direct imaging probe 4 and the side imaging probe 5 in the multi-angle imaging probe correspond to imaging surfaces at different angles.
[0069] like Figure 8 As shown in (a), the direct-view imaging probe 4 corresponds to the imaging area corresponding to the horizontal plane (6-3), and the imaging port can be fitted with the imaging surface; the nanosecond pulse laser emitted by the direct-view imaging probe (4) is focused on the horizontal plane (6-3), and two-dimensional plane scanning is performed through the miniaturized internal scanning component.
[0070] like Figure 8 As shown in (b), the oblique imaging probe 3 corresponds to the imaging area corresponding to the oblique plane (6-2). Figure 8 As shown in (b), ϴ1 is 30°, and the imaging port can be aligned with the imaging surface; the nanosecond pulse laser emitted by the oblique imaging probe (3) is focused on the oblique plane (6-2), and two-dimensional plane scanning is performed through the miniaturized internal scanning component.
[0071] like Figure 8 As shown in (c), the side-view imaging probe 5 corresponds to the imaging area corresponding to the vertical plane (6-1). Figure 8 The angle ϴ2 shown in (c) is 90°, and the imaging port can be aligned with the imaging surface; the nanosecond pulse laser emitted by the side-view imaging probe (5) is focused on the vertical plane (6-1), and two-dimensional plane scanning is performed through the miniaturized internal scanning component.
[0072] The specific implementation examples described in this application are merely illustrative of the main concepts of the present invention. Persons skilled in the art may make various modifications, additions, or substitutions to the described specific embodiments without departing from the spirit of the present invention or exceeding the scope defined by the appended claims.
Claims
1. A photoacoustic capsule endoscope, characterized in that: The invention comprises a capsule shell (1-10), a capsule base (1-2), and an optical fiber assembly (1-4), an optical path folding assembly (1-5), an optical modulation assembly, a miniaturized internal scanning assembly, a port connection assembly, and a multi-angle imaging probe assembly located at the front end, which are arranged in sequence from the rear end to the front end inside the capsule shell; The optical fiber assembly (1-4) is located at the rear end of the capsule shell and is used to emit laser light; The optical path folding component (1-5) is located at the front end of the optical fiber component and is used to spatially fold the laser light emitted from the optical fiber; The optical modulation component is located at the front end of the light path folding component, and includes a collimating lens (1-6) and a focusing lens (1-7) placed in sequence from the rear end to the front end; The miniaturized internal scanning component is located at the front end of the optical modulation component, and comprises a MEMS scanning micromirror lens (1-9-4) and a flexible PCB (1-8) connected thereto, wherein the MEMS scanning micromirror lens (1-9-4) is packaged and connected to the flexible PCB (1-8); The multi-angle imaging probe assembly is located at the front end of the photoacoustic capsule endoscope and includes a set of detachable and replaceable imaging probes, which can be installed with an oblique imaging probe (3), a direct imaging probe (4) or a side-view imaging probe (5) as needed to detect the cavity to be tested; the oblique imaging probe (3) includes a first light-transmitting and sound-transmitting film (3-6); The port connection component is located between the miniaturized internal scanning component and the multi-angle imaging probe component, and includes a mechanical fixing component and a magnetic fixing component placed in parallel; the mechanical fixing component includes a screw (2-12), and the magnetic fixing component includes a first magnet (2-1), a second magnet (2-2), a third magnet (2-4), and a fourth magnet (2-5); The capsule base (1-2) is located at the bottom of the capsule shell and is used to fix various component units inside the capsule shell.
2. The photoacoustic capsule endoscope according to claim 1, characterized in that: The capsule base (1-2) fixes the various component units inside the capsule shell in the following manner: the optical fiber (1-1) is fixed by being inserted into a ring-shaped hollow fixer (1-3) at the rear end of the capsule base (1-2); the optical path folding component (1-5) is fixed by being inserted into a conical fitting groove provided on the capsule base (1-2); the optical modulation component is fixed by being provided on a semicircular slideway provided on the capsule base (1-2); and the MEMS scanning micromirror (1-9) is fixed by being provided on a groove body and a backing substrate base provided on the capsule base (1-2).
3. The photoacoustic capsule endoscope according to claim 1, characterized in that: The optical path folding component (1-5) includes three identical aluminum-coated reflectors, wherein the first reflector (1-5-1) and the second reflector (1-5-2) are connected at a first bonding point (1-5-7) at an angle of 135°, the second reflector (1-5-2) and the third reflector (1-5-3) are connected at a second bonding point (1-5-8) at an angle of 45°, the third reflector (1-5-3) and the first reflector (1-5-1) are connected at a third bonding point (1-5-6) at an angle of 45°, and the first reflector (1-5-1) and the second reflector (1-5-2) are connected at a first bonding point (1-5-7) at an angle of 135°. The second reflector (1-5-2) and the third reflector (1-5-3) are placed in an azimuth relationship of 180° to each other in the xy plane, the second reflector (1-5-2) and the third reflector (1-5-3) are placed in an azimuth relationship of 180° to each other in the yz plane, and the first reflector (1-5-1) and the third reflector (1-5-3) are placed in an azimuth relationship of 180° to each other in the xz plane, so that the incident pulse nanosecond laser (1-5-4) is reflected by the first reflector (1-5-1) and then enters the surface of the second reflector (1-5-2), and then enters the surface of the third reflector (1-5-3) after being reflected by it, and then is emitted parallel to the y axis.
4. The photoacoustic capsule endoscope according to claim 1, characterized in that: The collimating lens (1-6) of the optical modulation component enables the laser to be collimated and emitted, and the focusing lens (1-7) enables the collimated laser to be focused at the imaging port.
5. The photoacoustic capsule endoscope according to claim 1, characterized in that: The MEMS scanning micromirror lens (1-9-4) of the miniaturized internal scanning component is electrically connected to the flexible PCB (1-8) by means of gold wire bonding; a high-transmittance glass sheet is bonded to the surface of the MEMS scanning micromirror (1-9), and the MEMS scanning micromirror (1-9) is bonded to an FR4 epoxy glass fiber board (1-9-2); an analog voltage signal is used to control the MEMS scanning micromirror lens (1-9-4) to perform two-dimensional plane scanning through internal circuits of the flexible PCB (1-8).
6. The photoacoustic capsule endoscope according to claim 1, characterized in that: The strabismus imaging probe (3) in the multi-angle imaging probe assembly comprises: a fourth reflector (3-1), a first probe base (3-2); a first light-transmitting component (3-3), a first light-transmitting anti-sound component (3-4), a first patch ultrasonic transducer (3-5), and a first light-transmitting and sound-transmitting film (3-6); the fourth reflector (3-1) is located at the rear end of the strabismus imaging probe (3), with an angle of 30° to the horizontal direction, and is bonded to the square groove of the first probe base (3-2); the first light-transmitting component (3-3) is located at the front end of the fourth reflector (3-1), with an angle of 30° to the horizontal direction. 60°, bonded in the circular groove of the first probe base (3-2); the first light-transmitting and sound-reflecting component (3-4) is located at the front end of the first light-transmitting component (3-3), with an angle of 75° with the horizontal direction, and bonded to the protrusion of the first probe base (3-2); the first light-transmitting and sound-transmitting film (3-6) is bonded to the front end of the strabismus imaging probe (3); the first patch ultrasonic transducer (3-5) is located in the square groove of the first probe base (3-2); the strabismus imaging probe (3) is connected to the capsule base (1-2) through the mechanical fixing and magnetic fixing components.
7. The photoacoustic capsule endoscope according to claim 1, characterized in that: The direct-view imaging probe (4) in the multi-angle imaging probe assembly comprises: a fifth reflector (4-1), a second probe base (4-2); a second light-transmitting component (4-3), a second light-transmitting anti-sound component (4-4), a second patch ultrasonic transducer (4-5), and a second light-transmitting and sound-transmitting film (4-6); the fifth reflector (4-1) is located at the rear end of the direct-view imaging probe (4), with an angle of 45° to the horizontal direction, and is bonded to the square groove of the second probe base (4-2); the second light-transmitting component (4-3) is located at the front end of the fifth reflector (4-1), with an angle of The second light-transmitting and sound-reflecting component (4-4) is located at the front end of the second light-transmitting component (4-3), with an angle of 45° with the horizontal direction, and is bonded to the protrusion of the second probe base (4-2); the second light-transmitting and sound-transmitting film (4-6) is bonded to the front end of the direct-view imaging probe (4); the second patch ultrasonic transducer (4-5) is located in the square groove of the second probe base (4-2); the direct-view imaging probe (4) is connected to the capsule base (1-2) through the mechanical fixing and magnetic fixing components.
8. The photoacoustic capsule endoscope according to claim 1, characterized in that: The side-view imaging probe (5) in the multi-angle imaging probe assembly comprises: a sixth reflector (5-1), a third probe base (5-2); a third light-transmitting component (5-3), a seventh reflector (5-4), a third light-transmitting anti-sound component (5-6), a third patch ultrasonic transducer (5-7), and a third light-transmitting and sound-transmitting film (5-5); the sixth reflector (5-1) is located at the rear end of the side-view imaging probe (5), with an angle of 45° to the horizontal direction, and is bonded into a square groove of the third probe base (5-2); the seventh reflector (5-4) is located at the front end of the sixth reflector (5-1), with an angle of 135° to the horizontal direction, and is bonded into the square groove of the third probe base (5-2). The third light-transmitting component (5-3) is located on the side of the seventh reflector (5-4), is placed parallel to the horizontal direction, and is bonded to the circular groove of the third probe base (5-2); the third light-transmitting and anti-sound component (5-6) is located on the side of the third light-transmitting component (5-3), is at an angle of 45° to the horizontal direction, and is bonded to the protrusion of the third probe base (5-2); the third light-transmitting and sound-transmitting film (5-5) is bonded to the front end of the side-view imaging probe (5); the third patch ultrasonic transducer (5-7) is located in the square groove of the third probe base (5-2); the side-view imaging probe (5) is connected to the capsule base (1-2) through the mechanical fixing and magnetic fixing components.
9. The photoacoustic capsule endoscope according to claim 1, characterized in that: The mechanical fixing component in the port connection component includes: a first gasket (2-7), a first sealing ring (2-6), an inserted cylindrical carrier (2-3), a first cylindrical hole (2-16), a second sealing ring (2-11), a second gasket (2-10), a screw (2-12), a second cylindrical hole (2-14), and an internal thread (2-13); the first cylindrical hole (2-16) is located at the bottom end of the middle part of the multi-angle imaging probe component, and a card slot is provided at the bottom thereof; the first gasket (2-7) is inserted into the bottom of the first cylindrical hole (2-16) and is engaged with the card slot; the first sealing ring (2-6) is placed between the inserted cylindrical carrier (2-3) and the first cylindrical hole (2-16); the second cylindrical hole (2-14) is provided at the bottom end of the outer side of the multi-angle imaging probe component, and the inner wall thereof is provided with the internal thread (2-13), and the bottom is provided with a card slot. The second gasket (2-10) is inserted into the bottom of the second cylindrical hole (2-14), and its protruding portion is engaged with the slot; the second sealing ring (2-11) is placed between the screw (2-12) and the second cylindrical hole (2-14); the external thread of the screw (2-12) cooperates with the internal thread (2-13) and is screwed into the second cylindrical hole (2-14); so that the inserted cylindrical carrier (2-3) is fixed between the second gasket (2-10) and the side wall of the multi-angle imaging probe assembly.
10. The photoacoustic capsule endoscope according to claim 1, characterized in that: The magnetic fixing component in the port connection component comprises: a first magnet (2-1), a second magnet (2-2), a third sealing ring (2-8), a third cylindrical hole (2-17), a fourth cylindrical hole (2-18), a third magnet (2-4), a fourth magnet (2-5), a fourth sealing ring (2-9), a fifth cylindrical hole (2-15), and a sixth cylindrical hole (2-19); the first magnet (2-1) is embedded in the third cylindrical hole (2-17) at the bottom end of the inner side of the multi-angle imaging probe component, the second magnet (2-2) is embedded in the fourth cylindrical hole (2-18) on the inner side of the capsule base (1-2), and the third sealing ring (2-8) is placed between the first magnet (2-1) and the third cylindrical hole (2-17 ... third A magnet (2-1) is bonded to the third cylindrical hole (2-17), and the second magnet (2-2) is bonded to the fourth cylindrical hole (2-18) inside the capsule base (1-2); the third magnet (2-4) is embedded in the fifth cylindrical hole (2-15) at the bottom end of the inner side of the multi-angle imaging probe assembly, and the third magnet (2-4) is embedded in the sixth cylindrical hole (2-19) inside the capsule base (1-2); the fourth sealing ring (2-9) is placed between the fourth magnet (2-5) and the fifth cylindrical hole (2-15); the third magnet (2-4) is bonded to the fifth cylindrical hole (2-15); and the third magnet (2-4) is bonded to the fourth cylindrical hole (2-18) inside the capsule base (1-2).
11. A photoacoustic capsule endoscopy imaging method, characterized in that: The endoscopic microscopic image of the cavity structure including the human esophagus, stomach, uterus, vagina, and intestine is obtained by using the photoacoustic capsule endoscope according to any one of claims 1 to 10, and the specific steps are as follows: Step S1, selecting a required multi-angle imaging probe assembly based on the target imaging cavity, and detachably connecting and fixing it to the capsule base (1-2); Step S2, injecting ultrasonic coupling liquid into the interior of the multi-angle imaging probe assembly through the imaging port, and sealing the port of the multi-angle imaging probe assembly with a first light-transmitting and sound-transmitting film (3-6); Step S3, injecting ultrasonic coupling liquid into the cavity to be imaged, and inserting the photoacoustic capsule endoscope into the cavity to be imaged; Step S4, the nanosecond pulse laser emits nanosecond pulse laser, and performs a two-dimensional plane scan on the imaging port surface under the control of the MEMS scanning micromirror (1-9); Step S5, controlling the multi-angle imaging probe assembly to translate and rotate three-dimensionally in the region of interest, acquiring imaging data of a specific position in the cavity, and reconstructing the image based on the acquired data to achieve high-degree-of-freedom full-space imaging.
12. The photoacoustic capsule endoscopy imaging method according to claim 11, characterized in that: In step S1, when the multi-angle imaging probe assembly is disassembled, the screw (2-12) is first unscrewed, the first magnet (2-1) and the second magnet (2-2) are separated, and the third magnet (2-4) and the fourth magnet (2-5) are separated, so that the imaging probe can be disassembled; when the imaging probe is replaced, the first magnet (2-1) and the second magnet (2-2) are first connected, the third magnet (2-4) and the fourth magnet (2-5) are connected, and then the screw (2-12) is first tightened, so that the imaging probe can be installed.
Citation Information
Patent Citations
Optical ultrasonic capsule endoscope and imaging method
CN113951802A
Endoscopic microscopic imaging system and method based on full-angle internal scanning mechanism
CN118177691A