A colon endoscope with panoramic camera function and image processing method
By designing panoramic imaging functions and image processing methods in colon endoscopy, the problem of narrow viewing angle is solved, 360° image acquisition and image correction are achieved, detection efficiency and image quality are improved, and operation complexity and medical risks are reduced.
Patent Information
- Application Number
- CN202310507879.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-08
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2043-05-08
AI Technical Summary
The existing colon endoscopy has a problem of narrow perspective, which leads to complex operation, large differences in detection efficiency, long examination time, and high dependence on physician level, increasing potential medical risks.
Design a colon endoscope with panoramic camera function, realize 360° image acquisition through two image modules, use lens collar and motor-driven diaphragm adjustment, combine multiple light sources and heat dissipation cavity to enhance image clarity and stability and correct and match through image processing methods.
A panoramic image acquisition of 360° in the colon is achieved, which reduces operational complexity, improves detection efficiency and image quality, reduces physician dependence and examination time, and enhances patient comfort and safety.
Smart Images

Figure CN116687331B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of medical devices, and in particular is a colon endoscope with panoramic camera function and an image processing method. Background Art
[0002] The environment inside the colon is relatively complex, with a large number of mucosal folds, colonic bags and other structures, and there are many physiological visual blind spots. It is easy to create blind spots through a single-view lens. In order to observe the colon mucosa as completely as possible, doctors need to constantly adjust the posture of the colonoscope end, adjust the observation angle, and even use the mirror body to push the intestinal wall for observation. This method improves the lesion detection rate. On the one hand, it is highly dependent on the personal level of the operating physician, increases the difficulty of physician training, and has large differences in detection efficiency. On the other hand, it greatly increases the complexity and difficulty of operating the colonoscope, prolongs the operation time, reduces the comfort of the examination and the patient's compliance, and also brings potential medical risks due to this long-term invasive examination.
[0003] At present, two types of equipment are mainly used for colon examination in clinical practice, one is a conventional colon endoscope and the other is a capsule endoscope. Conventional colon endoscopes invade the human colon through the anus to perform colorectal examinations, and detect colon mucosal lesions by withdrawing the endoscope and observing at the same time. In the prior art, wide-angle cameras with large viewing angles are symmetrically arranged at the end and side of the colon lens. Only by using three wide-angle cameras can a 360° observation of the colon be achieved. It has the problem of narrow viewing angle, and subsequently three cameras are required to collect images and then process the images, which makes the operation complicated and cumbersome, and it is not convenient to adjust the light receiving condition of the camera, so that blood vessels and other objects are more obviously collected. Summary of the invention
[0004] In order to solve the problem of narrow viewing angle in colonoscopy in the above-mentioned prior art, the purpose of the present invention is to provide a colon endoscope with panoramic camera function and an image processing method, which can realize 360° image acquisition in the colon through two image modules.
[0005] In order to achieve the above-mentioned object, the technical solution of the present invention is as follows: A colon endoscope with panoramic camera function, comprising a lens body, a first image module and a second image module are symmetrically arranged on both sides of the lens body, a third image module, an illumination light source, an instrument channel and two symmetrical functional channels are arranged on the end face of the lens body, and the third image module is located at the center of the functional channel;
[0006] The first image module, the second image module and the third image module all include a lens ring, the lens ring is located in the lens body, and the lens ring is provided with a first negative lens, a second negative lens, a first positive lens, an aperture, a second lens, a second positive lens, a third negative lens, a third lens, a filter, a protective plate, a sensor and an image plane in sequence from the object side to the image side; the sensor and the image plane signal are connected with a controller;
[0007] The object side surface of the first negative lens is convex, and the image side surface is a concave mirror; the second negative lens is a double concave structure; the object side surface of the first positive lens is convex, and the image side surface is concave; the object side surface of the second lens is concave, and the image side surface is convex; both sides of the second positive lens are convex; the object side surface of the third negative lens is concave, and the image side surface is convex; the paraxial side of the object side surface of the third lens is convex, and the paraxial side of the image side surface is concave;
[0008] The lens ring includes a first ring, an adjustment ring and a second ring, which are arranged in sequence from the object side to the image side, and the two sides of the adjustment ring are rotatably connected to the first ring and the second ring respectively, a plurality of tooth blocks are arranged on the outer side of the adjustment ring, and the adjustment ring is symmetrically provided with arc grooves, and the diaphragm is symmetrically provided with sliders, which are respectively located in the arc grooves, and the diaphragm is slidably matched with the sliders and the arc grooves;
[0009] A protective body is fixedly connected to one side of the lens ring, a first motor is arranged in the protective body, the first motor is connected to the controller signal, an output shaft of the first motor is fixedly connected to a rotating shaft, a gear is fixedly connected to the rotating shaft, and the gear is meshed with a gear block.
[0010] The principle of the basic scheme is: when the first image module and the second image module are collecting images, the light will first pass through the first negative lens, and because the object side surface of the first negative lens is a convex surface and the image side surface is a concave mirror, the light will be diverged and its angle will become larger after passing through the first negative lens, and then the light will pass through the second negative lens and the first positive lens. The second negative lens and the first positive lens can play a certain role in astigmatism after being combined, and then the light will be diverged. The diverged light will be refracted to the second lens through the aperture. The second lens will converge the light, and then the angle of the light after passing through the second lens will become smaller. Then the light will pass through the second positive lens and the third negative lens. The second positive lens and the third negative lens will play a certain role in focusing. The converged light will pass through the third lens and refract to the filter. The filter will filter the refracted light to a certain extent, and then the filtered light will be refracted to the sensor and the image plane through the protective plate, thereby realizing imaging; wherein the imaging can be made clearer by diverging the light and converging it to a certain extent.
[0011] Start the first motor. Then, driven by the first motor, the rotating shaft performs a rotational motion. Consequently, the gear will follow and perform a rotational motion. Since the gear meshes with the tooth block, the gear will drive the adjusting ring to perform a rotational motion after rotation. And because the diaphragm slides and fits in the arc-shaped groove through the slider, when the adjusting ring rotates, the slider will be driven to slide in the arc-shaped groove, thereby driving the diaphragm to perform a horizontal distance transformation inside the adjusting ring, and thus the focal length adjustment of the diaphragm can be achieved.
[0012] The beneficial effect of the basic solution is that the diaphragm has the function of controlling light collection and imaging. As the distance of the diaphragm changes, the number and angle of the light beams entering the lens can be changed, thereby affecting the performance of the image in terms of brightness, contrast, clarity, etc. Driving the diaphragm to perform a horizontal distance transformation inside the adjusting ring, the focal length adjustment of the diaphragm can be achieved, so that the position of the diaphragm is adjusted to a suitable position and the image information in the colon can be collected more fully.
[0013] Further, four light sources are circumferentially arranged on both the first image module and the second image module. The four light sources are a white light source, a blue light source, a white light source, and a green light source respectively.
[0014] The beneficial effect of the basic solution is that the white light can provide light sources for the first image module and the second image module, thereby making the images collected by the first image module and the second image module clearer and brighter. The range of the green light wavelength is between approximately 495 and 570 nanometers, generating a high contrast with the red hemoglobin in the blood and being able to reflect blood vessels more clearly. At the same time, due to the short wavelength of the blue light, it can enhance the blood vessel contrast and can better penetrate the tissue surface layer and be absorbed by the dyes in the tissue, making the images displayed by the endoscope clearer and brighter.
[0015] Further, two flow channels are respectively connected to both sides of the two functional channels. The ends of the flow channels far from the functional channels are both connected to a heat dissipation cavity, and the heat dissipation cavities are respectively arranged at the four light sources.
[0016] The beneficial effect of the basic solution is that because the functional channel is connected to the flow channel, the water injected into the functional channel will also flow to the flow channel accordingly. Thus, a certain amount of water will be injected into the heat dissipation cavity, which can play a role in dissipating heat from the light source, reducing the heat emitted by the light source during long-term operation, which affects the refraction of light by the first image module and the second image module, and further affecting the subsequent collected images.
[0017] Further, function cavities are provided at the positions where the lens body is close to the first image module and the second image module. Support rods are provided in the function cavities. The support rods are fixedly connected to the bottom of the second ring, and one end of the support rod far from the second ring is fixedly connected to a "C"-shaped swing frame;
[0018] A second motor is also provided in the functional cavity, and the output shaft of the second motor is coaxially fixedly connected with a guide shaft, the guide shaft is connected to the bottom end of the swing frame, a rotating hole is provided on the top rod of the swing frame, the swing frame is rotatably matched with a fixed rod through the rotating hole, one end of the fixed rod is located in the rotating hole, and the other end of the fixed rod is fixedly connected to the top wall of the functional cavity, and the second motor is connected to the controller signal.
[0019] The beneficial effect of the basic scheme is: the second motor is started through the controller, and then the guide shaft rotates accordingly, so that the swing frame swings accordingly, because the swing frame is fixedly connected to the support rod and the support rod is fixedly connected to the bottom of the second ring, the first image module and the second image module will swing accordingly, and because the swing frame and the fixed rod rotate in coordination, the fixed rod will not affect the swing of the image module on the one hand, and on the other hand, the fixed rod will provide it with a certain supporting force, thereby making the image module operate stably.
[0020] Furthermore, by swinging the first image module and the second image module, the overlapping range of the images captured by the first image module and the second image module can be increased, so that in the subsequent process of collecting the image information, the required image information can be more fully captured, and the internal environment of the colon can be more fully displayed.
[0021] Furthermore, the first negative lens and the second lens are both made of glass.
[0022] The benefits of the basic solution are: compared to plastic lenses, glass materials have a lower coefficient of thermal expansion than most plastics, and glass lenses expand or contract less under the same temperature change; plastic materials generally have higher thermal conductivity and expansion coefficients, which means that when they are subject to temperature changes, they absorb and release heat faster and produce larger volume expansion or contraction accordingly. Therefore, lenses made of glass are less affected by temperature.
[0023] Furthermore, an image processing method of a colon endoscope with a panoramic camera function comprises the following steps:
[0024] Step 1: Use the second motor to drive the first image module and the second image module to swing left and right and combine with the third image module to collect 360° video of the surroundings;
[0025] Step 2, exploring the imaging rules of the first image module, the second image module and the third image module obtained by acquisition, and calculating the distortion coefficient matrix;
[0026] Step 3, correcting the images of the first image module, the second image module and the third image module, and performing extreme correction on the corrected images;
[0027] Step 4: Use a segmentation-based fast stereo matching algorithm to complete the matching of the planar images to synthesize the image.
[0028] Furthermore, in step 2, the calculation process of the distortion coefficient matrix is:
[0029] First, the imaging model formula is:
[0030] ω=K[r′,r ′2 ,r ′3 ,r ′4 ,r ′5 ] T (1)
[0031] θ=J[θ′,θ ′2 ,θ ′3 ,θ ′4 ,θ ′5 ] T (2)
[0032] In the formula, K and J represent the radial distortion coefficient matrix and the tangential distortion coefficient matrix respectively, r is the radial distance, and θ is the tangential offset angle;
[0033] The virtual imaging distance ι is the premise of calibrating the distortion matrix, but ι cannot be measured directly. The value of ι is derived using geometric relationships. Therefore, the least squares fitting method of the image edge is used to calibrate the center. The center of the circle is the image center, and the image circle radius is obtained. According to the geometric relationship of similar triangles, the formula is:
[0034]
[0035] Then the distortion coefficient is fitted. Since K is the fifth-order radial distortion coefficient matrix, the formula is expanded to obtain:
[0036] ω=K1r′+K2r ′2 +K3r ′3 +K4r ′4 +K5r ′5 (4)
[0037] Where r′ is the radial distance from the projection point on the imaging plane to the optical center, as shown in the following expression:
[0038]
[0039] (u, v) is the projection point on the imaging surface, (u0, v0) is the calibrated optical center coordinates,
[0040] Then the tangential offset angle can be fitted by equation (2), and the equation (6) can be obtained by expanding it. The equation (6) is:
[0041] θ=j1θ′+j2θ ′2 +j3θ ′3+j4θ ′4 +j5θ ′5 (6)
[0042]
[0043] The polar coordinates of the image plane are periodic. When θ′=2π, θ=2π, so j5 is calculated through other parameters and can be expressed as follows:
[0044] j5=(1-j1-2πj2-4π 2 j3-8π 3 j4) / 16π 4 (8)
[0045] Among them, r′ and θ′ are calculated by the pixel points of the image through equations (5) and (7). The value of ω can be known from r′, and the value of θ has been set in the target. The distortion coefficients K and J are thus fitted. According to the imaging models (1) and (2), the position of the object point in the space corresponding to any image point in the image can be calculated.
[0046] Furthermore, in step 3, the correction formula is used to obtain the corrected image pixel point (x, y) and the image pixel point (u p , v p ), the correction formula is:
[0047]
[0048] Where, (i0, v0) is the position of the optical center of the image, and (x0, y0) is the image center of the corrected image;
[0049] The image is then subjected to extreme correction.
[0050] The beneficial effects of the basic scheme are: 1. Because the first image module and the second image module have a large field of view, they will also bring a strong distortion effect. By correcting the image, this distortion can be eliminated to obtain a more realistic and natural image effect; and the corrected image can make the image details clearer and more accurately reflect the shape and characteristics of the object being photographed. In subsequent applications, such as artificial intelligence, computer vision and other fields, such data quality is easier to identify, analyze and process; the corrected image is usually regular and easy to digitize. For example, in the fields of three-dimensional reconstruction and panoramic production, the corrected image is easier to be spliced or fused with other images; thereby correcting the captured image can improve the quality of the data and the convenience of processing, making the application field of the image more extensive.
[0051] 2. At the same time, by using the fast stereo matching algorithm, the image can be segmented, the search range can be narrowed and matching can be performed in a smaller area, thereby improving the matching efficiency and speed; and the fast stereo matching algorithm based on segmentation can use feature information such as edges and textures in the image for matching, without the need for a time-consuming and computationally resource-intensive global search of the entire image; at the same time, the fast stereo matching algorithm based on segmentation has strong adaptability, can effectively match different types of images in different scenarios, and can be optimized and improved for different goals. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1 It is an axonometric diagram of a colon endoscope with a panoramic imaging function in an embodiment of the present invention.
[0053] Figure 2 Schematic diagram of the structural decomposition of the first image module of the colon endoscope with panoramic camera function in an embodiment of the present invention.
[0054] Figure 3 for Figure 1 Top view of the lens collar in .
[0055] Figure 4 for Figure 1 Top view of the gears in Figure 1.
[0056] Figure 5 for Figure 3 Axonometric drawing of the arc groove in.
[0057] Figure 6 for Figure 1 Side view of the flow channel in .
[0058] Figure 7 for Figure 1 Side view of the second motor in FIG.
[0059] Figure 8 Schematic diagram of the steps of the image processing method of the colon endoscope with panoramic camera function in an embodiment of the invention. DETAILED DESCRIPTION
[0060] The following is further described in detail through specific implementation methods:
[0061] The figure marks in the drawings of the specification include: lens body 1, functional channel 2, illumination light source 3, instrument channel 4, first white light source 5, blue light source 6, second white light source 7, first image module 8, first negative lens 801, second negative lens 802, first positive lens 803, aperture 804, second lens 805, second positive lens 806, third negative lens 807, third lens 808, filter 809, protection plate 810, sensor and image plane 811, first ring 9, adjustment ring 10, second ring 11, arc groove 12, flow channel 13, heat dissipation cavity 14, first motor 15, rotating shaft 16, gear 17, fixing rod 18, swing frame 19, support rod 20, guide shaft 21, second motor 22, and third image module 23.
[0062] Example 1
[0063] Basically as attached Figure 1-5 As shown: a colon endoscope with panoramic camera function, comprising a lens body 1, a first image module 8 and a second image module are symmetrically arranged on both sides of the lens body 1, a third image module 23, an illumination light source 3, an instrument channel 4 and two symmetrical functional channels 2 are arranged on the end surface of the lens body 1, and the third image module 23 is located at the center of the functional channel 2;
[0064] The first image module 8, the second image module and the third image module 23 all include a lens ring, which is located in the lens body 1, and the lens ring is provided with a first negative lens 801, a second negative lens 802, a first positive lens 803, an aperture 804, a second lens 805, a second positive lens 806, a third negative lens 807, a third lens 808, a filter 809, a protective plate 810 and a sensor and an image plane 811 in sequence from the object side to the image side; the sensor and the image plane 811 are signal-connected to a controller;
[0065] The object side surface of the first negative lens 801 is convex, and the image side surface is a concave mirror; the second negative lens 802 is a double concave structure, and the object side surface is concave from the edge of the second negative lens 802, and any concave portion of the image side surface is at a certain distance from the edge; the object side surface of the first positive lens 803 is convex, and the image side surface is concave; the object side surface of the second lens 805 is concave, and the image side surface is convex; both surfaces of the second positive lens 806 are convex; the paraxial side of the object side surface of the third lens 808 is convex, and the paraxial side of the image side surface is concave; at the inflection point, the third lens 808 convexes toward the object side surface; the object side surface of the third negative lens 807 is concave, and the image side surface is convex;
[0066] The lens ring includes a first ring 9, an adjustment ring 10 and a second ring 11, which are arranged in sequence from the object side to the image side, and the two sides of the adjustment ring 10 are rotatably connected to the first ring 9 and the second ring 11, a plurality of tooth blocks are welded on the outer side of the adjustment ring 10, and an arc groove 12 is symmetrically opened on the adjustment ring 10, and sliders are symmetrically welded on the diaphragm 804, the sliders are respectively located in the arc grooves 12, and the diaphragm 804 is slidably matched with the sliders and the arc grooves 12;
[0067] A protective body is fixedly connected to one side of the lens ring by bolts, a first motor 15 is fixedly connected to the protective body by bolts, the first motor 15 is connected to the controller signal, a rotating shaft 16 is welded to the output shaft of the first motor 15, a gear 17 is welded to the rotating shaft 16, the gear 17 is meshed with the gear block, and the adjustment ring 10 rotates with the drive of the first motor 15. The model of the first motor 15 is preferably 412T8.
[0068] The specific implementation process is as follows: when using the endoscope to observe the situation inside the colon, first extend the lens body 1 to the position to be detected, and then the illumination light source 3 will provide a certain light source for the first image module 8 and the second image module to collect images, so as to facilitate the first image module 8 and the second image module to collect images.
[0069] When the first image module 8, the second image module and the third image module 23 collect images, firstly, the light will pass through the first negative lens 801, and because the object side of the first negative lens 801 is a convex surface and the image side is a concave mirror, the light will be diverged by the first negative lens 801 and its angle will be larger. Then, the light will pass through the second negative lens 802 and the first positive lens 803. The combination of the second negative lens 802 and the first positive lens 803 can play a certain role in astigmatism, and then diverge the light. The diverged light is refracted to the second lens 805 through the aperture 804, and the second lens 805 will play a role in It has the effect of converging the light, thereby reducing the angle of the light after passing through the second lens 805, and then the light will pass through the second positive lens 806 and the third negative lens 807. The second positive lens 806 and the third negative lens 807 combined will play a certain focusing role. The converged light passes through the third lens 808 and is refracted to the filter 809. The filter 809 will filter the refracted light to a certain extent, and then the filtered light is refracted to the sensor and the image plane 811 through the protective plate 810, thereby realizing imaging; wherein the imaging can be made clearer by diverging the light and converging it to a certain extent.
[0070] At the same time, the aperture 804 has the function of controlling light collection and imaging. As the distance of the aperture 804 changes, the number and angle of the light beams entering the lens can be changed, thereby affecting the brightness, contrast and clarity of the image. Therefore, when the aperture 804 is adjusted, the first motor 15 is first started, and then the shaft 16 rotates under the drive of the first motor 15, so that the gear 17 will rotate accordingly. Because the gear 17 is meshed with the tooth block, the gear 17 will drive the adjustment ring 10 to rotate after the rotation, and because the aperture 804 slides in the arc groove 12 through the slider, when the adjustment ring 10 rotates, the slider will be driven to slide in the arc groove 12, and then the aperture 804 can be driven to change the distance horizontally inside the adjustment ring 10, so that the focal length of the aperture 804 can be adjusted, so that the position of the aperture 804 is adjusted to a suitable position and the image information in the colon is collected more fully.
[0071] Example 2
[0072] The difference from the above embodiment is that the first image module 8 and the second image module are both circumferentially welded with four light sources, which are a white light source, a blue light source 6 , a white light source and a green light source.
[0073] The specific implementation process is as follows: white light can provide light source for the first image module 8 and the second image module, thereby making the images captured by the first image module 8 and the second image module clearer and brighter; the wavelength of green light ranges from about 495 to 570 nanometers, which produces a higher contrast with the red hemoglobin in the blood and can reflect the blood vessels more clearly; at the same time, since the wavelength of blue light is shorter, it can enhance the contrast of blood vessels, and can better penetrate the surface of tissues and be absorbed by the dye in the tissues, making the image displayed by the endoscope clearer and brighter.
[0074] Example 3
[0075] The difference from the above embodiment is that, Figure 6 As shown, two functional channels 2 are connected to two flow channels 13 on both sides respectively, and the ends of the flow channels 13 away from the functional channels 2 are connected to heat dissipation cavities 14, which are respectively arranged at the four light sources.
[0076] The specific implementation process is as follows: When flushing and cleaning the colon using the functional channel 2, a certain amount of water needs to be injected into the functional channel 2 for flushing. Since the functional channel 2 is connected to the flow channel 13, the water injected into the functional channel 2 will also flow to the flow channel 13 accordingly. Thus, a certain amount of water will be injected into the heat dissipation cavity 14, which can play a role in dissipating heat from the light source, reducing the heat emitted by the light source during long-term operation, which affects the refraction of light by the first image module 8 and the second image module, and further affects the images collected subsequently.
[0077] Embodiment 4
[0078] The difference from the above embodiment is that, as Figure 7 shown, functional cavities are opened at both the positions where the lens body 1 is close to the first image module 8 and the second image module. Support rods 20 are provided in the functional cavities. The support rods 20 are welded to the bottom of the second ring 11. A "C"-shaped swing frame 19 is welded to one end of the support rod 20 away from the second ring 11;
[0079] The functional cavities also are provided with a second motor 22. The bottom of the second motor 22 is welded to the bottom wall of the functional cavity. A guide shaft 21 is coaxially welded to the output shaft of the second motor 22. The guide shaft 21 is welded to the bottom end of the swing frame 19. A rotation hole is opened on the top rod of the swing frame 19. The swing frame 19 is rotationally matched with a fixed rod 18 through the rotation hole. One end of the fixed rod 18 is located in the rotation hole, and the other end of the fixed rod 18 is welded to the top wall of the functional cavity. The second motor 22 is signal-connected to the controller. The model of the second motor 22 is preferably 412T8.
[0080] The specific implementation process is as follows: Start the second motor 22 through the controller, and then the guide shaft 21 rotates accordingly. Thus, the swing frame 19 swings accordingly. Since the swing frame 19 is fixedly connected to the support rod 20 and the support rod 20 is fixedly connected to the bottom of the second ring 11, the first image module 8 and the second image module will swing accordingly. And since the swing frame 19 is rotationally matched with the fixed rod 18, on the one hand, the fixed rod 18 will not affect the swing of the image module, and on the other hand, the fixed rod 18 will provide a certain supporting force for it, so that the image module operates stably.
[0081] And through the swing of the first image module 8 and the second image module, the overlapping range of the images collected by the first image module 8 and the second image module can be increased. Thus, in the subsequent process of collecting the image information, the required image information can be collected more fully, and the internal environment of the colon can be presented more fully.
[0082] Embodiment 5
[0083] The difference from the above embodiment is that both the first negative lens 801 and the second lens 805 are made of glass material.
[0084] The specific implementation process is as follows: Compared with plastic lenses, glass materials have a lower coefficient of thermal expansion than most plastics. Under the same temperature change, glass lenses expand or contract less; plastic materials usually have higher thermal conductivity and expansion coefficient, which means that when they are subject to temperature changes, they absorb and release heat faster and produce larger volume expansion or contraction accordingly. Therefore, lenses made of glass are less affected by temperature.
[0085] Example 6
[0086] The difference from the above embodiment is that, Figure 8 As shown, an image processing method of a colon endoscope with a panoramic camera function comprises the following steps:
[0087] Step 1: Use the second motor to drive the first image module and the second image module to swing left and right and combine with the third image module to collect 360° video of the surroundings;
[0088] Step 2: Explore the imaging rules of the first image module, the second image module, and the third image module, and calculate the distortion coefficient matrix; the calculation process of the distortion coefficient matrix is:
[0089] First, the imaging model formula is:
[0090] ω=K[r′,r ′2 ,r ′3 ,r ′4 ,r ′5 ] T (1)
[0091] θ=J[θ′,θ ′2 ,θ ′3 ,θ ′4 ,θ ′5 ] T (2)
[0092] In the formula, K and J represent the radial distortion coefficient matrix and the tangential distortion coefficient matrix respectively, r is the radial distance, and θ is the tangential offset angle;
[0093] The virtual imaging distance ι is the premise of calibrating the distortion matrix, but ι cannot be measured directly. The value of ι is derived using geometric relationships. Therefore, the least squares fitting method of the image edge is used to calibrate the center. The center of the circle is the image center, and the image circle radius is obtained. According to the geometric relationship of similar triangles, the formula is:
[0094]
[0095] Then the distortion coefficient is fitted. Since K is the fifth-order radial distortion coefficient matrix, the formula is expanded to obtain:
[0096] ω=K1r′+K2r ′2 +K3r ′3 +K4r ′4 +K5r ′5 (4)
[0097] Where r′ is the radial distance from the projection point on the imaging plane to the optical center, as shown in the following expression:
[0098]
[0099] (u, v) is the projection point on the imaging surface, (u0, v0) is the calibrated optical center coordinates,
[0100] Then the tangential offset angle can be fitted by equation (2), and the equation (6) can be obtained by expanding it. The equation (6) is:
[0101] θ=j1θ′+j2θ ′2 +j3θ ′3 +j4θ ′4 +j5θ ′5 (6)
[0102]
[0103] The polar coordinates of the image plane are periodic. When θ′=2π, θ=2π, so j5 is calculated through other parameters and can be expressed as follows:
[0104] j5=(1-j1-2πj2-4π 2 j3-8π 3 j4) / 16π 4 (8)
[0105] Among them, r′ and θ′ are calculated by the pixel points of the image through equations (5) and (7). The value of ω can be known from r′, and the value of θ has been set in the target. The distortion coefficients K and J are thus fitted. According to the imaging models (1) and (2), the position of the object point in the space corresponding to any image point in the image can be calculated.
[0106] Step 3, correcting the images of the first image module, the second image module and the third image module, and performing extreme correction on the corrected images;
[0107] During correction, the correction formula can be used to obtain the correction image pixel point (x, y) and the image pixel point (u p , v p ), the correction formula is:
[0108]
[0109] Where, (u0, v0) is the position of the optical center of the image, and (x0, y0) is the image center of the corrected image;
[0110] The image is then subjected to extreme correction.
[0111] Step 4: Use the segmentation-based fast stereo matching algorithm to complete the matching of the planar images to synthesize the image. The fast stereo matching algorithm can improve the matching efficiency and speed by segmenting the image, narrowing the search range and matching in a smaller area; and the fast stereo matching algorithm based on segmentation can use the edge, texture and other feature information in the image for matching, without the need for a time-consuming and computationally resource-intensive global search of the entire image; at the same time, the fast stereo matching algorithm based on segmentation has strong adaptability, can effectively match different types of images in different scenarios, and can be optimized and improved for different goals.
[0112] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0113] The above is only an embodiment of the present invention. The common sense such as the known specific structure and characteristics in the scheme is not described in detail here. The ordinary technicians in the relevant field know all the common technical knowledge in the technical field of the invention before the application date or priority date, can obtain all the existing technologies in the field, and have the ability to apply the conventional experimental means before that date. The ordinary technicians in the relevant field can improve and implement this scheme in combination with their own abilities under the enlightenment given by this application. Some typical known structures or known methods should not become obstacles for ordinary technicians in the relevant field to implement this application. It should be pointed out that for those skilled in the art, without departing from the structure of the present invention, several deformations and improvements can be made, which should also be regarded as the protection scope of the present invention, which will not affect the effect of the implementation of the present invention and the practicality of the patent. The protection scope required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.
Claims
1. A colon endoscope with panoramic camera function, characterized in that: It includes a lens body. A first image module and a second image module are symmetrically arranged on both sides of the lens body. On the end face of the lens body, there are a third image module, an illumination light source, an instrument channel, and two symmetric functional channels. The third image module is located at the center between the two symmetric functional channels; The first image module, the second image module, and the third image module all include a lens collar. The lens collar is located inside the lens body. Inside the lens collar, from the object side to the image side, there are sequentially arranged a first negative lens, a second negative lens, a first positive lens, a diaphragm, a second lens, a second positive lens, a third negative lens, a third lens, a filter, a protection flat plate, a sensor, and an image plane. The sensor and the image plane are signal-connected to a controller; Among them, the object side surface of the first negative lens is convex, and the image side surface is concave. The second negative lens has a double concave structure. The object side surface of the first positive lens is convex, and the image side surface is concave. The object side surface of the second lens is concave, and the image side surface is convex. Both sides of the second positive lens are convex. The object side surface of the third negative lens is concave, and the image side surface is convex. The paraxial side of the object side surface of the third lens is convex, and the paraxial side of the image side surface is concave; And the lens collar includes a first ring, an adjustment ring, and a second ring. The first ring, the adjustment ring, and the second ring are sequentially arranged from the object side to the image side. The adjustment ring is rotatably connected to the first ring and the second ring on both sides respectively. There are several tooth blocks on the outer side of the adjustment ring. And there are symmetric arc-shaped grooves on the adjustment ring. There are symmetric sliders on the diaphragm. The sliders are respectively located in the arc-shaped grooves, and the diaphragm slides in cooperation with the sliders and the arc-shaped grooves; One side of the lens collar is fixedly connected to a protection body. There is a first motor inside the protection body. The first motor is signal-connected to the controller. The output shaft of the first motor is fixedly connected to a rotating shaft. A gear is fixedly connected to the rotating shaft. The gear meshes with the tooth blocks; Among them, functional cavities are provided near the first image module and the second image module of the lens body. Support rods are provided in the functional cavities. The support rods are fixedly connected to the bottom of the second ring. One end of the support rod away from the second ring is fixedly connected to a "C"-shaped swing frame; There is also a second motor in the functional cavity. The output shaft of the second motor is coaxially fixedly connected to a guide shaft. The guide shaft is connected to the bottom end of the swing frame. There is a rotation hole on the top rod of the swing frame. The swing frame is rotationally matched with a fixed rod through the rotation hole. One end of the fixed rod is located in the rotation hole, and the other end of the fixed rod is fixedly connected to the top wall of the functional cavity. The second motor is signal-connected to the controller.
2. The colon endoscope with panoramic camera function as claimed in claim 1, characterized in that: Four light sources are circumferentially arranged on both the first image module and the second image module. The four light sources are respectively a first white light source, a blue light source, a second white light source, and a green light source.
3. The colon endoscope with panoramic camera function as claimed in claim 2, characterized in that: Two flow channels are respectively communicated on both sides of the two functional channels. The ends of the flow channels away from the functional channels are both communicated with a heat dissipation cavity. The heat dissipation cavities are respectively arranged at the four light sources.
4. The colon endoscope with panoramic camera function as claimed in claim 3, characterized in that: Both the first negative lens and the second lens are made of glass material.
