An infrared thermal imaging multimodal integrated mirror

Abstract

The invention discloses an infrared thermal imaging multi-modal integrated mirror, which belongs to the technical field of minimally invasive surgery, and comprises: a fixed mirror body, a mirror body handle and a lens assembly; a wireless radio frequency transmitting module and a battery compartment are arranged on the mirror body handle; one end of the fixed mirror body is detachably connected to the mirror body handle; the lens assembly comprises: a lens front end and a tilting lens; one end of the lens front end is movably connected to the other end of the fixed mirror body; one end of the tilting lens is connected to the other end of the lens front end, and the other end of the tilting lens is tilted in a direction away from the axis of the tilting lens, and a visible light camera and a thermal imaging camera are arranged on the oblique surface of the tilting lens for photographing targets in the monitoring environment; the wireless radio frequency transmitting module is communicatively connected to the tilting lens, and is used to transmit the image information obtained by the tilting lens to an external display through a wireless signal. When performing a segmentectomy, it is not necessary to inflate the lung, so as to realize the proofreading of the visible light image and the infrared image.

Description

Technical Field

[0001] The invention belongs to the technical field of minimally invasive surgery and relates to an infrared thermal imaging multi-modal integrated mirror. Background Art

[0002] Segmentectomy is listed as one of the standard surgical procedures for early lung cancer. However, due to the complex anatomy of lung segments, large variations, and no clear boundaries between segments, how to determine the intersegmental plane is a difficult point in segmentectomy. Currently, the recognized methods for identifying intersegmental planes in the world can be divided into two categories: vascular and bronchial. However, there are common problems such as long plane presentation time (10-15 minutes), the need for intraoperative injection of contrast agents, poor biosafety, or high prices of dedicated equipment, which have affected the popularization of the technology.

[0003] At present, international research on the simple artery ligation method for identifying the intersegmental plane has only been tested on animals. The relevant literature is: Kei, Sakamoto, Masato, et al. A novel and simple method for identifying the lung intersegmental plane using thermography. [J]. Interactive cardiovascular and thoracic surgery, 2016. At that time, an in vitro handheld infrared temperature measurement device was used, and there was no subsequent follow-up research and literature. This device has a large measurement error and cannot be used in the chest cavity due to its large size.

[0004] Minimally invasive surgery is now performed using video-assisted thoracoscopy, which requires inserting a camera into the chest cavity. In segmentectomy, the lung segments must be identified. In the past, the ventilation deflation method was used to identify the intersegmental plane after ligating the pulmonary arteries, veins and bronchi. This was time-consuming and required inflating the lungs, which increased the operation time. In addition, the inflated lungs also increased the difficulty of resection.

[0005] Therefore, it is necessary to provide a thoracoscopic device that can quickly identify lung segments. Summary of the invention

[0006] In order to at least solve the problem of the need to inflate the lungs when performing segmentectomy surgery using video-assisted thoracoscopy in the prior art, the present invention provides the following technical solution: an infrared thermal imaging multi-modal integrated scope, the infrared thermal imaging multi-modal integrated scope comprising: a fixed scope body, a scope handle and a lens assembly;

[0007] The handle of the scope is provided with a wireless radio frequency transmission module and a battery compartment for accommodating batteries;

[0008] One end of the fixed mirror body is detachably connected to the mirror body handle;

[0009] The lens assembly comprises: a lens front end and a tilting lens;

[0010] One end of the front end of the lens is movably connected to the other end of the fixed lens body;

[0011] One end of the tilted lens is connected to the other end of the front end of the lens, and the other end of the tilted lens is tilted in a direction away from the axis of the tilted lens. A visible light camera and a thermal imaging camera are arranged on the oblique surface of the tilted lens for photographing targets in the monitoring environment;

[0012] The wireless radio frequency transmitting module is communicatively connected with the tilting lens and is used for transmitting the image information acquired by the tilting lens to the external display via wireless signals.

[0013] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the lens assembly further comprises: a flexible data line;

[0014] One end of the flexible data cable is connected to the tilting lens, the middle portion of the flexible data cable is built into the front end of the lens and the fixed lens body, and the other end of the flexible data cable is electrically connected to the lens body handle.

[0015] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the visible light camera is located above the thermal imaging camera;

[0016] LED light sources are arranged on the oblique cut surfaces on both sides of the visible light camera and the thermal imaging camera.

[0017] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the tilted lens adopts a lens module with a diameter φ ranging from 10 to 21 mm.

[0018] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the angle between the beveled surface and the axis of the tilted lens is in the range of 0 to 30°.

[0019] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the flexible data line is spiral-shaped and elastic;

[0020] The length of the lens assembly is 35 to 50 cm.

[0021] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the other end of the fixed mirror body is provided with a groove;

[0022] A protrusion matching the shape of the groove is provided at one end of the front end of the lens;

[0023] The inner side wall of the groove is provided with a thread;

[0024] The outer side wall of the protrusion is provided with a thread.

[0025] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the tilted lens is cylindrical and the beveled surface is elliptical.

[0026] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the infrared thermal imaging multi-modal integrated mirror further includes: a processor;

[0027] The processor is electrically connected to the visible light camera and the thermal imaging camera respectively, and is used to switch the camera between visible light and infrared light imaging states.

[0028] Optionally, in the above-mentioned infrared thermal imaging multi-modal integrated mirror, the mirror body handle is also provided with an integrated display and function buttons;

[0029] The integrated display is electrically connected to the tilted lens and is used to display image information acquired by the tilted lens;

[0030] The function key is electrically connected to the processor and is used to input operation instructions to the processor.

[0031] The technical solution provided by the embodiment of the present invention has the following beneficial effects:

[0032] 1) This device adopts a 30-degree tilt lens design, which is applied to infrared lenses. It can realize the rotation of the lens angle in the chest cavity, which is more convenient for surgical operation and switching of angles;

[0033] 2) The front lens is detachable and can be sterilized. The lens used during surgery is also independent and can be directly placed in the sterile area;

[0034] 3) The self-spiral flexible connection line can be extended to facilitate intraoperative operation. In actual surgery, we also prefer longer video and light source lines, which are more conducive to changing the position of the laparoscope during surgery. At the same time, due to the sterility requirements, the spiral retractable data line reduces the possibility of accidental contact of the wire during use, avoiding violations of the sterility principle;

[0035] 4) Adding wireless video output function to the functions integrated in the host can facilitate sharing of intraoperative vision with personnel outside the sterile area during surgery, facilitate expert guidance and video record sharing;

[0036] 5) The integrated light source, visible light camera, and infrared camera can directly switch the field of view during surgery. When we were verifying the lens of the infrared life detection instrument we originally used, we found that due to the lack of a visible light lens, when comparing it with the ordinary thoracoscopic image, we always had to repeatedly look for some identifiable marks to calibrate the visible light image and the infrared image. After integration, it is more convenient to operate during surgery, and it can calibrate the visible light image and the infrared image at the same time. In this part, the infrared lens module uses a smaller lens module with a diameter of 10mm, which further reduces the space and facilitates operations in small spaces such as thoracic surgery. At the same time, there is no need to inflate the lungs during segmentectomy surgery, and the lung segments can be quickly identified, shortening the operation time. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of the structure of an infrared thermal imaging multi-modal integrated mirror provided by the present invention;

[0038] Figure 2 A schematic diagram of the specific structure of a tilted lens in an infrared thermal imaging multi-modal integrated mirror provided by the present invention;

[0039] In the figure: 1. Tilted lens; 101. Beveled surface; 102. Visible light camera; 103. LED light source; 104. Thermal imaging camera; 2. Front end of lens; 3. Flexible data cable; 4. Fixed lens body; 5. Lens handle; 6. Integrated display; 7. Wireless RF transmitter module; 8. Function buttons; 9. Battery; 10. Wireless signal transmission; 11. External display; 12. Processor. DETAILED DESCRIPTION

[0040] In order to make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0041] In the description of the present invention, the terms "longitudinal", "lateral", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and do not require that the present invention must be constructed and operated in a specific orientation. Therefore, they cannot be understood as limitations on the present invention. The terms "connected", "connected" and "set" used in the present invention should be understood in a broad sense. For example, it can be a fixed connection or a detachable connection; it can be a direct connection or an indirect connection through an intermediate component; it can be a wired electrical connection, a radio connection, or a wireless communication signal connection. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to specific circumstances.

[0042] See also Figure 1The present invention provides an infrared thermal imaging multi-modal integrated mirror, which is mainly used in the field of minimally invasive surgical technology, and can also be used in the fields of infrared life detection, rescue, etc. that require infrared detection in a narrow space. The infrared thermal imaging multi-modal integrated mirror includes: a fixed mirror body 4, a mirror body handle 5 and a lens assembly. The mirror body handle 5 can be made of aluminum alloy. A wireless radio frequency transmission module is arranged in the mirror body handle 5, and the lens handle has a battery compartment for accommodating a battery 9. The battery compartment is equipped with a replaceable battery 9, which can support the operation of the device, making the layout of the device simpler and more convenient, without the need to set up a power cord, etc. The wireless radio frequency transmission module 7 has a wireless video (also including photos) output function. The fixed mirror body 4 is rod-shaped and can be made of titanium alloy material. One end of the fixed mirror body 4 is detachably connected to the mirror body handle 5. Specifically, the interface between the fixed mirror body 4 and the mirror body handle 5 (the interface is a data transmission end, such as a USB or type C interface, which can conduct digital signals) is a pin connection for data transmission and power supply. The lens assembly includes: a lens front end 2 and a tilting lens 1. One end of the front end 2 of the lens is movably connected to the other end of the fixed lens body 4, that is, during use, the lens assembly can be moved outward (or extended) a certain distance relative to the fixed lens body 4, for example, by means of extension lines, telescopic rods and other commonly used technical means in the art, which are not limited in this embodiment, so as to facilitate changing the position of the tilting lens 1 in the chest cavity. Preferably, the tilting lens 1 is columnar. One end of the tilting lens 1 is connected to the other end of the front end 2 of the lens, and the other end of the tilting lens 1 is visible from the side (refer to FIG. 1 ). Figure 1 The inclined surface 101 is tilted from bottom to top in a direction away from the axis of the tilting lens 1 to form an inclined surface 101. Preferably, the inclined surface 101 is elliptical (refer to Figure 2As shown). A visible light camera 102 and a thermal imaging camera 104 are arranged on the oblique surface of the tilting lens 1, and these two cameras can be used to shoot the target in the monitoring environment, so as to realize the proofreading of the visible light image and the infrared image. Since the fixed mirror body 4 and the mirror body handle 5 can be disassembled, that is, the integrated front-end lens composed of the fixed mirror body 4 and the lens assembly can be disassembled from the mirror body handle 5, and then can be disinfected so as to directly enter the sterile area during the operation. The wireless radio frequency transmission module 7 is connected to the tilting lens 1 (specifically the visible light camera 102 and the thermal imaging camera 104) for communication, and is used to transmit the image information obtained by the tilting lens 1 to the external display 11 through a wireless signal. This embodiment does not limit how the wireless radio frequency transmission module 7 outputs data to the outside (for example, to the external display 11). As long as the data output is realized, the wireless radio frequency transmission module 7 can be connected to the tilting lens 1, or the wireless radio frequency transmission module 7 can be connected to the processor 12, or other connection methods, which are not limited in this embodiment. After the tilted lens 1 obtains image information and generates photos through the built-in camera module, the tilted lens 1 outputs the photos to the outside through the wireless radio frequency transmission module 7, for example, directly transmits them to the integrated display 6 on the local side or the external display 11 on the cloud side, so as to share the intraoperative visual field for personnel in and outside the sterile area during the operation, and facilitate expert guidance and video record sharing. It should be noted that when the tilted lens 1 is in the infrared light imaging state, it can identify the changes in the infrared characteristics of the lesion site of the human organ (such as the lung) (because we need to ligate the corresponding pulmonary artery during the operation, and the corresponding pulmonary tissue will change its infrared radiation due to the blockage of blood supply after the simple ligation of the artery), so as to guide the pulmonary segment resection. The present application uses the inter-segment plane identified by "infrared thermal imaging combined with simple arterial ligation method" to compare with the "ventilation and atrophy method" for identifying the inter-segment plane after the traditional ligation of the pulmonary artery, vein and bronchus, which has the advantages of fast plane presentation time (about 20-30 seconds), safety and reliability, repeatable display and no need to purchase expensive equipment.

[0043] As a preferred embodiment of the above, the lens assembly in this embodiment further includes: a flexible data cable 3. One end of the flexible data cable 3 is connected to the tilting lens 1, the middle part of the flexible data cable 3 is built into the front end 2 of the lens and the fixed lens body 4, and the other end of the flexible data cable 3 is electrically connected to the mirror body handle 5, so that the image information obtained by the tilting lens 1 can be transmitted to the processor 12 through the data interface on the mirror body handle 5 through the flexible data cable 3. Preferably, the flexible data cable 3 is spiral. According to the needs of the site, the flexible data cable 3 can be completely stored in the inner side of the front end 2 of the lens and the fixed lens body 4, or the flexible data cable 3 can be partially exposed from the front end 2 of the lens and the fixed lens body 4. Since the flexible data cable 3 has a certain elasticity, it can be extended to facilitate intraoperative operation. At the same time, due to the intraoperative aseptic requirements (the disinfection range of the surgical area is defined as 15 cm), the use of the spiral flexible data cable 3 can extend the lens and change the lens angle, so that it can be applied to more application scenarios including but not limited to thoracotomy, abdominal surgery, etc., and reduce the situation of accidental touch due to the length of the wire during use, avoiding violation of the aseptic principle. Extending the flexible data line 3 allows the tilting lens 1 to directly enter the sterile area.

[0044] Reference Figure 2 The picture shown is a front view of the beveled surface 101 of the tilted lens 1, and the visible light camera 102 is located above the thermal imaging camera 104. To realize the integrated light source, LED light sources 103 are provided on the beveled surfaces 101 on both sides of the visible light camera 102 and the thermal imaging camera 104, so that the intraoperative field of view can be directly switched to realize the proofreading of the visible light image and the infrared image. It should be noted that the detection temperature range of the two cameras needs to be calibrated before leaving the factory, and an optimal temperature working range can be set according to actual needs, for example, it can be set to 30-40°C. In addition, the LED light source 103 can also be started through the function button 8.

[0045] In order to further reduce the space occupied by the device, the tilted lens 1 adopts a lens module with a diameter φ ranging from 10 to 21 mm. In order to facilitate operations in a narrow space such as thoracic surgery, the tilted lens 1 preferably adopts a lens module with a diameter φ of 10 mm. In addition, the diameter of the fixed lens body 4 and the front end 2 of the lens can be 12 mm.

[0046] The angle between the bevel 101 and the axis of the tilted lens 1 is in the range of 0 to 30°. In order to be suitable for thoracic cavity operations, the angle between the bevel 101 and the axis of the tilted lens 1 is preferably 30°. In this case, the lens angle of the tilted lens 1 is 30°. The tilted lens 1 is applied to the infrared lens. By rotating the fixed lens body 4, the lens viewing angle in the thoracoscope can be rotated, which is more convenient for surgical operations and switching viewing angles.

[0047] In order to meet the use of thoracic surgery space, the length of the lens assembly is 35 to 50 cm. If the lens front end 2 and the fixed lens body 4 are connected together, the flexible data line 3 is completely stored in the lens front end 2 and the fixed lens body 4. The sum of the lengths of the tilting lens 1, the lens front end 2 and the fixed lens body 4 is 35 cm. If the lens front end 2 and the fixed lens body 4 are separated, the flexible data line 3 is stretched, and the sum of the lengths of the tilting lens 1, the lens front end 2, the flexible data line 3 and the fixed lens body 4 reaches 50 cm. That is to say, through the extension function of the flexible data line 3, the light source line during the operation is extended by a maximum of 15 cm, which is conducive to changing the position of the tilting lens 1 during the operation and meets the sterility requirements during the operation. It should be noted that in other embodiments, the extension length of the flexible data line 3 can be designed according to actual needs.

[0048] As a specific embodiment of the detachable connection between the fixed lens body 4 and the front end of the lens 2, in this embodiment, the other end of the fixed lens body 4 (referring to the end away from the lens body handle 5) is provided with a groove, and one end of the front end of the lens 2 (referring to the end away from the tilting lens 1) is provided with a protrusion matching the shape of the groove, and the inner side wall of the groove is provided with a thread, and the outer side wall of the protrusion is provided with a thread, so that the fixed lens body 4 and the front end of the lens 2 are threadedly connected, and when the fixed lens body 4 is separated from the front end of the lens 2, the flexible data line 3 can be stretched to change the position of the front end lens. In other embodiments, the other end of the fixed lens body 4 (referring to the end away from the lens body handle 5) can be provided with a protrusion, and one end of the front end of the lens 2 (referring to the end away from the tilting lens 1) is provided with a groove matching the shape of the groove, and the inner side wall of the groove is provided with a thread, and the outer side wall of the protrusion is provided with a thread.

[0049] In order to control the tilting lens 1, the infrared thermal imaging multi-modal integrated mirror also includes: a processor 12. The processor 12 (not shown in the figure) is electrically connected to the visible light camera 102 and the thermal imaging camera 104 respectively, and is used to switch the camera between the two imaging states of visible light and infrared light. Preferably, an integrated display 6 and a function button 8 are also provided on the mirror handle 5. The integrated display 6 is electrically connected to the tilting lens 1, and the integrated display 6 is used to display the image information obtained by the tilting lens 1. The function button 8 is electrically connected to the processor 12, and an operation instruction can be input to the processor 12 through the function button 8, and then the processor 12 sends a control instruction to the tilting lens 1 to control the tilting lens 1 to switch between the two imaging states of visible light and infrared light, and the visible light image and the infrared image can be directly proofread, so that the field of view required in the operation (this article takes the surgical application environment as an example) can be met. In addition, the mirror handle 5 also has a memory card, which can store video and photo records.

[0050] It is known from common technical knowledge that the present invention can be implemented by other embodiments that do not deviate from its spirit or essential features. Therefore, the above disclosed embodiments are only illustrative in all respects and are not exclusive. All changes within the scope of the present invention or within the scope equivalent to the present invention are included in the present invention.

Claims

1. An infrared thermal imaging multi-modal integrated mirror, characterized in that: The infrared thermal imaging multi-modal integrated mirror comprises: a fixed mirror body, a mirror body handle and a lens assembly; The handle of the scope is provided with a wireless radio frequency transmission module and a battery compartment for accommodating batteries; One end of the fixed mirror body is detachably connected to the mirror body handle; The lens assembly comprises: a lens front end and a tilting lens; One end of the front end of the lens is movably connected to the other end of the fixed lens body; One end of the tilted lens is connected to the other end of the front end of the lens, and the other end of the tilted lens is tilted in a direction away from the axis of the tilted lens. A visible light camera and a thermal imaging camera are arranged on the oblique surface of the tilted lens for photographing targets in the monitoring environment; The wireless radio frequency transmission module is communicatively connected with the tilting lens, and is used to transmit the image information acquired by the tilting lens to the external display via wireless signals; The lens assembly further includes: a flexible data line; One end of the flexible data cable is connected to the tilting lens, the middle part of the flexible data cable is built into the front end of the lens and the fixed lens body, and the other end of the flexible data cable is electrically connected to the lens body handle; The flexible data line is spiral-shaped and elastic; The fixed lens body is threadedly connected to the front end of the lens, so that the flexible data line can be completely stored inside the front end of the lens and the inner side of the fixed lens body. When the fixed lens body is separated from the front end of the lens, the flexible data line can be lengthened to change the position of the front end of the lens.

2. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The visible light camera is located above the thermal imaging camera; LED light sources are arranged on the oblique cut surfaces on both sides of the visible light camera and the thermal imaging camera.

3. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The tilted lens adopts a lens module with a diameter φ ranging from 10 to 21 mm.

4. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The included angle between the beveled surface and the axis of the tilted lens is in the range of 0 to 30 degrees.

5. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The length of the lens assembly is 35 to 50 cm.

6. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The other end of the fixed mirror body is provided with a groove; A protrusion matching the shape of the groove is provided at one end of the front end of the lens; The inner side wall of the groove is provided with a thread; The outer side wall of the protrusion is provided with a thread.

7. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The tilted lens is cylindrical, and the beveled surface is elliptical.

8. The infrared thermal imaging multi-modal integrated mirror according to claim 1, characterized in that: The infrared thermal imaging multi-modal integrated mirror also includes: a processor; The processor is electrically connected to the visible light camera and the thermal imaging camera respectively, and is used to switch the camera between visible light and infrared light imaging states.

9. The infrared thermal imaging multi-modal integrated mirror according to claim 8, characterized in that: The mirror handle is also provided with an integrated display and function buttons; The integrated display is electrically connected to the tilted lens and is used to display image information acquired by the tilted lens; The function key is electrically connected to the processor and is used to input operation instructions to the processor.

Images