Depth and contour detection of anatomical targets
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-04
- Publication Date
- 2026-08-14
Smart Images

Figure CN116056621B_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 061,249, filed August 5, 2020, the contents of which are incorporated herein by reference in their entirety. Technical Field
[0003] This disclosure relates to target recognition, and more specifically to techniques for detecting the contours and depth of anatomical targets. Background Technology
[0004] Medical endoscopes enable users to examine hidden areas of a patient. Some medical endoscopes, such as endoscopes and laparoscopes, were originally developed in the early 19th century and have been used to examine the inside of a patient's body. A medical endoscope may include optical sensors, such as a camera device for imaging an area at the distal end of the endoscope, and controls located near the user for manipulating the distal end of the endoscope. An axis can transmit signals and provide a link between the proximal and distal ends of the endoscope. Some axes can be flexible, while others can be rigid. Some medical endoscopes allow the user to pass tools or treatments along the channels of the axis, for example, to remove tissue or retrieve objects.
[0005] The effective use of medical endoscopes depends on several factors, such as experience, dexterity, and visual cues. Medical endoscopes that allow interaction within a small, enclosed space around the patient's body can use a screen or monitor to provide images of the area surrounding the distal end of the endoscope. Summary of the Invention
[0006] Improved image display can help allow for better visual cues and thus more efficient use of medical endoscopes. This document describes techniques for detecting the depth and contour of anatomical targets and for enhancing the imaging of these targets. In the example, a pattern of light can be projected across the anatomical target, and an image of the light pattern on the anatomical target can be captured. The captured light pattern can be analyzed and used to help enhance the 2D image of the anatomical target.
[0007] This section is intended to provide an overview of the subject matter of this patent application. It is not intended to provide an exclusive or exhaustive description of the invention. Detailed descriptions are included to provide additional information regarding this patent application. Attached Figure Description
[0008] Figure 1 An example system 100 for enhancing images according to this subject is generally shown.
[0009] Figures 2A to 2D The effect of projecting a spatial light pattern onto an anatomical target is generally shown.
[0010] Figure 3 Details of an example system 300 for enhancing images according to this subject are generally shown.
[0011] Figure 4 An example system 400 is generally shown for enhancing 3D cues in an image provided using a medical endoscope 301.
[0012] Figure 5 Example methods are generally shown for enhancing 2D images of anatomical targets to provide 3D clues. Detailed Implementation
[0013] During medical procedures, such as endoscopic procedures to apply treatment to tissue or remove unwanted substances like stones (“pebbles”) or tumors, physicians can control the position of the fiber optic tip and the resulting laser beam spot while viewing real-time images captured by the endoscopic camera. One approach provides two-dimensional (x,y) images of the camera, but it does not provide visual depth cues or scaled visualization of depth. Without visual depth cues, manipulating and positioning the endoscope and the fiber optic tip in the axial depth direction can be difficult.
[0014] In endoscopic and laparoscopic procedures, success can depend on the precise positioning of the distal endoscope to achieve the desired outcome. Besides aiming the fiber optic tip at the anatomical target, the distance between the fiber optic tip and the target can also affect the effectiveness of a treatment cycle. While 2D imaging techniques can provide good two-dimensional visual cues, they lack effective third-dimensional visual cues. In some cases, such as tumor removal, the lack of good visual depth cues can prolong the treatment process, for example, by requiring the physician to first examine the target tumor multiple times from various directions before subsequent treatment. This approach, involving multiple examinations from different directions, is cumbersome for users assessing the 3D properties of the tumor, any adjacent healthy tissue, or both.
[0015] The inventors have described techniques for improving 3D cues, particularly visual depth cues and visual contour cues, in 2D images provided by a medical endoscope. Figure 1 Examples of the various parts of a system 100 for enhancing images are generally shown. The system 100 may include, for example, a medical mirror 101 for viewing an anatomical target 102 or a target area 103, an imaging system 104, and a patterned illumination system 105.
[0016] The medical endoscope 101 can provide a view of a target area 103 or a specific anatomical target 102 for a patient. Examples of such a medical endoscope 101 may include, but are not limited to, endoscopes, laparoscopes, or variants, and other types of endoscopes that may be used for diagnostic or surgical procedures, or both. The medical endoscope 101 may include, for example, a camera device 106 or image sensor for electronically capturing a representation of an image of the target area 103 or anatomical target 102. The medical endoscope 101 may include, for example, one or more channels 107, 111, 113 for extending one or more instruments from one end, i.e., the proximal end 108, of the medical endoscope 101 to the other end, i.e., the distal end 109, of the medical endoscope 101. For example, the first channel 111 may include, for example, one or more wires or fibers for conducting or transmitting information between the camera device and the imaging system. The medical endoscope 101 may include or be coupled to an optional light source 114, for example, for illuminating or lighting a target area 103 so that the imaging device 106 can capture one or more images of the target area 103 and any anatomical target 102. In such a configuration, a second channel 113 may provide an optical path for transmitting light from the proximal end 108 to the distal end 109 of the medical endoscope 101. A channel 107 of the medical endoscope 101 may provide an optical path for, for example, one or more optical fibers for a patterned illumination system 105. At the distal end of channel 107, light from one or more optical fibers may be projected toward the target area 103.
[0017] Pattern illumination system 105 can provide light for projecting spatial light patterns across target area 104 (including across anatomical target 102). Pattern illumination system 105 may include lasers or other light sources. Projected light from the light source can be configured to form a specified projection pattern at anatomical target 102 or target area 103. When the specified first pattern of light is projected onto and reflected from a flat surface at a given distance from the end of channel 107 to provide a reference response pattern, the specified first pattern of light may have specified characteristics. Such characteristics may include, but are not limited to, the spacing between properties of the reference response pattern, the shadows of the light in the reference response pattern, or the thickness of the pillars, etc., when reflected from a non-flat surface or from a flat surface at a distance different from the end of channel 107 than a given distance. When reflected from a non-flat surface or from a flat surface at a different distance from the end of channel 107, imaging device 106 may capture a second pattern of reflected light via one or more optical fibers. The imaging system 104 can analyze the difference between the second pattern of the reflected response and the first pattern of the projection, and based on such analysis, can detect and measure contour and depth information associated with the target region 103 or the anatomical target 102 within the target region 103. The imaging system 104 can then enhance the 2D image, for example, with shading, to add or emphasize 3D cues that can be included by the 2D image to visually distinguish depth and contour information. Shading can include, for example, visual modulation of light intensity or spatial modulation of light to indicate depth or contour.
[0018] Adding or emphasizing 3D cues can help provide the user with useful spatial context, which in turn can help the user obtain better 3D positioning of the distal end of the medical endoscope 101 or one or more instruments used with the medical endoscope 101. This can help avoid, reduce, or minimize the number of different orientations that the user might otherwise need to “observe” in order to perform a successful procedure, such as a laser treatment procedure.
[0019] Figures 2A to 2D This generally illustrates the effect of projecting a light pattern onto an anatomical target. Figure 2A An example of a light pattern projected onto a flat surface from an illumination system used with a medical mirror is shown. When projected onto an orthogonal flat surface, the pattern may include a specified line pattern, such as a line pattern with a certain spacing and thickness. In some examples, when projected onto an orthogonal flat surface, the spacing and thickness may be substantially equal, for example, to provide one or more of equal spacing between lines, equal line thickness, or both spacing and thickness being equal to each other. However, if the pattern is projected onto a surface or portion of a surface that is not orthogonal but forms a non-zero angle with the orthogonal flat surface, the thickness and spacing of the lines may vary depending on the magnitude, direction, or orientation of the angle and the direction of the projected lines relative to such an angle. Figure 2B Generally, a 2D image of an anatomical target (e.g., a kidney stone or tumor) is displayed on the screen of an imaging system used with a medical endoscope. The 2D image can show the user a very good outline of the stone or tumor, but may not provide any additional 3D clues. Figure 2C Generally shown Figure 2B Tumors or kidney stones, in which light patterns, for example Figure 2A The light pattern projects across the tumor or kidney stone. The light pattern reflected from the surface of the stone, as well as the background of the area, can help reveal 3D artifacts in the anatomical target and target area that may be hidden in the 2D image due to glare, texture fluctuations, emission angles, etc. This is achieved by using, for example, a reference response pattern or projection pattern. Figure 2A Compared to the distortion of lines in a reflected light pattern, 3D cues are visible. In some examples, the imaging system can analyze one or more variations in line undulations, line thickness, and line spacing to provide 3D information about the target. The imaging system can then augment a 2D image based on this 3D information to provide the viewer with an enhanced 2D image containing 3D cues, such as... Figure 2D As shown. For example, the enhanced view provided by the imaging system may include additional or enhanced shading to reveal 3D cues. In some examples, the enhanced view does not include line patterns. In some examples, the enhanced view may include visual and text-based indications of data associated with the orientation of the instrument's fibers relative to the anatomical target. Such data may include, but is not limited to, the distance between the tip of the fiber and the surface of the anatomical target, the angle of the surface relative to the trajectory of the fiber, etc. In some examples, information that enables the conversion of 2D images into 3D images may be displayed.
[0020] Figure 3 Details of a portion of an example system 300 for image enhancement according to this subject are generally shown. In some examples, Figure 3 System 300 can be Figure 1A more detailed view of example system 100 is provided. System 300 may include a medical endoscope 301 for viewing anatomical targets 302 or target regions 303, an imaging system 304, and a patterned illumination system 305. In some examples, system 300 or the medical endoscope may include a second illumination source (not shown) for illuminating or lighting the target region 303 so that the imaging system can capture images of the target region 303 and any anatomical targets 302. Medical endoscope 301 may include an axis 310 for extending into a patient's orifice or through a patient's incision. Axis 310 may include multiple channels 307, 311 and an optical sensor 306. A first channel 311 may be used to transmit image signals from the optical sensor 306 located at the distal end 309 of axis 310 to the imaging system 304 coupled to the proximal end 308 of axis 310. The second channel 307 can serve as an optical path to deliver light from the pattern illumination system 305 to the anatomical target 302 or target region 303 for the purpose of projecting a pattern of light across the anatomical target 302 or target region 303. At the distal end 309 of axis 310, light can be projected from the optical path via two locations or two regions. The purpose of projecting light from two points toward the anatomical target 302 is to allow light from each point to interfere with each other to form an interference pattern across the field of view or target region 303. In some examples, projecting polarized light across the anatomical target from two different regions of the optical path can form a sharp interference pattern. Using the polarization of light can provide enhanced sharpness. Using coherent and polarized light can achieve further pattern sharpness compared to using incoherent and unpolarized light.
[0021] In some examples, the second channel 307 may include a beam splitter 312 that forms two beams from a single beam of light from a light source of the patterned illumination system 305. For example, light from the light source may be transmitted from the light source of the patterned illumination system 305 to the beam splitter 312 via a single optical medium such as an optical cable or fiber. At the beam splitter 312, the light may be further transmitted as two distinct beams via two optical paths to a distal end 309. In some examples, the distal end 309 of the optical path may project each of the two beams such that the light appears to be projected through two slits at the end of the optical path to provide an interference pattern. In some examples, light may be transmitted from the patterned illumination system 305 via a single-mode fiber or single-mode fiber optic cable.
[0022] Imaging system 304 can capture image information from signals provided by optical sensor 306. In some examples, imaging system 304 may include input processing circuitry 321, 2D image processing circuitry 322, 3D artifact circuitry 323, and display interface circuitry 324. Input processing circuitry 321 can divide image information into first image information and second image information, the first image information being associated with a 2D image providing the anatomical target 302 or target region 303, and the second image information being associated with an interference pattern captured on the surface of the anatomical target 302 or target region 303. 2D image processing circuitry 322 can process the first image information for reception at display interface circuitry 324. 3D artifact circuitry 323 can process the second image information for enhancing the 2D image. For example, 3D artifact circuitry 323 can analyze the interference pattern of the second image information, including comparing and measuring deviations of the interference pattern from a reference pattern, to extract 3D cues about the anatomical target 302 or target region 303. Analysis allows the display interface circuitry 324 to utilize information provided by the 3D artifact circuitry 323 to enhance the 2D image information received from the 2D image processing circuitry 322, guiding image enhancement techniques to provide or display 3D cues in the enhanced 2D image. In some examples, techniques may include altering the interference pattern or adding shading or color to the 2D image to provide the enhanced 2D image. The enhanced 2D image can be displayed on the monitor 325 of the imaging system to help the user of the medical endoscope 301 position the distal end of the medical endoscope 301 relative to anatomical targets, and to position therapeutic instruments relative to anatomical targets for effective and efficient use of treatment.
[0023] Figure 4 An example system 400 is generally shown for enhancing 3D cues in an image provided using a medical endoscope 301. Figure 4 System 400 is Figure 3 System 300 modifications. In some examples, Figure 4 System 400 can be Figure 1A more detailed view of example system 100 is provided. System 400 may include a medical endoscope 301 for viewing anatomical target 302 or target region 303, an imaging system 304, and a pattern illumination system 405. The medical endoscope 301 may include an axis 310 for extending into a patient's orifice or through a patient's incision. The axis 310 may include multiple channels 307, 311 and an optical sensor 306. A first channel 311 may be used to transmit image signals from the optical sensor 306 located at the distal end 309 of the axis 310 to the imaging system 304 coupled to the proximal end 308 of the axis 310. A second channel 307 may serve as an optical path to transmit light from the pattern illumination system 305 to the anatomical target 302 or target region 303 for the purpose of projecting a pattern of light across the anatomical target 302 or target region 303. At the distal end 309 of the axis 310, light may be projected from the optical path via two points or two regions. The purpose of projecting light from two points toward the anatomical target 302 is to allow the light from each point to interfere with each other, forming an interference pattern across the field of view or target region 303. In some examples, projecting polarized light across the anatomical target from two different regions of the optical path can form a sharp interference pattern. Sharpness comes from the polarization of the light. Using coherent and polarized light can achieve further sharpness of the pattern compared to using incoherent and unpolarized light.
[0024] In some examples, instead of a beam splitter, light from the patterned illumination system can be transmitted through the second channel 307 via two isolated optical media, such as two optical fibers, to form two beams from the light source of the patterned illumination system 405. In some examples, the distal end 309 of the optical path can project each of the two beams, such that the light appears to be projected through two slits at the end of the optical path. In some examples, light can be transmitted from the patterned illumination system 405 via single-mode optical fiber or single-mode optical fiber cable.
[0025] Imaging system 304 can capture image information from signals provided by optical sensor 306. In some examples, imaging system 304 may include input processing circuitry 321, 2D image processing circuitry 322, 3D artifact circuitry 323, and display interface circuitry 324. Input processing circuitry 321 can divide image information into first image information and second image information, the first image information being associated with a 2D image providing the anatomical target 302 or target region 303, and the second image information being associated with an interference pattern captured on the surface of the anatomical target 302 or target region 303. 2D image processing circuitry 322 can process the first image information for reception at display interface circuitry 324. 3D artifact circuitry 323 can process the second image information for enhancing the 2D image. For example, 3D artifact circuitry 323 can analyze the interference pattern of the second image information, including comparing and measuring deviations of the interference pattern from a reference pattern, to extract 3D cues about the anatomical target 302 or target region 303. Analysis allows the display interface circuitry 324 to utilize information provided by the 3D artifact circuitry 323 to enhance the 2D image information received from the 2D image processing circuitry 322, guiding techniques to reveal 3D cues in the new 2D image. In some examples, techniques may include providing an enhanced 2D image based on changes in the interference pattern or the addition of shadows to the 2D image. The enhanced 2D image can be displayed on the monitor 325 of the imaging system to help the user of the medical endoscope 301 position the distal end of the endoscope 301 relative to anatomical targets, and to position therapeutic instruments relative to anatomical targets for effective and efficient use of treatment.
[0026] Figure 3 and Figure 4 The diagram illustrates the use of interference to generate a light pattern projected onto an anatomical target. Other methods for generating patterns are also possible, including using a pattern filter to project the light pattern, such that the pattern filter can block light to project a pattern of shadows and light onto the anatomical target. Such a filter may include a glass layer containing the pattern filter. In some examples, the system may include a scanning laser that can guide, scan, or continuously move a laser beam to project the pattern onto the anatomical target.
[0027] Figure 5An example method for enhancing a 2D image of an anatomical target to provide 3D cues is generally illustrated. At 501, a first specified pattern of light can be projected onto the anatomical target. When projected onto a specified surface at a specified distance, the first pattern of light will have specified characteristics, including specified dimensions regarding the distance between lines of the pattern and specified thicknesses of bright and shadowed or dark areas of the pattern. At 503, a second pattern can be detected and captured by an optical sensor. The second pattern can be a result of the first pattern reflecting off the surface of the anatomical target. At 505, the characteristics of the second pattern can be analyzed with reference to the characteristics of the first pattern. The analysis may include creating data points showing the deviation of the characteristics of the second pattern from the first pattern, and deriving depth and contour information of the anatomical target from the data points, enabling the detection and capture of 3D cues regarding the surface of the anatomical target. Such 3D cues can be derived by an imaging system and can be used to provide an enhanced 2D image of the anatomical target for display to a user, for example, an endoscope or laparoscope.
[0028] In some examples, enhanced 2D images, including additional 3D cues about anatomical targets accessible via a medical endoscope, can further assist the user in visualizing the anatomical target and surrounding areas during laparoscopic or endoscopic procedures. In some examples, illumination patterns used to detect the depth and contour of the anatomical target during the procedure are not visible on the enhanced 2D images so as not to interfere with visualization. Enhanced visualization can help shorten the procedure because 3D cues can help the user reduce the number of "looking" actions during the procedure. In some examples, additional 3D cues can help reduce mental fatigue compared to non-enhanced 2D images of the anatomical target used by the user. In some examples, 3D cues in enhanced 2D images can help provide more effective treatment. For example, when treating a tumor via laser therapy, the depth of treatment can be controlled by applying the laser at a distance from the anatomical target surface of the tumor and at an angle to the tumor surface. An angle less perpendicular to the plane of the tumor surface generally results in a smaller depth of treatment applied. The enhanced 2D images provided in this topic can offer clues about the contours and undulations of the tumor surface, allowing the treatment angle to be adjusted to take these contours and undulations into account, which can lead to more precise application of the treatment.
[0029] Notes and Examples
[0030] In a first example, Example 1, an image enhancement system for enhancing a 2D display image may include: a first illumination source; a first optical path configured to project a first pattern of light provided by the first illumination source onto the surface of an anatomical target; a sensor configured to detect light reflected from the surface and transmit an image signal based on the light reflected from the surface; and an imaging system configured to receive the image signal, detect a second pattern of light reflected from the surface, and determine contour information of the surface of the anatomical target based on the second pattern of light.
[0031] In Example 2, the subject of Example 1 includes, wherein a first illumination source is configured to produce coherent light.
[0032] In Example 3, the subject matter of Examples 1 to 2 includes a first illumination source configured to produce polarized light.
[0033] In Example 4, the subject of Example 3 includes, wherein a first optical path is configured to project at least two different beams toward a surface; and wherein a first pattern is an interference pattern of at least two different beams at the surface.
[0034] In Example 5, the subject of Example 4 includes a first illumination source configured to project a single beam; and a first optical path including a beam splitter to provide at least two different beams.
[0035] In Example 6, the subject matter of Examples 1 to 5 includes a first optical path configured to extend through an endoscope or laparoscope to an anatomical target.
[0036] In Example 7, the subject matter of Examples 1 to 6 includes an imaging system comprising a display; and wherein the imaging system is configured to visually distinguish contour information via the display.
[0037] In Example 8, the subject of Example 7 includes, where D represents an image with shading adjusted based on contour information.
[0038] In Example 9, the subject of Examples 1 to 8 includes a second illumination source configured to illuminate the anatomical target with second light via a second optical path.
[0039] Example 10 is a method for detecting 3D cues from an anatomical target, the method comprising: projecting a first pattern of light onto the anatomical target, the first pattern of light being configured to display specified properties in response to being applied to a reference target; detecting a second pattern of light redirected from the anatomical target at an optical sensor; and analyzing the properties of the second pattern against the specified properties to provide contour information of the anatomical target.
[0040] In Example 11, the subject of Example 10 includes D-clues based on contour information.
[0041] In Example 12, the subject of Example 11 includes that the D image does not include the second pattern.
[0042] In Example 13, the subject of Examples 10 to 12 includes, wherein projecting a first pattern includes illuminating the anatomical target with two different polarized beams.
[0043] In Example 14, the subject of Example 13 includes a first pattern formed by the interference of a first beam of two polarized beams with a second beam of two polarized beams.
[0044] In Example 15, the subject of Example 14 includes the fact that polarized light is coherent light.
[0045] In Example 16, the subject of Examples 10 to 15 includes, wherein projecting a first pattern includes generating a laser beam to form the first pattern.
[0046] In Example 17, the subject of Example 16 includes, wherein projecting a first pattern includes splitting a laser beam into two laser beams using a beam splitter located within a channel of an endoscope or laparoscope.
[0047] In Example 18, the subject of Example 17 includes the projection of two beams from the ends of two optical media at the distal end of an endoscope or laparoscope onto an anatomical target.
[0048] In Example 19, the subject matter of Examples 10 to 18 includes, wherein detecting the second pattern includes detecting the second pattern at an optical sensor located at the distal end of an endoscope or laparoscope.
[0049] In Example 20, the subject of Example 19 includes, wherein projecting a first pattern of light onto an anatomical target comprises projecting a first pattern of light from a first illumination source onto the anatomical target; and wherein the method comprises illuminating the target with a second illumination source, wherein the second illumination source is part of an endoscope or laparoscopic system.
[0050] Example 21 is at least one machine-readable medium including instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations for implementing any of the examples 1 through 20.
[0051] Example 22 is an apparatus that includes means for implementing any of the examples in Examples 1 to 20.
[0052] Example 23 is a system for implementing any of the examples in Examples 1 through 20.
[0053] Example 24 is a method for implementing any of the examples in Examples 1 through 20.
[0054] The above detailed description includes reference to the accompanying drawings, which form part of the detailed description. By way of illustration, the drawings show specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as “examples.” Such examples may include elements other than those shown or described. However, the inventors also contemplate examples in which only the shown or described elements are provided. Furthermore, the inventors contemplate examples using any combination or substitution of these elements (or one or more aspects of these elements) shown or described with respect to a particular example (or one or more aspects of a particular example) or with respect to other examples shown or described herein (or one or more aspects of other examples).
[0055] In the event of any inconsistency between the usage in this document and any other document incorporated by reference, the usage in this document shall prevail.
[0056] In this document, as is common in patent literature, the terms "a" or "an" are used to include one or more, regardless of any other instance or use of "at least one" or "one or more". In this document, unless otherwise indicated, the term "or" is used to refer to a non-exclusive "or", such that "A or B" includes "A but not B", "B but not A", and "A and B". In this document, the terms "comprising" and "in..." are used as concise Chinese equivalents of the corresponding terms "comprising" and "wherein". Furthermore, the terms "comprising" and "including" are open-ended, meaning that a system, apparatus, article, composition, formulation, or process that includes elements other than those listed after this term is still considered to fall within the scope of the subject matter discussed. Additionally, as may appear in the claims, the terms "first", "second", and "third", etc., are used only as designations and are not intended to impose numerical requirements on their subject matter.
[0057] The above description is intended to be illustrative and not restrictive. For example, the above examples (or one or more aspects of the above examples) can be used in combination with each other. After reviewing the above description, those skilled in the art can use other embodiments. An abstract is provided to enable the reader to quickly determine the nature of the technical disclosure. The abstract is submitted on the understanding that it will not be used to define or limit the scope or meaning of the claims. Furthermore, in the above detailed description, various features may be combined to simplify this disclosure. This should not be construed as meaning that all unclaimed disclosed features are necessary for any claim. Rather, the subject matter of the invention may lie in fewer than all features of a particular disclosed embodiment. The appended aspects are thus incorporated into the detailed description as examples or embodiments, wherein each aspect exists independently as a separate embodiment, and it is contemplated that such embodiments can be combined with each other in various combinations or arrangements.
Claims
1. An image enhancement system for enhancing two-dimensional display images, the image enhancement system comprising: First light source; A first optical path, configured to project a first pattern of light provided by the first illumination source onto the surface of the anatomical target; A sensor configured to detect light reflected from the surface and transmit an image signal based on the light reflected from the surface; as well as An imaging system configured to receive the image signal, detect a second pattern of light reflected from the surface, and determine contour and depth information of the surface of the anatomical target based on the difference between the first pattern and the second pattern, and the imaging system configured to display an enhanced two-dimensional representation of the two-dimensional display image with enhanced three-dimensional cues on a display, the enhanced two-dimensional representation including the two-dimensional display image with adjusted shading based on the contour and depth information.
2. The image enhancement system according to claim 1, wherein, The first illumination source is configured to produce coherent light.
3. The image enhancement system according to claim 1, wherein, The first illumination source is configured to generate polarized light.
4. The image enhancement system according to claim 3, wherein, The first optical path is configured to project at least two different beams toward the surface; and The first pattern is the interference pattern of the at least two different light beams on the surface.
5. The image enhancement system according to claim 4, wherein, The first illumination source is configured to project a single beam of light; and The first optical path includes a beam splitter to provide the at least two different beams.
6. The image enhancement system according to claim 1, wherein, The first optical path is configured to extend through the endoscope or laparoscope to the anatomical target.
7. The image enhancement system according to claim 1, wherein, The imaging system includes a display; and The imaging system is configured to visually distinguish the contour information via the display.
8. The image enhancement system of claim 1, further comprising a second illumination source configured to illuminate the anatomical target with second light via a second optical path.
9. A method for detecting three-dimensional cues from an anatomical target, the method comprising: A first pattern of light is projected onto the anatomical target, the first pattern of light being configured to display specified characteristics in response to being applied to a reference target; A second pattern of light redirected from the anatomical target is detected at the optical sensor; Analyze the differences between the first pattern and the second pattern to provide contour and depth information of the anatomical target; as well as An enhanced two-dimensional representation of the anatomical target is displayed on a monitor, the enhanced two-dimensional representation comprising a two-dimensional display image with coloring based on the contour information and the depth information.
10. The method of claim 9, comprising: An enhanced two-dimensional image of the anatomical target is displayed using three-dimensional cues based on the contour information.
11. The method according to claim 10, wherein, The enhanced two-dimensional image does not include the second pattern.
12. The method according to claim 9, wherein, Projecting the first pattern involves illuminating the anatomical target with two different polarized light beams.
13. The method according to claim 12, wherein, The first pattern is formed by the interference of the first beam of two polarized beams with the second beam of the two polarized beams.
14. The method according to claim 13, wherein, The polarized light is coherent light.
15. The method according to claim 9, wherein, Projecting the first pattern includes generating a laser beam to form the first pattern.
16. The method according to claim 15, wherein, Projecting the first pattern includes splitting the laser beam into two laser beams using a beam splitter located within the channel of an endoscope or laparoscope.
17. The method according to claim 16, wherein, The projection includes projecting two light beams from the ends of two optical media at the distal end of the endoscope or laparoscope onto the anatomical target.
18. The method according to claim 9, wherein, Detecting the second pattern includes detecting the second pattern at an optical sensor located at the distal end of an endoscope or laparoscope.
19. The method according to claim 18, wherein, Projecting a first pattern of light onto the anatomical target includes projecting a first pattern of light from a first illumination source onto the anatomical target; and The method includes illuminating the target with a second illumination source, wherein the second illumination source is part of an endoscope or laparoscopic system.
Citation Information
Patent Citations
Apparatus and method of texture mapping for dental 3d scanner
CN107257992A
Endoscope system
JP2004121546A
Endoscope system
JP2016198304A