Depth and Contour Detection of Anatomical Landmarks

Abstract

Techniques are provided for detecting depth contours of anatomical landmarks and for enhancing imaging of anatomical landmarks. In one example, a fiducial pattern of light can be projected across the anatomical landmark, and an image of the light pattern reflected on the anatomical landmark can be captured. The captured light pattern can be analyzed to determine contour information, which can then be used to provide 3D cues for enhancing the two-dimensional image of the anatomical landmark.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 061,249, filed August 5, 2020, the contents of which are incorporated by reference in their entirety.

[0002] The present disclosure relates to landmark identification, and more particularly, to techniques for detecting the contour and depth of anatomical landmarks. [Background technology]

[0003] A medical scope allows a user to inspect hidden areas of a patient. Certain medical scopes, such as endoscopes and laparoscopes, were first developed in the early 1800s and have been used to inspect the inside of a patient's body. A medical scope may include an optical sensor, such as a camera, for imaging an area at the distal end of the scope, and a control located at the end proximal to the user for manipulating the distal end of the scope. A shaft may pass signals and provide a link between the proximal and distal ends of the scope. Some shafts may be flexible and some shafts may be rigid. Some medical scopes allow a user to pass a tool or treatment through a channel in the shaft, for example to cut tissue or remove an object.

[0004] Effective use of a medical scope depends on several factors, including experience, dexterity, and visual cues. Medical scopes that allow interaction within small, confined spaces on a patient's body can use a screen or monitor to provide an image of the area around the distal end of the medical scope. Summary of the Invention [Problem to be solved by the invention]

[0005] Improving the displayed image can help enable better visual cues and therefore more effective use of the medical scope. Techniques for detecting the depth and contour of an anatomical landmark and for enhancing the imaging of the anatomical landmark are described herein. In one example, a light pattern can be projected across an anatomical landmark and an image of the light pattern on the anatomical landmark can be captured. The captured light pattern can be analyzed and used to help enhance the two-dimensional image of the anatomical landmark. [Means for solving the problem]

[0006] This section is intended to provide an overview of the subject matter of this patent application. It is not intended to provide an exclusive or exhaustive description of the invention. The detailed description is included to provide further information about this patent application. [Brief description of the drawings]

[0007] [Figure 1] 1 illustrates generally an example system 100 for enhancing images in accordance with the present subject matter. [Figure 2A] FIG. 1 illustrates the general effect of projecting a spatial light pattern onto an anatomical landmark. [Figure 2B] FIG. 1 illustrates the general effect of projecting a spatial light pattern onto an anatomical landmark. [Figure 2C] FIG. 1 illustrates the general effect of projecting a spatial light pattern onto an anatomical landmark. [Figure 2D] FIG. 1 illustrates the general effect of projecting a spatial light pattern onto an anatomical landmark. [Diagram 3] FIG. 3 illustrates general details of an example system 300 for enhancing images in accordance with the present subject matter. [Figure 4] FIG. 4 generally illustrates an example system 400 for enhancing 3D cues in images provided using a medical scope 301. [Diagram 5]1A-1D generally illustrate an example method for enhancing a 2D image of an anatomical landmark to provide 3D cues. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] During a medical procedure, such as an endoscopic procedure to administer treatment to tissue or remove unwanted material such as calculi ("stones") or tumors, a physician can control the position of the fiber optic tip and the resulting laser beam point while viewing real-time images captured by an endoscopic camera. One approach can provide camera images that are two-dimensional (x,y) but do not provide depth-scaled visualization or provide visual depth cues. Without visual depth cues, steering and positioning the endoscope position and fiber optic tip in the axial depth direction can be difficult.

[0009] In endoscopic and laparoscopic procedures, success depends on the positioning of the distal end of the scope to achieve the desired results. In addition to pointing the end of the fiber tip at the anatomical landmark, the distance of the fiber tip from the anatomical landmark can also affect the effectiveness of a single treatment. 2D imaging techniques can provide good two-dimensional visual cues, but lack effective three-dimensional visual cues. For example, in some cases of tumor removal, the lack of good visual depth cues can lengthen medical procedure procedures by requiring the physician to first view the target tumor multiple times from various directions beforehand and then administer the treatment. This technique, which involves multiple views from different directions, is a redundant way for the user to evaluate the 3D characteristics of the tumor, the 3D characteristics of any healthy tissue near the tumor, or both.

[0010] The inventors describe techniques to, among other things, help improve three-dimensional cues, particularly visual depth and visual contour cues, of two-dimensional images provided via a medical scope. Figure 1 generally illustrates an example of portions of a system 100 for enhancing an image. The system 100 can include a medical scope 101, such as for viewing an anatomical landmark 102 or target area 103, an imaging system 104, and a pattern illumination system 105.

[0011] The medical scope 101 can provide a view of a target area 103 or a particular anatomical landmark 102 of a patient. Examples of such medical scopes 101 include, but are not limited to, endoscopes, laparoscopes, or variations and other types of scopes, such as those that can be used for diagnostic or surgical procedures or both. The medical scope 101 can include a camera 106 or image sensor, such as for electronically capturing a representation of an image of the target area 103 or anatomical landmark 102. The medical scope 101 can include one or more channels 107, 111, 113, such as for extending one or more instruments from one end, a proximal end 108, of the medical scope 101 to the other end, a distal end 109, of the medical scope 101. For example, the first channel 111 can include one or more wires or fibers, such as for conveying or communicating information between a camera and an imaging system. The medical scope 101 may include or be coupled with an optional light source 114, such as for illuminating or flooding the target area 103 with light, so that the camera 106 can capture one or more images of the target area 103 and any anatomical landmarks 102. In such a configuration, the second channel 113 may provide an optical pathway for carrying light from the proximal end 108 to the distal end 109 of the medical scope 101. The channel 107 of the medical scope 101 may provide an optical pathway, such as for one or more optical fibers of the pattern illumination system 105. At the distal end of the channel 107, light from one or more optical fibers may be projected toward the target area 103.

[0012] The pattern illumination system 105 can provide light for projecting a spatial light pattern onto the target area 103, including onto the anatomical landmark 102. The pattern illumination system 105 can include a laser or other light source. The light projected from the light source can be configured to form a specified projection pattern at the anatomical landmark 102 or the target area 103. The specified first pattern of light can have specified characteristics that achieve a reference response pattern when projected onto and reflected from a plane at a given distance from the end of the channel 107. Such characteristics include, but are not limited to, spacing between attributes of the reference response pattern, thickness of a shadow or column of light of the reference response pattern, etc. When reflected from a non-plane surface or from a plane at a different distance from the end of the channel 107, such as when reflected from a non-plane surface or from a plane at a different distance from the end of the channel 107 rather than the given distance, the camera 106 can capture a second pattern of reflected light via one or more optical fibers. The imaging system 104 can analyze the difference between the second pattern of reflected responses and the projected first pattern, and from such analysis can detect and measure contour and depth information related to the target area 103 or the anatomical landmarks 102 in the target area 103. The imaging system 104 can then augment the two-dimensional image with shading, such as to add or emphasize three-dimensional cues that can be included with the two-dimensional image to visually distinguish depth and contour information. Shading can include visual modulation of light intensity or spatial modulation of light, for example, to indicate depth or contour.

[0013] The added or enhanced three-dimensional cues can help provide useful spatial context to the user, which in turn can help enable the user to better three-dimensionally position the distal end of the medical scope 101 or one or more instruments utilized with the medical scope 101. This can help to avoid or reduce or minimize the number of different directional "gazings" that a user may otherwise need to perform a successful procedure, such as a laser treatment procedure.

[0014] 2A-2D broadly illustrate the effect of projecting a light pattern onto an anatomical target. FIG. 2A illustrates an example of a light pattern that can be cast onto a plane from an illumination system employing a medical scope. The pattern can include a pattern of designated lines that, when projected onto an orthogonal plane, result in a certain spacing and thickness, etc. In some examples, the spacing and thickness can be approximately equal when projected onto the orthogonal plane, such as to achieve one or more of even spacing between the lines, equal thickness of the lines, or both spacing and thickness being equal to each other. However, when the pattern is cast onto a surface or portion of a surface that is not orthogonal but instead at a non-zero angle to the orthogonal plane, the thickness and spacing of the lines may vary depending on the magnitude, direction or orientation of the angle, and the direction of the projected lines relative to such angle. FIG. 2B generally illustrates a two-dimensional image of an anatomical target (e.g., a kidney stone or tumor) that can appear on the screen of an imaging system employing a medical scope. A two-dimensional image can show a user a very good outline of the stone or tumor, but cannot provide any additional 3D cues. FIG. 2C generally illustrates the tumor or kidney stone of FIG. 2B, where a light pattern, such as that of FIG. 2A, is cast across the tumor or kidney stone. The light pattern reflected from the stone's surface as well as the area's background can help highlight 3D artifacts of the anatomical landmark and the target area that may be hidden in the two-dimensional image due to glare, texture fluctuation, illumination angle, etc. The 3D cues can be seen due to line distortions of the reflected light pattern compared to a reference response pattern or projected pattern, such as the pattern of FIG. 2A. In certain examples, the imaging system can analyze one or more of the line fluctuations and changes in line thickness and line spacing to provide 3D information about the landmark. As illustrated in FIG. 2D, the imaging system can augment the two-dimensional image based on the 3D information to provide an augmented two-dimensional image with 3D cues for the observer. For example, the augmented view provided by the imaging system may include additional or enhanced shading to accentuate 3D cues.In some examples, the augmented display does not include a line pattern. In some examples, the augmented display can include visual and text-based displays of data related to the orientation of the instrument's fiber relative to the anatomical landmark. Such data includes, but is not limited to, the distance between the tip of the fiber and the surface of the anatomical landmark, the angle of the surface relative to the trajectory of the fiber, etc. In certain examples, information can be displayed that allows for the conversion of a 2D image to a 3D image.

[0015] FIG. 3 generally illustrates details of portions of an example system 300 for enhancing images according to the present subject matter. In certain examples, the system 300 of FIG. 3 may be a more detailed view of the example system 100 of FIG. 1. The system 300 may include a medical scope 301 for viewing an anatomical landmark 302 or target area 303, an imaging system 304, and a pattern illumination system 305. In certain examples, the system 300 or medical scope may include a second illumination source (not shown) for illuminating or flooding the target area 303 with light, so that the imaging system can capture images of the target area 303 and any anatomical landmarks 302. The medical scope 301 may include a shaft 310 for extending into an opening or through an incision in the patient. The shaft 310 may include a number of channels 307, 311, and an optical sensor 306. The first channel 311 can be used to carry image signals from an optical sensor 306 disposed at the distal end 309 of the shaft 310 to an imaging system 304 coupled to the proximal end 308 of the shaft 310. The second channel 307 can be used as an optical path to carry light of a pattern illumination system 305 to the anatomical target 302 or target area 303 to project a pattern of light across the anatomical target 302 or target area 303. At the distal end 309 of the shaft 310, light can be projected from the optical path through two locations or two areas. The purpose of projecting light from two points toward the anatomical target 302 is to allow the light from each point to interfere with each other to form an interference pattern across the field of view or target area 303. In certain instances, polarized light projected across the anatomical target from two separate areas of the optical path can form a clear interference pattern. The polarization of light can be used to achieve enhanced clarity. A more distinct pattern can be achieved using coherent polarized light compared to using incoherent unpolarized light.

[0016] In certain examples, the second channel 307 can include a beam splitter 312 for forming two beams of light from a single beam of light of the light source of the pattern illumination system 305. For example, the light source light can be conveyed from the light source of the pattern illumination system 305 to the beam splitter 312 via a single optical medium, such as an optical cable or optical fiber. At the beam splitter 312, the light can be further conveyed to the distal end 309 as two different beams via two optical paths. In some examples, the distal end 309 of the optical paths can project each of the two beams of light such that the light appears to project through two slits at the end of the optical paths to achieve an interference pattern. In certain examples, the light can be conveyed from the pattern illumination system 305 via a single mode optical fiber or a single mode optical fiber cable.

[0017] The imaging system 304 can capture image information from signals provided by the optical sensor 306. In certain examples, the imaging system 304 can include an input processing circuit 321, a 2D image processing circuit 322, a 3D artifact circuit 323, and a display interface circuit 324. The input processing circuit 321 can separate the image information into first image information related to providing a 2D image of the anatomical landmark 302 or target area 303 and second image information related to an interference pattern as captured on a surface of the anatomical landmark 302 or target area 303. The 2D image processing circuit 322 can process the first image information for receipt at the display interface circuit 324. The 3D artifact circuit 323 can process the second image information to enhance the 2D image. For example, the 3D artifact circuit 323 can analyze the interference pattern of the second image information, including measuring the deviation of the interference pattern compared to a reference pattern, to extract 3D cues about the anatomical landmark 302 or target area 303. The analysis can enable the display interface circuit 324 to augment the 2D image information received from the 2D image processing circuit 322 with information provided by the 3D artifact circuit 323 and guide image augmentation techniques to provide or accentuate 3D cues in the augmented 2D image. In certain examples, the techniques can include varying or adding shading or coloring of the 2D image based on the interference pattern to achieve the augmented 2D image. The augmented 2D image can be displayed on the monitor 325 of the imaging system to assist the user of the medical scope 301 in positioning the distal end of the medical scope 301 relative to an anatomical landmark, as well as in positioning a treatment device relative to an anatomical landmark for effective and efficient use of treatment.

[0018] FIG. 4 generally illustrates an example system 400 for enhancing 3D cues of an image provided using a medical scope 301. The system 400 of FIG. 4 is a modification of the system 300 of FIG. 3. In certain examples, the system 400 of FIG. 4 may be a more detailed view of the example system 100 of FIG. 1. The system 400 may include a medical scope 301 for viewing an anatomical landmark 302 or target area 303, an imaging system 304, and a pattern illumination system 405. The medical scope 301 may include a shaft 310 for extending into an opening or through an incision in a patient. The shaft 310 may include a number of channels 307, 311, and an optical sensor 306. The first channel 311 may be used to carry an image signal from the optical sensor 306 disposed at a distal end 309 of the shaft 310 to an imaging system 304 coupled to a proximal end 308 of the shaft 310. The second channel 307 can be used as an optical path to carry the light of the pattern illumination system 305 to the anatomical target 302 or the target area 303 to project a pattern of light across the anatomical target 302 or the target area 303. At the distal end 309 of the shaft 310, the light can be projected from the optical path through two points or two areas. The purpose of projecting light from two points towards the anatomical target 302 is to allow the light from each point to interfere with each other to form an interference pattern across the field of view or the target area 303. In certain instances, polarized light projected across the anatomical target from two separate areas of the optical path can form a clear interference pattern. The clarity comes from the polarization of the light. A more distinct pattern can be achieved using coherent polarized light compared to using non-coherent non-polarized light.

[0019] In certain examples, instead of a beam splitter, the light from the pattern illumination system can be conveyed through the second channel 307 via two separated optical media, such as two optical fibers, to form two beams of light from the light source of the pattern illumination system 405. In some examples, the distal end 309 of the optical path can project each of the two beams of light such that the light appears to project through two slits at the end of the optical path. In certain examples, the light can be conveyed from the pattern illumination system 405 via a single mode optical fiber or single mode optical fiber cable.

[0020] The imaging system 304 can capture image information from signals provided by the optical sensor 306. In certain examples, the imaging system 304 can include an input processing circuit 321, a 2D image processing circuit 322, a 3D artifact circuit 323, and a display interface circuit 324. The input processing circuit 321 can separate the image information into first image information related to providing a 2D image of the anatomical landmark 302 or target area 303 and second image information related to an interference pattern as captured on a surface of the anatomical landmark 302 or target area 303. The 2D image processing circuit 322 can process the first image information for receipt at the display interface circuit 324. The 3D artifact circuit 323 can process the second image information to enhance the 2D image. For example, the 3D artifact circuit 323 can analyze the interference pattern of the second image information, including measuring the deviation of the interference pattern compared to a reference pattern, to extract 3D cues about the anatomical landmark 302 or target area 303. The analysis can enable the display interface circuit 324 to augment the 2D image information received from the 2D image processing circuit 322 with information provided by the 3D artifact circuit 323 and guide the technique to make the 3D cues stand out in the new 2D image. In certain examples, the technique can include altering or adding shading to the 2D image based on the interference pattern to achieve the augmented 2D image. The augmented 2D image can be displayed on the monitor 325 of the imaging system to assist the user of the medical scope 301 in positioning the distal end of the medical scope 301 relative to the anatomical landmark, as well as in positioning the treatment device relative to the anatomical landmark for effective and efficient use of the treatment.

[0021] 3 and 4 illustrate the use of interference to generate a light pattern that is projected onto the anatomical landmark. Other methods of generating a pattern can also include using a pattern filter to project the light pattern, such that the pattern filter can block light and cast a pattern of light and shadow on the anatomical landmark. Such a filter can include a layer of glass that includes a pattern filter. In some examples, the system can include a scanning laser that can direct, scan, or continuously move a laser beam in a pattern to project the pattern onto the anatomical landmark.

[0022] FIG. 5 generally illustrates an exemplary method of enhancing a 2D image of an anatomical landmark to provide 3D cues. At 501, a specified first pattern of light may be cast on the anatomical landmark. The first pattern of light, when cast on a specified surface at a specified distance, will have specified characteristics including, among other things, specified dimensions relating to distances between lines of the pattern, and specified thicknesses of light and shadow or dark areas of the pattern. At 503, a second pattern may be detected and captured by an optical sensor. The second pattern may be a result of reflection of the first pattern from the surface of the anatomical landmark. At 505, characteristics of the second pattern may be analyzed with reference to characteristics of the first pattern. The analysis may include creating data points of characteristic deviations of the second pattern from the first pattern, and deriving depth and contour information of the anatomical landmark from the data points such that 3D cues about the surface of the anatomical landmark may be detected and captured. Such 3D cues can be derived by the imaging system and used, for example, to provide an enhanced 2D image of an anatomical landmark for display to an endoscope or laparoscope user.

[0023] In certain instances, the augmented 2D image with additional 3D cues for anatomical landmarks accessible through the medical scope can further assist the user with visualization of the anatomical landmarks and surrounding areas as the laparoscopic or endoscopic procedure progresses. In certain instances, the illumination pattern used to detect the depth and contour of the anatomical landmarks during the procedure is not visible on the augmented 2D image so as not to interfere with the visualization. The augmented visualization can help shorten the procedure since the 3D cues can help the user reduce the number of "looking" movements of the procedure. In certain instances, the additional 3D cues can help reduce mental fatigue compared to a user using a non-augmented 2D image of the anatomical landmark. In some instances, the 3D cues of the augmented 2D image can help achieve a more effective treatment. For example, when treating a tumor via laser treatment, the depth of treatment can be controlled by administering the laser treatment at a distance from the anatomical landmark surface of the tumor and at an angle to the tumor surface. An angle less than perpendicular to the plane of the tumor surface typically results in a lesser depth of treatment being administered. The enhanced 2D images provided in accordance with the present subject matter can provide cues around the contours and undulations of the tumor surface, such that the angle of treatment can be adjusted to account for the contours and undulations, which can result in more precise application of treatment.

[0024] Notes and Examples In a first example, Example 1, i.e., an image enhancement system for enhancing a two-dimensional display image, the image enhancement system may include a first illumination source, a first optical path configured to project a first pattern of light provided by the first illumination source onto a surface of an anatomical landmark, a sensor configured to detect light reflected from the surface and transmit an image signal, where the image signal is based on the light reflected from the surface, and an imaging system configured to receive the image signal, detect a second pattern of light reflected from the surface, and determine contour information of the surface of the anatomical landmark based on the second pattern of light.

[0025] In Example 2, the subject matter of Example 1 includes where the first illumination source is configured to generate coherent light.

[0026] In Example 3, the subject matter of Examples 1-2 includes where the first illumination source is configured to generate polarized light.

[0027] In Example 4, the subject matter of Example 3 includes the first optical path being configured to project at least two separate beams of light toward the surface, and the first pattern being an interference pattern of the at least two separate beams at the surface.

[0028] In Example 5, the subject matter of Example 4 includes wherein the first illumination source is configured to project a single beam of light and the first optical path includes a beam splitter for providing at least two separate beams.

[0029] In Example 6, the subject matter of Examples 1-5 includes wherein the first optical pathway is configured to extend through an endoscope or laparoscope to the anatomical target.

[0030] In Example 7, the subject matter of Examples 1-6 includes the imaging system including a display, the imaging system configured to visually distinguish the contour information via the display.

[0031] In Example 8, the subject matter of Example 7 includes wherein the D representation includes an image having shading adjusted based on the contour information.

[0032] In Example 9, the subject matter of Examples 1-8 includes a second illumination source configured to illuminate the anatomical target with a second light via a second optical path.

[0033] Example 10 is a method for detecting three-dimensional (3D) cues from an anatomical landmark, the method including projecting a first pattern of light onto the anatomical landmark, the first pattern of light configured to display specified characteristics in response to application onto a reference landmark; detecting at an optical sensor a second pattern of light redirected from the anatomical landmark; and analyzing characteristics of the second pattern with the specified characteristics to provide contour information of the anatomical landmark.

[0034] In Example 11, the subject matter of Example 10 includes a D-cue based on contour information.

[0035] In Example 12, the subject matter of Example 11 includes the D image not including the second pattern.

[0036] In Example 13, the subject matter of Examples 10-12 includes where the step of projecting the first pattern includes illuminating the anatomical target with beams of two separate polarizations.

[0037] In Example 14, the subject matter of Example 13 includes the first pattern being formed from interference of a first one of the beams of two polarized light and a second one of the beams of two polarized light.

[0038] In Example 15, the subject matter of Example 14 includes that the polarized light is coherent light.

[0039] In Example 16, the subject matter of Examples 10-15 includes where projecting the first pattern includes generating a laser beam to form the first pattern.

[0040] In Example 17, the subject matter of Example 16 includes the step of projecting the first pattern including splitting the laser beam into two beams of laser light using a beam splitter disposed within a channel of the endoscope or laparoscope.

[0041] In Example 18, the subject matter of Example 17 includes where the projecting step includes projecting two beams from ends of two optical media onto the anatomical target at a distal end of the endoscope or laparoscope.

[0042] In Example 19, the subject matter of Examples 10-18 includes where detecting the second pattern includes detecting the second pattern with an optical sensor positioned at a distal end of the endoscope or laparoscope.

[0043] In Example 20, the subject matter of Example 19 includes the step of projecting a first pattern of light onto the anatomical target including projecting a first pattern of light from a first illumination source onto the anatomical target, and the method includes illuminating the target using a second illumination source, and the second illumination source is part of an endoscopic or laparoscopic system.

[0044] Example 21 is at least one machine-readable medium including instructions that, when executed by a processing circuit, cause the processing circuit to perform operations to implement any of Examples 1-20.

[0045] Example 22 is an apparatus equipped with means for carrying out any one of Examples 1 to 20.

[0046] Example 23 is a system for carrying out any one of Examples 1 to 20.

[0047] Example 24 is a method for carrying out any of Examples 1-20.

[0048] The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, for illustration purposes, specific embodiments in which the invention may be practiced. These embodiments are also referred to herein as "examples." Such examples may include elements in addition to those shown or described. However, the inventors also contemplate examples in which only those elements shown or described are provided. Furthermore, the inventors also contemplate examples that use any combination or permutation of those elements (or one or more aspects thereof) shown or described with respect to a particular example (or one or more aspects thereof) shown or described herein, or with respect to other examples (or one or more aspects thereof).

[0049] In the event of a conflict in usage between this document and any document incorporated by reference, the usage in this document takes precedence.

[0050] In this document, the terms "a" or "an" are used to include one or more than one, as is common in patent documents, independent of any other instance or usage of the terms "at least one" or "one or more." In this document, the term "or" is used to refer to a non-exclusive logical or, so that "A or B" includes "A but not B," "B but not A," and "A and B," unless otherwise specified. In this document, the terms "including" and "in which" are used as the plain English equivalents of the respective terms "comprising" and "wherein." Additionally, the terms "including" and "comprising" are open-ended, i.e., systems, devices, articles, compositions, formulations, or processes that include elements in addition to those listed after such terms, are still considered to be within the scope of the subject matter discussed. Moreover, the terms "first," "second," and "third," etc., as they may appear in the claims, are used merely as labels and are not intended to impose numerical requirements on their objects.

[0051] The above description is intended to be illustrative and not limiting. For example, the above examples (or one or more aspects thereof) can be used in combination with each other. Other embodiments can be used by those skilled in the art upon review of the above description. The Abstract is provided to enable the reader to quickly ascertain the nature of the present technical disclosure. The Abstract has been submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Also, in the above Detailed Description, various features may be grouped together to simplify the disclosure. This should not be construed as intending that unclaimed disclosed features are essential to any claim. Rather, the subject matter of the present invention may lie in less than all features of a particular disclosed embodiment. The following aspects are incorporated herein as examples or embodiments into the detailed description, and each aspect stands alone as a separate embodiment, and it is intended that such embodiments can be combined with each other in various combinations or permutations. [Explanation of symbols]

[0052] 100 Systems 101 Medical Scope 102 Anatomical Goals 103 Target area 104 Imaging systems, image systems 105 Pattern Irradiation System 106 Camera 107 Channels 108 Proximal end 109 Distal end 111 First Channel 113 Second Channel 114 Optional Light Source 300 Systems 301 Medical Scope 302 Anatomical Goals 303 Target Area 304 Imaging systems, image systems 305 Pattern Irradiation System 306 Optical Sensor 307 Second Channel 308 Proximal end 309 Distal end 310 Shaft 311 First Channel 312 Beam splitter 321 Input Processing Circuit 322 2D image processing circuit 323 3D Artifact Circuit 324 Display Interface Circuit 325 Display, Monitor 400 Systems 405 Pattern Irradiation System

Claims

1. 1. An image enhancement system for enhancing a two-dimensional image, comprising: A first illumination source; and a first optical path configured to project a first pattern of light provided by the first illumination source and a pattern filter onto a surface of an anatomical landmark; a sensor configured to detect light reflected from the surface and transmit an image signal, the image signal being based on the light reflected from the surface; and an imaging system configured to receive the image signal, detect a second pattern of light reflected from the surface, and determine contour and depth information of the surface of the anatomical landmark based on a difference between the first and second patterns, the image enhancement system further configured to visually distinguish the contour and depth information via a display, and to project on a display a three-dimensional (3D) cue enhanced two-dimensional (2D) representation of the two-dimensional image with shading adjusted based on the contour and depth information; An image enhancement system comprising:

2. The image enhancement system of claim 1 , wherein the first illumination source is configured to generate coherent light.

3. The image enhancement system of claim 1 , wherein the first optical path is configured to extend to the anatomical landmark through an endoscope or laparoscope.

4. The image enhancement system of claim 1 , further comprising a second illumination source configured to illuminate the anatomical landmark with a second light via a second optical path.

5. 1. A method for enhancing a two-dimensional image by detecting three-dimensional (3D) cues from an anatomical landmark, comprising: projecting a first pattern of light onto the anatomical landmark with a pattern filter, the first pattern of light configured to display specified characteristics in response to application onto a reference landmark; detecting a second pattern of light redirected from the anatomical landmark at an optical sensor; analyzing differences between the first and second patterns at the specified characteristics to determine contour and depth information of the anatomical landmark; visually distinguishing the contour and depth information via a display; and projecting a three-dimensional (3D) cue-enhanced two-dimensional (2D) representation of the two-dimensional image on the display with adjusted shading based on the contour and depth information. A method comprising:

6. The method of claim 5 , wherein the enhanced 2D image does not include the second pattern.

7. The method of claim 5 , wherein the step of projecting the first pattern comprises the step of generating a laser beam to form the first pattern.

8. The method of claim 5 , wherein the step of detecting the second pattern comprises detecting the second pattern with an optical sensor positioned at a distal end of an endoscope or laparoscope.

9. wherein said step of projecting a first pattern of light onto the anatomical landmark comprises projecting a first pattern of light from a first illumination source onto the anatomical landmark; The method includes illuminating the anatomical landmark using a second illumination source; The method of claim 8 , wherein the second illumination source is part of an endoscopic or laparoscopic system.

Images