Multifocal multi-camera endoscope system

The multifocal, multi-camera endoscopic system addresses space constraints and magnification issues by zooming in on one image and hiding others, ensuring clear object identification and comfort in a compact design.

JP7750802B2Active Publication Date: 2025-10-07ENDOCHOICE INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022110645
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2014-07-28
Filing Date
2022-07-08
Publication Date
2025-10-07
Estimated Expiration
2035-07-21

AI Technical Summary

Technical Problem

Existing multi-camera endoscopes face challenges with limited space at the tip, requiring multiple motor-driven lenses that cause disorientation and discomfort due to magnification differences between images, and struggle to maintain a compact form while providing clear object identification and magnification.

Method used

A multifocal, multi-camera endoscopic system with optical assemblies that generate multiple images, using a processing system to zoom in on one image for magnification and automatically hide others, reducing power or illumination to non-focused images, and incorporating telescopic spacers and light conditioning elements to maintain compactness and clarity.

Benefits of technology

The system allows for comfortable and clear identification of objects of interest by focusing on a single magnified image, reducing operator discomfort and disorientation, while maintaining a compact endoscope tip size.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007750802000001
    Figure 0007750802000001
  • Figure 0007750802000002
    Figure 0007750802000002
  • Figure 0007750802000003
    Figure 0007750802000003
Patent Text Reader

Abstract

Small and compact, yet comfortable to identify and magnify objects of interest during endoscopic procedures. [Solution] A distal end portion of an endoscope includes a first optical assembly that generates a first image of a body cavity, a second optical assembly that generates a second image of the body cavity, and at least one illuminator associated with each of the first and second optical assemblies. The first optical assembly includes a first lens having a first depth of field and a first optical axis, and a second lens having a second depth of field and a second optical axis, the second depth of field being different from the first depth of field. The first lens is movable between a first position and a second position on a path that intersects the first optical axis, and the first lens is movable in a first plane, while the second lens is movable in a second plane different from the first plane.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application relies on and claims priority to U.S. Provisional Patent Application No. 62 / 027,005, filed July 21, 2014, entitled "Multi-Focal, Multi-Camera Endoscope Systems," and U.S. Provisional Patent Application No. 62 / 029,764, filed July 28, 2014, entitled "Multi-Focal, Multi-Camera Endoscope Systems," the entire contents of which are incorporated herein by reference.

[0002] The present specification relates generally to multi-camera endoscopic systems, and more particularly to endoscopic systems that include at least one multi-focal optical assembly and / or at least one type of light conditioning element. [Background technology]

[0003] Some endoscopes, including high-resolution endoscopes, have a lens assembly at the tip of the endoscope that includes a motor-driven movable lens, allowing the endoscope to be moved closer to an object of interest (such as a lesion, mucosa, polyp, or adenoma) while controlling the focal length, thereby obtaining a magnified image of the object of interest.

[0004] A multi-camera endoscopic system can include multiple screen displays configured to simultaneously display multiple images captured by multiple cameras. The multi-screen display provides the operator with an expanded 330° field of view, allowing them to easily identify, inspect, and process objects of interest during an endoscopic procedure. U.S. Patent Application No. 14 / 263,896, filed April 28, 2014, entitled "Video Processing In a Compact Multi-Viewing Element Endoscope System," is incorporated herein by reference in its entirety. U.S. Patent Application No. 14 / 273,923, filed May 9, 2014, entitled "Operational Interface In A Multi-Viewing Element Endoscope," is also incorporated herein by reference in its entirety. Additionally, this specification is related to U.S. Patent Application No. 13 / 882,004 (filed April 26, 2013), entitled "Optical Systems for Multi-Sensor Endoscopes," the entire contents of which, along with the application from which priority is claimed, are incorporated herein by reference. Summary of the Invention [Problem to be solved by the invention]

[0005] However, zooming in on an image of one object by a certain percentage (which may be, for example, about 30% or more) while displaying other objects at a lower magnification on a multi-screen display can cause disorientation, eye strain, and general discomfort to the operator.

[0006] Furthermore, accommodating one or more lens assemblies, each with a motor-driven movable lens, requires a large amount of space, and space at the tip of a multi-camera endoscope is an extremely limited resource.

[0007] It would therefore be highly beneficial to provide a multifocal, multi-camera endoscopic system that is small and compact enough to fit within the limited volume of an endoscope tip, yet is able to comfortably identify and magnify objects of interest during use in an endoscopic procedure. [Means for solving the problem]

[0008] In some embodiments, the present specification discloses a distal portion of an endoscope comprising a first optical assembly that generates a first image of a body cavity, a second optical assembly that generates a second image of the body cavity, at least one light associated with each of the first optical assembly and the second optical assembly, and a processing system configured to zoom the first optical assembly to generate a magnified first image in place of the first image and to automatically cause a physical display to display only the magnified first image without displaying the second image.

[0009] Optionally, the tip section is part of an endoscope system and further comprises at least two screens for displaying the first and second images, respectively.

[0010] In some embodiments, at least one illuminator is sufficiently close so as to be the primary illuminator of the field of view of the associated optical assembly.

[0011] Optionally, the first image may overlap with the second image. Further optionally, the first image may not overlap with the second image. Optionally, "overlapping" may be defined as capturing views of the same physical entity.

[0012] Optionally, the processing system reduces power to the second optical assembly to stop displaying the second image.

[0013] Optionally, the processing system reduces the illuminance of the at least one illuminant associated with the second optical assembly to cease displaying the second image.

[0014] Optionally, the processing system powers down, dims or blacks out the physical display to stop displaying the second image.

[0015] In some embodiments, the first optical assembly can be a forward-facing optical assembly and the second optical assembly can be a first side-facing optical assembly.

[0016] Optionally, the tip portion further comprises a third optical assembly for generating a third image of the body cavity and displaying the third image on a corresponding third screen, the third optical assembly being a second side-facing optical assembly.

[0017] Optionally, at least one of the first optical assembly and the second optical assembly is configured to operate at a first working distance and a second working distance. Further optionally, the magnified first image is generated when the working distance of the at least one optical assembly is switched from the first working distance to the second working distance. Further optionally, the first working distance provides a magnification ranging from 100x to 6x. Further optionally, the second working distance provides a magnification ranging from 250x to 100x.

[0018] In some embodiments, the present specification discloses a method of using an endoscope having a tip portion comprising at least two optical assemblies and at least one light associated with each of the at least two optical assemblies, the method including: a generating step of generating at least two images of a body cavity from each of the at least two optical assemblies; a display step of displaying the at least two images, a first image and a second image, on a first screen and a second screen, respectively; a zoom step of zooming one of the at least two optical assemblies to generate and display an enlarged image in place of the first image of the at least two images; and a display stop step of automatically preventing the second image of the at least two images from being displayed on the second screen.

[0019] Optionally, the step of stopping the display is performed by reducing power to an optical assembly that generates said second of said at least two images.

[0020] Optionally, the display stopping step is enabled by reducing the illuminance of the at least one light associated with the optical assembly that generates the second of the at least two images.

[0021] Optionally, said ceasing display step is enabled by powering off, dimming or blacking out one of said at least two screens corresponding to the display of said second of said at least two images.

[0022] Optionally, a first optical assembly of said at least two optical assemblies is a forward-facing optical assembly and a second optical assembly of said at least two optical assemblies is a first side-facing optical assembly.

[0023] In some embodiments, the endoscope may further comprise a third optical assembly for generating a third image of the body cavity and displaying the third image on a corresponding third screen, the third optical assembly being a second side-facing optical assembly.

[0024] Optionally, at least one of the at least two optical assemblies is configured to operate at a first working distance and a second working distance. Further optionally, the magnified image is generated when the working distance of the optical assembly is switched from the first working distance to the second working distance. Further optionally, the first working distance provides a magnification ranging from 100x to 6x. Further optionally, the second working distance provides a magnification ranging from 250x to 100x.

[0025] In some embodiments, the present specification discloses an endoscopic system having a distal end, the distal end comprising: a forward-facing optical assembly that generates a first image of a body cavity at a first working distance and a second image at a second working distance, the forward-facing optical assembly comprising a first lens assembly mounted to a forward imaging sensor, the forward lens assembly comprising a first lens associated with the first working distance and a second lens associated with the second working distance; at least one side-facing optical assembly that generates at least one side image of the body cavity; at least one light associated with each of the forward-facing optical assembly and the at least one side-facing optical assembly; at least one actuating element disposed within the forward-facing optical assembly; and a processing system configured to enable the at least one actuating element to move the first lens out of an optical path connecting a line of sight from the forward imaging sensor to an object of interest within the body cavity and move the second lens into the optical path to generate the second image.

[0026] Optionally, the magnification of the first image produced at the first working distance is in the range of 100x to 6x. Optionally, the magnification of the second image produced at the second working distance is in the range of 250x to 100x.

[0027] Optionally, the at least one actuating element comprises at least one compressed air engine. Optionally, the at least one actuating element comprises a piezoelectric element, an electric engine, a solenoid, a nitinol engine, a compressed air engine, or a combination thereof.

[0028] Optionally, the endoscope system comprises a front screen and at least one side screen, the front screen configured to display the first image or the second image, and the at least one side screen configured to display the at least one side image.

[0029] In some embodiments, the processing system may be further configured to automatically stop displaying the at least one lateral image when moving the second lens into the optical path.

[0030] Optionally, the processing system stops displaying the at least one side image by removing or reducing power to the at least one side-pointing optical assembly.

[0031] Optionally, the processing system stops displaying the at least one side image by powering off or reducing the illumination of the at least one light associated with the at least one side-pointing optical assembly.

[0032] Optionally, the processing system stops displaying the at least one side image by powering off, dimming or blacking out the at least one side screen.

[0033] In some embodiments, the present specification discloses a distal portion of an endoscope, the distal portion comprising: a forward-facing optical assembly that generates a forward image of a body cavity; a first side-facing optical assembly including a first side lens assembly that generates a first image of the body cavity at a first working distance and a second image at a second working distance and that is mounted to a first side imaging sensor, the first side lens assembly being mounted to the first side imaging sensor and including a first lens associated with the first working distance and a second lens associated with the second working distance; one or more illuminators associated with each of the forward-facing optical assembly and the first side-facing optical assembly; one or more actuating elements disposed within the first side lens assembly; and a processor configured to enable the one or more actuating elements to move the first lens out of an optical path connecting a line of sight from the first side imaging sensor to an object of interest within the body cavity and move the second lens into the optical path to generate the second image.

[0034] Optionally, the magnification of the first image produced at the first working distance ranges from 100x to 6x. Still optionally, the magnification of the second image produced at the second working distance ranges from 250x to 100x.

[0035] Optionally, the one or more actuating elements comprise at least one compressed air engine. Further optionally, the one or more actuating elements may comprise any one or combination of a piezoelectric element, an electric engine, a solenoid, a nitinol engine, at least one compressed air engine.

[0036] Optionally, the processor is configured to display the front image on a front screen and the first or second image on a first side screen.

[0037] In some embodiments, the processor may be further configured to automatically stop displaying the forward image when moving the second lens into the optical path.

[0038] Optionally, the processor is configured to stop displaying the forward image by powering off or reducing the power supply to the forward facing optical assembly.

[0039] Optionally, the processor is configured to cease displaying the forward image by powering off or reducing the illumination of the one or more lights associated with the forward facing optical assembly. Optionally, the processor is configured to cease displaying the forward image by powering off, dimming or blacking out the front screen.

[0040] In some embodiments, the present specification discloses a distal portion of an endoscope, the distal portion comprising: a forward-facing optical assembly that generates a first image of a body cavity at a first working distance and a second image at a second working distance; at least one side-facing optical assembly that generates at least one lateral image of the body cavity; one or more illuminators associated with each of the forward-facing optical assembly and the at least one side-facing optical assembly; one or more spacers that are telescopically disposed at a distal end of the distal portion; and a processing system configured such that the one or more spacers can be deployed to an extended position to maintain a distance between the forward-facing optical assembly and a wall of the body cavity and retracted within the distal end of the distal portion.

[0041] Optionally, the distance generally corresponds to the second working distance.

[0042] Optionally, the one or more spacers each have a protruding length in the range of 1.5 millimeters to 7 millimeters.

[0043] Optionally, one or more spacers are positioned such that the distance between any two of said spacers is in the range of 8 millimeters to 10 millimeters.

[0044] Optionally, the magnification of the first image produced at the first working distance is in the range of 100x to 6x, and the magnification of the second image produced at the second working distance is in the range of 250x to 100x.

[0045] In some embodiments, the present specification discloses a distal portion of an endoscope, the distal portion comprising: a forward-facing optical assembly that generates a forward image; a first side-facing optical assembly that generates a first image at a first working distance and a second image at a second working distance; one or more illuminators associated with each of the forward-facing optical assembly and the side-facing optical assembly; three or more spacers that are telescopically mounted to a distal end of the distal portion and associated with the first side-facing optical assembly; and a processor configured to enable the three or more spacers to be deployed to an extended position to maintain a distance between the first side-facing optical assembly and a wall of a body cavity to generate the second image and retract the three or more spacers into the distal end of the distal portion.

[0046] Optionally, the distance generally corresponds to the second working distance.

[0047] Optionally, the three or more spacers have a radial protruding height in the range of 1.5 millimeters to 7 millimeters.

[0048] Optionally, three or more spacers are positioned such that the distance between any two consecutive said spacers is in the range of 8 millimeters to 10 millimeters.

[0049] Optionally, the magnification of the first image produced at the first working distance is in the range of 100x to 6x, and the magnification of the second image produced at the second working distance is in the range of 250x to 100x.

[0050] In some embodiments, the present disclosure provides a distal end portion of an endoscope, the distal end portion comprising at least one optical assembly configured to generate a first image of a body cavity at a first working distance and a second image at a second working distance shorter than the first working distance; one or more illuminators associated with the at least one optical assembly and configured to provide a first illumination mode associated with the first working distance and a second illumination mode associated with the second working distance; first and second light conditioning elements telescopically positioned on either side of the at least one optical assembly such that the optical assembly and the one or more illuminators are between the first and second light conditioning elements; and one or more illuminators. a third light adjusting element and a fourth light adjusting element attached to the illumination above, the third light adjusting element and the fourth light adjusting element passing light during the first illumination mode and diffusing light during the second illumination mode; and a processor configured to do one or both of the following: (1) when the at least one optical assembly is configured to generate the second image at the second working distance, the first light adjusting element and the second light adjusting element can be deployed, and the deployment of the first light adjusting element and the second light adjusting element changes the first illumination mode to the second illumination mode; and (2) when the at least one optical assembly is configured to generate the second image at the second working distance, the third and fourth light adjusting elements can diffuse light.

[0051] Optionally, the first light conditioning element and the second light conditioning element have surfaces with Lambertian reflection.

[0052] Optionally, the first light conditioning element and the second light conditioning element are balloons that are inflated for deployment.

[0053] Optionally, the third light-adjusting element and the fourth light-adjusting element are liquid crystal transmission screens.

[0054] Optionally, the deployed dimensions of the first light conditioning element and the second light conditioning element generally correspond to the second working distance.

[0055] Optionally, the magnification of the first image produced at the first working distance is in the range of 100x to 6x. Still optionally, the magnification of the second image produced at the second working distance is in the range of 250x to 100x.

[0056] Optionally, the first illumination mode is characterized in that the illumination range of the one or more illuminators is 150° to 170°, and the illumination light directly hits the abnormality in the body cavity. Optionally, the second illumination mode is characterized in that the illumination range of the one or more illuminators is 140° to 180°, and the oblique light of the illumination hits the abnormality in the body cavity.

[0057] Optionally, the first working distance is in the range of 4 millimeters to 100 millimeters and the second working distance is in the range of 1 millimeter to 4 millimeters.

[0058] In some embodiments, the present disclosure is directed to a method of using a distal portion of an endoscope having at least one optical assembly, at least one associated illuminator, and first, second, third, and fourth light adjusting elements, wherein the first light adjusting element and the second light adjusting element are telescopically disposed on either side of the at least one optical assembly such that the optical assembly and the one or more illuminators are between the first light adjusting element and the second light adjusting element, and the third light adjusting element and the fourth light adjusting element are attached to the one or more illuminators, the method of use comprising: the first light adjusting element and the second light adjusting element in a retracted configuration; and the third light adjusting element and the fourth light adjusting element in a first illumination mode and a front illumination mode. A method of using the distal end portion of an endoscope is disclosed, comprising the steps of: generating a first image of a body cavity at a first working distance using the at least one optical assembly while passing light from the one or more illuminators; generating a second image at a second working distance using the at least one optical assembly; and performing one or both of the following steps: (1) changing the first illumination mode of the one or more illuminators to the second illumination mode by deploying the first light adjusting element and the second light adjusting element; and (2) changing the first illumination mode of the one or more illuminators to the second illumination mode by allowing the third and fourth light adjusting elements to diffuse light.

[0059] Optionally, the first light conditioning element and the second light conditioning element have surfaces with Lambertian reflection.Optionally, the first light conditioning element and the second light conditioning element are balloons that are inflated for deployment.

[0060] Optionally, the third light-adjusting element and the fourth light-adjusting element are liquid crystal transmission screens.

[0061] Optionally, the deployed dimensions of the first light conditioning element and the second light conditioning element generally correspond to the second working distance.

[0062] Optionally, the magnification of the first image produced at the first working distance is in the range of 100x to 6x. Optionally, the magnification of the second image produced at the second working distance is in the range of 250x to 100x.

[0063] Optionally, the first illumination mode is characterized in that the illumination range of the one or more illuminators is 150° to 170°, and the illumination light directly strikes the abnormality in the body cavity.

[0064] Optionally, the second illumination mode is characterized in that the illumination range of the one or more illuminators is 140° to 180°, and oblique light rays of the illuminators are incident on the abnormality in the body cavity.

[0065] Optionally, the first working distance is in the range of 4 millimeters to 100 millimeters and the second working distance is in the range of 1 millimeter to 4 millimeters. [Brief explanation of the drawings]

[0066] [Figure 1] 1 is a cross-sectional view of a distal portion of a multi-camera endoscope having a multifocal forward-looking optical assembly, according to one embodiment. [Figure 2] 1 is a cross-sectional view of a distal portion of a multi-camera endoscope having a multifocal, forward-facing, compound optical assembly, according to one embodiment. [Figure 3A] FIG. 1 illustrates a multi-camera display system with three screens for displaying images and / or video captured by the distal end of a multi-camera endoscope. [Figure 3B] FIG. 3B illustrates the multi-camera display system of FIG. 3A, with the front-view screen displaying a magnified image of an anomaly identified by the multi-focal, forward-facing optical assembly. [Figure 3C] FIG. 3C illustrates the multi-camera display system of FIG. 3B with the first and second side-view screens disabled or darkened. [Figure 4] 1C shows the endoscope tip portion of FIGS. 1A and 1B with a plurality of distance-determining members in a deployed configuration. FIG. [Figure 5] 1 is a flowchart illustrating exemplary steps of a method for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal, forward-looking optical assembly of a multifocal, multi-camera endoscope tip. [Figure 6A] 1 is a cross-sectional view of a distal portion of a multi-camera endoscope having a multifocal first side-directing optical assembly, according to one embodiment. [Figure 6B] 1 is a cross-sectional view of a distal portion of a multi-camera endoscope having a multifocal first side-directing compound optical assembly, according to one embodiment. [Figure 7A] FIG. 1 illustrates a multi-camera display system with three screens for displaying images and / or video captured by the distal end of a multi-camera endoscope. [Figure 7B] 7B illustrates the multi-camera display system of FIG. 7A, with the first side-viewscreen displaying a magnified image of the anomaly identified by the multi-focal first side-directing optical assembly. FIG. [Figure 7C] FIG. 7C illustrates the multi-camera display system of FIG. 7B with the front and second side-view screen displays disabled or darkened. [Figure 8A] FIG. 1 illustrates a multifocal side-pointing optical assembly located within a body cavity at a distance from an object of interest that does not match the working distance of a multifocal side-pointing optical assembly used to obtain a magnified image of the object of interest. [Figure 8B] 8B shows the multifocal side-pointing optical assembly of FIG. 8A present within an inflated body cavity, with the distance of the multifocal optical assembly from the object of interest approximately matching the working distance of the multifocal side-pointing optical assembly. [Figure 8C] 8B shows the multifocal side-directing optical assembly of FIG. 8A with the first and second distance determining members deployed to approximately match the distance of the multifocal side-directing optical assembly from the object of interest with the working distance of the multifocal side-directing optical assembly. [Figure 9]1 is a flowchart illustrating exemplary steps of a method for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal side-pointing optical assembly of a multifocal multi-camera endoscope tip. [Figure 10A] FIG. 1 shows the distal end of an endoscope illuminating an abnormality within a body cavity at a first working distance. [Figure 10B] 10B shows the distal end of the endoscope of FIG. 10A at the second working distance but failing to illuminate the abnormality. [Figure 11A] A diagram showing an embodiment of an endoscope tip portion with a multifocal optical assembly in a first operating mode, a first type of light adjusting element retracted, and a first illumination mode. [Figure 11B] 11B shows the endoscope tip portion of FIG. 11A with the multifocal optical assembly in a second operating mode and the first type of light adjusting element deployed in a second illumination mode. [Figure 11C] 1 illustrates an endoscope tip portion with a multifocal optical assembly in a first operating mode and first and second types of light adjusting elements in a first illumination mode. [Figure 11D] 11D shows the endoscope tip portion of FIG. 11C, with the multifocal optical assembly in a second operating mode and at least one of the first and second types of light conditioning elements in a second illumination mode. [Figure 11E] A diagram showing another embodiment of an endoscope tip portion with a multifocal optical assembly in a first operating mode and a first type of light adjusting element retracted and in a first illumination mode. [Figure 11F] 11E shows the endoscope tip portion of FIG. 11E with the multifocal optical assembly in a second operating mode and the first type of light adjusting element deployed in a second illumination mode. [Figure 11G] 1 illustrates an endoscope tip portion with a multifocal optical assembly in a first operating mode and first and second types of light adjusting elements in a first illumination mode. [Figure 11H] A diagram showing an embodiment of an endoscope tip portion with a compound multifocal optical assembly in a first operating mode, a first type of light adjusting element retracted, and a first illumination mode. [Figure 11I] 11H shows the endoscope tip portion of FIG. 11H with the compound multifocal optical assembly in a second operating mode and the first type of light adjusting element deployed in a second illumination mode. [Figure 11J] 1 shows an endoscope tip portion with a multifocal compound optical assembly in a first operating mode and first and second types of light adjusting elements in a first illumination mode. [Figure 12] 1 is a flowchart illustrating exemplary steps of a method for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal, multi-camera endoscopic tip portion comprising at least one of first and second types of light conditioning elements. [Figure 13A] FIG. 10 is a diagram showing the variation of relative illuminance at an optical diffuser with respect to the emission angle when no electric field is applied to the optical diffuser. [Figure 13B] FIG. 10 shows the variation of relative illuminance at an optical diffuser with respect to emission angle when an electric field is applied to the optical diffuser. DETAILED DESCRIPTION OF THE INVENTION

[0067] These and other embodiments of the present invention will be explained in more detail in the drawings and detailed description that follow.

[0068] These and other features and advantages of the present invention will be further appreciated as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings.

[0069] This specification is directed to multiple embodiments. The following disclosure is provided to enable those skilled in the art to practice the invention. The language used in this specification should not be construed as a general denial of any specific embodiment, nor should such terminology be used to limit the scope of the claims beyond the meaning of the terms used in the claims. The general principles characterized herein can be applied to other embodiments and applications without departing from the spirit and scope of the specification. Furthermore, terminology and expressions are used to describe exemplary embodiments and should not be considered limiting. Thus, the specification is accorded the widest scope, encompassing numerous alternatives, modifications, and equivalents consistent with the principles and configurations disclosed. For clarity, details regarding technical matters known in the technical fields related to the present invention are not described in detail so as not to unnecessarily obscure the present invention.

[0070] In the present specification and claims, the words "comprise," "include," and "have," and their variations, do not necessarily limit the elements of the list with which the term may be associated.

[0071] In accordance with aspects and embodiments of the present invention, a multi-focal (e.g., bi-focal) multi-camera endoscopic system is disclosed. According to some embodiments, the endoscopic system includes at least one multi-focal optical assembly comprising at least one imaging sensor and at least one lens assembly. The lens assembly further comprises an optical element configured to change from a first working distance to a second working distance when activated by a processor associated with the endoscopic system, thereby increasing magnification for an object of interest.

[0072] According to some embodiments, at least the lens assembly is part of a "camera" or "view element," as used herein. In some embodiments, the term "camera" is used to describe the lens assembly and an imaging sensor associated with the lens assembly. The "camera" or "view element" with its associated imaging sensor and associated circuit board constitute an "optical assembly." Furthermore, the optical assembly is generally associated with at least one illuminator that illuminates the field of view. Thus, a multifocal optical assembly includes a multifocal view element with an associated sensor and associated circuit board, and in various other embodiments is associated with at least one illuminator. In various embodiments, the multifocal optical assembly is also associated with at least one of a first type and a second type of light conditioning element configured to operate in a first illumination mode or a second illumination mode. The terms "camera" and "view element" are used interchangeably throughout this specification.

[0073] Some embodiments use a processing system that includes a processor operating in conjunction with local or remote memory and other electronic components known to those skilled in the art.

[0074] In some embodiments, portions of the invention may be implemented as software instructions executed by a data processing device, e.g., components of a general-purpose or custom computer. In some embodiments, the data processing device or computer comprises volatile memory for storing instructions and / or data and / or comprises non-volatile storage (e.g., a magnetic hard disk and / or removable media) for storing instructions and / or data. In some embodiments, the implementation includes a network connection. In some embodiments, the implementation includes a user interface, typically comprising one or more input devices (e.g., allowing for input of commands and / or parameters) and output devices (e.g., allowing for reporting of operational parameters and results).

[0075] The multi-camera endoscopic system also includes multiple displays configured to simultaneously display multiple images captured by the multiple optical assemblies. However, zooming in on an image of an object by a predetermined percentage (e.g., which may be greater than about 30%) while displaying other images at a lower magnification on such a multiple image display can be disorienting for the operator and generally can cause eye strain and discomfort. Therefore, according to aspects and embodiments herein, a processor is configured to allow the operator to focus only on the magnified image acquired from one optical assembly (which is a multifocal optical assembly) of interest. This focusing is achieved by disabling other optical assemblies, associated illumination, and / or display of images acquired from other optical assemblies, or a combination thereof.

[0076] Thus, to allow the operator to focus only on the magnified image obtained from the multifocal optical assembly of interest, the processor is configured to perform any one or a combination of the following actions: a) switch off the other optical assembly capturing images at lower magnification, while leaving one or more lights associated with the other optical assembly switched on and leaving on the screen displaying the lower magnification image, b) switch off one or more lights associated with the other optical assembly, while the other optical assembly continues to capture and generate live images and / or video, and while leaving on the screen displaying the lower magnification image, and / or c) switch off, dim, or black out the screen displaying the lower magnification image, while the other optical assembly continues to capture and generate live images and / or video, and leaving on the one or more lights associated with the other optical assembly.

[0077] Reference is now made to FIG. 1, which illustrates a cross-sectional view of the distal end of a multifocal colonoscope according to one embodiment. The endoscope distal end 100a includes a multifocal, forward-facing optical assembly 101 positioned at the distal end of an endoscope (e.g., a colonoscope). The forward-facing optical assembly 101 typically has a wide field of view of 170 degrees. The endoscope distal end 100a includes a first side-facing optical assembly 102 and a second side-facing optical assembly 103. The two side-facing optical assemblies 102, 103 and the multifocal, forward-facing optical assembly 101 are configured to provide an expanded field of view of approximately 330 degrees. In various embodiments, the first side-facing optical assembly 102 and the second side-facing optical assembly 103 are positioned such that their optical axes are at a distance ranging from 6 mm to 10 mm from the distal end of the endoscope. In various embodiments, forward facing optical assembly 101, first side facing optical assembly 102, and second side facing optical assembly 103 each have a field of view (FOV) in the range of 150° to 170°.

[0078] Multifocal forward-facing optical assembly 101 can detect objects of interest (such as polyps) that are visible in the forward field of view, while side-facing optical assemblies 102 and 103 can additionally detect objects of interest that may be hidden from forward-facing optical assembly 101 (e.g., residing inside the folds of the colon). According to some embodiments, the focal length of forward-facing optical assembly 101 is approximately 1.1 mm, while the focal lengths of first and second side-facing optical assemblies 102, 103 are approximately 1.0 mm.

[0079] The multi-focal forward-facing optical assembly 101 comprises a forward-facing view element or camera having a forward-facing imaging sensor 105 (such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor). The forward-facing imaging sensor 105 has a lens assembly 107 mounted on top of it that provides the optics necessary to receive the image. The lens assembly 107 comprises a plurality of fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°.

[0080] The forward-facing imaging sensor 105 is mounted on an integrated circuit board 106, which can be rigid or flexible. The integrated circuit board 106 provides the necessary power to the forward-facing imaging sensor 105 and acquires still images and / or video feeds captured by the imaging sensor 105. The integrated circuit board 106 connects to a set of electrical cables attached via electrical channels through the elongated shaft of the endoscope.

[0081] One or more separate illuminators 108 are positioned adjacent to lens assembly 107 to illuminate the field of view of lens assembly 107. Optionally, separate forward illuminators 108 may be mounted on the same integrated circuit board 106 on which forward-facing imaging sensor 105 is mounted. Thus, in some embodiments, multifocal forward-facing optical assembly 101 comprises at least a forward-facing view element including lens assembly 107 and forward-facing imaging sensor 105 mounted on integrated circuit board 106, and associated with at least one illuminator 108.

[0082] In one embodiment, the illumination is optionally a separate illumination and includes light emitting diodes (LEDs). Thus, light is provided by light emitting diodes (LEDs) that illuminate the field of view. According to some embodiments, white light LEDs are used. According to other embodiments, other colored LEDs or any combination of LEDs can be used. These LEDs include, but are not limited to, red, green, blue, infrared, near infrared, ultraviolet, or any other LED.

[0083] In relation to discrete lighting, the term "discrete" refers to an illumination source that produces light internally, as opposed to non-discrete lighting, which may be, for example, an optical fiber that simply transmits remotely produced light.

[0084] In some embodiments, light can be generated internally within the endoscope tip 100a, or light can be generated remotely and transmitted, for example, by optical fiber. In some embodiments, more than one illuminator can be used, with at least one illuminator capable of generating light internally and at least one illuminator capable of providing remotely generated light.

[0085] According to some embodiments herein, lens assembly 107 is associated with an endoscope and includes two lenses 109 and 111 that are dynamically switched by a processor to change from a first working distance (associated with first lens 109) to a second working distance (associated with second lens 111) to magnify the image of an abnormality (e.g., a polyp) that is imaged by multifocal forward looking optical assembly 101 and its associated elements.

[0086] According to aspects and embodiments herein, changing from a first working distance to a second working distance can expand and improve the images that image sensor 105 can produce. Changing to the second working distance improves the modulation transfer function (MTF) and allows the use of lens 111 with aberration qualities suited to a shorter depth of field (DOF) compared to the longer DOF of first conventional lens 109. For example, the first working distance and depth of field of first lens 109 is approximately 3 mm (millimeters) to 100 mm, while the second working distance and depth of field of second lens 111 is approximately 2 mm to 5 mm or approximately 2 mm to 7 mm. The imaging performance provided by second lens 111, suited to the shorter distance, is superior to the imaging performance of first conventional lens 109, which typically has a depth of field of 3 mm to 100 mm, at this shorter distance. At this short distance, the first normal lens 109 uses the camera shutter to limit the field of view, thereby reducing the low resolution and light intensity.

[0087] In various alternative embodiments, the first working distance is between about 6 mm and 70 mm, while the second working distance is between about 2 mm and 4 mm.

[0088] According to aspects herein, lens assembly 107 includes one or more drive elements configured to control optical elements included in lens assembly 107. The one or more drive elements comprise a compressed air engine, a piezoelectric element, an electric engine, a solenoid, a nitinol engine, or a combination thereof. In a preferred embodiment, the drive elements comprise at least one compressed air engine. The optical elements comprise a lens (such as lenses 109, 111), a mirror, a diffractive element, or any combination thereof.

[0089] In various embodiments, the driving elements are driven by a processor to push, move, or pull lens 109 out of optical path 110 and push, move, or pull lens 111 onto optical path 110, such that optical path 110 connecting the line of sight from image sensor 105 to the target passes through first lens 109 or second lens 111.

[0090] According to various embodiments, the endoscope tip section 100a includes a first side-pointing imaging sensor 115 (such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor). The first side-pointing imaging sensor 115 is mounted on an integrated circuit board 116, which can be rigid or flexible. The integrated circuit board 116 provides the necessary power to the first side-pointing imaging sensor 115 and acquires still images and / or video feeds captured by the imaging sensor 115. The integrated circuit board 116 connects to a set of electrical cables attached via electrical channels through the elongated shaft of the endoscope.

[0091] The first side-pointing imaging sensor 115 has a lens assembly 117 mounted on top of the first side-pointing imaging sensor 115 and providing the optics necessary to receive the image. The lens assembly 117 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, the lens assembly 117 provides a working distance of approximately 5 to 100 millimeters. In another embodiment, the lens assembly 117 provides a working distance of approximately 2 to 5 millimeters. The first side-pointing imaging sensor 115 and the lens assembly 117 are collectively referred to as the "first side-pointing view element."

[0092] One or more separate side lights 118 are positioned adjacent to lens assembly 117 to illuminate the field of view of lens assembly 117. Optionally, separate front lights 118 can be mounted on the same integrated circuit board 116 on which first side-pointing imaging sensor 115 is mounted.

[0093] Thus, in some embodiments, the side-facing view element comprises a lens assembly 117 and a side-facing imaging sensor 115 mounted on an integrated circuit substrate 116, associated with at least one illuminator 118 to form a first side-facing optical assembly.

[0094] In another configuration, integrated circuit boards 106 and 116 are configured as a single integrated circuit board on which both forward-facing image sensor 105 and first side-facing image sensor 115 are mounted, such that the integrated circuit board is essentially L-shaped.

[0095] In some embodiments, endoscope tip section 100a includes a second side-pointing imaging sensor 125 (such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor). Side-pointing imaging sensor 125 is mounted on an integrated circuit board 126, which can be rigid or flexible. Integrated circuit board 126 provides the necessary power to side-pointing imaging sensor 125 and acquires still images and / or video feeds captured by imaging sensor 125. Integrated circuit board 126 connects to a set of electrical cables attached via electrical channels through the elongated shaft of the endoscope.

[0096] Side-pointing image sensor 125 has a lens assembly 127 mounted on top of side-pointing image sensor 125 and providing the optics necessary to receive the image. Lens assembly 127 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, lens assembly 127 provides a working distance of approximately 2 to 5 millimeters. In another embodiment, lens assembly 127 provides a working distance of approximately 3 to 40 millimeters. Side-pointing image sensor 125 and lens assembly 127 are collectively referred to as the "second side-pointing view element."

[0097] One or more separate side lights 128 are positioned adjacent to lens assembly 127 to illuminate the field of view of lens assembly 127. Optionally, separate front lights 128 can be mounted on the same integrated circuit board 126 on which side-pointing image sensor 125 is mounted.

[0098] Thus, in some embodiments, the second side-facing view element comprises a lens assembly 127 and a side-facing imaging sensor 125 mounted on an integrated circuit board 126, associated with at least one illuminator 128 to form a side-facing optical assembly.

[0099] In another configuration, integrated circuit boards 106, 116, and 126 are configured as a single integrated circuit board that includes both forward-facing image sensor 105 and side-facing image sensors 115 and 125. To accomplish this, the integrated circuit board is essentially shaped like an upside-down U.

[0100] For clarity, FIG. 1 depicts only the view elements, associated components, and illumination (optical assembly) of the multifocal, multi-view element endoscope tip section 100a. It is understood that the endoscope tip section 100a may include one or more working channels to allow for simultaneous insertion of multiple treatment tools. Similarly, the endoscope tip section 100a may include one or more fluid channels, such as for separately supplying at least one of a front fluid injector, a side fluid injector, and / or a pathway fluid injector, and for separately providing aspiration through the pathway fluid injectors. The endoscope tip section 100a may also include one or more electrical cables threaded through the elongate shaft and / or bend to control the endoscope's camera and illumination.

[0101] Reference is now made to FIG. 2, which shows a cross-sectional view of a distal end portion 100b of a multifocal, multi-camera endoscope having two forward-facing viewing elements, and thus two optical assemblies, according to one embodiment. Endoscope distal end portion 100b includes a first forward-facing optical assembly 101A and a second forward-facing optical assembly 101B. These optical assemblies, collectively referred to as a "combined multifocal optical assembly," are positioned at the distal end of an endoscope (such as a colonoscope). Endoscope distal end portion 100b includes a first side-facing optical assembly 102 and a second side-facing optical assembly 103. In various embodiments, these optical assemblies are positioned such that the optical axes of first side-facing optical assembly 102 and second side-facing optical assembly 103 are at a distance ranging from 6 mm to 10 mm from the distal end of the endoscope. In various embodiments, forward-facing optical assemblies 101A and 101B and first and second side-facing optical assemblies 102, 103 each have a field of view (FOV) in the range of 150° to 170°.

[0102] Forward-facing optical assembly 101A includes a first forward-facing view element having a forward-facing image sensor 105. Forward-facing image sensor 105 has a lens assembly 107 mounted thereon that provides the necessary optics for receiving an image. Lens assembly 107 includes a plurality of fixed or movable lenses. The lenses provide a field of view of at least 90° and preferably up to 180°. Lens assembly 107 provides a first working distance of approximately 5 to 100 millimeters.

[0103] A forward-facing image sensor 105 is mounted on a first integrated circuit board 106 .

[0104] When forward-facing image sensor 105 and lens assembly 107 are coupled to integrated circuit board 106, forward-facing image sensor 105 and lens assembly 107 are collectively referred to as a "first forward-facing optical assembly."

[0105] Forward-facing optical assembly 101B includes a second forward-facing view element having a forward-facing image sensor 135. Forward-facing image sensor 135 has a lens assembly 137 mounted thereon that provides the optics necessary to receive an image. Lens assembly 137 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and preferably up to 180°. Lens assembly 137 provides a second working distance of approximately 2 to 5 millimeters.

[0106] A forward-facing image sensor 135 is mounted on a second integrated circuit board 136 .

[0107] When forward-facing imaging sensor 135 and lens assembly 137 are coupled to integrated circuit board 136, forward-facing imaging sensor 135 and lens assembly 137 are collectively referred to as a "second forward-facing optical assembly."

[0108] According to one embodiment, first forward-facing optical assembly 101A is a typical endoscope's forward-facing viewing element, comprising image sensor 105 and lens assembly 107 having lens 109 providing a first working distance of 5 to 100 millimeters. Lens 109 is used during an endoscopic procedure, for example, to move endoscope tip 100b through a patient's colon. Lens 109 is configured to identify abnormalities or objects of interest (such as polyps) from a relatively long distance and at a relatively low magnification. One or more separate forward illuminators 108A are positioned adjacent lens assembly 107 to illuminate the field of view of lens assembly 107. Optionally, separate forward illuminators 108A are mounted on the same integrated circuit board 106 on which forward-facing image sensor 105 is mounted.

[0109] Second forward-facing optical assembly 101B is a larger magnification camera that includes an imaging sensor 135 and a lens assembly 137 having a lens 131 that provides a second working distance of 3 to 6 millimeters. Lens 131 is configured to increase the magnification of an identified object of interest. One or more separate illuminators 108B are positioned adjacent to lens assembly 137 to illuminate the field of view of lens assembly 137. Optionally, the separate forward illuminators 108B are mounted on the same integrated circuit board 136 on which forward-facing imaging sensor 135 is implemented.

[0110] According to certain embodiments, endoscope tip section 100b includes a first side-pointing optical assembly 102 having a lens assembly 117 mounted to an imaging sensor 115, which in turn is mounted to an integrated circuit board 116. First side-pointing optical assembly 102 also has one or more separate associated illuminators 118. In various embodiments, endoscope tip section 100 includes a second side-pointing optical assembly 103 having a lens assembly 127 mounted to an imaging sensor 125, which in turn is mounted to an integrated circuit board 126. Second side-pointing optical assembly 103 has one or more separate associated illuminators 128. According to some embodiments, the focal length of forward-pointing optical assemblies 101A, 101B is at or on the order of 1.1 mm, while the focal lengths of first and second side-pointing optical assemblies 102, 103 are at or on the order of 1.0 mm.

[0111] Reference is now made to Figures 1 and 2, along with Figures 3A through 3C. Figures 3A through 3C illustrate example content that can be displayed on a multifocal, multi-camera endoscopic display system 300, according to certain embodiments. Endoscopic display system 300 includes a forward-facing viewscreen 301, a first side-pointing screen 303, and a second side-pointing screen 305. Forward-facing viewscreen 301 is used to display images captured by forward-facing optical assembly 101 of Figure 1 or optical assembly 101A of Figure 2 (depending on whether endoscope tip section 100a or 100b is used), first side-pointing screen 303 is used to display images captured by first side-pointing optical assembly 102 shown in Figures 1 and 2, and second side-pointing screen 305 is used to display images captured by second side-pointing optical assembly 103 shown in Figures 1 and 2. Thus, it should be understood that when using endoscope tip section 100a of Figure 1, forward-viewing screen 301 displays images captured by forward-pointing optical assembly 101, while side-pointing screens 303 and 305 display images captured by first and second side-pointing optical assemblies 102, 103, respectively, shown in Figure 1. Alternatively, when using endoscope tip section 100b of Figure 2, forward-viewing screen 301 by default displays images captured by forward-pointing optical assembly 101A, while side-pointing screens 303 and 305 display images captured by first and second side-pointing optical assemblies 102, 103, respectively, shown in Figure 2.

[0112] Thus, screens 301, 303, and 305 are configured to simultaneously display multiple fields of view captured by multi-camera endoscope tip 100a or 100b shown in Figures 1 and 2, which provides an expanded 330° field of view and allows a clinician to conveniently move the endoscope tip through the investigation area to identify and treat objects of interest or abnormalities.

[0113] 3A shows exemplary images of the front and side views of a colon 307 and objects of interest, which may be colon folds 309 and polyps 311, displayed on a front view screen 301. The polyp 311 may also be imaged from a side viewing angle by the side-directing view element 102, and is displayed on the side view screen 305 as a polyp labeled 311′. During surgery, an operator advances the endoscope tip 100a (or 100b in FIG. 2) through a body cavity (such as the colon) while viewing images (typically video feeds) transmitted by the optical assemblies 101, 102, and 103 in FIG. 1 (or optical assemblies 101A, 102, and 103 in FIG. 2). For example, upon finding an object of interest (such as polyp 311) in the wall of colon 307, the operator advances multi-camera endoscope tip portion 100a (or 100b in FIG. 2) further toward polyp 311. After advancing endoscope tip portion 100a (or 100b in FIG. 2) to the "optimum distance" from the wall / polyp / any other location of interest of the colon (or any body cavity), the operator can acquire a magnified image 320 of the object using lens 111 of FIG. 1 at the second working distance (when using endoscope tip portion 100a of FIG. 1) or using second forward-facing optical assembly 101B at the second working distance (when using endoscope tip portion 100b of FIG. 2).

[0114] According to some embodiments, the operator determines the "optimal distance," or in various embodiments, a spacer / distance determining member determines the "optimal distance." According to some embodiments, the "optimal distance" is, for example, 2-4 millimeters from the wall / polyp / any other location of interest of the colon (or any body cavity). Based on the magnified image 311'' of the polyp 311, the operator can decide whether to insert a treatment tool through the working channel of the endoscope to remove, treat, and / or extract a sample of the polyp 311 or the entire polyp for biopsy.

[0115] Reference is now made to FIG. 3B, which shows magnified image 311'' on front view screen 301. Polyp 311 has been displayed at a greatly enlarged scale, so that polyp 311 occupies a larger screen area of ​​front view screen 301. The magnification of side view screens 303 and 305 remains unchanged, and polyp 311' is still displayed at default magnification on side view screen 305. However, zooming in and enlarging polyp 311 by, for example, about 30% or more on front view screen 301 while displaying images 303 and 305 at default magnification on the side view screens may cause disorientation to the operator and may generally cause eye strain and discomfort.

[0116] Reference is now made to FIG. 3C, which depicts a magnified image 311'' on the front-view screen 301 with the side-view screens 303 and 305 disabled, dimmed, and / or blacked out. The polyp 311 is displayed at a large magnification as image 311'' which occupies a larger screen area of ​​the front-view screen 301, while the two side-view screens 303 and 305 are disabled, dimmed, and / or blacked out. By disabling, dimming, and / or blacking out the side-view screens 303 and 305, the operator can examine the magnified polyp image 311'' without being visually obstructed or distracted.

[0117] According to aspects and embodiments herein, while zooming in and magnifying an image of an object of interest (such as an image of polyp 311) using either the larger magnification lens 111 of FIG. 1 (when using endoscope tip section 100a of FIG. 1) or the second forward-facing optical assembly 101B (when using endoscope tip section 100b of FIG. 2), the processor may be configured to do one or a combination of the following: a) disable the side-pointing optical assemblies (102 and 103 of FIGS. 1 and 2) while the side-pointing lights (118, 128, associated with side-pointing optical assemblies 102 and 103 of FIGS. 1 and 2) are turned on and the two side-pointing screens or monitors (303 and 305) are also turned on, for example, by removing or reducing power to the side-pointing optical assemblies; or b) disable the side-pointing optical assemblies (102 and 103 of FIGS. 1 and 2) while the side-pointing optical assemblies continue to capture live images and / or video streams and while the two side-pointing screens (303 and 305) are also turned on and associated with the side-pointing optical assemblies. and / or c) turning off or reducing the illumination of the side-pointing lights (118, 128 in FIGS. 1 and 2) associated with the side-pointing optical assemblies, and / or b) turning off, dimming or blacking out the two side-pointing screens or monitors (303 and 305) resulting from the side-pointing optical assemblies by switching off, dimming or blacking out the two side-pointing screens while the side-pointing optical assemblies (102 and 103 in FIGS. 1 and 2) continue to capture live images and / or video streams and while the lights (118, 128 in FIGS. 1 and 2) associated with the side-pointing optical assemblies are also switched on.

[0118] Also, in one embodiment, the processor can automate disabling the side-pointing optical assembly and associated lighting and / or switching off, dimming, or blacking the two side-pointing screens when the larger magnification lens 111 of FIG. 1 is enabled (when using the endoscope tip section 100a of FIG. 1) or when the second forward-pointing optical assembly 101B is enabled (when using the endoscope tip section 100b of FIG. 2) to provide a magnified view of an object of interest. In other embodiments, the operator can manually disable the side-pointing optical assembly and associated lighting and / or switch off, dimming, or blacking the two side-pointing screens, for example, by operating one or more switches on the endoscope handle, when the larger magnification lens 111 of FIG. 1 is enabled (when using the endoscope tip section 100a of FIG. 1) or when the second forward-pointing optical assembly 101B is enabled (when using the endoscope tip section 100b of FIG. 2) to provide a magnified view of an object of interest.

[0119] 2 , according to aspects and embodiments herein, the processor is configured to turn on forward facing optical assembly 101B to zoom in, turn off forward facing optical assembly 101A, turn off lights associated with forward facing optical assembly 101A (i.e., for example, turn off one or more lights 108A), and replace the image captured by forward facing optical assembly 101A with the enlarged image captured by forward facing optical assembly 101B for display on front view screen 301. The processor is further configured to enable any one or combination of the following: That is, the processor may be further configured to be able to: a) turn off the side-pointing optical assemblies 102 and 103 to zoom in while leaving the associated illumination 118, 128 on and the side-pointing screen 303, 305 on; b) switch off the side-pointing illumination 118, 128 associated with the side-pointing optical assemblies 102, 103 while the side-pointing optical assemblies 102, 103 continue to capture live images and / or video streams and while the side-pointing screen or monitor 303, 305 is also on; and / or c) switch off, dim, or black the display on the side-pointing screen or monitor 303, 305 while the side-pointing optical assemblies 102, 103 continue to capture live images and / or video streams and while the side-pointing illumination 118, 128 is also on.

[0120] Also, in one embodiment, the processor can automate disabling the side-pointing optical assembly and associated lighting and / or switching off, dimming, or blacking the two side-pointing screens when second forward-pointing optical assembly 101B is used and enabled to provide a magnified view of an object of interest. In other embodiments, the operator can manually disable the side-pointing optical assembly and associated lighting and / or switch off, dimming, or blacking the two side-pointing screens when second forward-pointing optical assembly 101B is enabled to provide a magnified view of an object of interest, for example, by operating one or more switches on the handle of the endoscope.

[0121] Reference is now made to Figure 4, which shows a perspective view of a multifocal, multi-camera endoscope tip section 400 comprising one or more distance determining members or spacers. Endoscope tip section 400 comprises a forward-facing optical assembly 401, one or more forward-facing illuminators 402 associated with forward-facing optical assembly 401, a working channel 403, fluid injection channels 404 and 405 for flushing optical assembly 401 and illuminators 402, and a side-facing optical assembly 411 associated with one or more side-facing illuminators 412.

[0122] According to certain embodiments, the endoscope tip section 400 includes one or more, preferably three or more, distance-determining members or spacers 415, 416, and 417 configured to contact the interior wall of a body cavity (e.g., the interior wall of the colon) and fix or maintain the distance between the optical assembly 401 and the interior wall of the colon. In various embodiments, the three or more distance-determining members 415, 416, and 417 are one or more spacers, ridges, protrusions, or projections fixedly attached to the distal end 420 of the tip section 400 or retractable from the tip section 400 when needed.

[0123] In various embodiments, the protrusion length beyond the distal end 420 of the three or more distance determining members 415, 416, and 417 generally corresponds to the second working distance of the magnifying second lens 111 in FIG. 1 or the second working distance of the lenses of the second forward-facing optical assembly 101B in FIG. 2. Thus, in various embodiments, the protrusion length of the three or more distance determining members or spacers 415, 416, and 417 ranges from 3 mm to 7 mm. In some embodiments, the protrusion length of the three or more distance determining members or spacers 415, 416, and 417 ranges from 1.5 mm to 7 mm. In one embodiment, the protrusion length of the three or more distance determining members or spacers 415, 416, and 417 is limited to 2 mm to ensure that the field of view of the optical assembly 401 is not distorted by the spacers 415, 416, and 417. In certain embodiments where three or more distance determining members 415, 416, and 417 are telescopically extendable from distal end 420, the extension lengths of the three or more distance determining members 415, 416, and 417 can be dynamically varied to match the second working distance. In various embodiments, the three or more distance determining members 415, 416, and 417 are spaced apart from one another, with the distance between any two distance determining members ranging from 8 mm to 10 mm.

[0124] According to some embodiments, the distance determining member is configured to provide distance determinations or spacings of approximately 4 mm. According to some embodiments, the distance determining member is configured to provide distance determinations or spacings of greater than 5 mm. According to other embodiments, the distance determining member is configured to controllably provide multiple distance determinations or spacings ranging from 3 mm to 12 mm. According to yet other embodiments, the distance determining member is configured to controllably provide multiple distance determinations or spacings ranging from 4 mm to 6 mm. According to some embodiments, the distance determining member is configured to provide dynamic distance determinations according to the working distance.

[0125] 5 is a flowchart illustrating exemplary steps of a method 500 for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal, multi-camera endoscope tip of an endoscope (such as a colonoscope). A processor associated with the endoscope is configured to perform method 500. Now referring to FIGS. 1, 2, and 5, in step 510, the multifocal, multi-camera endoscope tip (e.g., tip section 100a or 100b) is moved within the patient's colon with at least one multifocal, forward-facing optical assembly (i.e., forward-facing optical assembly 101 of tip section 100a or first forward-facing optical assembly 101A of tip section 100b) in a first mode of operation to identify an abnormality, region, or object of interest (such as a polyp). During the first mode of operation, the at least one multifocal, forward-facing optical assembly acquires images and / or video of the colon at a first working distance. At least one multifocal forward-facing optical assembly can operate at a first working distance using either first lens 109 or first forward-facing optical assembly 101A (while second forward-facing optical assembly 101B is disabled), depending on whether endoscope tip section 100a or 100b is being used. In one embodiment, the endoscope tip section operates in the first mode by default.

[0126] Images and / or video of the first mode of operation acquired from the at least one multifocal forward-looking optical assembly are displayed on the front-view screen along with the identified anomaly, and images and / or video acquired from the first and second side-looking optical assemblies, respectively, are displayed on corresponding first and second side-looking screens. It should be appreciated that the identified anomaly visible on the front-view screen when imaged by the at least one multifocal forward-looking optical assembly is also simultaneously displayed on at least one of the first or second side-looking screens when imaged by at least one of the first or second side-looking optical assemblies in an overlapping field of view. In various embodiments, a magnification of 100x-6x is possible for the image for the first working distance at which the anomaly was imaged during the first mode of operation.

[0127] In step 520, the processor enables the at least one multifocal forward-facing optical assembly to operate in a second mode of operation to acquire and display a magnified image containing the identified anomaly on the forward-view screen. During the second mode of operation, the at least one multifocal forward-facing optical assembly acquires the magnified image at a second working distance. The at least one multifocal forward-facing optical assembly can operate at the second working distance by switching to use the second lens 111 or by activating the second forward-facing optical assembly 101B (while simultaneously disabling the first forward-facing optical assembly 101A), depending on whether the endoscope tip section 100a or 100b is being used. In various embodiments, during the second mode of operation, the image for the second working distance at which the anomaly is imaged can have a magnification ranging from 250x-100x.

[0128] According to one embodiment, the distance between the at least one multifocal forward-facing optical assembly and the identified abnormality or object of interest is maintained by retracting or deploying one or more distance-determining members (e.g., members 415, 416 in FIG. 4 ) from the distal end of the endoscope tip and advancing the distal section until the one or more distance-determining members contact the abnormality or the inner wall of the colon, thereby maintaining approximately the second working distance. In this embodiment, the length of the distance-determining members can be varied by partially or fully retracting or deploying the distance-determining members. In other embodiments, the distance-determining members are attached to the distal end, providing a fixed length that generally corresponds to the second working distance. In operation, this configuration has the advantage of maintaining and ensuring a minimum distance between the endoscope's camera and the tissue being viewed.

[0129] In step 530, if the magnification of the magnified image on the front-view screen exceeds a predetermined percentage, the processor enables one or a combination of the following: a) switching off or disabling the first and second side-pointing optical assemblies while leaving the lights associated with the first and second side-pointing optical assemblies on and leaving the first and second side-pointing screens on, b) switching off the side lights associated with the first and second side-pointing optical assemblies while the first and second side-pointing optical assemblies continue to capture and generate live images and / or video streams and while the first and second side-pointing screens are on, and / or c) switching off, blacking out, or dimming the image and / or video display on the first and second side-pointing screens while the first and second side-pointing optical assemblies continue to capture and generate live images and / or video streams and while the lights associated with the first and second side-pointing optical assemblies are on. In some embodiments, the predetermined magnification percentage is about 30% or greater.

[0130] If necessary, under magnification, instruments can be inserted through the working channel of the endoscope to remove, treat and / or extract a sample or the entire abnormality or object of interest for biopsy.

[0131] According to one embodiment, activating a button or switch on the handle of the endoscope causes the processor to switch the operating mode of the endoscope tip section from a first operating mode to a second operating mode.

[0132] Reference is now made to FIG. 6A, which illustrates a cross-sectional view of the distal end of a multifocal colonoscope according to one embodiment. The endoscope distal end 600a includes a forward-facing optical assembly 601 positioned at the distal end of the endoscope (e.g., a colonoscope). The forward-facing optical assembly 601 typically has a wide field of view of 170 degrees. The endoscope distal end 600a includes a first multifocal side-facing optical assembly 602 and a second side-facing optical assembly 603. The two side-facing optical assemblies 602, 603 and the forward-facing optical assembly 601 are configured to provide an expanded field of view of approximately 330 degrees. In various embodiments, the first side-facing optical assembly 602 and the second side-facing optical assembly 603 are positioned such that their optical axes are at a distance ranging from 6 mm to 10 mm from the distal end of the endoscope. In various embodiments, the forward facing optical assembly 601, the first side facing optical assembly 602, and the second side facing optical assembly 603 each have a field of view (FOV) in the range of 150° to 170°.

[0133] Forward-facing optical assembly 601 can detect objects of interest (such as polyps) that are visible in the forward field of view, while side-facing optical assemblies 602 and 603 can additionally detect objects of interest that may be hidden from forward-facing optical assembly 601 (e.g., residing inside the folds of the colon). According to some embodiments, forward-facing optical assembly 601 has a focal length of approximately 1.1 mm, while first and second side-facing optical assemblies 602, 603 have a focal length of approximately 1.0 mm.

[0134] The forward-facing optical assembly 601 comprises a forward-facing view element or camera having a forward-facing imaging sensor 605 (such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor). The forward-facing imaging sensor 605 has a lens assembly 607 mounted on top of it that provides the optics necessary to receive the image. The lens assembly 607 comprises a plurality of fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°.

[0135] The forward-facing imaging sensor 605 is mounted on an integrated circuit board 106, which can be rigid or flexible. The integrated circuit board 606 provides the necessary power to the forward-facing imaging sensor 605 and acquires still images and / or video feeds captured by the imaging sensor 605. The integrated circuit board 606 connects to a set of electrical cables attached via electrical channels running through the elongated shaft of the endoscope.

[0136] One or more separate illuminators 608 are positioned adjacent to the lens assembly 607 to illuminate the field of view of the lens assembly 607. Optionally, the separate forward illuminators 608 may be mounted on the same integrated circuit board 606 on which the forward-facing imaging sensor 605 is mounted. Thus, in some embodiments, the multifocal forward-facing optical assembly 601 comprises at least a forward-facing view element including the lens assembly 107 and the forward-facing imaging sensor 105 mounted on the integrated circuit board 106, and associated with at least one illuminator 608.

[0137] In one embodiment, the illumination is optionally a separate illumination and includes light emitting diodes (LEDs). Thus, light is provided by light emitting diodes (LEDs) that illuminate the field of view. According to some embodiments, white light LEDs are used. According to other embodiments, other colored LEDs or any combination of LEDs can be used. These LEDs include, but are not limited to, red, green, blue, infrared, near infrared, ultraviolet, or any other LED.

[0138] In some embodiments, light can be generated internally within the endoscope tip 600a, or light can be generated remotely and transmitted, for example, by optical fiber. In some embodiments, more than one illuminator can be used, with at least one illuminator capable of generating light internally and at least one illuminator capable of providing remotely generated light.

[0139] In various embodiments, the endoscope tip section 600a includes a first side-pointing imaging sensor 615, such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor. The first side-pointing imaging sensor 615 is mounted on an integrated circuit board 616, which can be rigid or flexible. The integrated circuit board 616 provides the necessary power to the first side-pointing imaging sensor 615 and acquires still images and / or video feeds captured by the imaging sensor 615. The integrated circuit board 616 connects to a set of electrical cables attached via electrical channels through the elongated shaft of the endoscope.

[0140] First side-pointing imaging sensor 615 has a lens assembly 617 mounted on top of it that provides the optics necessary to receive the image. Lens assembly 617 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, lens assembly 617 provides a working distance of approximately 2 to 40 millimeters. In another embodiment, lens assembly 617 provides a working distance of approximately 2 to 6 millimeters. First side-pointing imaging sensor 615 and lens assembly 617 are collectively referred to as the "first side-pointing view element."

[0141] One or more separate side lights 618 are positioned adjacent to the lens assembly 617 to illuminate the field of view of the lens assembly 617. Optionally, a separate front light 618 can be mounted on the same integrated circuit board 616 on which the first side-pointing imaging sensor 615 is mounted.

[0142] Thus, in some embodiments, the side-facing view element comprises a lens assembly 617 and a first side-facing imaging sensor 615 mounted on an integrated circuit substrate 616, associated with at least one illuminator 618 to form a first side-facing optical assembly.

[0143] Alternatively, integrated circuit boards 606 and 616 can be configured as a single integrated circuit board on which both forward-facing image sensor 605 and first side-facing image sensor 615 are mounted, which can result in the integrated circuit board being essentially L-shaped.

[0144] According to some embodiments herein, lens assembly 617 includes two lenses 609 and 611 that are dynamically switched by a processor from a first working distance (associated with first lens 609) to a second working distance (associated with second lens 611) to increase the magnification of an image of an abnormality or object of interest (e.g., a polyp) that is imaged by first multifocal side-facing optical assembly 602 and associated elements.

[0145] According to aspects and embodiments herein, changing from a first working distance to a second working distance can improve the image by increasing the magnification of the image that image sensor 615 can produce. Changing to the second working distance can improve the modulation transfer function (MTF) and allow the use of lens 611 with aberration qualities that are suited to a shorter depth of field (DOF) compared to the longer depth of field of first conventional lens 609. For example, in one embodiment, lens assembly 617 provides a first working distance of approximately 20 millimeters provided by lens 609 and a second working distance of approximately 5 millimeters provided by lens 611. Alternatively, in another embodiment, lens assembly 617 provides a first working distance of approximately 10 millimeters provided by lens 609 and a second working distance of approximately 2 millimeters provided by lens 611. It should be understood that lens assembly 617 can include other lenses having other working distances (illustratively ranging from 2 millimeters to 40 millimeters), and such lenses are within the scope of this specification.

[0146] According to aspects herein, lens assembly 617 includes one or more drive elements configured to control optical elements included in lens assembly 617. The one or more drive elements comprise piezoelectric elements, electric engines, solenoids, nitinol engines, or combinations thereof. In a preferred embodiment, the drive elements comprise at least one compressed air engine. The optical elements comprise lenses (such as lenses 609 and 611), mirrors, diffractive elements, or combinations thereof.

[0147] In various embodiments, the drive elements are driven by a processor to push, move, or pull lens 609 out of optical path 610 and lens 611 onto optical path 610, such that an optical path connecting the line of sight from imaging sensor 615 to the anomaly or object of interest passes through first lens 609 or second lens 611. In some embodiments, endoscope tip section 600a includes second side-pointing imaging sensor 625 (such as a charge-coupled device (CCD) imaging sensor or a complementary metal-oxide semiconductor (CMOS) imaging sensor). Second side-pointing imaging sensor 625 is mounted on an integrated circuit board 626, which can be rigid or flexible. Integrated circuit board 626 provides the necessary power to second side-pointing imaging sensor 625 and acquires still images and / or video feeds captured by imaging sensor 625. Integrated circuit board 626 connects to a set of electrical cables attached via electrical channels running through the elongated shaft of the endoscope.

[0148] Second side-pointing imaging sensor 625 includes a lens assembly 627 mounted on top of side-pointing imaging sensor 625 to provide the necessary optics for receiving the image. Lens assembly 627 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, lens assembly 627 provides a working distance of approximately 2 to 6 millimeters. In another embodiment, lens assembly 627 provides a working distance of 2 to 40 millimeters. Second side-pointing imaging sensor 625 and lens assembly 627 are collectively referred to as the "second side-pointing view element."

[0149] One or more separate side lights 628 are positioned adjacent to lens assembly 627 to illuminate the field of view of lens assembly 627. Optionally, separate front lights 628 can be mounted on the same integrated circuit board 626 on which side-pointing imaging sensor 625 is implemented.

[0150] Thus, in some embodiments, the second side-facing view element comprises a lens assembly 627 and a side-facing imaging sensor 625 mounted on an integrated circuit substrate 626, associated with at least one illuminator 628 to form a second side-facing optical assembly.

[0151] In another configuration, integrated circuit boards 606, 616, and 626 are configured as a single integrated circuit board that includes both forward-facing image sensor 605 and side-facing image sensors 615 and 625. To accomplish this, the integrated circuit board is essentially shaped like an upside-down U.

[0152] In certain embodiments, lens assembly 627 may be a multifocal (e.g., bifocal) lens assembly similar to lens assembly 617 described above, which includes two lenses (e.g., first lens 609 and second lens 611). The processor may dynamically switch between the two lenses from a first working distance to a second working distance to increase the magnification of the image of the object of interest captured by second side-pointing optical assembly 603.

[0153] Optionally and additionally, one or more of the lens assemblies described herein above may further comprise an autofocus zoom system, an optical zoom system and / or a digital zoom system.

[0154] For clarity, FIG. 6A depicts only the view elements, associated elements, and illumination (collectively referred to as the optical assembly) of the multifocal, multiview element endoscope tip section 600a. It is understood that the endoscope tip section 600a may include one or more working channels that allow for simultaneous insertion of multiple instruments. Similarly, the endoscope tip section 600a may include one or more fluid channels, such as for separately supplying at least one of a front fluid injector, a side fluid injector, and / or a pathway fluid injector, and for separately providing aspiration through the pathway fluid injectors. The endoscope tip section 600a may also include one or more electrical cables routed through the elongate shaft and / or bend to control the endoscope's camera and illumination.

[0155] Reference is now made to Figure 6B, which shows a cross-sectional view of a distal end portion 600b of a multifocal, multi-camera endoscope that includes two first side-directing viewing elements, and thus two optical assemblies, according to one embodiment. The endoscope distal end portion 600b includes two first side-directing optical assemblies 602A and 602B. These optical assemblies, collectively referred to as a "compound multifocal optical assembly," have a field of view facing toward a first side of the distal end of the endoscope (such as a colonoscope). In some embodiments, the endoscope distal end portion 600b can also include an additional side-directing optical assembly 603 that faces toward a second side opposite the first side.

[0156] First side-pointing first view element 602A includes a side-pointing image sensor 615 having a lens assembly 617 mounted on top of it that provides the necessary optics for receiving an image. Side-pointing image sensor 615 is mounted on integrated circuit board 616. Lens assembly 617 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, lens assembly 617 provides a working distance of approximately 4 to 40 millimeters. In another embodiment, lens assembly 617 provides a working distance of approximately 2 to 5 millimeters. Side-pointing image sensor 615 and lens assembly 617, when coupled to integrated circuit board 616 and associated with at least one illuminator 618A, are collectively referred to as a “first side-pointing first optical assembly.”

[0157] First side-pointing second view element 602B includes side-pointing image sensor 635 with lens assembly 637 mounted on top of it to provide the optics necessary to receive the image. Side-pointing image sensor 635 is mounted on integrated circuit board 636. Lens assembly 637 includes multiple fixed or movable lenses. The lenses provide a field of view of at least 90° and typically up to 180°. In one embodiment, lens assembly 637 provides a working distance of approximately 2 to 5 millimeters. In another embodiment, lens assembly 637 provides a working distance of approximately 3 to 6 millimeters. Side-pointing image sensor 635 and lens assembly 637, when coupled to integrated circuit board 636 and associated with at least one illuminator 618B, are collectively referred to as a “first side-pointing second optical assembly.”

[0158] According to one embodiment, first side-pointing first view element 602A is a commonly used view element for a first side and includes an image sensor 615 and a lens assembly 617 having a lens 619 providing a first working distance of 2 to 40 millimeters. Lens 619 is used during an endoscopic procedure, for example, to move endoscope tip portion 600b through a patient's colon. Lens 619 is configured to identify objects of interest from a relatively long distance and at a relatively low magnification. One or more separate illuminators 618A are positioned adjacent to lens assembly 617 to illuminate the field of view of lens assembly 617. Optionally, separate side illuminators 618A are mounted on the same integrated circuit board 616 on which side-pointing image sensor 615 is implemented.

[0159] First side-pointing second view element 602B is a larger magnification camera that includes an imaging sensor 635 and a lens assembly 637 having a lens 631 that provides a second working distance of 2 to 6 millimeters. Lens 631 is configured to increase the magnification of an identified object of interest. One or more separate illuminators 618B are positioned adjacent to lens assembly 637 to illuminate the field of view of lens assembly 637. Optionally, separate side illuminators 618B are mounted on the same integrated circuit board 636 on which side-pointing imaging sensor 635 is implemented.

[0160] According to certain embodiments, endoscope tip section 600b includes a forward-facing optical assembly 601 having a lens assembly 607 mounted to an imaging sensor 605, which in turn is mounted to an integrated circuit board 606. Forward-facing optical assembly 601 also has one or more separate associated illuminators 608. In various embodiments, endoscope tip section 600b also includes a second side-facing optical assembly 603 having a lens assembly 627 mounted to an imaging sensor 625, which in turn is mounted to an integrated circuit board 626. Second side-facing optical assembly 603 has one or more separate associated illuminators 628. In various embodiments, first side-facing optical assembly 602A and second side-facing optical assembly 603 are positioned such that their optical axes are at a distance ranging from 6 mm to 10 mm from the distal end of the endoscope. In various embodiments, the first side-pointing optical assemblies 602A and 602B and the forward-pointing optical assembly 601 and second side-pointing optical assembly 603 each have a field of view (FOV) in the range of 150° to 170°.

[0161] Optionally, in further embodiments, the optical assembly 603 can also comprise two second side-directing optical assemblies similar to the first side-directing first optical assembly 602A and the second side-directing first optical assembly 602B described hereinabove. According to some embodiments, the focal length of the forward-directing optical assembly 601 is on the order of about 1.1 mm, while the focal lengths of the first and second side-directing optical assemblies 602 (602A, 602B), 603 are on the order of about 1.0 mm.

[0162] Reference is now made to Figures 6A and 6B, along with Figures 7A through 7C. Figures 7A through 7C illustrate example content that can be displayed on a multifocal, multi-camera endoscopic display system 700, according to certain embodiments. Endoscopic display system 700 includes a forward-facing viewscreen 701, a first side-viewscreen 703, and a second side-viewscreen 705. The forward-facing viewscreen 701 is used to display images captured by forward-facing optical assembly 601 shown in Figures 6A and 6B, the first side-viewscreen 703 is used to display images captured by first side-facing optical assembly 602 shown in Figure 6A or first side-facing optical assembly 602A shown in Figure 6B (depending on whether endoscope tip section 600a or 600b is being used), and the second side-viewscreen 705 is used to display images captured by second side-facing optical assembly 703 shown in Figures 6A and 6B. Thus, it should be understood that when using endoscope tip section 600a of Figure 6A, forward-viewing screen 701 displays images captured by forward-pointing optical assembly 601, while side-pointing screens 703 and 705 display images captured by first and second side-pointing optical assemblies 602, 603, respectively, shown in Figure 6A. Alternatively, when using endoscope tip section 600b of Figure 6B, forward-viewing screen 701 displays images captured by forward-pointing optical assembly 601, while side-pointing screens 703 and 705 by default display images captured by first side-pointing optical assembly 602A and second side-pointing optical assembly 603, respectively, shown in Figure 6B.

[0163] Thus, screens 701, 703, and 705 are configured to simultaneously display multiple fields of view captured by multi-camera endoscope tip section 600a or 600b shown in Figures 6A and 6B. Multi-camera endoscope tip section 600a or 600b provides an expanded 330° field of view, allowing a clinician to conveniently move the endoscope tip section through the investigation area to identify and treat objects of interest or abnormalities.

[0164] 7A shows exemplary images of anterior and lateral views of a colon 707, colonic folds 709, and objects of interest (such as polyp 711) displayed on first side-viewing screen 703. The images are captured by first side-directing optical assembly 602 or first side-directing optical assembly 602A (depending on whether endoscope tip section 600a or 600b is used). An exploded view of first side-viewing screen 703 is shown, depicting a magnified image 720 that includes a magnified image of polyp 311, labeled 711″.

[0165] During an endoscopic procedure, a clinician or operator advances endoscope tip section 600a (or 600b) while using endoscope tip sections 600a and 600b within a body cavity (such as the colon) while observing images (typically video feeds) transmitted by optical assemblies 601, 602, and 603 depicted in FIG. 6A (or optical assemblies 601, 602A, and 603 depicted in FIG. 6B). According to one embodiment, upon identifying or locating a polyp 711 in the wall of the colon, the operator can move or advance endoscope tip section 600a (or endoscope tip section 600b) near polyp 711 and magnify the image of the polyp using first side-directing optical assembly 602 having a second working distance lens 611 depicted in FIG. 6B. In another embodiment, the operator can magnify the image of the polyp using first side-directing second optical assembly 602B having a second working distance lens 631 depicted in FIG. 6B. Depending on the condition of the polyp 711 shown in the enlarged image 711'', the operator can decide whether to insert a treatment tool through the working channel of the endoscope to remove, treat and / or extract a sample of the polyp 711 or the entire polyp for biopsy.

[0166] Reference is now made to FIG. 7B, which illustrates a magnified image 311'' on side-view screen 703. Polyp 311 is displayed at a high magnification, occupying a large portion of side-view screen 703, while an image of, for example, colon 707 and colon folds 709 is displayed on front screen 701 at a default magnification. However, zooming in and magnifying polyp 311 by, for example, about 30% or more on first side-view screen 703, while displaying images at the default magnification on front-view screen 701 and second side-view screen 705, may cause disorientation and general eye strain and discomfort to the operator, which may interfere with the operator's ability to successfully examine, treat, and / or remove the polyp.

[0167] Reference is now made to Figure 7C, which illustrates a magnified image on the first side-view screen 703 and a dimmed, blacked-out, or disabled front-view screen 701 and second side-view screen 705. The polyp 311 is shown at a large magnification, occupying a large portion of the first side-view screen 703, while the other two screens 701 and 705 are disabled, blacked-out, and / or darkened. By disabling, blacking-out, and / or darkening the front-view screen 701 and second side-view screen 705, the operator can examine the magnified polyp image 311'' without being visually obstructed or confused.

[0168] According to aspects and embodiments herein, the processor is configured to perform the following actions in any order: switching off the forward-facing optical assembly 601, switching off the associated illumination 608, and / or switching off, blacking out, or darkening the display of the forward-view screen 701; switching off the second side-facing optical assembly 603, switching off the associated illumination 628, and / or switching off, blacking out, or darkening the display of the second side-view screen 705; changing the working distance of the first side-facing optical assembly 602 to zoom in by moving the first lens 609 out and instead moving the second lens 611 into the light path 610; or to switch off, deactivate or disable, e.g., by removing power to, the first lateral-direction first optical assembly 602A (having the first working distance) and switch on, activate or enable, e.g., by applying power to, the second lateral-direction second optical assembly 602B (having the second working distance) in order to zoom in (if the endoscope tip section 600b is being used).

[0169] This allows the front view screen 701 and the second side view screen 705 to be disabled, blacked out or darkened while the first side view screen 703 displays the magnified polyp image 711'' in place of the previous unmagnified polyp image 311.

[0170] Reference is now made to Figure 8A, which illustrates a perspective view of a tip section of a multifocal, multi-camera endoscope, the interior walls of a body cavity, and an object of interest, according to a specific embodiment. Endoscope tip section 800 (which may be endoscope tip section 600a or 600b of Figures 6A and 6B) comprises a forward-facing view element or camera 801, one or more forward-facing illuminators 802, a working channel 803, fluid injection channels 804 and 805 for irrigating camera 801 and illuminator 802, a multifocal side-facing view element 811, and one or more side-facing illuminators 812. In various alternative embodiments, endoscope tip section 800 also optionally comprises another side-facing view element and one or more associated side-facing illuminators positioned opposite multifocal view element 811.

[0171] According to some embodiments, the term “inner wall of a body cavity” includes, for example, the inner wall of a colon or intestine. A distal portion 800 of a multi-camera endoscope is shown near an inner wall of a body cavity 850, which may be, for example, the wall of a colon. The inner wall has an abnormality or object of interest 860 that may require further investigation. For this further investigation, the operating working distance of multifocal side-pointing viewing element 811 is changed from a first working distance (e.g., provided by lens 609 in FIG. 6A or provided by first side-pointing first optical assembly 602B in FIG. 6B ) to a greater magnification or second working distance (e.g., provided by lens 611 in FIG. 6A or provided by first side-pointing second optical assembly 602B in FIG. 6B ). According to certain aspects, object of interest 860 may be too close to multifocal side-pointing optical assembly 811, as represented by arrow 810 indicating the greater magnification or second working distance. As shown in FIG. 8A, the distance to object 860 does not match the working distance of the higher magnification lens 611 or the working distance provided by the first side-directed second optical assembly 602B, so zooming in or moving to a higher magnification working distance may produce a blurred image of object 860 on the side-view screen 703 shown in FIG. 7.

[0172] Reference is now made to Figure 8B, which shows a perspective view of a multifocal, multi-camera endoscope tip section 800 and an inflated colon, according to certain embodiments. In various embodiments, the interior wall of body cavity 850 is pushed away from endoscope tip section 800, thereby increasing the distance of multifocal side-pointing viewing element 811 to the interior wall, so that the working distance, indicated by arrow 810, generally matches the distance from side-pointing viewing element 811 to object of interest 860. In one embodiment, the distance from multifocal side-pointing viewing element 811 to the interior wall of body cavity 850 is increased or adjusted by injecting gas into the colon, for example, through fluid injection channel 804.

[0173] Reference is now made to FIG. 8C , which depicts a perspective view of a distal end portion 800 of a multifocal, multi-camera endoscope including one or more, preferably three or more, distance-determining members configured to contact the interior wall of a body cavity, according to certain embodiments. According to aspects herein, distance-determining members or spacers (such as spacers 807A and 807B) are retracted, extended, or deployed radially outward from distal end portion 800. The distance-determining members or spacers are configured to maintain the distance between multifocal side-pointing view element 811 and the interior wall of body cavity 850. While this embodiment provides two distance-determining members 807A and 807B as shown in FIG. 8C , more preferred embodiments provide three or more such distance-determining members. Alternative embodiments utilize one or more distance-determining members or spacers. First distance determining member 807A and second distance determining member 807B are configured to contact the inner wall of body cavity 450 to maintain a constant distance from multifocal side pointing view element 811 to object 860 consistent with a greater magnification or second working distance (e.g., provided by lens 611 depicted in FIG. 6A or provided by first side pointing second optical assembly 602B in FIG. 6B ). Thus, first distance determining member 807A and second distance determining member 807B are configured to extend radially outward from tip portion 800 and / or be positioned radially outward from tip portion 800 to enable stable acquisition of a magnified image captured by multifocal side pointing view element 811 and displayed on side-viewscreen 703 (depicted in FIG. 7C ).

[0174] In various embodiments, one or more distance determining members 807A and 807B are mounted on the distal end of tip section 800 or are deployable rings that are pulled radially outward from tip section 800 when activated or actuated. Activation or deployment of the rings is accomplished, for example, by depressing a button or switch on the handle of an endoscope that includes, in one embodiment, endoscopic tip section 800, or by configuring a processor associated with the endoscope to automatically deploy the rings when multifocal side-pointing view element 811 is capable of acquiring a magnified image at a second working distance (e.g., provided by lens 611 depicted in FIG. 6A or provided by first side-pointing second optical assembly 602B in FIG. 6B). In an alternative embodiment, one or more distance determining members 807A, 807B are designed as protrusions or spacers similar to protrusions 415, 415, 417 of FIG. 4.

[0175] In various embodiments, the radial protrusion height 'H' of the distance determining members or spacers 807A, 807B is in the range of 1.5 mm to 7 mm. In one embodiment, the radial protrusion height 'H' of one or more distance determining members or spacers 807A, 807B is limited to 2 mm to ensure that the field of view of the viewing element 811 is not distorted by the spacers 807A, 807B. In various embodiments, the one or more distance determining members 807A, 807B are spaced apart from each other such that the distance 'D' between any two consecutive distance determining means is in the range of 8 mm to 10 mm or in the range of 10 mm to 15 mm.

[0176] 9 is a flowchart illustrating exemplary steps of a method 900 for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal, multi-camera endoscope tip of an endoscope (such as a colonoscope). A processor associated with the endoscope is configured to perform method 900. Referring now to FIGS. 6A, 6B, and 9, in step 910, the multifocal, multi-camera endoscope tip (e.g., tip portion 600a or 600b) is moved within the patient's colon with at least one multifocal side-pointing optical assembly (i.e., the first side-pointing optical assembly 602 of tip portion 600a or the first side-pointing optical assembly 602A of tip portion 600b) in a first mode of operation to identify an abnormality, region, or object of interest (such as a polyp). During the first mode of operation, the at least one multifocal side-pointing optical assembly acquires images and / or video of the colon at a first working distance. The at least one multifocal side-directing optical assembly can operate at a first working distance using either the first lens 609 or the first side-directing first optical assembly 602A (while the first side-directing second optical assembly 602B is disabled), depending on whether the endoscope tip section 600a or 600b is being used. In one embodiment, the endoscope tip section operates in the first mode by default.

[0177] Images and / or video from the first mode of operation acquired from the at least one multifocal side-pointing optical assembly are displayed on a corresponding first side-view screen along with the identified anomaly, and images and / or video acquired from the forward and second side-pointing optical assemblies, respectively, are displayed on corresponding front and second side-pointing screens. It should be appreciated that the identified anomaly visible on the first side-view screen when imaged by the at least one multifocal side-pointing optical assembly is also simultaneously displayed on the front-view screen when imaged by the forward-pointing optical assembly in an overlapping field of view. In various embodiments, magnifications ranging from 100x to 6x are possible for images for the first working distance at which the anomaly is imaged during the first mode of operation.

[0178] In step 520, the processor enables the at least one multifocal side-pointing optical assembly to operate in a second mode of operation to acquire and display a magnified image containing the identified abnormality on the first side-view screen. During the second mode of operation, the at least one multifocal side-pointing optical assembly acquires the magnified image at a second working distance. The at least one multifocal side-pointing optical assembly can operate at the second working distance by switching to use the second lens 611 or by activating the first side-pointing second optical assembly 602B (while simultaneously disabling the first side-pointing first optical assembly 602A), depending on whether the endoscope tip section 600a or 600b is being used. In various embodiments, during the second mode of operation, the image for the second working distance at which the abnormality is imaged can have a magnification ranging from 250x to 100x.

[0179] According to one embodiment, the distance between the at least one multifocal side-directing optical assembly and the identified abnormality or object of interest is maintained by deploying one or more distance-determining members (e.g., members 807A, 807 in FIG. 8C ) radially outward from the distal end of the endoscope tip and advancing the distal section until the one or more distance-determining members contact the abnormality or the inner wall of the colon, thereby maintaining approximately the second working distance. In this embodiment, the radially outward extension or range of the distance-determining members, which in one embodiment are rings, can be varied by partially or fully retracting or deploying the distance-determining members. In other embodiments, the distance-determining members are attached to the distal end, providing a fixed radial extension or range that generally corresponds to the second working distance.

[0180] According to another embodiment, the body cavity (such as the colon) is inflated to push an object of interest located on the interior wall of the colon away from the distal end of the endoscope, thereby increasing the distance from the at least one multifocal side-directing optical assembly to the interior wall so that the working distance generally matches the distance from the multifocal side-directing optical assembly to the object of interest. In one embodiment, the distance from the at least one multifocal side-directing optical assembly to the interior wall of the body cavity is increased or adjusted by injecting gas into the colon, for example, through a fluid injection channel located at the distal end of the distal end of the tip section.

[0181] In step 530, if the magnification of the magnified image on the first side-view screen exceeds a predetermined percentage, the processor may perform any one or a combination of the following actions: a) switch off or disable the front and second side-pointing optical assemblies while leaving the lights associated with the front and second side-pointing optical assemblies on and while leaving the front and second side-pointing screens on, b) switch off the front and second side lights associated with the front and second side-pointing optical assemblies while continuing to generate live images and / or video streams and while leaving the front and second side-pointing screens on, and / or c) switch off, dim, or black out the image and / or video display on the front and second side-pointing screens while continuing to generate live images and / or video streams and while leaving the lights associated with the front and second side-pointing optical assemblies on. In some embodiments, the predetermined magnification percentage is about 30% or greater.

[0182] If necessary, while viewing the magnified image, a treatment tool can be inserted through the side service or working channel of the endoscope to remove, treat, and / or extract a sample or the entire abnormality or object of interest for biopsy. According to one embodiment, activating a button or switch on the handle of the endoscope causes a processor to switch the operating mode of the endoscope tip section from a first operating mode to a second operating mode.

[0183] Although endoscope tip sections 100a and 100b in FIGS. 1 and 2 illustrate a single multifocal optical assembly configured as forward-facing optical assembly 101 (or 101A or 101B), and endoscope tip sections 600a and 600b in FIGS. 6A and 6B illustrate a single multifocal optical assembly configured as first side-facing optical assembly 602 (or 602A or 602B), it should be understood that in various alternative embodiments, a multifocal, multi-camera endoscope tip section can include multiple multifocal optical assemblies. For example, various embodiments of the endoscope tip section can include at least two and up to three multifocal optical assemblies configured as a forward-facing optical assembly and a first and / or second side-facing optical assembly. In such endoscope tip sections including multiple multifocal optical assemblies, the multifocal optical assembly best suited, positioned, or oriented for observing abnormalities in a magnified or microscopic view can operate in a second operational mode to display the magnified view on a corresponding screen, while disabling and / or darkening the remaining optical assemblies and / or corresponding screens.

[0184] 10A and 10B show an endoscope tip 1000 used to view and / or capture images and / or video of an interior wall 1020 of a body cavity (such as the colon) that may have an abnormality or object of interest 1022 (such as a polyp). The tip 1000 includes an optical assembly 1001 that includes an imaging sensor 1005 mounted on an integrated circuit board, a lens assembly 1007 mounted to the imaging sensor 1005 to capture images, and one or more associated illuminators (such as illuminators 1008 and 1009). The first illuminator 1008 generates a first range of illumination 1030, and the second illuminator 1009 generates a second range of illumination 1032.

[0185] As shown in Figure 10A, while the tip section 1000 is moving through the body cavity, the optical assembly 1001 is positioned at a first working distance from the polyp 1022, where the first and second ranges of illumination can sufficiently illuminate the polyp 1022 to capture an image of the polyp 1022 by the imaging sensor 1005 and lens assembly 1007. Once the polyp 1022 is identified, the endoscope tip section 1000 immediately moves closer to the polyp 1022 to a second working distance, as shown in Figure 10B, to obtain a magnified image or view of the polyp 1022 (e.g., for closer analysis of the polyp 1022). The second working distance is shorter than the first working distance, and at the (shorter) second working distance, the first range of illumination 1030 and the second range of illumination 1032 cannot partially or completely illuminate the polyp 1022, as shown in Figure 10B. Therefore, even if the lens assembly 1007 has optical elements (such as lenses) that provide a working distance or field of view sufficient to capture an image of the polyp 1022 at the second working distance, the lack of adequate illumination reduces the ability to observe or obtain an image of the polyp 1022.

[0186] Thus, in accordance with certain aspects, the present specification discloses systems and methods for adjusting, redirecting, or redistributing lighting or the field of view of one or more lighting to facilitate sufficient illumination of an object of interest for observing or obtaining a magnified image and / or video of the object of interest using an optical assembly.

[0187] 11A through 11J show cross-sectional views of endoscopic tip sections 1100a through 1100g of various embodiments of endoscopes having at least one optical assembly, one or more associated illumination elements, and associated light conditioning elements. It should be understood that at least one optical assembly (provided with associated illumination and light conditioning elements) can be configured as a forward-facing optical assembly, a first side-facing optical assembly, and / or a second side-facing optical assembly. Thus, in various embodiments, the endoscopic tip section is a multifocal, multi-camera tip section comprising one, two, and up to three optical assemblies configured as a forward-facing optical assembly, a first side-facing optical assembly, and / or a second side-facing optical assembly, each having a field of view (FOV) in the range of 150° to 170° in various embodiments. Additionally, in various embodiments of a multi-camera tip including up to three optical assemblies configured as a forward-facing optical assembly, a first side-facing optical assembly, and / or a second side-facing optical assembly, the forward-facing optical assembly has a focal length on the order of 1.1 mm, while the first and / or second side-facing optical assemblies have a focal length on the order of 1.0 mm. Additionally, in some embodiments, the first and / or second side-facing optical assemblies are positioned such that their optical axes are at a distance ranging from 6 mm to 10 mm from the distal end of the endoscope.

[0188] Figures 11A and 11B show an endoscope tip portion 1100a having at least one multifocal optical assembly 1101 according to a first embodiment, the multifocal optical assembly 1101 comprising an imaging sensor 1105 mounted on an integrated circuit board, a lens assembly 1107 mounted on the imaging sensor 1105 and including a first lens 1107a and a second lens 1107b, and one or more illuminators (e.g., a first illuminator 1108 and a second illuminator 1109).

[0189] The distance between the first lens 1107a and the second lens 1107b is adjustable to allow the working distance or focal length of the optical assembly 1101 (or lens assembly 1107) to be changed from a first working distance or first focal length to a second working distance or second focal length. It should be understood that in this embodiment, both lenses 1107a and 1107b are positioned to have a common or identical optical path or optical axis. The first working distance is associated with a typical or standard working distance as the endoscope tip portion 1100a moves through a body cavity (e.g., the colon). The second working distance is associated with a standard or microscopic working distance that is shorter than the first working distance as the endoscope tip portion 1100a moves closer to an identified anomaly or object of interest (under analysis) to obtain a magnified image of the anomaly (e.g., a polyp).

[0190] According to a first embodiment, the endoscope tip section 1100a also includes first and second light conditioning elements 1118a, shown in a retracted configuration in FIG. 11A and in a deployed configuration in FIG. 11B. In one embodiment, the light conditioning elements 1118a are positioned on either side of the optical assembly 1101, with the optical assembly 1101, along with associated illumination 1108, 1109, residing between the first and second light conditioning elements 1118a. In one embodiment, the light conditioning elements 1118a have a Lambertian-reflecting surface configured to scatter or diffusely reflect light. Those skilled in the art will appreciate that Lambertian reflectance is a characteristic that defines an ideally "matt" or diffusely reflecting surface. The apparent brightness to an observer of a Lambertian surface is the same regardless of the observer's viewing angle. In one embodiment, the light conditioning elements 1118a are etched to have a Lambertian coating. The range of coating materials for Lambert coatings includes, but is not limited to, for example, Spectralon® or Spectraflect® manufactured by Labsphere.

[0191] In one embodiment, the light conditioning element 1118a is a balloon that is inflatable and electrically and / or mechanically actuable to deploy or protrude, hi another embodiment, the light conditioning element 1118a is a screen that is initially coiled in a retracted configuration and then unfolded in a deployed configuration.

[0192] During an endoscopic procedure, with the optical assembly 1101 providing a first working distance or focal length and the light conditioning element 1118a in a retracted configuration, the clinician moves the endoscope tip section 1000a through the body cavity, with light emitted from the first illuminator 1108 and the second illuminator 1109 directly illuminating or illuminating the anomaly in a first illumination mode (as depicted in FIG. 10 ). Once the anomaly is identified, the clinician approaches the anomaly, adjusts the distance between the first lens 1107a and the second lens 1107b so that the optical assembly 1107 provides a microscopic or second working distance, and extends or deploys the light conditioning element 1118a (which in one embodiment is a balloon) (e.g., by inflating the balloon) to reflect or redirect the light emitted from the illuminators 1108, 1109 into multiple oblique light beams that are directed toward the anomaly in a second illumination mode. Thus, in the second illumination mode, the oblique light beam illuminates the anomaly sufficiently to observe and / or capture a magnified image of the anomaly at the second working distance.

[0193] In one embodiment, the dimensions of the balloon and / or the amount of inflation of the balloon are determined so that when the balloon is inflated and deployed, the balloon can approximately match the distance of the multifocal optical assembly 1101 from the abnormality to the second working distance or the second focal distance.

[0194] 11C shows an endoscope tip section 1100b according to a second embodiment. In the second embodiment, the multifocal optical assembly 1101 and associated illuminators 1108, 1109 are similar to the first embodiment of FIGS. 11A and 11B in that a light conditioning element 1118a is included. Furthermore, in the second embodiment, the first and second light conditioning elements 1118b are positioned above the light emission surfaces of the first and second illuminators such that light emitted by the illuminators 1108, 1109 must strike and pass through the first and second light conditioning elements 1118b.

[0195] In various embodiments, the light conditioning element 1118b includes a light diffuser, such as, but not limited to, a liquid crystal transmission screen, a movable translucent diffuser film, or a quantum well diffuser. Examples of liquid crystal transmission screens or movable translucent diffuser films include polymer-dispersed liquid crystal films, also known as PDLC films, which have microdroplets of liquid crystal material dispersed in a transparent polymer matrix. Transparent electrodes are applied to both surfaces of the film. In the absence of an electric field, the liquid crystal microdroplets diffuse light, making the film translucent. However, an electric field applied between the electrodes orients the liquid crystal molecules so that the film transmits light without diffusing it, making the film transparent. Alternatively, the PDLC film can be configured so that in the absence of an electric field, the liquid crystal microdroplets transmit light without diffusing it, making the film transparent. However, an electric field applied between the electrodes orients the liquid crystal molecules, diffusing or scattering light, making the film translucent.

[0196] During the first illumination mode, as the clinician moves the endoscope tip section 1100b through the body cavity with the optical assembly 1101 providing a first working distance or first focal length, the light conditioning element 1118a is retracted and the element 1118b passes light with little or no diffusion. However, during the second illumination mode, as the clinician moves the endoscope tip section 1100b abnormally close to capture a magnified view or image with the optical assembly 1101 providing a second working distance, the light conditioning element 1118b passes light with greater scattering or diffusion and / or the light conditioning element 1118a is in the deployed configuration and diffuses light. Advantageously, scattering or diffusing the light provides multiple oblique beam illumination, which is desirable for microscopic imaging at the second working distance.

[0197] Advantageously, the diffused light has a large incidence angle. According to some embodiments, the incidence angle of the diffused light is approximately 180°. According to some embodiments, the incidence angle of the diffused light is in the range of 120° to 180°. FIG. 13A shows a polar diagram of the relative illuminance 1305 at a light diffuser (e.g., light conditioning element 1118a) versus the incidence angle 1308 when no electric field is applied to the light diffuser. In one embodiment, the light diffuser is a PDLC film that diffuses or scatters light when an electric field is applied, but transmits light otherwise. As discussed herein, PDLC film contains microdroplets of liquid crystal material dispersed within a transparent polymer matrix. Each microdroplet of liquid crystal typically contains individual liquid crystal molecules with dimensions of 5-10 μm, close to the wavelength of light. Applying an electric field also changes the polarization and diffusion state of the light. Thus, as depicted in FIG. 13B, when an electric field is applied to the PDLC film, the relative illuminance 1305' of the light is spread or scattered over a wider radiation angle 1308 compared to the illuminance spread 1305 described above.

[0198] Figure 11D illustrates an endoscope tip portion 1100c according to a third embodiment, which is similar to the second embodiment (1100b) in that the tip portion 1100c includes two types of light conditioning elements 1118a and 1118b. Specifically, Figure 11D illustrates a second illumination mode when the endoscope tip portion 1100c, having a multifocal optical assembly 1101 adjusted to provide a second working distance, approaches an abnormality 1122 present on an inner wall 1120 of a body cavity. As illustrated in the figure, in the second illumination mode, the light conditioning element 1118a in the deployed configuration diffusely reflects the light from the illuminators 1108 and 1109, and the light conditioning element 1118b largely scatters or diffuses the light from the illuminators 1108 and 1109 and passes it through, forming multiple oblique light beams 1130 and 1132 that illuminate the abnormality 1122. It should be understood that in various alternative embodiments, two types of light conditioning elements 1118a, 118b may be provided at the distal end of the endoscope, and either one or both of the two types of light conditioning elements 1118a, 118b may be activated and used to illuminate the abnormality for microscopic visualization and imaging. Thus, according to various embodiments, the light conditioning elements 1118a, 1118b are configured to condition, redirect, diffusely reflect, or reflect light to provide dark-field illumination for obtaining microscopic images. Dark-field illumination is achieved by providing light as an oblique beam characterized by an acute angle to the abnormality, minimizing light reflected directly from the abnormality back into the multifocal optical assembly.

[0199] 11E and 11F show an endoscope tip portion 1100d according to a fourth embodiment, similar to the first embodiment (1100b) but differing in that the lens assembly 1107 includes first and second interchangeable lenses 1107a and 1107b. Thus, during a first illumination mode, the multifocal optical assembly 1101 shown in FIG. 11E can provide a first working distance or focal length with the first lens 1107a positioned in the optical path or axis of the lens assembly 1107, while the light conditioning element 1118a (e.g., a balloon) is in a retracted configuration. However, during a second illumination mode, the optical assembly 1101 shown in FIG. 11F can provide a second working distance or focal length by moving the first lens 1107a out of the optical path and inserting the second lens 1107b into the optical path or axis, while the light conditioning element 1118a is in a deployed configuration (e.g., by inflating the balloon).

[0200] Figure 11G shows an endoscope tip portion 1100e according to a fifth embodiment, which is similar to the third embodiment (1100c), but differs in that the lens assembly 1107 includes first and second interchangeable lenses 1107a, 1107b, as in the embodiment of Figures 11E and 11F. Referring now to Figure 11G, during a first illumination mode, the multifocal optical assembly 1101 can provide a first working distance or first focal length with the first lens 1107a positioned in the optical path or optical axis of the lens assembly 1107, while the light conditioning element 1118a (such as a balloon) is in a retracted configuration and the light conditioning element 1118b (such as a liquid crystal transmission screen) can pass light therethrough with little or no diffusion or scattering. However, during the second illumination mode, the optical assembly 1101 can provide a second working distance or a second focal length by moving the first lens 1107a out of the optical path and inserting the second lens 1107b into the optical path or optical axis, while the light conditioning element 1118a is in an expanded configuration and / or the light conditioning element 1118b can pass light therethrough in a highly diffused or scattered manner.

[0201] 11H and 11I show an endoscope tip portion 1100f according to a sixth embodiment, which is similar to the third embodiment (1100c) except that the tip portion 1100f includes first and second multifocal optical assemblies 1101, 1101′ (collectively referred to as a “composite multifocal optical assembly”). The first and second multifocal optical assemblies 1101, 1101′ include corresponding image sensors 1105, 1105′, respectively, mounted on integrated circuit boards, corresponding lens assemblies 1107, 1107′, respectively, mounted on the image sensors 1105, 1105′, and one or more associated illuminators (illuminators 1108, 1109, etc.). The first lens assembly 1107 enables the optical assembly 1101 to provide a first working distance or a first focal length. The second lens assembly 1107′ enables the optical assembly 1101′ to provide a second working distance or a second focal length. 11H, during a first illumination mode, the first optical assembly 1101 can provide a first working distance or a first focal length, and the second optical assembly 1101' can be disabled, while the light conditioning element 1118a (such as a balloon) is in a retracted configuration. However, during a second illumination mode, as shown in FIG. 11I, the second optical assembly 1101' can be enabled and can provide a second working distance or a second focal length, and the first optical assembly 1101 can be disabled, while the light conditioning element 1118a is in a deployed configuration.

[0202] 11J shows an endoscope tip portion 1100g according to a seventh embodiment, which is similar to the third embodiment (1100), but differs in that, like the embodiments of FIGS. 11H and 11I, the tip portion 1100g includes first and second optical assemblies 1101, 1101′ (“compound multifocal optical assemblies”). As shown in FIG. 11J, during a first illumination mode, the first optical assembly 1101 can provide a first working distance or a first focal length, and the second optical assembly 1101′ is disabled, during which the light conditioning element 1118a (such as a balloon) is in a retracted configuration, and the light conditioning element 1118b (such as a liquid crystal transmission screen) can pass light therethrough with little or no diffusion or scattering. However, during the second illumination mode, the second optical assembly 1101′ is enabled and the first optical assembly 1101 is disabled, during which time the light conditioning element 1118a is in an expanded configuration and / or the light conditioning element 1118b allows light passing therethrough to pass through in a highly diffused or scattered manner.

[0203] In various embodiments, during the second illumination mode, the physician manually activates the light adjusting elements 1118a and / or 1118b by actuating at least one button or switch on the handle of the endoscope, activating the associated processor to enable the endoscope tip section (1100e, 1100g) to operate in the first illumination mode. In other embodiments, the processor is configured to enable the endoscope tip section to operate automatically in the second illumination mode.

[0204] In some alternative embodiments, the illuminance of the illuminators can be adjusted. According to some embodiments, at least one illuminator is switched off while other illuminators are switched on. According to further embodiments, the endoscope tip portion comprises a plurality of illuminators arranged at different distances from the multifocal optical assembly. Advantageously, in the second illumination mode, the illuminators arranged close to the multifocal optical assembly are switched off while the illuminators arranged relatively farther from the multifocal optical assembly are switched on, thereby reducing light reflected directly from the anomaly back to the multifocal optical assembly.

[0205] 12 is a flowchart illustrating exemplary steps of a method 1200 for obtaining a magnified view of a region or object of interest within a body cavity (such as the colon) using a multifocal, multi-camera endoscopic tip of an endoscope (such as a colonoscope), in accordance with various embodiments. A processor associated with the endoscope is configured to perform method 1200.

[0206] 11A through 11J and 12, in step 1210, a tip section of a multifocal, multi-camera endoscope (e.g., any one of tip sections 1100a through 1100g) is moved through the patient's colon. In various embodiments, the endoscope tip section includes at least one and up to three multifocal optical assemblies. In various embodiments, the one or more multifocal optical assemblies are configured as a forward-facing optical assembly and first and / or second side-facing optical assemblies. As shown in Figures 11 to 11J, at least one multifocal optical assembly may be: a) configured to have at least two lenses, both of which are positioned on the same optical path or optical axis of the at least one optical assembly, and provide a first working distance or first focal length or a second working distance or second focal length by adjusting the distance between the two lenses; b) configured to have at least two lenses that are alternately moved on the optical path or optical axis of the at least one optical assembly, and provide a first working distance or first focal length and a second working distance or second focal length; or c) configured as a "compound optical assembly" comprising a first optical assembly and a second optical assembly, wherein the first optical assembly has a first lens (or multiple lenses) to provide a first working distance or first focal length, and the second optical assembly has a second lens (or multiple lenses) to provide a second working distance or second focal length. As previously discussed herein, the first working distance or first focal length is associated with a first mode of operation of the at least one multifocal optical assembly during movement of the endoscope tip portion through the colon for initial identification of an abnormality, area, or object of interest, and the second working distance or second focal length is associated with a second mode of operation of the at least one multifocal optical assembly during observation, analysis, viewing, and / or acquisition of a magnified image of the identified abnormality, area, or object of interest.

[0207] 11A to 11J, at least one multifocal optical assembly is associated with one or more illuminators. The at least one multifocal optical assembly is also associated with: a) a first type of light conditioning element (e.g., element 1118a) comprising, for example, an inflatable balloon having a Lambertian-reflecting surface, which is in a retracted configuration in a first illumination mode and, when deployed in a second illumination mode, diffusely scatters light from the one or more illuminators such that light emitted from the one or more illuminators is diffusely reflected into multiple oblique light rays toward the identified anomaly, region, or object of interest; and / or b) a second type of light conditioning element (e.g., element 1118b) comprising, for example, a light diffuser such as, but not limited to, a movable translucent liquid crystal transmission screen, a diffuser film, or a quantum well diffuser. In the first illumination mode, the light conditioning element allows light to pass therethrough without being diffused or scattered or with a relatively small amount of diffusion or scattering, while in the second illumination mode, the light conditioning element allows light to pass therethrough with a relatively large amount of diffusion or scattering, such that light emitted from one or more illuminators is scattered into multiple oblique rays toward the identified anomaly, area, or object of interest.

[0208] In some embodiments, the first mode of operation is characterized by a field of view (FOV) of the multifocal optical assembly of 330° and a first working distance of 4 mm to 100 mm, while the second mode of operation is characterized by an FOV of 30° to 80°, particularly 40°, and a second working distance of 1 mm to 4 mm or 3 mm to 6 mm. In various embodiments, during the first mode of operation, a magnification ranging from 100x to 6x is possible for the image of the abnormality for the first working distance, and during the second mode of operation, a magnification ranging from 250x to 100x is possible for the second working distance.

[0209] Additionally, in some embodiments, the first illumination mode is characterized by a field of illumination (FOI) greater than 120°, resulting in unusually direct illumination (also known as bright-field illumination). In various other embodiments, the first illumination mode has an FOI in the range of 150°-170°. In some embodiments, the second illumination mode is characterized by an FOI in the range of 140°-180°, resulting in unusually oblique illumination (also known as dark-field illumination). In certain embodiments, the second illumination mode is characterized by an FOI in the range of 110°-170°.

[0210] In step 1210, the at least one optical assembly is in a first operational mode and the associated at least one light conditioning element is in a first illumination mode while moving through the patient's colon to identify abnormalities, regions, or objects of interest (such as polyps). In one embodiment, the first operational mode and first illumination mode are enabled by default, while in other embodiments, the physician activates at least one button or switch on the endoscope handle to wake up the processor and enable the endoscope tip to operate in the first operational mode and first illumination mode. During movement, images and / or video of the colon acquired by the at least one multifocal optical assembly are displayed on at least one associated screen.

[0211] In step 1220, the endoscope tip section is brought closer to the identified anomaly (for closer microscopic inspection using the magnified view and image), and at least one optical assembly is switched or moved to a second operational mode and at least one associated light adjusting element is switched or moved to a second illumination mode to obtain a magnified image of the anomaly. In one embodiment, the physician activates at least one button or switch to activate the processor to operate the endoscope tip section in the second operational mode and the second illumination mode. In another embodiment, the processor is configured to automatically operate the endoscope tip section in the second operational mode and the second illumination mode. In yet another embodiment, the processor is configured to automatically operate the endoscope tip section in the second illumination mode once the physician activates at least one button or switch on the handle of the endoscope to enable the tip section to operate in the second operational mode.

[0212] In step 1230, if the magnification of the magnified image exceeds a predetermined percentage, at least one multifocal optical assembly (used to optimally identify anomalies in step 1210) and at least one associated light conditioning element are enabled to operate in a second operating mode and a second illumination mode, respectively, and the processor disables other optical assemblies and / or their display on associated screens, as well as one or more lights and at least one associated light conditioning element. The other optical assemblies may or may not be multifocal and therefore may or may not have associated light conditioning elements. In some embodiments, the predetermined percentage magnification is greater than or equal to about 30%.

[0213] If necessary, under magnification, instruments can be inserted through the working channel of the endoscope to remove, treat and / or extract a sample or the entire abnormality or object of interest for biopsy.

[0214] The above examples are merely illustrative of the many applications of the methods and systems herein. While only a few embodiments of the invention have been described herein, it should be understood that the invention can be embodied in many other specific forms without departing from the spirit or scope of the invention. Accordingly, it is to be understood that these examples and embodiments are to be considered illustrative and not limiting, and the invention may be modified within the scope of the appended claims.

Claims

1. a first optical assembly for generating a first image of the body cavity, the first optical assembly including a plurality of lenses; a second optical assembly for generating a second image of the body cavity; at least one illuminator associated with each of the first optical assembly and the second optical assembly; A physical display; Processing system and The processing system comprises: simultaneously displaying the first image and the second image on the physical display; causing the first optical assembly to generate a magnified first image; causing the physical display to automatically erase the display of the second image when the enlarged first image is generated; Displaying the enlarged first image on the physical display and causing the first optical assembly to generate a magnified first image includes moving at least one lens of the plurality of lenses laterally into a field of view of the first optical assembly.

2. The endoscopic system of claim 1 , wherein the processing system reduces power to the second optical assembly to erase the display of the second image.

3. The endoscopic system of claim 1 , wherein the processing system reduces the illuminance of the at least one light associated with the second optical assembly to eliminate the display of the second image.

4. The endoscopic system of claim 1 , wherein the processing system dims or blacks out a portion of the physical display to remove the display of the second image.

5. The endoscopic system of claim 1 , wherein the first optical assembly is a forward-facing optical assembly and the second optical assembly is a first side-facing optical assembly.

6. 6. The endoscopic system of claim 5, further comprising a third optical assembly for generating a third image of the body cavity and displaying the third image on the physical display, the third optical assembly being a second side-facing optical assembly.

7. The endoscopic system of claim 1 , wherein the first optical assembly is configured to operate at a first working distance and a second working distance.

8. The endoscopic system of claim 7 , wherein the magnified first image is generated when the first optical assembly is switched from the first working distance to the second working distance.

9. 9. The endoscopic system of claim 8, wherein the first working distance provides a magnification ranging between 100x and 6x, and the second working distance provides a magnification ranging between 250x and 100x.

10. An endoscopic system as described in claim 1, wherein causing the first optical assembly to generate a magnified first image includes adjusting at least one light associated with the first optical assembly based on the magnified first image.

11. The endoscopic system of claim 1 , wherein the first optical assembly includes a first image sensor and the second optical assembly includes a second image sensor.

12. An endoscopic system as described in claim 11, wherein automatically erasing the display of the second image on the physical display when the enlarged first image is generated includes turning off power to the second image sensor.

Citation Information

Patent Citations

  • Light projector

    JP1980037750A

  • Electronic endoscope system

    JP1992341232A

  • Stereoscopic endoscope device

    JP1997005642A

  • Apparatus and method for forming gastric fundus folds

    JP2003526439A

  • Endoscope

    JP2010029545A