Imaging adapter for endoscopes

Abstract

An adapter for an endoscope system comprises a housing, an input device for receiving imaging signal input from an endoscope, and an imaging signal processing device configured to receive the imaging signal input and perform image processing techniques on the imaging signal input to generate an imaging signal output, wherein the imaging signal processing techniques are configured to change the display characteristics of the imaging signal input, and an output coupler for providing the imaging signal output to an imaging and control system. A method for converting a flat image to a distorted image includes the steps of: mapping pixels of a flat image to a first table that correlates pixels to locations in the flat image; correlating locations in the first table to locations in a second table for a distorted image; and generating a distorted image by moving pixels from locations in the first table to corresponding locations in the second table.

Description

Technical Field

[0001] Priority Claim This application claims the benefit of priority to U.S. Provisional Patent Application No. 500,046, filed May 4, 2023, and U.S. Provisional Patent Application No. 63 / 590,638, filed Oct. 16, 2023, the contents of which are incorporated herein by reference.

[0002] The present disclosure generally relates to medical devices having an elongate body configured to be inserted into an incision or opening in a patient's body structure to provide a diagnostic or treatment operation.

[0003] More particularly, the present disclosure relates to systems and devices for establishing connectivity between a medical device, an imaging system, and a control system.

Background Art

[0004] Endoscopes can be used for one or more of 1) providing passage for other devices, such as treatment devices or tissue retrieval devices, to various anatomical parts, and 2) imaging such anatomical parts. Such anatomical parts can include the gastrointestinal tract (e.g., esophagus, stomach, duodenum, pancreaticobiliary duct, intestine, and colon, etc.), the renal region (e.g., kidney, ureter, bladder, urethra), and other internal organs (e.g., genital system, sinus cavity, submucosal region, airway).

[0005] Conventional endoscopes can be involved in various clinical procedures, such as, for example, illuminating, imaging, detecting, and diagnosing one or more disease states, providing fluid delivery (e.g., saline or other formulated solutions via a fluid passageway) to an anatomical region, providing passage for one or more treatment devices (e.g., via a working channel) for sampling or treating an anatomical region, and providing a suction channel for recovering fluids (e.g., saline or other formulated solutions).

[0006] In conventional endoscopes, the distal portion of the endoscope may be configured to support and orient treatment devices, such as with the use of an elevator. In some systems, two endoscopes may be configured to work together, with the first endoscope guiding the second endoscope, which is inserted with the help of an elevator. Such systems can be useful when guiding the endoscope to anatomical locations within the body that are difficult to reach. For example, certain anatomical locations can only be accessed by the endoscope after insertion through a roundabout route. For example, duodenal endoscopy procedures (e.g., endoscopic retrograde cholangiopancreatography, hereafter referred to as the "ERCP" procedure) involve the use of an auxiliary scope (also referred to as a dotascope or cholangioscope) that can be advanced through the working passage of the main scope (also referred to as the motherscope or duodenal endoscope). In addition, other devices, such as tissue retrieval devices used for biopsy, can be inserted into the auxiliary scope. Typically, the duodenal endoscope, auxiliary scope, and tissue retrieval device are configured in a telescopic arrangement and gradually decrease in size. Typically, after each use, the duodenal endoscope, auxiliary scope, and tissue retrieval device are cleaned and sterilized for reuse. Therefore, the imaging and control systems have photogenerators, and their imaging processing capabilities and treatment functions are typically configured for repeated use with the same type of endoscope and instrument. [Prior art documents] [Patent Documents]

[0007] [Patent Document 1] WO2011 / 140118A1 [Overview of the project] [Problems that the invention aims to solve]

[0008] This disclosure recognizes that problems solved in surgical systems necessitate adapting disposable endoscopes for use with existing imaging and control systems. For example, there is a recent demand for using disposable endoscopes to eliminate the need to clean, sterilize, and reprocess reusable scopes. However, many capital equipment, such as photogenerators, imaging and processing equipment, are configured for use with reusable endoscopes that have specific compatibility, such as compatibility of illumination and imaging systems. Specifically, many endoscopes include the ability to transmit light, such as photoconductors or optical pipes, to transmit light generated in the imaging and control system to the distal end of the endoscope for use in biological structures. This allows the endoscope operator to control the imaging and illumination characteristics of the endoscope from the imaging and control system. Therefore, there is a need to create disposable endoscopes that are compatible with both existing imaging and control systems and are inexpensive. [Means for solving the problem]

[0009] This disclosure recognizes that the problems addressed in disposable surgical systems include not only the need to replicate compatibility but also the need to replicate the output and usability of conventional endoscopes in disposable endoscopes. Sometimes, to reduce the cost of disposable endoscopes, it is desirable to use less expensive components in single-use or disposable endoscopes. However, less expensive components can be implemented in a different way than components used in reusable endoscopes where the cost of additional capabilities is justified by multiple uses. Nevertheless, less expensive components, desirable for single-use endoscopes, may produce different outputs than more expensive components.

[0010] This disclosure can provide solutions to these and other problems by providing systems, devices, and methods relating to adapters that can transmit imaging commands between an imaging and control system and an endoscope, specifically to a disposable endoscope having components selected for cost and disposability. For example, a reusable endoscope may have imaging components such as a camera, sensor, or microchip configured to provide a video feed to the imaging and control system. Sometimes, these imaging components can work in conjunction with a fisheye lens that provides an intentionally distorted image that combines a wide-angle field of view at the periphery of the image with a magnified field of view at the center of the image. Such imaging provides the surgeon with both a magnified field of view of the tissue immediately in front of the camera, which can be useful when identifying target biological structures, and a wide-angle field of view around the magnified image, which can be useful when guiding through biological structures and when providing a background to the magnified image. However, the fisheye lens adds an additional cost to the endoscope and takes up space inside the endoscope. Therefore, it may be desirable to omit such features from disposable endoscopes in order to reduce costs and save space. This disclosure allows images generated by a disposable endoscope to be transformed or processed before transmission to the imaging and control system. Such converted or processed images can provide a customizable output familiar to users of reusable endoscopes. Specifically, an imaging adapter for a disposable endoscope may be configured to acquire a flat imaging signal from a camera that does not produce a fisheye image and electronically distort the image in order to reproduce a fisheye output for the imaging and control system. The imaging adapter of this disclosure can also provide other image processing capabilities, such as zoom, crop, stretch, distortion, warp, scaling, skew, interpolation, and other image processing.The imaging adapter of this disclosure can crop pixels of a raw digital image having a specific resolution to have a lower resolution, and can also provide imaging shifting capabilities that allow shifting from the center of the raw digital image to focus on a more desirable portion, such as an unobtrusive portion of the image, or a portion containing an area of ​​interest. Furthermore, the imaging adapter of this disclosure can create a three-dimensional (3D) image from a series of images.

[0011] In the example, an adapter for an endoscope system may comprise a housing, an input device for receiving imaging signal input from an endoscope, an imaging signal processing device configured to receive the imaging signal input and perform image processing techniques on the imaging signal input to generate an imaging signal output, wherein the imaging signal processing techniques are configured to alter the display characteristics of the imaging signal input, and an output coupler for providing the imaging signal output to an imaging and control system.

[0012] In another example, a surgical endoscope system may include an imaging and control system with a socket; an endoscope comprising a shaft with an imaging device at its distal end, a working passage extending at least partially through the shaft, an imaging sensor at the distal end configured to generate an endoscopic imaging signal including a flat image, and a communication device for transmitting the output of the imaging sensor; and an adapter configured to connect to the socket, comprising an input device configured to communicate with the communication device of the endoscope to receive the endoscopic imaging signal, a converter configured to convert the flat image of the endoscopic imaging signal into a converted image of the output imaging signal, and an output coupler configured to connect to the socket of the imaging and control system to transmit the output imaging signal.

[0013] An additional example may include a method for transforming a flat image into a distorted image, comprising the steps of: mapping pixels of the flat image to a first table that correlates pixels to locations in the flat image; correlating locations in the first table to locations in a second table for a distorted image; and generating a distorted image by moving pixels from their locations in the first table to their corresponding locations in the second table. [Brief explanation of the drawing]

[0014] [Figure 1] This is a schematic diagram of an endoscopic system comprising an imaging and control system and an endoscope such as a duodenal endoscope, on which the imaging processing adapter of this disclosure can be used. [Figure 2] Figure 1 is a schematic diagram of the endoscopic system, showing the imaging and control system connected to the endoscope. [Figure 3] This block diagram shows the optical conduction and signal relay connectors that connect the imaging and control system and the endoscope shown in Figures 1 and 2. [Figure 4] This block diagram shows the imaging processing adapter of the present disclosure, which connects the connectors of the imaging and control systems shown in Figures 1 and 2 to an endoscope equipped with an imaging generator. [Figure 5] This is a rear perspective view of the adapter of this disclosure showing connections for linking to an imaging and control system. [Figure 6] Figure 5 is a front perspective view of the adapter, showing the socket for connecting to an endoscope. [Figure 7] Figures 5 and 6 are rear view views of the adapter, showing the photoconductor and air connector for connecting to the imaging and control system. [Figure 8] Figures 5 and 6 are front view views of the adapter, showing the electronic port, air port, and alignment column for connecting to the endoscope. [Figure 9] Figures 5 to 8 show front perspective views of the adapter with the outer housing removed to reveal the support brackets connected to the plug and socket components. [Figure 10] The front perspective view of the adapter of FIG. 9 with the support brackets and socket components removed to show the photoconductor, circuit board, communication port, air tube, and air outlet. [Figure 11] A cross-sectional view through the adapter of FIG. 10 showing the air passage through the adapter and the image processing circuit electrically positioned between the communication port and the electrical lead wires. [Figure 12] A block diagram showing an example of the imaging processing adapter of the present disclosure including an image processing circuit. [Figure 13] A schematic diagram showing an imaging processing adapter for converting a flat image obtained from an endoscopic imaging sensor into a fish-eye image for use in an imaging and control system. [Figure 14A] A schematic diagram where a flat image is converted into a fish-eye image through an image manipulation process. [Figure 14B] A schematic diagram where the pixels of the flat digital image of FIG. 14A are converted into the fish-eye image of FIG. 14A. [Figure 15A] A schematic diagram where a flat image is converted into a pincushion image through an image manipulation process. [Figure 15B] A schematic diagram where the pixels of the flat digital image of FIG. 15A are converted into the pincushion image of FIG. 15A. [Figure 16] A block diagram showing the operation of a method for converting an imaging signal generated by an endoscope into a processed imaging signal generated by the imaging processing adapter of the present disclosure. [Figure 17A] A diagram showing a digital image from an imaging sensor indicating the presence of medical instrument components in the field of view and the processed image boundary in the digital image. [Figure 17B] A diagram showing the digital image of FIG. 17A with the processed image boundary shifted to adjust the presence of the medical instrument components.

Best Mode for Carrying Out the Invention

[0015] In drawings that are not necessarily to a consistent scale, similar symbols may depict similar components in different drawings. Similar symbols with different subscripts may represent different examples of similar components. Drawings are generally illustrative but not limiting, illustrating the various embodiments discussed in this document.

[0016] Figure 1 is a schematic diagram of an endoscopic system 10 comprising an imaging and control system 12 and an endoscope 14. The system in Figure 1 is an illustrated example of an endoscopic system suitable for use with the systems, devices, and methods described herein, such as an imaging processing adapter. According to some examples, the endoscope 14 may be insertable into an anatomical region for imaging and / or to provide passage for other devices, such as auxiliary scopes and biopsy devices, or one or more therapeutic devices for the treatment of disease conditions associated with an anatomical region. In advantageous embodiments, the endoscope 14 may be interfaced with and connected to the imaging and control system 12, for example, by insertion of a coupling section 36 into a socket 37. In the illustrated example, the endoscope 14 comprises a duodenal endoscope, although other types of endoscopes may be used with the features and teachings of this disclosure.

[0017] The imaging and control system 12 may include a control unit 16, an output unit 18, an input unit 20, a light source unit 22, a fluid source 24, and a suction pump 26.

[0018] The imaging and control system 12 may have various ports for connecting with the endoscope system 10. For example, the control unit 16 may have data input / output ports for receiving data from and communicating data to the endoscope 14. Such data input / output ports may be provided through an interface between the coupler area 36 and the socket 37. The light source unit 22 may have output ports for transmitting light to the endoscope 14, such as via an optical fiber link. For example, the coupler area 36 may have a photoconductor 39 (Figure 2) configured to receive light from a lens or bulb in the light source unit 22. The fluid source 24 may have ports for transmitting fluid to the endoscope 14. The fluid source 24 may have a fluid pump and tank, or it may be connected to an external tank, container, or storage unit. The suction pump 26 may have ports used to draw a vacuum from the endoscope 14 to generate suction, such as to draw fluid from the anatomical region into which the endoscope 14 is inserted. In the example, a fluid such as air may be supplied to the endoscope 14 through the interface in the coupling area 36 and socket 37. In the example, a fluid such as water may be directly input into the coupling area 36 without exiting from socket 37. An output unit 18, such as a touchscreen display, and an input unit 20, such as a keyboard, may be used by the operator of the endoscope system 10 to control the functions of the endoscope system 10 and to view the output of the endoscope 14. A control unit 16 may be additionally used to generate signals or other outputs from treating the anatomical region into which the endoscope 14 is inserted. In the example, the control unit 16 may generate electrical outputs, acoustic outputs, and fluid outputs, etc., for treating the anatomical region in the case of cauterization, cutting, and freezing.

[0019] The endoscope 14 may comprise an insertion area 28, a functional area 30, and a handle area 32 that can be connected to a cable area 34 and a connector area 36. The connector area 36 may be connected to the control unit 16 in a socket 37 to connect the endoscope 14 to several features of the control unit 16, such as an input unit 20 and a light source unit 22. A fluid source 24 and a suction pump 26 can be connected directly to the endoscope 14 without routing through the control unit 16.

[0020] The insertion area 28 may extend distally from the handle area 32, and the cable area 34 may extend proximal to the handle area 32. The insertion area 28 may be elongated and may include a bending area and a distal end to which the functional area 30 may be attached. The bending area may be controllable (e.g., by a control knob 38 in the handle area 32) to maneuver the distal end through a winding anatomical passage (e.g., stomach, duodenum, kidney, ureter, etc.). The insertion area 28 may be elongated and may include one or more working passages (e.g., lumens) that can support the insertion of one or more therapeutic instruments into the functional area 30, such as an auxiliary scope. The working passages may extend between the handle area 32 and the functional area 30. Additional functions such as fluid passages, guide wires, and tension wires may be provided by the insertion area 28 (e.g., via suction or irrigation passages, etc.).

[0021] The handle area 32 may include not only a control knob 38 but also a port 40A. The control knob 38 may be connected to a tension wire or other operating mechanism extending through the insertion area 28. In addition to port 40A, other ports such as port 40B (Figure 2) may also be configured to connect various electrical cables, guide wires, auxiliary scopes, tissue collection devices, and fluid tubes to the handle area 32 for connection to the insertion area 28. In the example, the handle area 32 may additionally include control features for the operational capabilities of the functional area 30 and imaging processing adapter of the present disclosure.

[0022] The imaging and control system 12, as an example, may be mounted on a mobile platform (e.g., a cart 41) with shelves for housing the light source unit 22, the suction pump 26, the imaging processing unit 42 (Figure 2), and the like. Alternatively, some components of the imaging and control system 12 shown in Figures 1 and 2 may be mounted directly on the endoscope 14 to make the endoscope "integrated".

[0023] The functional region 30 may contain components for treating and diagnosing the patient's biological structures. The functional region 30 may include an imaging device, an illumination device (e.g., the distal end of an optical fiber), and an elevator. In an example, the imaging device may be used with various lenses, such as lenses that can bend light or lenses that can protect the imaging device. Typically, the operation of some or all of the features of the functional region 30 is carried out in the imaging and control system 12 or the handle region 32.

[0024] Figure 2 is a schematic diagram of the endoscopic system 10 of Figure 1, comprising an imaging and control system 12 and an endoscope 14. Figure 2 schematically shows the components of the imaging and control system 12 connected to the endoscope 14, which in the illustrated example includes a duodenal endoscope. The imaging and control system 12 may include a control unit 16 that may include, or be connected to, a light source unit 22, an input unit 20, and an output unit 18, as well as an imaging processing unit 42, a treatment generator 44, and a drive unit 46. The coupling area 36 may be connected to the control unit 16 to connect the endoscope 14 to several features of the control unit 16, such as the imaging processing unit 42 and the treatment generator 44. In the example, the plug portion 48 of the coupling area 36 may include lead wires 49 for connecting to wiring in a socket 37 (Figure 1) that can be connected to one or more of the light source unit 22, the imaging processing unit 42, and the treatment generator 44. In the example, port 40A may be used to insert other instruments or devices, such as a dotascope or auxiliary scope, into the endoscope 14. Such instruments and devices can be independently connected to the control unit 16 via cable 47, or they can extend directly from the fluid source 24 and suction pump 26, rather than coming from the control unit 16. In the example, port 40B can be used to connect the coupling area 36 to various inputs and outputs such as video, air, light, and electricity. The control unit 16 may be configured to activate a camera to view the distal target tissue of the endoscope 14. In the example, the functional area 30 may include an imaging device that can transmit imaging signals to the imaging and control system 12 via lead wires 49 connected to wiring in socket 37 (Figure 1). Similarly, the control unit 16 may be configured to activate a light source unit 22 to direct light to the endoscope 14 or other devices extending from the endoscope 14. The light source unit 22 may include a light generator such as a xenon bulb or light-emitting diode. In the example, the light source unit 22 may include multiple light generators to generate light with different characteristics, such as different colors.

[0025] Each of the imaging processing unit 42 and the light source unit 22 can be interfaced with the endoscope 14 (for example, in the functional area 30) by wired or wireless electrical connections. Thus, the imaging and control system 12 can illuminate anatomical regions, collect signals representing anatomical regions, process signals representing anatomical regions, and display images representing anatomical regions on the output unit 18. The imaging and control system 12 may include a light source unit 22 to illuminate anatomical regions using light of a desired spectrum (e.g., broadband white light and narrowband light observation using preferred electromagnetic wavelengths). The imaging and control system 12 can be connected to the endoscope 14 (for example, via an endoscope connector or socket 37 (Figure 1)) for signal transmission (e.g., light output from the light source, video signals from the imaging system at the distal end, and diagnostic and sensor signals from diagnostic devices).

[0026] The fluid source 24 (Figure 1) can communicate with the control unit 16 and may include not only one or more sources of air, saline solution, or other fluids, but also passages for the associated fluids (e.g., air passages, irrigation passages, suction passages) and connectors (such as barb fittings, fluid seals, and valves). The fluid source 24 may also be used as operating energy for a biasing device or a pressure application device. The imaging and control system 12 may also include a drive unit 46, which may be an optional component. The drive unit 46 may include a motorized drive unit for advancing the distal section of the endoscope 14, as described at least in Patent Document 1, entitled “Rotate-to-Advance Catheterization System” to Frassica et al., which is incorporated herein by reference in its entirety.

[0027] As previously described, the coupling area 36 may be used to connect the endoscope 14 to the imaging and control system 12. The coupling area 36 may be used to communicate various functions between the endoscope 14 and the imaging and control system 12. For example, the coupling area 36 can transmit communication signals, electronic signals, electrical signals, power signals, fluids including water and air, and light waves, etc. The coupling area 36 may comprise a part of the endoscope 14 and may be configured for a specific configuration of the imaging and control system 12. For example, the coupling area 36 may be configured to transmit light generated by the light source unit 22 to the endoscope 14 using a photoconductor 39, as considered with reference to Figure 3. The coupling area 36 may also utilize lead wires 49 to transmit imaging signals between the functional area 30 and the imaging and control system 12. In this disclosure, as considered in more detail with reference to Figure 4, an imaging processing adapter may be connected to the imaging and control system 12 to couple with an endoscope that has built-in or mounted imaging processing capabilities. The imaging adapter can connect the imaging and control system 12 to the endoscope via a wired or wireless connection. Such an imaging adapter can convert, transform, transfer, or otherwise manipulate the imaging signal generated by the endoscope's imaging sensor to other image outputs, such as the shape or format of the image, for display to the user in the output unit 18 (Figure 1). Thus, for example, the output of a disposable endoscope with a less expensive imaging sensor can be electronically transformed to replicate the output of a more expensive imaging sensor, and to reproduce images familiar to users of non-disposable or reusable endoscopes. For example, the imaging adapter can transform a flat image into an image with fisheye distortion (e.g., barrel distortion) or pincushion distortion, or into an image that is cropped, distorted, skewed, stretched, enlarged, distorted, zoomed, and interpolated.The imaging adapter of this disclosure uses only a portion of the raw digital image that may be offset from the center of the raw digital image, such as being asymmetrically cropped, thereby allowing for additional cropping and shifting of the raw digital image to show only the portion of the raw digital image that has more features of interest. Furthermore, the imaging adapter of this disclosure can combine multiple two-dimensional images to form a three-dimensional image.

[0028] Figure 3 is a block diagram showing an optical guide connector 100 connecting the imaging and control system 102 to the endoscope 104. The imaging and control system 102 may include the imaging and control system 12 example shown in Figures 1 and 2. The imaging and control system 102 may include a control device 105, a video processing device 106, a memory 108, a light source 110, and a filter 112. In this example, the control device 105 may include the control unit 16 example shown in Figure 2, the light source 110 may include the light source unit 22 example shown in Figure 2, and the video processing device 106 may include the imaging processing unit 42 example shown in Figure 2. The endoscope 104 may include a scope cable 114, a scope handle 116, a scope working shaft 118, an imaging device 120, a lens 122, and an optical guide 124. In the example, the scope cable 114 may include the example of the cable area 34 in Figure 2, the scope handle 116 may include the example of the handle area 32 in Figure 2, and the scope working shaft 118 may include the example of the insertion area 28 in Figure 2. In the example, the optical guide connector 100 may include the example of the socket 37 in Figure 1. Thereafter, the scope cable 114 may have a connector similar to the connector area 36 in Figure 1.

[0029] The optical guide connector 100 can be used to transmit electronic signals, such as imaging signals and optical waves, between the imaging and control system 102 and the endoscope 104. In Figure 3, optical waves can be indicated by dashed lines, and optical signals can be indicated by solid lines. The optical guide connector 100 can transmit electronic signals generated by the imaging device 120 to the imaging and control system 102 and control signals from the control device 105 to the endoscope 104. For example, control signals for various operating features of the endoscope 104, such as ablation, suturing, RF signal generation, and low-temperature features, can be transmitted from the control device 105 to the endoscope 104. Furthermore, optical waves from the light source 110 can be transmitted to the endoscope 104 via the optical guide connector 100.

[0030] The optical guide connector 100 may comprise a photoconductor 126 and electrical wiring 128. The endoscope 104 may comprise a photoconductor 130 and electrical wiring 132. The imaging and control system 102 may comprise a photoconductor 134 and control wiring 136. The photoconductor 126 of the optical guide connector 100 can connect the photoconductor 130 of the endoscope 104 to the light source 110 via the photoconductor 134, and the electrical wiring 128 of the optical guide connector 100 can connect the electrical wiring 132 of the endoscope 104 to the control device 105 via the control wiring 136.

[0031] The endoscope 104 can control the transmission of electronic imaging signals from the imaging device 120 to the imaging and control system 102. For example, light can enter the lens 122 in the endoscope 104. The lens 122 can bend or distort the light waves passing through it in order to distort or otherwise transform the image generated by the imaging device 120. In this example, the lens 122 may be a fisheye lens or other customized lens to produce a desired output image. The lens 122 can be used to increase the input to the imaging device 120 in order to produce an enlarged or desiredly distorted image, such as fisheye distortion or pincushion distortion. Light can be received by the imaging device 120. In this example, the imaging device 120 may be a charge-coupled device (CCD) or a solid-state device such as a complementary metal-oxide-semiconductor (CMOS) device. The imaging device 120 can convert the light waves received from the lens 122 into electronic signals. Electronic signals can be transmitted through the scope work shaft 118, scope handle 116, and scope cable 114 via appropriate conductors of the electrical wiring 132 to the electrical wiring 128 of the optical guide connector 100. The electrical wiring 128 of the optical guide connector 100 may be equipped with appropriate connectors for transmitting electronic signals from the imaging device 120 to the imaging and control system 102 via control wiring 136. Thereafter, the video processing device 106 can receive electronic signals from the imaging device 120 for display on a video monitor such as the output unit 18 in Figure 1, after appropriate processing, etc. The memory 108 may include various red, green, and blue image memories for processing signals generated by the imaging device 120. Thereafter, in the case of a typical reusable endoscope, image data or signals generated by the imaging device 120 can be relayed from the endoscope 104 through the optical guide connector 100 to the imaging and control system 102 without modification.

[0032] In addition to optical and imaging signals, the optical guide connector 100 can relay other types of data, such as control signals for various functions of the endoscope 104. Specifically, control wiring 136, electrical wiring 128, and electrical wiring 132 can be additionally used to transmit control signals for the diagnostic and treatment functions of the endoscope 104. For example, a user can input settings for the functionality of the endoscope 104 into the control device 105 using an input unit 20 (Figure 2), etc. The control device 105 can then generate appropriate control signals for transmission to the optical guide connector 100. Electrical wiring 128 can be configured to transmit control signals using an additional conductor, such as a lead wire 49 (Figure 2), to transmit imaging signals, or the same conductor.

[0033] Furthermore, although not shown in Figure 3, the optical guide connector 100 may be equipped with appropriate piping or conduits for transporting fluids such as saline solution, irrigation fluid, air, blown gas, and other gases into and out of the endoscope 104.

[0034] The light source 110 can control the intensity and type of light generated by the imaging and control system 102. For example, the light source 110, or features of the imaging and control system 102 such as the input unit 20 (Figure 1), may include control features such as buttons or knobs for starting and stopping the generation of light waves and controlling the intensity of the light waves. The imaging and control system 102 includes control features for activating or deactivating different types of filters of the filter 112, such as color filters. Thus, a user of the imaging and control system 102 can initiate settings in the imaging and control system 102 for light to be transmitted to the optical guide 124 of the endoscope 104. Typical user settings include 1) on / off, 2) light intensity, and 3) light color. In an example, 1) the on / off setting may be an intensity function (e.g., zero intensity is equivalent to off), 2) the light intensity may be a function of the current or electrical signal supplied to the light source 110, and 3) the color setting may be a function of the filter 112 applied to the output of the light source 110. Each of 1), 2), and 3) can be set by the user in the control device 105 and can be specified as a characteristic of the light wave emitted from the light source 110. The photoconductor 126 of the optical guide connector 100 may be equipped with a suitable connector, conductor, or pipe for transmitting the light wave from the photoconductor 134 of the light source 110 to the optical guide unit 124. Thereafter, the light wave from the light source 110 can travel through the filter 112, the photoconductor 134 of the imaging and control system 102, the photoconductor 126 of the optical guide connector 100, the photoconductor 130 of the endoscope 104 (including the photoconductor 39 in Figure 2), and the optical guide unit 124, thereby allowing the light wave to exit the endoscope 104 to illuminate the biological structure into which the endoscope 104 is inserted.

[0035] With this configuration, the optical guide connector 100 can be configured to relay signals and optical waves between the imaging and control system 102 and the endoscope 104 without modification. In this example, the endoscope 104 can be specifically configured for operation by the imaging and control system 102. For example, the optical guide unit 124 may be configured to transmit optical waves generated by the light source 110 without interference or without introducing distortion such as discoloration or intensity changes. In addition, the optical guide connector 100 can provide electronic communication paths between the imaging device 120 and the video processing unit 106, and between the control unit 105 and the functions of the endoscope 104. Thus, the optical guide connector 100 does not include the ability to interpret, analyze, or modify optical signals, imaging signals, and control signals. Furthermore, the optical guide connector 100 may be mechanically configured to connect to specific types of endoscope plugs, such as the connector area 36 in Figure 1. Therefore, other types of endoscopes that are not configured to accept the output of the imaging and control system 12, or that are not mechanically configured to fit into the socket 37, are not mutually compatible with or operable with the imaging and control system 12.

[0036] Figure 4 is a block diagram showing the adapter 150 of this disclosure, which connects the imaging and control system 102 of Figures 1 and 2 to the endoscope 152.

[0037] The imaging and control system 102 may include a control device 105, a video processing device 106, a memory 108, a light source 110, and a filter 112. The imaging and control system 102 may be configured similarly to that disclosed with reference to Figure 3 to provide an optical output in the photoconductor 134 and to transmit and receive communication signals via control wiring 136.

[0038] The endoscope 152 may comprise a scope cable 154, a scope handle 156, a scope working shaft 158, an imaging device 160, a lens 162, an optical guide 164, and a light generator 166. The endoscope 152 may be configured similarly to the endoscope 104 in Figure 3, except that the endoscope 152 may comprise a light generator 166, rather than having a photoconductor 130 extending through it, as in the endoscope 104. In this example, the scope cable 154 may be configured similarly to the cable section 34 in Figure 2, the scope handle 156 may be configured similarly to the handle section 32 in Figure 2, and the scope working shaft 158 ​​may be configured similarly to the insertion section 28 in Figure 2, with the imaging device 160 located proximal to it instead of a photoconductor. In this example, the optical guide connector 100 may include the example of the socket 37 in Figure 1.

[0039] Adapter 150 can be used to transmit information from the optical guide connector 100 to the endoscope 152. Adapter 150 may be configured for insertion into socket 37 (Figure 1) to receive light from the light source unit 22 and control signals from the control unit 16, as well as various air sources. Adapter 150 may be configured to receive imaging signals from the imaging sensor 160, to perform imaging processing techniques on the imaging signals, and to transmit the processed imaging signals to the imaging and control system 102. The optical guide connector 100 can be used to transmit electronic signals and optical waves between the imaging and control system 102 and the adapter 150. In Figure 4, optical waves can be indicated by dashed lines and optical signals can be indicated by solid lines. Adapter 150 can transmit electronic signals generated by the imaging device 120 to the optical guide connector 100 for transmission to the imaging and control system 102, either after image processing has been performed or, optionally, after no image processing has been performed. The adapter 150 additionally transmits electronic signals from the control device 105 and the optical guide connector 100 to the endoscope 152. The adapter 150 can receive light waves from the optical guide connector 100 generated by the light source 110 and can convert such light waves into combined signal wiring 170 for transmission to the photogenerator 166. The photogenerator 166 may include a light source configured to output light waves. In this example, the photogenerator 166 may include a light-emitting diode (LED). In an additional example, the photogenerator 166 may be configured to generate light of different colors.

[0040] The adapter 150 may include a combined signal wiring 170 that can extend through the endoscope 152. The combined signal wiring 170 may be branched into an optical signal wiring 170A for communication with the photogenerator 166 and an imaging signal wiring 170B for communication with the imaging device 160. The imaging and control system 102 may include a photoconductor 134 and control wiring 136. The photoconductor 126 and electrical wiring 128 of the optical guide connector 100 can be connected to the adapter 150, which can transmit the combined signal wiring 170 to the photogenerator 166 and the imaging device 160. The combined signal wiring 170, the optical signal wiring 170A, and the imaging signal wiring 170B are depicted in the illustrated example of Figure 4 as having wired connections. However, in various examples, any or all of the combined signal wiring 170, the optical signal wiring 170A, and the imaging signal wiring 170B may include wireless signals. For example, the scope working shaft 158 ​​or scope handle 156 may be equipped with a wireless transmission device to receive signals from the optical signal wiring 170A and the imaging signal wiring 170B and convert those signals into wireless signals for transmission to the wireless antenna in the adapter 150. The endoscope 152 and adapter 150 may be equipped with wireless hardware to enable bidirectional wireless communication between the endoscope 152 and the adapter 150. In an additional example, the endoscope 152 may communicate with the imaging and control system 102 via wireless communication. In an example in which the wireless transmission device is included with the endoscope 152, the scope cable 154 does not need to extend to or connect to the adapter 150. However, a redundant communication system may be provided in which the endoscope 152 and adapter 150 are configured to communicate with the imaging and control system 12 via wired and wireless means.

[0041] The endoscope 152 can control the transmission of electronic imaging signals from the imaging device 160 to the imaging and control system 102. For example, light can enter the lens 162 in the endoscope 152. In this example, the lens 162 may be omitted, for example, because it may add cost and take up space. In this example, the lens 162 may be a protective lens that does not bend or convert the light passing through it. However, a lens that bends light may be used in some examples. Light can be received by the imaging device 160. In this example, the imaging device 160 may be a solid-state device such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS). The imaging device 160 can convert the light wave received from the lens 162 into an electronic signal. The electronic signal can pass through the scope working shaft 158, the scope handle 156, and the scope cable 154 via a suitable conductor of the combined signal wiring 170, and through the adapter 150 to the electrical wiring 128 of the optical guide connector 100. As will be described in more detail later, referring to Figure 12, etc., the adapter 150 may include circuits such as memory and processing units to convert the raw output of the image sensor 160 into a converted image output which may include one or more of the following image processing techniques, including the generation of a three-dimensional photograph: zoom, crop, transition, reframe, stretch, distortion, warp, scaling, skew, interpolation, and other image processing techniques. The electrical wiring 128 of the optical guide connector 100 may include appropriate connectors for transmitting electronic signals from the adapter 150 to the imaging and control system 102 through the control wiring 136. Thereafter, the video processing unit 106 can receive the processed image signal generated from the image sensor 160 for display on a video monitor such as the output unit 18 in Figure 1, after appropriate filtering, etc.

[0042] The light source 110 can control the intensity and type of light generated by the imaging and control system 102, as previously described. For example, the light source 110, or an imaging and control system 102 feature such as the input unit 20 (Figure 1), may include control features such as buttons or knobs to control 1) turning the light source 110 on / off, 2) the intensity of light from the light source 110, and 3) the color of light, as determined by the filter 112, by starting and stopping the generation of light waves and controlling the intensity of the light waves. The photoconductor 126 of the optical guide connector 100 may include a suitable coupler, conductor, or pipe for transmitting light waves from the photoconductor 134 of the light source 110 to the adapter 150. The adapter 150 can receive light waves from the photoconductor 134 and convert the sensed characteristics of the light waves, such as on / off, intensity, and color, into electronic control signals for the photogenerator 166. The adapter 150 may include a suitable sensor and circuit for converting light waves into electronic control signals, as discussed herein. As a result, the light waves from the light source 110 can travel through the filter 112 and the photoconductor 126 of the optical guide connector 100 to the adapter 150, and from the adapter 150, the light generation signal is transmitted along the combined signal wiring 170 to the light generator 166, which can then output light to the optical guide 164, thereby allowing the light waves to exit the endoscope 152 to illuminate the biological structure into which the endoscope 152 is inserted. Therefore, when an operator of the imaging and control system 102 requests light, such as by commanding the light source 110 to be turned on, the light generator 166 can be commanded to generate light waves equivalent in intensity and color to the light waves exiting the light source 110.

[0043] As configured, the adapter 150 can be configured to relay signals between the imaging and control system 102 and the endoscope 152 through conversion, modification, or interpolation. The endoscope 152 does not need to be specifically designed to work with the imaging and control system 102 and can have any type of photogenerator 166 and coupling section. In the example, the endoscope 152 can be adapted for operation with the imaging and control system 102 by using the adapter 150. The adapter 150 can be configured to allow multiple different types of endoscopes to communicate with the imaging and control system 102. For example, the adapter 150 can recognize the capabilities of the endoscope, such as the type of camera, and can perform image processing functions to provide the imaging and control system 12 with the image input that the imaging and control system 12 expects to receive, thereby making different types of endoscopes compatible with the imaging and control system 12. The adapter 150 can provide a suitable mechanical interface between the endoscope 152 and the imaging and control system 102, and a suitable conversion of control inputs 1), 2), and 3) that are input to the photogenerator 166 in the control device 105. In addition to optical signals such as light waves and imaging signals such as electronic communication signals, the adapter 150 can relay various fluids such as water and air, as well as other types of data such as control signals, between the optical guide connector 100 and the endoscope 152. In this disclosure, the adapter 150 may be additionally configured to provide imaging processing capabilities as discussed herein. The adapter 150 may have reusable parts that are easily cleaned and sterilized, while the endoscope 152 may be configured as a disposable scope that does not require cleaning and sterilization.

[0044] Figure 5 is a rear perspective view of the adapter 200 of this disclosure, showing the main housing 202 and the plug component 204. Figure 6 is a front perspective view of the adapter 200 of Figure 5, showing the socket component 206 for receiving the endoscope plug. The adapter 200 may include the example of the adapter 150 of Figure 4. Figures 5 and 6 are considered together.

[0045] The plug component 204 may comprise an air connector 208, a photoconductor assembly 210, and electrical leads 212. The air connector 208 and the photoconductor assembly 210 may extend from the end face 214 of the plug component 204. The electrical leads 212 may extend from the shoulder or corner of the plug component 204. The air connector 208 and the photoconductor assembly 210 may be connected to the optical guide connector 100 (Figure 3), or directly to the light source unit 22 (Figure 1) or other components of the imaging and control system 12. The plug component 204 can be inserted into the receptacle 216 of the main housing 202. The main housing 202 may have projections 218A and 218B that can be connected to a socket 37 (Figure 1) in the optical guide connector 100 or a receptacle such as the light source unit 22 via twist-lock or push-pull operation. The adapter 200 may include a button 219 for operating the functions of the adapter 200. In an example, the button 219 can switch the image processing features of the present disclosure by enabling or disabling an image processing capability, or by periodically repeating different image processing capabilities. In an example, two or more buttons may be included to perform additional functions, such as enabling individual switching of different image processing functions on or off. The main housing 202 may include other features, such as pads 220A and 220B, to provide ergonomic engagement with the user's fingers.

[0046] The adapter 200 may be configured to receive light waves in the photoconductor assembly 210, accept air in the air connector 208, and receive imaging and control signals in the electrical leads 212 and 214. In this example, the plug component 204 can be configured similarly to the plug portion 48 of the connector area 36 (Figure 2), and the electrical lead 212 can operate similarly to the lead 49. Thus, control signals generated by the imaging and control system 12 (Figures 1 and 2) can be transmitted to the adapter 200. Similarly, imaging signals generated by the endoscope 152 (Figure 4) can be transmitted to the imaging and control system 12 via the adapter 200. The photoconductor assembly 210 can be configured similarly to the photoconductor 39 (Figure 2). Thus, light output by the light source unit 22 can be transmitted to the adapter 200.

[0047] The socket component 206 may have an opening 222 to receive an endoscope plug, such as a plug connected to a combined signal wiring 170 (Figure 4). The opening 222 may have an air coupler 230 (Figure 8) and an electrical coupler 232 (Figure 8) for communication with the endoscope 152 (Figure 4). As discussed with reference to Figures 7 and 8, the adapter 200 can allow air, imaging signals, and control signals to pass through the main housing 202 and plug component 204 via the fluid coupler 230 and the electrical coupler 232.

[0048] Figure 7 is a rear view of the adapter 200 from Figures 5 and 6, showing the photoconductor assembly 210 and the air connector 208. Figure 8 is a front view of the adapter 200 from Figures 5 and 6, showing the air connector 230, the electrical connector 232, and the alignment columns 234A and 234B. Figures 7 and 8 are considered simultaneously.

[0049] The plug component 204 can be inserted into the socket 37 (Figure 1) of the light source unit 22. When inserted, the electrical lead wires 212 can be connected to electrical contacts in the socket 37 to enable the transmission of electrical signals from the imaging and control system 12, such as from the control unit 16 and the light source unit 22 to the endoscope. As discussed herein, the adapter 200 may include a circuit in the electrical connector 232 for performing image processing operations on the imaging signals coming to the adapter 200, and the processed signals, etc., can be transmitted to the electrical lead wires 212. The adapter 200 may also be configured to receive imaging signals via other means, such as via wireless communication signals, by using a wireless communication device 260 (Figure 11).

[0050] A plug for the endoscope 152 (Figure 4) can be inserted into the opening 222. The opening 222 may have an irregular shape, such as a rough square with one side rounded, to facilitate assembly with the endoscope plug in one orientation. Alignment columns 234A and 234B may be positioned in the opening 222 to facilitate connection with the endoscope plug. For example, alignment columns 234A and 234B may comprise cylindrical columns that can slide over the cylindrical socket in the endoscope plug to facilitate alignment. Alignment columns 234A and 234B may also reduce stress on the fluid coupler 230 and electrical coupler 232. In an additional example, alignment columns 234A and 234B may be spring-loaded to facilitate the withdrawal of the adapter 200. For example, alignment columns 234A and 234B may be biased to an extended position and thus compressed when the adapter 200 is connected to the control unit. This allows the compressed spring force to facilitate the removal of the adapter 200 when pulled by an operator or user.

[0051] Air piping may be connected to air connectors 208 and 230. Air piping 242 (Figures 10 and 11) may extend between air connectors 208 and 230 to allow air to pass through adapter 200. For example, air connectors 208 and 230 may be connected to air, carbon dioxide, saline solution, water, and other fluids to perform a variety of functions, including blowing. In the example, air connectors 208 and 230 may be equipped with hose connectors or hose fittings, with or without valves. In the example, adapter 200 may be configured to simply allow air to pass through main housing 202 and plug component 204 without interference, adjustment, or control. However, in some examples, adapter 200 may be configured to actively control the airflow through main housing 202 and plug component 204 based on electronic signals received from control unit 16 (Figure 1) or other supply source, for example, by including an electronically controlled valve.

[0052] The photoconductor assembly 210 may be configured to receive light waves from a light source. Specifically, the ends of the photoconductor assembly 210 may be directed towards the output of a light bulb or LED in the light source unit 22. The photoconductor assembly 210 may extend to a plug component 204 and emit light waves to a sensor package 245 (Figure 9). Electronic equipment connected to the sensor package 245 can convert the light waves into commands for a photogenerator 166 (Figure 4), which may be transmitted through an electrical connector 232. In this example, the photoconductor assembly 210 may comprise a photoconductor 240 located in a sheath 241. In this example, the photoconductor 240 may comprise an optical pipe or a bundle of optical fibers. For example, the photoconductor 39 (Figure 2) of the endoscope 14 may comprise a bundle of optical fibers, since it may comprise the most proximal end of a bundle of optical fibers extending through the cable section 34 and the insertion section 28. Therefore, to facilitate flexibility, it is desirable to fabricate the photoconductor 39 from multiple optical fibers. However, the optical conductor 240 may also include an optical pipe that contains a single optical conductor having a much larger diameter than individual optical fibers. This allows the optical conductor 240 to be more robust, with greater rigidity and greater resistance to heat.

[0053] Furthermore, as described herein, the adapter 200 may include electronic equipment such as an image processing circuit 247 (Figures 9-11) electrically positioned between the lead wire 212 and the electrical connector 232 to perform image processing and conversion techniques on the raw output of the imaging sensor received at the electrical connector 232, and to transmit the converted image to the imaging and control system 12 (Figure 1) via the electrical lead wire 212.

[0054] Figure 9 is a front perspective view of the adapter 200 of Figures 5 and 6 with the main housing 202 removed to show the support bracket 203 connected to the plug component 204 and the socket component 206. Figure 9 additionally shows the sensor package 245 and the image processing circuit 247. Figure 10 is a front perspective view of the adapter 200 of Figure 9 with the support bracket 203 and the socket component 206 removed to show the air connector 230, the electrical connector 232, the photoconductor 240, and the air piping 242. Figures 9 and 10 are considered together.

[0055] The photoconductor 240 may be connected to a photoconductor assembly 210 extending from the plug component 204. The photoconductor can direct light towards the sensor package 245. Air piping 242 may be connected to air connectors 230 and 208 (Figures 5 and 7). The optical substrate 244 may be connected to the control board 246 of the plug component 204 via fasteners 248 and columns 250. The control board 246 may be connected to the prongs 254 of the electrical leads 212. The control board 246 may be connected to the communication board 252 via a connector 253 which may be mounted on the substrate 255. The substrate 255 may additionally include other electronic components for processing imaging signals received from the imaging sensor 160 (Figure 4). For example, the substrate 255 may be connected to an image processing circuit 247. The circuit board 255 may be additionally connected to one or more buttons, such as button 219 (Figure 6), which is accessible from outside the main housing 202, in order to operate various features of the adapter 200. The connector 253 may be connected to the communication board 252 via wiring 256 (Figure 11). The optical board 244 may be connected to the communication board 252 via wiring 258 (Figure 11). The communication board 252 may be connected to the electrical connector 232 not only for transmitting control signals and optical generation signals to the endoscope 152 (Figure 4), but also for receiving imaging signals from the electrical connector 232 for transmission to the imaging and control system 12 (Figure 2). Thus, when the plug component 204 is inserted into the socket 37 (Figure 1), the electrical lead wires 212 may be arranged to communicate with the endoscope 152 through the prongs 254, the communication board 252, and the electrical connector 232. Similarly, when the plug component 204 is inserted into the socket 37, the air piping 242 may be positioned to communicate with the endoscope 152 through the air piping 242, air connector 208, and air connector 230. The photoconductor assembly 210 may also be positioned to align with the sensor package 245.

[0056] Figure 11 is a cross-sectional view passing through the adapter 200 in Figure 10, showing an air pipe 242 passing through the adapter 200 and a sensor package 245 positioned in close proximity to the photoconductor 240.

[0057] The air piping 242 may comprise a conduit connected to the air connectors 208 and 230. In the example, the air piping 242 may comprise a rubber or plastic pipe or tube. The air piping 242 may be connected to appropriate fittings in the air connectors 208 and 230 to provide a leak-proof passage through the adapter 200. For example, the air connectors 208 and 230 may comprise barb fittings into which the air piping 242 fits over. The air connector 208 may comprise a male projection that can be fitted into a mating female receptacle in the socket 37 (Figure 1). The air connector 230 may comprise a female receptacle that can receive a mating male projection in the connector of the scope cable 154 (Figure 4). The air connector 208 can be firmly supported by the end face 214 of the plug component 204, and the air connector 230 can be firmly supported by the socket component 206. The air piping 242 may extend unsupported through the adapter 200 between the air connector 208 and the air connector 230. In this manner, the support bracket 203 and the control board 246 may have appropriate openings to allow the air piping 242 to extend through them.

[0058] The sensor package 245 may comprise one or more optical sensors for interpreting various characteristics of light waves emitted from the photoconductor 240. The sensor package 245 or other suitable electronic equipment can convert the output of the optical sensors into commands to operate the photogenerator 166 (Figure 4). The commands to operate the photogenerator 166, along with other control signals from the electrical leads 212, can be communicated to the electrical connector 232. In this example, the electrical connector 232 may comprise an input / output device configured to transmit and receive not only electronic communication signals but also power such as electric current. In this example, the electrical connector 232 may comprise a Universal Serial Bus (USB) port, and more specifically, a USB-C port. Thus, the output from the sensor package 245 and the various prongs 254 from the control unit 16 can be transmitted to various components of the endoscope 152 (Figure 4).

[0059] In this example, the imaging signal may travel a path including an electrical connector 232, a communication board 252, wiring 256, a connector 253, a board 255 containing an image processing circuit 247, a control board 246, and electrical leads 212 to reach the imaging and control system 12 (Figure 1). In this example, the electrical connector 232 may be replaced or supplemented by a wireless communication device 260 to facilitate wireless transmission of communication with the communication board 252. The wireless communication device 260 may be wirelessly connected to a complementary wireless communication device of the endoscope to receive digital images. The image processing circuit 247 may include memory such as random access memory (RAM), read-only memory (ROM), optical memory, magnetic memory, and solid-state drives. The memory can be used to store not only the imaging output of the imaging sensor 160 but also a lookup table for processing the imaging output. For example, the imaging output may be stored in temporary memory, and the lookup table may be stored in permanent memory. The image processing circuit 247 may include appropriate electronic components, such as a circuit board and processing unit for converting the imaging output of the imaging sensor 160 using a lookup table, as discussed with reference to Figure 12.

[0060] Figure 12 is a block diagram of the optical processing adapter 300 of the present disclosure. The optical processing adapter 300 may include a housing 302, an optical pipe assembly 304, a first input / output (I / O) device 306, a second input / output (I / O) device 308, an air passage 310, and a control device 312. The control device 312 may include a circuit board 314, a processing unit 316, and a memory 318. The control device 312 may include the image processing circuit 247 shown in Figures 9 to 11. The optical pipe assembly 304 may include a filter 320, an optical pipe 322, a first sensor 324A, and a second sensor 324B.

[0061] The air passage 310 may be configured similarly to the air connector 208, air piping 242, and air connector 230. The air passage 310 may be configured as a pipe or tube to allow fluids such as air, gas, and water to pass through the adapter 300. The ends of the air passage 310 may be provided with appropriate male or female fittings for connection to imaging and control systems and endoscopes.

[0062] The I / O device 306 may be configured as electrical leads 212, prongs 254, and a control board 246, or may be configured to communicate with the electrical leads 212, prongs 254, and control board 246. The I / O device 306 may be configured to relay electronic communication signals to or from the adapter 300 for communication with the imaging and control system. The I / O device 308 may be configured as an electrical connector 232. The I / O device 306 may be configured to relay electronic communication signals to or from the adapter 300 for communication with an endoscope that generates light.

[0063] In the example, I / O devices 306 and 308 can communicate using wireless communication signals, such as Bluetooth, WiFi, Zigbee, infrared (IR), near-field communication (NFC), 3GPP, or other technologies. In the example, I / O devices 306 and 308 may have wired connections or ports for accepting wires for wired connections. In the example, I / O devices 306 and 308 can communicate using one or more of the IEEE 802.15.6-2012 protocol, the MICS protocol, and the MBAN protocol. In the example, I / O devices 306 and 308 may have ports such as serial (e.g., Universal Serial Bus (USB)) ports, parallel ports, or other wired or wireless (e.g., infrared (IR), near-field communication (NFC), etc.) connections for communicating or controlling one or more features of the imaging and control system and endoscope.

[0064] Filter 320 may be configured as filters 264A and 264B. In the example, filter 320 may include an absorptive filter that can absorb wavelengths of a particular color and allow wavelengths of other colors to pass through. In the example, filter 320 may include an interference filter that reflects wavelengths in a particular spectral band and transmits wavelengths in other spectral bands. In the example, filter 320 may include a pair of polarizing filters that are offset in rotation to allow light waves of a particular polarization to pass through while blocking light waves of other polarizations.

[0065] The optical pipe 322 can be configured as a photoconductor 240. The optical pipe 322 may comprise a single or monolithic component made from optical acrylic, polycarbonate, or other material. In an alternative example, the optical pipe 322 may be replaced by a bundle of optical fibers made from silica, plastic, or other material. The optical pipe 322 may extend between the filter 320 and sensors 324A and 324B. Thereafter, light exiting the filter 320 can enter one end face of the optical pipe 322, and light exiting the opposite face of the optical pipe 322 can direct the light waves toward sensors 324A and 324B.

[0066] The first sensor 324A and the second sensor 324B can be configured as part of the sensor package 245 (Figures 11 and 12). In the example, the first sensor 324A may comprise a light intensity sensor. In the example, the first sensor 324A may comprise a photodiode, a photoresistor, a phototransistor, and a photovoltaic photosensor. In the example, the second sensor 324B may comprise a color sensor. In the example, the second sensor 324B may comprise a light-to-photocurrent conversion sensor, a light-to-analog voltage conversion sensor, and a light-to-digital conversion sensor.

[0067] The circuit board 314 may include structural components for electrical components that electrically and structurally couple the adapter 300. For example, the circuit board 314 may include a silicon wafer or chip to which electrical coupling is mounted for electronic coupling, such as the processing unit 316, memory 318, sensor 324A, and sensor 324B. As connected to the processing unit 316, memory 318, and sensors 324A and 324B, the circuit board 314 can operate as a converter for converting light waves into electronic signals, as described herein.

[0068] The processing unit 316 may include an integrated circuit that controls the operation of components of the adapter 300, such as I / O devices 306 and 308, sensors 324A and 324B, and memory 318. The processing unit 316 can execute instructions stored in memory 318 to operate the components of the adapter 300, such as sensors 324A and 324B. In the example, the processing unit and memory are not required, and the adapter 300 can operate as a single integrated circuit, thereby allowing the outputs of sensors 324A and 324B to be transmitted directly by I / O devices 306 and 308.

[0069] Memory 318 may comprise any suitable storage device, such as non-volatile computer-readable memory, magnetic memory, flash memory, volatile memory, and programmable read-only memory. Memory 318 may contain instructions stored for the processing unit 316 to control the operation of the adapter 300. In the example, memory 318 may additionally comprise random access memory (RAM) or other types of memory suitable for storing imaging signals for processing by the processing unit 316 and transmission from the optical processing adapter 300, for example, since long-term storage of live stream imaging data is typically not required. Memory 318 may comprise more stable memory to store information that may be useful with different endoscopes, as it is intended to be used repeatedly by the optical processing adapter 300 over multiple uses.

[0070] Memory 318 may contain instructions for operating I / O devices 306 and 308 and sensors 324A and 324B. Memory 318 may additionally contain reference data for comparing the sensed light intensity with data from sensors 324A and 324B, such as one or more lookup tables (LUTs) for correlating the sensed light intensity with power and other information input to the light generator 166 (Figure 4), which can be used to convert specific light waves of intensity and color into one or more electronic signals for generating light of the same or approximately the same intensity and color. In the example, memory 318 may contain a lookup table having light intensity correlated with the current input to the light generator 166 (Figure 4), from zero input to maximum input to the light generator 166, and light intensity from zero output to maximum output of the light source 110 (Figure 4). Memory 318 may additionally include instructions for scaling the optical signal generated by the photogenerator 166 based on the effect of the filter 320, such as by applying an increase / decrease factor to adjust the output of the light source 110 by a correlated percentage. Memory 318 may additionally include instructions for compensating for the performance degradation of the light source 110 over time, such as by applying a correlation factor determined by comparing the actual output of the light source 110 with a predicted output stored in memory 318.

[0071] Memory 318 may additionally include information for processing images from the imaging sensor 160 (Figure 4). For example, memory 318 may include one or more lookup tables (LUTs) having imaging processing transformation tables stored therein. A lookup table may include a matrix of pixel locations for a flat image from the imaging sensor 160, which can be transformed into locations in the matrix of the transformed image. A lookup table may include a transformation table that maps pixels in the source image to locations in the transformed image. In the example, the lookup table can correlate pixel locations from the flat image to locations for pixels in the distorted image. Memory 318 may include lookup tables for transitioning or reframing images, such as removing components of a medical device, such as an elevator, within the field of view of the imaging device. Memory 318 may include multiple tables for different endoscopes and identifiers for different endoscopes that map to different lookup tables in the multiple lookup tables. Thus, the optical processing adapter 300 can be used with different endoscopes having different image outputs, for example, due to different types of lenses used together. Disposable endoscopes may be configured to output an identification signal that provides the type of imaging sensor, the type of lens, or the type of imaging output intended to be received by the imaging and control system. Thus, the processing unit 316 can use the information in memory to find an appropriate lookup table based on the type or model of the endoscope in order to provide the imaging and control system with the appropriate imaging signal.

[0072] Figure 13 is a schematic diagram showing how the imaging processing adapter 200 converts a flat image 330 obtained from the imaging sensor 160 (Figure 4) into a fisheye image 332.

[0073] Current reusable duodenal endoscopes have an image sensor and a lens designed to produce a fisheye image (greater magnification at the center of the target), but this design, using an image sensor and a customized lens, is expensive for a single-use endoscope. The most commonly mass-produced imaging devices available have lenses that produce flat images, which are undesirable for physicians accustomed to viewing fisheye images.

[0074] Therefore, it is necessary to create fisheye images while utilizing mass-produced image sensors that do not substantially increase the cost of endoscopes.

[0075] In an example, this disclosure relates to modifying an existing flat image without additional refractive lenses applied to an image sensor, which would incur considerable cost and space disadvantages. The flat image is modified electronically using a hardware and software strategy to produce a desired barrel distortion. The screen image is stored in a RAM chip in the system (preferably in the adapter of this disclosure) along with an FPGA (Field-Programmable Gate Array), so that the FPGA is programmed to manipulate pixels before being transmitted to a VPU (Video Processing Unit), such as an imaging and control system 12 (Figure 1) for display.

[0076] An image sensor is positioned at the distal end of the endoscope and outputs a flat 800x800 image. An adapter connected between the endoscope and the VPU (Video Processing Unit) uses a video output block stored on a RAM chip to selectively manipulate the image via an FPGA and LUT (Lookup Table) to convert the flat image into a fisheye image, with the LUT providing instructions on how scaling occurs across the screen image. The resulting image is then cropped and reduced to produce a 100-degree field of view from the 120-degree field of view generated by mass-produced imaging lens required for the intended design. Alternatively, for different applications, the image can be cropped and scaled to minimize the resulting image to keep it as close as possible to the sensor specifications.

[0077] While this example uses barrel distortion, other image manipulations can be performed by storing the image in RAM and modifying it using an FPGA. For example, pincushion distortion or image skew can be performed, and scaling and cropping can be limited to a portion of the image, such as the center or a portion identified by the user. By storing images in RAM, stitching multiple images can be used in camera systems with higher frame rates to create a larger field of view or a higher resolution image. Additionally, storing sequential images can be used to create stereoscopic images for 3D effects.

[0078] Figure 14A is a schematic diagram showing how a flat image 330 is transformed into a fisheye image 332 through image manipulation processing. The fisheye image 332 may contain a distorted image.

[0079] The flat image 330 coming from the imaging sensor 160 (Figure 4) may include a flat image with a size of 800 pixels × 800 pixels. Pixels can be mapped to grid locations for the flat image. For example, x and y coordinates can be assigned to each pixel.

[0080] The fisheye image 332 to be output by the output unit 18 (Figure 1) may have fisheye distortion and may have a size of 496 pixels × 496 pixels. This allows the imaging processing adapter of this disclosure to perform cropping of the flat image 330, for example, to convert the output of the imaging sensor 160 to something similar to that of an imaging device 120 (Figure 3) which may have a different type of imaging sensor.

[0081] The fisheye image 332 may contain pixels from the flat image 330 that have been moved to different locations. The fisheye image 332 may have grid locations to which x and y coordinates are assigned. However, the x and y coordinates may be further spaced apart towards the center of the fisheye image 332 at the periphery. Also, some of the pixels from the flat image 330 may be omitted. For example, some of the pixels around the periphery of the flat image 330 may be omitted to accommodate or make space for pixels extended around the center. The pixel mapping transformation from the flat image 330 to the fisheye image 332 can be stored in a lookup table.

[0082] The imaging adapter 200 can perform scaling and cropping in a single movement or transformation operation. The imaging adapter 200 may include one or more lookup tables to instruct a video output block, such as the image processing circuit 247 (Figures 9-11), where to extract pixels from the flat image 330 and where to place the extracted pixels in the fisheye image 332. In this example, the lookup tables for image transformation may be stored in the handle of the endoscope 152 (Figure 4). Thereafter, each endoscope configured for use with the imaging adapter 200 can instruct the imaging adapter 200 to perform the desired transformation to produce an output similar to that of a non-disposable or reusable endoscope.

[0083] Figure 14B shows a digital image 500 having pixels 502 arranged in a grid structure 504. Figure 14B also shows a converted digital image 510 in which the pixels 502 from the digital image 500 have been distributed to a barrel grid structure 514. Figure 14B shows a specific conversion for the image manipulation process described with reference to Figure 14A.

[0084] The digital image 500 may depict the raw output of an image sensor, such as the image sensor 160 in Figure 4. The converted digital image 510 may include a version of the digital image 500 processed by an image processing device of the Disclosure, such as the adapter 150 in Figure 4. As disclosed herein, the converted digital image 510 has undergone one or more operations, such as cropping, zooming, and shaping, to produce a digital image of a desired format, resolution, size, and distortion. In the example of Figure 14B, the converted digital image 510 is converted such as being cropped to a smaller image size, such as an image with fewer pixels, and distorted or stretched at the center to a fisheye shape.

[0085] The grid structure 504 may comprise columns 506A to 506T and rows 508A to 508T. Columns 506A to 506T may comprise pixels 502 arranged in straight vertical lines with respect to the orientation of Figure 14B. Rows 508A to 508T may comprise pixels 502 arranged in straight horizontal lines with respect to the orientation of Figure 14B. Each of the pixels 502 may be a square. Thus, the digital image 500 may contain linear space. Figure 14B shows the digital image 500 as a square with an equal number of rows and columns. However, the digital image 500 may have a rectangle, such that there are more rows or more columns of pixels 502.

[0086] The grid structure 514 may comprise columns 516A to 516P and rows 518A to 518P. Columns 516A to 516P may comprise pixels 502 arranged in outwardly curved lines (for example, away from the center of the grid structure 514) relative to the orientation of Figure 14B. Rows 518A to 518P may comprise pixels 502 arranged in outwardly curved lines (for example, away from the center of the grid structure 514) relative to the orientation of Figure 14B. Each of the pixels 502 may be a distorted square. In the example, pixels at or near the center of the converted digital image 510 may be stretched more than pixels at the center of the digital image 500. However, pixels at or near the center of the converted digital image 510 may be distorted less, or not distorted at all. The further away from the center of the converted digital image 510, the more distorted the pixels 502 may be. Therefore, while pixels 502 near the center of the converted digital image 510 may be square, pixels 502 at the four corners of the converted digital image 510 may be shaped like a rhombus, equilateral quadrilateral, or diamond, and may also have curved edges. However, other shapes may be produced, including other fisheye shapes. The converted digital image 510 may have a linear shape with outwardly curved edges. However, the edges of the converted digital image 510 may be truncated to form straight edges, as shown. Figure 14B shows the converted digital image 510 as a square with an equal number of rows and columns. However, the converted digital image 510 may have a rectangle, such that there are more rows or more columns of pixels 502.

[0087] The image processing hardware and the software of adapter 150 can assign grid coordinates to the columns and rows in the digital image 500. Similarly, the columns and rows of the converted digital image 510 may include grid coordinates. Adapter 150 can copy information about any or all of the pixels 502 in the digital image 500, process the pixel information, and thereby reproduce the processed pixel information in the converted digital image 510. For example, adapter 150 can take any combination of color, shadow, contrast, brightness, light intensity, and other information from one or more of the pixels 502 in the digital image 500 and transfer some or all of that information, either unchanged or modified, to a selected location in the converted digital image 510. In this example, not all of the pixels 502 in the digital image 500 are transferred to the converted digital image 510. As described above, the adapter 150 may include a memory device or may communicate with a memory device via a wired or wireless connection, and may include mapping information for moving pixels from one coordinate system to another to produce one or more fisheye effects.

[0088] Figure 14B shows an example where five rows of digital image 500 are converted into a single row in the converted digital image 510 near the top edge of digital image 500 to create a fisheye effect near the top edge of the converted digital image 510. This reduces approximately 100 pixels from the top portion of digital image 500 to approximately 16 pixels for the top line of the converted digital image 510.

[0089] Pixel 502-1 from coordinates A,E, such as column A, row E in the digital image 500, can be moved to coordinates A,B in the converted digital image 510. Pixels 502 above pixel 502-1, such as pixels from coordinates A,D to A,A, may be omitted from the transfer.

[0090] Pixels 502-2 from coordinates B,D in digital image 500 can be moved to coordinates B,B in the converted digital image 510. Pixels 502 above pixel 502-2, such as pixels between coordinates B,C and B,A, may be omitted from the transfer.

[0091] Pixels 502-3 from coordinates C,C in digital image 500 can be moved to coordinates C,B in the converted digital image 510. Pixels 502 above pixels 502-3, such as pixels between coordinates C,B and C,A, may be omitted from the transfer.

[0092] Pixels 502-4 may contain a block of pixels 502 in the same row. In the illustrated example, pixels 502-4 may contain six pixels. Pixels 502-4 can be moved from coordinates D,B to I,B in the digital image 500 to coordinates D,B to G,B in the converted digital image 510. Thus, six pixels 502 in the digital image 500 can be reduced to four pixels in the converted digital image 510. Pixels 502 above pixels 502-4, such as the pixels from coordinates D,A to I,A, can be omitted from the transfer.

[0093] Pixels 502-5 from coordinates J,A in digital image 500 can be moved to coordinates H,B in the converted digital image 510.

[0094] Pixels 502-6 can be moved from the digital image 500, similar to pixels 502-5 on the other side of the converted digital image 510.

[0095] Pixels 502-7 can be moved from the digital image 500, similar to pixels 502-4 on the other side of the converted digital image 510.

[0096] Pixels 502-8 can be moved from the digital image 500, similar to pixels 502-3 on the other side of the converted digital image 510.

[0097] Pixels 502-9 can be moved from the digital image 500, similar to pixels 502-2 on the other side of the converted digital image 510.

[0098] Pixels 502-10 can be moved from the digital image 500, similar to pixels 502-1 on the other side of the converted digital image 510.

[0099] Therefore, the left-hand side of the converted digital image 510, although the contents of each pixel are independent, can be a mirror image of the right-hand side of the converted digital image 510 from the perspective of the mapping process.

[0100] Figure 14B shows an example in which a vertically spaced pattern of pixels 502 from multiple straight rows in a digital image 500 can be moved to form an adjacent pattern of pixels 502 in a single inwardly curved row, thereby creating a fisheye effect.

[0101] Pixel 502 near the bottom of digital image 500 can be moved to the bottom of the transformed digital image with a mirrored image pattern, as is the case at the top.

[0102] Pixels near the left edge of digital image 500 are rotated 90 degrees counterclockwise, but can be moved in the same way as pixels at the top of digital image 500.

[0103] Pixels near the right edge of digital image 500 are rotated 90 degrees clockwise, but can be moved in the same way as pixels at the top of digital image 500.

[0104] Pixels 502 near the center of the digital image 500 can be moved to the converted digital image 510 through individual correlations. For example, pixels 502 at coordinates (J,J), (J,K), (K,J), and (K,K) in the digital image 500 can be directly moved to coordinates (H,H), (H,I), (I,H), and (I,I) in the converted digital image 510.

[0105] As considered, the specific mapping of the coordinates of the digital image 500 to the coordinates of the converted digital image 510 can be stored in the memory of the image processing circuit 247 (Figures 9-11).

[0106] Figure 15A is a schematic diagram showing how a flat image 330 is transformed into a pincushion image 340. The pincushion image 340 may include a distorted image. The pincushion image 340 may include a type of transformation of the flat image 330 that is the opposite of the fisheye image 332. The pincushion image 340 may be formed in a similar manner to the fisheye image 332 in Figure 14A. The pixel lines for the pincushion image 340 may be drawn from different lines of the flat image 330. The x and y coordinates for the pincushion image 340 may be spaced apart so that they are closer together towards the center of the pincushion image 340 at the periphery. The pixel mapping transformation from the flat image 330 to the pincushion image 340 can be stored in a lookup table.

[0107] There may be different types of memory used to store information about the flat image 330, the fisheye image 332, and the pincushion image 340. Block memory can be used to distort the transformation. Data about the source flat image 330 can be streamed to DDR memory. In the example, approximately 70 lines of the source image may be read into block memory. The video output block can utilize a lookup table to determine the location of the required pixels in the source image. The final pixels are streamed to the image and control system 12 (Figure 1).

[0108] In additional examples, pixel interpolation may be performed. Interpolation may involve combining pixels of a flat image 330 into a single pixel for a fisheye image 332 or pincushion image 340, or separating a single pixel for a fisheye image 332 into multiple pixels for a fisheye image 332 or pincushion image 340. Nearest neighbor interpolation may be used. Bilinear and bicubic interpolation may also be used. Special filtering may be performed simultaneously with interpolation if desired. For example, color filtering may be performed to enhance, remove, or add a desired color. Other filters may include NBI (narrowband imaging), UV, color enhancement, infrared, or color transition (warm or cool-warm). In addition to color filtering, other filters such as edge enhancement (sharpness) may be performed.

[0109] Figure 15B shows a digital image 550 having pixels 552 arranged in a grid structure 554. Figure 15B also shows a converted digital image 560 in which the pixels 552 from the digital image 550 have been distributed to a barrel grid structure 564. Figure 15B shows a specific conversion for the image manipulation process described with reference to Figure 15A.

[0110] The digital image 550 may depict the raw output of an image sensor, such as the image sensor 160 in Figure 4. The converted digital image 560 may include a version of the digital image 550 processed by an image processing device of the Disclosure, such as the adapter 150 in Figure 4. As disclosed herein, the converted digital image 560 has undergone one or more operations, such as cropping, zooming, and shaping, to produce a digital image of a desired format, resolution, size, and distortion. In the example in Figure 15B, the converted digital image 560 is transformed, such as being distorted or stretched at its center into a pincushion shape. In the illustrated example, the converted digital image 560 is not cropped to a smaller image size, such as an image with fewer pixels, but may be cropped in other pincushion transformations.

[0111] The grid structure 554 may comprise columns 556A to 556P and rows 558A to 558P. Columns 556A to 556P may comprise pixels 552 arranged in straight vertical lines with respect to the orientation of Figure 15B. Rows 558A to 558P may comprise pixels 552 arranged in straight horizontal lines with respect to the orientation of Figure 15B. Each of the pixels 552 may be a square. Thus, the digital image 550 may contain linear space. Figure 15B shows the digital image 550 as a square with an equal number of rows and columns. However, the digital image 550 may have a rectangle, such that there are more rows or more columns of pixels 552.

[0112] The grid structure 564 may comprise columns 566A to 566P and rows 568A to 568P. Columns 566A to 566P may comprise pixels 552 arranged in lines that curve inward (for example, toward the center of the grid structure 554) with respect to the orientation of Figure 15B. Rows 568A to 568P may comprise pixels 552 arranged in lines that curve inward (for example, toward the center of the grid structure 554) with respect to the orientation of Figure 15B. Each of the pixels 552 may be a distorted square. However, pixels in or near the center of the converted digital image 560 may be distorted more or not at all. In the example, pixels in or near the periphery of the converted digital image 560 may be stretched more than pixels in the periphery of the digital image 550. The further away from the center of the converted digital image 560, the more distorted the pixels 552 may be. Therefore, while pixels 552 near the center of the converted digital image 560 may be square, pixels 552 at the four corners of the converted digital image 560 may be shaped like a rhombus, equilateral quadrilateral, or diamond, and may also have curved edges. However, other shapes may be produced, including other pincushion shapes. The converted digital image 560 may have a linear shape with inwardly curved edges, as shown. However, the edges of the converted digital image 560 may be truncated to form straight edges. Figure 15B shows the converted digital image 560 as a stretched square with an equal number of rows and columns. However, the converted digital image 560 may have a rectangle, such that there are more rows or more columns of pixels 552.

[0113] The image processing hardware and the software of adapter 150 can assign grid coordinates to the columns and rows in the digital image 550. Similarly, the columns and rows of the converted digital image 560 may include grid coordinates. Adapter 150 can copy information about any or all of the pixels 552 in the digital image 550, process the pixel information, and thereby reproduce the processed pixel information in the converted digital image 560. For example, adapter 150 can take any combination of color, shadow, contrast, brightness, light intensity, and other information from one or more of the pixels 552 in the digital image 550 and transfer some or all of that information, either unchanged or modified, to selected locations in the converted digital image 560. In this example, not all of the pixels 552 in the digital image 550 are transferred to the converted digital image 560. As described above, the adapter 150 may include a memory device or may communicate with a memory device via a wired or wireless connection, and may include mapping information for moving pixels from one coordinate system to another to create one or more pincushion effects.

[0114] Figure 15B shows an example where four columns of digital image 550 are converted into a single row in the converted digital image 560 near the top edge of digital image 550 to create a pincushion effect near the top edge of the converted digital image 560. This reduces approximately 64 pixels from digital image 550 to approximately 16 pixels in the converted digital image 560.

[0115] Pixels 552-1 from coordinates A, A in column A, row A, etc., in the digital image 550 can be moved to coordinates A, A in the converted digital image 560.

[0116] Pixels 552-2 from coordinates B,A in digital image 550 can be moved to coordinates B,A in the converted digital image 560.

[0117] Pixels 552-3 from coordinates C,B in digital image 550 can be moved to coordinates C,A in the converted digital image 560. Pixels 552 above pixels 552-3, such as pixels at coordinates C,A, may be omitted from the transfer.

[0118] Pixels 552-4 may contain a block of pixels 552 in the same row. In the illustrated example, pixels 552-4 may contain four pixels. Pixels 552-4 can be moved from coordinates D,C to G,C in the digital image 550 to coordinates D,A to G,A in the converted digital image 560. Thus, four pixels 552 in the digital image 550 can be moved to four pixels in the converted digital image 560. Pixels 552 above pixel 552-4, such as the pixels at coordinates D,B to G,B and D,A to G,A, may be omitted from the transfer.

[0119] Pixels 552-5 from coordinates H,D in digital image 550 can be moved to coordinates H,A in the converted digital image 560. Pixels 552 above pixels 552-5, such as pixels between coordinates H,C and H,A, may be omitted from the transfer.

[0120] Pixels 552-6 can be moved from the digital image 550, similar to pixels 552-5 on the other side of the converted digital image 560.

[0121] Pixels 552-7 can be moved from the digital image 550, similar to pixels 552-4 on the other side of the converted digital image 560.

[0122] Pixels 552-8 can be moved from the digital image 550, similar to pixels 552-3 on the other side of the converted digital image 560.

[0123] Pixels 552-9 can be moved from the digital image 550, similar to pixels 552-2 on the other side of the converted digital image 560.

[0124] Pixel 552-10 can be moved from the digital image 550, similar to pixel 552-1 on the other side of the converted digital image 560.

[0125] Therefore, the left-hand side of the converted digital image 560, although the contents of each pixel are independent, can be a mirror image of the right-hand side of the converted digital image 560 from the perspective of the mapping process.

[0126] Figure 15B shows an example in which a vertically spaced pattern of pixels 552 from multiple straight rows in a digital image 550 can be moved to form an adjacent pattern of pixels 552 in a single outwardly curved row, thereby creating a pincushion effect.

[0127] Pixels 552 near the bottom of the digital image 550 can be moved to the bottom of the transformed digital image in a mirrored image pattern, as they are at the top.

[0128] Pixels near the left edge of digital image 550 are rotated 90 degrees counterclockwise, but can be moved in the same way as pixels at the top of digital image 550.

[0129] Pixels near the right edge of digital image 550 are rotated 90 degrees clockwise, but can be moved in the same way as pixels at the top of digital image 550.

[0130] Pixels 552 near the center of the digital image 550 can be moved to the converted digital image 560 through individual correlations. For example, pixels 552 at coordinates (H,H), (H,I), (I,H), and (I,I) in the digital image 550 can be directly moved to coordinates (H,H), (H,I), (I,H), and (I,I) in the converted digital image 560.

[0131] As considered, the specific mapping of the coordinates of the digital image 550 to the coordinates of the converted digital image 560 can be stored in the memory of the image processing circuit 247 (Figures 9-11).

[0132] Figure 16 is a block diagram showing the operation of method 400 for converting the imaging signal generated by the endoscope 152 into a processed imaging signal for the imaging and control system 12.

[0133] In operation 402, the patient's biological structure can be imaged by the imaging sensor of the endoscope inserted into the patient. Light reflected from the biological structure can enter the imaging sensor 160 (Figure 4). In this example, the light can pass through lens 162. As has been considered, the lens of a disposable endoscope can be configured not to bend light. Thereafter, lens 162 can be omitted.

[0134] In operation 404, the imaging sensor 160 can convert light into an imaging signal or video feed. The imaging signal can output a flat image with a fixed field of view and pixel size. For example, a 120° field of view can generate an 800x800 pixel image.

[0135] In operation 406, the imaging signal can be transmitted through the endoscope 152. For example, the imaging signal can be transmitted to the adapter 150 through the combined signal wiring 170.

[0136] In operation 408, the adapter 150 can store the imaging signal in memory. Multiple lines of the source imaging signal may be stored in memory. Storing the imaging signal in memory facilitates the imaging processing performed by the adapter 150. The imaging signal may be temporarily stored so that the adapter 150 can use it in other procedures with other endoscopes without having to clear data that is no longer of interest.

[0137] In operation 410, the adapter 150 can perform image signal conversion or processing on the stored image signal. Processing of the stored image signal may include zooming, cropping, stretching, distortion, resizing, skew, interpolation, and other image processing techniques. Processing of the stored image signal may include converting a matrix of pixels from the image sensor 160 to a matrix of pixels in the converted image. The conversion may include referencing one or more lookup tables to convert the pixels. The conversion may include converting a flat image to a distorted image such as a fisheye image or a pincushion image. The conversion may involve cropping, such as reducing an 800x800 image to a 496x496 image. In the example, the processing of the stored image signal may be performed automatically. In the example, the adapter 150 of this disclosure may be configured to perform specific pre-configured image processing. Thus, a user can select the adapter 150 to perform the desired image processing. In such an example, the image processing may be performed automatically in the background without user intervention. Therefore, image processing can occur without being visible to the user. In an example, the adapter 150 may be configured to perform all of the processing described herein, but certain processing may be disabled during or after manufacturing so that the adapter can perform a more limited subset of the processing described herein. In an additional example, processing of stored imaging signals may be performed based on user input. The adapter 150 may include buttons or switches to activate or deactivate various processing features. Therefore, image processing can be started by the user and turned on or off before or during a medical procedure. Thus, the user can switch between different processed images to obtain the best aperture or preferred view. In an additional example, the adapter 150 may be programmed when connected to the imaging and control system 12. For example, the imaging and control system 12 may recognize when the adapter 150 is connected to socket 37 (Figure 1) and automatically present a menu of options in the output unit 18.The imaging and control system 12 can additionally recognize the type of endoscope connected to the adapter 150. The output unit 18 can display the imaging processing capabilities of the adapter 150, such as zoom, crop, stretch, distortion, resizing, skew, interpolation, and other image processing, and can provide the user with options to activate or deactivate each imaging processing capability, taking into account the hardware of the attached endoscope. The user can use the input unit 20 (Figure 1) to select the functional imaging processing capabilities for the adapter 150.

[0138] In operation 412, the processed imaging signal can be transmitted to the imaging and control system 12 (Figure 1).

[0139] In operation 414, the processed imaging signal may be displayed in the output unit 18 (Figure 1).

[0140] Figure 17A shows a digital image 600 from an imaging sensor showing the presence of a medical device component 602 in the field of view 604, and a processed image boundary 606 in the digital image 600. The digital image 600 may include the raw output of an imaging device, such as an imaging device mounted on an endoscope. The digital image 600 can depict the entire output of the imaging sensor, including sufficient resolution. In the example, the digital image 600 may include 800 pixels × 496 pixels. The processed image boundary 606 is used for transmission to the control unit 16 and may include a portion of the digital image 600 displayed on the output unit 18 in Figures 1 and 2. The processed image boundary 606 may include 496 pixels × 496 pixels. Therefore, the processed image boundary 606 can be cropped relative to the digital image 600. The processed image boundary 606 can be further transformed into the pincushion or fisheye shape described herein.

[0141] The digital image 600 can be generated while inside the patient's biological structure. This allows tissue 608 to be present within the digital image 600. The tissue 608 may include the feature of interest 610 and the surrounding biological structure 612. The digital image 600 may also show a medical instrument component 602 in a field of view 604 near the feature of interest 610. In an example, the medical instrument component 602 may include a portion of the elevator of a duodenal endoscope. Sometimes, it may be desirable to visualize the placement of the feature of interest 610 without obstruction of the surrounding biological structure 612, for example, to obtain a better view of the feature of interest 610, or to better diagnose the condition of the feature of interest 610 and the surrounding biological structure 612. Therefore, the placement of the medical instrument component 602 within the post-processed image boundary 606 may obscure portions of the tissue 608 that can be used to evaluate the feature of interest 610 and the surrounding biological structure 612.

[0142] Figure 17B shows the digital image 600 of Figure 17A with a repositioned post-processing image boundary 606 to adjust the presence and / or location of the medical device component 602. As discussed herein, the post-processing image boundary 606 may be cropped, for example, to reduce the resolution of the post-processing image boundary 606 to the resolution of a conventional endoscope. Furthermore, the post-processing image boundary 606 may be repositioned to reframe its contents. For example, the post-processing image boundary 606 may be repositioned to position the medical device component 602 more clearly within the digital image 600 outside the post-processing image boundary 606. In this example, the post-processing image boundary 606 may be positioned so that the medical device component 602 is completely outside the post-processing image boundary 606. However, for reference and orientation purposes, it may be desirable to have a small portion of the medical device component 602 within the post-processing image boundary 606. For example, the presence of medical device component 602 can guide the surgeon or the person viewing the digital image 600 in the direction in which an auxiliary scope, such as a cholangioscope, is facing the duodenal endoscope. In the example, the post-processed image boundary 606 can be shifted to position the feature of interest 610 more prominently within the post-processed image boundary 606, such as closer to the center. In the example, the post-processed image boundary 606 can be shifted to position more of the feature of interest 610 within the post-processed image boundary 606, such as a larger surface area of ​​the feature of interest 610, such as closer to the center.

[0143] Therefore, the imaging adapter of this disclosure can crop a raw digital image to reproduce a digital image obtained from a conventional endoscopic image processing device. Thus, for example, the size of the image may be familiar to the surgeon. Considering the foregoing, the imaging adapter of this disclosure does not need to simply select the center of the raw video image in order to send it so that an equal portion of the boundary of the raw video image is cropped. The imaging adapter can select a portion of the raw video image to be sent to a display monitor in the imaging and control system. In an example, the image processing circuit 247 (Figures 9-11) may have, or be connected to, a memory that stores instructions for executing commands to locate the presence of objects in the digital image 600. For example, the image processing circuit may include a database of digital files of the shapes and sizes of various medical instrument components, such as elevators, which can be identified by comparing their shapes from the video image. The image processing circuit 247 may also be trained to look for the presence of straight lines in the digital image 600. When the image processing circuit 247 detects the presence of a predetermined shape or straight line, it can shift the location of the post-processed image boundary 606 according to programmed parameters to minimize or eliminate the presence of such features within the post-processed image boundary 606. For example, the identified presence of an elevator can cause the elevator's location within the post-processed image boundary 606 to be shifted so that only a predetermined portion or length of the elevator is visible. In this example, the image processing circuit 247 may have, or be able to communicate with, an artificial intelligence or machine learning engine trained to identify the presence of features that are moved out of the post-processed image boundary 606, or features that are moved to the middle of the post-processed image boundary 606 to be more prominent. In an additional example, the user may utilize a button on one or both of the adapter 150, output unit 18, and input unit 20 to provide manual shifting of the post-processed image boundary 606 for the digital image 600.

[0144] As discussed herein, the disclosure is useful when receiving imaging signals from a disposable or reusable endoscope equipped with an imaging sensor, which may have an inexpensive imaging sensor that provides a flat imaging signal with a fixed resolution. The imaging processing adapter of the disclosure can receive imaging signals from an imaging sensor mounted on a disposable endoscope with a fixed flat output, and can convert such a fixed flat imaging signal into a processed imaging signal that can replicate a shaped imaging signal, such as stretching, zooming, scaling, cropping, and distortion, which replicates the output of a more expensive and sophisticated imaging sensor in a reusable endoscope. The imaging processing adapter of the disclosure can automatically perform the processing procedures described herein so that such image processing is not visible to the user. However, in other examples, the image processing procedures described herein can be selected by the user, adjusted by the user, or turned on and off by the user. This allows a disposable endoscope with a single imaging sensor to be used with existing capital equipment such as imaging and control systems, while also allowing surgeons to additionally produce high-quality images in a familiar format from conventional reusable endoscopes.

[0145] Note The above detailed description includes references to the accompanying drawings, which form part of the detailed description. The drawings illustrate, by example, specific embodiments in which the present invention may be carried out. These embodiments are also referred to herein as “examples.” These examples may include elements in addition to those shown or described. However, the inventors also consider examples in which only those elements shown or described are provided. Furthermore, the inventors also consider examples using any combination or substitution of those elements shown or described (or one or more embodiments thereof) with respect to any specific example (or one or more embodiments thereof) or any other example (or one or more embodiments thereof) shown or described herein.

[0146] In the event of any inconsistency in use between this book and any of the references incorporated by reference, the use in this book shall prevail.

[0147] In this book, the term “a, an” is used to include one or more, as is common in patent literature, independently of any other examples or uses of “at least one” or “one or more.” In this book, the term “or” is used to refer non-exclusively, or “A or B” is used to include “A but not B,” “B but not A,” and “A and B.” In this book, the terms “including” and “in which” are used as plain English equivalents of the terms “comprising” and “wherein.” Furthermore, in the following claims, the terms “including” and “comprising” are open-ended, meaning that a system, device, article, composition, formulation, or process that includes elements in addition to those listed after such terms in a claim is still considered to be within the scope of that claim. Furthermore, in the following claims, terms such as “first,” “second,” and “third” are used merely as labels and are not intended to impose numerical requirements on those subjects.

[0148] Examples of methods described herein can be implemented, at least in part, by a machine or a computer. Some examples may include a computer-readable or machine-readable medium encoded with instructions operable to constitute an electronic device for implementing methods such as those described above. Such implementations may include code, such as microcode, assembly language code, or high-level language code. Such code may include computer-readable instructions for implementing various methods. The code may form part of a computer program product. Furthermore, in the examples, the code may be stored, at some point during execution or at other times, on one or more volatile, non-temporary, or non-volatile tangible computer-readable media. Examples of these tangible computer-readable media include, but are not limited to, hard disks, removable magnetic disks, removable optical disks (e.g., compact discs and digital video discs), magnetic cassettes, memory cards or memory sticks, random-access memory (RAM), and read-only memory (ROM).

[0149] The preceding descriptions are intended to be illustrative and not limiting. For example, the above examples (or one or more of their embodiments) can be used in combination with each other. Other embodiments may be used by those skilled in the art to consider the preceding descriptions. The abstract is provided to allow the reader to quickly grasp the essence of the disclosure of the present art. The abstract is submitted with the understanding that it is not to be used to interpret or limit the scope or meaning of the claims. Also, in the above detailed description, various features may be grouped together for the sake of simplification of the disclosure. This should not be interpreted as meaning that any disclosed feature not claimed is essential to any claim. Rather, the subject matter of the invention may lie less than all the features of the specific disclosed embodiments. Accordingly, the following claims are incorporated herein by reference as examples or embodiments in the detailed description, and each claim stands alone as a separate embodiment, and it is considered that such embodiments can be combined with each other in various combinations or substitutions. The scope of the invention should be determined by reference to the appended claims, along with the equivalent full scope given to such claims. [Examples]

[0150] Example 1 is an adapter for an endoscope system, the adapter comprising a housing, an input device for receiving imaging signal input from an endoscope, and an imaging signal processing device configured to receive the imaging signal input and perform image processing techniques on the imaging signal input to generate an imaging signal output, wherein the imaging signal processing techniques are configured to change the display characteristics of the imaging signal input, and the adapter comprises an output coupler for providing the imaging signal output to an imaging and control system.

[0151] In Example 2, the subject of Example 1 optionally includes a photoconductive element extending to the housing and a fluid passage extending through the housing and having an inlet and outlet accessible from the housing.

[0152] In Example 3, one or more subjects from Examples 1-2 optionally include the input device having a USB port and the output connector having multiple electrical leads.

[0153] In Example 4, the input device comprises a wireless communication device, which is optionally included in one or more of the themes from Examples 1 to 3.

[0154] In Example 5, one or more subjects from Examples 1 to 4 optionally include an imaging signal processing device comprising a processing device and a non-temporary computer-readable storage medium having instructions stored for performing imaging processing techniques in the processing device.

[0155] In Example 6, the subject of Example 5 optionally includes the fact that the imaging processing technique includes distortion correction.

[0156] In Example 7, the imaging processing technique optionally includes converting a flat image into a barrel image, which is included in one or more of the subjects from Examples 5-6.

[0157] In Example 8, one or more of the themes in Examples 5-7 optionally include that the imaging processing technique includes converting the source pixelated image to a post-pixelated image using one or more of the following functions: zoom, crop, stretch, distort, warp, scale, skew, and interpolation.

[0158] In Example 9, the imaging processing technique optionally includes cropping the source image in order to shift the center of the source image and to move a portion of the medical device in the source image toward the boundary of the cropped image, as is optional for one or more subjects in Examples 5-8.

[0159] In Example 10, one or more subjects from Examples 5 to 9 optionally include a lookup table having a transformation table for performing image processing techniques, and the transformation table mapping pixels of the source image to locations in the transformed image.

[0160] In Example 11, the subject of Example 10 optionally includes that the non-temporary computer-readable storage medium of the adapter's imaging signal processing device includes multiple lookup tables, including a lookup table.

[0161] In Example 12, the subject of Example 11 optionally includes further, the non-temporary computer-readable storage medium of the adapter's imaging signal processing device, which includes a list of identifiers for different endoscopes, which are mapped to different lookup tables in a plurality of lookup tables.

[0162] In Example 13, one or more subjects from Examples 10 to 12 optionally include an endoscope that can be connected to an input device and a non-temporary computer-readable storage medium placed in the endoscope, on which a lookup table is stored.

[0163] Example 14 is a surgical endoscope system comprising an imaging and control system having a socket, an endoscope having a shaft with an imaging device at its distal end, a working passage extending at least partially through the shaft, an imaging sensor at the distal end having an imaging sensor configured to generate an endoscopic imaging signal including a flat image, and a communication device for transmitting the output of the imaging sensor, and an adapter configured to be connected to the socket, having an input device configured to communicate with the communication device of the endoscope to receive the endoscopic imaging signal, a converter configured to convert the flat image of the endoscopic imaging signal into a converted image of the output imaging signal, and an output coupler configured to be connected to the socket of the imaging and control system to transmit the output imaging signal.

[0164] In Example 15, the subject of Example 14 optionally includes a memory device containing a lookup table that correlates the locations of pixels from a flat image to the locations of pixels in a converted image, and a processing unit configured to receive an endoscopic imaging signal and generate an output imaging signal using the lookup table.

[0165] In Example 16, the subject of Example 15 optionally includes further details such as the memory device further comprising multiple lookup tables for different endoscopes and identifiers for different endoscopes that map to different lookup tables in the multiple lookup tables.

[0166] In Example 17, one or more subjects from Examples 14–16 optionally include a memory device that includes a lookup table that correlates the locations of pixels from a flat image to the locations of pixels in a distorted image.

[0167] In Example 18, one or more subjects from any one of Examples 14–17 optionally include a fisheye image in which the endoscope is configured to include a lens for the imaging device that does not distort the light entering the imaging device, and the converted image is configured to replicate the image from a fisheye lens positioned across the imaging device.

[0168] Example 19 is a method for converting a flat image into a distorted image, comprising the steps of: mapping pixels of the flat image to a first table that correlates pixels to locations in the flat image; correlating locations in the first table to locations in a second table for a distorted image; and generating a distorted image by moving pixels from their locations in the first table to their corresponding locations in the second table.

[0169] In Example 20, the subject of Example 19 optionally includes the steps of receiving a flat image from the endoscope in an adapter and transmitting a distorted image to an imaging and control system for the endoscope.

[0170] In Example 21, the subject of Example 20 optionally includes the idea that the distorted image mimics a fisheye image obtained from an endoscope having a fisheye lens configured to bend the light entering the imaging sensor.

[0171] In Example 22, the steps for generating a distorted image include, optionally, cropping pixels from a flat image to reduce the size of the flat image, and distorting the pixels in the central part of the flat image to produce a fisheye effect, one or more of themes from Examples 19 to 21.

[0172] In Example 23, the step of generating a distorted image optionally includes, in order to generate a distorted image from a flat image, one or more of the following functions: zoom, crop, stretch, distort, warp, scale, skew, and interpolation, as one or more subjects from Examples 19 to 22 may choose.

[0173] In Example 24, one or more subjects from Examples 19–23 optionally include a step of generating a distorted image, which involves cropping pixels from a flat image asymmetrically with respect to the center of the flat image in order to reposition a portion of a medical device that is visible in the flat image. [Explanation of symbols]

[0174] 10 Endoscopy Systems 12. Imaging and control systems 14 Endoscopy 16 Control Unit 18 Output Units 20 Input Units 22 Light source units 24 Fluid source 26 Suction pump 28 Insertion area 30 functional areas 32 Handle area 34 Cable Area 36 coupler area 37 Sockets 39 Photoconductors 40A, 40B ports 41 Cart 42 Imaging Processing Unit 44 Treatment Generator 46 Drive Unit 47 Cables 48 Plug part 49 Lead wires 100 Optical Guide Connectors 102 Imaging and control systems 104 Endoscope 105 Control device 106 Video Processing Unit 108 memory 110 Light source 112 filters 114 Scope Cable 116 Scope Handle 118 Scope work shaft 120 imaging devices, imaging sensors 122 lenses 124 Light guide section 126 Photoconductors 128 Electrical Wiring 130 Photoconductors 132 Electrical Wiring 134 Photoconductors 136 Control Wiring 150 adapter 152 Endoscope 154 Scope Cable 156 Scope Handle 158 Scope work shaft 160 imaging devices, imaging sensors 162 lenses 164 Light guide section 166 Light Generator 170 Combination signal wiring 170A Optical signal wiring 170B Imaging signal wiring 200 Imaging Processing Adapter, Imaging Processing Adapter 202 Main enclosure 204 Plug Components 206 Socket Components 208 Air connector 210 Photoconductor Assembly 212 Electrical lead wires, electrodes 214 End face 216 Receptacles 218A, 218B protrusion 220A, 220B pads 219 buttons 222 Aperture 230 Air couplers, fluid couplers 232 Electrical connector 234A, 234B Alignment Posts 240 Photoconductors 241 Sheath 242 Air Piping 244 Optical substrates 245 Sensor Package 246 Control board 247 Image processing circuits, optical processing circuits 248 Fasteners 250 pillars 252 Communication board 253 Connectors 254 Prong 255 circuit boards 256, 258 Wiring 260 Wireless Communication Devices 262 lenses

Claims

1. An adapter for an endoscope system, The casing and An input device for receiving imaging signals from an endoscope, An imaging signal processing device configured to receive the imaging signal input and perform imaging processing techniques on the imaging signal input to generate an imaging signal output, wherein the imaging signal processing techniques are configured to change the display characteristics of the imaging signal input, An output coupler for providing the aforementioned imaging signal output to the imaging and control system, An adapter equipped with the following features.

2. A photoconductive element extending into the housing, A fluid passage extending through the housing and having an inlet and outlet accessible from the housing, The adapter according to claim 1, further comprising:

3. The aforementioned input device is equipped with a USB port, The adapter according to claim 1, wherein the output connector comprises a plurality of electrical lead wires.

4. The adapter according to claim 1, wherein the input device comprises a wireless communication device.

5. The aforementioned imaging signal processing device is Processing device and A non-temporary computer-readable storage medium having instructions stored for performing the aforementioned imaging processing technology in the processing device, The adapter according to claim 1, comprising:

6. The adapter according to claim 5, wherein the imaging processing technique includes distortion processing.

7. The adapter according to claim 5, wherein the imaging processing technique includes converting a flat image into a barrel image.

8. The adapter according to claim 5, wherein the imaging processing technique includes converting a source pixelated image to a post-pixelated image using one or more functions among zoom, crop, stretch, distortion, warp, scaling, skew, and interpolation.

9. The adapter according to claim 5, wherein the imaging processing technique includes cropping the source image in order to shift the center of the source image and to move a portion of the medical device in the source image toward the boundary of the cropped image.

10. The adapter according to claim 5, further comprising a lookup table having a conversion table for performing the aforementioned imaging processing technology, wherein the conversion table maps pixels of a source image to locations in a converted image.

11. The adapter according to claim 10, wherein the non-temporary computer-readable storage medium of the imaging signal processing device of the adapter includes a plurality of lookup tables, including the lookup table.

12. The adapter according to claim 11, wherein the non-temporary computer-readable storage medium of the imaging signal processing device of the adapter further includes a list of identifiers for different endoscopes, which are mapped to different lookup tables in the plurality of lookup tables.

13. An endoscope that can be connected to the aforementioned input device, A non-temporary computer-readable storage medium placed in the endoscope and on which the lookup table is stored The adapter according to claim 10, further comprising:

14. An imaging and control system equipped with a socket, It is an endoscope, A shaft equipped with an imaging device at its distal end, A work passage extending at least partially through the shaft, The imaging sensor at the distal end portion is configured to generate an endoscopic imaging signal including a flat image, and A communication device for transmitting the output of the aforementioned imaging sensor. An endoscope equipped with, An adapter configured to be connected to the aforementioned socket, An input device configured to communicate with the communication device of the endoscope in order to receive the endoscopic imaging signal, A converter configured to convert the flat image of the endoscopic imaging signal into a converted image of the output imaging signal, and An output coupler configured to connect to the socket of the imaging and control system in order to transmit the output imaging signal. An adapter equipped with A surgical endoscopy system equipped with the following features.

15. The aforementioned converter is A memory device including a lookup table that correlates the location of a pixel from the flat image to the location of that pixel in the converted image, A processing device configured to receive the endoscopic imaging signal and generate the output imaging signal using the lookup table, The surgical endoscope system according to claim 14, comprising:

16. The memory device is Multiple lookup tables for different endoscopes, Identifiers for different endoscopes mapped to different lookup tables in the aforementioned plurality of lookup tables and The surgical endoscopy system according to claim 15, further comprising:

17. The aforementioned endoscope, The surgical endoscope system according to claim 14, comprising a memory device including a lookup table that correlates the location of a pixel from the flat image to the location of the pixel in the distorted image.

18. The endoscope is equipped with a lens for the imaging device that does not distort the light entering the imaging device. The surgical endoscope system according to claim 14, wherein the converted image includes a fisheye image configured to replicate an image from a fisheye lens positioned above the imaging device.

19. A method for converting a flat image into a distorted image, The steps include mapping the pixels of the flat image to a first table that correlates the pixels to locations in the flat image, The steps of correlating the location in the first table with the location in the second table for the distorted image, The steps include generating the distorted image by moving a pixel from the location in the first table to the corresponding location in the second table, and A method that includes this.

20. The steps include receiving the aforementioned flat image from the endoscope in the adapter, The steps include transmitting the distorted image to the imaging and control system for the endoscope. The method according to claim 19, further comprising:

21. The method according to claim 20, wherein the distorted image mimics a fisheye image obtained from an endoscope having a fisheye lens configured to bend light entering an imaging sensor.

22. The step of generating the aforementioned distorted image is: In order to reduce the size of the flat image, pixels are cropped from the flat image, In order to produce a fisheye effect, the pixels in the central part of the flat image are distorted. The method according to claim 19, including the method described in claim 19.

23. The step of generating the aforementioned distorted image is: The method according to claim 19, comprising performing one or more functions from zoom, crop, stretch, distort, warp, scale, skew, and interpolation to generate the distorted image from the flat image.

24. The step of generating the aforementioned distorted image is: The method according to claim 19, comprising cropping pixels from the flat image asymmetrically with respect to the center of the flat image in order to reposition a portion of a medical device visible in the flat image.

Images