Video signal converter for medical applications

Abstract

Disclosed embodiments relate to a medical system including a video signal converter. The video signal converter is configured to receive a first video signal from an imaging device, the first video signal having a first video signal format; convert the first video signal from the first video signal format to a second video signal format different from the first video signal format; and output the converted video signal as a second video signal to a control unit. The control unit is further configured to receive the second video signal and process the second video signal for output to an electronic display.

Description

Cross-references to related applications

[0001] This application claims priority to U.S. Provisional Application No. 63 / 613,306, filed December 21, 2023, pursuant to 35 USC § 119, which is incorporated herein by reference in its entirety. Technical Field

[0002] Various aspects of this disclosure generally relate to medical devices that include imaging elements, such as endoscopes or bronchoscopes. More specifically, various aspects of this disclosure relate to techniques for converting video signals captured by such medical devices. Background Technology

[0003] Endoscopes have gained widespread acceptance in the medical community because they provide a means of performing surgery with minimal patient trauma while allowing physicians to visualize the patient's internal anatomy. Many endoscopes have been developed and categorized according to their specific applications (such as cystoscopy, colonoscopy, bronchoscopy, upper GI endoscopy, etc.).

[0004] Endoscopes typically have a long, tubular shaft with a camera or fiber optic lens assembly at the distal end. The shaft connects to a handle. Viewing is usually achieved via an external monitor. Various surgical instruments can be inserted through the working channels in the endoscope to perform different surgical procedures. Endoscopes (such as colonoscopes) typically have a front-mounted camera for viewing internal organs such as the colon, an illuminator, a fluid injector for cleaning the camera lens (and sometimes the illuminator), and a working channel for inserting surgical instruments (e.g., for removing polyps found in the colon). Endoscopes also often have a fluid injector for cleaning body cavities (such as the colon), which is inserted into the cavity. Common illuminators include an optical fiber that transmits light to the endoscope tip and a light-emitting diode (LED) located at the endoscope tip.

[0005] Current endoscopes typically implement imaging systems via a camera sensor (such as a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor) located at the tip of the endoscope. The imaging system is ultimately connected to a control unit, which may include additional capabilities such as outputting images or videos to a display or adjusting a light source connected to or inside the endoscope.

[0006] However, imaging systems within some types of endoscopes may be incompatible with other types of control units. Therefore, there is a need in the art for image processing devices, systems, and methods capable of converting camera signals to make them compatible with different control units. Summary of the Invention

[0007] Various aspects of this disclosure relate in particular to systems, apparatus, and methods for video conversion of image signals from medical devices. For example, some aspects implement video signal converters that can be housed either within a medical device (such as an endoscope) or within an adapter (such as a pigtail or other type of adapter).

[0008] In some aspects, the embodiments disclosed herein relate to a medical system including a video signal converter. The video signal converter is configured to: receive a first video signal from an imaging device, the first video signal having a first video signal format; convert the first video signal from the first video signal format into a second video signal format different from the first video signal format; and output the converted video signal as a second video signal to a control unit. The control unit is configured to receive the second video signal and process the second video signal for output to an electronic display.

[0009] In some respects, the embodiments disclosed herein relate to a medical system that further includes a medical device including a distal end portion comprising an imaging device configured to output the first video signal in the first video signal format.

[0010] In some respects, the video signal converter is located within the handle of the medical device.

[0011] In some aspects, the embodiments disclosed herein relate to a medical system wherein the first video signal format is an analog video format, the second video signal format is a digital video format, and the video signal converter includes an analog-to-digital converter. In some aspects, converting the first video signal includes: applying the analog-to-digital converter to the first video signal, and receiving the second video signal from the analog-to-digital converter.

[0012] In some respects, the embodiments disclosed herein relate to a medical system in which the imaging device is a charge-coupled device (CCD), and wherein the second video signal is compatible with a signal from a metal-oxide-semiconductor (CMOS).

[0013] In some aspects, the embodiments disclosed herein relate to a medical system in which the first video signal includes a first frame rate. The medical system further includes a processor configured to adjust the first frame rate of the first video signal to a second frame rate of the second video signal. The second frame rate differs from the first frame rate.

[0014] In some aspects, the embodiments disclosed herein relate to a medical system including an illumination source configured to emit light at a distal end portion. In some aspects, the conversion of the first video signal to the second video signal includes: causing the illumination source to emit light having a first primary color at a first time; capturing a first video frame; causing the illumination source to emit light having a second primary color different from the first primary color at a second time; capturing a second video frame; and constructing the second video signal based on the first video frame and the second video frame.

[0015] In some aspects, the embodiments disclosed herein relate to a medical system that further includes a processor configured to decompose the first video signal into individual primary color components and to construct a mosaic from the second video signal having the primary color components. Each pixel value of the second video signal includes a single primary color component.

[0016] In some respects, the embodiments disclosed herein relate to a medical system in which the first video signal format is a digital signal format and the second video signal is an analog signal format; the video signal converter includes a digital-to-analog converter, and wherein converting the first video signal includes: applying the digital-to-analog converter to the first video signal, and receiving the second video signal from the digital-to-analog converter.

[0017] In some respects, the embodiments disclosed herein relate to a medical system in which the imaging device is a CMOS device. The second video signal is compatible with a signal from a CCD.

[0018] In some respects, the embodiments disclosed herein relate to a medical system in which the first video signal format is an analog video signal format having a first signaling type, and the second video signal format is a second analog video signal format having a second signaling type different from the first signaling type.

[0019] In some respects, the embodiments disclosed herein relate to a medical system in which each of the first video signal format and the second video signal format conforms to a Low Voltage Differential Signaling (LVDS) format or a Mobile Industry Processor Interface (MIPI) format.

[0020] In some aspects, the embodiments disclosed herein relate to a medical system that further includes an adapter having a video signal converter. The adapter is capable of being attached to the medical device.

[0021] In some respects, the embodiments disclosed herein relate to a medical system, which is an endoscope, and wherein the adapter includes an optical coupler configured to transmit light from an illumination source to the endoscope.

[0022] In some respects, the embodiments disclosed herein relate to a medical system in which the control unit is configured to process the second video signal before outputting the second video signal to an electronic display.

[0023] In some aspects, the embodiments disclosed herein relate to a medical system comprising: a medical device including an axis having a distal end portion, the distal end portion including an imaging device configured to output a first video signal in a first video signal format; and a video signal converter. The video signal converter is configured to: receive the first video signal from the imaging device; and convert the first video signal from the first video signal format into a second video signal format different from the first video signal format. The medical device includes a control unit configured to: receive the converted video signal from the video signal converter, and process the converted video signal into an image-processed video signal for output.

[0024] In some respects, the embodiments disclosed herein relate to a medical system in which the first video signal format is an analog video format, the second video signal format is a digital video format, the video signal converter includes an analog-to-digital converter, and wherein converting the first video signal includes: applying the analog-to-digital converter to the first video signal, and receiving the second video signal from the analog-to-digital converter.

[0025] In some respects, the embodiments disclosed herein relate to a medical system in which the first video signal format is a digital signal format, the second video signal is an analog signal format, the video signal converter includes a digital-to-analog converter, and wherein converting the first video signal includes: applying the digital-to-analog converter to the first video signal, and receiving the second video signal from the digital-to-analog converter.

[0026] In some aspects, embodiments disclosed herein relate to a method comprising: receiving a first video signal in a first video signal format from an imaging device within the medical device; converting the first video signal from the first video signal format into a second video signal format different from the first video signal format; outputting the converted video signal as a second video signal to a control unit; receiving the second video signal at the control unit; processing the second video signal into an image-processed video signal via the control unit; and displaying the image-processed video signal on an electronic display.

[0027] In some respects, the embodiments disclosed herein relate to a medical system in which the first video signal format is an analog video format and the second video signal format is a digital video format, and wherein converting the first video signal includes: applying an analog-to-digital converter to the first video signal and receiving the second video signal from the analog-to-digital converter.

[0028] It is understood that the foregoing general description and the following detailed description are merely exemplary and illustrative, and do not limit the claimed invention. Attached Figure Description

[0029] The accompanying drawings, which are incorporated in and form part of this specification, illustrate exemplary aspects of this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0030] Figure 1A and Figure 1B These are perspective views of exemplary endoscopes according to various aspects of this disclosure.

[0031] Figure 2 This is a diagram of a system for video conversion for endoscopy, based on various aspects of this disclosure.

[0032] Figure 3 This is a diagram of an analog-to-digital conversion system for endoscopes, based on various aspects of this disclosure.

[0033] Figure 4 This is a diagram of a digital-to-analog conversion system for endoscopes, based on various aspects of this disclosure.

[0034] Figure 5 This is a diagram of a charge-coupled device (CCD) to complementary metal-oxide-semiconductor (CMOS) conversion system for an endoscope, based on various aspects of this disclosure.

[0035] Figure 6 This is a diagram of a CMOS to CCD conversion system for endoscopes, based on various aspects of this disclosure.

[0036] Figure 7This is a diagram of an example analog signaling scheme for use in an endoscope, based on various aspects of this disclosure.

[0037] Figure 8 This is a diagram of an example circuit for a Mobile Industry Processor Interface (MIPI) to Low Voltage Differential Signaling (LVDS) conversion system for endoscopes, based on various aspects of this disclosure.

[0038] Figure 9 This is a diagram of an example circuit for an LVDS to MIPI conversion system for an endoscope, based on various aspects of this disclosure.

[0039] Figure 10 This is a flowchart of an example frame rate conversion system for an endoscope, based on various aspects of this disclosure.

[0040] Figure 11 This is a diagram of the inputs and outputs of a video de-mosaic system for endoscopy, based on various aspects of this disclosure.

[0041] Figure 12 The diagram shows an example monochrome-to-color conversion system for an endoscope, based on various aspects of this disclosure.

[0042] Figure 13 These are diagrams illustrating exemplary inputs and outputs of a monochrome-to-color conversion system for an endoscope, based on various aspects of this disclosure.

[0043] Figure 14 This is a diagram of an example mechanical adapter system for use with an endoscope and signal converter, based on various aspects of this disclosure.

[0044] Figure 15 The diagram shows an example mechanical adapter system for use with an endoscope and signal converter, based on various aspects of this disclosure.

[0045] Figure 16 The diagram shows an example mechanical adapter system for use with an endoscope and signal converter, based on various aspects of this disclosure.

[0046] Figure 17 The diagram shows an example mechanical adapter system for use with an endoscope and signal converter, based on various aspects of this disclosure.

[0047] Figure 18 Example computing devices are described in accordance with various aspects of this disclosure. Detailed Implementation

[0048] Reference will now be made in detail to various aspects of this disclosure, examples of which are illustrated in the accompanying drawings. Where possible, the same or similar reference numerals are used throughout the drawings to refer to the same or similar parts. The term "distal" refers to the part furthest from the user when the device is introduced into the patient's body. In contrast, the term "proximal" refers to the part closest to the user when the device is placed into the patient's body. In all the drawings included in this application, arrows marked "P" and "D" are used to indicate the proximal and distal directions in the drawings. As used herein, the terms "comprises," "comprising," "includes," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article of manufacture, or apparatus that comprises a list of elements may include not only those elements but also other elements not expressly listed or inherent to such process, method, article of manufacture, or apparatus. The term "exemplary" is used in the sense of "example" rather than "ideal." Further, relative terms (e.g., "about," "approximately," "about," etc.) are used to indicate possible variations of ±10% within the stated values ​​or ranges.

[0049] Various aspects of this disclosure relate to video signal converters capable of converting image or video signals associated with medical devices, such as endoscopes. The disclosed technologies facilitate broader compatibility between endoscopes and control systems while maintaining a compact package. For example, for a control unit, a camera used in a first endoscope can appear as if it were a camera in a second endoscope with different electronic components.

[0050] As further discussed herein, the disclosed video signal converter can be located anywhere, inside or outside the endoscope or related system. For example, the signal converter can be embedded within the endoscope itself or located in an adapter connected to the endoscope.

[0051] Examples of signal conversion include, but are not limited to: analog-to-digital or digital-to-analog conversion; conversion of signals compatible with complementary metal-oxide-semiconductor (CMOS) to signals compatible with charge-coupled devices (CCD) (or vice versa); conversion between different types of analog signals; or conversion between different types of digital signals. In some aspects, additional processing may be performed before and / or after the conversion. Non-limiting examples of such processing include scaling, cropping, and adjusting color spaces. The disclosed signal converter may also appropriately control the light source, for example, to facilitate these signal conversions, such as illuminating the light source at a specific time and for a specific duration to achieve a conversion from monochrome to color.

[0052] Now turn to the attached image. Figure 1A and Figure 1BA perspective view of an exemplary endoscope system 100 is shown. The endoscope system 100 may include an endoscope 101 and other system components (not shown), such as controllers, light sources, suction and / or irrigation sources, etc. The endoscope 101 may include a handle assembly 106 and a flexible tubular shaft 108. The handle assembly 106 may include a biopsy port 102, a biopsy cap 103, an image capture button 104, a lifter actuator 107, a first locking lever 109, a second locking lever 110, a first control knob 112, a second control knob 114, a suction button 116, an air / water delivery button 16, a handle body 120, and an umbilical cable 105. All actuators, lifters, knobs, buttons, levers, ports, or caps (such as those listed above) of the endoscope 101 may be used for any purpose and are not limited to any particular use that may be implied by the corresponding naming of each component used herein. The umbilical cable 105 (which is typically part of the endoscope 101) can extend from the handle body 120 to one or more auxiliary devices, such as the control unit 250 (e.g., in...). Figure 2 The umbilical cable 105 can transmit signals between the endoscope 101 and the control unit 250 to control the illumination and imaging components of the endoscope 101 and / or receive image data from the endoscope 101. The umbilical cable 105 can also provide fluid for flushing from the water / fluid supply device and / or provide suction to the distal end 119 of the shaft 108. Buttons 116 and 117 control valves for suction and fluid supply (e.g., air and water), respectively. The shaft 108 may terminate at the distal end 119. The shaft 108 may include an articulation section 122 for deflecting the distal end 119 in upward, downward, leftward, and / or rightward directions. Knobs 112 and 114 can be used to control this deflection, and locking levers 109 and 110 can lock knobs 112 and 114 in desired positions, respectively. The handle body 120 may be tapered and may narrow as the handle extends distally, such that the profile of the handle body 120 is smaller at its distal end than at its proximal end.

[0053] Although the term endoscope may be used herein, it should be understood that other devices may be used in conjunction with the devices disclosed herein, including, but not limited to, other types of endoscopes and medical devices such as cholangioscopes, duodenoscopes, colonoscopes, ureteroscopes, bronchoscopes, laparoscopes, sheaths, catheters, or any other suitable delivery devices or medical devices, and the devices, systems, and methods discussed below may be incorporated into any of these or other medical devices.

[0054] Figure 2This is a diagram of a video conversion system 200 for an endoscope according to various aspects of this disclosure. In the example depicted in system 200, a first video signal is received from an image sensor 222. In some cases, during the capture of the first video signal, an illumination source 224 illuminates the subject. The first video signal is transmitted to a signal converter 230 in a first video format (e.g., optically or electrically). The signal converter 230 then converts the signal from the first video format to a second video format. The converted signal is then output to a control unit 250, where it can be visualized or displayed on a monitor or transmitted to another device.

[0055] Components of system 200 can be located anywhere within endoscope system 100 or in an adapter used with endoscope system 100. For example, system 200 can be embedded within endoscope system 100, including, for example, endoscope 101, within handle assembly 106, within distal portion 119 of flexible tubular shaft 108, within umbilical cable 105, or within tip portion 119 and / or within any other portion of endoscope system 100. In some cases, components of system 200 can be separate, and various components are placed in different locations within or outside endoscope system 100 and interconnected, for example, electrically or optically.

[0056] Examples of image sensor 222 include, but are not limited to, image sensors, cameras, optical fibers, and lens assemblies with image sensors. Examples of illumination source 224 include, but are not limited to, light-emitting diodes (LEDs) or optical fibers. In some examples, image sensor 222 is located at the tip of the endoscope. In this case, image sensor 222 (especially in small-diameter endoscopes) may be simply an image sensor, such as a CCD or CMOS sensor, without any other image processing components, and may output an image signal processed by signal converter 230.

[0057] For example, refer to Figure 1 and Figure 2One or more of the imaging device 222 and the illumination source 224 may be located within the distal end 119. In some examples, the distal end 119 may include a forward-facing imaging device 222, may include a forward-facing imaging device 222 and a side-facing imaging device 222, may include only a side-facing imaging device 222, may include one forward-facing imaging device 222 and two side-facing imaging devices 222, or any other combination of imaging devices at the distal end 119. The side-facing imaging device 222 and the illumination source 224 may face radially outward from the longitudinal axis of the axis 108 and the distal end 119, facing a direction perpendicular, approximately perpendicular to, or otherwise transverse to the longitudinal axis. The forward-facing or forward-facing imaging device 222 or the illumination source 224 may face a direction approximately along or parallel to the longitudinal axis of the distal end 119 and the axis 108. In some examples, imaging device 222 may be a charge-coupled device (CCD) image sensor, a complementary metal-oxide-semiconductor (CMOS) image sensor, and / or any other element used to convert light into electrons for transmission as an electrical signal.

[0058] Signal converter 230 can be connected to control unit 250 and image sensor 222. Signal converter 230 may include one or more processors 232. Processor 232 may be a general-purpose processor, microcontroller, signal processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other device. Example processor is... Figure 18 The processor 1802 is depicted in the image.

[0059] Processor 232 can be configured to perform any of the functions described herein, such as interpolation, decimation, color space transformation, filtering, and / or other adjustments. Processor 232 can perform image processing that may be necessary to make the camera used in the endoscope compatible with a specific control unit. For example, processor 232 can adjust the pixel count through appropriate image processing and scaling. Scaling may include increasing or decreasing resolution, zooming in or out.

[0060] The control unit 250 may be able to interface with the endoscope 101 directly or via a signal converter 230 to provide power and / or commands to the imaging device 222 and / or the light source 224. The control unit 250 may also control one or more other aspects of the endoscope 101, such as the application of suction, the deployment or delivery of fluid, and / or the movement of the distal endpiece 119. The control unit 250 may be powered by an external source, such as an electrical outlet. Additionally, the control unit 250 may include or be otherwise coupled to one or more buttons, knobs, touchscreens, or other user interfaces to control the imaging device 222, the light source 224, and other features of the endoscope 101. The control unit 250 may be housed within the handle 106 itself or in a separate device.

[0061] The control unit 250 can be configured to set or control one or more illumination parameters and imaging parameters. For example, the control unit 250 can set or control the illumination level of each light source 224, the gain level of each imaging device 222, the exposure time of each imaging device 222, the frame rate of each imaging device 222, the maximum or target value of any one of the illumination parameters and imaging parameters, and / or any other parameters associated with the imaging device 222 and / or the light source 224.

[0062] In some examples, control unit 250 may be configured to execute one or more algorithms using one or more illumination parameters and imaging parameters, such as to automatically adjust the illumination levels of one or more light sources in light source 224 and / or automatically adjust one or more parameters of imaging device 222. For example, control unit 250 may set or select the illumination levels of one or more light sources 224 based on data received from one or more imaging devices 222.

[0063] Control unit 250 may include electronic circuitry configured to receive, process, and / or transmit data and signals between endoscope 101 and one or more other devices. For example, control unit 250 may electronically communicate with a display configured to display images based on image data and / or signals that may have been generated by imaging device 222 of endoscope 101 and processed by control unit 250. Control unit 250 may communicate electronically with the display in any suitable manner (via wires or wirelessly). The display may be manufactured in any suitable manner and may include touchscreen input and / or be connected to various input and output devices, such as a mouse, stylus, printer, server, and / or other portable electronic devices. Control unit 250 may include software and / or hardware that facilitates operation (such as those discussed above). For example, control unit 250 may include one or more algorithms, models, etc., for performing any of the methods and / or systems discussed in this disclosure. Control unit 250 may be configured to automatically adjust illumination values ​​applied to one or more light sources 224 and automatically adjust gain and frame rate applied to one or more imaging devices 222.

[0064] When operating the endoscope system 100, the user can hold the handle assembly 106 with their left hand and the accessory devices and / or actuators of the handle assembly 106 with their right hand, such as the first control knob 112 and the second control knob 114, and the first locking lever 109 and the second locking lever 110. The user can grip the handle assembly 106 by covering the handle body 120 with their hand. When gripping the handle body 120, the user can operate the first control knob 112 and the second control knob 114 and the lift actuator 107 with their left thumb (by rotating them about their respective axes), and can operate the image capture button 104, the suction button 116, and / or the air / water delivery button 118 (each by pressing) with their left-hand fingers. The user can rotate the handle assembly 106 (e.g., by moving their wrist) to rotate the axis 108 about the longitudinal axis of the axis 108 and position the distal end 119 at a target area within the patient's body.

[0065] A user can actuate button 104 to initiate a video display from the imaging device, capture images (such as digital images) using the imaging device, and / or take any other actions associated with the imaging device. During operation, the user can visualize the video feed from the imaging device on an electronic display. Real-time signals from the imaging device can be processed by control unit 250 and output to the electronic display. The electronic display can be one or more electronic displays, such as a monitor, television, tablet computer, smartphone, part of control unit 250, virtual reality display, or other display device. For example, during operation of endoscope 101, the user can first actuate imaging button 104 to initiate image capture using imaging device 222 or start video recording. In some examples, the user can also actuate illumination source 224 to illuminate the field of view of imaging device 222. Imaging device 222 can then receive photons within its field of view at its image sensor and can transmit raw analog signals and / or digital signals.

[0066] Figure 3 This is a diagram of an analog-to-digital conversion system 300 for an endoscope, based on various aspects of this disclosure. System 300 includes an image sensor 322, a signal converter 330, and a control unit 350. Image sensor 322 may perform functions substantially similar to image sensor 222. Signal converter 330 includes an analog-to-digital (A / D) converter 336, which is configurable to convert analog signals received from image sensor 322 into digital signals for processing by control unit 350. Signal converter 330 may also format digital data into a number and type of channels desired by control unit 350.

[0067] Although not depicted, system 300 may include a lighting source (e.g., lighting source 224). Non-limiting examples of functions that may be implemented by signal converter 330 include analog-to-digital (A / D) conversion, video or image processing, data formatting (such as serialization or parallelization), etc.

[0068] In this example, signal converter 330 receives a first video signal in analog format from imaging sensor 322. Signal converter 330 converts the first video signal from a first video signal format to a second video signal format, which is a digital video signal format, using analog-to-digital (A / D) converter 336. Specifically, signal converter 330 applies analog-to-digital (A / D) converter 336 to the first video signal. Analog-to-digital (A / D) converter 336 then outputs the converted signal as a second video signal in the second format.

[0069] On one hand, the A / D converter 336 may include a front end designed to minimize artifacts from anti-aliasing. In this case, a comparator within the A / D converter 336 can be used to determine a trigger point based on the incoming analog signal. For example, the reference level of the comparator can be adjusted such that the trigger point occurs slightly ahead of the analog trigger point. While doing so, the processor (or FPGA) prepares the expected analog-to-digital data. When the trigger point is detected, the processor (FPGA) can determine timing parameters within the analog signal to begin the conversion.

[0070] Alternatively or alternatively, control signals may be transmitted between the control unit 350 and the signal converter, such as synchronization signals or user inputs, for example, to adjust the gain or exposure time of the image sensor, or to control the brightness of the illumination source. Alternatively or alternatively, the A / D converter 336 may include circuitry for detecting and generating line and frame synchronization information.

[0071] The signal converter 330 can be built using various electronic components and can be implemented partially or entirely by a field-programmable gate array (FPGA) or application-specific integrated circuit (ASIC). If it is an FPGA or ASIC, algorithms can be added to communicate with an image sensor, which may not be the original intended sensor for a particular control unit 350. The FPGA or ASIC can then also be used as a converter for image sensor control, such as gain, region of interest, pixel binning, exposure, and other operations.

[0072] In some respects, digitized analog data is sent to the control unit 350 without significant or any digital processing. If the output of the A / D converter 336 matches the expected input of the control unit 350, the signal converter 330 can be used as a pass-through repeater. In this case, various components of the signal converter 330 may not be necessary.

[0073] In some aspects, the signal converter 330 may include one or more processors 332. The processor 332 may be configured to perform actions such as those described above. Figure 2 The processor 232 is described in the figure. The processor 332 can transmit the fully formed image to the control unit 350.

[0074] In some respects, processor 332 can act as a data formatter and / or converter. For example, processor 332 can reformat or process digitized data into a format intended by control unit 350. For instance, if control unit 350 intends a serialized digital data stream, and A / D converter 336 outputs data in a parallel stream, then signal converter 330 can serialize the data from A / D converter 336 and transmit the serialized data to control unit 350. Processor 332 can send one or more control signals from control unit 350 to control image sensor 322. Examples of control signals include, but are not limited to, signals for causing image sensor 322 to capture an image, stopping image capture, etc. Therefore, the signal flow between processor 330 and image sensor 322 can be bidirectional.

[0075] In some respects, processor 332 is used to adjust the raw pixel data. For example, it can boost the red pixels with a defined gain. Processor 332 can be used to enlarge or reduce an image to the image size expected by control unit 350. For example, the output from a 400 × 400 pixel image sensor can be reduced to 250 × 250 pixels. Examples of algorithms that processor 332 can employ include, but are not limited to, bilinear, bicubic, and Lanczos algorithms. In a simplified example, processor 332 can be programmed to strategically discard or scrap various pixels of the image to facilitate reduction.

[0076] In some respects, processor 332 can crop pixel data. For example, processor 332 can crop an image or video frame to a desired field of view. For example, an image sensor with a 120-degree field of view can be cropped to a 90-degree field of view.

[0077] In some respects, processor 332 may generate timing signals and / or blanking signals intended for control unit 350. More generally, processor 332 analogs any camera signals intended for use by control unit 350 to maintain interoperability between different combinations of endoscope and control unit. For example, the digital signal output from processor 332 may be a low-voltage differential signal (LVDS), a mobile industry processor interface (MIPI), pulse width modulation (PWM), or any other signal.

[0078] Figure 4 This is a diagram of an analog-to-digital converter system 400 for an endoscope, according to various aspects of this disclosure. System 400 includes an image sensor 422, a signal converter 430, and a control unit 450. Image sensor 422 may perform functions substantially similar to those of image sensor 222. Although not depicted, system 400 may include an illumination source (e.g., illumination source 224).

[0079] Signal converter 420 includes a digital-to-analog (D / A) converter 438. The D / A converter 438 receives a digital signal from the image sensor 422 and converts the digital signal into an analog format. In this example, signal converter 430 receives a first video signal in digital format from the image sensor 422. Signal converter 430 applies the D / A converter 438 to the first video signal. The D / A converter 438 outputs a converted signal as an analog signal.

[0080] During conversion, the D / A converter 438 can take into account the timing requirements of the control unit 450. Thus, in some cases, the signal converter 430 includes an FPGA or ASIC to create the synchronization and blanking signals required by the control unit 450. Similarly, the signal converter 430 can be configured to ensure that other requirements, such as rise and fall times or transition times, are met.

[0081] In some respects, signal converter 430 may first perform processing on the digitized signal received from image sensor 422, and then convert it into analog format. For example, as depicted, signal converter 430 may include one or more processors 432. Processor 432 may be configured to perform actions such as those described above. Figure 2 The operation described in the processor 232 is shown in the figure.

[0082] For example, in some cases, the signal converter 430 can reorganize the output pixel sequence. For instance, if the signal expected by the control unit 450 does not match the pixel order received from the image sensor 422, an adjustment is made. For example, the image sensor 422 might output a pixel sequence: RGRG..., GBGBGBG (where R represents red, G represents green, and B represents blue in the RGB color space). However, the control unit 450 might expect a sequence formed from consecutive pixels of the same color, such as RRR…, GGG…, and BBB…. In this case, the memory is used to store multiple pixels or data frames.

[0083] Figure 5 This is a diagram of a charge-coupled device (CCD) to complementary metal-oxide-semiconductor (CMOS) conversion system 500 for an endoscope, according to various aspects of this disclosure. In the depicted example, a signal converter 530 receives a CCD image signal from a CCD image sensor 522 and converts the signal into one compatible with the CMOS signal input expected by the control unit 550.

[0084] Signal converter 530 includes a D / A converter 538, an A / D converter 536, an adjustable voltage reference 534, and a processor 540. For the purposes of discussion, it is assumed that the CCD image sensor 522 outputs an image signal in analog form. However, system 500 can operate with a CCD image sensor that outputs a digital signal. In this case, an analog-to-digital converter is not required and is bypassed.

[0085] Processor 540 includes pixel pipeline 541, Vref control 542, vertical transmission clock generator 543, horizontal transmission clock generator 544, substrate clock generator 545, synchronization generator and pixel formatter 546, data formatter 547, and data input / output (I / O) interface 548. Processor 540 can be a general-purpose processor, FPGA and / or ASIC.

[0086] System 500 can be configured to convert analog signals into digital signals, and additionally convert the input video signal from the CCD into a signal compatible with the control unit 550 of the intended CMOS image sensor. To accomplish this conversion, in addition to the circuitry for digitizing the CCD output, an additional clock signal is required. As can be seen, system 500 includes various clock signal generators, such as a vertical transmission clock generator 543, a horizontal transmission clock generator 544, and a substrate clock generator 545.

[0087] In the depicted example, signal converter 530 receives CCD signals from CCD image sensor 522. A / D converter 536 is used to digitize the analog output of the CCD sensor. D / A converter 532, in conjunction with an adjustable voltage reference 534, is used to set the voltage reference for A / D converter 536. The adjustable voltage reference 534 can be set based on a specific type of CCD sensor and / or the expected CMOS output, or it can be dynamically changed to adjust the image based on information within the image.

[0088] In some aspects, the control unit 550 can provide a clock signal to the signal converter 530. In some cases, the control unit 550 can anticipate a pixel array of a specific size. Thus, the signal converter 530 can calculate a clock signal to provide to the CCD image sensor 522, thereby obtaining the desired pixel array size.

[0089] A typical CMOS image sensor uses a single input clock to drive the circuitry, while a CCD sensor has multiple clocks. Therefore, processor 540 can receive a standard CMOS sensor clock, typically generated by control unit 550, as input and convert that clock timing into multiple clocks required to drive CCD sensor 522. In the case of an analog CCD sensor, these clocks can also provide timing for A / D converter 536, ensuring a minimum sampling rate to pixel data rate ratio of 1:1. D / A converter 538 provides a reference for A / D converter 536. This allows the FPGA to dynamically adjust the A / D reference, providing pseudo-gain and / or black level adjustment. Additional analog gain circuitry can be added before A / D converter 536 if needed. Synchronizer generator and pixel formatter 547 align the data to the pattern expected by control unit 550.

[0090] Typical CMOS image sensors transmit data line by line in alternating color pixels; for example, line 1 would repeat BGBGBG, and line 2 would repeat GRGRGR, etc. The analog readout of the sensor can be entirely different, where all blue pixels in a line are transmitted, followed by all green pixels in the same line. This is the function of the pixel formatter, which acquires the data and rearranges it into the line-by-line color pattern typically used by CMOS sensors. Data formatter 547 operates to serialize the digitized and formatted data and insert synchronization. Synchronization can take the form of bits within a word of pixel data. For example, if the pixel data is eight bits, the word can be ten bits, where the first two bits are used to signal the valid frame and line, respectively. Data formatter 547 can also insert the start or end of line or frame codes into the data, as well as any data generated during the blanking period. This will depend on the control unit's expectations of the image data. Data I / O interface 548 is circuitry connected to the control unit using the signal levels expected by the control unit. Data I / O interface 548 can be single-ended parallel signaling and standard CMOS voltage levels, or differential LVDS, MIPI, etc.

[0091] Alternatively or concurrently, the signal converter 530 may allow gain and / or black level adjustment.

[0092] In some cases, pixel readouts from the CCD image sensor 522 may not follow the same pattern as the expected CMOS signal at the control unit 550. If this is the case, the processor 540 and / or other circuitry can be used to buffer the image data from the CCD image sensor 522 into memory to allow for processing.

[0093] CMOS relies on a finite clock and provides intuitive pixel data output, while CCD output and clocking can be more complex. Furthermore, most CMOS image sensors produce digital output, while CCD sensors produce analog signals. Therefore, the disclosed techniques involve converting CMOS signals into CCD signals, for example, as... Figure 6 As depicted in the text.

[0094] Figure 6 This is a diagram of a CMOS to CCD conversion system 600 for an endoscope, according to various aspects of this disclosure. System 600 includes a CMOS image sensor 622, a signal converter 630, and a control unit 650. In the depicted example, the signal converter 630 converts a CMOS image signal received from the CMOS sensor 622 into a CCD signal.

[0095] Signal converter 630 includes a D / A converter 638, a line or frame buffer 641, an image formatter 642, a data formatter 643, a sensor controller 649, and a clock retimer 645. Signal converter 630 receives CCD timing 646 from control unit 650. CCD timing 646 is then passed to clock retimer 645, which transmits the signal to sensor controller 649.

[0096] When a control signal 647 is provided, the CMOS image sensor 622 outputs image data 648. The image data 648 is passed to a line or frame buffer 641, which buffers a predetermined amount of data (e.g., lines or frames), and then passed to an image formatter 642. The image formatter 642 then passes the formatted image to a data formatter 643, which passes the data to a D / A converter 638. The analog data from the D / A converter 638 is then passed to the control unit 650.

[0097] In some cases, the sensor controller 649 further generates sensor control signals 647 for the CMOS image sensor 622. For example, in some aspects, the signal converter 630 can determine the physical size of the CMOS image sensor 622 array and write one or more appropriate register commands to the CMOS image sensor 622 to specify the size of the image array. In some aspects, storage devices may be needed to buffer image lines or frames and reconstruct timing data as anticipated by the control unit 650. For example, the signal converter 630 can read one or more clocks from the control unit 650, enabling the sending of appropriate commands to the CMOS image sensor 622 to configure it to generate images of appropriate size.

[0098] Different analog sensors may also rely on different signaling schemes. Therefore, in some cases, certain aspects involve conversion between different analog signals, examples of which are found in... Figure 7 As shown in the image.

[0099] Figure 7 This is a diagram of an example analog signaling scheme for use in an endoscope, based on various aspects of this disclosure. Figure 7 A graph 700 is depicted, which includes an analog signal 710 plotted relative to voltage 720 and time 730.

[0100] Graph 700 represents the National Television Standards Committee (NTSC) digital signal. Analog video can have a reference level, which is used as a reference for synchronization and data. The reference level is typically positive relative to the sync pulse and is usually close to the level representing black in the moving video data. Signal 710 can represent an entire video line with timing, luminance, and color information.

[0101] In some cases, the video converters described herein can digitize, for example, analog signals generated from non-NTSC-based analog sensors, and then convert the digital signals into NTSC-compatible analog signals. In some cases, the data received from an image sensor may include pixel values ​​corresponding to grayscale levels rather than colors. In these cases, demosaicing or color reconstruction, as discussed herein, can be performed.

[0102] Return to reference Figure 3 and Figure 4 System 300 can be used to convert analog video to digital video, and system 400 can be used to convert digital video to analog video. Systems 300 and 400 can also convert between analog formats. For example, the signal converters of systems 300 or 400 can employ A / D converters to digitize the input NTSC signal. The signal converters then process the digitized signal and convert it back to different analog signals. Examples of processing include cropping and resizing the digitized image.

[0103] For example, systems 300 or 400 can use a synchronization detection circuit system that can be used to detect negative or positive synchronization pulses. An adjustable reference allows the detection of synchronization pulses with many different voltage levels. A similar voltage reference circuit system is also used in an analog-to-digital converter (ADC), which will allow the digitization of many different analog video voltage levels.

[0104] For control units that anticipate specific analog video input, analog image sensors with different formats can be digitized, and the data passed to an image processor. The data can then be converted back to analog video, taking into account the timing and synchronization levels expected by the control unit.

[0105] It can also convert between different digital image sensors using different video signaling schemes. For example, LVDS and MIPI signaling, although both use differential signaling, are incompatible. MIPI refers to a signal consisting of a high-speed (HS) section and a low-power (LP) section. The HS section is a differential signal with a common-mode voltage typically around 200 mV and a differential-mode voltage of around 200 mV (with a swing of + / - 100 mV per line). The LP mode voltage is driven in a single-ended manner on the differential lines, with a voltage of approximately 1.2 V. LVDS refers to a differential signal with a common-mode voltage of approximately 1.2 V and a differential voltage of approximately 350 mV. Converting to LVDS allows data to be transmitted to the receiver over long distances (3 meters or more).

[0106] Therefore, the disclosed system can be converted from the LVDS signaling scheme to the MIPI signaling scheme, and vice versa.

[0107] Figure 8 This is a diagram of an example circuit 800 for a Mobile Industry Processor Interface (MIPI) to Low Voltage Differential Signaling (LVDS) conversion system for endoscopes, according to various aspects of this disclosure. Circuit 800 is configured to convert an LVDS signal from an LVDS-compatible image sensor (not shown) into a signal intended for a MIPI-compatible control unit (not shown). Circuit 800 may include signal level conversion and / or amplification. Additionally, the timing between the two different sides of the conversion can be adjusted.

[0108] Circuit 800 converts high-speed MIPI differential mode data into high-speed LVDS data and converts low-power single-ended MIPI control signals into control signals for use by an image processor. When combined with a processor such as an FPGA or ASIC, circuit 800 can convert single-channel or multi-channel MIPI sensors into single-channel or multi-channel LVDS format for a control unit intended for LVDS processing.

[0109] Conversely, using such Figure 9 The circuit depicted suggests that the control unit for the MIPI-type sensor could use an LVDS sensor.

[0110] Circuit 800 includes a high-speed comparator that outputs an LVDS signal. The comparator may have a single-ended output or a differential output. Circuit 800 also includes two low-speed comparators, each with a single-ended output. The low-speed comparators may have differential outputs. During the HS section of the MIPI signal, the high-speed comparator relays the incoming signal and converts the signal level to LVDS.

[0111] During the HS section, the output of the low-speed comparator is zero because the HS signaling is well below the reference voltage. Depending on the application, the reference voltage can be safely set between 400 mV and 800 mV. When the MIPI signal enters LP mode, a 1.2 V signal swing triggers the low-speed comparator, providing a single-ended output for each differential line. If the signal requires long-distance transmission, each output can be converted to differential; or it can remain as is. The LP signal typically includes frame and line start and stop information for synchronization. The HS section contains the image data. Circuit 800 can be built with or without an FPGA or ASIC. In some cases, a microprocessor or GPU can also be used as a receiver after circuit 800.

[0112] Figure 9 This is a diagram of an example circuit 900 for an LVDS-to-MIPI conversion system for an endoscope, according to various aspects of this disclosure. Circuit 900 receives output from an LVDS image sensor (not shown). Image data is driven to a differential driver for use in MIPI high-speed signaling. As can be seen, a bidirectional driver is connected to each of the N and P channels of the MIPI differential driver. When horizontal or vertical synchronization is received from the LVDS sensor, the FPGA or ASIC places the high-speed differential driver in a high-impedance state and independently drives each of the N and P channels to properly control the MIPI LP mode. Figure 9 A 100-ohm resistor is described, which can be on-chip or off-chip.

[0113] Alternatively, different types of digital image sensor data conversion may be required, for example, to convert a digital LVDS signal with an embedded clock signal to a digital LVDS signal without an embedded clock signal. In this case, the LVDS signal can be routed to an FPGA, for example. The FPGA can decode the clock signal from the LVDS data and send the data without an embedded clock to the control unit. It should be noted that the synchronization signal required by the existing control unit can be matched.

[0114] In some respects, frame rate conversion is performed before the signal is passed to the control unit. For example, a video sequence with a frame rate of 60 frames per second (fps) may need to be converted to 30 fps, and vice versa. Frame rate downconversion can be performed by discarding entire frames as needed to achieve the desired lower frame rate. In a given example of downconverting from 60 fps to 30 fps, every other frame would be discarded; however, if the desired frame rate is different, a different number of frames can be discarded. For example, for a conversion from 60 fps to 45 fps, one out of four frames could be discarded. Figure 10 An example of frame rate conversion is depicted.

[0115] Circuit 900 can be constructed using discrete components or an FPGA or ASIC. In this example, the FPGA will receive the incoming video data. In this way, the pixel data, along with horizontal and vertical synchronization, is known. The FPGA outputs are a tri-state differential driver and two tri-state single-ended output drivers. The FPGA can control the tri-state outputs used to drive HS and LP modes. The FPGA can have a timing generator that will transmit in both modes at the receiver's expected rate and timing. For example, if the receiver's expected data rate will be associated with a large sensor, but the sensor connected to the FPGA is a small sensor, the FPGA can insert artificially created data to fill timing gaps in the data channel, but still provide LP mode information at the timing expected for the large sensor.

[0116] Figure 10 This is a flowchart 1000 of an example frame rate conversion system for an endoscope, according to various aspects of this disclosure. Flowchart 1000 depicts multiple camera frames, each received at 33.32 millisecond intervals, resulting in a frame rate of 30 fps. Flowchart 1000 illustrates the conversion to double the frame rate (specifically, to 60 fps).

[0117] In the example, to perform frame rate conversion, the processor receives a first video signal with a first frame rate and converts it into a second video signal with a second frame rate. As depicted in flowchart 1000, camera frame 1001 is received and stored in memory at time 0 milliseconds (ms). At time 33.32 ms, camera frame 1002 is received and stored in memory. At time 66.64 ms, camera frame 1003 is received and stored in memory. Additionally, camera frames 1001 and 1002 are retrieved from memory, and camera frame 1011 is output (reflecting the 66.64 ms processing delay), and an interpolated frame representing the frame between frames 1001 and 1002 is calculated. At time 83.3 ms, the interpolated frame is output, and so on. In some cases, simple frame duplication is used to obtain the interpolated frame, which simplifies the processing.

[0118] Video frame interpolation involves creating new frames from existing frames so that the new frames are spatially and temporally consistent with the existing frames. Different algorithms are possible, including adaptive and fixed methods.

[0119] Alternatively or concurrently, certain aspects can be used to perform demosaicing or color reconstruction of the image signal. Pixel data obtained from an image sensor may have an incomplete set of pixel data for the image. For example, such pixel data may have a subset of the total pixel data for each of the red, green, and blue measurements. In contrast, demosaiced image data includes the pixel values ​​for each of the red, green, and blue measurements corresponding to each pixel in the array. The disclosed techniques can be used, for example, using an FPGA, ASIC, or other image processing device to perform this conversion.

[0120] Furthermore, the disclosed technology can perform data re-mosaicing. For example, if the control unit expects mosaic data, but the image sensor provides RGB de-mosaiced data, the signal converter can re-mosaic the signal. In the example, to re-mosaic, representative R, G, or B components of the RGB pixel data are extracted and used for frame data. Other methods are also possible. Figure 11 The inputs and outputs of the re-mosaic process are described.

[0121] Figure 11 Figure 1100 shows the input and output of a video re-mosaic system for endoscopy according to various aspects of this disclosure. Figure 1100 depicts raw data 1110 and mosaic image data 1120. As can be seen, data 1110 includes each pixel having a value for each of the R, G, and B data. In contrast, mosaic image data 1120 includes an output sequence comprising R, G, and B values ​​presented as individual data values ​​in an interleaved manner. Different types of re-mosaic algorithms can be used.

[0122] In some aspects, it can be converted between black and white and RGB, and vice versa. Figure 12 An example of such a system is described.

[0123] Figure 12 This is a diagram of an example monochrome-to-color conversion system 1200 for an endoscope, based on various aspects of this disclosure. System 1200 includes an FPGA 1240. In the depicted example, FPGA 1240 generates RGB data 1202 by activating a light source via illumination control 1203 and receiving monochrome data 1201 captured when an image sensor is properly illuminated. Although the RGB color space is used for illustrative purposes, conversion from or to any color space is possible.

[0124] FPGA 1240 includes a pixel pipeline 1241, a timing generator-data 1242, a color / frame combiner 1243, a memory 1244 (including red frame 1245, green frame 1246, and blue frame 1247), and a timing generator-illumination 1248. FPGA 1240 operates by generating repeating groups of three frames, each generated using red, green, and blue illumination respectively. Data from these three frames is combined to create the desired RGB data.

[0125] Memory 1244 is used to store intermediate data. Memory 1244 may or may not be within FPGA 1240. FPGA 1240 can generate the timing required to synchronize the illumination of different colors with the exposure of camera frames. Pixel pipeline 1241 reads incoming data and stores the incoming data in memory 1244. Each incoming data point is assigned to the corresponding frame and the correct pixel position. Color / frame combiner 1243 receives data from all three frames to generate a frame with RGB data for each pixel. Timing generator-illumination 1248 is operable to emit the correct light (e.g., red, green, or blue) in a pulsed manner. The timing of the pulses is coordinated to match the expected image, thereby correctly assigning red, green, and blue frames.

[0126] Figure 13 Figure 1300 shows exemplary inputs and outputs of a monochrome-to-color conversion system for an endoscope, according to various aspects of this disclosure. RGB frames are formed from separate R, G, and B frames.

[0127] As can be seen, R-frame 1301, G-frame 1302, and B-frame 1303 are combined into RGB frame 1310. G-frame 1302, B-frame 1303, and R-frame 1304 are combined into RGB frame 1311. B-frame 1303, R-frame 1304, and G-frame 1305 are combined into RGB frame 1312.

[0128] Figure 1300 illustrates the scrolling frame method. For example, each sequential RGB output frame is created from a scrolling (or sliding) window of a sequential triplet of R, G, and B input frames. The number of RGB frames created equal to the total number of combined R, G, and B frames is increased. In some cases, the processor can be used to smooth motion artifacts produced by the conversion process.

[0129] Various aspects involve adapters that facilitate interoperability between the endoscope and the control unit. For adapters (including external devices not integrated into the endoscope) to be used with existing control units as well as with new or different endoscopes not previously used with that control unit, secure integration of the adapter into existing devices is required. Typically, in endoscopes that use fiber optic / illumination fiber to transmit light to the distal end, the endoscope is securely connected to the light source via an umbilical cable to couple light from the light source into the illumination fiber, and electrical connections (e.g., pigtails) are used to connect the circuitry to the image processor.

[0130] The video converter described herein can be attached to a light source that is not located at the end of the endoscope, but rather within the control unit. In this case, an adapter containing an illumination fiber optic assembly can be used, allowing light to be coupled from the light source of the existing control unit to the endoscope via the adapter. Figure 14 An example of this is described.

[0131] Figure 14 This is a figure of an example mechanical adapter system 1400 for use with an endoscope and a signal converter, according to various aspects of this disclosure. System 1400 includes an endoscope 1410, a light source 1404, an optical coupler 1420, an adapter 1430, and an image processor 1432. As can be seen, the optical coupler 1420 connects the light source 1404 to the endoscope 1410, such that light is transmitted from the light source 1404 through the optical coupler 1420 of the adapter 1430 to the endoscope 1410. The adapter 1430 may accommodate one or more components of a video signal converter and, as shown, is positioned between the endoscope 1410 and the image processor 1432.

[0132] Figure 15 This is a diagram of an example mechanical adapter system 1500 for use with an endoscope and signal transducer, according to various aspects of this disclosure. System 1500 includes an endoscope 1510, a light source 1504, an adapter 1530, and an image processor 1532. In system 1500, adapter 1530 is attached to a fiber optic pigtail on image processor 1532 because light source 1504 is not necessary for the system to function as intended. For example, endoscope 1510 may include one or more LEDs as a light source at a distal end, and an umbilical cable connects endoscope 1510 to adapter 1530. Adapter 1530 is then connected to a port of image processor 1532, which can provide electrical signals to the LEDs and provide image processing functions.

[0133] Figure 16This is a diagram of an example mechanical adapter system 1600 for use with an endoscope and a signal converter, according to various aspects of this disclosure. System 1600 includes an endoscope 1610, a light source 1604, an adapter 1630, and an image processor 1632. In system 1600, the converter (adapter 1630) is a separate device added to a device stack of image processor 1632 and light source 1604. Similar to system 1500, endoscope 1610 may include one or more LEDs as a light source at a distal end, and an umbilical cable connects endoscope 1610 to adapter 1630. Adapter 1630 is then connected, for example, via the umbilical cable (or other electrical wiring) of adapter 1630 to a port of image processor 1632. Image processor 1632 can provide electrical signals to the LEDs and provide image processing functions.

[0134] Figure 17 This is a diagram of an example mechanical adapter system 1700 for use with an endoscope and signal transducer, according to various aspects of this disclosure. System 1700 includes an endoscope 1710, a light source 1704, an adapter 1730, and an image processor 1732. In system 1700, the adapter 1730 is a device added to the stack; however, the light source 1704, a device from the prior art, is still used to provide illumination to the endoscope 1710, for example, via optical fiber illumination technology.

[0135] On the other hand, the image sensor converter resides within the endoscope. This image sensor can be located in a connector used to connect the endoscope to existing equipment, or within the endoscope's handle.

[0136] Figure 18 Examples of computing devices 1800 according to various aspects of this disclosure are depicted. Figure 18 This is a simplified functional block diagram of a computing device 1800 that can be configured to perform the processes described herein. In various aspects, any system herein may be or include the computing device 1800, which includes, for example, a data communication interface 1820 for packet data communication. The computing device 1800 may communicate with one or more other computers, for example, using an electronic network 1825 (e.g., via the data communication interface 1820). The electronic network 1825 may include a wired or wireless network.

[0137] The computing device 1800 may also include a central processing unit (“CPU”) in the form of one or more processors 1802 for executing program instructions 1824. The program instructions 1824 may include instructions for, for example, controlling components of the various systems described herein (such as D / A or A / D controllers) and / or performing functions such as image processing.

[0138] The computing device 1800 may include an internal communication bus 1808. The computing device 1800 may also include a drive unit 1806 (e.g., read-only memory (ROM), hard disk drive (HDD), solid-state drive (SDD), etc.) that can store data on a computer-readable medium 1822 (e.g., a non-transitory computer-readable medium), although the computing device 1800 may receive programming and data via network communication. The computing device 1800 may also have a memory 1804 (e.g., random access memory (RAM)) storing instructions 1824 for performing the techniques presented herein. However, it should be noted that in some aspects, the instructions 1824 may be temporarily or permanently stored within other modules of the computing device 1800 (e.g., processor 1802 and / or computer-readable medium 1822). The computing device 1800 may also include user input and output devices 1812 and / or a display 1810 for connection to input and / or output devices such as a keyboard, mouse, touchscreen, monitor, display, etc. Various system functions can be implemented in a distributed manner on multiple similar platforms to distribute the processing load. Alternatively, these systems can be implemented by appropriately programming a single computer hardware platform.

[0139] The programmatic aspect of this technology can be considered a "product" or "artifact" typically in the form of executable code and / or associated data carried or embodied on a type of machine-readable medium. "Storage" media includes any or all of the tangible memory of computers, processors, etc., or their associated modules (such as various semiconductor memories, tape drives, disk drives, etc.), which can provide non-transitory storage for software programming at any time. All or part of the software can sometimes communicate via the Internet or various other telecommunications networks. Such communication, for example, enables the loading of software from one computer or processor into another. Therefore, another type of medium that can carry software elements includes light waves, radio waves, and electromagnetic waves, such as physical interfaces between local devices, used via wired and optical terrestrial networks, and via various air links. Physical elements carrying such waves (such as wired or wireless links, optical links, etc.) can also be considered as media carrying software. As used herein, unless limited to non-transitory tangible "storage" media, terms such as "computer or machine-readable medium" refer to any medium involved in providing instructions to a processor for execution.

[0140] While the principles of this disclosure have been described herein with reference to illustrative examples of specific applications, it should be understood that this disclosure is not limited thereto. Those skilled in the art and those who have received the teachings provided herein will recognize that additional modifications, applications, and substitutions of equivalents fall within the scope of the examples described herein. Therefore, the invention should not be considered limited to the foregoing description.

Claims

1. A medical system comprising: Video signal converter, the video signal converter being configured to: Receive a first video signal from an imaging device, the first video signal having a first video signal format; Convert the first video signal from the first video signal format to a second video signal format that is different from the first video signal format; as well as The converted video signal is output as a second video signal to the control unit, wherein the control unit is configured to receive the second video signal and process the second video signal for output to an electronic display.

2. The medical system as claimed in claim 1, wherein: The first video signal format is an analog video format. The second video signal format is a digital video format. The video signal converter includes an analog-to-digital converter, and Converting the first video signal includes: Apply the analog-to-digital converter to the first video signal, and The second video signal is received from the analog-to-digital converter.

3. The medical system as described in claim 2, wherein, The imaging device is a charge-coupled device (CCD), and the second video signal is compatible with signals from a metal-oxide-semiconductor (CMOS).

4. The medical system as described in claim 1, wherein, The first video signal format is a digital signal format. The second video signal is in analog signal format; The video signal converter includes a digital-to-analog converter, and Converting the first video signal includes: Apply the digital-to-analog converter to the first video signal, and The second video signal is received from the digital-to-analog converter.

5. The medical system as described in claim 4, wherein, The imaging device is a CMOS device, and the second video signal is compatible with the signal from the CCD.

6. The medical system as claimed in claim 1, wherein, Each of the first video signal format and the second video signal format conforms to either the Low Voltage Differential Signaling (LVDS) format or the Mobile Industry Processor Interface (MIPI) format.

7. The medical system of any preceding claim, further comprising a medical device including a distal end portion, the distal end portion including the imaging device configured to output the first video signal in the first video signal format.

8. The medical system of claim 7, further comprising an illumination source configured to emit light at the distal end portion, and wherein, The conversion from the first video signal to the second video signal includes: The lighting source emits light with the first primary color at the first moment; Capture the first video frame; The lighting source emits light with a second primary color that is different from the first primary color at a second time. Capture the second video frame; and The second video signal is constructed based on the first video frame and the second video frame.

9. The medical system as claimed in claim 7 or 8, wherein, The video signal converter is located inside the handle of the medical device.

10. The medical system as claimed in any of the preceding claims, wherein: The first video signal includes a first frame rate, and The system further includes a processor configured to adjust a first frame rate of the first video signal to a second frame rate of the second video signal, wherein the second frame rate is different from the first frame rate.

11. The medical system as claimed in any of the preceding claims, wherein, The system further includes a processor configured to decompose the first video signal into individual primary color components and construct a mosaic from the second video signal having the primary color components, wherein each pixel value of the second video signal includes a single primary color component.

12. The medical system as described in claim 1 or 7 to 10, wherein, The first video signal format is an analog video signal format having a first signaling type, and the second video signal format is a second analog video signal format having a second signaling type different from the first signaling type.

13. The medical system of any preceding claim, further comprising an adapter having the video signal converter, wherein, The adapter can be attached to the medical device.

14. The medical system of claim 13, wherein, The medical device is an endoscope, and the adapter includes an optical coupler configured to transmit light from an illumination source to the endoscope.

15. The medical system as claimed in any of the preceding claims, wherein, The control unit is configured to process the second video signal before outputting it to an electronic display.

Images