Endoscope camera system and image data transmission device thereof

Abstract

An endoscope camera system and an image data transmission device are provided. When transmitting image data, the image data is transmitted through a first data processing device (20), an optical fiber transmission component (30), and a second data processing device (40). The first data processing device (20) is at least used to convert image data based on a first data communication protocol output by an image sensor (10) into data based on a second data communication protocol, and transmit the data to the second data processing device (40) via the optical fiber sensor component (30). The second data processing device (40) then converts the acquired image data into image data based on a third data communication protocol and outputs the data to an image processing unit (500) for processing.

Description

Technical Field

[0001] The present invention relates to an endoscope camera system and an image data transmission device thereof. Background Art

[0002] In recent years, endoscopic camera systems have been increasingly used in surgical operations and diagnostic examinations. Endoscopic camera systems can provide doctors with images of the inside of the human body, allowing doctors to perform operations or examinations stably and correctly through the images.

[0003] The resolution of endoscope camera systems has evolved from high definition (HD) to full high definition (FHD) and then to ultra high definition (UHD), or in other words, from 1K to 2K and finally to 4K. While resolution continues to improve, many technical challenges remain to be resolved.

[0004] For example, as the resolution of endoscopic camera systems continues to improve, the amount of data collected by the sensors that collect image data is also increasing. The collected data needs to be transmitted to the host of the endoscopic camera system through a transmission cable assembly for processing. In order to ensure real-time and display efficiency, this requires the transmission cable assembly to be able to transmit large amounts of data at high speed and have good anti-interference capabilities.

[0005] Currently, image data in endoscope camera systems is transmitted from the sensor to the image processing host through multi-channel twisted pair cables. This has many disadvantages, such as the overall cable being too thick, poor anti-interference capabilities, and usually unable to meet the real-time transmission requirements of high-resolution image data. SUMMARY OF THE INVENTION

[0007] Technical issues

[0008] Solution to the problem

[0009] Technical Solutions

[0010] An image data transmission device for an endoscopic camera system, the image data transmission device being used to connect to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; comprising:

[0011] At least a first image sensor and a second image sensor, wherein the first image sensor and the second image sensor are both configured to generate image data, and the first image sensor and the second image sensor output the image data based on a first data communication protocol through respective data output channels;

[0012] a first data processing device, the first data processing device being communicatively connected to data output channels of the first image sensor and the second image sensor; the first data processing device comprising at least a first set of data output terminals and a second set of data output terminals; the first data processing device being configured to convert image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert image data output by the second image sensor into a second set of image data based on a second data communication protocol and output the data through the second set of data output terminals; the second data communication protocol being different from the first data communication protocol;

[0013] An optical fiber transmission assembly comprising an electro-optical converter, an optical-electrical converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; the electro-optical converter is configured to convert a first set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the signal to the optical-electrical converter via the first optical fiber transmission channel; the optical-electrical converter then converts the received first set of image data from an optical signal into an electrical signal and outputs the signal; the electro-optical converter is further configured to convert a second set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the signal to the optical-electrical converter via the second optical fiber transmission channel; the optical-electrical converter then converts the received second set of image data from an optical signal into an electrical signal and outputs the signal;

[0014] A second data processing device includes at least a first group of data input terminals and a second group of data input terminals; the second data processing device is used to receive a first group of image data output by the photoelectric converter through the first group of data input terminals, and convert the first group of image data into image data based on a third data communication protocol for output; and the second data processing device is also used to receive a second group of image data output by the photoelectric converter through the second group of data input terminals, and convert the second group of image data into image data based on a third data communication protocol for output.

[0015] In one embodiment, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the V-by-One signal transmission interface standard, the first group of data input terminals and the second group of data input terminals of the second data processing device adopt the V-by-One signal transmission interface standard, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;

[0016] Alternatively, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the FPD-LINK signal transmission interface standard, the first group of data input terminals and the second group of data input terminals of the second data processing device adopt the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

[0017] In one embodiment, the first data output terminal and the second data output terminal of the first data processing device adopt the FPD-LINK III signal transmission interface standard, the first data input terminal and the second data input terminal of the second data processing device adopt the FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard;

[0018] Alternatively, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the FPD-LINK IV signal transmission interface standard, the first group of data input terminals and the second group of data input terminals of the second data processing device adopt the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

[0019] In one embodiment, the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.

[0020] In one embodiment, the data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is MIPI CSI protocol.

[0021] In one embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required for the electro-optical converter to convert the image data from an electrical signal to an optical signal.

[0022] In one embodiment, the first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

[0023] The electro-optical converter comprises at least a first input end, a second input end, a first output end, and a second output end; the photoelectric converter comprises at least a first input end, a second input end, a first output end, and a second output end; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter via the first optical fiber; the second output end of the electro-optical converter is connected to the second input end of the photoelectric converter via the second optical fiber;

[0024] The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the photoelectric converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end;

[0025] The electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the photoelectric converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

[0026] In one embodiment, the electro-optical converter includes a first electro-optical converter and a second electro-optical converter; the optical-to-electrical converter includes a first optical-to-electrical converter and a first optical-to-electrical converter; the first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

[0027] The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a first output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first electro-optical converter is connected to the first input end of the first photoelectric converter via the first optical fiber; the second output end of the second electro-optical converter is connected to the second input end of the second photoelectric converter via the second optical fiber;

[0028] The first electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the first photoelectric converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end;

[0029] The second electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the second photoelectric converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

[0030] An image data transmission device for an endoscopic camera system, the image data transmission device being used to connect to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; comprising:

[0031] an image sensor, the image sensor being configured to generate and output image data based on a first data communication protocol;

[0032] a first data processing device, the first data processing device being configured to convert the image data output by the image sensor into image data based on a second data communication protocol and output the converted image data; the second data communication protocol being different from the first data communication protocol;

[0033] an optical fiber transmission component for converting the image data output by the first data processing device from an electrical signal into an optical signal for transmission, and then converting the image data converted into the optical signal into an electrical signal for output;

[0034] a second data processing device for receiving the image data transmitted from the optical fiber transmission component and converting the image data into image data based on a third data communication protocol for output;

[0035] in:

[0036] The first data processing device and the second data processing device use V-by - One signal transmission interface standard, the second data communication protocol is based on V-by - One signal transmission interface standard protocol;

[0037] Alternatively, the first data processing device and the second data processing device use the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

[0038] In one embodiment, the first data processing device and the second data processing device use an FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard;

[0039] Alternatively, the first data processing device and the second data processing device use the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

[0040] In one embodiment, the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.

[0041] In one embodiment, the first data communication protocol is the MIPI CSI protocol.

[0042] In one embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required for the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

[0043] In one embodiment, the optical fiber transmission component includes an electro-optical converter, an optical fiber transmission channel, and an optical-electrical converter;

[0044] The electro-optical converter receives the image data output by the first data processing device and converts the image data from an electrical signal into an optical signal to output to the optical fiber transmission channel;

[0045] The optical fiber transmission channel is used to transmit the image data converted into optical signals; the optical fiber transmission channel includes an optical fiber;

[0046] The photoelectric converter receives the image data converted into an optical signal transmitted through the optical fiber transmission channel, converts the image data from an optical signal into an electrical signal, and outputs the electrical signal.

[0047] An endoscope camera system, comprising:

[0048] Light source department;

[0049] a light source control unit, configured to control the light source unit to provide light required for imaging;

[0050] An endoscope comprising an insertion portion capable of being inserted into a living body;

[0051] A camera unit, the camera unit including any one of the above-mentioned image data transmission devices;

[0052] an image processing unit for receiving and processing image data output by the endoscope data transmission device to generate data for displaying an image;

[0053] A display is used to display the data used to display the image.

[0054] In one embodiment, the image processing unit includes an FPGA or a CPU.

[0055] Advantageous Effects of the Invention

[0056] Brief description of the accompanying drawings BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 A schematic structural diagram of an image data transmission device according to an embodiment;

[0058] Figure 2 A schematic structural diagram of an image data transmission device according to an embodiment;

[0059] Figure 3 A schematic structural diagram of an image data transmission device according to an embodiment;

[0060] Figure 4 A schematic structural diagram of an image data transmission device according to an embodiment;

[0061] Figure 5 A schematic structural diagram of an image data transmission device according to an embodiment;

[0062] Figure 6 A schematic structural diagram of an image data transmission device according to an embodiment;

[0063] Figure 7 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0064] Figure 8 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0065] Figure 9 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0066] Figure 10 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0067] Figure 11 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0068] Figure 12 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0069] Figure 13Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0070] Figure 14 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0071] Figure 15 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0072] Figure 16 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0073] Figure 17 Schematic diagram of the structure of an endoscope camera system according to an embodiment.

[0074] Invention Embodiments

[0075] Modes for Carrying Out the Invention

[0076] The present invention will be further described in detail below by means of specific embodiments in conjunction with the accompanying drawings. Similar elements in different embodiments are numbered with associated similar elements. In the following embodiments, many detailed descriptions are provided to enable the present application to be better understood. However, those skilled in the art will readily appreciate that some of the features may be omitted in different circumstances, or may be replaced by other elements, materials, or methods. In some cases, some operations related to the present application are not shown or described in the specification. This is to avoid the core portion of the present application being overwhelmed by excessive descriptions, and for those skilled in the art, it is not necessary to describe these related operations in detail. They will fully understand the related operations based on the description in the specification and the general technical knowledge in the art.

[0077] In addition, the features, operations, or characteristics described in the specification may be combined in any appropriate manner to form various embodiments. Furthermore, the steps or actions in the method description may be reordered or adjusted in a manner readily apparent to those skilled in the art. Therefore, the various sequences in the specification and drawings are provided solely for the purpose of clearly describing a particular embodiment and are not intended to be mandatory, unless otherwise specified.

[0078] The serial numbers assigned to components herein, such as "first," "second," etc., are used solely to distinguish the objects being described and do not convey any sequential or technical meaning. References to "connection" and "coupling" herein, unless otherwise specified, include both direct and indirect connections (couplings).

[0079] As mentioned above, the performance of the current image data acquisition and transmission solutions of endoscopic camera systems cannot meet the requirements of high-definition or even 4K real-time video.

[0080] First, current 4K image sensors generally use image sensors with a sub-LVDS interface, and image sensors with the better-performing MIPI CSI interface cannot be selected. This is because the image acquisition portion (camera / camera handle) of the endoscope camera system is constrained by size and power consumption, and image sensors with the better-performing MIPI CSI interface typically have four data channels, which makes the rate of a single channel higher, usually exceeding 1.5Gbps. Image sensors with a sub-LVDS interface typically have 8-10 data channels. Therefore, when the number is the same, the rate of a single channel of an image sensor with a sub-LVDS interface can be greatly reduced, for example, less than 1Gbps. Therefore, current endoscope camera systems cannot directly choose image sensors with interfaces such as MIPI CSI for image acquisition.

[0081] Secondly, for 4K image sensors, the amount of data collected and to be transmitted is very large. In order to ensure real-time performance, the image data collected by the image sensor needs to be transmitted to the image processing host at high speed. However, the current image data transmission method such as multi-channel twisted pair cables cannot meet this high-speed real-time transmission requirements, and the anti-interference ability is poor, and the cables are relatively thick.

[0082] Considering that large-resolution endoscope camera systems, typically 4K, still have many technical problems to be solved, the applicant has studied one or more of these technical problems and proposed some solutions, which are described in detail below.

[0083] Some embodiments provide an image data transmission device. The image data transmission device of the present invention can be used in applications and products such as endoscopic camera systems. The image data transmission device of the present invention can be connected to an image processing unit in an endoscopic camera system, such as an image processing host, to transmit image data to the image processing unit. The image data transmitted to the image processing unit can then be processed by the image processing unit to generate data for displaying an image. The image data transmission device can include one or more image sensors, as described below in different scenarios.

[0084] Please refer to Figure 1 In some embodiments, the image data transmission device includes an image sensor 10, a first data processing device 20, an optical fiber transmission component 30, and a second data processing device 40, which are described in detail below.

[0085] Image sensor 10 is configured to generate and output image data based on a first data communication protocol. In some embodiments, image sensor 10 includes at least two data output channels, such as 10a and 10b, through which the image sensor outputs image data. Image sensor 10 can generate image data in a format that can be processed by an application processor (AP), which serves as a CPU in a mobile device.

[0086] The first data processing device 20 is communicatively connected to the data output channel of the image sensor 10; the first data processing device 20 is at least used to convert the image data output by the image sensor 10 into image data based on a second data communication protocol and output it; the second data communication protocol is different from the first data communication protocol.

[0087] The optical fiber transmission component 30 is used to convert the image data output by the first data processing device 20 from electrical signals to optical signals for transmission, and then convert the optical signals to electrical signals for output. The optical fiber transmission component 30 only serves as a transparent transmission channel and does not involve protocol packaging and unpacking.

[0088] Please refer to Figure 2 In some embodiments, the optical fiber transmission component 30 may include an electro-optical converter 32, an optical fiber transmission channel 39a, and an optical-electrical converter 36. The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from an electrical signal into an optical signal, which is then output to the optical fiber transmission channel 39a. The optical fiber transmission channel 39a is used to transmit the image data converted into an optical signal. In some examples, the optical fiber transmission channel 39a includes an optical fiber. The optical-electrical converter 36 receives the image data converted into an optical signal transmitted by the optical fiber transmission channel 39a, and converts the image data from an optical signal into an electrical signal before outputting it.

[0089] The second data processing device 40 is used to receive the image data transmitted from the optical fiber transmission component 30 and convert the image data into image data based on the third data communication protocol for output.

[0090] It can be seen that the first data processing device 20, the optical fiber transmission component 30, and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or other CPU processing platform. The optical fiber transmission component 30 mainly performs electrical-to-optical conversion, then transmits the optical signal through the optical fiber, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution. When designing the first data processing device 20 and the second data processing device 40, two chips using the chip-to-chip solution are included. These two chips are usually purchased from outside, and a proprietary data communication protocol is used for data transmission between the two chips. That is, the second data communication protocol can be a proprietary data communication protocol provided by the chip supplier.

[0091] In one embodiment, the image sensor 10 can generate image data in accordance with the MIPI (Mobile Industry Processor Interface) specification. For example, the image sensor's data output channel is a MIPI CSI interface, and the first data communication protocol is the MIPI CSI protocol. Specifically, the image sensor's data output channel can be a MIPI CSI-2 interface. MIPI is an alliance established in 2003 by companies including ARM (UK), Nokia (Finland), STMicroelectronics (ST), and Texas Instruments (TI) of the United States. Its goal is to standardize internal mobile phone interfaces, such as camera, display, and RF / baseband interfaces, thereby reducing the complexity and increasing design flexibility of mobile phones. The MIPI Alliance has different working groups that define a series of internal mobile phone interface standards, such as the CSI (Camera Serial Interface), DSI (Display Serial Interface), DigRF (Radio Frequency), and SLIMbus (Microphone / Speaker Bus). The end market demands lower power consumption, higher data rates, and smaller PCB footprints. Among the several currently used standard-based serial differential interfaces, the MIPI interface is suitable for power-sensitive devices that also require high performance. As mentioned above, CSI is an interface standard specified by the Camera Working Group of the MIPI Alliance. CSI-2 is the second version of MIPI CSI, consisting primarily of the application layer, protocol layer, and physical layer. It typically supports four-lane data transmission at single-line speeds up to 1Gb / s, and also supports eight-lane data transmission. In addition to the ground line, the MIPI CSI-2 interface generally has one pair of I2C communication pins, one pair of MIPI differential clock pins, and one to four pairs of MIPI differential data signal pins.

[0092] Typically, endoscope cameras are handheld, allowing surgeons to adjust viewing areas and control parameters during surgery. Image sensors transmit large amounts of data, requiring high transmission power and generating significant heat. Cameras must be designed to be low-power and generate minimal heat. Image sensors with MIPI interfaces offer low power consumption, precisely meeting these requirements.

[0093] Therefore, in order to reduce the power consumption of related devices, this embodiment adopts an image sensor with a MIPI CSI interface with lower power consumption. However, since the optical fiber transmission component has requirements for the signal swing of the image data when converting the image data from an electrical signal to an optical signal. For example, when the optical fiber transmission component converts the data from an electrical signal to an optical signal, it usually requires that the lower limit of the signal swing of the data be 200mv, while the signal swing of MIPI CSI data is usually less than 200mv. Coupled with the loss during the transmission process, it is impossible to support the optical fiber transmission component to convert it from an electrical signal to an optical signal. Therefore, in this embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has the signal amplitude required by the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

[0094] In one embodiment, when the image sensor has an 8-lane MIPI interface, the image sensor outputs image data via the 8-lane MIPI interface to the first data processing device. The first data processing device processes the acquired image data, converts it into one channel of image data, and outputs it. Correspondingly, the optical fiber transmission component converts the image data from an electrical signal into an optical signal and transmits it via one optical fiber.

[0095] In another embodiment, when the image sensor has an 8-lane MIPI interface, the image sensor outputs image data to the first data processing device via the 8-lane MIPI interface. The first data processing device processes the acquired image data, converts it into two channels of image data, and outputs them. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, which are then transmitted via two optical fibers.

[0096] In some embodiments, the third data communication protocol is the same as the first data communication protocol. For example, when the image sensor 10 outputs MIPI-compliant image data, the image data converted by the second data processing device 40 is also MIPI-compliant image data. In some embodiments, the third data communication protocol is different from the first data communication protocol, as long as data based on the third data communication protocol can be recognized and processed by the image processing unit.

[0097] In one embodiment, the number of channels of the image data output by the first data processing device is less than the number of channels of the image data input.

[0098] One data output channel of the image sensor 10 may correspond to one pin of the image sensor 10 or to multiple pins (e.g., two) of the image sensor 10. Since the image data generated by the image sensor is large and difficult to output through a single data output channel, the generated image data is typically output through multiple data output channels to reduce the rate of each output channel. Furthermore, reducing the rate of each output channel allows for a wider range of adaptation to the data processing capability and power consumption requirements of the next-level processing unit (e.g., the first data processing device 20).

[0099] In some examples, the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard. V-by-One is a signal transmission interface standard developed by THine Electronics of Japan, which can be used for high-definition digital image signal transmission and consists of 1 to 8 groups of paired signals; specifically, V-by-One uses 8B / 10B encoding, which is better compatible with other high-speed serials such as PCI Express and USB 3.0; and converting 8Bit data into 10Bit data can effectively solve the DC balance. V-by-One not only solves the wiring delay problem, but also greatly reduces EMI interference, and increases the maximum transmission speed of each group of signals (for example, up to 3.75Gbps), and the number of transmission lines is greatly reduced, saving PCB space. For example, an ultra-high-definition UHD display with a resolution of not less than 3840X2160, if the LVDS protocol standard is used, its data lines will be as many as 48 pairs; if V-by - On protocol standard, only 8 pairs of data cables are required.

[0100] In some examples, the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Furthermore, the FPD-LINK III / IV signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK III / IV signal transmission interface standard. FPD-Link III is an iteration based on FPD-Link II. Its primary function is to embed the same differential bidirectional communication channel pair. Compared to FPD-Link II, FPD-Link III further reduces cable costs by eliminating control channel cables, such as I2C and CAN bus. Compared to FPD-Link II, FPD-Link III discontinues the use of LVDS technology and only uses CML serialized high-speed signals. This allows it to easily support data transmission rates exceeding 3 Gbit / s on transmission lines with cable lengths greater than 10m. The benefit of using CML in FPD-Link III is that it takes advantage of the driving capability of coaxial cables. In addition, since coaxial cables are very good at controlling impedance and noise, the need for differential signals can be reduced, and the interference from impedance discontinuities and noise can be better tolerated. The characteristic of FPD-LINK III is that it supports full-duplex control of high-speed video data transmission and bidirectional control communication through a single differential link. Integrating video data and control through a single differential pair can reduce the size and weight of interconnect lines, while also eliminating skew issues and simplifying system design. FPD-LINK III is generally used as an interface for automotive applications, capable of point-to-point video transmission. Compared to FPD-LINK III, FPD-LINK IV increases the data transmission rate of a single channel.

[0101] Please refer to Figure 3 In some embodiments, the image data transmission device includes multiple image sensors, such as a first image sensor 11 and a second image sensor 12. The image data transmission device also includes a first data processing device 20, an optical fiber transmission assembly 30, and a second data processing device 40, as described in detail below. It should be noted that while the figure illustrates an example of an image data transmission device including two image sensors, this does not necessarily limit the number of image sensors to two. In actual practice, N image sensors can be configured as needed, where N can be 2 or an integer greater than 2.

[0102] The first image sensor 11 and the second image sensor 12 are both used to generate image data. The first image sensor 11 and the second image sensor 12 each include at least two data output channels, such as 10a and 10b. The first image sensor 11 and the second image sensor 12 output image data based on the first data communication protocol through their respective at least two data output channels. For example, the first image sensor 11 outputs image data through its at least two data output channels, such as 10a and 10b, and the first image sensor 12 outputs image data through its at least two data output channels, such as 10a and 10b.

[0103] The first image sensor 11 and the second image sensor 12 can generate image data in accordance with specifications that can be processed by an AP (Application Processor), which is a CPU in a mobile device. For example, the first image sensor 11 and the second image sensor 12 can generate image data in accordance with the MIPI (Mobile Industry Processor Interface) specification. Accordingly, the data output channels of the image sensors can be MIPI CSI-2 interfaces.

[0104] The first data processing device 20 is communicatively connected to the data output channels of the first image sensor 11 and the second image sensor 12. The first data processing device 20 includes at least a first set of data output terminals 20a and a second set of data output terminals 20b. The first data processing device 20 is configured to convert the image data output by the first image sensor 11 into a first set of image data based on a second data communication protocol and output it through the first set of data output terminals 20a. Furthermore, the first data processing device 20 is configured to convert the image data output by the second image sensor 12 into a second set of image data based on the second data communication protocol and output it through the second set of data output terminals 20b. In one embodiment, the second data communication protocol is different from the first data communication protocol.

[0105] Please refer to Figure 4The fiber optic transmission assembly 30 includes an electro-optical converter 31, a photoelectric converter 35, and at least a first fiber optic transmission channel 39b and a second fiber optic transmission channel 39c. The electro-optical converter 31 is used to convert the first set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the signal to the photoelectric converter 35 via the first fiber optic transmission channel 39b. The photoelectric converter 35 then converts the received first set of image data from an optical signal into an electrical signal and outputs the signal. The electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the signal to the photoelectric converter 35 via the second fiber optic transmission channel 39c. The photoelectric converter 35 then converts the received second set of image data from an optical signal into an electrical signal and outputs the signal. It can be seen that the first fiber optic transmission channel 39b and the second fiber optic transmission channel 39c are two independent signal transmission channels, which are described in detail below.

[0106] Please refer to Figure 5 In some embodiments, the first fiber optic transmission channel 39b includes a first optical fiber 39bg, and the second fiber optic transmission channel 39c includes a second optical fiber 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c, and a second output end 32d; the optical-to-electrical converter 36 includes at least a first input end 36a, a second input end 36b, a first output end 36c, and a second output end 36d. The first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the optical-to-electrical converter 36 via a first optical fiber 39bg; the second output end 32b of the electro-optical converter 32 is connected to the second input end 36b of the optical-to-electrical converter 36 via a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20.

[0107] Therefore, the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the first set of image data converted into optical signals through its first output end 32c, and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 36a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 36c. Similarly, the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input end 32b, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the second set of image data converted into optical signals through its second output end 32b, and transmits them through the second optical fiber 39cg; the photoelectric converter 36 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 36b, and converts the second set of image data from optical signals to electrical signals for output through its second output end 36d.

[0108] Please refer to Figure 6 In some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; the optical-to-electrical converter 35 includes a first optical-to-electrical converter 37 and a first optical-to-electrical converter 38; the first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first optical-to-electrical converter 37 includes a first input end 37a and a first output end 37b; the second optical-to-electrical converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 is connected to the first input end 37a of the first optical-to-electrical converter 37 via a first optical fiber 39bg; and the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second optical-to-electrical converter 38 via a second optical fiber 39cg. The first input terminal 33a of the first electro-optical converter 33 is connected to the first group of data output terminals 20a of the first data processing device 20 , and the second input terminal 34a of the second electro-optical converter 34 is connected to the second group of data output terminals 20b of the first data processing device 20 .

[0109] Therefore, the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg; the first photoelectric converter 37 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 37a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 37b. Similarly, the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input end 34a, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter 34 outputs the second set of image data converted into optical signals through its second output end 34b, and transmits them through the second optical fiber 39cg; the second photoelectric converter 38 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 38a, and converts the second set of image data from optical signals to electrical signals for output through its second output end 38b.

[0110] The above is some description of the optical fiber transmission assembly 30 .

[0111] The second data processing device 40 includes at least a first group of data input terminals 40a and a second group of data input terminals 40b; the second data processing device 40 is used to receive the first group of image data output by the photoelectric converter 20 through its first group of data input terminals 40a, and convert the first group of image data into image data based on the third data communication protocol for output; and the second data processing device 40 is also used to receive the second group of image data output by the photoelectric converter through its second group of data input terminals 40b, and convert the second group of image data into image data based on the third data communication protocol for output.

[0112] In some embodiments, the third data communication protocol is the same as the first data communication protocol. For example, when the image sensor 10 outputs MIPI-compliant image data, the image data converted by the second data processing device 40 is also MIPI-compliant image data. In some embodiments, the third data communication protocol is different from the first data communication protocol, as long as data based on the third data communication protocol can be recognized and processed by the image processing unit.

[0113] It can be seen that the first data processing device 20, the optical fiber transmission component 30, and the second data processing device 40 cooperate to transmit the image data generated by the image sensors, such as the first image sensor 11 and the second image sensor 12, for example, to the image processing unit, etc. The image processing unit can be an FPGA or other CPU processing platform. The optical fiber transmission component 30 mainly performs electro-optical conversion, then transmits the signal through the optical fiber, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip matching solution. When designing the product, the first data processing device 20 and the second data processing device 40 include two chips using the chip matching solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used for data transmission between the two chips, that is, the second data communication protocol can be a proprietary data communication protocol, which is provided by the chip supplier.

[0114] In some examples, the first data processing device 20 and the second data processing device 40 use V-by - One signal transmission interface standard, the second data communication protocol is based on V-by - One signal transmission interface standard protocol.

[0115] In some examples, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Furthermore, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK III / IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III / IV signal transmission interface standard.

[0116] The above is some description of the image data transmission device of the present invention. The image data transmission device of the present invention can be applied to occasions and products such as endoscope camera systems. The following description will be made using the application in endoscope camera occasions as an example.

[0117] Please refer to Figure 7 、 Figure 8 and Figure 9 In some embodiments, the endoscope camera system includes a light source unit 100, a light source control unit 200, an endoscope 300, a camera unit 320, an endoscope data transmission device 400, an image processing unit 500 and a display 600, which are described in detail below.

[0118] The light source unit 100 is used to provide an illumination source to the part to be observed. The light source unit 100 can provide the light required for ordinary light imaging, and can also provide the light required for special light imaging. For example, the illumination source provided by the light source unit 100 to the part to be observed can be ordinary light illumination based on wide-band light or special light illumination based on narrow-band light. The endoscope system generates a color image in ordinary illumination mode, and in special illumination mode, it first generates a monochrome image with a vascular enhancement effect, and then generates a color image based on the grayscale value of the monochrome image. It can be understood that this color image generated from a monochrome image, such as a grayscale image, is a pseudo-color image, that is, the special light image is a pseudo-color image at this time.

[0119] In some embodiments, the light source unit 100 may include a first light source 110 and a second light source 120. In normal illumination mode, the first light source 110 may provide multiple monochromatic lights of different wavelength ranges in a time-sharing manner. For example, the first light source 110 may be a semiconductor light source or an LED light source, and the monochromatic light provided may be blue light, green light, red light, etc. In other embodiments, the first light source 110 may also provide a combination of the multiple monochromatic lights, or a wide-spectrum white light source. The wavelength range of the monochromatic light is approximately 400nm to 700nm. In special illumination mode, the second light source 120 provides narrowband light. For example, the second light source 120 may be a laser that emits narrowband blue laser light, and the peak wavelength of the blue light is at least one value within the range of 390nm-460nm. In other embodiments, the second light source 120 may also be an LED light source or a laser LED, and the narrowband light emitted may be a narrowband green laser light, etc.

[0120] In some embodiments, the light source unit 100 may further include a dichroic mirror 130. Under the control of the light source control unit 200, the first light source 110 and the second light source 120 operate in a time-sharing manner; that is, when the first light source 110 is turned on, the second light source 120 is turned off. And vice versa. The dichroic mirror 130 is arranged on the transmission optical path of multiple monochromatic lights and narrow-band lights, and the optical paths of the multiple monochromatic lights and the narrow-band lights are combined into the same optical path after passing through the dichroic mirror 130. For example, multiple monochromatic lights can pass through the dichroic mirror 130, and the narrow-band lights can be reflected by the dichroic mirror 130, so that the optical paths of the two are combined into the same optical path; and vice versa. On the optical path after the dichroic mirror 130, the narrow-band lights and the multiple monochromatic lights are transmitted in a time-sharing manner along the combined same optical path toward the endoscope 300.

[0121] In some embodiments, the light source unit 100 further includes a coupling mirror 140 disposed between the dichroic mirror 130 and the light source inlet of the endoscope 300. The coupling mirror 140 focuses the light transmitted from the dichroic mirror 130, thereby better guiding it into the endoscope 300, minimizing light loss and improving the overall illumination quality of the system. The optical path combining function of the dichroic mirror 130 and the focusing function of the coupling mirror 140 both effectively guide light into the endoscope 300. Furthermore, the use of the dichroic mirror 130 can make the overall structure of the light source unit 100 more compact and shorten the light propagation path.

[0122] The above is some description of the light source unit 100. The light source control unit 200 is used to control the light source unit 100, for example, to control the light source unit 100 to provide light required for ordinary light imaging and to control the light source unit 100 to provide light required for special light imaging.

[0123] Endoscope 300 is used to transmit optical signals. In some embodiments, endoscope 300 may include an insertion portion 310. In some embodiments, insertion portion 310 is capable of being inserted into a living body. For example, insertion portion 310 is a portion of the endoscope body that can be inserted into a living body by an operator. Insertion portion 310 is capable of transmitting light generated by light source portion 100 to an inlet portion (which may be a light-guiding optical fiber) at the site to be observed.

[0124] The imaging unit 320 includes at least one sensor for generating image data. For example, in some examples, the imaging unit 320 may include an image sensor 10. In another example, the imaging unit 320 may include a first image sensor 11 and a second image sensor 12. In another example, the imaging unit 320 may include N sensors for generating image data, where N may be an integer greater than 2.

[0125] Please refer to Figure 10 , is an example in which the camera unit 320 includes an image sensor 10. In some examples, the image sensor 10 is used to generate image data based on a first data communication protocol. Specifically, the image sensor 10 may include at least two data output channels, such as 10a and 10b, and the image sensor outputs image data through its at least two data output channels, such as 10a and 10b. In some examples, the image sensor 10 can generate image data in accordance with specifications that can be processed by an AP (Application Processor) serving as a CPU for a mobile device. For example, the image sensor 10 can generate image data in MIPI specifications, and accordingly, the data output channel of the image sensor can be a MIPI CSI-2 interface.

[0126] Please refer to Figure 11, is an example in which the camera unit 320 includes a first image sensor 11 and a second image sensor 12. In some examples, the first image sensor 11 and the second image sensor 12 are both used to generate image data. The first image sensor 11 and the second image sensor 12 each include at least two data output channels, such as 10a and 10b. The first image sensor 11 and the second image sensor 12 output image data based on a first data communication protocol through their respective at least two data output channels. For example, the first image sensor 11 outputs image data through its at least two data output channels, such as 10a and 10b, and the first image sensor 12 outputs image data through its at least two data output channels, such as 10a and 10b. In some examples, the first image sensor 11 and the second image sensor 12 can generate image data in a format that can be processed by an AP (Application Processor) serving as a CPU in a mobile device. For example, the first image sensor 11 and the second image sensor 12 can generate image data in accordance with MIPI specifications. Accordingly, the data output channels of the image sensors can be MIPI CSI-2 interfaces.

[0127] In some examples, one end of the imaging unit 320 is connected to the endoscope data transmission device 400 to provide image data to the image processing unit 500. One end of the imaging unit 320 can be clipped onto an endoscope, while the light source unit 100 provides light to the endoscope 300, and the imaging unit 320 can acquire optical signals from the endoscope. The endoscope data transmission device 400 is described below.

[0128] The endoscope data transmission device 400 is used to transmit the image data generated by the camera unit 320 to the subsequent image processing unit 500 for processing. There are many ways to implement the endoscope data transmission device 400, which are described in detail below.

[0129] Let's take the example of the camera unit 320 including the image sensor 10 to illustrate the structure and function of the endoscope data transmission device 400 in this embodiment. Figure 12 In this case, the endoscope data transmission device 400 may include a first data processing component 20 , an optical fiber transmission component 30 , and a second data processing component 40 .

[0130] The first data processing device 20 is communicatively connected to the data output channel of the image sensor 10; the first data processing device 20 is at least used to convert the image data output by the image sensor 10 into image data based on a second data communication protocol and output it; the second data communication protocol is different from the first data communication protocol.

[0131] The optical fiber transmission component 30 is used to convert the image data output by the first data processing device 20 from an electrical signal into an optical signal for transmission, and then convert the image data from an optical signal into an electrical signal for output.

[0132] Please refer to Figure 13 In some embodiments, the optical fiber transmission component 30 may include an electro-optical converter 32, an optical fiber transmission channel 39a, and an optical-electrical converter 36. The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from an electrical signal into an optical signal, which is then output to the optical fiber transmission channel 39a. The optical fiber transmission channel 39a is used to transmit the image data converted into an optical signal. In some examples, the optical fiber transmission channel 39a includes an optical fiber. The optical-electrical converter 36 receives the image data converted into an optical signal transmitted by the optical fiber transmission channel 39a, and converts the image data from an optical signal into an electrical signal before outputting it.

[0133] The second data processing device 40 is used to receive the image data transmitted from the optical fiber transmission component 30 and convert the image data into image data based on the third data communication protocol for output.

[0134] It can be seen that the first data processing device 20, the optical fiber transmission component 30, and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or other CPU processing platform. The optical fiber transmission component 30 mainly performs electrical-to-optical conversion, then transmits the signal through the optical fiber, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip matching solution. When designing the first data processing device 20 and the second data processing device 40, two chips using the chip matching solution are included. These two chips are usually purchased from outside, and a proprietary data communication protocol is used for data transmission between the two chips. That is, the second data communication protocol can be a proprietary data communication protocol provided by the chip supplier.

[0135] In some examples, the first data processing device 20 and the second data processing device 40 use V-by - One signal transmission interface standard, the second data communication protocol is based on V-by - One signal transmission interface standard protocol.

[0136] In some examples, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Furthermore, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK III / IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III / IV signal transmission interface standard.

[0137] Let's take the example of the camera unit 320 including the first image sensor 11 and the second image sensor 12 to illustrate the structure and function of the endoscope data transmission device 400 in this embodiment. Figure 14 In this case, the endoscope data transmission device 400 may include a first data processing component 20 , an optical fiber transmission component 30 , and a second data processing component 40 .

[0138] The first data processing device 20 is communicatively connected to the data output channels of the first image sensor 11 and the second image sensor 12. The first data processing device 20 includes at least a first set of data output terminals 20a and a second set of data output terminals 20b. The first data processing device 20 is configured to convert the image data output by the first image sensor 11 into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals 20a. The first data processing device 20 is also configured to convert the image data output by the second image sensor 12 into a second set of image data based on the second data communication protocol and output the data through the second set of data output terminals 20b.

[0139] It should be noted that the first data output terminal 20a and the second data output terminal 20b can be one output terminal or multiple output terminals. Correspondingly, the first image data and the second image data can be one channel of image data or multiple channels of image data.

[0140] Please refer to Figure 15The fiber optic transmission assembly 30 includes an electro-optical converter 31, a photoelectric converter 35, and at least a first fiber optic transmission channel 39b and a second fiber optic transmission channel 39c. The electro-optical converter 31 is used to convert the first set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the signal to the photoelectric converter 35 via the first fiber optic transmission channel 39b. The photoelectric converter 35 then converts the received first set of image data from an optical signal into an electrical signal and outputs the signal. The electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the signal to the photoelectric converter 35 via the second fiber optic transmission channel 39c. The photoelectric converter 35 then converts the received second set of image data from an optical signal into an electrical signal and outputs the signal. It can be seen that the first fiber optic transmission channel 39b and the second fiber optic transmission channel 39c are two independent signal transmission channels, which are described in detail below.

[0141] In one embodiment, when the first image sensor and the second image sensor are 8-channel MIPI interfaces, the first image sensor and the second image sensor output image data to the first data processing device through the 8-channel MIPI interface. After the first data processing device processes the image data acquired by the first image sensor, it converts it into one channel of image data (a first group of image data) and outputs it. Correspondingly, the optical fiber transmission component converts the image data from an electrical signal into an optical signal and transmits it through one optical fiber. After the first data processing device processes the image data acquired by the second image sensor, it converts it into one channel of image data (a second group of image data) and outputs it. Correspondingly, the optical fiber transmission component converts the image data from an electrical signal into an optical signal and transmits it through one optical fiber.

[0142] In another embodiment, when the first image sensor and the second image sensor are 8-channel MIPI interfaces, the image sensor outputs image data to the first data processing device through the 8-channel MIPI interface. After the first data processing device processes the image data acquired from the first image sensor, it converts it into two channels of image data (a first group of image data) and outputs it. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through two optical fibers. After the first data processing device processes the image data acquired from the second image sensor, it converts it into two channels of image data (a second group of image data) and outputs it. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through two optical fibers.

[0143] Generally, when there are multiple image sensors, the first data processing device converts the image data of each image sensor into a set of corresponding image data.

[0144] Please refer to Figure 16In some embodiments, the electro-optical converter 31 includes an electro-optical converter 32, and the optoelectronic converter 35 includes an optoelectronic converter 36. The first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c, and a second output end 32d. The optoelectronic converter 36 includes at least a first input end 36a, a second input end 36b, a first output end 36c, and a second output end 36d. The first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the optoelectronic converter 36 via a first optical fiber 39bg. The second output end 32b of the electro-optical converter 32 is connected to the second input end 36b of the optoelectronic converter 36 via a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20.

[0145] Therefore, the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the first set of image data converted into optical signals through its first output end 32c, and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 36a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 36c. Similarly, the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input end 32b, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the second set of image data converted into optical signals through its second output end 32b, and transmits them through the second optical fiber 39cg; the photoelectric converter 36 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 36b, and converts the second set of image data from optical signals to electrical signals for output through its second output end 36d.

[0146] Please refer to Figure 17In some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; the optical-to-electrical converter 35 includes a first optical-to-electrical converter 37 and a first optical-to-electrical converter 38; the first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first optical-to-electrical converter 37 includes a first input end 37a and a first output end 37b; the second optical-to-electrical converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 is connected to the first input end 37a of the first optical-to-electrical converter 37 via a first optical fiber 39bg; and the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second optical-to-electrical converter 38 via a second optical fiber 39cg. The first input terminal 33a of the first electro-optical converter 33 is connected to the first group of data output terminals 20a of the first data processing device 20 , and the second input terminal 34a of the second electro-optical converter 34 is connected to the second group of data output terminals 20b of the first data processing device 20 .

[0147] Therefore, the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg; the first photoelectric converter 37 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 37a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 37b. Similarly, the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input end 34a, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter 34 outputs the second set of image data converted into optical signals through its second output end 34b, and transmits them through the second optical fiber 39cg; the second photoelectric converter 38 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 38a, and converts the second set of image data from optical signals to electrical signals for output through its second output end 38b.

[0148] The above is some description of the optical fiber transmission assembly 30 .

[0149] The second data processing device 40 includes at least a first group of data input terminals 40a and a second group of data input terminals 40b; the second data processing device 40 is used to receive the first group of image data output by the photoelectric converter 20 through its first group of data input terminals 40a, and convert the first group of image data into image data based on the third data communication protocol for output; and the second data processing device 40 is also used to receive the second group of image data output by the photoelectric converter through its second group of data input terminals 40b, and convert the second group of image data into image data based on the third data communication protocol for output.

[0150] In some embodiments, the third data communication protocol is the same as the first data communication protocol. For example, when the image sensor 10 outputs MIPI-compliant image data, the image data converted by the second data processing device 40 is also MIPI-compliant image data. In some embodiments, the third data communication protocol is different from the first data communication protocol, as long as data based on the third data communication protocol can be recognized and processed by the image processing unit.

[0151] In one embodiment, the number of the first group of data input terminals 40a is the same as the number of the first group of data output terminals 20a, and the number of the second group of data input terminals 40b is the same as the number of the second group of data output terminals 20b.

[0152] It can be seen that the first data processing device 20, the optical fiber transmission component 30, and the second data processing device 40 cooperate to transmit the image data generated by the image sensors, such as the first image sensor 11 and the second image sensor 12, for example, to the image processing unit, etc. The image processing unit can be an FPGA or other CPU processing platform. The optical fiber transmission component 30 mainly performs electro-optical conversion, then transmits the signal through the optical fiber, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip matching solution. When designing the product, the first data processing device 20 and the second data processing device 40 include two chips using the chip matching solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used for data transmission between the two chips, that is, the second data communication protocol can be a proprietary data communication protocol, which is provided by the chip supplier.

[0153] In some examples, the first data processing device 20 and the second data processing device 40 use V-by - One signal transmission interface standard, the second data communication protocol is based on V-by - One signal transmission interface standard protocol.

[0154] In some examples, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Furthermore, the first data processing device 20 and the second data processing device 40 utilize the FPD-LINK III / IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III / IV signal transmission interface standard.

[0155] The above is some description of the endoscope data transmission device 400. In other embodiments, the camera unit 320 may also include more than three image sensors, and the transmission principle of the image data may refer to that of two image sensors (the first image sensor 11 and the second image sensor 12).

[0156] The image processing unit 500 can serve as the image processing host of the endoscope camera system. The image processing unit 500 is used to receive and process the image data output by the endoscope data transmission device 400 to generate data for displaying the image. In some embodiments, the image processing unit 500 includes an FPGA or a CPU.

[0157] The display 600 is used to display the data used to display the image.

[0158] The above is a description of the endoscope camera system in some embodiments of the present invention. It should be understood by those skilled in the art that Figures 7 to 17 This is only an example of an endoscopic camera system and does not constitute a limitation of the endoscopic camera system. The endoscopic camera system may include Figures 7 to 17 More or fewer components, or combinations of certain components, or different components may be shown. For example, the endoscope camera system may also include an expander, a smoke control device, input and output devices, a network access device, etc. In addition, Figure 7-17 and Figure 1-6 Components with the same reference numerals may be identical. For details, see Figure 1 -_6 corresponds to the description in the embodiment.

[0159] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, the various operational steps and components used to perform the operational steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0160] Although the principles of this invention have been shown in various embodiments, many modifications of structure, arrangement, proportion, elements, materials and components that are particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments are intended to be included within the scope of this invention.

[0161] The foregoing detailed description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of this disclosure. Therefore, the present disclosure will be considered in an illustrative rather than a restrictive sense, and all such modifications will be included within its scope. Similarly, the advantages, other advantages and solutions to the problems of the various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more specific, should not be interpreted as critical, required or necessary. The term "comprising" and any other variants used in this article are all non-exclusive inclusions, so that a process, method, article or device that includes a list of elements includes not only these elements, but also other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0162] Those skilled in the art will recognize that many changes can be made to the details of the above embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. An image data transmission device for an endoscopic camera system, the image data transmission device being connected to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; characterized in that: include: At least a first image sensor and a second image sensor, wherein the first image sensor and the second image sensor are both configured to generate image data, and the first image sensor and the second image sensor output the image data based on a first data communication protocol through respective data output channels; a first data processing device, the first data processing device being communicatively connected to data output channels of the first image sensor and the second image sensor; the first data processing device comprising at least a first set of data output terminals and a second set of data output terminals; the first data processing device being configured to convert image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert image data output by the second image sensor into a second set of image data based on the second data communication protocol and output the data through the second set of data output terminals; An optical fiber transmission assembly comprising an electro-optical converter, an optical-electrical converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; The electro-optical converter is used to convert the first set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the optical signal to the photoelectric converter via the first optical fiber transmission channel. The photoelectric converter then converts the received first set of image data from an optical signal into an electrical signal and outputs the electrical signal. The electro-optical converter is further configured to convert a second set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the converted signal to the photoelectric converter via the second optical fiber transmission channel. The photoelectric converter then converts the received second set of image data from an optical signal into an electrical signal and outputs the converted signal. The second data communication protocol is different from the first data communication protocol, and the image data based on the second data communication protocol has a signal amplitude required by the electro-optical converter to convert the image data from an electrical signal into an optical signal. A second data processing device includes at least a first group of data input terminals and a second group of data input terminals; the second data processing device is used to receive a first group of image data output by the photoelectric converter through the first group of data input terminals, and convert the first group of image data into image data based on a third data communication protocol for output; and the second data processing device is also used to receive a second group of image data output by the photoelectric converter through the second group of data input terminals, and convert the second group of image data into image data based on a third data communication protocol for output.

2. The image data transmission device according to claim 1, wherein: The first data output terminal and the second data output terminal of the first data processing device adopt the V-by-One signal transmission interface standard, the first data input terminal and the second data input terminal of the second data processing device adopt the V-by-One signal transmission interface standard, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard; Alternatively, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the FPD-LINK signal transmission interface standard, the first group of data input terminals and the second group of data input terminals of the second data processing device adopt the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

3. The image data transmission device according to claim 2, wherein: The first data output terminal and the second data output terminal of the first data processing device adopt the FPD-LINK III signal transmission interface standard, the first data input terminal and the second data input terminal of the second data processing device adopt the FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard; Alternatively, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the FPD-LINK IV signal transmission interface standard, the first group of data input terminals and the second group of data input terminals of the second data processing device adopt the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

4. The image data transmission device according to claim 1, wherein: The third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.

5. The image data transmission device according to any one of claims 1 to 4, wherein: The data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is MIPI CSI protocol.

6. The image data transmission device according to claim 1, wherein: The first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber; The electro-optical converter comprises at least a first input end, a second input end, a first output end, and a second output end; the photoelectric converter comprises at least a first input end, a second input end, a first output end, and a second output end; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter via the first optical fiber; the second output end of the electro-optical converter is connected to the second input end of the photoelectric converter via the second optical fiber; The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the photoelectric converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end; The electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the photoelectric converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

7. The image data transmission device according to claim 1, wherein: The electro-optical converter includes a first electro-optical converter and a second electro-optical converter; the photoelectric converter includes a first photoelectric converter and a second photoelectric converter; The first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber; The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a first output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first electro-optical converter is connected to the first input end of the first photoelectric converter via the first optical fiber; the second output end of the second electro-optical converter is connected to the second input end of the second photoelectric converter via the second optical fiber; The first electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the first photoelectric converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end; The second electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the second photoelectric converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

8. An image data transmission device for an endoscopic camera system, the image data transmission device being connected to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; characterized in that: include: an image sensor, the image sensor being configured to generate and output image data based on a first data communication protocol; a first data processing device, the first data processing device being at least configured to convert the image data output by the image sensor into image data based on a second data communication protocol and output the converted image data; an optical fiber transmission component configured to convert the image data output by the first data processing device from an electrical signal into an optical signal for transmission, and then convert the converted image data from the optical signal into an electrical signal for output; wherein the second data communication protocol is different from the first data communication protocol, and the image data based on the second data communication protocol has a signal amplitude required for the optical fiber transmission component to convert the image data from an electrical signal into an optical signal; a second data processing device for receiving the image data transmitted from the optical fiber transmission component and converting the image data into image data based on a third data communication protocol for output; in: The first data processing device and the second data processing device use a V-by-One signal transmission interface standard, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard; Alternatively, the first data processing device and the second data processing device use the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

9. The image data transmission device according to claim 8, wherein: The first data processing device and the second data processing device use the FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard; Alternatively, the first data processing device and the second data processing device use the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

10. The image data transmission device according to claim 8, wherein: The third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.

11. The image data transmission device according to any one of claims 8 to 10, wherein: The first data communication protocol is the MIPI CSI protocol.

12. The image data transmission device according to claim 8, wherein: The optical fiber transmission component includes an electro-optical converter, an optical fiber transmission channel and an optical-electrical converter; The electro-optical converter receives the image data output by the first data processing device and converts the image data from an electrical signal into an optical signal to output to the optical fiber transmission channel; The optical fiber transmission channel is used to transmit the image data converted into optical signals; the optical fiber transmission channel includes an optical fiber; The photoelectric converter receives the image data converted into an optical signal transmitted through the optical fiber transmission channel, converts the image data from an optical signal into an electrical signal, and outputs the electrical signal.

13. An endoscope camera system, characterized in that: include: Light source department; a light source control unit, configured to control the light source unit to provide light required for imaging; An endoscope comprising an insertion portion capable of being inserted into a living body; A camera unit, the camera unit comprising the image data transmission device according to any one of claims 1 to 12; an image processing unit for receiving and processing image data output by the endoscope data transmission device to generate data for displaying an image; A display is used to display the data used to display the image.

14. The endoscope imaging system according to claim 13, wherein: The image processing unit includes an FPGA or a CPU.

Images