Endoscope camera system and image data transmission device thereof

Abstract

An image data transmission device for an endoscope camera system, used for connecting to an image processing unit (500) in the endoscope camera system to transmit image data to the image processing unit (500); comprising: image sensors (10, 11, 12) for generating and outputting image data based on a first data communication protocol; a first data processing device (20) comprising a programmable logic gate array device, the first data processing device (20) being at least used for converting the image data output by the image sensors (10, 11, 12) into image data based on a second data communication protocol and outputting the image data; the second data communication protocol being different from the first data communication protocol; and an optical fiber transmission component (30) for converting the image data based on the second data communication protocol output by the first data processing device (20) from an electrical signal into an optical signal for transmission, and then converting the optical signal into an electrical signal and outputting the optical signal for processing by the image processing unit (500) and generating data for displaying the image.

Description

Technical Field

[0001] The present invention relates to an endoscope camera system and an image data transmission device thereof. Background Art

[0002] In recent years, endoscopic camera systems have been increasingly used in surgical operations and diagnostic examinations. Endoscopic camera systems can provide doctors with images of the inside of the human body, allowing doctors to perform operations or examinations stably and correctly through the images.

[0003] The resolution of endoscope camera systems has evolved from high definition (HD) to full high definition (FHD) and then to ultra high definition (UHD), or in other words, from 1K to 2K and finally to 4K. While resolution continues to improve, many technical challenges remain to be resolved.

[0004] For example, as the resolution of endoscopic camera systems continues to improve, the amount of data collected by the sensors that collect image data is also increasing. The collected data needs to be transmitted to the host of the endoscopic camera system through a transmission cable assembly for processing. In order to ensure real-time and display efficiency, this requires the transmission cable assembly to be able to transmit large amounts of data at high speed and have good anti-interference capabilities.

[0005] Currently, image data in endoscope camera systems is transmitted from the sensor to the image processing host through multi-channel twisted pair cables. This has many disadvantages, such as the overall cable being too thick, poor anti-interference capabilities, and usually unable to meet the real-time transmission requirements of high-resolution image data. SUMMARY OF THE INVENTION

[0007] Technical issues

[0008] Solution to the problem

[0009] Technical Solutions

[0010] An image data transmission device for an endoscopic camera system, the image data transmission device being used to connect to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; the image data transmission device comprising:

[0011] At least a first image sensor and a second image sensor, wherein the first image sensor and the second image sensor are both configured to generate image data; the first image sensor and the second image sensor output the image data based on a first data communication protocol through respective data output channels;

[0012] a first data processing device, the first data processing device comprising a programmable logic gate array device including at least a first set of data output terminals and a second set of data output terminals; the first data processing device is configured to convert image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert image data output by the second image sensor into a second set of image data based on a second data communication protocol and output the data through the second set of data output terminals; the second data communication protocol being different from the first data communication protocol;

[0013] An optical fiber transmission component includes an electro-optical converter, a photoelectric converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; the electro-optical converter is used to convert a first set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the first set of image data to the photoelectric converter via the first optical fiber transmission channel, and the photoelectric converter then converts the received first set of image data from an optical signal into an electrical signal and outputs the signal; the electro-optical converter is also used to convert a second set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the second set of image data to the photoelectric converter via the second optical fiber transmission channel, and the photoelectric converter then converts the received second set of image data from an optical signal into an electrical signal and outputs the signal; wherein the first set of image data and the second set of image data output by the photoelectric converter are used by the image processing unit to process and generate data for displaying images.

[0014] In one embodiment, the data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is MIPI CSI protocol.

[0015] In one embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required for the electro-optical converter to convert the image data from an electrical signal to an optical signal.

[0016] In one embodiment, the second data communication protocol can be directly recognized by the image processing unit.

[0017] In one embodiment, the image data transmission device further includes a first bridge circuit connected between the first image sensor and the first data processing device and / or a second bridge circuit connected between the second image sensor and the first data processing device.

[0018] In one embodiment, the data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the first image sensor, and the data output channel of the second bridge circuit has a lower data transmission rate than the data output channel of the second image sensor.

[0019] In one embodiment, the first bridge circuit includes more data output channels than the first image sensor, and the second bridge circuit includes more data output channels than the second image sensor.

[0020] In one embodiment, the first bridge circuit and the second bridge circuit are used to convert image data based on a first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

[0021] In one embodiment, the image data transmission device also includes a third bridge circuit and / or a fourth bridge circuit connected between the optical fiber transmission component and the image processing unit; the third bridge circuit is used to convert a first set of image data based on the second data communication protocol into image data based on a fourth data communication protocol, and the fourth bridge circuit is used to convert a second set of image data based on the second data communication protocol into image data based on a fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol.

[0022] In one embodiment, the first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

[0023] The electro-optical converter comprises at least a first input end, a second input end, a first output end, and a second output end; the photoelectric converter comprises at least a first input end, a second input end, a first output end, and a second output end; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter via the first optical fiber; the second output end of the electro-optical converter is connected to the second input end of the photoelectric converter via the second optical fiber;

[0024] The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the electro-optical converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end;

[0025] The electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the electro-optical converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

[0026] In one embodiment, the electro-optical converter includes a first electro-optical converter and a second electro-optical converter; the optical-to-electrical converter includes a first optical-to-electrical converter and a second optical-to-electrical converter; the first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

[0027] The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a first output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first electro-optical converter is connected to the first input end of the first photoelectric converter via the first optical fiber; the second output end of the second electro-optical converter is connected to the second input end of the second photoelectric converter via the second optical fiber;

[0028] The first electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted first set of image data through the first optical fiber; the first electro-optical converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted first set of image data through its first output end;

[0029] The second electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the second electro-optical converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

[0030] An image data transmission device for an endoscopic camera system, the image data transmission device being used to connect to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; the image data transmission device comprising:

[0031] an image sensor, the image sensor being configured to generate and output image data based on a first data communication protocol;

[0032] a first data processing device, the first data processing device comprising a programmable logic gate array device, the first data processing device being configured to at least convert image data output by the image sensor into image data based on a second data communication protocol and output the image data; the second data communication protocol being different from the first data communication protocol;

[0033] An optical fiber transmission component is used to convert the image data based on the second data communication protocol output by the first data processing device from an electrical signal into an optical signal for transmission, and then convert the optical signal into an electrical signal and output it for processing by the image processing unit to generate data for displaying the image.

[0034] In one embodiment, the data output channel of the image sensor is a MIPI CSI interface, and the first data communication protocol is a MIPI CSI protocol.

[0035] In one embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required for the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

[0036] In one embodiment, the second data communication protocol can be directly recognized by the image processing unit.

[0037] In one embodiment, the image data transmission device further includes a first bridge circuit connected between the image sensor and the first data processing device.

[0038] In one embodiment, a data output channel of the first bridge circuit has a lower data transmission rate than a data output channel of the image sensor.

[0039] In one embodiment, the first bridge circuit includes more data output channels than the image sensor.

[0040] In one embodiment, the first bridge circuit is used to convert image data based on a first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

[0041] In one embodiment, the image data transmission device also includes a third bridge circuit connected between the optical fiber transmission component and the image processing unit, and the third bridge circuit is used to convert image data based on the second data communication protocol into image data based on a fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol.

[0042] In one embodiment, the optical fiber transmission component includes an electro-optical converter, an optical fiber transmission channel, and an optical-electrical converter;

[0043] The electro-optical converter receives the image data output by the first data processing device and converts the image data from an electrical signal into an optical signal to output to the optical fiber transmission channel;

[0044] The optical fiber transmission channel is used to transmit the image data converted into optical signals; the optical fiber transmission channel includes an optical fiber;

[0045] The photoelectric converter receives the image data of the optical signal transmitted by the optical fiber transmission channel, converts the image data from the optical signal into an electrical signal, and then outputs the electrical signal.

[0046] An endoscope camera system, comprising:

[0047] Light source department;

[0048] a light source control unit, configured to control the light source unit to provide light required for imaging;

[0049] An endoscope comprising an insertion portion capable of being inserted into a living body;

[0050] A camera unit, the camera unit including the image data transmission device according to any one of the above embodiments;

[0051] an image processing unit, configured to receive and process the image data output by the image data transmission device to generate data for displaying an image;

[0052] A display is used to display the data used to display the image.

[0053] In one embodiment, the image processor includes a programmable logic gate array or a central processing unit.

[0054] Advantageous Effects of the Invention

[0055] Brief description of the accompanying drawings BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 A schematic structural diagram of an image data transmission device according to an embodiment;

[0057] Figure 2 A schematic structural diagram of an image data transmission device according to an embodiment;

[0058] Figure 3 A schematic structural diagram of an image data transmission device according to an embodiment;

[0059] Figure 4 A schematic structural diagram of an image data transmission device according to an embodiment;

[0060] Figure 5 A schematic structural diagram of an image data transmission device according to an embodiment;

[0061] Figure 6 A schematic structural diagram of an image data transmission device according to an embodiment;

[0062] Figure 7 A schematic structural diagram of an image data transmission device according to an embodiment;

[0063] Figure 8 A schematic structural diagram of an image data transmission device according to an embodiment;

[0064] Figure 9 A schematic structural diagram of an image data transmission device according to an embodiment;

[0065] Figure 10 A schematic structural diagram of an image data transmission device according to an embodiment;

[0066] Figure 11 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0067] Figure 12 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0068] Figure 13 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0069] Figure 14 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0070] Figure 15 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0071] Figure 16 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0072] Figure 17 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0073] Figure 18 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0074] Figure 19 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0075] Figure 20 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0076] Figure 21 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0077] Figure 22 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0078] Figure 23 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0079] Figure 24 Schematic diagram of the structure of an endoscope camera system according to an embodiment;

[0080] Figure 25 Schematic diagram of the structure of an endoscope camera system according to an embodiment.

[0081] Invention Embodiments

[0082] Modes for Carrying Out the Invention

[0083] The present invention will be further described in detail below by means of specific embodiments in conjunction with the accompanying drawings. Similar elements in different embodiments are numbered with associated similar elements. In the following embodiments, many detailed descriptions are provided to enable the present application to be better understood. However, those skilled in the art will readily appreciate that some of the features may be omitted in different circumstances, or may be replaced by other elements, materials, or methods. In some cases, some operations related to the present application are not shown or described in the specification. This is to avoid the core portion of the present application being overwhelmed by excessive descriptions, and for those skilled in the art, it is not necessary to describe these related operations in detail. They will fully understand the related operations based on the description in the specification and the general technical knowledge in the art.

[0084] In addition, the features, operations, or characteristics described in the specification may be combined in any appropriate manner to form various embodiments. Furthermore, the steps or actions in the method description may be reordered or adjusted in a manner readily apparent to those skilled in the art. Therefore, the various sequences in the specification and drawings are provided solely for the purpose of clearly describing a particular embodiment and are not intended to be mandatory, unless otherwise specified.

[0085] The serial numbers assigned to components herein, such as "first," "second," etc., are used solely to distinguish the objects being described and do not convey any sequential or technical meaning. References to "connection" and "coupling" herein, unless otherwise specified, include both direct and indirect connections (couplings).

[0086] As mentioned above, the performance of the current image data acquisition and transmission solutions of endoscopic camera systems is difficult to meet the requirements of high-definition or even 4K real-time video.

[0087] First, current 4K image sensors generally use image sensors with a sub-LVDS interface, and image sensors with the better-performing MIPI CSI interface cannot be selected. This is because the image acquisition portion (camera / camera handle) of the endoscope camera system is constrained by size and power consumption. Image sensors with the better-performing MIPI CSI interface typically have four data channels, which makes the rate of a single channel higher, usually exceeding 1.5Gbps. Image sensors with a sub-LVDS interface typically have 8-10 data channels. Therefore, when the number of data channels is the same, the rate of a single channel of an image sensor with a sub-LVDS interface can be greatly reduced, for example, less than 1Gbps. Therefore, current endoscope camera systems cannot directly choose image sensors with interfaces such as MIPI CSI for image acquisition.

[0088] Secondly, for 4K image sensors, the amount of data collected and to be transmitted is very large. In order to ensure real-time performance, the image data collected by the image sensor needs to be transmitted to the image processing host at high speed. However, the current image data transmission method such as multi-channel twisted pair cables cannot meet this high-speed real-time transmission requirements, and the anti-interference ability is poor, and the cables are relatively thick.

[0089] Considering the large resolution, such as 4K endoscopic camera system, there are still many technical problems to be solved. The applicant has studied one or more of these technical problems and proposed some solutions, which are described in detail below.

[0090] Some embodiments provide an image data transmission device. The image data transmission device of the present invention can be used in applications and products such as endoscopic camera systems. The image data transmission device of the present invention can be connected to an image processing unit in an endoscopic camera system, such as an image processing host, to transmit image data to the image processing unit. The image data transmitted to the image processing unit can then be processed by the image processing unit to generate data for displaying an image. The image data transmission device can include one or more image sensors, as described below in different scenarios.

[0091] Please refer to Figure 1 In some embodiments, the image data transmission device includes an image sensor 10, a first data processing device 20, and an optical fiber transmission component 30, which are described in detail below.

[0092] Image sensor 10 is configured to generate and output image data based on a first data communication protocol. In some embodiments, image sensor 10 includes at least two data output channels, such as 10a and 10b, through which the image sensor outputs image data. Image sensor 10 can generate image data in a format that can be processed by an application processor (AP), which serves as a CPU in a mobile device.

[0093] The first data processing device 20 includes a programmable logic gate array device, and is used to convert the image data output by the image sensor 10 into image data based on a second data communication protocol and output the converted image data. The second data communication protocol is different from the first data communication protocol.

[0094] The optical fiber transmission assembly 30 is used to convert the image data based on the second data communication protocol output by the first data processing device 20 from an electrical signal into an optical signal for transmission. The optical signal is then converted back into an electrical signal and output for processing by the image processing unit to generate data for image display. The optical fiber transmission assembly 30 serves only as a transparent transmission channel and is not involved in protocol packaging and depacketization.

[0095] In one embodiment, the image sensor 10 can generate image data in accordance with the MIPI (Mobile Industry Processor Interface) specification. For example, the image sensor's data output channel is a MIPI CSI interface, and the first data communication protocol is the MIPI CSI protocol. Specifically, the image sensor's data output channel can be a MIPI CSI-2 interface. MIPI is an alliance established in 2003 by companies including ARM (UK), Nokia (Finland), STMicroelectronics (ST), and Texas Instruments (TI) of the United States. Its goal is to standardize internal mobile phone interfaces, such as camera, display, and RF / baseband interfaces, thereby reducing the complexity and increasing design flexibility of mobile phone designs. The MIPI Alliance has different working groups that define a series of internal mobile phone interface standards, such as the CSI (Camera Serial Interface), DSI (Display Serial Interface), DigRF (Radio Frequency), and SLIMbus (Microphone / Speaker Bus). The end market demands lower power consumption, higher data rates, and smaller PCB footprints. Among the several currently used standard-based serial differential interfaces, the MIPI interface is suitable for power-sensitive devices that also require high performance. As mentioned above, CSI is an interface standard specified by the Camera Working Group of the MIPI Alliance. CSI-2 is the second version of MIPI CSI, consisting primarily of the application layer, protocol layer, and physical layer. It typically supports four-lane data transmission at single-line speeds up to 1Gb / s, and also supports eight-lane data transmission. In addition to the ground line, the MIPI CSI-2 interface generally has one pair of I2C communication pins, one pair of MIPI differential clock pins, and one to four pairs of MIPI differential data signal pins.

[0096] Typically, endoscope cameras are handheld, allowing surgeons to adjust viewing areas and control parameters during surgery. Image sensors transmit large amounts of data, requiring high transmission power and generating significant heat. Cameras must be designed to be low-power and generate minimal heat. Image sensors with MIPI interfaces offer low power consumption, precisely meeting these requirements.

[0097] Therefore, in order to reduce the power consumption of related devices, this embodiment adopts an image sensor with a MIPI CSI interface with lower power consumption. However, since the optical fiber transmission component has requirements for the signal swing of the image data when converting the image data from an electrical signal to an optical signal. For example, when the optical fiber transmission component converts the data from an electrical signal to an optical signal, it usually requires that the lower limit of the signal swing of the data be 200mv, while the signal swing of MIPI CSI data is usually less than 200mv. Coupled with the loss during the transmission process, it is impossible to support the optical fiber transmission component to convert it from an electrical signal to an optical signal. Therefore, in this embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has the signal amplitude required by the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

[0098] In one embodiment, since the first data processing device 20 includes a programmable logic gate array device, the second data communication protocol can be a private protocol, that is, a protocol standard defined within the enterprise.

[0099] In one embodiment, the second data communication protocol can be directly recognized by the image processing unit. Typically, if the second data communication protocol is proprietary, the image data transmitted via the optical fiber transmission component can be directly processed by the image processing unit without further protocol conversion. In other words, the optical fiber transmission component 30 can directly connect to the image processing unit and output data to the image processing unit for processing, without requiring protocol conversion by the data processing device.

[0100] Please refer to Figure 2 In some embodiments, the optical fiber transmission component 30 may include an electro-optical converter 32, an optical fiber transmission channel 39a, and an optical-electrical converter 36. The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from an electrical signal into an optical signal, which is then output to the optical fiber transmission channel 39a. The optical fiber transmission channel 39a is used to transmit the image data converted into an optical signal. In some examples, the optical fiber transmission channel 39a includes an optical fiber. The optical-electrical converter 36 receives the image data converted into an optical signal transmitted by the optical fiber transmission channel 39a, and converts the image data from an optical signal into an electrical signal, which is then output to the image processing unit.

[0101] In one embodiment, when the image sensor has an 8-lane MIPI interface, the image sensor outputs image data via the 8-lane MIPI interface to the first data processing device. The first data processing device processes the acquired image data, converts it into one channel of image data, and outputs it. Correspondingly, the optical fiber transmission component converts the image data from an electrical signal into an optical signal and transmits it via one optical fiber.

[0102] In another embodiment, when the image sensor has an 8-lane MIPI interface, the image sensor outputs image data to the first data processing device via the 8-lane MIPI interface. The first data processing device processes the acquired image data, converts it into two channels of image data, and outputs them. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, which are then transmitted via two optical fibers.

[0103] Typically, the number of channels of the image data output by the first data processing device is less than the number of channels of the image data input.

[0104] One data output channel of the image sensor 10 may correspond to one pin of the image sensor 10 or to multiple pins (e.g., two) of the image sensor 10. Since the image data generated by the image sensor is large and difficult to output through a single data output channel, the generated image data is typically output through multiple data output channels to reduce the rate of each output channel. Furthermore, reducing the rate of each output channel allows for a wider range of adaptation to the data processing capability and power consumption requirements of the next-level processing unit (e.g., the first data processing device 20).

[0105] Typically, the image sensor is set on the camera (camera handle). Due to the size and power consumption requirements of the camera, if the image sensor with the MIPI interface is directly used, its subsequent data processing unit, such as the first data processing device, may not have sufficient performance to receive and process the high-speed image data output by the image sensor. Therefore, in some embodiments, the image data transmission device may further include one or more bridge circuits, such as the first bridge circuit 41 ( Figure 3 ) and / or the third bridge circuit 43 ( Figure 4 The main function of the first bridge circuit is to reduce the data transmission rate. That is, the data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the image sensor to adapt to the subsequent data processing unit, such as the first data processing device.

[0106] In one embodiment, the first bridge circuit includes more data output channels than the image sensor.

[0107] In one embodiment, the first bridge circuit is used to convert image data based on the first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol. For example, 4-channel MIPI format data is converted into 8-channel Sub-LVDS or LVDS format data and then output to convert high-speed MIPI data into low-speed Sub-LVDS data. LVDS (Low Voltage Differential Signaling) interface is also known as RS-644 bus interface; LVDS is a low voltage differential signal, which is a differential signal technology with low power consumption, low bit error rate, low crosstalk and low radiation. This transmission technology can reach more than 155Mbps. The core of LVDS technology is to use extremely low voltage swing to transmit data at high speed differentially. LVDS was originally proposed by National Semiconductor as a high-speed signal transmission standard. Subsequently, LVDS was defined in two standards: IEEE P1996.3 (approved in March 1996), primarily for the SCI (Scalable Coherent Interface) protocol. It defines the electrical characteristics of LVDS and the encoding used for packet switching within the SCI protocol; and ANS / EIA / EIA-644 (approved in November 1995), which primarily defines the electrical characteristics of LVDS and recommends parameters such as the maximum transmission rate and theoretical limit rate. The LVDS standard commonly referred to is the latter. ANS / EIA / EIA-644 was revised and published in 2001. The LVDS standard defined in ANS / EIA / EIA-644 has a theoretical limit rate of 1.923 Gbps. Its constant current source mode and low-swing output operation contribute to its high-speed drive capability. Sub-LVDS, a development of LVDS, utilizes a low-swing current-mode transmission system. Compared to traditional voltage-mode transmission, while achieving nearly identical performance, it can operate with significantly lower noise tolerance and swing, thanks to its improved immunity to power supply noise. The primary challenge in designing an efficient current-mode circuit is static power consumption, but this is less of a problem in ultra-high-speed networks, where dynamic power consumption often plays a major role. Furthermore, a more advanced process is employed, reducing the supply voltage from 2.5V to 1.8V and the output voltage swing from 350mV to 150mV, resulting in lower power consumption and higher transmission rates. Sub-LVDS typically supports 8-10 channels of data transmission.

[0108] In some embodiments, such as Figure 4 As shown, the image data transmission device also includes a third bridge circuit 43 connected between the optical fiber transmission component and the image processing unit. The third bridge circuit is used to convert image data based on the second data communication protocol into image data based on a fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol. Generally, since the image data processing unit is often located within the camera host, the camera host has less stringent requirements on size and power consumption than the camera. Therefore, the main function of the third bridge circuit is to convert the data protocol format to adapt the protocol format requirements of the image data received by the image data processing unit. For example, it can convert MIPI format data into Sub-LVDS format data.

[0109] Please refer to Figure 5 In some embodiments, the image data transmission device includes multiple image sensors, such as a first image sensor 11 and a second image sensor 12. The image data transmission device also includes a first data processing device 20 and an optical fiber transmission assembly 30, as described in detail below. It should be noted that while the figure illustrates an example of an image data transmission device including two image sensors, this does not necessarily limit the number of image sensors to two. In actual practice, N image sensors can be configured as needed, where N can be 2 or an integer greater than 2.

[0110] The first image sensor 11 and the second image sensor 12 are both configured to generate image data. The first image sensor and the second image sensor output image data based on a first data communication protocol via respective data output channels. In one embodiment, the first image sensor 11 and the second image sensor 12 each include at least two data output channels, such as 10a and 10b, and the first image sensor 11 and the second image sensor 12 output image data via their respective at least two data output channels. For example, the first image sensor 11 outputs image data via its at least two data output channels, such as 10a and 10b, and the first image sensor 12 outputs image data via its at least two data output channels, such as 10a and 10b.

[0111] The first data processing device 20 includes a programmable logic gate array device, which includes at least a first set of data output terminals 20a and a second set of data output terminals 20b; the first data processing device 20 is used to convert the image data output by the first image sensor into a first set of image data based on a second data communication protocol and output it through the first set of data output terminals, and to convert the image data output by the second image sensor into a second set of image data based on a second data communication protocol and output it through the second set of data output terminals; the second data communication protocol is different from the first data communication protocol.

[0112] It should be noted that the first data output terminal 20a and the second data output terminal 20b can be one output terminal or multiple output terminals. Correspondingly, the first image data and the second image data can be one channel of image data or multiple channels of image data.

[0113] Please refer to Figure 6 The optical fiber transmission assembly 30 includes an electro-optical converter 31, an optical-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c. The electro-optical converter 31 is used to convert the first set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the converted data to the optical-electrical converter 35 via the first optical fiber transmission channel 39b. The optical-electrical converter 35 then converts the received first set of image data from the optical signal into an electrical signal and outputs the converted data. The electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the converted data to the optical-electrical converter 35 via the second optical fiber transmission channel 39c. The optical-electrical converter 35 then converts the received second set of image data from the optical signal into an electrical signal and outputs the converted data. The first set of image data and the second set of image data output by the optical-electrical converter 35 are used by the image processing unit to process and generate data for displaying an image.

[0114] In one embodiment, the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.

[0115] Please refer to Figure 7In some embodiments, the first fiber optic transmission channel 39b includes a first optical fiber 39bg, and the second fiber optic transmission channel 39c includes a second optical fiber 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c, and a second output end 32d; the optical-to-electrical converter 36 includes at least a first input end 36a, a second input end 36b, a first output end 36c, and a second output end 36d. The first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the optical-to-electrical converter 36 via a first optical fiber 39bg; the second output end 32b of the electro-optical converter 32 is connected to the second input end 36b of the optical-to-electrical converter 36 via a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20.

[0116] Therefore, the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the first set of image data converted into optical signals through its first output end 32c, and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 36a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 36c. Similarly, the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input end 32b, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the second set of image data converted into optical signals through its second output end 32b, and transmits them through the second optical fiber 39cg; the photoelectric converter 36 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 36b, and converts the second set of image data from optical signals to electrical signals for output through its second output end 36d.

[0117] Please refer to Figure 8In some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; the optical-to-electrical converter 35 includes a first optical-to-electrical converter 37 and a first optical-to-electrical converter 38; the first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first optical-to-electrical converter 37 includes a first input end 37a and a first output end 37b; the second optical-to-electrical converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 is connected to the first input end 37a of the first optical-to-electrical converter 37 via a first optical fiber 39bg; and the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second optical-to-electrical converter 38 via a second optical fiber 39cg. The first input terminal 33a of the first electro-optical converter 33 is connected to the first group of data output terminals 20a of the first data processing device 20 , and the second input terminal 34a of the second electro-optical converter 34 is connected to the second group of data output terminals 20b of the first data processing device 20 .

[0118] Therefore, the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg; the first photoelectric converter 37 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 37a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 37b. Similarly, the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input end 34a, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter 34 outputs the second set of image data converted into optical signals through its second output end 34b, and transmits them through the second optical fiber 39cg; the second photoelectric converter 38 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 38a, and converts the second set of image data from optical signals to electrical signals for output through its second output end 38b.

[0119] The above is some description of the optical fiber transmission assembly 30 .

[0120] In one embodiment, the data output channels of the first and second image sensors are MIPI CSI interfaces, and the first data communication protocol is the MIPI CSI protocol. Specifically, the data output channels of the first and second image sensors may be MIPI CSI-2 interfaces. MIPI is an alliance established in 2003 by companies such as ARM of the UK, Nokia of Finland, STMicroelectronics of Switzerland, and Texas Instruments of the United States. Its goal is to standardize internal mobile phone interfaces, such as camera, display, and RF / baseband interfaces, thereby reducing the complexity and increasing design flexibility of mobile phones. The MIPI Alliance has different working groups that define a series of internal mobile phone interface standards, such as the Camera Serial Interface (CSI), Display Serial Interface (DSI), DigRF, and SLIMbus. The terminal market requires lower power consumption, higher data rates, and smaller PCB footprints. Among the several currently used standard-based serial differential interfaces, the MIPI interface is suitable for power-sensitive devices that also require high performance. As mentioned above, CSI is an interface standard specified by the Camera Working Group of the MIPI Alliance. CSI-2 is the second version of MIPI CSI, consisting primarily of the application layer, protocol layer, and physical layer. It typically supports four-lane data transmission at single-line speeds up to 1Gb / s, and also supports eight-lane data transmission. In addition to the ground line, the MIPI CSI-2 interface generally has one pair of I2C communication pins, one pair of MIPI differential clock pins, and one to four pairs of MIPI differential data signal pins.

[0121] Typically, endoscope cameras are handheld, allowing surgeons to adjust viewing areas and control parameters during surgery. Image sensors transmit large amounts of data, requiring high transmission power and generating significant heat. Cameras must be designed to be low-power and generate minimal heat. Image sensors with MIPI interfaces offer low power consumption, precisely meeting these requirements.

[0122] Therefore, in order to reduce the power consumption of related devices, this embodiment adopts an image sensor with a MIPI CSI interface with lower power consumption. However, since the optical fiber transmission component has requirements for the signal swing of the image data when converting the image data from an electrical signal to an optical signal. For example, when the optical fiber transmission component converts the data from an electrical signal to an optical signal, it usually requires that the lower limit of the signal swing of the data be 200mv, while the signal swing of MIPI CSI data is usually less than 200mv. Coupled with the loss during the transmission process, it is impossible to support the optical fiber transmission component to convert it from an electrical signal to an optical signal. Therefore, in this embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has the signal amplitude required by the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

[0123] In one embodiment, since the first data processing device 20 includes a programmable logic gate array device, the second data communication protocol can be a private protocol, that is, a protocol standard defined within the enterprise.

[0124] In one embodiment, the second data communication protocol can be directly recognized by the image processing unit. Generally, if the second data communication protocol is a proprietary protocol, the image data transmitted via the optical fiber transmission component can be directly processed by the image processing unit without further protocol conversion.

[0125] In some embodiments, the image data transmission device may further include one or more bridge circuits, such as a first bridge circuit 41 and / or a second bridge circuit 42. The bridge circuits function to reduce the data transmission rate, i.e., the data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the first image sensor, and the data output channel of the second bridge circuit has a lower data transmission rate than the data output channel of the second image sensor.

[0126] In one embodiment, the first bridge circuit includes more data output channels than the first image sensor, and the second bridge circuit includes more data output channels than the second image sensor.

[0127] In one embodiment, the first bridge circuit and the second bridge circuit are used to convert image data based on a first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

[0128] For example, the first and second bridge circuits convert the input image data into data formats such as Sub-LVDS or LVDS, and then output it. The LVDS (Low Voltage Differential Signaling) interface, also known as the RS-644 bus interface, is a differential signaling technology that offers low power consumption, low bit error rate, low crosstalk, and low radiation. This transmission technology can achieve speeds exceeding 155Mbps. The core of LVDS technology is the use of extremely low voltage swings for high-speed differential data transmission.

[0129] Figure 9 This is an example including a first bridge circuit 41 and a second bridge circuit 42 .

[0130] like Figure 10 As shown, in one embodiment, the image data transmission device further includes a third bridge circuit 43 and / or a fourth bridge circuit 44 connected between the optical fiber transmission component and the image processing unit; the third bridge circuit 43 is configured to convert the first set of image data based on the second data communication protocol into image data based on a fourth data communication protocol, and the fourth bridge circuit 44 is configured to convert the second set of image data based on the second data communication protocol into image data based on the fourth data communication protocol; the fourth data communication protocol is different from the first and second data communication protocols, and has a lower data transmission rate than the second data communication protocol. In one embodiment, the fourth data communication protocol may be a proprietary protocol.

[0131] The image data transmission device provided in the embodiment of the present application performs a communication protocol conversion on the image data output by the image sensor through the first data processing device, so that the selection of image sensors is wider during product design, for example, a low-power, high-speed MIPI interface image sensor can be used.

[0132] The image data transmission device of the present invention can be applied to occasions and products such as endoscope camera systems, and the following description will be made using the application in endoscope camera occasions as an example.

[0133] Please refer to Figure 11 、 Figure 12 and Figure 13 In some embodiments, the endoscope camera system includes a light source unit 100, a light source control unit 200, an endoscope 300, a camera unit 320, an endoscope data transmission device 400, an image processing unit 500 and a display 600, which are described in detail below.

[0134] The light source unit 100 is used to provide an illumination source to the part to be observed. The light source unit 100 can provide the light required for ordinary light imaging, and can also provide the light required for special light imaging. For example, the illumination source provided by the light source unit 100 to the part to be observed can be ordinary light illumination based on wide-band light or special light illumination based on narrow-band light. The endoscope system generates a color image in ordinary illumination mode, and in special illumination mode, it first generates a monochrome image with a vascular enhancement effect, and then generates a color image based on the grayscale value of the monochrome image. It can be understood that this color image generated from a monochrome image, such as a grayscale image, is a pseudo-color image, that is, the special light image is a pseudo-color image at this time.

[0135] In some embodiments, the light source unit 100 may include a first light source 110 and a second light source 120. In normal illumination mode, the first light source 110 may provide multiple monochromatic lights of different wavelength ranges in a time-sharing manner. For example, the first light source 110 may be a semiconductor light source or an LED light source, and the monochromatic light provided may be blue light, green light, red light, etc. In other embodiments, the first light source 110 may also provide a combination of the multiple monochromatic lights, or a wide-spectrum white light source. The wavelength range of the monochromatic light is approximately 400nm to 700nm. In special illumination mode, the second light source 120 provides narrowband light. For example, the second light source 120 may be a laser that emits narrowband blue laser light, and the peak wavelength of the blue light is at least one value within the range of 390nm-460nm. In other embodiments, the second light source 120 may also be an LED light source or a laser LED, and the narrowband light emitted may be a narrowband green laser light, etc.

[0136] In some embodiments, the light source unit 100 may further include a dichroic mirror 130. Under the control of the light source control unit 200, the first light source 110 and the second light source 120 operate in a time-sharing manner; that is, when the first light source 110 is turned on, the second light source 120 is turned off. And vice versa. The dichroic mirror 130 is arranged on the transmission optical path of multiple monochromatic lights and narrow-band lights, and the optical paths of the multiple monochromatic lights and the narrow-band lights are combined into the same optical path after passing through the dichroic mirror 130. For example, multiple monochromatic lights can pass through the dichroic mirror 130, and the narrow-band lights can be reflected by the dichroic mirror 130, so that the optical paths of the two are combined into the same optical path; and vice versa. On the optical path after the dichroic mirror 130, the narrow-band lights and the multiple monochromatic lights are transmitted in a time-sharing manner along the combined same optical path toward the endoscope 300.

[0137] In some embodiments, the light source unit 100 further includes a coupling mirror 140 disposed between the dichroic mirror 130 and the light source inlet of the endoscope 300. The coupling mirror 140 focuses the light transmitted from the dichroic mirror 130, thereby better guiding it into the endoscope 300, minimizing light loss and improving the overall illumination quality of the system. The optical path combining function of the dichroic mirror 130 and the focusing function of the coupling mirror 140 both effectively guide light into the endoscope 300. Furthermore, the use of the dichroic mirror 130 can make the overall structure of the light source unit 100 more compact and shorten the light propagation path.

[0138] The above is some description of the light source unit 100. The light source control unit 200 is used to control the light source unit 100, for example, to control the light source unit 100 to provide light required for ordinary light imaging and to control the light source unit 100 to provide light required for special light imaging.

[0139] Endoscope 300 is used to transmit optical signals. In some embodiments, endoscope 300 may include an insertion portion 310. In some embodiments, insertion portion 310 is capable of being inserted into a living body. For example, insertion portion 310 is a portion of the endoscope body that can be inserted into a living body by an operator. Insertion portion 310 is capable of transmitting light generated by light source portion 100 to an inlet portion (which may be a light-guiding optical fiber) at the site to be observed.

[0140] The imaging unit 320 includes at least one sensor for generating image data. For example, in some examples, the imaging unit 320 may include an image sensor 10. In another example, the imaging unit 320 may include a first image sensor 11 and a second image sensor 12. In another example, the imaging unit 320 may include N sensors for generating image data, where N may be an integer greater than 2.

[0141] Please refer to Figure 14 , is an example in which the camera unit 320 includes the image sensor 10. In some examples, the image sensor 10 is used to generate image data. The image sensor 10 can generate image data in accordance with a specification that can be processed by an AP (Application Processor) as a CPU of a mobile device.

[0142] For example, the image sensor 10 may generate image data in accordance with the MIPI (Mobile Industry Processor Interface) specification. Accordingly, the data output channel of the image sensor may be a MIPI CSI-2 interface.

[0143] Please refer to Figure 15, is an example of the first image sensor 11 and the second image sensor 12 of the imaging unit 320. In some examples, the first image sensor 11 and the second image sensor 12 are both used to generate image data.

[0144] The first image sensor 11 and the second image sensor 12 can generate image data in accordance with a specification that can be processed by an AP (Application Processor), which is a CPU in a mobile device. For example, the first image sensor 11 and the second image sensor 12 can generate image data in accordance with the MIPI (Mobile Industry Processor Interface) specification. Accordingly, the data output channels of the image sensors can be MIPI CSI-2 interfaces.

[0145] In some examples, one end of the imaging unit 320 is connected to the endoscope data transmission device 400 to provide image data to the image processing unit 500. One end of the imaging unit 320 can be clipped onto an endoscope, while the light source unit 100 provides light to the endoscope 300, and the imaging unit 320 can acquire optical signals from the endoscope. The endoscope data transmission device 400 is described below.

[0146] The endoscope data transmission device 400 is used to transmit the image data generated by the sensor in the camera unit 320 to the subsequent image processing unit 500 for processing. There are many ways to implement the endoscope data transmission device 400, which are described in detail below.

[0147] Let's take the example of the camera unit 320 including the image sensor 10 to illustrate the structure and function of the endoscope data transmission device 400 in this embodiment. Figure 16 In this case, the endoscope data transmission device 400 may include a first data processing component 20 and an optical fiber transmission component 30.

[0148] The first data processing device 20 includes a programmable logic gate array device, and is used to convert the image data output by the image sensor 10 into image data based on a second data communication protocol and output the converted image data. The second data communication protocol is different from the first data communication protocol.

[0149] The optical fiber transmission component 30 is used to convert the image data based on the second data communication protocol output by the first data processing device 20 from an electrical signal into an optical signal for transmission, and then convert the optical signal into an electrical signal and output it for processing by the image processing unit to generate data for displaying the image.

[0150] Please refer to Figure 17In some embodiments, the optical fiber transmission component 30 may include an electro-optical converter 32, an optical fiber transmission channel 39a, and an optical-electrical converter 36. The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from an electrical signal into an optical signal, which is then output to the optical fiber transmission channel 39a. The optical fiber transmission channel 39a is used to transmit the image data converted into an optical signal. In some examples, the optical fiber transmission channel 39a includes an optical fiber. The optical-electrical converter 36 receives the image data converted into an optical signal transmitted by the optical fiber transmission channel 39a, and converts the image data from an optical signal into an electrical signal before outputting it.

[0151] In some embodiments, the endoscope data transmission device 400 may further include one or more bridge circuits, such as a first bridge circuit 41 ( Figure 18 ) and / or the third bridge circuit 43 ( Figure 19 The bridge circuit is used to reduce the data transmission rate to adapt to subsequent data processing units, such as the first data processing device.

[0152] In one embodiment, the first bridge circuit includes more data output channels than the image sensor.

[0153] In one embodiment, the first bridge circuit is used to convert image data based on the first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

[0154] The third bridge circuit 43 is used to convert image data based on the second data communication protocol into image data based on a fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol.

[0155] Let us take the example of the camera unit 320 including the first image sensor 11 and the second image sensor 12 to explain the structure and function of the endoscope data transmission device 400 in this embodiment. Figure 20 In this case, the endoscope data transmission device 400 may include a first data processing component 20 and an optical fiber transmission component 30.

[0156] The first image sensor 11 and the second image sensor 12 are both used to generate image data; the first image sensor and the second image sensor output the image data based on the first data communication protocol through their respective data output channels.

[0157] The first data processing device 20 comprises a programmable logic gate array device, which includes at least a first set of data output terminals 20a and a second set of data output terminals 20b. The first data processing device 20 is configured to convert image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert image data output by the second image sensor into a second set of image data based on a second data communication protocol and output the data through the second set of data output terminals. The second data communication protocol is different from the first data communication protocol.

[0158] Please refer to Figure 21 The optical fiber transmission assembly 30 includes an electro-optical converter 31, an optical-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c. The electro-optical converter 31 is used to convert the first set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the converted data to the optical-electrical converter 35 via the first optical fiber transmission channel 39b. The optical-electrical converter 35 then converts the received first set of image data from the optical signal into an electrical signal and outputs the converted data. The electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from an electrical signal into an optical signal, and transmit the converted data to the optical-electrical converter 35 via the second optical fiber transmission channel 39c. The optical-electrical converter 35 then converts the received second set of image data from the optical signal into an electrical signal and outputs the converted data. The first set of image data and the second set of image data output by the optical-electrical converter 35 are used by the image processing unit to process and generate data for displaying an image.

[0159] In one embodiment, the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.

[0160] Please refer to Figure 22 In some embodiments, the first fiber optic transmission channel 39b includes a first optical fiber 39bg, and the second fiber optic transmission channel 39c includes a second optical fiber 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c, and a second output end 32d; the optical-to-electrical converter 36 includes at least a first input end 36a, a second input end 36b, a first output end 36c, and a second output end 36d. The first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the optical-to-electrical converter 36 via a first optical fiber 39bg; the second output end 32b of the electro-optical converter 32 is connected to the second input end 36b of the optical-to-electrical converter 36 via a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20.

[0161] Therefore, the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the first set of image data converted into optical signals through its first output end 32c, and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 36a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 36c. Similarly, the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input end 32b, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter 32 outputs the second set of image data converted into optical signals through its second output end 32b, and transmits them through the second optical fiber 39cg; the photoelectric converter 36 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 36b, and converts the second set of image data from optical signals to electrical signals for output through its second output end 36d.

[0162] Please refer to Figure 23 In some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; the optical-to-electrical converter 35 includes a first optical-to-electrical converter 37 and a first optical-to-electrical converter 38; the first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first optical-to-electrical converter 37 includes a first input end 37a and a first output end 37b; the second optical-to-electrical converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 is connected to the first input end 37a of the first optical-to-electrical converter 37 via a first optical fiber 39bg; and the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second optical-to-electrical converter 38 via a second optical fiber 39cg. The first input terminal 33a of the first electro-optical converter 33 is connected to the first group of data output terminals 20a of the first data processing device 20 , and the second input terminal 34a of the second electro-optical converter 34 is connected to the second group of data output terminals 20b of the first data processing device 20 .

[0163] Therefore, the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg; the first photoelectric converter 37 receives the first set of image data converted into optical signals transmitted by the first optical fiber 39bg through its first input end 37a, and converts the first set of image data from optical signals to electrical signals for output through its first output end 37b. Similarly, the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input end 34a, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter 34 outputs the second set of image data converted into optical signals through its second output end 34b, and transmits them through the second optical fiber 39cg; the second photoelectric converter 38 receives the second set of image data converted into optical signals transmitted by the second optical fiber 39cg through its second input end 38a, and converts the second set of image data from optical signals to electrical signals for output through its second output end 38b.

[0164] The above is some description of the optical fiber transmission assembly 30 .

[0165] like Figure 24 As shown, in some embodiments, the endoscope data transmission device 400 may further include one or more bridge circuits, such as a first bridge circuit 41 and / or a second bridge circuit 42. The bridge circuits are used to reduce the data transmission rate, that is, the data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the first image sensor, and the data output channel of the second bridge circuit has a lower data transmission rate than the data output channel of the second image sensor.

[0166] In one embodiment, the first bridge circuit includes more data output channels than the first image sensor, and the second bridge circuit includes more data output channels than the second image sensor.

[0167] In one embodiment, the first bridge circuit and the second bridge circuit are used to convert image data based on a first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

[0168] For example, the first and second bridge circuits convert the input image data into data formats such as Sub-LVDS or LVDS, and then output it. The LVDS (Low Voltage Differential Signaling) interface, also known as the RS-644 bus interface, is a differential signaling technology that offers low power consumption, low bit error rate, low crosstalk, and low radiation. This transmission technology can achieve speeds exceeding 155Mbps. The core of LVDS technology is the high-speed differential transmission of data using extremely low voltage swings.

[0169] like Figure 25 As shown, in one embodiment, the endoscope data transmission device 400 further includes a third bridge circuit 43 and / or a fourth bridge circuit 44 connected between the optical fiber transmission component and the image processing unit. The third bridge circuit 43 is configured to convert the first set of image data based on the second data communication protocol into image data based on a fourth data communication protocol, and the fourth bridge circuit 44 is configured to convert the second set of image data based on the second data communication protocol into image data based on the fourth data communication protocol. The fourth data communication protocol is different from the first and second data communication protocols, and has a lower data transmission rate than the second data communication protocol. In one embodiment, the fourth data communication protocol may be a proprietary protocol.

[0170] The endoscopic camera system provided in the embodiment of the present application performs a communication protocol conversion on the image data output by the image sensor through the first data processing device, so that the choice of image sensors is wider during product design, for example, a low-power, high-speed MIPI interface image sensor can be used.

[0171] The above is some description of the endoscope data transmission device 400. In other embodiments, the camera unit 320 may also include more than three image sensors, and the transmission principle of the image data may refer to that of two image sensors (the first image sensor 11 and the second image sensor 12).

[0172] The image processing unit 500 can serve as an image processing host of the endoscope camera system. The image processing unit 500 is used to receive and process the image data output by the endoscope data transmission device 400 to generate data for displaying the image.

[0173] The display 600 is used to display image data.

[0174] The above is a description of the endoscope camera system in some embodiments of the present invention. It should be understood by those skilled in the art that Figures 11 to 25 This is only an example of an endoscopic camera system and does not constitute a limitation of the endoscopic camera system. The endoscopic camera system may include Figures 11 to 25 More or fewer components, or combinations of certain components, or different components may be shown. For example, the endoscope camera system may also include an expander, a smoke control device, input and output devices, a network access device, etc. In addition, Figure 11-25 and Figure 1-10 Components with the same reference numerals may be identical. For details, see Figure 1-10 Corresponding to the description in the embodiment.

[0175] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, the various operational steps and components used to perform the operational steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0176] Although the principles of this invention have been shown in various embodiments, many modifications of structure, arrangement, proportion, elements, materials and components that are particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments are intended to be included within the scope of this invention.

[0177] The foregoing detailed description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of this disclosure. Therefore, the present disclosure will be considered in an illustrative rather than a restrictive sense, and all such modifications will be included within its scope. Similarly, the advantages, other advantages and solutions to the problems of the various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more specific, should not be interpreted as critical, required or necessary. The term "comprising" and any other variants used in this article are all non-exclusive inclusions, so that a process, method, article or device that includes a list of elements includes not only these elements, but also other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0178] Those skilled in the art will recognize that many changes can be made to the details of the above embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. An image data transmission device for an endoscopic camera system, the image data transmission device being connected to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; characterized in that: The image data transmission device includes: At least a first image sensor and a second image sensor, wherein the first image sensor and the second image sensor are both configured to generate image data; the first image sensor and the second image sensor output the image data based on a first data communication protocol through respective data output channels; a first data processing device, the first data processing device comprising a programmable logic gate array device including at least a first set of data output terminals and a second set of data output terminals; the first data processing device being configured to convert image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert image data output by the second image sensor into a second set of image data based on a second data communication protocol and output the data through the second set of data output terminals; the second data communication protocol being different from the first data communication protocol and being directly recognizable by the image processing unit; An optical fiber transmission component includes an electro-optical converter, a photoelectric converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; the electro-optical converter is used to convert a first set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the first set of image data to the photoelectric converter via the first optical fiber transmission channel, and the photoelectric converter then converts the received first set of image data from an optical signal into an electrical signal and outputs the signal; the electro-optical converter is also used to convert a second set of image data output by the first data processing device from an electrical signal into an optical signal, and transmit the second set of image data to the photoelectric converter via the second optical fiber transmission channel, and the photoelectric converter then converts the received second set of image data from an optical signal into an electrical signal and outputs the signal; wherein the first set of image data and the second set of image data output by the photoelectric converter are used by the image processing unit to process and generate data for displaying images.

2. The image data transmission device according to claim 1, wherein: The data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is the MIPI CSI protocol.

3. The image data transmission device according to claim 2, wherein: The second data communication protocol satisfies that image data based on the second data communication protocol has a signal amplitude required for the electro-optical converter to convert the image data from an electrical signal into an optical signal.

4. The image data transmission device according to any one of claims 1 to 3, wherein: The first data processing device is configured to convert the image data output by the first image sensor into a first set of image data based on a second data communication protocol and output the data through the first set of data output terminals, and to convert the image data output by the second image sensor into a second set of image data based on a second data communication protocol and output the data through the second set of data output terminals, including: The first data processing device is used to convert the image data based on the first data communication protocol output by the first image sensor through its data output channel into a first group of image data based on a second data communication protocol, and output the data through the first group of data output terminals; and to convert the image data based on the first data communication protocol output by the second image sensor through its data output channel into a second group of image data based on the second data communication protocol, and output the data through the second group of data output terminals.

5. The image data transmission device according to any one of claims 1 to 3, wherein: The device further includes a first bridge circuit connected between the first image sensor and the first data processing device and / or a second bridge circuit connected between the second image sensor and the first data processing device.

6. The image data transmission device according to claim 5, wherein: The data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the first image sensor, and the data output channel of the second bridge circuit has a lower data transmission rate than the data output channel of the second image sensor.

7. The image data transmission device according to claim 5, wherein: The first bridge circuit includes more data output channels than the first image sensor, and the second bridge circuit includes more data output channels than the second image sensor.

8. The image data transmission device according to claim 5, wherein: The first bridge circuit and the second bridge circuit are used to convert image data based on a first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

9. The image data transmission device according to any one of claims 1 to 3 and 6 to 8, wherein: It also includes a third bridge circuit and / or a fourth bridge circuit connected between the optical fiber transmission component and the image processing unit; the third bridge circuit is used to convert a first set of image data based on the second data communication protocol into image data based on a fourth data communication protocol, and the fourth bridge circuit is used to convert a second set of image data based on the second data communication protocol into image data based on the fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol.

10. The image data transmission device according to claim 1, wherein: The first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber; The electro-optical converter comprises at least a first input end, a second input end, a first output end, and a second output end; the photoelectric converter comprises at least a first input end, a second input end, a first output end, and a second output end; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter via the first optical fiber; the second output end of the electro-optical converter is connected to the second input end of the photoelectric converter via the second optical fiber; The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted data through the first optical fiber; the electro-optical converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted data through its first output end; The electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the electro-optical converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

11. The image data transmission device according to claim 1, wherein: The electro-optical converter includes a first electro-optical converter and a second electro-optical converter; the photoelectric converter includes a first photoelectric converter and a second photoelectric converter; The first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber; The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a first output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first electro-optical converter is connected to the first input end of the first photoelectric converter via the first optical fiber; the second output end of the second electro-optical converter is connected to the second input end of the second photoelectric converter via the second optical fiber; The first electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals to optical signals; the first electro-optical converter outputs the first set of image data converted into optical signals through its first output end, and transmits the converted first set of image data through the first optical fiber; the first electro-optical converter receives the first set of image data converted into optical signals transmitted by the first optical fiber through its first input end, and converts the first set of image data from optical signals to electrical signals, and outputs the converted first set of image data through its first output end; The second electro-optical converter receives the second set of image data output by the first data processing device through its second input end, and converts the second set of image data from electrical signals to optical signals; the second electro-optical converter outputs the second set of image data converted into optical signals through its second output end, and transmits them through the second optical fiber; the second electro-optical converter receives the second set of image data converted into optical signals transmitted by the second optical fiber through its second input end, and converts the second set of image data from optical signals to electrical signals for output through its second output end.

12. An image data transmission device for an endoscopic camera system, the image data transmission device being connected to an image processing unit in the endoscopic camera system to transmit image data to the image processing unit; characterized in that: The image data transmission device includes: an image sensor, the image sensor being configured to generate and output image data based on a first data communication protocol; a first data processing device, the first data processing device comprising a programmable logic gate array device, the first data processing device being configured to at least convert image data output by the image sensor into image data based on a second data communication protocol and output the converted image data; the second data communication protocol being different from the first data communication protocol and capable of being directly recognized by the image processing unit; An optical fiber transmission component is used to convert the image data based on the second data communication protocol output by the first data processing device from an electrical signal into an optical signal for transmission, and then convert the optical signal into an electrical signal and output it for processing by the image processing unit to generate data for displaying the image.

13. The image data transmission device according to claim 12, wherein: The data output channel of the image sensor is a MIPI CSI interface, and the first data communication protocol is a MIPI CSI protocol.

14. The image data transmission device according to claim 13, wherein: The second data communication protocol satisfies that: the image data based on the second data communication protocol has a signal amplitude required for the optical fiber transmission component to convert the image data from an electrical signal to an optical signal.

15. The image data transmission device according to any one of claims 12 to 14, wherein: The first data processing device is at least used to convert the image data output by the image sensor into image data based on a second data communication protocol and output it, including: the first data processing device is used to convert the image data output by the image sensor based on the first data communication protocol into image data based on a second data communication protocol and output it.

16. The image data transmission device according to any one of claims 12 to 14, wherein: It also includes a first bridge circuit connected between the image sensor and the first data processing device.

17. The image data transmission device according to claim 16, wherein: The data output channel of the first bridge circuit has a lower data transmission rate than the data output channel of the image sensor.

18. The image data transmission device according to claim 16, wherein: The first bridge circuit includes more data output channels than the image sensor.

19. The image data transmission device according to claim 16, wherein: The first bridge circuit is used to convert image data based on the first data communication protocol into image data based on a third data communication protocol; the third data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the third data communication protocol is lower than the data transmission rate of the first data communication protocol.

20. The image data transmission device according to any one of claims 12-14 and 17-19, wherein: It also includes a third bridge circuit connected between the optical fiber transmission component and the image processing unit, and the third bridge circuit is used to convert image data based on the second data communication protocol into image data based on a fourth data communication protocol; the fourth data communication protocol is different from the first data communication protocol and the second data communication protocol, and the data transmission rate of the fourth data communication protocol is lower than the data transmission rate of the second data communication protocol.

21. The image data transmission device according to claim 12, wherein: The optical fiber transmission component includes an electro-optical converter, an optical fiber transmission channel and an optical-electrical converter; The electro-optical converter receives the image data output by the first data processing device and converts the image data from an electrical signal into an optical signal to output to the optical fiber transmission channel; The optical fiber transmission channel is used to transmit the image data converted into optical signals; the optical fiber transmission channel includes an optical fiber; The photoelectric converter receives the image data of the optical signal transmitted by the optical fiber transmission channel, converts the image data from the optical signal into an electrical signal, and then outputs the electrical signal.

22. An endoscope camera system, characterized in that: include: Light source department; a light source control unit, configured to control the light source unit to provide light required for imaging; An endoscope comprising an insertion portion capable of being inserted into a living body; A camera unit, the camera unit comprising the image data transmission device according to any one of claims 1 to 21; an image processing unit, configured to receive and process the image data output by the image data transmission device to generate data for displaying an image; A display is used to display the data used to display the image.

23. The endoscope imaging system according to claim 22, wherein: The image processing unit includes a programmable logic gate array or a central processing unit.

Images