Portable bronchiourinary tract endoscope system

Abstract

The utility model discloses a portable bronchiourinary tube endoscope system, which belongs to the field of endoscopes and comprises a power adapter, an image processor mainboard, a display module, an image sensor, a patient end peripheral module, a peripheral interface and a battery module. The image sensor and the patient end peripheral module are both electrically connected with the image processor mainboard, the display module and the peripheral interface are both electrically connected with the image processor mainboard, and the image processor mainboard is electrically connected with the image processor mainboard; the image processor mainboard comprises an SOC module and an FPGA module. And the SOC module and the FPGA module are connected through an MIPICSI communication mode. According to the utility model, through a two-stage image processing scheme combining the SOC and the FPGA, advantages of the SOC and the FPGA can be fully utilized, disadvantages are avoided, development difficulty is reduced, and development time is saved; therefore, targeted processing of images in different scenes is realized.

Description

Technical Field

[0001] The utility model relates to the field of endoscopes, in particular to a portable broncho-urinary endoscope system. Background Art

[0002] In the medical field, endoscopes are used to observe the internal body cavities of humans. Through them, the tissue morphology of internal organs can be directly observed, which improves the accuracy of diagnosis and becomes a reliable tool for medical diagnosis. With the continuous advancement of technology, the size of CMOS cameras is also shrinking, and the use of endoscopes in the medical field is becoming more and more extensive. Limited by semiconductor technology, the image signal output by the endoscope CMOS often has noise, color aberration, etc. In addition, the image signal transmission distance is often >1m, which requires an efficient and professional image processing system to ensure high-quality, low-latency imaging.

[0003] At present, there are many solutions for endoscopic video stream acquisition and processing, including ARM, FPGA, DSP, dedicated SOC, etc. Each solution has its own advantages and disadvantages. For example, ARM is small in size and low in power consumption, but the design is relatively inflexible, and the code runs in serial mode, which occupies high resources and is inefficient when running complex algorithms; the advantage of the FPGA solution is strong flexibility, and the parallel processing mechanism of FPGA determines that it can still achieve very low latency when the algorithm is very complex, but the design of FPGA is difficult, and the algorithm cycle described by the idea of ​​"digital circuit" is very long, and it is not conducive to maintenance and modification; DSP is a unique microprocessor with its own complete instruction system. The advantages of the DSP solution are flexible design, easy expansion, and strong computing power; the disadvantages are high cost, high design difficulty, and the occupied area and power consumption need to be improved; the advantages of the dedicated SOC solution are small size, high integration, low power consumption, and the IP of various image processing algorithms integrated internally can be directly called. The disadvantage is that it is not flexible enough, and complex image processing algorithms can only call fixed algorithms provided by manufacturers. Therefore, an endoscope system that is relatively flexible, low in resource consumption, easy to maintain and modify, and low in design difficulty is needed. Utility Model Content

[0004] With regard to the above-mentioned problems existing in the prior art, the purpose of the present invention is to provide a portable broncho-urinary endoscope system to solve the problems raised in the above-mentioned background technology.

[0005] In order to achieve the above purpose, the utility model provides the following technical solutions:

[0006] A portable bronchial and urinary tract endoscope system includes a power adapter, an image processor main board, a display module, an image sensor, a patient-side peripheral module, a peripheral interface, and a battery module. The power adapter is electrically connected to the input end of the image processor main board. The image sensor and the patient-side peripheral module are both electrically connected to the image processor main board. The display module and the peripheral interface are both electrically connected to the image processor main board. The image processor main board is electrically connected to the image processor main board;

[0007] The power adapter includes an AC / DC conversion module;

[0008] The image processor main board includes a BMS battery management system, a power supply switching circuit, a first DC-DC circuit, an SOC module, an FPGA module, an audio module, a DC-DC isolation module, a first isolation module, a second isolation module, a second DC-DC circuit, a decoding module, MCU1, a first signal processing module, an LED driving module, a second signal processing module, a third signal processing module, and a fourth signal processing module;

[0009] The input end of the charging management circuit in the BMS battery management system is connected to the circuit point of the AC / DC conversion module in the power adapter. The output end of the charging management circuit is connected to the input end of the discharge management circuit in the BMS battery management system and the battery module. The output end of the charging management circuit and the output end of the discharge management circuit are both connected to the FPGA module. The input end of the charging management circuit and the input end of the discharge management circuit are both connected to the input end of the power supply switching circuit;

[0010] The output end of the power supply switching circuit is connected to the input end of the first DC-DC circuit and the input end of the DC-DC isolation module. The output end of the first DC-DC circuit is electrically connected to the SOC module and the FPGA module. The SOC module and the FPGA module are connected by MIPI_CSI communication. The FPGA module is communicatively connected to the first isolation module and the second isolation module. The second isolation module is communicatively connected to the decoding module. The output end of the DC-DC isolation module is connected to the input end of the second DC-DC circuit. The output end of the second DC-DC circuit is electrically connected to MCU1 and the decoding module; The first isolation module is communicatively connected to MCU1;

[0011] The audio module is connected to the FPGA module.

[0012] As a further solution of the present invention: The SOC module is communicatively connected to the display module. The SOC module includes an SOC, a MIPI_CSI interface module, a MIPI_DSI interface module, an HDMI interface module, an SD card interface module, a USB interface module, a Wifi module, and an Ethernet interface module.

[0013] As a further solution of the utility model: The SOC module is communicatively connected to the peripheral interface through an SD card interface module and a USB interface module.

[0014] As a further solution of the utility model: The decoding module is connected to multiple camera modules in the image sensor.

[0015] As a further solution of the utility model: The MCU 1 is communicatively connected to the patient-side peripheral module.

[0016] As a further solution of the utility model: The patient-side peripheral module includes a handle information storage IC, an angle sensor, an LED, a handle button, a pressure sensor, and a temperature sensor; the handle information storage IC is communicatively connected to the MCU 1; the angle sensor is connected to the input end of the MCU1 through a first signal processing module; the LED is connected to the MCU1 through an LED driving module; the handle button is connected to the input end of the MCU1 through a second signal processing module; the pressure sensor is connected to the input end of the MCU1 through a third signal processing module; the temperature sensor is connected to the input end of the MCU1 through a fourth signal processing module.

[0017] Compared with the prior art, the beneficial effects of the utility model are as follows:

[0018] The FPGA and the dedicated image SOC of the utility model constitute two-level image processing. The two-level image processing scheme combining the dedicated image SOC and the FPGA can make full use of the advantages of both and avoid the disadvantages. The dedicated image SOC integrates various algorithm modules and dedicated IPs inside, which can be directly called, reducing the development difficulty and saving the development time; the rich peripheral resources of the FPGA provide the possibility for the subsequent product upgrade. It simplifies the design of the product electrical system and the patient circuit design; it can effectively avoid the interference introduced by the long-distance transmission of the patient circuit signal to affect the intermediate circuit, so as to realize the targeted processing of images in different scenarios, enhance the rendering effect of local tissue images, and optimize the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is the overall block diagram of a portable bronchial and urinary tract endoscope system disclosed in the embodiment.

[0020] Figure 2 It is the internal circuit diagram of a portable bronchial and urinary tract endoscope system disclosed in the embodiment.

[0021] Figure 3 It is the power supply logic block diagram of the image processor main board in a portable bronchial and urinary tract endoscope system disclosed in the embodiment.

[0022] The reference numerals in the figure are: 1, power adapter; 2, image processor main board; 3, display module; 4, image sensor; 5, patient-side peripheral module; 6, peripheral interface; 7, battery module. Detailed implementation manners

[0023] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention; obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0024] In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, the terms "installed", "provided with", "connected", and "connected" should be understood in a broad sense; for example, it can be a fixed connection, a detachable connection, or an integral connection, it can be a mechanical connection, it can be an electrical connection, it can be directly connected, or it can be indirectly connected through an intermediate medium, and it can be the communication inside two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

[0025] Please refer to Figures 1-3 , a portable bronchial and urinary tract endoscope system, including a power adapter 1, an image processor main board 2, a display module 3, an image sensor 4, a patient-side peripheral module 5, a peripheral interface 6, and a battery module 7. The power adapter 1 is electrically connected to the input end of the image processor main board 2. The image sensor 4 and the patient-side peripheral module 5 are both electrically connected to the image processor main board 2. The display module 3 and the peripheral interface 6 are both electrically connected to the image processor main board 2. The image processor main board 2 is electrically connected to the image processor main board 2.

[0026] The power adapter 1 includes an AC / DC conversion module. The power adapter 1 is used to convert the 100Vac-240Vac AC input from the power grid into a 12Vdc DC voltage and provide it to the image processor main board 2. The power adapter 1 meets the 2xMOPP insulation level requirements.

[0027] The image processor main board 2 includes a BMS battery management system, a power supply switching circuit, a first DC-DC circuit, an SOC module, an FPGA module, an audio module, a DC-DC isolation module, a first isolation module, a second isolation module, a second DC-DC circuit, a decoding module, an MCU1, a first signal processing module, an LED driving module, a second signal processing module, a third signal processing module, and a fourth signal processing module; the image processor main board 2 is the system control core and the image processing center, such as Figure 2as shown

[0028] The input end of the charging management circuit in the BMS battery management system is connected to the circuit point of the AC / DC conversion module in the power adapter 1. The output end of the charging management circuit is electrically connected to the input end of the discharge management circuit and the battery module 7 in the BMS battery management system. The output ends of the charging management circuit and the discharge management circuit are both connected to the FPGA module. The input ends of the charging management circuit and the discharge management circuit are both connected to the input end of the power supply switching circuit. It consists of a charging management circuit and a discharge management circuit: The charging management circuit uses the VCC_12V power input by the power adapter 1 to charge the battery module 7, and during the charging process, it real-time detects the battery state of charge (SOC), voltage (V), and battery temperature (T), and transmits this part of the information to the FPGA module in real-time; the discharge management circuit real-time detects the battery state of charge (SOC), voltage (V), and battery temperature (T) during the battery discharge process, and transmits this part of the information to the FPGA module in real-time. In addition, the FPGA is connected to the charging management circuit and the discharge management circuit to realize real-time state monitoring of the battery module 7, and controls the charge and discharge management circuit to stop working or generate an alarm prompt when the battery state is abnormal.

[0029] The output end of the power supply switching circuit is connected to the input end of the first DC-DC circuit and the input end of the DC-DC isolation module. The power supply switching circuit selects the power supply source for the image processor main board 2 to ensure that only one power supply source is used at the same time. Its power supply selection logic is as Figure 3 shown: When only the battery module 7 is connected, the VCC_BAT generated by the battery module is the power supply source; in the case of the power adapter 1 being connected, the power supply switching circuit selects the VCC_12V generated by the power adapter 1 as the power supply source.

[0030] The output end of the first DC-DC circuit is electrically connected to the SOC module and the FPGA module. The DC-DC circuit 1 converts the voltage VCC1 output by the power supply switching circuit to provide energy for the circuit modules in the image processor main board 2. For example: the VCC2 output by the DC-DC circuit 1 powers the SOC module, and VCC3 and VCC4 power the FPGA.

[0031] The SOC module and the FPGA module are connected through the MIPI_CSI communication method. The SOC module and the FPGA module, as the core modules of the image processor main board, play the functions of image processing, peripheral interaction, and logic control. The FPGA and the SOC are connected through the MIPI_CSI communication method to realize image transmission and processing between the two.

[0032] The FPGA module is communicatively connected to the first isolation module and the second isolation module. The second isolation module is communicatively connected to the decoding module. The FPGA module serves as the primary processing core for image processing. Through the communication connection, it receives the digital-format image data transmitted from the decoding module and performs primary processing on the image data. The processed image data is transmitted to the SOC module in the MIPI_CSI protocol format, and the SOC module performs secondary processing on the image.

[0033] The output terminal of the DC-DC isolation module is connected to the input terminal of the second DC-DC circuit, and the output terminal of the second DC-DC circuit is electrically connected to the MCU1 and the decoding module.

[0034] The first isolation module is communicatively connected to the MCU1. The FPGA serves as the logical control core of the system and is connected to the patient circuit MCU 1 through the first isolation module in the form of communication (UART) to achieve the status monitoring and action response of the patient-side peripheral 5.

[0035] The audio module is connected to the FPGA module and is controlled by the FPGA module.

[0036] The SOC module is communicatively connected to the display module 3. The SOC module includes a SOC, a MIPI_CSI interface module, a MIPI_DSI interface module, an HDMI interface module, an SD card interface module, a USB interface module, a Wifi module, and an Ethernet interface module. The SOC module consists of a dedicated image processing SOC and various peripheral interface modules. The SOC module receives the MIPI_CSI format image data transmitted from the FPGA module and performs secondary image processing, and finally sends the processed image data to the display module 3 for display. The SOC module is connected to the display module 3. In addition to image data communication, it also needs to interact with the touch operation of the display module 3. The display module 3 has both display and touch functions. On the one hand, the display module 3 displays the image sent from the image processor main board 2, and on the other hand, it sends the operator's touch action to the image processor main board 2 in the form of an instruction.

[0037] The SOC module is communicatively connected to the peripheral interface 6 through the SD card interface module and the USB interface module. The USB flash drive, SD card, extended display, etc. achieve data interaction with the image processor main board 2 through the peripheral interface 6.

[0038] The image processor motherboard 2 can be divided into an intermediate circuit and a patient circuit (AP) from the perspective of medical electrical insulation. The patient circuit (AP) includes: a DC-DC isolation module, a first isolation module, a second isolation module, a second DC-DC circuit, a decoding module, an MCU1, a first signal processing module, an LED driving module, a second signal processing module, a third signal processing module, and a fourth signal processing module. A portable bronchial and urinary tract endoscope system proposed by the present invention separates the patient circuit (AP) from the intermediate circuit and conducts instruction and data interaction in the form of communication.

[0039] The DC-DC isolation circuit supplies power to the patient circuit (AP) and its peripherals. The DC-DC isolation circuit is connected to the output of the power supply switching circuit, converts the VCC1 output by the power supply switching circuit into the isolated power supply VCC7 of the patient circuit, and realizes the isolated power supply of the patient circuit.

[0040] The first isolation module and the second isolation module provide an isolated communication channel for the patient circuit and the FPGA module. The first isolation module is connected to the patient circuit MCU 1 and the intermediate circuit FPGA module.

[0041] The second isolation module is connected to the decoding module and the FPGA module, providing a channel for the isolated transmission of image data.

[0042] The second DC-DC circuit module converts the VCC7 output by the DC-DC isolation circuit, forms various voltages as required, and provides energy for the operation of each module of the patient circuit (AP).

[0043] The decoding module is connected to multiple camera modules in the image sensor 4; the decoding module receives the original image data sent by the camera modules in the image sensor 4, decodes it to form digital image data, and transmits it to the intermediate circuit FPGA module through the second isolation module according to a certain protocol. For example, the OV426 dedicated image decoding module can decode the image data output by the OV6946 CMOS image sensor and convert it into digital image data in DVP format, and send it to the FPGA module through the isolation module 2. The image sensor 4 is a CMOS camera module. The system solution proposed by the present invention can be adapted to two different specifications of image sensors. The image sensor 4 converts the image into an analog signal and inputs it to the decoding module. The image sensor 4 is the source of the image signal.

[0044] The MCU 1 is communicatively connected to the patient-side peripheral module 5; the patient-side peripheral module 5 includes a handle information storage IC, an angle sensor, an LED, a handle button, a pressure sensor, and a temperature sensor.

[0045] The handle information storage IC is communicatively connected to the MCU 1; the MCU 1 reads the data previously written into the handle information storage IC, determines which application scenario (bronchus, ureter) it is, and sends the scenario information to the FPGA module to achieve targeted image processing;

[0046] The angle sensor is connected to the input end of the MCU1 through the first signal processing module; the first signal processing module processes the angle information collected by the angle sensor and transmits it to the MCU 1 in the patient circuit of the image processor main board 2, and the MCU 1 will send the angle information to the FPGA module to achieve automatic adjustment of the image angle of the display screen;

[0047] The LED is connected to the MCU1 through the LED driving module; the LED provides a good lighting environment for the image sensor 4 and is controlled by the MCU 1 through the LED driving module to achieve different brightness adjustments;

[0048] The handle keys are connected to the input end of the MCU1 through the second signal processing module; the MCU 1 monitors the key states through the signal processing module 2 and sends the state information to the FPGA module to perform corresponding operations;

[0049] The pressure sensor is connected to the input end of the MCU1 through the third signal processing module; it senses the pressure situation around the image sensor 4 in real time, and transmits the pressure signal to the MCU 1 through the signal processing module 3 to achieve real-time monitoring of the pressure;

[0050] The temperature sensor is connected to the input end of the MCU1 through the fourth signal processing module, senses the ambient temperature around the image sensor 4 in real time, and transmits the temperature signal to the MCU 1 through the signal processing module 4 to achieve real-time monitoring of the temperature.

[0051] The MCU 1 is the control core of the patient circuit and the patient-side peripherals. For example: controlling the light source, receiving sensor signals, identifying key instructions, etc. The MCU 1 sends the received signals to the intermediate circuit FPGA module in the form of serial port instructions through the first isolation module. On the other hand, the MCU1 receives the control instructions sent by the intermediate circuit FPGA module through the first isolation module and controls the patient-side peripheral module 5 through the corresponding patient circuit (AP). Realize the control interaction between the MCU 1 and the patient-side peripheral module 5.

[0052] In the PCB layout, the patient circuit (AP) in the image processor main board 2 and the intermediate circuit are isolated and laid out with the DC-DC isolation circuit, the first isolation module, and the second isolation module as the boundaries to reduce the interference of the patient circuit (AP) on the intermediate circuit.

[0053] The FPGA and the dedicated image SOC of the present utility model constitute two-level image processing. The FPGA is responsible for the primary processing of image signals. After the processing is completed, the signals are converted into a protocol acceptable to the dedicated image SOC and transmitted to the SOC. The SOC reads the image data transmitted by the FPGA and performs secondary processing on the images. The two-level image processing scheme combining the dedicated image SOC and the FPGA can make full use of the advantages of both and avoid the disadvantages. The primary FPGA image processing gives developers the possibility to perform targeted image processing according to needs, especially in the cases of using different image sensors, different handles and different scenarios. Targeted image processing can provide higher-quality images. Various algorithm modules and dedicated IPs are integrated inside the dedicated image SOC and can be directly called, which reduces the development difficulty and saves development time. The rich peripheral resources of the FPGA provide the possibility for the upgrade of subsequent products.

[0054] The present utility model adopts a modular design idea for the patient circuit. The MCU 1, as the control core of the patient circuit (AP), communicates with the FPGA through an opto-coupler device, and realizes the interaction between all the peripherals at the patient end and the FPGA in the form of simple serial communication. The completely isolated design of the patient circuit better meets the requirements of medical standards regarding electrical safety, simplifies the design of the product electrical system and the patient circuit; especially for the handle cable design, all the signals in the cable are at the patient end and have the same reference point, and the insulation design between the leads inside the cable is simple. The connection cable between the endoscope handle and the host is usually >1m. Adopting the modular design idea for the patient circuit can effectively avoid the interference introduced by the long-distance transmission of patient circuit signals to the intermediate circuit, thereby affecting the image quality.

[0055] The system proposed in the present utility model can be paired with two types of handles, namely the bronchial handle and the urinary tract handle. The handle information storage IC is built in the handle. By reading the handle information storage chip, the handle type and the usage scenario are identified, and different image processing algorithms are selected. The function of identifying the handle type and the usage scenario can realize targeted processing of images in different scenarios, enhance the rendering effect of local tissue images, and optimize the user experience.

[0056] For those skilled in the art, it is obvious that the present utility model is not limited to the details of the above-mentioned exemplary embodiments, and can be implemented in other specific forms without departing from the spirit or basic characteristics of the present utility model. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-limiting. The scope of the present utility model is defined by the appended claims rather than the above description. Therefore, all changes falling within the meaning and scope of the equivalent elements of the claims are intended to be included in the present utility model, and any reference signs in the claims should not be regarded as limiting the claims involved.

[0057] In addition, it should be understood that although this specification is described in terms of embodiments, not every embodiment contains only one independent technical solution. This narrative style of the specification is only for clarity. Those skilled in the art should regard the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.

Claims

1. A portable broncho-urinary endoscope system, characterized in that: The device comprises a power adapter (1), an image processor mainboard (2), a display module (3), an image sensor (4), a patient-side peripheral module (5), a peripheral interface (6) and a battery module (7), wherein the power adapter (1) is electrically connected to an input end of the image processor mainboard (2), the image sensor (4) and the patient-side peripheral module (5) are electrically connected to the image processor mainboard (2), the display module (3) and the peripheral interface (6) are electrically connected to the image processor mainboard (2), and the image processor mainboard (2) is electrically connected to the image processor mainboard (2); The power adapter (1) comprises an AC / DC conversion module; The image processor mainboard (2) comprises a BMS battery management system, a power supply switching circuit, a first DC-DC circuit, a SOC module, an FPGA module, an audio module, a DC-DC isolation module, a first isolation module, a second isolation module, a second DC-DC circuit, a decoding module, an MCU1, a first signal processing module, an LED driving module, a second signal processing module, a third signal processing module and a fourth signal processing module; The input end of the charging management circuit in the BMS battery management system is connected to the circuit point of the AC / DC conversion module in the power adapter (1); the output end of the charging management circuit is electrically connected to the input end of the discharge management circuit in the BMS battery management system and the battery module (7); the output end of the charging management circuit and the output end of the discharge management circuit are both connected to the FPGA module; the input end of the charging management circuit and the input end of the discharge management circuit are both connected to the input end of the power supply switching circuit; The output end of the power supply switching circuit is connected to the input end of the first DC-DC circuit and the input end of the DC-DC isolation module, the output end of the first DC-DC circuit is electrically connected to the SOC module and the FPGA module, the SOC module and the FPGA module are connected via the MIPI_CSI communication mode, the FPGA module is communicatively connected to the first isolation module and the second isolation module, the second isolation module is communicatively connected to the decoding module, the output end of the DC-DC isolation module is connected to the input end of the second DC-DC circuit, the output end of the second DC-DC circuit is electrically connected to MCU1 and the decoding module; the first isolation module is communicatively connected to MCU1; The audio module is connected to the FPGA module.

2. A portable broncho-urinary endoscope system according to claim 1, characterized in that: The SOC module is communicatively connected with the display module (3), and the SOC module comprises a SOC, a MIPI_CSI interface module, a MIPI_DSI interface module, an HDMI interface module, an SD card interface module, a USB interface module, a Wifi module and an Ethernet interface module.

3. A portable broncho-urinary endoscope system according to claim 2, characterized in that: The SOC module is communicatively connected to the peripheral interface (6) via the SD card interface module and the USB interface module.

4. A portable broncho-urinary endoscope system according to claim 3, characterized in that: The decoding module is connected to multiple camera modules in the image sensor (4).

5. A portable broncho-urinary endoscope system according to claim 4, characterized in that: The MCU1 is in communication connection with the patient-side peripheral module (5).

6. A portable broncho-urinary endoscope system according to claim 5, characterized in that: The patient-side peripheral module (5) comprises a handle information storage IC, an angle sensor, an LED, a handle button, a pressure sensor and a temperature sensor; the handle information storage IC is connected to the MCU 1 for communication; the angle sensor is connected to the input end of the MCU 1 via a first signal processing module; the LED is connected to the MCU 1 via an LED driving module; the handle button is connected to the input end of the MCU 1 via a second signal processing module; the pressure sensor is connected to the input end of the MCU 1 via a third signal processing module; and the temperature sensor is connected to the input end of the MCU 1 via a fourth signal processing module.

Images