Portable endoscope integrated system

Abstract

The embodiment of the invention discloses a portable endoscope integrated system. According to one specific embodiment, the portable endoscope integrated system comprises a portable endoscope integrated device and an external trolley used for bearing the portable endoscope integrated device, the portable endoscope integrated device comprises a displayer and a host, the host is fixedly connected with the displayer, and the host is in communication connection with the displayer; the host comprises a power switch, an optical endoscope interface and an electron mirror interface, the optical endoscope interface is configured to be capable of being connected with an optical endoscope, and the electron mirror interface is configured to be capable of being connected with an electron mirror; the display is configured to display a picture detected when the accessed optical endoscope or electron mirror enters a human body; the external trolley is constructed to be capable of fixing the portable endoscope integrated device. According to the embodiment, the portable endoscope integrated device which can be compatible with various endoscopes and is small in occupied area can be provided, and the universality of the endoscope integrated device is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of endoscopes, and more particularly to a portable integrated endoscope system. Background Art

[0002] With the aging of the population and the improvement of health concepts, the public's demand for the examination and treatment of otolaryngology endoscopes is increasing, and the demand for endoscopic examinations is also increasing. Most of the current otolaryngology endoscope systems detect the internal conditions of the human body by externally connecting nasal endoscopes, ear endoscopes or electronic pharyngeal endoscopes.

[0003] However, when performing otolaryngology endoscopic examinations in the above manner, the following technical problems often exist:

[0004] Most otolaryngology endoscope systems are large in size, occupy a relatively large area, and can only access one type of endoscope and cannot be compatible with other endoscopes, resulting in low versatility. Summary of the Invention

[0005] This section of the present disclosure is used to briefly introduce concepts that will be described in detail in the following detailed implementation section. This section of the present disclosure is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0006] Some embodiments of the present disclosure propose a portable integrated endoscope system to solve one or more of the technical problems mentioned in the above background art section.

[0007] Some embodiments of the present disclosure provide a portable integrated endoscope system, characterized in that the portable integrated endoscope system includes: a portable integrated endoscope device and an external trolley for supporting the portable integrated endoscope device, wherein the portable integrated endoscope device includes a display and a host, wherein the host is fixedly connected to the display and communicatively connected to the display; the host includes a power switch, an optical endoscope interface, and an electronic endoscope interface, wherein the optical endoscope interface is configured to be able to access an optical endoscope, and the electronic endoscope interface is configured to be able to access an electronic endoscope; the display is configured to display the image detected when the accessed optical endoscope or electronic endoscope enters the human body; the portable integrated endoscope device includes an external trolley, the external trolley includes a trolley shaft and a trolley base, the trolley shaft is disposed at the central position of the trolley base, the trolley shaft includes an outer shaft and an inner shaft, both the outer shaft and the inner shaft are hollow shafts, the size of the outer shaft is larger than that of the inner shaft, the inner shaft is configured to be able to telescopically move within the outer shaft, one end of the inner shaft includes a movable fixed shaft, an endoscope device mounting bracket is included on the movable fixed shaft, the endoscope device mounting bracket is configured to be able to fix the portable integrated endoscope device on the external trolley, the movable fixed shaft is configured to be a movable structure, and the endoscope device mounting bracket can rotate clockwise or counterclockwise with the movable fixed shaft as the axis, the outer shaft includes a storage basket, the storage basket has a hollow structure, the storage basket is disposed at the upper end of the outer shaft, the trolley base includes movable wheels, and the external trolley is configured to be able to move through the movable wheels.

[0008] Optionally, the host includes a host heat dissipation hole, and the host heat dissipation hole is disposed on one side of the host.

[0009] Optionally, the host includes a button area, the button area is communicatively connected to the display, the button area is communicatively connected to the host, and the button area is provided with at least one button.

[0010] Optionally, the host includes a light guide beam interface, and the light guide beam interface, the power switch, the optical endoscope interface, and the electronic endoscope interface are disposed on the same side of the host.

[0011] Optionally, the border of the display is provided with a rounded corner structure.

[0012] Optionally, a display screen protection film is provided on the display screen of the display.

[0013] Optionally, the power switch is provided with anti-slip protrusions.

[0014] Optionally, the above-mentioned portable endoscope integrated system further includes a button handle. The button handle includes a handle connection line and a handle head. The handle connection line is configured to be able to access the interface of the button area. The handle head includes a handle button area. The button functions on the handle button area correspond to the button functions on the button area. The portable endoscope integrated device includes a backlight circuit board, a liquid crystal screen logic board, and a built-in chip. The backlight circuit board is configured to be able to be embedded on one side of the host. The liquid crystal logic board is configured to be able to be embedded on the other side of the host. The built-in chip is communicatively connected to the backlight circuit board and the liquid crystal screen logic board. The positions of the backlight circuit board, the liquid crystal screen logic board, and the built-in chip do not overlap. Only the main body parts of the backlight circuit board and the liquid crystal screen logic board are inserted into the host. The backlight circuit board and the liquid crystal screen logic board are both in a long strip plate structure. Among them, the built-in chip is further configured to: obtain patient data; store the patient data; synchronize the patient data to an external device.

[0015] Optionally, the above-mentioned host includes a graphics card. The graphics card is configured to: obtain the image of the human body detected by the above-mentioned optical endoscope or the electronic endoscope to obtain an endoscopic image to be processed; input the endoscopic image to be processed into the feature extraction layer of a pre-trained image enhancement model to obtain an endoscopic image feature map. Among them, the image enhancement model includes a feature extraction layer, a channel attention layer, a spatial attention layer, a reconstruction layer, and an output layer; input the endoscopic image feature map into the channel attention layer to obtain an endoscopic image adjusted by channel attention; input the endoscopic image adjusted by channel attention into the spatial attention layer to obtain an endoscopic image adjusted by spatial attention; input the endoscopic image adjusted by spatial attention into the reconstruction layer to obtain a reconstructed endoscopic image; output the reconstructed endoscopic image through the output layer to obtain an enhanced endoscopic image; visualize the enhanced endoscopic image through the above-mentioned display. Among them, the clarity of the enhanced endoscopic image is higher than that of the endoscopic image to be processed.

[0016] Some embodiments of the present disclosure provide a portable integrated endoscope system, which provides an otolaryngology endoscope integrated system with a small size and compatible with multiple endoscopes, and has high versatility. Specifically, the reason for the low versatility of most otolaryngology endoscope systems is that most otolaryngology endoscope systems have a complex structure, a large floor area, and most otolaryngology endoscope systems only support the access of one type of endoscope, resulting in low versatility. Based on this, some embodiments of the present disclosure provide a portable integrated endoscope system, which is characterized in that the portable integrated endoscope system includes: a portable integrated endoscope device and an external trolley for supporting the portable integrated endoscope device. Among them, the portable integrated endoscope device includes a display and a host, the host is fixedly connected to the display, and the host is communicatively connected to the display; the host includes a power switch, an optical endoscope interface, and an electronic endoscope interface. Among them, the optical endoscope interface is configured to be able to access an optical endoscope, and the electronic endoscope interface is configured to be able to access an electronic endoscope; the display is configured to display the image detected when the accessed optical endoscope or electronic endoscope enters the human body; the portable integrated endoscope system includes an external trolley, the external trolley includes a trolley shaft and a trolley base, the trolley shaft is arranged at the central position of the trolley base, the trolley shaft includes an outer shaft and an inner shaft, both the outer shaft and the inner shaft are hollow shafts, the size of the outer shaft is larger than that of the inner shaft, the inner shaft is configured to be able to telescopically move within the outer shaft, one end of the inner shaft includes a movable fixed shaft, and an endoscope device mounting bracket is arranged on the movable fixed shaft. The endoscope device mounting bracket is configured to be able to fix the portable integrated endoscope device on the external trolley. The movable fixed shaft is configured to be a movable structure, and the endoscope device mounting bracket can rotate clockwise or counterclockwise around the movable fixed shaft. The outer shaft includes a storage basket, the storage basket has a hollow structure, the storage basket is arranged at the upper end of the outer shaft, the trolley base includes movable wheels, and the external trolley is configured to be able to move through the movable wheels. On the one hand, the structural main body of the portable integrated endoscope system has a host with a display and a lightweight external trolley, with a simple structure and a small floor area. On the other hand, the host of the portable integrated endoscope device includes an optical endoscope interface and an electronic endoscope interface, and can access and be compatible with multiple endoscopes. Thus, a portable integrated endoscope system is provided, which can be compatible with multiple endoscopes and has high versatility. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic, and the elements and elements are not necessarily drawn to scale.

[0018] Figure 1Structural diagrams of different perspectives of the portable endoscope integrated system according to some embodiments of the present disclosure;

[0019] Figure 2 Structural diagram of the external trolley according to some embodiments of the present disclosure;

[0020] Figure 3 Schematic structural diagram of the button handle and the portable endoscope integrated device arranged on the external trolley and a partially enlarged structural diagram of the button handle according to some embodiments of the present disclosure;

[0021] Figure 4 Schematic structural diagram of the button handle and the portable endoscope integrated device arranged on the external trolley according to some embodiments of the present disclosure. Detailed implementation manners

[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0023] In addition, it should be noted that for the sake of convenience of description, only parts related to the relevant invention are shown in the drawings. Without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0024] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence relationship of the functions performed by these devices, modules or units.

[0025] It should be noted that the modifications of "one" and "plural" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0026] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0027] The present disclosure will be described in detail below with reference to the drawings and in combination with the embodiments.

[0028] Figure 1 Structural diagrams of different perspectives of the portable endoscope integrated device according to some embodiments of the present disclosure. Figure 1It includes a main unit 1, a key area 11, a power switch 12, an optical endoscope interface 13, an electronic endoscope interface 14, a light guide beam interface 15, a main unit heat dissipation hole 16, a display 2, a backlight circuit board 3, and a liquid crystal logic board 4.

[0029] Figure 2 It is a structural diagram of an external trolley according to some embodiments of the present disclosure. Figure 2 It includes an inner shaft 6, a movable fixed shaft 61, an endoscope device mounting bracket 62, an outer shaft 7, a storage basket 71, a trolley base 8, and movable wheels 81.

[0030] Figure 3 It is a schematic structural diagram of a button handle and a portable endoscope integrated device disposed on an external trolley according to some embodiments of the present disclosure, and a partial enlarged structural diagram of the button handle. Figure 3 It includes a display 2, a button handle 5, a handle key area 51, buttons 511, and a handle connection line 52.

[0031] In some embodiments, the above-mentioned portable endoscope integrated device may include a display 2 and a main unit 1. The type of the above-mentioned main unit 1 may include but is not limited to: a 4K integrated endoscope camera system or a Storz endoscope camera system, without specific limitation. The internal components of the above-mentioned main unit 1 may include but are not limited to: an image processing system, a storage system, an operating system, and a processor (such as an 8-core 2.4 GHz CPU, running an Android 12 operating system), a power system (such as configured with a 10,000 mAh large battery), and an interface (for accessing an endoscope), etc. The above-mentioned main unit 1 may be used to run various functions of the above-mentioned portable endoscope integrated device, and the above-mentioned functions may include but are not limited to: image processing, data management, and interface functions, etc. The above-mentioned display 2 may be a 4K display screen, and the specific type is not limited. The above-mentioned display 2 may be used to display endoscope detection images.

[0032] In some embodiments, the above-mentioned main unit 1 may be fixedly connected to the above-mentioned display 2, and the above-mentioned main unit 1 may be communicatively connected to the above-mentioned display 2 to facilitate the control of the above-mentioned display 2 by the above-mentioned main unit 1.

[0033] In some embodiments, the above-mentioned main unit 1 includes a power switch 12, an optical endoscope interface 13, and an electronic endoscope interface 14. Among them, the above-mentioned optical endoscope interface 13 may be configured to be able to access an optical endoscope. The above-mentioned electronic endoscope interface 14 may be configured to be able to access an electronic endoscope. The above-mentioned power switch 12 may be used to control the on and off of the above-mentioned portable endoscope integrated device. The above-mentioned optical endoscope interface 13 and the above-mentioned electronic endoscope interface 14 may be compatible with the sockets of most electronic endoscopes and optical endoscopes on the market. For example, the above-mentioned optical endoscope interface 13 may be a high-definition optical zoom interface F14-F32. The above-mentioned electronic endoscope interface may be CV-170 of Olympus.

[0034] In some embodiments, the above-mentioned display 2 is configured to display the images detected when the accessed optical endoscope or electronic endoscope enters the human body.

[0035] In some embodiments, the above-mentioned portable endoscope integrated system may include an external trolley. The above-mentioned external trolley can be used to temporarily support the above-mentioned portable endoscope integrated device, facilitating the user's operation and avoiding pressing the accessed wires. The above-mentioned external trolley may include a trolley shaft and a trolley base 8. The trolley shaft may be disposed at the central position of the trolley base 8. The trolley shaft may include an outer shaft 7 and an inner shaft 6. Both the outer shaft 7 and the inner shaft 6 may be hollow shafts to reduce the weight of the trolley. The size of the outer shaft 7 may be larger than that of the inner shaft 6 so that the inner shaft 6 can be placed inside the outer shaft 7. The inner shaft 6 may be configured to be telescopable within the outer shaft 7 to adjust the position of the above-mentioned portable endoscope integrated device.

[0036] In some embodiments, one end of the above-mentioned inner shaft 6 may include a movable fixing shaft 61. An endoscope device mounting bracket 62 may be included on the movable fixing shaft 61. The endoscope device mounting bracket 62 may be configured to fix the above-mentioned portable endoscope integrated device to the above-mentioned external trolley. The movable fixing shaft 61 may be configured as a movable structure. The endoscope device mounting bracket 62 can rotate clockwise or counterclockwise with the movable fixing shaft 61 as the axis to further adjust the position of the above-mentioned display 2, increasing flexibility.

[0037] In some embodiments, the above-mentioned outer shaft 7 may include a storage basket 71. The storage basket 71 can hold some sundries such as water cups, notebooks, etc. The storage basket 71 may have a hollow structure to further reduce the weight. The storage basket 71 may be disposed at the upper end of the outer shaft 7.

[0038] In some embodiments, the above-mentioned trolley base 8 includes movable wheels 81. The above-mentioned trolley base 8 may be a polygonal structure with multiple protruding ends, and the specific shape is not limited. The above-mentioned external trolley is configured to be movable through the movable wheels 81.

[0039] Optionally, as Figure 1 shown, the above-mentioned host 1 may include host heat dissipation holes 16. The host heat dissipation holes 16 may be disposed on one side of the host 1. The host heat dissipation holes 16 can be used to prevent, to a certain extent, damage to the system caused by overheating of the host 1.

[0040] Optionally, as Figure 1As shown, the above-mentioned host 1 may include a key area 11. The above-mentioned key area 11 may be communicatively connected to the above-mentioned display 2. The above-mentioned key area 11 may be communicatively connected to the above-mentioned host 1 to ensure that the above-mentioned host 1 can respond to each function as required. The above-mentioned key area 11 may be provided with at least one button. The functions of the above-mentioned button may include, but are not limited to: taking pictures, recording videos, and white balance, etc. The above-mentioned key area 11 may be set with ten buttons as Figure 1 shown. For example, the functions of the above-mentioned ten buttons from top to bottom may be: taking pictures, recording videos, white balance, zooming in, zooming out, view moving, view switching, brightness adjustment, custom function 1, and custom function 2.

[0041] Optionally, as Figure 1 shown, the above-mentioned host 1 may include a light guide beam interface 15. The above-mentioned light guide beam interface 15 may be arranged on the same side of the above-mentioned host 1 as the above-mentioned power switch 12, the above-mentioned optical endoscope interface 13, and the above-mentioned electronic endoscope interface 14. The above-mentioned light guide beam interface 15 may be connected to a cold light source and an endoscope, responsible for transmitting the light source to the distal end of the endoscope to illuminate the examination area, enabling the doctor to clearly see the internal structure of the ear, nose, and throat.

[0042] Optionally, as Figure 1 shown, the border of the above-mentioned display 2 may be provided with a rounded corner structure. The above-mentioned rounded corner structure may be used to reduce the possibility of causing harm to people or objects during collisions or falls, and to reduce the stress concentration phenomenon of the above-mentioned border to a certain extent.

[0043] Optionally, a display screen protection film may be provided on the display screen of the above-mentioned display 2. The above-mentioned display protection film may be a PET film or tempered glass, and no specific limitation is made here. The above-mentioned display screen protection film may be used to prevent scratches on the above-mentioned display screen to a certain extent.

[0044] Optionally, as Figure 1 shown, the above-mentioned power switch 12 may be provided with anti-slip protrusions. The above-mentioned anti-slip protrusions may prevent the user from sliding additionally when pressing the above-mentioned power switch 12 to a certain extent, improving the user experience.

[0045] Optionally, as Figure 1 and Figure 3-4 shown, the above-mentioned portable endoscope integrated system may further include a key handle 5. The above-mentioned key handle 5 may enable the user to use the button functions more conveniently and quickly, and provide a spare key when the buttons in the above-mentioned key area 11 are damaged. The above-mentioned key handle 5 may include a handle connection line 52 and a handle head. The above-mentioned handle connection line 52 may be configured to be able to access the interface of the above-mentioned key area 11 to ensure linkage with the above-mentioned host 1. The above-mentioned handle head may include a handle key area 51. The functions of the buttons 511 on the above-mentioned handle key area 51 correspond to the functions of the above-mentioned buttons in the above-mentioned key area 11. AsFigure 3 As shown, five buttons can be set on the above-mentioned handle button area 51. Among them, the function of the button 511 can be photographing, video recording, and white balance, and the functions of the remaining buttons 511 can be defined as needed. The above-mentioned portable endoscope integrated device may include a backlight circuit board 3, a liquid crystal display logic board 4, and a built-in chip. Since the liquid crystal itself does not emit light, the above-mentioned backlight circuit board 3 is responsible for providing a backlight source so that the liquid crystal display can display images. The above-mentioned liquid crystal display logic board 4 can be a highly integrated multimedia video processor based on ASIC (Application Specific Integrated Circuit). The above-mentioned built-in chip can be a CMOS (Complementary Metal Oxide Semiconductor) sensor, and no specific limitation is made. The above-mentioned built-in chip can be used to execute the data processing function of the above-mentioned portable endoscope integrated device, such as storing the user's endoscope images. It should be particularly noted that the above-mentioned built-in chip is not shown in Figure 1 . The above-mentioned liquid crystal display logic board 4 can process the signals of the image sensor and convert them into a format suitable for display on the liquid crystal display. The above-mentioned backlight circuit board 3 can be configured to be embedded in one side of the above-mentioned main body. The above-mentioned liquid crystal logic board 4 can be configured to be embedded in the other side of the above-mentioned main body. The above-mentioned built-in chip is communicatively connected to the above-mentioned backlight circuit board 3 and the above-mentioned liquid crystal display logic board 4, and the positions of the above-mentioned backlight circuit board 3, the above-mentioned liquid crystal display logic board 4, and the above-mentioned built-in chip can not overlap with each other, so as to prevent interference with their respective functions to a certain extent. Only the main body parts of the above-mentioned backlight circuit board 3 and the above-mentioned liquid crystal display logic board 4 can be inserted into the above-mentioned main body 1, so as to facilitate damage replacement. The main body part can be the circuit connection point of the above-mentioned liquid crystal logic board 4 and the above-mentioned backlight circuit board 3, the interface end of the signal transmission line, and the part of the chip and circuit trace that plays the role of power supply and data processing transfer. These built-in parts are mainly responsible for establishing a stable connection with the core processing system and power supply system of the main body, realizing data interaction and power transmission, and ensuring its stable operation. What is not embedded in the above-mentioned main body 1 can be the flexible cable interface for physically connecting the above-mentioned liquid crystal logic board 4, the above-mentioned backlight circuit board 3 and the liquid crystal display, and part of the circuit module for heat dissipation or convenient maintenance and plugging. The exposure of the flexible cable interface can make the installation, after-sales maintenance, and replacement of the liquid crystal display more convenient. At the same time, part of the heat dissipation-related circuit is exposed because this kind of circuit board generates heat during operation, and moderate exposure can also accelerate heat dissipation and prevent local overheating from causing failures to a certain extent. The above-mentioned parts not embedded in the above-mentioned main body 1 can be provided with an external wrapping layer or wrapping shell to prevent damage to the above-mentioned liquid crystal logic board 4 and the above-mentioned backlight circuit board 3 to a certain extent. The above-mentioned backlight circuit board 3 and the above-mentioned liquid crystal display logic board 4 can both be in a long strip plate structure.

[0046] Among them, the above-mentioned built-in chip can be configured as:

[0047] Step 1: Obtain patient data. The above-mentioned patient data can be automatically stored in the above-mentioned host 1 after the user takes an endoscopic image or finishes recording a video. Among them, the above-mentioned patient data includes patient information, endoscopic photos, videos, operators, dates, etc. The above-mentioned portable endoscopic integrated device can also store the above-mentioned patient data. The above-mentioned storage method can be a data protection and tracking technology based on white-box cryptography.

[0048] Step 2: Store the above-mentioned patient data. The above-mentioned patient data is stored in the above-mentioned host 1. The above-mentioned host 1 has a preset memory. For example, the memory of the above-mentioned host 1 can be 240G. The stored above-mentioned patient data can be deleted regularly.

[0049] Step 3: Synchronize the above-mentioned patient data to an external device. Among them, the above-mentioned external device can include an external app software, such as a mobile phone app. The above-mentioned app software can be a mobile phone software. The user can use personal information to create their own personal account, and the user can use this account to receive, view, and store their own endoscopic images. The user can create their own account on the relevant app to view and receive endoscopic images.

[0050] The above optional embodiment, as an inventive point of the embodiments of the present disclosure, solves the technical problem of "currently, most otolaryngology endoscopic systems are not easy to replace components related to optimizing the display function (such as a liquid crystal logic board and a backlight circuit board) and lack the linkage ability with external devices". The factors that cause most current endoscopic systems to be not easy to replace components related to optimizing the display function and lack the linkage ability with external devices are as follows: On the one hand, components related to optimizing the display function are usually set inside the endoscopic host. If replacement is required, the host needs to be completely disassembled, which is time-consuming and laborious. On the other hand, most current endoscopic systems are not configured with linkage with external devices (such as mobile phones or other endoscopic devices), lacking flexibility. If the above factors are solved, the effect of simplifying the components related to optimizing the display function in the endoscopic system and improving flexibility can be achieved. To achieve this effect, on the one hand, the embodiments of the present disclosure provide a method that can partially expose the liquid crystal logic board and the backlight circuit board while embedding them in the host, and only need to loosen the host during disassembly, simplifying the disassembly and replacement process. On the other hand, the embodiments of the present disclosure are configured with a function that can be linked with external devices. The above-mentioned chip can store the user's endoscopic images and can produce a linkage effect with the mobile phone app of external users, enabling the user to view their own endoscopic images and related information even when they are in different places, improving the flexibility of the endoscopic system. Thus, while simplifying the process of disassembling and replacing the display components, a method of linking with external devices is provided, improving the flexibility of the above-mentioned portable endoscopic integrated system.

[0051] Optionally, the above-mentioned host 1 may include a graphics card. The above-mentioned graphics card may be an NVIDIA Jetson Nano. The above-mentioned graphics card may be configured to:

[0052] In the first step, obtain the image of the human body detected by the above-mentioned optical endoscope or the above-mentioned electronic endoscope to obtain the endoscopic image to be processed. The above-mentioned endoscopic image to be processed may be taken in real time or stored in the above-mentioned host 1.

[0053] In the second step, input the above-mentioned endoscopic image to be processed into the feature extraction layer of a pre-trained image enhancement model to obtain an endoscopic image feature map. Among them, the above-mentioned image enhancement model includes a feature extraction layer, a channel attention layer, a spatial attention layer, a reconstruction layer, and an output layer. The above-mentioned image enhancement model may be a neural network model that takes the image taken by an otolaryngology endoscope as input data and outputs an image taken by the above-mentioned otolaryngology endoscope with a higher resolution. In practice, the training samples of the above-mentioned pre-trained image enhancement model may be endoscopic images with key areas manually marked, where the above-mentioned key areas may be areas with more fine tissues or more complex areas. The above-mentioned feature extraction layer may include a convolutional layer with a 9*9 convolutional kernel and a stride of 1 and a ReLU activation layer. The above-mentioned feature extraction layer may be used to capture basic features such as initial textures and edges in the above-mentioned endoscopic image to be processed. The above-mentioned channel attention layer may include a global average pooling layer (Global Average Pooling, GAP), a fully connected layer, and an activation layer, where the activation layer may be a Sigmoid activation layer. The above-mentioned channel attention layer may be used to output a weight vector for calibrating the importance of channels. The above-mentioned spatial attention layer may include a max pooling layer and an average pooling layer. The above-mentioned spatial attention layer may be used to fuse and enhance important features and output a weight map of the key spatial regions of the above-mentioned endoscopic image to be processed. The cooperation of the above-mentioned channel attention layer and the spatial attention layer can enable the above-mentioned image enhancement model to preferentially enhance the above-mentioned key areas of the above-mentioned endoscopic image to be processed. The above-mentioned reconstruction layer may include a convolutional layer with a 3*3 convolutional kernel and a stride of 1 and a convolutional layer with a 5*5 convolutional kernel and a stride of 1. The above-mentioned reconstruction layer may be used to output a preliminarily reconstructed high-resolution image tensor. The above-mentioned output layer may be used to denormalize the above-mentioned preliminarily reconstructed high-resolution image tensor to output the enhanced above-mentioned endoscopic image to be processed.

[0054] In the second step, input the above-mentioned endoscopic image feature map into the above-mentioned channel attention layer to obtain an endoscopic image with channel attention adjusted.

[0055] In the third step, the endoscope image after the above channel attention adjustment is input into the above spatial attention layer to obtain the endoscope image after the spatial attention adjustment.

[0056] In the fourth step, the endoscope image after the above spatial attention adjustment is input into the above reconstruction layer to obtain the reconstructed endoscope image.

[0057] In the fifth step, the above reconstructed endoscope image is output through the above output layer to obtain the enhanced endoscope image.

[0058] In the sixth step, the above enhanced endoscope image is visualized through the above display 2. Among them, the clarity of the above enhanced endoscope image is higher than that of the above endoscopic image to be processed. For example, the resolution before enhancement is 720P, and the full-image resolution or local resolution after enhancement can be 1080P.

[0059] The technical solutions of the above first step to the sixth step are an inventive point of the embodiments of the present disclosure, which solves the technical problem of "the uneven quality of endoscopic image due to the access of various different endoscopes". The specific factors leading to the uneven quality of endoscopic images are as follows: Since the image quality accessed by each different model of endoscope will vary, when they are compatible on the same device, the phenomenon of uneven image quality will occur. If the above factors are solved, the problem of poor endoscopic image quality caused by the compatibility of different endoscopes can be solved. To achieve this effect, the present disclosure processes the received endoscopic images through the following steps: First, obtain the image of the human body detected by the above optical endoscope or the above electronic endoscope to obtain the endoscopic image to be processed. Then, input the above endoscopic image to be processed into the feature extraction layer of the pre-trained image enhancement model to obtain the endoscopic image feature map, where the above image enhancement model includes a feature extraction layer, a channel attention layer, a spatial attention layer, a reconstruction layer, and an output layer. Thus, a feature map is obtained that extracts basic features such as initial texture and edges. Then, input the above endoscopic image feature map into the above channel attention layer to obtain the endoscopic image adjusted by the channel attention. Then, input the endoscopic image adjusted by the channel attention into the above spatial attention layer to obtain the endoscopic image adjusted by the spatial attention. Thus, an endoscopic image with prominent key areas is obtained, enabling the above image enhancement model to preferentially enhance the key areas and saving the configuration required for model operation. Then, input the endoscopic image adjusted by the spatial attention into the above reconstruction layer to obtain the reconstructed endoscopic image. Thus, a preliminarily enhanced image vector is obtained. Then, output the above reconstructed endoscopic image through the above output layer to obtain the enhanced endoscopic image. Finally, visualize the above enhanced endoscopic image through the above display, where the clarity of the enhanced endoscopic image is higher than that of the above endoscopic image to be processed. On the one hand, the above steps can optimize the endoscopic images with degraded image quality due to the access of various different endoscopes through the image enhancement model, and on the other hand, can distinguish the priority and importance of the optimization, and focus on optimizing and enhancing the more important parts. Thus, the endoscopic images obtained by accessing various different endoscopes can be optimized and unified, improving the user experience.

[0060] Optionally, the above portable endoscopic integrated device may further include an image processing chip. The above image processing chip may be an NPU (Neural Network Processor). The above image processing chip is configured to:

[0061] First step, obtain the above enhanced endoscopic image.

[0062] Step 2: Input the above enhanced endoscopic image into the first extraction convolutional layer of a pre-trained anomaly classification model to obtain a preliminary feature extraction map. The above anomaly classification model includes a first extraction convolutional layer, a second extraction convolutional layer, a self-attention layer, a first fully-connected layer, a second fully-connected layer, and a classification output layer. The above anomaly classification model can be a neural network model that takes the enhanced otolaryngology endoscopic image as input data and the anomaly classification probability as output data. In practice, the samples of the above pre-trained anomaly classification model can be an image set with manually circled anomaly regions and corresponding descriptive labels. For example, circle the red and ulcerated parts on an endoscopic image and attach the label "type I anomaly". Both the above first extraction convolutional layer and the above second extraction convolutional layer can include a convolutional layer with a 3*3 convolutional kernel and a stride of 1, and a pooling layer with a 2*2 pooling kernel and a stride of 2. Among them, the above first extraction convolutional layer can be used to complete the extraction of the basic texture and simple contour features of the input image at one time, reducing the complex layering in the early stage of the network. The activation function (such as ReLU) is used to introduce non-linearity and enhance the model's expressiveness. The above second extraction convolutional layer can mine more implicit and deep-level feature information based on the feature map of the first extraction convolutional layer. The above self-attention layer (Self-Attention Layer) can be a mechanism in deep learning that allows the model to dynamically adjust the degree of attention to each element by calculating the correlation scores between elements at different positions in the sequence when processing sequence data, thereby capturing the complex dependencies within the sequence. This mechanism enables the model to capture the dependencies between different positions in the input sequence. The core of the above self-attention layer lies in calculating three key vectors: query, key, and value. When processing the above enhanced endoscopic image, traditional convolutional neural networks focus on local feature extraction and are difficult to capture long-distance dependencies, such as the associations between anomaly regions that are far apart. The above self-attention layer can be used to break through the position limitation, calculate the correlation between the elements at each position on the feature map and all other position elements, and re-distribute the weights of each position element accordingly, making the key features more prominent. The above first fully-connected layer can be used to flatten the feature map output by the above self-attention layer into a one-dimensional vector, initially converge the scattered features with the help of fully-connected neurons, and make a preliminary mapping in the direction of anomaly classification. The above second fully-connected layer can be used to complete the final anomaly classification mapping, finely adjust the connection weights of each neuron according to the input vector to distinguish various anomalies. The above classification output layer can be used to output a formatted classification result, providing users with an intuitive and quantitative reference for the possibility of anomalies.

[0063] Step 3: Input the above preliminary feature extraction map into the above second extraction convolutional layer to obtain a deep feature extraction map.

[0064] In the fourth step, input the above-mentioned depth feature extraction map into the above-mentioned self-attention layer to obtain a classification feature map with optimized weight distribution.

[0065] In the fifth step, input the above-mentioned classification feature map with optimized weight distribution into the above-mentioned first fully-connected layer to obtain an intermediate-dimensional vector. Among them, the above-mentioned intermediate-dimensional vector contains the preliminary mapping of the above-mentioned classification feature map with optimized weight distribution and classification information.

[0066] In the sixth step, input the above-mentioned intermediate-dimensional vector into the above-mentioned second fully-connected layer to obtain an abnormal classification prediction probability vector.

[0067] In the seventh step, output the above-mentioned abnormal classification prediction probability vector through the above-mentioned classification output layer to obtain an abnormal classification result. For example, output "The possibility of type I abnormality is 70%, and the possibility of type II abnormality is 30%".

[0068] In the eighth step, visualize the above-mentioned abnormal classification result through the above-mentioned display 2. In practice, the above-mentioned abnormal classification result can be a printable complete report, and can be accompanied by a diagram showing the abnormal area. The above-mentioned abnormal area can be obtained and circled according to the above-mentioned classification feature map with optimized weight distribution obtained by the above-mentioned abnormal classification model.

[0069] The technical solutions of the first step to the eighth step above are an inventive point of the embodiments of the present disclosure, which solve the technical problem that "most otolaryngology endoscope integrated systems lack the function of classifying and judging abnormalities". If the above factors are solved, the problem that most otolaryngology endoscope integrated systems lack the function of classifying and judging abnormalities is solved. To achieve this effect, the present disclosure processes the received enhanced endoscope images through the following steps: First, obtain the above enhanced endoscope images. Then, input the above enhanced endoscope images into the first extraction convolutional layer of a pre-trained abnormality classification model to obtain a preliminary feature extraction map, where the above abnormality classification model includes a first extraction convolutional layer, a second extraction convolutional layer, a self-attention layer, a first fully connected layer, a second fully connected layer, and a classification output layer. Then, input the above preliminary feature extraction map into the above second extraction convolutional layer to obtain a depth feature extraction map. Then, input the above depth feature extraction map into the above self-attention layer to obtain a classification feature map with optimized weight distribution. Then, input the above classification feature map with optimized weight distribution into the above first fully connected layer to obtain an intermediate-dimensional vector, where the above intermediate-dimensional vector contains a preliminary mapping of the above classification feature map with optimized weight distribution and classification information. Then, input the above intermediate-dimensional vector into the above second fully connected layer to obtain an abnormality classification prediction probability vector. Then, output the above abnormality classification prediction probability vector through the above classification output layer to obtain an abnormality classification result. Thus, an abnormality judgment classification report can be obtained. Finally, visualize the above abnormality classification result through the above display. On the one hand, the above steps can further utilize the above key-enhanced endoscopic images to provide better training samples for the above abnormality judgment model. On the other hand, it provides an abnormality classification and judgment function for the above portable endoscope integrated device. Thus, an abnormality classification and judgment function can be provided to assist the user in judging the abnormality category and improve the user experience.

[0070] Some embodiments of the present disclosure provide a portable integrated endoscope system, which provides an otolaryngology endoscope integrated system with a small volume and compatible with multiple endoscopes, having high versatility. Specifically, the reason for the low versatility of most otolaryngology endoscope systems is that most otolaryngology endoscope systems have complex structures, occupy a large floor area, and most otolaryngology endoscope systems only support the access of one type of endoscope, resulting in low versatility. Based on this, some embodiments of the present disclosure provide a portable integrated endoscope system, which is characterized in that the portable integrated endoscope system includes: a portable integrated endoscope device and a trolley for supporting the portable integrated endoscope device, wherein the portable integrated endoscope device includes a display and a host, the host is fixedly connected to the display, and the host is communicatively connected to the display; the host includes a power switch, an optical endoscope interface, and an electronic endoscope interface, wherein the optical endoscope interface is configured to be able to access an optical endoscope, and the electronic endoscope interface is configured to be able to access an electronic endoscope; the display is configured to display the image detected when the accessed optical endoscope or electronic endoscope enters the human body; the portable integrated endoscope system includes an external trolley, the external trolley includes a trolley shaft and a trolley base, the trolley shaft is arranged at the central position of the trolley base, the trolley shaft includes an outer shaft and an inner shaft, both the outer shaft and the inner shaft are hollow shafts, the size of the outer shaft is larger than that of the inner shaft, the inner shaft is configured to be able to telescopically move within the outer shaft, one end of the inner shaft includes a movable fixed shaft, an endoscope device mounting bracket is arranged on the movable fixed shaft, the endoscope device mounting bracket is configured to be able to fix the portable integrated endoscope device on the external trolley, the movable fixed shaft is configured to be a movable structure, the endoscope device mounting bracket can rotate clockwise or counterclockwise around the movable fixed shaft as the axis, the outer shaft includes a storage basket, the storage basket has a hollow structure, the storage basket is arranged at the upper end of the outer shaft, the trolley base includes movable wheels, and the external trolley is configured to be able to move through the movable wheels. On the one hand, the main structure of the portable integrated endoscope system has a host with a display and a lightweight external trolley, with a simple structure and a small floor area. On the other hand, the host of the portable integrated endoscope device includes an optical endoscope interface and an electronic endoscope interface, which can access and be compatible with multiple endoscopes. Thus, a portable integrated endoscope device is provided, which can be compatible with multiple endoscopes and has high versatility.

[0071] The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) disclosed in the embodiments of the present disclosure that have similar functions.

Claims

1. A portable endoscope integrated system, characterized in that: The portable integrated endoscope system comprises: a portable integrated endoscope device and an external trolley for supporting the portable integrated endoscope device, wherein: The portable endoscope integrated device comprises a display and a host; The host is fixedly connected to the display, and the host is communicatively connected to the display; The host comprises a power switch, an optical endoscope interface and an electronic endoscope interface, wherein the optical endoscope interface is configured to be connected to an optical endoscope, and the electronic endoscope interface is configured to be connected to an electronic endoscope; The display is configured to display images detected by the connected optical endoscope or electronic endoscope entering the human body; The external trolley includes a trolley shaft and a trolley base, the trolley shaft is arranged at the center of the trolley base, the trolley shaft includes an outer shaft and an inner shaft, the outer shaft and the inner shaft are both hollow shafts, the size of the outer shaft is larger than the inner shaft, and the inner shaft is configured to be able to extend and retract in the outer shaft; One end of the inner shaft includes a movable fixed shaft, and the movable fixed shaft includes an endoscope device mounting frame, and the endoscope device mounting frame is configured to be able to fix the portable endoscope integrated device on the external trolley, and the movable fixed shaft is configured as a movable structure, and the endoscope device mounting frame can rotate clockwise or counterclockwise with the movable fixed shaft as the axis; The outer shaft includes a storage basket, the storage basket has a hollow structure, and the storage basket is arranged at the upper end of the outer shaft; The trolley base includes movable wheels, and the external trolley is configured to be movable via the movable wheels.

2. The portable endoscope integrated system according to claim 1, characterized in that: The host comprises a host heat dissipation hole, and the host heat dissipation hole is arranged on one side of the host.

3. The portable endoscope integrated system according to claim 1, characterized in that: The host comprises a key area, the key area is communicatively connected to the display, the key area is communicatively connected to the host, and the key area is provided with at least one button.

4. The portable endoscope integrated system according to claim 1, characterized in that: The host comprises a light guide interface, and the light guide interface, the power switch, the optical endoscope interface and the electronic mirror interface are arranged on the same surface of the host.

5. The portable endoscope integrated system according to claim 1, characterized in that: The frame of the display is provided with a rounded corner structure.

6. The portable endoscope integrated system according to claim 1, characterized in that: A display screen protective film is arranged on the display screen of the display.

7. The portable endoscope integrated system according to claim 1, characterized in that: The power switch is provided with an anti-slip protrusion.

8. The portable endoscope integrated system according to claim 1, characterized in that: The portable endoscope integrated system also includes a button handle, the button handle includes a handle connection line and a handle head, the handle connection line is configured to be connected to an interface of the key area, the handle head includes a handle key area, the button functions on the handle key area correspond to the button functions on the key area, the portable endoscope integrated device includes a backlight circuit board, a liquid crystal screen logic board and a built-in chip, the backlight circuit board is configured to be embedded in one side of the host, the liquid crystal logic board is configured to be embedded in the other side of the host, the built-in chip is communicatively connected with the backlight circuit board and the liquid crystal screen logic board, the positions of the backlight circuit board, the liquid crystal screen logic board and the built-in chip do not overlap, the backlight circuit board and the liquid crystal screen logic board have only the main body part inserted into the host, the backlight circuit board and the liquid crystal screen logic board are both long strip-shaped structures, wherein the built-in chip is also configured as: Access patient data; storing the patient data; The patient data is synchronized to an external device.

Images