Endoscope integrated intelligent examination method and system for otorhinolaryngology department

By designing the integrated intelligent endoscopy examination system of otolaryngology, the problems of inconvenient operation, insensitivity of image processing, inconvenient data management, out-of-synchronization of endoscopy and outpatient systems and low efficiency of anesthesia and disinfection in traditional systems are solved, and efficient, convenient and intelligent endoscopy examination and diagnosis are achieved.

CN120130902APending Publication Date: 2025-06-13THE FIRST AFFILIATED HOSPITAL OF SUN YAT SEN UNIV
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202510108613.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-23
Publication Date
2025-06-13

AI Technical Summary

Technical Problem

Traditional ENT endoscopy systems have problems such as inconvenient operation, insensible image processing, inconvenient data management, out-of-synchronization of endoscopy and outpatient systems, and low efficiency of anesthesia and disinfection.

Method used

Design an integrated intelligent examination system for otolaryngology, including endoscopic equipment module, remote control handle module, communication module, anesthetic spray device and embedded software. The system solves the above problems through wireless control, deep learning image processing, automatic data recording, synchronous inspection and intelligent anesthesia and disinfection devices.

Benefits of technology

It realizes wireless control and multi-angle operation, improving the operation flexibility and diagnostic accuracy of the doctor; improving real-time image processing capabilities and supporting more accurate diagnosis; real-time data recording and management are realized to ensure data integrity and safety; synchronizing the endoscopic system with the outpatient system, improving diagnosis and treatment efficiency; improving patient comfort and examination safety through intelligent anesthesia and disinfection devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120130902A_ABST
    Figure CN120130902A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an endoscope integrated intelligent examination method and system for the otolaryngology department, and belongs to the field of image processing. The system comprises an endoscope equipment module, a remote control handle module, a communication module and an anesthetic spraying device, the endoscope equipment module comprises an endoscope, a servo motor and an image sensor; the servo motor is used for controlling bending, rotation and insertion of the endoscope; the image sensor is used for capturing an image and analyzing, identifying and marking an abnormal area; the remote control handle module is used for controlling the movement of the endoscope; the communication module is used for executing data exchange between the remote control handle module and the endoscope equipment module; the anesthetic spraying device is used for controlling an anesthesia area. Wireless control and multi-angle operation are achieved, automatic surface anesthesia of a patient is achieved, and the comfort level and safety of examination are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of image processing, and particularly to an integrated intelligent inspection method and system for endoscopes in otorhinolaryngology. Background Art

[0002] Traditional otorhinolaryngology endoscope systems are usually equipped with components such as light sources, cameras, and catheters, and rely on direct operation by physicians for inspection and diagnosis. The images collected by the camera are transmitted to the display through a wired connection. However, there are the following disadvantages: During operation, the physician needs to be in close contact with the patient, which is easily affected by changes in the patient's condition and interferes with the inspection effect. The wired connection may cause position limitations during operation, making it difficult to adjust the angle and position of the endoscope. The real-time recording and storage of data often rely on manual operation, which is prone to omissions and errors. Summary of the Invention

[0003] The main purpose of the embodiments of this application is to provide an integrated intelligent inspection method and system for endoscopes in otorhinolaryngology.

[0004] The technical solution adopted by the present invention is as follows:

[0005] On the one hand, the embodiments of the present invention provide an integrated intelligent inspection system for endoscopes in otorhinolaryngology. The integrated intelligent inspection system for endoscopes in otorhinolaryngology includes an endoscope device module, a remote control handle module, a communication module, and an anesthetic spray device;

[0006] The endoscope device module includes an endoscope, a servo motor, and an image sensor;

[0007] The servo motor is used to control the bending, rotation, and insertion of the endoscope;

[0008] The image sensor is used to capture images and perform analysis, identify and mark abnormal areas;

[0009] The remote control handle module is used to control the movement of the endoscope;

[0010] The communication module is used to perform data exchange between the remote control handle module and the endoscope device module;

[0011] The anesthetic spray device is used to control the anesthetic area.

[0012] Further, the endoscope device module further includes an embedded software module;

[0013] The embedded software module is used to receive the control instructions transmitted from the remote control handle module, control image acquisition and preprocessing, and analyze the images through a deep learning model.

[0014] Further, the remote control handle module includes a handle, a wireless module, sensors, and a feedback module;

[0015] The handle is used to output operation instructions; the handle includes control buttons and a multi-directional joystick;

[0016] The wireless module is used to perform data transmission and receive the control data of the handle;

[0017] The sensors are used to monitor the movement and angle changes of the handle; the sensors include an acceleration sensor, a position sensor, and a pressure sensor; the sensors are built into the handle;

[0018] The feedback module includes a display screen and an indicator light; the display screen is used to display the current endoscope state, positioning, and operation mode according to the data of the sensors, and the indicator light is used to perform signal adjustment prompts;

[0019] The display screen and the indicator light are installed on the handle.

[0020] Further, the anesthetic spray device includes a nozzle and a control algorithm module;

[0021] The nozzle is used to perform angle adjustment and evenly cover the anesthetic on the examination area;

[0022] The control algorithm module is used to control the distribution of the anesthetic spray according to the position of the nozzle and the information of the examination area.

[0023] Further, the image sensor includes a camera and an image processing module;

[0024] The camera is used to capture the image information of the examination area;

[0025] The image processing module is used to provide high-resolution image processing technology and deep learning algorithms, synchronously analyze and process the image information obtained by the camera, and obtain the information of the lesion area.

[0026] Further, the servo motor includes a high-precision encoder and a closed-loop control algorithm module;

[0027] The high-precision encoder is used to monitor the position and speed of the motor;

[0028] The closed-loop control algorithm module is used to adjust the control behavior according to the requirements of response speed and stability.

[0029] On the other hand, an embodiment of the present invention provides an integrated intelligent examination method for otolaryngology endoscopes, which is used to be realized by the integrated intelligent examination system for otolaryngology endoscopes as described above, and includes the following steps:

[0030] Complete the otolaryngology examination tasks through the endoscope device module, remote control handle module, communication module, and anesthetic spray device.

[0031] Furthermore, for the integrated intelligent endoscopy examination method in otolaryngology according to the embodiments of the present invention, the method further includes the following steps:

[0032] Obtain the handle control data;

[0033] Analyze the angle and force of the multi-directional joystick according to the handle control data to obtain the joystick data;

[0034] Communicate with the endoscope device module through the communication module, and the servo motor in the endoscope device module controls the movement of the endoscope according to the joystick data.

[0035] Furthermore, for the integrated intelligent endoscopy examination method in otolaryngology according to the embodiments of the present invention, the method further includes the following steps:

[0036] Obtain the online image data;

[0037] Perform image analysis through an image sensor according to the online image data to obtain the information of the lesion identification area;

[0038] Perform status monitoring and prompting through the feedback module according to the information of the lesion identification area.

[0039] Furthermore, for the integrated intelligent endoscopy examination method in otolaryngology according to the embodiments of the present invention, the method further includes the following steps:

[0040] Disinfect the endoscope;

[0041] Obtain the examination area information;

[0042] Perform local anesthesia on the examination area through a spray control model according to the examination area information and the anesthetic spray device;

[0043] The formula used in the spray control model includes:

[0044]

[0045] Where C(x s , y s , A i ) is a function of the relationship between the spray volume and the nozzle position, (x s , y s ) is the nozzle position, A i is a sub-region in the examination area, (x i , y i ) is the center point of the sub-region in the examination area, and σ is a parameter controlling the spray distribution range.

[0046] The embodiments of the present application at least include the following beneficial effects: The present application provides an integrated intelligent examination method and system for endoscopes in otolaryngology. The present invention includes an endoscope device module, a remote control handle module, a communication module, and an anesthetic spray device; the endoscope device module includes an endoscope, a servo motor, and an image sensor; the servo motor is used to control the bending, rotation, and insertion of the endoscope; the image sensor is used to capture images and perform analysis, identify and mark abnormal areas; the remote control handle module is used to control the movement of the endoscope; the communication module is used to perform data exchange between the remote control handle module and the endoscope device module; the anesthetic spray device is used to control the anesthetized area. The present invention realizes wireless control and multi-angle operation, realizes automatic topical anesthesia for patients, and improves the comfort and safety of the examination. Description of the Drawings

[0047] Figure 1 is an example diagram of the integrated intelligent examination system for endoscopes in otolaryngology provided by the embodiments of the present invention;

[0048] Figure 2 is a schematic diagram of the integrated intelligent examination method for endoscopes in otolaryngology provided by the embodiments of the present invention;

[0049] Figure 3 is a flowchart of controlling the movement of the endoscope provided by the embodiments of the present invention;

[0050] Figure 4 is a flowchart of state monitoring and prompting through the feedback module provided by the embodiments of the present invention;

[0051] Figure 5 is a flowchart of endoscope disinfection and using the anesthetic spray device provided by the embodiments of the present invention. Detailed Embodiments

[0052] In order to make the objectives, technical solutions, and advantages of the present application clearer, the following further details the present application in combination with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. When the following description involves the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the embodiments of the present application. They are only examples of devices and methods consistent with some aspects of the embodiments of the present application detailed in the appended claims.

[0053] It can be understood that the terms "first", "second", etc. used in this application may be used herein to describe various concepts, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of the embodiments of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if", "when" as used herein may be interpreted as "when...", "while...", or "in response to determining".

[0054] The terms "at least one", "a plurality of", "each", "any one", etc. used in this application, at least one includes one, two or more than two, a plurality of includes two or more than two, each refers to each one of the corresponding plurality, and any one refers to any one of the plurality.

[0055] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0056] Before elaborating on the embodiments of this application in detail, first, some nouns and terms involved in the embodiments of this application are described, and the nouns and terms involved in the embodiments of this application are applicable to the following explanations.

[0057] 1) PID control algorithm, a feedback control algorithm. PID stands for Proportion (P), Integral (I), and Derivative (D);

[0058] 2) CMOS sensor (CMOS Sensor), an image sensor, fabricated using complementary metal-oxide-semiconductor technology (CMOS), used to capture optical signals and convert them into electrical signals;

[0059] 3) SPI (Serial Peripheral Interface), a serial peripheral interface, a high-speed serial communication protocol used between a microcontroller and peripherals;

[0060] 4) I2C interface (Inter-Integrated Circuit), an interface between integrated circuits, a serial communication protocol used for communication between low-speed devices;

[0061] 5) MEMS technology (Micro-Electro-Mechanical Systems), micro-electro-mechanical systems technology;

[0062] 6) MQTT (Message Queuing Telemetry Transport), a message transmission protocol;

[0063] 7) WebSocket, a network communication protocol;

[0064] 8) AES (Advanced Encryption Standard), the Advanced Encryption Standard, a symmetric encryption algorithm used for data encryption and protection;

[0065] 9) UV-C lamp tube, a lamp tube capable of emitting ultraviolet C band (200 - 280 nm);

[0066] 10) CCD camera, a camera that uses a Charge Coupled Device (CCD) for image capture.

[0067] In consideration of the fact that indirect laryngoscopy and nasopharyngoscopy are common and essential examination and diagnosis tools in the otolaryngology outpatient department, which can effectively observe the laryngeal and nasopharyngeal parts of patients and preliminarily diagnose diseases. However, these examinations usually require face-to-face and mouth-to-mouth contact between doctors and patients, which is unhygienic. In addition, the commonly used otolaryngology endoscope systems in clinics usually require special personnel to operate, and it is impossible to synchronize images with outpatient consultations. Moreover, the topical anesthesia before endoscope operation is time-consuming and laborious, and the endoscope cleaning and disinfection processes are complex, seriously affecting the diagnosis and treatment efficiency and increasing the economic burden on patients. Therefore, developing a convenient, efficient, visual, and reusable otolaryngology outpatient endoscope integrated synchronization examination system has become an urgent medical need.

[0068] The present invention takes into account the following technical problems:

[0069] 1. Insufficient remote control and flexibility: Traditional endoscopes lack the ability of remote control, require close contact with patients, and physicians are limited by space and perspective during the examination process. Therefore, the present invention requires a system that can achieve wireless control and multi-angle operation to improve the operation flexibility of physicians.

[0070] 2. Real-time image processing ability: Existing endoscope systems lack intelligent processing in image analysis and anomaly detection and cannot effectively support rapid clinical decision-making. The present invention needs to introduce deep learning and AI technologies to improve the analysis ability of real-time images and provide more accurate diagnostic support.

[0071] 3. Insufficiency in data management and recording: Traditional endoscope systems still rely on manual work for data recording, and it is the technical work of special personnel in the endoscopy room or doctors, and there are potential risks in data security and continuity. The present invention needs to implement a system for automatic recording and synchronous management to ensure the integrity and security of patient data.

[0072] 4. The endoscopy system cannot be synchronized with the outpatient system: The traditional endoscopy system is operated by a dedicated endoscopy technician and cannot perform precise examinations in combination with the disease characteristics and needs of patients. The present invention synchronizes the endoscopy system with the outpatient consultation system. The consulting doctor can perform synchronous examinations and view endoscopy images in the consulting room, and can give rapid diagnoses and treatments in a timely manner, which can greatly improve the diagnosis and treatment efficiency, and also does not require endoscopy technicians, reducing waste of medical resources.

[0073] 5. Low efficiency of anesthesia and disinfection: The prior art lacks the integration of the anesthesia process and disinfection process for visual endoscopic operations, resulting in the need for dedicated personnel to perform topical anesthesia on patients and dedicated endoscope disinfection, which is time-consuming and laborious. The present invention needs to design an integrated anesthetic spray and disinfection device, which can achieve automatic topical anesthesia for patients and improve the comfort and safety of examinations.

[0074] The following further elaborates on the embodiments of the present invention in conjunction with the accompanying drawings.

[0075] On the one hand, referring to Figure 1 , an endoscopic integrated intelligent examination system for otolaryngology is provided in an embodiment of the present invention. The endoscopic integrated intelligent examination system for otolaryngology includes an endoscopic device module, a remote control handle module, a communication module, and an anesthetic spray device;

[0076] The endoscopic device module includes an endoscope, a servo motor, and an image sensor;

[0077] The servo motor is used to control the bending, rotation, and insertion of the endoscope;

[0078] The image sensor is used to capture images and perform analysis, identify and mark abnormal areas;

[0079] The remote control handle module is used to control the movement of the endoscope;

[0080] The communication module is used to perform data exchange between the remote control handle module and the endoscopic device module;

[0081] The anesthetic spray device is used to control the anesthetized area.

[0082] Further, the endoscopic device module further includes an embedded software module;

[0083] The embedded software module is used to receive control instructions transmitted from the remote control handle module, control image acquisition and preprocessing, and analyze the images through a deep learning model.

[0084] Further, the remote control handle module includes a handle, a wireless module, a sensor, and a feedback module;

[0085] The handle is used to output operation instructions; the handle includes control buttons and a multi-directional joystick;

[0086] The wireless module is used to perform data transmission and receive the control data of the handle.

[0087] The sensor is used to monitor the movement and angle change of the handle; the sensor includes an acceleration sensor, a position sensor, and a pressure sensor; the sensor is built into the handle.

[0088] The feedback module includes a display screen and an indicator light; the display screen is used to display the current endoscope state, positioning, and operation mode according to the data of the sensor, and the indicator light is used to perform signal adjustment prompts.

[0089] The display screen and the indicator light are installed on the handle.

[0090] As an optional implementation method, remote control of the handle operation:

[0091] The operator holds the remote control handle, and the handle communicates with the endoscope control system through a wireless module (such as Bluetooth or Wi-Fi).

[0092] The operator adjusts the angle and force of the handle through the multi-directional joystick to control the actions of the endoscope such as insertion, retraction, and rotation. These instructions are transmitted to the control computer through a low-power Bluetooth or Wi-Fi wireless module, and the endoscope actions are realized through the control computer instructions.

[0093] The servo motor in the endoscope system controls the precise movement of the endoscope according to the instructions issued by the handle, ensuring that the endoscope can safely and smoothly enter the patient's nasal cavity or throat for examination.

[0094] The feedback module combines sensors (such as position sensors and pressure sensors) to monitor the real-time state and position of the endoscope, preventing the endoscope from being inserted too deeply or over-pressured.

[0095] These feedback data are transmitted to the control computer through wireless communication, and the doctor can obtain the real-time state of the endoscope through the screen to ensure the safety and effectiveness of the examination operation.

[0096] Furthermore, the anesthetic spray device includes a nozzle and a control algorithm module;

[0097] The nozzle is used to perform angle adjustment to evenly cover the anesthetic on the examination area;

[0098] The control algorithm module is used to control the distribution of the anesthetic spray according to the position of the nozzle and the information of the examination area.

[0099] As an optional implementation method, aim the anesthetic sprayer at the patient's ear, nose, and throat area and press the spray button for local anesthesia. At this time, the anesthetic is evenly covered on the examination area through micron-level spray technology. The device can adjust the angle of the spray port to ensure accurate spraying of the anesthetic.

[0100] Further, the image sensor includes a camera and an image processing module;

[0101] The camera is used to capture the image information of the inspection area;

[0102] The image processing module is used to provide high-resolution image processing technology and deep learning algorithms, synchronously analyze and process the image information obtained by the camera, and obtain the information of the lesion area.

[0103] In some embodiments, the image sensor of the endoscope device module captures a real-time image, and the image is transmitted to the display module through the endoscope control computer, and the doctor can immediately observe the internal situation. The camera is equipped with deep learning algorithms, and image processing and analysis are synchronously performed during the image acquisition process to automatically identify the lesion area.

[0104] Image analysis: The deep learning algorithm processes the image through a convolutional neural network (CNN), automatically marks the possible lesion areas, and generates a diagnostic report in real time. The doctor can make a timely diagnosis based on this report.

[0105] Further, the servo motor includes a high-precision encoder and a closed-loop control algorithm module;

[0106] The high-precision encoder is used to monitor the position and speed of the motor;

[0107] The closed-loop control algorithm module is used to adjust the control behavior according to the requirements of response speed and stability.

[0108] On the other hand, referring to Figure 2 , the embodiment of the present invention also provides an integrated intelligent inspection method for endoscopes in otolaryngology, which is used to be realized by the integrated intelligent inspection system for endoscopes in otolaryngology as described above, and includes the following steps:

[0109] S100. Complete the otolaryngology inspection task through the endoscope device module, the remote control handle module, the communication module, and the anesthetic spray device.

[0110] Further, referring to Figure 3 , the integrated intelligent inspection method for endoscopes in otolaryngology according to the embodiment of the present invention further includes the following steps:

[0111] S200. Obtain the handle control data;

[0112] S300. Analyze the angle and force of the multi-directional joystick according to the handle control data to obtain the joystick data;

[0113] S400. Communicate with the endoscope device module through the communication module, and the servo motor in the endoscope device module controls the movement of the endoscope according to the joystick data.

[0114] Further, referring toFigure 4 , the endoscopic integrated intelligent examination method for otolaryngology in the embodiments of the present invention further includes the following steps:

[0115] S500. Obtain online image data;

[0116] S600. Perform image analysis through an image sensor based on the online image data to obtain lesion identification area information;

[0117] S700. Perform status monitoring and prompting through a feedback module based on the lesion identification area information.

[0118] Further, referring to Figure 5 , the endoscopic integrated intelligent examination method for otolaryngology in the embodiments of the present invention further includes the following steps:

[0119] S800. Disinfect the endoscope;

[0120] S900. Obtain examination area information;

[0121] S1000. Perform local anesthesia on the examination area through a spray control model according to the examination area information and the anesthetic spray device;

[0122] The formula used by the spray control model includes:

[0123]

[0124] Among them, C(x s , y s , A i ) is a function of the relationship between the spray volume and the nozzle position, (x s , y s ) is the nozzle position, A i is a sub-region in the examination area, (x i , y i ) is the center point of the sub-region in the examination area, and σ is a parameter for controlling the spray distribution range.

[0125] x s is the abscissa of the nozzle position, y s is the ordinate of the nozzle position, x i is the abscissa of the center point of the sub-region in the examination area, and y i is the ordinate of the center point of the sub-region in the examination area.

[0126] As an optional implementation manner, the anesthetic spray device of the present invention includes a nozzle and a control algorithm module, and the control algorithm module includes a spray control model. The formula used by the spray control model of the present invention for calculating the spray volume includes:

[0127] Mi = Q s ×t×C(x s ,y s ,A i )

[0128] Wherein, M i is the dosage of anesthetic in sub-region A i , t is the spraying duration, and Q s is the spraying flow rate (unit: ml / s).

[0129] As an optional implementation manner, the embodiment of the present invention provides a visualization and intelligent integrated endoscopy outpatient system, which includes: an endoscope device module, an image acquisition unit, a control unit, a communication module, and a remote operation terminal.

[0130] 1. The endoscope device module includes:

[0131] Servo motor: used to control the bending, rotation, and insertion of the endoscope, providing high-precision motion control. High-precision encoders and closed-loop control algorithms are adopted to monitor the position and speed of the motor in real time, ensuring the stability and accuracy of the endoscope movement.

[0132] Embedded software: responsible for receiving control instructions from the handle and adjusting the output of the motor through the PID control algorithm to achieve precise endoscope movement.

[0133] Image sensor: The image sensor is a camera built with an image processing module having a deep learning algorithm, which captures and synchronously analyzes the image information of the examination area in real time; the camera uses a high-resolution and high-frame-rate CMOS sensor to ensure the clarity and real-time nature of the image. The deep learning algorithm performs real-time analysis on the image through a convolutional neural network (CNN), automatically identifies the lesion area, and captures and synchronously analyzes the image information of the examination area in real time; Embedded software: The embedded software is responsible for image acquisition and preprocessing, and performs real-time analysis on the image through a deep learning model. The model uses GPU acceleration to improve the calculation efficiency.

[0134] Function implementation: The endoscope system inserts deeply into the ear, nose, and throat through a slender endoscope body for examination, and captures real-time images through the front-end camera. The endoscope body is made of high-strength and low-weight materials to ensure its flexibility and durability. The light source uses an LED light source to provide uniform and bright illumination. Innovation point: A camera with an image processing module having a deep learning algorithm is adopted, which supports automatic image recognition and anomaly detection, realizing intelligent identification and diagnosis of lesions; the deep learning algorithm automatically marks the lesion area and generates a diagnostic report through pre-trained models and real-time inference. The model improves the recognition accuracy through continuous data training and optimization.

[0135] 2. The remote control handle module includes:

[0136] Wireless Module: The handle is built-in with a low-power Bluetooth or Wi-Fi module to ensure the stability and low latency of data transmission. The wireless module communicates with the handle control unit through the SPI or I2C interface for wireless data transmission and receives instructions from the control computer.

[0137] Sensor: The handle is equipped with an acceleration sensor inside. The acceleration sensor adopts MEMS technology to monitor the movement and angle changes of the handle in real time. The sensor data is transmitted to the control computer through the wireless module. The operator's actions are grasped in real time and corresponding instruction conversions are performed. The handle is designed with ergonomics in mind, having a shape that is comfortable to hold by hand, and is equipped with a variety of control buttons and joysticks to achieve fine adjustment of the endoscope movement.

[0138] Sensor and Feedback Module: The endoscope system is equipped with a variety of sensors inside (such as position sensors, pressure sensors, etc.). The position sensor adopts magnetic encoder or laser ranging technology to monitor the insertion depth and angle of the endoscope in real time. The pressure sensor is used to monitor the force on the tissue to prevent excessive compression and can monitor the state and position of the endoscope in real time. This feedback data is returned to the handle through wireless signals to update the operator's operation information in real time.

[0139] Visual Feedback: A small display screen or LED indicator can be equipped on the handle to display the current state, positioning, and operation mode of the endoscope to help the operator make timely adjustments.

[0140] Function Realization:

[0141] Multi-directional Joystick: The joystick in the handle adopts a multi-axis design, supporting movements in multiple directions such as up and down, left and right, and rotation. The operator controls the insertion, retraction, and rotation of the endoscope by adjusting the angle and force of the joystick.

[0142] Using wireless communication technology (such as Bluetooth or Wi-Fi), the operator's instructions are fed back to the endoscope control system in real time.

[0143] Innovation Point: Compared with traditional manual control, this handle supports precise control in multiple directions with high sensitivity, greatly improving the control efficiency.

[0144] 3. Remote Operation Terminal

[0145] Embedded Software: Installed in the outpatient computer system, the software is also responsible for receiving feedback information, performing data integration, and updating the user interface. By setting a unified communication protocol, the handle and the endoscope can be connected to other devices such as the medical management system for information docking, realizing data sharing and operation recording. Runs a dedicated software for controlling endoscope operations, processes real-time data and image data transmitted by the handle. Display Module: Updates real-time endoscope images and displays endoscope status information. Displays a small window for real-time images and control buttons (such as "Start", "Stop"), as well as an endoscope status information bar. Integrates an AI algorithm for real-time image analysis, which can quickly identify the lesion area and give prompts. Among them, the display module uses a GPU-accelerated image processing algorithm to ensure smooth display of real-time images. The AI algorithm performs real-time analysis on the images through a deep learning model and automatically marks the lesion area.

[0146] Function Realization: Used to receive control instructions and endoscope feedback information from the handle, and perform data processing and display. Adopts an operating system with a user-friendly interface, integrating functions such as real-time video monitoring, instruction reception, and operation recording.

[0147] 4. Wireless Communication Module

[0148] The handle integrates a wireless communication module, such as Bluetooth or Wi-Fi, providing the ability to interact with the endoscope system. This allows for remote control without physical connection, reducing the limitations of operation. Real-time Data Transmission: The handle converts the operator's instructions into digital signals and transmits them to the endoscope control system in real-time through the wireless network. Adopts a low-latency protocol (such as MQTT or WebSocket) to ensure that the response time is within an acceptable range. Data Encryption: Ensures the security and integrity of information during transmission, and adopts the AES (Advanced Encryption Standard) encryption protocol.

[0149] Function Realization: Supports two-way data transmission between the handle and the endoscope controller, and between the endoscope and the computer. Uses low-latency and high-bandwidth wireless transmission technology to greatly improve the real-time performance of operation feedback.

[0150] 5. Anesthetic Spray Device

[0151] Nozzle Design: Adopts micron-level spraying technology to ensure uniform coverage of the anesthetic on the examination area. The spray outlet is designed with an adjustable angle to facilitate medical staff to align with the examination area. Before the examination, medical staff can align the spray outlet with the patient's nasal cavity or throat area by spraying, and press the nozzle button for spraying to perform local anesthesia and improve the patient's comfort.

[0152] 6. Disinfection System

[0153] After soaking in the quick-soaking disinfection tank for 5 minutes, it is placed in an ultraviolet disinfection cabinet. The disinfection tank uses chemical disinfectant to soak the endoscope to kill most bacteria and viruses. The ultraviolet disinfection cabinet uses UV-C lamps with a specific wavelength to further kill the remaining pathogens.

[0154] As an optional implementation method, the execution steps include:

[0155] The patient is sitting upright on the outpatient clinic chair. The medical staff aims the anesthetic sprayer at the ENT part and presses the spray button to spray the anesthetic to achieve local anesthesia. The operator holds the remote control handle, and the joystick moves downward. The fiber endoscope is gradually inserted into the patient's nasal cavity under the instruction of the computer. After the endoscope enters, the camera takes real-time pictures and transmits the images to the control computer. The doctor can observe the internal situation on the display screen and perform necessary operations. The camera has an image processing module with deep learning algorithm, which supports synchronized intelligent image recognition and abnormal detection prompts. Through Bluetooth, the status information feedback by the endoscope is synchronized to the control computer in real time, and the system automatically records the operation data for later review. After the inspection is completed, the endoscope is put into the disinfection tank, and the ultraviolet disinfection system is started for quick disinfection to ensure the safety of the next patient.

[0156] The beneficial effects of the present invention are as follows: By integrating advanced hardware devices and intelligent algorithms, this invention patent provides an efficient, convenient and intelligent visual and intelligent endoscopy outpatient integrated system. Through innovative designs such as remote control handles, high-precision servo motors, and deep learning image processing modules, precise control and intelligent diagnosis of endoscope operations are realized. The embedded software and wireless communication module of the system ensure real-time data transmission and secure encryption, improving the convenience and safety of operations. The anesthetic spray device and disinfection system further enhance the patient's comfort and the safety of the operation, providing comprehensive technical support for the diagnosis and treatment of otolaryngology.

[0157] The key points of the present invention:

[0158] 1. Remote control handle: Adopting wireless communication technology (such as Bluetooth or Wi-Fi) to achieve real-time remote control of the endoscope.

[0159] Its operation should have multi-directional precise control and emergency stop functions to provide safety guarantee for medical operations.

[0160] 2. Intelligent endoscope equipment module: The endoscope adopts a high-resolution CCD camera and an advanced lighting system to provide clear real-time images. Introducing deep learning or artificial intelligence technology to support automatic analysis and abnormal detection of real-time images, improving the diagnostic efficiency and accuracy.

[0161] 3. Data transmission and processing: Design an efficient wireless data transmission module to achieve high-bandwidth and low-latency data information intercommunication.

[0162] Supports real-time feedback and recording of data, which helps with subsequent review and data analysis.

[0163] 4. Local anesthesia and disinfection system: The system integrates an anesthetic spray device to perform local anesthesia quickly and evenly.

[0164] During the disinfection process, chemical disinfection and ultraviolet technology are combined to ensure the safe use of the endoscope and improve the sterility of the medical environment.

[0165] 5. Protect the design process, wireless connection mode, and real-time control function of the remote control handle. Patents for high-resolution cameras and intelligent analysis functions in the endoscope and its image processing device.

[0166] 6. Protection for the integration of a visualization and intelligent endoscopy outpatient integrated system: How each part in the entire endoscope system combines to form an efficient outpatient workflow, including the organic integration methods of anesthesia, examination, image analysis, and disinfection.

[0167] 7. Application of intelligent technology: Protect the implementation of artificial intelligence algorithms for image analysis and automatic detection, including models and methods for medical image data analysis.

[0168] 8. Anesthetic spray and disinfection technology: Protection can be provided for the use of specific structures and chemical formulations of anesthetic sprays. Patents for the combination method of ultraviolet and chemical disinfection in the disinfection system.

[0169] On the other hand, an embodiment of the present invention also provides an integrated intelligent examination device for otolaryngology endoscopes, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it implements the integrated intelligent examination method for otolaryngology endoscopes as described above.

[0170] The processor and the memory can be connected through a bus or other means. The memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. In addition, the memory can include high-speed random access memory, and can also include non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory can optionally include a memory remotely set relative to the processor, and these remote memories can be connected to the processor through a network. Examples of the above networks include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0171] On the other hand, an embodiment of the present invention further provides a computer-readable storage medium storing computer-executable instructions for causing a computer to execute the endoscopic integrated intelligent examination method for otorhinolaryngology as described above.

[0172] Those of ordinary skill in the art will appreciate that all or some of the steps and systems disclosed in the methods above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, a communication medium typically includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium.

[0173] The preferred embodiments of the embodiments of the present application have been described above with reference to the accompanying drawings, and thus do not limit the scope of the rights of the embodiments of the present application. Any modifications, equivalent replacements, and improvements made by those skilled in the art without departing from the scope and essence of the embodiments of the present application shall be within the scope of the rights of the embodiments of the present application.

Claims

1. An integrated intelligent endoscope inspection system for otorhinolaryngology, characterized in that: The endoscopic integrated intelligent inspection system for the Department of Otolaryngology includes an endoscopic device module, a remote control handle module, a communication module, and an anesthetic spray device; The endoscope equipment module includes an endoscope, a servo motor, and an image sensor; The servo motor is used to control the bending, rotation and insertion of the endoscope; The image sensor is used to capture images and analyze them to identify and mark abnormal areas; The remote control handle module is used to control the movement of the endoscope; The communication module is used to perform data exchange between the remote control handle module and the endoscope device module; The anesthetic spray device is used to control the anesthesia area.

2. The integrated intelligent endoscope inspection system for otorhinolaryngology according to claim 1, characterized in that: The endoscope device module also includes an embedded software module; The embedded software module is used to receive control instructions from the remote control handle module, control image acquisition and preprocessing, and analyze the image through a deep learning model.

3. The integrated intelligent endoscope inspection system for otorhinolaryngology according to claim 1, characterized in that: The remote control handle module includes a handle, a wireless module, a sensor and a feedback module; The handle is used to output operation instructions; the handle includes a control button and a multi-directional joystick; The wireless module is used to perform data transmission and receive the control data of the handle; The sensor is used to monitor the movement and angle change of the handle; the sensor includes an acceleration sensor, a position sensor, and a pressure sensor; the sensor is built into the handle; The feedback module includes a display screen and an indicator light; the display screen is used to display the current endoscope state, positioning and operation mode according to the data of the sensor, and the indicator light is used to perform signal adjustment prompts; The display screen and the indicator light are installed on the handle.

4. The integrated intelligent endoscope inspection system for otorhinolaryngology according to claim 1, characterized in that: The anesthetic spray device includes a nozzle and a control algorithm module; The nozzle is used to perform angle adjustment to evenly cover the examination area with anesthetic; The control algorithm module is used to control the distribution of the anesthetic spray according to the position of the nozzle and the information of the inspection area.

5. The integrated intelligent endoscope inspection system for otorhinolaryngology according to claim 1, characterized in that: The image sensor includes a camera and an image processing module; The camera is used to capture image information of the inspection area; The image processing module is used to provide high-resolution image processing technology and deep learning algorithms, and synchronously analyze and process the image information acquired by the camera to acquire lesion area information.

6. The integrated intelligent endoscope inspection system for otorhinolaryngology according to claim 1, characterized in that: The servo motor includes a high-precision encoder and a closed-loop control algorithm module; The high-precision encoder is used to monitor the position and speed of the motor; The closed-loop control algorithm module is used to adjust the control behavior according to the response speed and stability requirements.

7. An integrated intelligent endoscopic examination method for otorhinolaryngology, which is implemented by an integrated intelligent endoscopic examination system for otorhinolaryngology according to any one of claims 1 to 6, characterized in that: The following steps are involved: Complete otolaryngology examination tasks through the endoscope equipment module, remote control handle module, communication module and anesthetic spray device.

8. The endoscopic integrated intelligent inspection method for otorhinolaryngology according to claim 7, characterized in that: The method further comprises the following steps: Get handle control data; Analyze the angle and force of the multi-directional joystick according to the handle manipulation data to obtain joystick data; The communication module communicates with the endoscope device module, and the servo motor in the endoscope device module controls the movement of the endoscope according to the joystick data.

9. The endoscopic integrated intelligent inspection method for otorhinolaryngology according to claim 7, characterized in that: The method further comprises the following steps: Get online image data; According to the online image data, image analysis is performed by an image sensor to obtain lesion identification area information; According to the lesion identification area information, status monitoring and prompting are performed through a feedback module.

10. The endoscopic integrated intelligent inspection method for otorhinolaryngology according to claim 7, characterized in that: The method further comprises the following steps: Disinfect the endoscope; Get inspection area information; According to the inspection area information and the anesthetic spray device, local anesthesia is performed on the inspection area through the spray control model; The formula used in the spray control model includes: Among them, C(x s ,y s ,A i ) is a function of the relationship between the spray volume and the nozzle position, (x s ,y s ) is the nozzle position, A i is a sub-region in the inspection region, (x i ,y i ) is the center point of the sub-area in the inspection area, and σ is the parameter that controls the spray distribution range.

Citation Information

Patent Citations

  • Ultrasonic probe for ear-nose-throat department

    CN106510762A

  • Intelligent ear-nose-throat examination device

    CN112914476A

  • Steerable endoscope system with enhanced view

    CN114727746A

  • Visual throat surface anesthesia sprayer

    CN209933718U