Endoscope Light Source Control System and Control Method
The endoscope position is recognized through the camera and neural network, combined with the temperature sensor, and intelligent control of the endoscope light source is realized, solving the problem of forgetting to turn it off after use, and improving safety and life.
Patent Information
- Application Number
- CN202111172880.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-08
- Publication Date
- 2025-07-04
- Estimated Expiration
- 2041-10-08
AI Technical Summary
Forgot to turn off the endoscope light source after use, resulting in shortening of life and safety risks. The conventional automatic standby method cannot effectively control the light source without any obstruction.
Obtain endoscopic image information through the camera, use neural networks or machine learning algorithms to identify the endoscopic position, automatically control the light source to turn on or off, and combine it with a temperature sensor to prevent fire.
It realizes intelligent control of the endoscope light source, avoiding the shortening of life and safety risks caused by forgetting to turn it off after use, and improving the safety of use and system reliability.
Smart Images

Figure CN115956869B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of endoscope light source control, and particularly to an endoscope light source control system and a control method thereof. Background Art
[0002] In an endoscope light source control system, the light source is an essential component, which is used to provide illumination for the interior of the human body. After use, it is easy to shorten the service life of the light source due to forgetting to turn it off. Especially when the endoscope is in the fluorescence mode, the laser will be turned on. If the system is in the fluorescence mode after use, the laser will always be on, which will pose potential safety hazards: for example, if the laser irradiates on black flammable objects (such as black curtains) for a long time, it is easy to cause a fire; if the interface part between the light guide beam and the endoscope is always in contact with flammable objects (such as clothes), it is also easy to cause a fire.
[0003] For the conventional method of realizing automatic standby of the endoscope light source based on detecting the reflected light intensity, it is necessary to detect the reflected light intensity. If the front of the lens of the endoscope light source control system is always unobstructed after use, the detected light intensity will not change before and after, and the system may not be able to achieve light source standby.
[0004] Therefore, it is necessary to improve the existing problems. Summary of the Invention
[0005] In view of the problems existing in the prior art, the present application provides an endoscope light source control system, which includes a light source, a light guide beam, an endoscope, a camera, and a control device;
[0006] The light source is connected to the endoscope through the light guide beam and is configured to emit an optical signal;
[0007] The endoscope is configured to receive the optical signal sent by the light source through the light guide beam to illuminate the imaged part to be irradiated, and receive the image signal formed by the optical signal irradiating on the imaged part;
[0008] The camera is connected to the endoscope and is configured to receive the image signal transmitted by the endoscope and process the image signal to obtain the original image information;
[0009] The control device is connected to the camera and communicatively connected to the light source, and is configured to receive the original image information from the camera and process it to obtain an imaging picture, and identify the position of the endoscope represented by the imaged part in the imaging picture, and control the light source based on the identification result.
[0010] Optionally, the control device is configured to classify and identify the imaging picture and output the corresponding classification and identification result, including:
[0011] When the classification recognition result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification recognition result is an ex-vivo picture, the accumulated number of the ex-vivo pictures is compared with a set threshold value and a first comparison result is output. When the first comparison result is that the accumulated number is less than the set threshold value, an instruction to count the ex-vivo pictures to increase the value of the accumulated number is sent; when the first comparison result is that the accumulated number is greater than or equal to the set threshold value, an instruction to inhibit the light source is sent.
[0012] Optionally, the control device includes:
[0013] An image processing unit configured to receive the original image information and obtain an imaging picture;
[0014] A classification recognition unit configured to classify and recognize the position of the imaging picture and output the classification recognition result;
[0015] A control unit configured to receive the classification recognition result and send corresponding instructions according to the classification recognition result. When the classification recognition result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification recognition result is an ex-vivo picture, the accumulated number of the ex-vivo pictures is compared with a set threshold value and a first comparison result is output. When the first comparison result is that the accumulated number is less than the set threshold value, an instruction to count the ex-vivo pictures to increase the value of the accumulated number is sent; when the first comparison result is that the accumulated number is not less than the set threshold value, an instruction to inhibit the light source is sent.
[0016] Optionally, the classification recognition unit is configured to classify and recognize the imaging picture through a neural network algorithm or a machine learning algorithm and output a classification recognition result.
[0017] Optionally, the control device includes:
[0018] A counting unit configured to receive and execute an instruction to count the ex-vivo pictures to increase the value of the accumulated number.
[0019] Optionally, after sending an instruction to count the ex-vivo pictures to increase the value of the accumulated number, the control unit re-acquires a picture after a predetermined time, outputs the recognition result and the first comparison result of the re-acquired picture, and sends corresponding instructions based on the re-obtained recognition result and / or the first comparison result.
[0020] Optionally, the control device is configured to send an instruction to initialize at least one of the cumulative number, the preset threshold, and the predetermined time when the endoscopic light source control system is started and / or when the first comparison result is that the cumulative number is not less than the preset threshold.
[0021] Optionally, the system further includes:
[0022] A temperature sensing unit configured to detect the real-time temperature at a predetermined position within the endoscopic light source control system and transmit it to the control device;
[0023] The control device is configured to compare the real-time temperature with a first preset temperature and output a second comparison result when the classification and recognition result is an in-vivo picture, and send an instruction to give a warning when the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature; or
[0024] When the classification and recognition result is an ex-vivo picture, compare the real-time temperature with a second preset temperature and output a third comparison result, and send an instruction to inhibit the light source when the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature.
[0025] Optionally, the predetermined position is at least one of the front end of the endoscope and / or the junction of the light guide beam and the rigid endoscope of the endoscope.
[0026] Optionally, the system further includes:
[0027] A display device connected to the control device and configured to receive and display the imaging picture or receive an imaging picture processing instruction from the user.
[0028] The present application also provides a control method for an endoscopic light source control system. The endoscopic light source control system includes a light source, a light guide beam, an endoscope, a camera, and a control device. The light source is connected to the endoscope through the light guide beam, the camera is connected to the endoscope, and the control device is connected to the camera and communicatively connected to the light source. The control method includes:
[0029] The light source emits an optical signal;
[0030] The endoscope receives the optical signal sent by the light source through the light guide beam to illuminate the imaged part to be irradiated, and receives the image signal formed by the optical signal irradiating the imaged part;
[0031] The camera receives the image signal transmitted by the endoscope and processes the image signal to obtain the original image information;
[0032] The control device receives the original image information from the camera, processes it to obtain an imaging picture, identifies the position of the endoscope based on the position of the imaging part represented in the imaging picture, and controls the light source based on the identification result.
[0033] Optionally, the identifying the position of the endoscope based on the position of the imaging part represented in the imaging picture and controlling the light source based on the identification result includes:
[0034] Classifying and identifying the imaging picture and outputting a corresponding classification and identification result;
[0035] When the classification and identification result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification and identification result is an ex-vivo picture, the cumulative number of ex-vivo pictures is compared with a set threshold and a first comparison result is output. When the first comparison result is that the cumulative number is less than the set threshold, an instruction to count the ex-vivo pictures to increase the value of the cumulative number is sent; when the first comparison result is that the cumulative number is greater than or equal to the set threshold, an instruction to inhibit the light source is sent.
[0036] Optionally, the classification and identification unit is configured to classify and identify the imaging picture through a neural network algorithm or a machine learning algorithm and output a classification and identification result.
[0037] Optionally, the control method further includes:
[0038] Counting the ex-vivo pictures to increase the value of the cumulative number.
[0039] Optionally, the control method includes:
[0040] After counting the ex-vivo pictures to increase the value of the cumulative number, after a predetermined time, pictures are acquired again, the identification result and the first comparison result of the pictures acquired again are output, and corresponding instructions are sent based on the re-acquired identification result and / or the first comparison result.
[0041] Optionally, the control method includes:
[0042] When the endoscope light source control system is started and / or when the first comparison result is that the cumulative number is not less than the set threshold, at least one of the cumulative number, the preset threshold, and the predetermined time is initialized.
[0043] Optionally, it further includes:
[0044] Detecting the real-time temperature at a predetermined position in the endoscope light source control system and transmitting it to the control device;
[0045] When the classification recognition result is an in-vivo picture, compare the real-time temperature with a first preset temperature and output a second comparison result. When the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature, send an instruction to give a warning; or when the classification recognition result is an in-vitro picture, compare the real-time temperature with a second preset temperature and output a third comparison result. When the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature, send an instruction to suppress the light source.
[0046] Optionally, the predetermined position is at least one of the front end of the endoscope and / or the joint of the light guide beam and the rigid endoscope of the endoscope.
[0047] Optionally, the endoscope light source control system further includes a display device, which is connected to the control device. The control method further includes receiving and displaying the imaging picture through the display device or receiving a picture processing instruction from the user through the display device.
[0048] To solve the current existing technical problems, the present application provides an endoscope light source control system and a control method. The control system and the control method process the received original image information from the camera to obtain an imaging picture, and identify according to the position of the endoscope represented by the imaging part in the imaging picture. Based on the recognition result of the position of the endoscope, control the light source to keep it on or off. The control system and the method are simpler and have lower costs, so as to avoid problems caused by forgetting to suppress the light source after use. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] The following drawings of the present application are used as a part of the present application to understand the present application. The embodiments of the present application and their descriptions are shown in the drawings to explain the device and principle of the present application. In the drawings,
[0050] Figure 1 A schematic block diagram of an endoscope light source control system according to an embodiment of the present application is shown;
[0051] Figure 2 A schematic flowchart of an endoscope light source control method according to an embodiment of the present application is shown;
[0052] Figure 3 A flowchart block diagram of an endoscope light source control method according to another embodiment of the present application is shown. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0053] To make the objectives, technical solutions, and advantages of the present application more apparent, the following will describe exemplary embodiments according to the present application in detail with reference to the accompanying drawings. Apparently, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. It should be understood that the present application is not limited by the exemplary embodiments described herein. Based on the embodiments of the present application described herein, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present application.
[0054] In the following description, numerous specific details are given to provide a more thorough understanding of the present application. However, it is obvious to those skilled in the art that the present application can be implemented without one or more of these details. In other examples, to avoid confusion with the present application, some well-known technical features are not described.
[0055] It should be understood that the present application can be implemented in different forms and should not be construed as limited to the embodiments presented herein. On the contrary, providing these embodiments will make the disclosure thorough and complete, and will fully convey the scope of the present application to those skilled in the art.
[0056] The purpose of the terms used herein is only to describe specific embodiments and is not a limitation of the present application. When used herein, the singular forms "a", "an", and "the" are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the terms "comprising" and / or "including", when used in this specification, determine the presence of the described features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups. When used herein, the term "and / or" includes any and all combinations of the related listed items.
[0057] To thoroughly understand the present application, detailed structures will be presented in the following description to illustrate the technical solutions proposed by the present application. The optional embodiments of the present application are described in detail as follows. However, in addition to these detailed descriptions, the present application can also have other implementation manners.
[0058] To solve the technical problems of the present application, an endoscope light source control system and an endoscope light source control method are provided. Among them, the endoscope light source control method is based on the endoscope light source control system and is implemented through the endoscope light source control system.
[0059] To facilitate the explanation and description of the endoscope light source control method, the endoscope light source control system will be described in detail first.
[0060] Next, reference will be made to Figure 1Describe an endoscopic light source control system according to an embodiment of the present application. Figure 1 It is a schematic structural diagram of an endoscopic light source control system according to an embodiment of the present application.
[0061] As Figure 1 shown, the endoscopic light source control system 100 includes a light source 101, a light source power cord, an endoscope 103 (such as a laparoscope, a hysteroscope), a light guide beam 102, a camera 104, and a host (not shown). In addition, the endoscopic light source control system 100 may further include a host power cord, a CAN port line, a pneumoperitoneum machine, a pneumoperitoneum machine power cord, an air supply tube, a pneumoperitoneum tube, a display screen, a display screen power adapter, a video connection cable, etc.
[0062] Among them, the light source 101 is used to emit light. The light source power cord is connected to the power supply and the light source 101 to supply power to the light source 101. The light source 101 is connected to the host through a CAN port line, so that the host can send instructions to the light source 101 to control the switch and brightness of the light source 101.
[0063] Among them, the host is configured to present the imaging pictures on the display screen. The host power cord is connected to the power supply and the host to supply power to the host.
[0064] Among them, the camera 104 is configured to capture images. The cable tail of the camera 104 is connected to the host, and the bayonet at the head of the camera 104 is connected to the camera 104 interface of the endoscope 103. One end of the light guide beam 102 is connected to the light source 101, and the other end is connected to the light guide beam 102 interface of the endoscope 103. The light emitted by the light source 101 can enter the endoscope 103 through the light guide beam 102 and exit from the lens of the endoscope 103. Among them, the endoscope 103 is configured to enter the internal environment of the human body.
[0065] Among them, the display screen is configured to display the imaging pictures. The display screen power adapter is connected to the power supply and the display screen to supply power to the display screen. One end of the video connection cable is connected to the video output interface of the host, and the other end is connected to the video input interface of the display screen.
[0066] Among them, the pneumoperitoneum machine is used to inflate the human abdominal cavity to facilitate the doctor's operation. One end of the air supply tube is connected to the carbon dioxide outlet of the operating room, and the other end is connected to the air inlet of the pneumoperitoneum machine. One end of the pneumoperitoneum tube is connected to the air outlet of the pneumoperitoneum machine, and the other end is inserted into the human abdominal cavity. When all the above devices are connected, the endoscope 103 can be inserted into the body to observe the internal situation from the display screen.
[0067] Among them, the endoscopic light source control system 100 further includes a control device 105. The control device 105 can be set in the host or can be set independently of the host, which is not limited here.
[0068] When the endoscope light source control system 100 works, the light source 101 is connected to the endoscope 103 through the light guide beam 102 and is configured to emit an optical signal;
[0069] The endoscope 103 is configured to receive the optical signal sent by the light source 101 through the light guide beam 102 to illuminate the imaged part to be irradiated, and to receive the image signal formed by the optical signal irradiating the imaged part;
[0070] The camera 104, which is connected to the endoscope 103, is configured to receive the image signal transmitted by the endoscope 103 and process the image signal to obtain the original image information;
[0071] The control device 105, which is connected to the camera 104 and communicatively connected to the light source 101, is configured to receive the original image information from the camera 104 and process it to obtain an imaged picture, and to identify the position of the endoscope 103 according to the imaged picture, and to control the light source 101 based on the identification result.
[0072] Specifically, the control device 105 is configured to classify and identify the imaged picture to determine whether the imaged picture is an in-vivo picture or an ex-vivo picture, so as to obtain the classification and identification result of whether the endoscope 103 is located in the body or outside the body and output the corresponding classification and identification result.
[0073] Optionally, the control device 105 further includes an image processing unit, a classification and identification unit, and a control unit, and is configured to receive the original image information from the camera 104 and process it to obtain an imaged picture, and to identify the position of the endoscope 103 according to the imaged picture, and to control the light source 101 based on the identification result. Specifically:
[0074] The image processing unit is configured to receive the original image information and process it according to the original image information to obtain an imaged picture, and the imaged picture is a conventional image;
[0075] The classification and identification unit is configured to classify and identify the position of the imaged picture to determine whether the imaged picture is an in-vivo picture or an ex-vivo picture, so as to obtain whether the endoscope 103 is located in the body or outside the body, and at the same time output the corresponding classification and identification result;
[0076] A control unit, configured to receive the classification and recognition result and send a corresponding instruction according to the classification and recognition result. Specifically, when the classification and recognition result is an in-vivo picture, an instruction is sent to the light source 101 to keep the light source 101 in an on state, so as to ensure that the light source 101 will not be turned off when the endoscope 103 detects in the body, so as to provide continuous illumination; when the classification and recognition result is an ex-vivo picture, it is further determined whether it is necessary to suppress the light source 101. For example, the cumulative number of the ex-vivo pictures is compared with a set threshold and a first comparison result is output. When the first comparison result is that the cumulative number is less than the set threshold, at this time, the light source 101 is still kept in an on state to prevent the light source 101 from being suppressed when the endoscope 103 is temporarily taken out of the body and affecting the surgical process. At this time, an instruction is sent to count the ex-vivo pictures to increase the value of the cumulative number, so that the number of ex-vivo pictures is continuously accumulated; when the first comparison result is that the cumulative number is not less than the set threshold, an instruction to suppress the light source 101 is sent. Specifically, suppressing the light source may be turning off the light source or reducing the brightness of the light source. In this embodiment, no specific limitation is made on this. The suppressed light source will stop emitting optical signals or emit weak optical signals, so as to reduce the risk of heat accumulation caused by long-term continuous irradiation of the irradiated part. Optionally, the classification and recognition unit classifies and recognizes the picture through a neural network algorithm or a machine learning algorithm and outputs a classification and recognition result. The neural network algorithm includes but is not limited to ResNet, SENet, Inception, etc., and the machine learning algorithm includes but is not limited to SVM, RandomForest, LightGBM, etc. Among them, the neural network algorithm or the machine learning algorithm has the ability to distinguish in-vivo pictures and ex-vivo pictures through learning of in-vivo pictures and ex-vivo pictures, which will not be elaborated here.
[0077] Wherein, the instruction further includes an instruction to initialize at least one of the cumulative number, the preset threshold, and the predetermined time.
[0078] In an embodiment of the present application, when the endoscope 103 is started, an instruction to initialize at least one of the cumulative number, the preset threshold, and the predetermined time is sent, so that the cumulative number, the preset threshold, and the predetermined time are restored to the initial state. Or when the first comparison result is that the cumulative number is not less than the set threshold, at this time, the light source 101 is turned off, and at the same time, an instruction to initialize at least one of the cumulative number, the preset threshold, and the predetermined time is sent, so that the cumulative number, the preset threshold, and the predetermined time are restored to the initial state.
[0079] In an embodiment of the present application, the initial value of the cumulative number is 0, the preset threshold is greater than or equal to 1500, and the predetermined time is greater than or equal to 0.2 seconds. It should be noted that the values of the cumulative number, the preset threshold, and the predetermined time are merely exemplary and are not limited to the listed value ranges, and can be selected according to actual needs.
[0080] Wherein, the cumulative number refers to increasing the value of the in vitro picture by 1 each time an in vitro picture is detected in the imaging picture, so as to count how many in vitro pictures there are currently. When the cumulative number reaches the set threshold, the light source 101 is inhibited.
[0081] Wherein, the predetermined time refers to a time delay. For example, when the recognition result is an in vitro picture and the cumulative number is less than the preset threshold, after sending an instruction to count the in vitro picture and calculate the cumulative number of the in vitro pictures, the predetermined time is delayed and a picture is retrieved again, and the recognition result and the first comparison result of the retrieved picture again are output, and corresponding instructions are sent based on the retrieved recognition result and / or the first comparison result.
[0082] Wherein, the preset threshold is set according to the length of time the endoscope 103 is outside the body, and the time the endoscope 103 is outside the body is the sum of all preset times.
[0083] In an embodiment of the present application, if the video is 60 frames per second, the shortest delay time is about 1 / 60, which is about 0.017 seconds. It takes 25.5 seconds to continuously infer 1500 pictures. If the endoscope 103 is outside the body for 25.5 seconds, the light source 101 is turned off. Obviously, this setting method is unreasonable. By using the predetermined time to delay the time the endoscope 103 is outside the body, assuming the user hopes to turn off the light source 101 after the endoscope 103 is outside the body for 10 minutes, then the predetermined time is 10×60 / 1500 = 0.4 seconds.
[0084] By setting the preset threshold and the predetermined time, it can be prevented that the endoscope 103 does useless work for a long time outside the body and its service life is shortened. In addition, it can also prevent the lens of the endoscope 103 from coming into contact with flammable objects, such as gauze, for a long time, which may cause a fire.
[0085] Further, the control device 105 includes: a counting unit configured to count the number of the in vitro pictures. When the first comparison result is that the cumulative number is less than the set threshold, it receives and executes an instruction to count the in vitro pictures to increase the value of the cumulative number, so as to increase the number of the in vitro pictures.
[0086] In an embodiment of the present application, the working principle and process of the endoscope light source control system are as Figure 2As shown, three global variables are defined in the host program of the endoscopic light source control system: the cumulative number (obtained through the predictedImages counter), the preset threshold (AllImages), and the predetermined time (delay).
[0087] In this embodiment, the counting unit is a counter for counting the number of pictures classified as outside the body by the classification and recognition unit model. The classification and recognition unit is an image classification model in the host, which is used to classify the images obtained when the endoscope is in the human body cavity as in-body pictures, and classify the images obtained when the endoscope is in the operating room as out-of-body pictures.
[0088] Among them, the preset threshold is a customizable constant, with a default value of 1500, used to compare with the cumulative number predictedImages. When the cumulative number predictedImages is greater than or equal to the preset threshold AllImages, that is, when the cumulative number of out-of-body pictures is greater than or equal to 1500, the system suppresses the light source; otherwise, it does not suppress the light source.
[0089] Among them, the predetermined time (delay) represents the delay time before the image classification model infers the next picture. The user can customize the delay parameter, and the default value is 0.2 seconds, indicating that the light source is suppressed after the endoscope has been continuously outside the body for 300 seconds.
[0090] Among them, after the endoscopic light source control system is started, the program initializes these three variables, where predictedImages = 0, AllImages = 1500, and delay = 0.2 seconds. The control device obtains the image at the current time point through the hardware system responsible for image processing in the host, denoted as P, and inputs P into the classification and recognition unit (such as an image classification model) to determine whether P is an out-of-body image or an in-body image. If it is an in-body image, an instruction is sent to the light source through the CAN port to keep the light source on and return to the program initialization step. If it is an out-of-body image, the next step is entered to determine whether predictedImages is greater than or equal to AllImages. If predictedImages is greater than or equal to AllImages, an instruction is sent to the light source through the CAN port to suppress the light source, and the counter predictedImages is reset to 0. If predictedImages is less than AllImages, the counter predictedImages is incremented by 1, and after a delay of delay, it returns to the step described above "The program obtains the image at the current time point through the hardware system responsible for image processing in the host, denoted as P", as Figure 2 shown.
[0091] According to the control system of the present application, the endoscope is identified as being inside or outside the body by the classification and recognition unit to automatically keep the light source on or off. The control system identifies the imaging pictures obtained by the endoscope at the current moment through an algorithm. When the endoscope is outside the body for a long time (about one picture is inferred every 0.2 seconds, and continuously inferring 1500 pictures is about 5 minutes), the system sends an instruction to the light source through the CAN port connected to the light source by the host to turn off the light source, and as long as the endoscope is inside the body, the light source is kept on. The control system can ensure that the light source can be automatically turned off when the endoscope is outside the body for a long time, and the light source can be kept on once the endoscope is inside the body.
[0092] Further, the endoscope light source control system further includes:
[0093] A temperature sensing unit configured to detect the real-time temperature at a predetermined position inside the endoscope light source control system and transmit it to the control device;
[0094] The control device is configured to compare the real-time temperature with a first preset temperature and output a second comparison result when the classification and recognition result is a picture inside the body. The first preset temperature is a safe temperature specified to protect the internal tissues from thermal damage. When the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature, an instruction for giving a warning is sent, and the doctor is informed through the warning that there may be an object blocking the front end of the lens, and at the same time, the light source is not inhibited to ensure the smooth progress of the operation. Or in a preferred embodiment, the intensity of the optical signal emitted by the light source is reduced to ensure the normal operation of the endoscope on the premise of ensuring the safety of the surgical object, and to avoid accidentally turning off the light source due to other operations or causing unexpected damage to the surgical object.
[0095] When the classification and recognition result is a picture outside the body, the real-time temperature is compared with a second preset temperature and a third comparison result is output. The second preset temperature is a safe temperature to prevent the combustible near the lens from burning. When the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature, an instruction to inhibit the light source is sent to prevent fires or other accidents.
[0096] Wherein, the predetermined position is at least one of the front section of the endoscope and / or the joint of the light guide beam and the rigid endoscope of the endoscope, and the position is a position where the temperature is likely to rise or a fire is likely to occur.
[0097] In an embodiment of the present application, taking a medical gauze as an example for illustration, the ignition point of the medical gauze is 150 degrees. Two temperature thresholds are initialized. The first preset temperature is equal to 90 degrees, which is relatively high but does not reach the ignition point of the medical gauze. The second preset temperature is equal to 150 degrees, which reaches the ignition point of the medical gauze. When the lens of the endoscope is connected to the light guide beam and there is no object blocking the front end of the lens, the temperature of the lens is only about 40 degrees. If the temperature of the lens reaches 150 degrees, there must be an object blocking it.
[0098] When the temperature sensing unit detects that the temperature at the lens reaches the first preset temperature, it starts to send an alarm to inform the doctor that there may be an object blocking the front end of the lens or simultaneously reduces the intensity of the optical signal emitted by the light source, but does not inhibit the light source, because in the actual clinical scenario, the doctor may bring the lens close to the tissue for observation or wipe the lens, resulting in a temperature increase. When the temperature sensing unit detects that the temperature at the lens reaches the second preset temperature, it actively inhibits the light source, because this temperature has greatly exceeded the normal temperature of 40 degrees and reaches the ignition point of the gauze, which is extremely likely to cause a fire.
[0099] In an embodiment of the present application, when the recognition result of the imaging picture by the control unit is an in-vivo picture, or when the first comparison result output by comparing the cumulative number of in-vitro pictures with the set threshold is that the cumulative number is less than the set threshold, if the temperature detected by the temperature sensor reaches the first preset temperature, a corresponding instruction is issued based on the detected temperature. That is, for the control unit, the light source control instruction is preferentially issued based on the temperature signal detected by the temperature sensor.
[0100] Furthermore, the endoscope light source control system further includes a display device, which is connected to the control device and is configured to receive and display the imaging picture.
[0101] The display device can be a touch display screen, a liquid crystal display screen, etc.; or the display device can be a liquid crystal display device, a television, etc., independent display devices outside the endoscope light source control system 100; or the display device can be the display screen of an electronic device such as a smart phone or a tablet computer, etc. Among them, the number of display devices can be one or more. For example, the display device can include a main screen and a touch screen. The main screen is mainly used to display the imaging picture, and the touch screen is mainly used for human-computer interaction.
[0102] The display device can display the imaging pictures obtained by the control device. In addition, while displaying the imaging pictures, the display device can also provide a graphical interface for the user to perform human-computer interaction. One or more controlled objects are set on the graphical interface, and the user is provided with a human-computer interaction device to input operation instructions to control these controlled objects, so as to perform corresponding control operations. For example, an icon is displayed on the graphical interface, and the icon can be operated by using the human-computer interaction device to perform a specific function. For example, the display device is also used to receive an imaging picture processing instruction from the user and can perform zooming processing on the picture.
[0103] Optionally, the endoscope light source control system 100 may further include other human-computer interaction devices other than the display device, which are connected to the control device. For example, the control device can be connected to the human-computer interaction device through an external input / output port. The external input / output port can be a wireless communication module, a wired communication module, or a combination of both. The external input / output port can also be implemented based on USB, bus protocols such as CAN, and / or wired network protocols, etc.
[0104] The endoscope light source control system according to the present invention is capable of automatically turning off or turning on the light source after the endoscope is used, and ensures that within the range of a preset threshold, as long as the endoscope is in the body and within the normal working range, the light source remains on, so as to ensure that the light source is not inhibited during the operation. The implementation of the control system is simple and does not require adding additional components such as sensors.
[0105] This application also provides an endoscope light source control method. The endoscope light source control system includes a light source, a light guide beam, an endoscope, a camera, and a control device. The light source is connected to the endoscope through the light guide beam, the camera is connected to the endoscope, and the control device is connected to the camera and communicatively connected to the light source. As Figure 3 shown, the control method 300 includes:
[0106] Step S310: The light source emits an optical signal;
[0107] Step S320: The endoscope receives the optical signal sent by the light source through the light guide beam to illuminate the imaged part to be irradiated, and receives the image signal formed by the optical signal irradiating the imaged part;
[0108] Step S330: The camera receives the image signal transmitted by the endoscope and processes the image signal to obtain the original image information;
[0109] Step S340: The control device receives the original image information from the camera, processes it to obtain an imaging picture, identifies the position of the endoscope represented by the imaging part in the imaging picture, and controls the light source based on the identification result.
[0110] Optionally, the identifying the position of the endoscope represented by the imaging part in the imaging picture and controlling the light source based on the identification result includes:
[0111] Classifying and identifying the imaging picture and outputting a corresponding classification and identification result;
[0112] When the classification and identification result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification and identification result is an ex-vivo picture, the cumulative number of ex-vivo pictures is compared with a set threshold and a first comparison result is output. When the first comparison result is that the cumulative number is less than the set threshold, an instruction to count the ex-vivo pictures to increase the value of the cumulative number is sent; when the first comparison result is that the cumulative number is greater than or equal to the set threshold, an instruction to inhibit the light source is sent.
[0113] Optionally, the classification and identification unit is configured to classify and identify the imaging picture through a neural network algorithm or a machine learning algorithm and output a classification and identification result.
[0114] Optionally, the control method further includes:
[0115] Counting the ex-vivo pictures to increase the value of the cumulative number.
[0116] Optionally, the control method includes:
[0117] After counting the ex-vivo pictures to increase the value of the cumulative number, after a predetermined time, pictures are acquired again, and the identification result and the first comparison result of the pictures acquired again are output, and corresponding instructions are sent based on the re-acquired identification result and / or the first comparison result.
[0118] Optionally, the control method includes:
[0119] Initializing at least one of the cumulative number, the preset threshold, and the predetermined time when the endoscope light source control system is started and / or when the first comparison result is that the cumulative number is not less than the set threshold.
[0120] Optionally, it further includes:
[0121] Detect the real-time temperature at a predetermined position within the endoscope light source control system and transmit it to the control device;
[0122] When the classification and recognition result is an in-vivo picture, compare the real-time temperature with a first preset temperature and output a second comparison result. When the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature, send an instruction to give a warning, and at the same time, it is possible to select to suppress the optical signal emitted by the light source; or when the classification and recognition result is an ex-vivo picture, compare the real-time temperature with a second preset temperature and output a third comparison result. When the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature, send an instruction to suppress the light source.
[0123] Optionally, the predetermined position is at least one of the front section of the endoscope and / or the junction of the light guide beam and the rigid endoscope of the endoscope.
[0124] Optionally, the endoscope light source control system further includes a display device, which is connected to the control device. The control method further includes receiving and displaying the imaging picture through the display device or receiving a picture processing instruction from the user through the display device.
[0125] Continue to return to the control system. Among them, the control device may further include a processor for executing each step of the endoscope light source control method 300 described above. Among them, more details of the control method can refer to the relevant introduction of the structure and working principle of the endoscope light source control system, which will not be elaborated here.
[0126] Optionally, the processor can be implemented by software, hardware, firmware or any combination thereof, and can use circuits, single or multiple application specific integrated circuits (ASICs), single or multiple general integrated circuits, single or multiple microprocessors, single or multiple programmable logic devices, or any combination of the foregoing circuits and / or devices, or other suitable circuits or devices, so that the processor can execute the corresponding steps of the endoscope light source control method in each embodiment of this specification. And the processor can control other components in the endoscope light source control system 100 to perform the desired functions.
[0127] Optionally, the image processing unit, the classification and recognition unit, and the control unit are part of the processor and integrated therein to receive the original image information and obtain an imaging picture, classify and recognize the position of the imaging picture and output the classification and recognition result, and receive the classification and recognition result and send corresponding instructions according to the classification and recognition result. When the classification and recognition result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification and recognition result is an ex-vivo picture, the cumulative number of ex-vivo pictures is compared with a set threshold and a first comparison result is output. When the first comparison result is that the cumulative number is less than the set threshold, an instruction to count the ex-vivo pictures to increase the value of the cumulative number is sent; when the first comparison result is that the cumulative number is not less than the set threshold, an instruction to inhibit the light source is sent.
[0128] Among them, the human-computer interaction device may include an input device for detecting user input information. The input information may be, for example, a control instruction for operating an imaging picture, an operation input instruction for drawing points, lines, or frames on the imaging picture, or may also include other instruction types. The input device may include one or a combination of a keyboard, a mouse, a roller, a trackball, a mobile input device (such as a mobile device with a touch display screen, a mobile phone, etc.), a multi-functional knob, and the like. The human-computer interaction device may also include an output device such as a printer.
[0129] The endoscope light source control system 100 may further include a memory for storing instructions executed by the control device, storing received imaging pictures, and the like. The memory may be a flash card, a solid-state memory, a hard disk, etc. It may be a volatile memory and / or a non-volatile memory, a removable memory and / or a non-removable memory, etc.
[0130] It should be understood that Figure 1 The components included in the illustrated endoscope light source control system 100 are only illustrative, and it may include more or fewer components. This application is not limited thereto.
[0131] The endoscope light source control system 100 provided by an embodiment of the present application can be used to implement the above-mentioned endoscope light source control method 300.
[0132] Although example embodiments have been described herein with reference to the drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present application. Those of ordinary skill in the art can make various changes and modifications therein without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of the present application as claimed in the appended claims.
[0133] Those of ordinary skill in the art will appreciate that the units and algorithm steps of the examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of this application.
[0134] In several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.
[0135] In the specification provided herein, a large number of specific details are set forth. However, it can be understood that the embodiments of this application can be practiced without these specific details. In some instances, well-known methods, structures, and technologies have not been shown in detail so as not to obscure the understanding of this specification.
[0136] Similarly, it should be understood that, in order to streamline this application and assist in understanding one or more of the various inventive aspects, in the description of the exemplary embodiments of this application, the various features of this application are sometimes grouped together into a single embodiment, figure, or description thereof. However, the methods of this application should not be construed as reflecting the intention that the claimed application requires more features than are expressly recited in each claim. Rather, as reflected in the corresponding claims, the inventive point lies in being able to solve the corresponding technical problems with features less than all the features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into the detailed description, where each claim itself serves as a separate embodiment of this application.
[0137] Those skilled in the art can understand that, except for features that are mutually exclusive, any combination can be adopted for all the features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all the processes or units of any method or device so disclosed. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) can be replaced by an alternative feature that provides the same, equivalent, or similar purpose.
[0138] In addition, those skilled in the art can understand that although some of the embodiments described herein include certain features included in other embodiments rather than other features, the combination of features of different embodiments means that it is within the scope of this application and forms different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.
[0139] Each component embodiment of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the functions of some of the modules according to the embodiments of the present application. The present application can also be implemented as a device program (such as a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present application can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0140] It should be noted that the above embodiments illustrate rather than limit the present application, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claims. The present application can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In the unit claims listing several devices, several of these devices can be embodied by the same hardware item. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names.
[0141] As described above, it is only the specific implementation manner of the present application or the description of the specific implementation manner. The protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, and all of them should be covered by the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.
Claims
1. An endoscope light source control system, characterized in that, It includes a light source, a light guiding beam, an endoscope, a camera and a control device; The light source is connected to the endoscope through the light guiding beam and is configured to emit an optical signal; The endoscope is configured to receive the optical signal sent by the light source through the light guiding beam to illuminate the imaged part to be irradiated; and, receive the image signal formed by the optical signal irradiating the imaged part; The camera is connected to the endoscope and is configured to receive the image signal transmitted by the endoscope and process the image signal to obtain the original image information; The control device is connected to the camera and communicatively connected to the light source, and is configured to receive the original image information from the camera and process it to obtain an imaged picture, and identify the position of the endoscope represented by the imaged part in the imaged picture, and control the light source based on the identification result; The identifying the position of the endoscope represented by the imaged part in the imaged picture and controlling the light source based on the identification result includes: Classifying and identifying the imaged picture and outputting the corresponding classification and identification result; When the classification and identification result is an in-vivo picture, an instruction to keep the light source on is sent to the light source; When the classification and identification result is an ex-vivo picture, the cumulative number of ex-vivo pictures is compared with a set threshold and a first comparison result is output; when the first comparison result is that the cumulative number is less than the set threshold, the ex-vivo pictures are counted to increase the value of the cumulative number; when the first comparison result is that the cumulative number is greater than or equal to the set threshold, an instruction to inhibit the light source is sent; The control device is further configured to, after counting the ex-vivo pictures to increase the value of the cumulative number, delay for a predetermined time and re-obtain the imaged picture, and output the classification and identification result and the first comparison result of the re-obtained imaged picture, and send a corresponding instruction to the light source based on the re-obtained classification and identification result and / or the first comparison result.
2. The system according to claim 1, wherein The control device includes: An image processing unit configured to receive the original image information and obtain an imaged picture; A classification and identification unit configured to classify and identify the position of the endoscope represented by the imaged part in the imaged picture and output the classification and identification result; A control unit configured to send a corresponding instruction according to the classification and identification result. When the classification and identification result is an in-vivo picture, an instruction to keep the light source on is sent to the light source. When the classification and identification result is an ex-vivo picture, the cumulative number of ex-vivo pictures is compared with a set threshold and a first comparison result is output. When the first comparison result is that the cumulative number is less than the set threshold, an instruction to count the ex-vivo pictures to increase the value of the cumulative number is sent; when the first comparison result is that the cumulative number is not less than the set threshold, an instruction to inhibit the light source is sent.
3. The system according to claim 2, wherein The classification and recognition unit is configured to classify and recognize the imaging picture through a machine learning algorithm and output a classification and recognition result.
4. The system according to claim 2, wherein The control device further includes: A counting unit configured to receive and execute an instruction to count the in-vitro pictures to increase the value of the cumulative number.
5. The system according to claim 1, wherein The control device is further configured to send an instruction to initialize at least one of the cumulative number, the set threshold, and the predetermined time when the system is started and / or when the first comparison result is that the cumulative number is not less than the set threshold.
6. The system according to claim 1, wherein It further includes: A temperature sensing unit configured to detect the real-time temperature at a predetermined position within the system and transmit it to the control device; The control device is configured to compare the real-time temperature with a first preset temperature and output a second comparison result when the classification and recognition result is an in-vivo picture, and send an instruction to give a warning when the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature; Or When the classification and recognition result is an in-vitro picture, compare the real-time temperature with a second preset temperature and output a third comparison result, and send an instruction to suppress the light source when the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature.
7. The system according to claim 6, characterized in that, The predetermined position is at least one of the front section of the endoscope and / or the junction of the light guide beam and the rigid endoscope of the endoscope.
8. The system according to any one of claims 1-7, characterized in that, It further includes: A display device connected to the control device and configured to receive and display the imaging picture or receive an imaging picture processing instruction from a user.
9. An endoscopic light source control method for an endoscopic light source control system, the endoscopic light source control system comprising a light source, a light guide bundle, an endoscope, a camera, and a control device, the light source being connected to the endoscope through the light guide bundle, the camera being connected to the endoscope, the control device being connected to the camera and communicatively connected to the light source, characterized in that, The control method includes: Emitting an optical signal through the light source; Illuminating the irradiated imaging part by receiving the optical signal sent by the light source through the endoscope via the light guide beam, and receiving the image signal formed by the optical signal irradiating the imaging part; Receiving the image signal transmitted by the endoscope through the camera and processing the image signal to obtain original image information; Receiving the original image information from the camera by the control device, processing it to obtain an imaging picture, and identifying the position of the endoscope represented by the imaging part in the imaging picture, and controlling the light source based on the identification result; The identifying the position of the endoscope represented by the imaging part in the imaging picture and controlling the light source based on the identification result includes: Classifying and recognizing the imaging picture and outputting a corresponding classification and recognition result; When the classification and recognition result is an in-vivo picture, send an instruction to keep the light source on; when the classification and recognition result is an in-vitro picture, compare the cumulative number of the in-vitro pictures with a set threshold and output a first comparison result, and when the first comparison result is that the cumulative number is less than the set threshold, send an instruction to count the in-vitro pictures to increase the value of the cumulative number; when the first comparison result is that the cumulative number is greater than or equal to the set threshold, send an instruction to suppress the light source; The control method further includes: After counting the in-vitro pictures to increase the value of the cumulative number, re-acquire the imaging pictures after a predetermined time delay, output the classification and recognition results of the re-acquired imaging pictures and the first comparison result, and send corresponding instructions based on the re-obtained classification and recognition results and / or the first comparison result.
10. The control method according to claim 9, characterized in that, Classifying and recognizing the imaging pictures and outputting the corresponding classification and recognition results includes: classifying and recognizing the imaging pictures through a machine learning algorithm and outputting the classification and recognition results.
11. The control method according to claim 9, characterized in that The control method further includes: Initializing at least one of the cumulative number, the set threshold, and the predetermined time when the endoscope light source control system is started and / or when the first comparison result is that the cumulative number is not less than the set threshold.
12. The control method according to claim 9, wherein The control method further includes: Detecting the real-time temperature at a predetermined position within the endoscope light source control system and transmitting it to the control device; When the classification and recognition result is an in-vivo picture, comparing the real-time temperature with a first preset temperature and outputting a second comparison result. When the second comparison result is that the real-time temperature is greater than or equal to the first preset temperature, send an instruction to give a warning; or when the classification and recognition result is an in-vitro picture, comparing the real-time temperature with a second preset temperature and outputting a third comparison result. When the third comparison result is that the real-time temperature is greater than or equal to the second preset temperature, send an instruction to inhibit the light source.
13. The control method according to claim 12, characterized in that, The predetermined position is at least one of the front section of the endoscope and / or the junction of the light guide beam and the rigid endoscope of the endoscope.
14. The control method according to any one of claims 9-13, characterized in that, The control method further includes: receiving and displaying the imaging pictures through a display device or receiving picture processing instructions from the user through the display device.
Citation Information
Patent Citations
Method and device for controlling brightness of light source and computer storage medium
CN112906682A
Light source for endoscope
JP2000249935A