Method for adaptively adjusting high refresh rate of endoscope camera system and endoscope camera system

Abstract

The present invention discloses a method for adaptively adjusting the high refresh rate of an endoscope camera system and an endoscope camera system, which relates to the technical field of endoscopes. Among them, the method for adaptively adjusting the high refresh rate of the endoscope camera system includes first obtaining a real-time image, where the image refresh rate in the high refresh rate camera mode is greater than or equal to 90 Hz; then classifying and processing the real-time image, and determining the current camera scene mode according to the result of the classification and processing, where the current camera scene mode includes a high dynamic range scene mode; finally, when the current camera scene mode is the high dynamic range scene mode, determining the camera mode of the endoscope camera system as the high refresh rate camera mode, determining the high dynamic range scene mode according to the usage scenario of the surgery, and when the current camera scene mode is the high dynamic range scene mode, determining the camera mode of the endoscope camera system as the high refresh rate camera mode, enabling the user to feel a smoother and clearer picture when using the endoscope for surgery.

Description

Technical Field

[0001] The present invention relates to the technical field of endoscopes, and particularly to a method for adaptively adjusting the high refresh rate of an endoscope imaging system and an endoscope imaging system. Background Art

[0002] Modern surgical operations have become minimally invasive. As an important tool for minimally invasive surgery, an endoscope can enter the human body cavity and transmit the images captured inside the body to a screen in real time for surgical or examination users to observe.

[0003] The endoscope imaging system is called "the user's eyes". The imaging method and quality of the imaging system determine the user's experience. Generally, the human eye can perceive the speed of coherent images between 24 frames per second and 36 frames per second. However, due to the persistence of vision, the clarity of real-time images is often lower than that of static images at a lower frame rate. As the frame rate of the image increases, the image becomes smoother and the user's perception is better.

[0004] Currently, most endoscope imaging systems on the market are 30 frames per second, 50 frames per second, or 60 frames per second. Although they can meet the minimum number of frames that the human eye can perceive, the coherence is still lacking, especially for fast-moving and smoky scenes during endoscope surgery. During minimally invasive surgery, instruments often pull tissues and move quickly. At a refresh rate of 30 frames per second to 60 frames per second, the trailing effect (for fast-moving objects, the frame rate of shooting is low, resulting in a large difference in the content of each frame, and the final coherent image will be blurred) is obvious, the image will be blurred and may even make the user feel visual fatigue, and risks may be introduced during a long surgical process. Summary of the Invention

[0005] The main object of the present invention is to propose a method for adaptively adjusting the high refresh rate of an endoscope imaging system and an endoscope imaging system, aiming to provide an endoscope imaging refresh rate adaptive method and an endoscope imaging system that can automatically switch the screen mode according to the usage scenario.

[0006] To achieve the above object, the method for adaptively adjusting the high refresh rate of the endoscope imaging system proposed by the present invention includes the following steps:

[0007] Obtain a real-time image, and the image refresh rate in the high refresh rate imaging mode is greater than or equal to 90 Hz;

[0008] Classify the real-time image, and determine the current imaging scene mode according to the result of the classification process, where the current imaging scene mode includes a high dynamic scene mode;

[0009] When the current imaging scene mode is the high dynamic scene mode, determine the imaging mode of the endoscope imaging system as the high refresh rate imaging mode.

[0010] In one embodiment, the current camera scene mode further includes a low-dynamic range scene mode;

[0011] The classifying the real-time image and determining the current camera scene mode according to the result of the classification processing includes:

[0012] Determining motion information according to the real-time image;

[0013] When the motion information meets the low-speed preset condition, determining that the current camera scene mode is the low-dynamic range scene mode;

[0014] When the motion information meets the high-speed preset condition, determining that the current camera scene mode is the high-dynamic range scene mode.

[0015] In one embodiment, the current camera scene mode further includes a low-dynamic range scene mode;

[0016] The classifying the real-time image and determining the current camera scene mode according to the result of the classification processing includes:

[0017] Determining smoke information according to the real-time image;

[0018] When the smoke information meets the clean preset condition, determining that the current camera scene mode is the low-dynamic range scene mode;

[0019] When the smoke information meets the stain preset condition, determining that the current camera scene mode is the high-dynamic range scene mode.

[0020] In one embodiment, the method for the endoscopic camera system to adaptively adjust the high refresh rate further includes:

[0021] Obtaining the current camera mode, wherein the camera mode of the endoscopic camera system further includes a high-resolution camera mode;

[0022] When the current camera scene mode is the high-dynamic range scene mode, determining the camera mode of the endoscopic camera system as the high refresh rate camera mode includes:

[0023] When the current camera mode is the high-resolution camera mode and the current camera scene mode is the high-dynamic range scene mode, switching and determining the camera mode of the endoscopic camera system from the high-resolution camera mode to the high refresh rate camera mode.

[0024] In one embodiment, the endoscopic camera system includes an image sensor;

[0025] In switching and determining the camera mode of the endoscopic camera system from the high-resolution camera mode to the high refresh rate camera mode:

[0026] Control the image sensor to acquire an image with a first exposure time, and switch to acquire an image with a second exposure time, where the second exposure time is shorter than the first exposure time.

[0027] In one embodiment, the endoscopic camera system includes a controller in which a high-refresh path and a high-resolution path are formed;

[0028] When switching the imaging mode of the endoscopic camera system from the high-resolution imaging mode to the high-refresh rate imaging mode:

[0029] Switch the high-resolution path of the controller to a high-refresh path.

[0030] In one embodiment, the endoscopic camera system includes a display device having a high-refresh display mode and a high-resolution display mode;

[0031] When switching the imaging mode of the endoscopic camera system from the high-resolution imaging mode to the high-refresh rate imaging mode:

[0032] Switch the display device from the high-resolution display mode to the high-refresh display mode.

[0033] In one embodiment, classifying the real-time image includes:

[0034] Classify the image according to the real-time image based on the algorithm of a convolutional neural network.

[0035] In one embodiment, the imaging mode of the endoscopic camera system includes a high-resolution imaging mode;

[0036] Before acquiring the real-time image, it further includes:

[0037] After the endoscopic camera system is powered on, control the system to enter the high-resolution imaging mode.

[0038] The present invention also proposes an endoscopic camera system, including an image sensor, a controller, and a display device. The controller is electrically connected to the image sensor and the display device. Wherein, the controller includes: a memory, a processor, and a program for adaptively adjusting the high-refresh rate based on the endoscopic camera system stored on the memory and executable on the processor. The program for adaptively adjusting the high-refresh rate based on the endoscopic camera system is configured to implement the method for adaptively adjusting the high-refresh rate based on the endoscopic camera system as described above.

[0039] The technical solution of the present invention first obtains a real-time image, where the image refresh rate in the high refresh rate camera mode is greater than or equal to 90 Hz; then classifies the real-time image, and determines the current camera scene mode according to the result of the classification processing, where the current camera scene mode includes a high dynamic range scene mode; finally, when the current camera scene mode is the high dynamic range scene mode, determines the camera mode of the endoscope camera system as the high refresh rate camera mode. Thus, the high dynamic range scene mode is determined according to the usage scenario of the operation, and when the current camera scene mode is the high dynamic range scene mode, the camera mode of the endoscope camera system is determined as the high refresh rate camera mode, enabling the user to feel a smoother and clearer picture when using the endoscope for surgery. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on the structures shown in these drawings.

[0041] Figure 1 Schematic flowchart of the first embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0042] Figure 2 Schematic flowchart of the second embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0043] Figure 3 Schematic flowchart of the third embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0044] Figure 4 Schematic flowchart of the fourth embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0045] Figure 5 Schematic flowchart of the fifth embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0046] Figure 6 Schematic flowchart of the sixth embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0047] Figure 7 Schematic flowchart of the seventh embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0048] Figure 8 Schematic flowchart of the eighth embodiment of the endoscopic camera refresh rate adaptation method of the present invention;

[0049] Figure 9 This is a schematic flowchart of the ninth embodiment of the endoscopic camera frame rate adaptive method of the present invention;

[0050] Figure 10 is Figure 1 a schematic structural diagram of the controller of the hardware operating environment involved in the solution of the embodiment in

[0051] The realization, functional characteristics and advantages of the object of the present invention will be further described with reference to the embodiments and the accompanying drawings. Specific embodiments

[0052] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0053] It should be noted that if there are directional indications (such as up, down, left, right, front, back...) in the embodiments of the present invention, the directional indications are only used to explain the relative position relationship and movement conditions between components in a specific posture. If the specific posture changes, the directional indications will also change accordingly.

[0054] In addition, if there are descriptions such as "first" and "second" in the embodiments of the present invention, the descriptions of "first" and "second" are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In addition, if "and / or" or "and / or" appears throughout the text, its meaning includes three parallel solutions. Taking "A and / or B" as an example, it includes solution A, solution B, or a solution where A and B are satisfied simultaneously. In addition, the technical solutions between the embodiments can be combined with each other, but it must be based on the fact that those of ordinary skill in the art can implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the protection scope required by the present invention.

[0055] Modern surgical operations have become minimally invasive. As an important tool for minimally invasive surgery, the endoscope can enter the human body cavity and transmit the images captured inside the body to the screen in real time for the surgical or examination user to observe.

[0056] The endoscopic camera system is known as the "user's eyes". The imaging method and quality of the camera system determine the user's experience. Generally, the human eye can perceive the speed of coherent images between 24 frames per second and 36 frames per second. However, due to the persistence of vision, a lower frame rate often results in lower clarity of real-time images compared to static images. As the frame rate of the images increases, the video becomes smoother and the user's perception is better.

[0057] Currently, most endoscopic camera systems on the market have frame rates of 30 frames per second, 50 frames per second, or 60 frames per second. Although they can meet the minimum frame rate perceptible by the human eye, there is still a lack of coherence, especially for fast-moving and smoky scenes during endoscopic surgery. During minimally invasive surgery, instruments often pull tissues and move quickly. At frame rates of 30 frames per second to 60 frames per second, the trailing effect (for fast-moving objects, when the frame rate of shooting is low, the content of each frame varies greatly, and the resulting coherent image will be blurred) is obvious, the image will be blurred and may even cause visual fatigue to the user, and risks may be introduced during a long surgical procedure.

[0058] To solve the above problems, the present invention proposes a method for adaptively adjusting the high frame rate of an endoscopic camera system and an endoscopic camera system, aiming to provide an endoscopic camera frame rate adaptive method and an endoscopic camera system that can automatically switch the screen mode according to the usage scenario.

[0059] Please refer to Figure 1 , in an embodiment of the present invention, the method for adaptively adjusting the high frame rate of the endoscopic camera system includes the following steps:

[0060] S10, obtaining a real-time image, where the image frame rate in the high frame rate camera mode is greater than or equal to 90 Hz;

[0061] S20, classifying the real-time image, and determining the current camera scene mode according to the result of the classification process, where the current camera scene mode includes a high dynamic range scene mode;

[0062] S30, when the current camera scene mode is the high dynamic range scene mode, determining the camera mode of the endoscopic camera system as the high frame rate camera mode.

[0063] The technical solution of the present invention first obtains a real-time image, where the image refresh rate in the high refresh rate camera mode is greater than or equal to 90 Hz; then classifies the real-time image, and determines the current camera scene mode according to the result of the classification process. Among them, the current camera scene mode includes a high dynamic range scene mode; finally, when the current camera scene mode is the high dynamic range scene mode, the camera mode of the endoscope camera system is determined to be the high refresh rate camera mode. Thus, the high dynamic range scene mode is determined according to the usage scenario of the operation, and when the current camera scene mode is the high dynamic range scene mode, the camera mode of the endoscope camera system is determined to be the high refresh rate camera mode, enabling the user to feel a smoother and clearer picture when using the endoscope for surgery.

[0064] In addition, please refer to Figure 2 , the current camera scene mode further includes a low dynamic range scene mode; in the step of classifying the real-time image and determining the current camera scene mode according to the result of the classification process, the following steps are included:

[0065] S21, determine the movement information according to the real-time image;

[0066] S211, when the movement information meets the low speed preset condition, determine that the current camera scene mode is the low dynamic range scene mode;

[0067] S212, when the movement information meets the high speed preset condition, determine that the current camera scene mode is the high dynamic range scene mode.

[0068] It can be understood that in the step of classifying the real-time image and determining the current camera scene mode according to the result of the classification process, the result of the classification process can be based on the usage scenario of the endoscope. For example, when the endoscope quickly enters the specified lesion area inside the human body from the outside of the human body, at this time, the classification process can make a judgment based on the movement information of the endoscope. In this embodiment, when the movement information meets the low speed preset condition, it is determined that the current camera scene mode is the low dynamic range scene mode; when the movement information meets the high speed preset condition, it is determined that the current camera scene mode is the high dynamic range scene mode.

[0069] It can be understood that when the endoscopic camera moves faster inside the human body, the captured images become blurrier. To make the images smooth as the endoscopic camera moves, when the movement speed of the endoscopic camera exceeds a certain preset value, the current camera scene mode is determined as the high-dynamic range (HDR) scene mode. Accordingly, the camera mode of the endoscopic camera system is determined as the high frame rate (HFR) camera mode, where the frame rate of the HFR images is greater than or equal to 90 Hz. In contrast, when the endoscopic camera moves to the lesion area that needs to be observed inside the human body, the movement speed of the endoscopic camera slows down at this time, which is conducive to the user observing the lesion condition. That is, the images captured by the endoscopic camera at this time, even without a high frame rate, will still change smoothly as the endoscopic camera moves. Therefore, in this usage scenario, to facilitate the user's observation, that is, when the movement speed of the endoscopic camera is lower than a certain preset value, the current camera scene mode is determined as the low-dynamic range (LDR) scene mode. Furthermore, the camera mode of the endoscopic camera system is determined as the high-resolution camera mode to provide clearer pictures for the user, where the high resolution is not less than 3840*2160 pixels, making the picture clearer.

[0070] In addition, please refer to Figure 3 , the current camera scene mode further includes the low-dynamic range (LDR) scene mode; the classification process of the real-time images and determining the current camera scene mode according to the classification result includes the following steps:

[0071] S22, determining the smoke information according to the real-time images;

[0072] S221, when the smoke information meets the clean preset condition, determining the current camera scene mode as the low-dynamic range (LDR) scene mode;

[0073] S222, when the smoke information meets the stain preset condition, determining the current camera scene mode as the high-dynamic range (HDR) scene mode.

[0074] It can be understood that in the classification process of the real-time images and determining the current camera scene mode according to the classification result, the classification result can be determined according to the lens state of the endoscopic camera. For example, when the endoscopic camera quickly enters the designated lesion area inside the human body from outside the human body, at this time, due to the temperature difference between the lens of the endoscopic camera and the human body, water vapor is likely to form fog on the lens of the endoscopic camera. Therefore, the classification process can make a judgment based on the smoke information of the endoscopic camera. In this embodiment, when the smoke information meets the clean preset condition, the current camera scene mode is determined as the low-dynamic range (LDR) scene mode; when the smoke information meets the stain preset condition, the current camera scene mode is determined as the high-dynamic range (HDR) scene mode.

[0075] It can be understood that since the temperature difference between the endoscope lens and the human body easily forms smoke on the lens, which in turn affects the quality of the acquired image information. To facilitate the user to better obtain the lesion image from the image information, thus, when the smoke information of the lens meets the clean preset condition, that is, at this time, there is no smoke or only a very small amount of smoke on the endoscope lens, and the image quality will not be affected by the smoke. Therefore, it is determined that the current camera scene mode is the low dynamic scene mode, and then the camera mode of the endoscope camera system is determined to be the high-resolution mode, and a clearer image is output for the user. Among them, the high resolution is not less than 3840*2160 pixels to make the image clearer; when the smoke information of the lens meets the stain preset condition, that is, when there is more fog on the endoscope lens at this time, in this scenario, the endoscope lens cannot output a clear image. Therefore, it is determined that the current camera scene mode is the high dynamic scene mode, and then the camera mode of the endoscope camera system is determined to be the high refresh rate mode, and a smoother image is output for the user. Among them, the image refresh rate of the high refresh rate is greater than or equal to 90H.

[0076] In addition, please refer to Figure 4 , the method for the endoscope camera system to adaptively adjust the high refresh rate further includes the following steps:

[0077] S11, obtain the current camera mode, where the camera mode of the endoscope camera system also includes the high-resolution camera mode;

[0078] In the step of determining the camera mode of the endoscope camera system as the high refresh rate camera mode when the current camera scene mode is the high dynamic scene mode, it further includes:

[0079] S31, when the current camera mode is the high-resolution camera mode and the current camera scene mode is the high dynamic scene mode, switch and determine the camera mode of the endoscope camera system from the high-resolution camera mode to the high refresh rate camera mode.

[0080] It can be understood that, in order for the endoscope to meet the most basic function of transmitting the image back, the imaging mode of the endoscope imaging system further includes a high-resolution imaging mode. That is, in some embodiments, the endoscope can transmit an extremely clear image regardless of whether the transmitted image is smooth. That is, at this time, the imaging mode of the endoscope imaging system is set to the high-resolution imaging mode. However, in this embodiment, the user not only needs to obtain a clear image but also a smooth image. Therefore, in this embodiment, the imaging mode of the endoscope imaging system not only includes a high refresh rate mode but also a high-resolution mode, and it is also required to satisfy: when the current imaging mode is the high-resolution imaging mode, if the current imaging scene mode is the high-dynamic range scene mode, the imaging mode of the endoscope imaging system is switched and determined to be the high refresh rate imaging mode. That is, obtaining a clear image is the most basic ability of the endoscope system, and on the premise of being able to obtain a clear image, being able to obtain a smooth dynamic image can bring a better user experience.

[0081] Further, please refer to Figure 5 , the endoscope imaging system includes an image sensor; in the step of switching and determining the imaging mode of the endoscope imaging system from the high-resolution imaging mode to the high refresh rate imaging mode, it further includes:

[0082] S311, controlling the image sensor to collect images with a first exposure time and switching to collect images with a second exposure time, where the second exposure time is shorter than the first exposure time.

[0083] It can be understood that when the imaging mode of the endoscope imaging system is switched and determined from the high-resolution imaging mode to the high refresh rate imaging mode, what is essentially changed is the frame interval between dynamic images. That is, when the imaging mode of the imaging system is the high-resolution mode, the image sensor collects images with the first exposure time; when the imaging mode of the imaging system is the high refresh rate mode, the image sensor collects images with the second exposure time, where the second exposure time is shorter than the first exposure time. Therefore, the first exposure time with a longer exposure time but a slower exposure frequency collects clearer images, but the dynamic image is not smooth enough, corresponding to the high-resolution mode; while the second exposure time with a shorter exposure time but a faster exposure frequency has a higher smoothness between images, corresponding to the high refresh rate mode.

[0084] Further, the endoscopic camera system includes a controller in which a high-refresh path and a high-resolution path are formed; when switching the camera mode of the endoscopic camera system from the high-resolution camera mode to the high-refresh-rate camera mode:

[0085] S312, please refer to Figure 6 , switch the high-resolution path of the controller to a high-refresh path.

[0086] It can be understood that when switching the camera mode of the endoscopic camera system from the high-resolution camera mode to the high-refresh-rate camera mode, what is essentially changed is the frame interval between dynamic images and images, and the change in the controller is reflected as a change in the path. Specifically, the high-resolution path of the controller corresponds to the high-resolution camera mode of the endoscopic camera system; the high-refresh-rate path of the controller corresponds to the high-refresh-rate camera mode of the endoscopic camera system; and when the camera mode of the endoscopic camera system is switched from the high-resolution camera mode to the high-refresh-rate camera mode, correspondingly, the high-resolution path of the controller is switched to a high-refresh path.

[0087] Further, the endoscopic camera system includes a display device that has a high-refresh display mode and a high-resolution display mode; when switching the camera mode of the endoscopic camera system from the high-resolution camera mode to the high-refresh-rate camera mode:

[0088] S313, please refer to Figure 7 , switch the display device from the high-resolution display mode to the high-refresh display mode.

[0089] It can be understood that as the output device of the endoscopic camera system, the display device is used to output the acquired pictures for the user to refer to. Specifically, when the endoscopic camera system is in the high-resolution camera mode, the display device corresponds to the high-resolution display mode; when the endoscopic camera system is in the high-refresh-rate camera mode, the display device corresponds to the high-refresh-rate display mode; in particular, when the camera mode of the endoscopic camera system is switched from the high-resolution camera mode to the high-refresh-rate camera mode, correspondingly, the display device is switched from the high-resolution display mode to the high-refresh display mode.

[0090] In addition, the step of classifying the real-time image further includes:

[0091] S21, please refer to Figure 8 , classify the image based on the algorithm of the convolutional neural network according to the real-time image.

[0092] It is understandable that after obtaining the real-time image signal, how to determine the current camera mode requires identifying the real-time image features in the real-time image. Specifically, the features we select are the movement speed of the endoscope during the operation and the smoke content around it. On the one hand, the moving speed of the endoscope in the human body cavity will affect whether the image transmitted to the display device is clear. In addition, due to the temperature difference between the endoscope and the inside of the human body cavity, it is very easy to generate smoke factors near the lens of the endoscope, which in turn leads to poor image quality transmitted to the display device. Thus, for the classification of the obtained real-time image features, in this embodiment, the algorithm based on the convolutional neural network is used to classify the images.

[0093] Among them, the algorithm based on the convolutional neural network has the advantage of strong feature extraction ability; the convolutional neural network has excellent feature extraction ability. Through multiple convolutional operations, the network can automatically learn the local structure and global features of the image, thereby capturing higher-level semantic information; this makes the convolutional neural network perform well in tasks such as image classification, object detection, and semantic segmentation; it also has the advantages of parameter sharing and sparse connection; the convolutional neural network adopts the way of parameter sharing and sparse connection, which greatly reduces the number of network parameters and the amount of calculation; since the weights of the convolutional kernel are shared throughout the image, the network can better process large-scale image data and reduce the risk of overfitting at the same time; in addition, sparse connection also makes the network more efficient and can process larger-scale input data; at the same time, the algorithm based on the convolutional neural network also has the advantage of translational invariance; because the convolutional operation has the characteristic of translational invariance, that is, it is insensitive to image translation, the convolutional neural network has a certain robustness to the position and size changes of objects in the image. This makes it possible that in practical applications, even if the position of the target object changes slightly, the network can still accurately identify and locate; in addition, the algorithm based on the convolutional neural network also has strong visualization and interpretability; the convolutional neural network can intuitively display the features learned by each convolutional layer through visualization techniques; this enables us to better understand the working principle of the network and gain insights from it; in addition, through visualization methods such as heat maps, the prediction results of the network can also be explained, improving the interpretability of the network. Thus, for the classification of the obtained real-time image features, in this embodiment, the algorithm based on the convolutional neural network is used to classify the images.

[0094] In addition, the camera mode of the endoscope camera system includes a high-resolution camera mode; before obtaining the real-time image, it further includes the steps:

[0095] S00, please refer to Figure 9 , after the endoscope camera system is powered on, the control system enters the high-resolution camera mode.

[0096] It can be understood that in some scenarios of surgical use, since the endoscope needs time to make judgments and responses, the display device cannot output a picture, which greatly affects the timeliness of the doctor's surgery. Therefore, for the sake of stability and safety, when the endoscope is powered on, it preferentially enters the high-resolution mode, that is, it preferentially outputs a picture for the user to judge the situation, and then promptly selects a response plan without delaying treatment. During subsequent use, the high-resolution mode or high-frame rate mode is selected according to the picture state.

[0097] The present invention also provides an endoscope camera system, which includes an image sensor, a controller, and a display device. The controller is electrically connected to the image sensor and the display device. Among them, the controller includes: a memory, a processor, and a high-refresh rate program based on the endoscope camera system that is stored on the memory and can run on the processor. The high-refresh rate program based on the endoscope camera system is configured to implement the high-refresh rate adaptation method based on the endoscope camera system as described above.

[0098] It can be understood that, please refer to Figure 10 , to implement the above-mentioned endoscope camera refresh rate adaptation method, the controller includes: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard). Optionally, the user interface 1003 may further include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0099] Those skilled in the art can understand that Figure 10 the structure of the controller shown in

[0100] does not constitute a limitation on the controller, and may include more or fewer components than shown in the figure, or combine some components, or have different component arrangements. Figure 10 As shown in

[0101] In Figure 10 In the controller shown, the control program of the endoscopic camera frame rate adaptive method stored in the memory 1005 is called by the processor 1001, and the endoscopic camera frame rate adaptive method of the endoscopic camera frame rate adaptive system is executed.

[0102] The above is only an exemplary embodiment of the present invention, and does not limit the patent scope of the present invention. Any equivalent structural transformation made under the technical concept of the present invention by using the content of the specification and drawings of the present invention, or directly / indirectly applied to other related technical fields, is included in the patent protection scope of the present invention.

Claims

1. A method for adaptively adjusting a high refresh rate of an endoscope camera system, characterized in that: The following steps are involved: Acquire a real-time image, wherein the image refresh rate in the high refresh rate camera mode is greater than or equal to 90 Hz; Classify the real-time image and determine the current camera scene mode according to the classification result, wherein the current camera scene mode includes a high dynamic scene mode and a low dynamic scene mode; determining movement information based on the real-time image; When the movement information meets a low speed preset condition, determining that the current camera scene mode is a low dynamic scene mode; When the movement information meets the high-speed preset condition, determining that the current camera scene mode is a high-dynamic scene mode; or, determining smoke information according to the real-time image; When the smoke information meets the clean preset condition, determining that the current camera scene mode is a low dynamic scene mode; When the smoke information meets the preset stain condition, determining that the current camera scene mode is a high dynamic scene mode; When the current camera scene mode is a high dynamic scene mode, determining the camera mode of the endoscope camera system to be a high refresh rate camera mode; The method for adaptively adjusting a high refresh rate of an endoscope camera system also includes: Acquiring a current camera mode, wherein the camera mode of the endoscope camera system further includes a high-resolution camera mode; When the current camera scene mode is a high dynamic scene mode, determining the camera mode of the endoscope camera system as a high refresh rate camera mode includes: When the current camera mode is the high-resolution camera mode and when the current camera scene mode is the high-dynamic scene mode, the camera mode of the endoscope camera system is switched from the high-resolution camera mode to the high-refresh rate camera mode.

2. The method for adaptively adjusting a high refresh rate of an endoscope camera system as claimed in claim 1, characterized in that: The endoscope camera system includes an image sensor; The imaging mode of the endoscope imaging system is switched from the high-resolution imaging mode to the high-refresh rate imaging mode: The image sensor is controlled to capture images with a first exposure time, and switched to capture images with a second exposure time, wherein the second exposure time is shorter than the first exposure time.

3. The method for adaptively adjusting a high refresh rate of an endoscope camera system as claimed in claim 1, characterized in that: The endoscope camera system includes a controller, in which a high refresh path and a high resolution path are formed; The imaging mode of the endoscope imaging system is switched from the high-resolution imaging mode to the high-refresh rate imaging mode: The high-resolution path of the controller is switched to a high-refresh path.

4. The method for adaptively adjusting a high refresh rate of an endoscope camera system as claimed in claim 1, characterized in that: The endoscope camera system includes a display device, wherein the display device has a high refresh display mode and a high resolution display mode; The imaging mode of the endoscope imaging system is switched from the high-resolution imaging mode to the high-refresh rate imaging mode: The display device is switched from the high-resolution display mode to a high-refresh display mode.

5. The method for adaptively adjusting a high refresh rate of an endoscope camera system as claimed in claim 1, characterized in that: Classifying and processing the real-time image includes: The image is classified and processed based on the convolutional neural network algorithm according to the real-time image.

6. The method for adaptively adjusting a high refresh rate of an endoscope camera system as claimed in claim 1, characterized in that: The imaging mode of the endoscope imaging system includes a high-resolution imaging mode; Before acquiring the real-time image, the method further includes: After the endoscope camera system is turned on, the control system enters the high-resolution camera mode.

7. An endoscope camera system, characterized in that: It includes an image sensor, a controller and a display device, wherein the controller is electrically connected to the image sensor and the display device, wherein the controller includes: a memory, a processor and a program for adaptively adjusting a high refresh rate based on an endoscopic camera system stored in the memory and executable on the processor, wherein the program for adaptively adjusting a high refresh rate based on an endoscopic camera system is configured to implement a method for adaptively adjusting a high refresh rate based on an endoscopic camera system as described in any one of claims 1 to 6.

Images