Endoscope adaptive dimming method and device based on integrated control parameters
By using a segmented mapping model of integrated control parameters, the brightness of the endoscope's light source, the gain of the image sensor, and the exposure time are adjusted in a coordinated manner, which solves the problem of poor imaging performance of the endoscope in extreme environments and achieves high-quality adaptive dimming.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HIMAGING TECH (SHANGHAI) CO LTD
- Filing Date
- 2026-04-27
- Publication Date
- 2026-07-24
AI Technical Summary
Existing endoscopic dimming technology cannot effectively coordinate and control multiple parameters, resulting in poor imaging effects. In particular, the image brightness fluctuates drastically under extreme imaging environments, affecting the diagnostic and treatment outcomes.
An adaptive dimming method with integrated control parameters is adopted. By acquiring the current frame image and control parameters, a segmented mapping model is established, and the light source brightness, image sensor gain and exposure time are adjusted in a coordinated manner to achieve closed-loop adaptive dimming.
It enables intelligent dimming of endoscopes in extreme environments, improves imaging quality, avoids brightness oscillation and slow response, and ensures optimized image quality.
Smart Images
Figure CN122440112A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of endoscopy technology, and in particular to an endoscopy adaptive dimming method, device, electronic device, computer storage medium, and computer program product based on integrated control parameters. Background Technology
[0002] In medicine, an endoscope is a medical device that allows direct observation of hollow organs or tissues inside the human body. It integrates multiple modules, including image sensors, optical lenses, and light sources, and can be inserted into the body through orifices, allowing medical personnel to easily and quickly visualize lesions that are difficult to examine under normal circumstances. However, its imaging quality is highly dependent on the stability and adaptability of the intracavitary illumination.
[0003] In clinical practice, endoscopy often takes place in extremely harsh imaging environments. The cavity contains almost no natural light and relies entirely on its own light source. Furthermore, due to the varying reflectivity of different tissues, changes in object distance, and the complex environment of the cavity, image brightness often fluctuates dramatically, resulting in inconsistent imaging quality and significantly impacting diagnosis and treatment.
[0004] Existing technologies include several dimming techniques for endoscopes. These techniques aim to optimize endoscopic imaging by controlling parameters such as light source brightness, sensor gain, and exposure time. However, excessively low or high light source brightness can negatively impact imaging, excessive sensor gain can introduce electronic noise, and increased exposure time can lead to motion blur. Simply controlling these interdependent parameters independently, in series, or in parallel can still result in brightness oscillations, slow response, or image quality degradation, reducing the effectiveness of endoscopic diagnosis and treatment, and even complicating the diagnostic process.
[0005] Therefore, there is an urgent need for an endoscopic adaptive dimming method that can adjust parameters through an integrated and collaborative approach, which can unify the control of multiple parameters under a single mathematical model and achieve intelligent dimming that prioritizes image quality. Summary of the Invention
[0006] The main objective of this invention is to solve the technical problem that the existing technology cannot coordinate the control of multiple dimming parameters, resulting in an unintelligent dimming control method during endoscopic imaging, leading to poor adjustment effect and consequently poor image quality acquired by the endoscope.
[0007] The first aspect of this invention provides an endoscopic adaptive light adjustment method based on integrated control parameters, comprising: Acquire the current frame image captured by the endoscope and the corresponding current endoscope control parameters, and calculate the average image brightness of the current frame image; Based on a preset segmented mapping model, the current integrated control parameters corresponding to the current endoscope control parameters are obtained according to the mapping relationship; The target integrated control parameters are calculated based on the preset target image brightness, the average image brightness, and the current integrated control parameters; Determine the dimming stage of the integrated target control parameters in the segmented mapping model, and calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage; Using the target endoscope control parameters as the dimming target, adjust the endoscope control parameters to complete one dimming cycle; Repeat the dimming steps to achieve closed-loop adaptive dimming.
[0008] Optionally, in a first implementation of the first aspect of the present invention, the current endoscope control parameters include the current light source brightness, the current image sensor gain, and the current exposure time; The target endoscope control parameters include target light source brightness, target image sensor gain, and target exposure time.
[0009] Optionally, in a second implementation of the first aspect of the present invention, before acquiring the current frame image captured by the endoscope and the corresponding current endoscope control parameters, the method further includes: Based on the preset segmented mapping relationship, a segmented mapping model between endoscopic control parameters and integrated control parameters is constructed; The segmented mapping model divides the value range of the integrated control parameter into three value range stages. Each value range stage corresponds to a dimming stage, and each dimming stage only performs adjustment on one endoscope control parameter. The dimming stage includes a light source-dominant stage, a gain-assisted stage, and an exposure compensation stage. According to the order of the values of the integrated control parameters from small to large, the adjustment priority of the endoscope control parameters is: light source brightness > image sensor gain > exposure time.
[0010] Optionally, in a third implementation of the first aspect of the present invention, when adjusting the integrated control parameters, the light source brightness is increased linearly first, the gain is increased after the light source brightness reaches its maximum value, and finally the exposure time is increased.
[0011] Alternatively, in a fourth implementation of the first aspect of the present invention: by Indicates the numerical value of the integrated control parameters; when At this time, the dimming stage is the light source-dominated stage; when At this time, the dimming stage is a gain-assisted stage; when At this time, the dimming stage is the exposure compensation stage; in, Indicates the brightness of the light source, the This indicates the lowest adjustable value for the brightness of the light source. This indicates the highest adjustable value for the light source brightness. Indicates the image sensor gain, the This represents the lowest adjustable value for the image sensor gain. This indicates the highest adjustable value for the image sensor gain. Indicates the exposure time, the stated This indicates the lowest adjustable value for the exposure time. This indicates the highest adjustable value for exposure time.
[0012] Optionally, in a fifth implementation of the first aspect of the present invention, when the dimming stage is a light source-dominated stage, the expression for the mapping relationship of the segmented mapping model is: ; When the dimming stage is a gain-assisted stage, the expression for the mapping relationship of the segmented mapping model is: ; ; ; When the dimming stage is the exposure compensation stage, the expression for the mapping relationship of the segmented mapping model is: ; ; .
[0013] Optionally, in a sixth implementation of the first aspect of the present invention, calculating the target integrated control parameters based on the preset target image brightness, the average image brightness, and the current integrated control parameters includes: Calculate the scaling factor based on the target image brightness and the average image brightness; Based on the proportional coefficient and the current integrated control parameters, the target integrated control parameters are solved; When solving the target integrated control parameters, the average image brightness is protected by dividing by zero. When the average image brightness is less than the preset brightness threshold, the average image brightness is assigned a preset minimum value. After the solution is completed, the target integrated control parameters are limited to the preset integrated control parameter threshold range. The expression for solving the integrated control parameters of the target is as follows: ; The The target integrated control parameters, the The average image brightness is represented by the following. The brightness of the target image is represented by the following. This indicates the current integrated control parameters.
[0014] A second aspect of the present invention provides an endoscope adaptive dimming device based on integrated control parameters, comprising: The information acquisition module is used to acquire the current frame image and the corresponding current endoscope control parameters acquired by the endoscope, and to calculate the average image brightness of the current frame image; The mapping calculation module is used to obtain the current integrated control parameters corresponding to the current endoscope control parameters based on the mapping relationship according to the preset segmented mapping model. The target calculation module is used to calculate the target integrated control parameters based on the preset target image brightness, the average image brightness, and the current integrated control parameters; The mapping calculation module is also used to determine the dimming stage of the target integrated control parameters in the segmented mapping model, and to calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage. The control execution module is used to take the target endoscope control parameters as the dimming target, adjust the endoscope control parameters, and complete one dimming operation. The closed-loop execution module is used to repeatedly execute the dimming steps to achieve closed-loop adaptive dimming.
[0015] A third aspect of the present invention provides an endoscope adaptive dimming device based on integrated control parameters, comprising: a memory and at least one processor, wherein the memory stores instructions; the at least one processor invokes the instructions in the memory to cause the endoscope adaptive dimming device based on integrated control parameters to perform the steps of the above-described endoscope adaptive dimming method based on integrated control parameters.
[0016] A fourth aspect of the present invention provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the steps of the above-described endoscope adaptive dimming method based on integrated control parameters.
[0017] A fifth aspect of the present invention provides a computer program product comprising a computer program / instructions that, when executed by a processor, implement the steps of the endoscope adaptive dimming method based on integrated control parameters as described above.
[0018] The technical solution provided by this invention involves acquiring the current frame image captured by the endoscope and the corresponding current endoscope control parameters, and calculating the average image brightness of the current frame image; based on a preset segmented mapping model, obtaining the current integrated control parameters corresponding to the current endoscope control parameters according to the mapping relationship; calculating the target integrated control parameters based on the preset target image brightness, average image brightness, and current integrated control parameters; determining the dimming stage of the target integrated control parameters in the segmented mapping model, and calculating the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage; using the target endoscope control parameters as the dimming target, adjusting the endoscope control parameters to complete one dimming cycle; and repeating the dimming steps to achieve closed-loop adaptive dimming. This method can achieve integrated control of multiple dimming parameters of the endoscope through a holistic segmented mapping dimming model, and achieve intelligent adaptive dimming through the synergy of various dimming parameters, thereby improving the imaging effect of the endoscope.
[0019] The device, electronic device, computer-readable storage medium, and computer program product provided by this invention also solve the corresponding technical problems. Attached Figure Description
[0020] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is a flowchart illustrating the first embodiment of the endoscope adaptive dimming method based on integrated control parameters in this invention. Figure 2 This is a graph showing the measured relationship between the image sensor exposure time and the average image brightness in the first embodiment of the endoscope adaptive dimming method based on integrated control parameters according to the present invention. Figure 3 This is a measured curve showing the relationship between image sensor gain and average image brightness in the first embodiment of the endoscope adaptive dimming method based on integrated control parameters according to the present invention. Figure 4 This is a schematic diagram of the closed-loop control process in the first embodiment of the endoscope adaptive dimming method based on integrated control parameters according to the present invention. Figure 5 This is a schematic diagram of a piecewise function in the piecewise mapping model in the first embodiment of the endoscope adaptive dimming method based on integrated control parameters according to the present invention. Figure 6 This is a schematic diagram of an endoscope adaptive dimming device based on integrated control parameters in an embodiment of the present invention; Figure 7This is a schematic diagram of an endoscope adaptive dimming device based on integrated control parameters in an embodiment of the present invention; Figure 8 This is a schematic diagram illustrating the principle of a computer-readable medium according to an embodiment of the present invention. Detailed Implementation
[0021] Exemplary embodiments of the invention will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limiting the invention to the embodiments set forth herein. Rather, these exemplary embodiments are provided to make the invention more comprehensive and complete, and to facilitate a full communication of the inventive concept to those skilled in the art. The same reference numerals in the drawings denote the same or similar elements, components, or parts, and therefore repeated descriptions of them will be omitted.
[0022] Subject to the technical concept of this invention, the features, structures, characteristics or other details described in a particular embodiment may be combined in one or more other embodiments in a suitable manner.
[0023] In the description of specific embodiments, the features, structures, characteristics, or other details described in this invention are intended to enable those skilled in the art to fully understand the embodiments. However, it is not excluded that those skilled in the art can practice the technical solutions of this invention without one or more of the specific features, structures, characteristics, or other details.
[0024] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.
[0025] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.
[0026] The terms “and / or” or “and / or” include all combinations of any one or more of the listed items.
[0027] See Figures 1-5 The first embodiment of the endoscope adaptive dimming method based on integrated control parameters in this invention is described in detail below.
[0028] It is understood that the executing entity of this invention can be an endoscope adaptive dimming device or system based on integrated control parameters, or it can be a terminal or a server; the specific implementation is not limited here. This embodiment of the invention will be described using a server as an example.
[0029] S110, System Calibration and Parameter Acquisition; The parameters of the endoscope's hardware system are acquired and calibrated. Control parameters that affect the brightness of the acquired images are selected as the endoscope's control parameters. These control parameters include the light source brightness L and the image sensor gain. and exposure time .
[0030] Exposure time was determined experimentally. The linear effective operating range is Image sensor gain The linear effective working range is denoted as . And set the light source brightness. The adjustable range is .
[0031] Based on the actual test results, the exposure time can be determined. The relationship with the mean image brightness is as follows: Figure 2 As shown, image sensor gain The relationship with the mean image brightness is as follows: Figure 3 As shown. Based on this, the settings are... , (This is a hexadecimal value; the corresponding decimal value should be 48.) (This is a hexadecimal value; the corresponding decimal value should be 22.) (This is a hexadecimal value; the corresponding decimal value should be 255). The specific adjustment parameters should be obtained based on the chosen light source hardware. and The value of is usually made , .
[0032] S120: Constructing integrated control parameters ; Based on the endoscopic examination requirements, a target image brightness that meets those requirements is preset. Define a value related to the brightness of the target image. The proportional virtual control quantity is used as the integrated control parameter. That is, satisfying ; and the integrated control parameters This is the only core setting value for the entire dimming algorithm.
[0033] S130: Establish integrated control parameters With endoscope control parameters ( , , The piecewise mapping model; Integrated control parameters The entire value range The system is divided into three consecutive value range stages, each corresponding to a dimming stage, resulting in three dimming stages: a light source-dominant stage, a gain-assisted stage, and an exposure compensation stage. A single physical quantity for each dimming stage is controlled by the integrated parameters. The light source brightness changes linearly, while the other two quantities remain constant. Following the order of increasing values of the integrated control parameters, the adjustment priority of the endoscope control parameters is based on the light source brightness. Image sensor gain Exposure time That is, the active order of the endoscopic control parameters is fixed as follows: , and Prioritize linearly increasing the brightness of the light source Increase the image sensor gain only after it reaches its maximum value. Finally, increase the exposure time. The specific mapping rules are as follows: (1) Light source-dominated stage: This dimming stage is the light source-dominated stage, when hour, ; This dimming stage adjusts the image brightness by regulating the light source brightness, thus avoiding the introduction of sensor noise and achieving optimal image quality. Among these adjustments, The value is 1.
[0034] (2) Gain Assist Phase: This dimming stage is a gain-assisted stage, when hour: ; ; ; In this dimming stage, the light source has reached its maximum adjustment level. In fact, the brightness is increased by linearly increasing the gain, which may introduce some circuit noise, but it can ensure that the effects of motion blur are avoided.
[0035] (3) Exposure compensation stage: This dimming stage is the exposure compensation stage, when hour: ; ; ; In this dimming stage, both the light source and gain are at their maximum. To adjust the imaging effect of the endoscope, the exposure time is increased to meet the brightness requirements, which may introduce motion blur.
[0036] S140: Based on integrated parameters Real-time closed-loop dimming control; See Figure 4 The process for executing specific dimming control is as follows: S141: Acquire the current frame image captured by the endoscope and calculate the average image brightness; Acquire the current frame image captured by the endoscope, and calculate the average image brightness of the current frame image, labeled as... .
[0037] S142: Obtain the current endoscope control parameters corresponding to the current image acquisition; The current endoscope control parameters include the current light source brightness. Current image sensor gain and current exposure time .
[0038] S143: Based on the preset segmented mapping model, obtain the current integrated control parameters corresponding to the current endoscope control parameters according to the mapping relationship; Based on the segmented mapping model established in step S130 above, and according to the expression of the mapping relationship, reverse mapping is performed to obtain the current integrated parameters corresponding to the current endoscopic control parameters. .
[0039] S144: Calculate the target integrated control parameters based on the preset target image brightness, average image brightness, and current integrated control parameters; Obtain the target image brightness preset according to the endoscopic examination requirements in the aforementioned steps. Calculate the integrated parameter values of the target .
[0040] In specific calculations, a proportional calculation method is preferred. A proportional coefficient is calculated based on the target image brightness and the average image brightness. Based on the proportional coefficient and the current integrated control parameters, the target integrated control parameters are solved. The specific expression is: ; Among them, the The target integrated control parameters, the The average image brightness is represented by the following. The brightness of the target image is represented by the following. This indicates the current integrated control parameters.
[0041] In this embodiment, the average image brightness is obtained when the endoscope fails to capture a valid image. The result might be zero, which could lead to direct division by zero and calculation errors. Therefore, this embodiment requires careful calculation. Perform division by zero protection to obtain a preset brightness threshold. If the brightness is less than the preset threshold, then... The value is assigned to a preset minimum brightness value to ensure that the denominator is not zero during calculation. In a preferred embodiment, by adjusting the preset minimum brightness value, the division-to-zero protection scheme described in this embodiment can also control the scaling factor. The value will not be too large to prevent significant changes in the integrated control parameters of the target.
[0042] This embodiment also includes limiting the execution result of the integrated target control parameters. In some cases, if the result is obtained directly based on the calculation expression in this step... When performing dimming, issues such as exceeding the equipment's capacity or overexposure may occur; alternatively, the control value may be below the effective working range, resulting in insignificant adjustment effects. Therefore, it is necessary to pre-set the effective working range of the integrated control parameters. ,exist After the calculation is completed, The amplitude is limited within the preset threshold range of the integrated control parameters: like Then make Pick ,like , then make Pick In other cases, take The calculated value is sufficient.
[0043] S145: Determine the dimming stage of the integrated target control parameters in the segmented mapping model, and calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage. Based on target integrated control parameters The range of values within which the target integrated control parameters fall is used to determine the integrated control parameters. Which dimming stage should it fall into within the segmented mapping model?
[0044] Then, based on the corresponding dimming stage, the corresponding mapping relationship expression is found, and the target integrated control parameters are calculated based on the mapping relationship expression. The unique combination of target endoscope control parameters (i.e.) Target light source brightness Target image sensor gain and target exposure time ): When the target is integrated control parameters Target light source brightness = Target image sensor gain = Target exposure time = ; When the target is integrated control parameters At that time, the brightness of the target light source = Target image sensor gain Target exposure time ; When the target is integrated control parameters At that time, the brightness of the target light source = Target image sensor gain , .
[0045] S146: Use the target endoscope control parameters as the dimming target, adjust the endoscope control parameters, and complete one dimming cycle; Brightness of the target light source Target image sensor gain and target exposure time The signal is sent to the control center of the endoscope hardware, where the parameters are adjusted to the target value through a smooth adjustment process, completing one light adjustment.
[0046] Acquire the next frame image and repeat the steps in S141-S145 above to achieve closed-loop control through continuous dimming.
[0047] The following is a specific example to illustrate this, based on Figure 2 as well as Figure 3 Based on the measured data, the key parameters were determined as follows: , , , , , .
[0048] Based on the aforementioned S130, calculate the key nodes of the piecewise mapping model: (1) The end of the light source-dominant phase: ; At this point, the light source achieves its maximum adjustment effect; (2) End of the gain-assisted phase: ; At this point, the gain assist reaches its maximum adjustment effect; (3) End of the exposure compensation phase: The end of the exposure compensation phase is also the end of the entire adjustment process. ; At this point, the exposure time compensation achieves its maximum adjustment effect.
[0049] Substituting the specific parameters, we obtain a piecewise function that can be directly implemented in a program: when hour, , , ; when hour, , , ; when : , , ; The mapping relationship diagram of the above piecewise functions is shown in the figure below. Figure 5 As shown in the figure, the parameter values refer to... L / G / T For example, if the parameter value is 100 / 22 / 1, it means... L =100, G =22, T =1.
[0050] After obtaining the piecewise mapping model based on the piecewise function, specific dimming control can be executed: Assume the current state of the system: light source brightness Image sensor gain Current exposure time Corresponding brightness Target brightness ; First, we obtain the result through reverse mapping. Current light source brightness It has not yet reached its maximum value, therefore it is still in the stage dominated by the light source. ; Calculate the integrated control parameters of the target based on the proportional algorithm. : ; Execute judgment and solution, because , Therefore, it belongs to the gain-assisted stage; based on the relational expression of the gain-assisted stage, we can obtain: Target light source brightness ; Target image sensor gain (Round up); Target exposure time .
[0051] Based on the above solution, the control system adjusts the light source to the brightest (100), sets the gain to 35, and keeps the exposure at 1.
[0052] The solution provided in this embodiment of the invention achieves the following technical effects: By introducing integrated control parameters This transforms the originally independent and complex three physical quantities (light source brightness) Image sensor gain and exposure time The control problem is transformed into the control of a single variable. To address the linear tracking problem, a concise control model was established with clear control logic, smooth and oscillating response, achieving true multi-parameter integrated collaborative control. The segmented mapping model enforces the order of adjustment for "light source, gain, and exposure". This ensures that the system automatically and inevitably prioritizes adjustment methods that do not degrade image quality under any brightness requirement, and only uses methods that degrade image quality when necessary, thus always outputting the optimal signal-to-noise ratio image within hardware limitations, and embedding a mandatory strategy for image quality optimization. The mapping model is strictly established within the measured linear operating range of sensor gain and exposure time, avoiding parameters from entering the saturation region or the high-noise nonlinear region, so that the hardware performance can be used most effectively and safely, and efficient control based on physical characteristics can be achieved. The effectiveness of this method is rooted in universal physical principles; for different endoscopic hardware, only the image sensor gain of the hardware needs to be recalibrated. Effective working scope (i.e.) and and exposure time The linear effective working range (i.e. and With just a few key parameters such as ), it can be quickly deployed and applied, with extremely low migration costs.
[0053] The above describes the endoscope adaptive dimming method based on integrated control parameters in the embodiments of the present invention. The following describes the endoscope adaptive dimming device based on integrated control parameters in the embodiments of the present invention. (See reference...) Figure 6One embodiment of the endoscope adaptive dimming device based on integrated control parameters in this invention includes: The information acquisition module 601 is used to acquire the current frame image acquired by the endoscope and the corresponding current endoscope control parameters, and to calculate the average image brightness of the current frame image; The mapping calculation module 602 is used to obtain the current integrated control parameters corresponding to the current endoscope control parameters based on the mapping relationship according to the preset segmented mapping model. Target calculation module 603 is used to calculate target integrated control parameters based on preset target image brightness, average image brightness and current integrated control parameters; The mapping calculation module 602 is also used to determine the dimming stage of the target integrated control parameters in the segmented mapping model, and to calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage. The control execution module 604 is used to take the target endoscope control parameters as the dimming target, adjust the endoscope control parameters, and complete one dimming operation. The closed-loop execution module 605 is used to repeatedly execute the dimming steps to achieve closed-loop adaptive dimming.
[0054] The device provided in this embodiment of the invention can control multiple dimming parameters of an endoscope in an integrated manner through a whole segmented mapping dimming model. It achieves intelligent adaptive dimming through the coordination of various dimming parameters, thereby improving the imaging effect of the endoscope.
[0055] In another embodiment of this application, the current endoscope control parameters include the current light source brightness, the current image sensor gain, and the current exposure time; the target endoscope control parameters include the target light source brightness, the target image sensor gain, and the target exposure time.
[0056] In another embodiment of this application, the endoscope adaptive dimming device based on integrated control parameters further includes a model building module, which is specifically used to build a segmented mapping model between the endoscope control parameters and the integrated control parameters based on a preset segmented mapping relationship. The segmented mapping model divides the value range of the integrated control parameter into three value range stages. Each value range stage corresponds to a dimming stage, and each dimming stage only performs adjustment on one endoscope control parameter. The dimming stage includes a light source-dominant stage, a gain-assisted stage, and an exposure compensation stage. According to the order of the values of the integrated control parameters from small to large, the adjustment priority of the endoscope control parameters is: light source brightness > image sensor gain > exposure time.
[0057] In another embodiment of this application, with Indicates the numerical value of the integrated control parameters; when At this time, the dimming stage is the light source-dominated stage; when At this time, the dimming stage is a gain-assisted stage; when At this time, the dimming stage is the exposure compensation stage; in, Indicates the brightness of the light source, the This indicates the lowest adjustable value for the brightness of the light source. This indicates the highest adjustable value for the light source brightness. Indicates the image sensor gain, the This represents the lowest adjustable value for the image sensor gain. This indicates the highest adjustable value for the image sensor gain. Indicates the exposure time, the stated This indicates the lowest adjustable value for the exposure time. This indicates the highest adjustable value for exposure time.
[0058] In another embodiment of this application, when the dimming stage is a light source-dominated stage, the expression for the mapping relationship of the segmented mapping model is: ; When the dimming stage is a gain-assisted stage, the expression for the mapping relationship of the segmented mapping model is: ; ; ; When the dimming stage is the exposure compensation stage, the expression for the mapping relationship of the segmented mapping model is: ; ; .
[0059] In another embodiment of this application, the target calculation module 603 is specifically used to calculate a scaling factor based on the target image brightness and the average image brightness; Based on the proportional coefficient and the current integrated control parameters, the target integrated control parameters are solved; When solving the target integrated control parameters, the average image brightness is protected by dividing by zero. When the average image brightness is less than the preset brightness threshold, the average image brightness is assigned a preset minimum value. After the solution is completed, the target integrated control parameters are limited to the preset integrated control parameter threshold range. The expression for solving the integrated control parameters of the target is as follows: ; The The target integrated control parameters, the The average image brightness is represented by the following. The brightness of the target image is represented by the following. This indicates the current integrated control parameters.
[0060] The device provided in this invention can integrate multiple originally independent dimming parameters in the endoscope through a holistic, segmented mapping dimming model based on the introduced integrated control parameters, achieving true multi-parameter integrated collaborative control. By setting the priority order, it limits the endoscope to use limited image-quality-free adjustment methods, realizing an embedded optimization forced strategy. By limiting the adjustment range of each parameter, it prevents parameters from entering the saturation region or the high-noise nonlinear region, ensuring the most effective and safest utilization of hardware performance. For different hardware, it can be quickly deployed by recalibrating only a few key hardware parameters, making it highly applicable.
[0061] In a preferred embodiment, this application also provides an endoscope adaptive dimming system based on integrated control parameters. The corresponding description of the endoscope adaptive dimming system based on integrated control parameters can be found in the above-described device embodiments, and will not be repeated here.
[0062] Based on the same inventive concept, this specification also provides an electronic device for adaptive dimming of an endoscope based on integrated control parameters. The electronic device for adaptive dimming of an endoscope based on integrated control parameters in this embodiment of the invention will be described in detail below from the perspective of hardware processing.
[0063] Figure 7 This is a schematic diagram of an electronic device provided as an embodiment of this specification. Refer to the following... Figure 7 To describe the electronic device 700 according to this embodiment of the invention. Figure 7 The electronic device 700 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.
[0064] like Figure 7 As shown, the electronic device 700 is presented in the form of a general-purpose computing device. The components of the electronic device 700 may include, but are not limited to: at least one processing unit 710, at least one storage unit 720, a bus 730 connecting different system components (including storage unit 720 and processing unit 710), a display unit 740, etc.
[0065] The storage unit stores program code that can be executed by the processing unit 710, causing the processing unit 710 to perform the steps described in the processing method section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 710 can perform actions such as... Figure 1 or Figure 4 The steps are shown in the method.
[0066] The storage unit 720 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 7201 and / or a cache storage unit 7202, and may further include a read-only memory unit (ROM) 7203.
[0067] The storage unit 720 may also include a program / utility 7204 having a set (at least one) program module 7205, such program module 7205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.
[0068] Bus 730 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.
[0069] Electronic device 700 can also communicate with one or more external devices 100 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 700, and / or with any device that enables electronic device 700 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 750. Furthermore, electronic device 700 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 760. Network adapter 760 can communicate with other modules of electronic device 700 via bus 730. It should be understood that, although... Figure 7 As not shown in the diagram, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0070] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described in this invention can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, or network device, etc.) to execute the method described above according to this invention. When the computer program is executed by a data processing device, it enables the computer-readable medium to implement the method described above, i.e.: as... Figure 1 or Figure 4 The method shown.
[0071] Figure 8 This is a schematic diagram of a computer-readable medium provided for embodiments of this specification.
[0072] accomplish Figure 1 or Figure 4 The computer program of the method shown can be stored on one or more computer-readable media. A computer-readable medium can be a readable signal medium or a readable storage medium. A readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.
[0073] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.
[0074] In addition, the present invention also provides a computer program product, including a computer program / instruction that, when executed by a processor, implements the endoscope adaptive dimming method based on integrated control parameters as described in any of the above embodiments.
[0075] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0076] In summary, the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that in practice, general-purpose data processing devices such as microprocessors or digital signal processors (DSPs) can be used to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such programs implementing the present invention can be stored on a computer-readable medium or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
[0077] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the present invention is not inherently related to any specific computer, virtual device, or electronic device, and various general-purpose devices can also implement the present invention. The above descriptions are merely specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
[0078] The various embodiments in this specification are described in a progressive manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.
[0079] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.
Claims
1. An endoscope adaptive light adjustment method based on integrated control parameters, characterized in that, include: Acquire the current frame image captured by the endoscope and the corresponding current endoscope control parameters, and calculate the average image brightness of the current frame image; Based on a preset segmented mapping model, the current integrated control parameters corresponding to the current endoscope control parameters are obtained according to the mapping relationship; The target integrated control parameters are calculated based on the preset target image brightness, the average image brightness, and the current integrated control parameters; Determine the dimming stage of the integrated target control parameters in the segmented mapping model, and calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage; Using the target endoscope control parameters as the dimming target, adjust the endoscope control parameters to complete one dimming cycle; Repeat the dimming steps to achieve closed-loop adaptive dimming.
2. The endoscope adaptive dimming method based on integrated control parameters according to claim 1, characterized in that: The current endoscope control parameters include the current light source brightness, the current image sensor gain, and the current exposure time; The target endoscope control parameters include target light source brightness, target image sensor gain, and target exposure time.
3. The endoscope adaptive dimming method based on integrated control parameters according to claim 2, characterized in that, Before acquiring the current frame image captured by the endoscope and the corresponding current endoscope control parameters, the method further includes: Based on the preset segmented mapping relationship, a segmented mapping model between endoscopic control parameters and integrated control parameters is constructed; The segmented mapping model divides the value range of the integrated control parameter into three value range stages. Each value range stage corresponds to a dimming stage, and each dimming stage only performs adjustment on one endoscope control parameter. The dimming stage includes a light source-dominant stage, a gain-assisted stage, and an exposure compensation stage. According to the order of the values of the integrated control parameters from small to large, the adjustment priority of the endoscope control parameters is: light source brightness > image sensor gain > exposure time.
4. The endoscope adaptive dimming method based on integrated control parameters according to claim 3, characterized in that, by Indicates the numerical value of the integrated control parameters; when At this time, the dimming stage is the light source-dominated stage; when At this time, the dimming stage is a gain-assisted stage; when At this time, the dimming stage is the exposure compensation stage; in, Indicates the brightness of the light source, the This indicates the lowest adjustable value for the brightness of the light source. This indicates the highest adjustable value for the light source brightness. Indicates the image sensor gain, the This represents the lowest adjustable value for the image sensor gain. This indicates the highest adjustable value for the image sensor gain. Indicates the exposure time, the stated This indicates the lowest adjustable value for the exposure time. This indicates the highest adjustable value for exposure time.
5. The endoscope adaptive dimming method based on integrated control parameters according to claim 4, characterized in that: When the dimming stage is the light source-dominated stage, the expression for the mapping relationship of the segmented mapping model is: ； When the dimming stage is a gain-assisted stage, the expression for the mapping relationship of the segmented mapping model is: ； ； ； When the dimming stage is the exposure compensation stage, the expression for the mapping relationship of the segmented mapping model is: ； ； 。 6. The endoscope adaptive dimming method based on integrated control parameters according to claim 1, characterized in that, The calculation of the target integrated control parameters based on the preset target image brightness, the average image brightness, and the current integrated control parameters includes: Calculate the scaling factor based on the target image brightness and the average image brightness; Based on the proportional coefficient and the current integrated control parameters, the target integrated control parameters are solved; When solving the target integrated control parameters, the average image brightness is protected by dividing by zero. When the average image brightness is less than the preset brightness threshold, the average image brightness is assigned a preset minimum value. After the solution is completed, the target integrated control parameters are limited to the preset integrated control parameter threshold range. The expression for solving the integrated control parameters of the target is as follows: ； The The target integrated control parameters, the The average image brightness is represented by the following. The brightness of the target image is represented by the following. This indicates the current integrated control parameters.
7. An endoscope adaptive dimming device based on integrated control parameters, characterized in that, The endoscope adaptive dimming device based on integrated control parameters includes: The information acquisition module is used to acquire the current frame image and the corresponding current endoscope control parameters acquired by the endoscope, and to calculate the average image brightness of the current frame image; The mapping calculation module is used to obtain the current integrated control parameters corresponding to the current endoscope control parameters based on the mapping relationship according to the preset segmented mapping model. The target calculation module is used to calculate the target integrated control parameters based on the preset target image brightness, the average image brightness, and the current integrated control parameters; The mapping calculation module is also used to determine the dimming stage of the target integrated control parameters in the segmented mapping model, and to calculate the target endoscope control parameters according to the mapping relationship corresponding to the dimming stage. The control execution module is used to take the target endoscope control parameters as the dimming target, adjust the endoscope control parameters, and complete one dimming operation. The closed-loop execution module is used to repeatedly execute the dimming steps to achieve closed-loop adaptive dimming.
8. An endoscope adaptive dimming device based on integrated control parameters, characterized in that, The endoscope adaptive dimming device based on integrated control parameters includes: a memory and at least one processor, wherein the memory stores instructions; The at least one processor invokes the instructions in the memory to cause the endoscope adaptive dimming device based on integrated control parameters to perform the steps of the endoscope adaptive dimming method based on integrated control parameters as described in any one of claims 1-6.
9. A computer-readable storage medium storing a computer program / instructions thereon, characterized in that, When the program / instruction is executed by the processor, it implements the steps of the endoscope adaptive dimming method based on integrated control parameters as described in any one of claims 1-6.
10. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, the steps of the endoscope adaptive dimming method based on integrated control parameters as described in any one of claims 1-6 are implemented.