Intelligent exterior mirror automatic illumination multi-stage adjusting method

Abstract

The invention discloses an automatic illumination multistage adjusting method for an intelligent exterior mirror. The automatic illumination multistage adjusting method sequentially comprises the steps of default parameter setting, image acquisition, illumination calculation, illumination judgment and illumination adjustment. According to the invention, the illumination parameters can be adjusted step by step through three adjustment strategies for adjusting the priorities, so that the steps of manual operation in an operation are reduced, and the automation and intelligence levels of the exterior mirror are improved.

Description

Technical Field

[0001] The invention belongs to the technical field of medical devices and relates to an automatic illumination multi-level adjustment method for an intelligent exterior mirror. Background Art

[0002] In recent years, exoscopic devices, as an important auxiliary instrument for surgical site observation, have been increasingly used in surgical procedures. During use, the illumination of the target tissue must meet a certain level of comfort for the human eye while also achieving a certain brightness within the surgical field, avoiding excessive or insufficient illumination.

[0003] Traditional methods require manual adjustment of light source brightness, camera shutter speed, and lens aperture. Reducing manual steps and improving automation during exterior mirror illumination adjustment is a pressing issue for smart exterior mirrors. Summary of the Invention

[0004] In order to solve the above problems, the present invention provides a method for automatically adjusting the illumination of an intelligent exterior mirror in multiple stages.

[0005] The specific plan is as follows:

[0006] A method for automatically adjusting the illumination of an intelligent exterior mirror in multiple stages comprises the following steps:

[0007] Step 1. Start the automatic illumination adjustment function;

[0008] Step 2. Default parameter settings;

[0009] Step 3. Image acquisition;

[0010] Step 4. Illumination calculation;

[0011] Step 5. Illumination determination;

[0012] Step 6. Illumination adjustment;

[0013] Step 7. End.

[0014] Further, the Step2 default parameter settings are as follows: a light measurement area ROI, a light measurement sensitivity threshold T, a reference illumination value RefIllumValue, a maximum light source brightness upper limit MaxLight, a minimum light source brightness lower limit MinLight, a light source adjustment step LightStep, a maximum camera shutter upper limit MaxShutter, a minimum camera shutter lower limit MinShutter, a camera shutter adjustment step ShutterStep, a maximum lens aperture upper limit MaxAperture, a minimum lens aperture lower limit MinAperture, and a lens aperture adjustment step ApertureStep. The light measurement area ROI is used to limit the illumination calculation area, the light measurement sensitivity threshold T is used to adjust the illumination sensitivity, the reference illumination value RefIllumValue is used to provide a reference value of a suitable illumination, the maximum light source brightness upper limit MaxLight is used as an upper limit value of the light source brightness in the automatic illumination adjustment process under the premise that no burns are caused and the comfort of the human eye when directly viewing the field of view of the tissue is ensured, the minimum light source brightness lower limit MinLight is used as a lower limit value of the light source brightness in the automatic illumination adjustment process, the light source adjustment step LightStep is used as a unit amount of increase or decrease when updating the light source brightness, the maximum camera shutter upper limit MaxShutter is used as an upper limit value of the camera shutter in the automatic illumination adjustment process, the minimum camera shutter lower limit MinShutter is used as a lower limit value of the camera shutter in the automatic illumination adjustment process, the camera shutter adjustment step ShutterStep is used as a unit amount of increase or decrease when updating the camera shutter, the maximum lens aperture upper limit MaxAperture is used as an upper limit value of the lens aperture value in the automatic illumination adjustment process, the minimum lens aperture lower limit MinAperture is used as a lower limit value of the lens aperture value in the automatic illumination adjustment process, and the lens aperture adjustment step ApertureStep is used as a unit amount of increase or decrease when updating the lens aperture.

[0015] The 4 / 5 of the field of view of the mirror outside the light measurement area ROI is the illumination calculation area, the light measurement sensitivity threshold T is 20, the reference illumination value RefIllumValue is 128, the maximum light source brightness upper limit MaxLight is 60, the minimum light source brightness lower limit MinLight is 5, the light source adjustment step LightStep is 5, the maximum camera shutter upper limit MaxShutter is 1 / 125, the minimum camera shutter lower limit MinShutter is 1 / 1000, the camera shutter adjustment step ShutterStep is 0.5, the maximum lens aperture upper limit MaxAperture is F64, the minimum lens aperture lower limit MinAperture is F5, and the lens aperture adjustment step ApertureStep is 1.

[0016] Further, Step3 image acquisition, specifically: acquisition of the current parameter light source brightness, camera shutter and lens aperture value of the image CurImage.

[0017] Further, Step4 illumination calculation, specifically: CurImage input for illumination calculation, get the current parameter under the illumination value CurIllumValue.

[0018] Further, Step5 illumination judgment, specifically: CurIllumValue input for illumination judgment, if CurIllumValue between RefIllumValue+T and RefIllumValue-T range, moderate illumination, end of automatic illumination adjustment; if CurIllumValue less than RefIllumValue-T, the illumination is low, into the illumination rising adjustment logic; if CurIllumValue greater than RefIllumValue+T, the illumination is high, into the illumination reduction adjustment logic.

[0019] Further, Step6 illumination adjustment, specifically: including Step6.1 illumination reduction adjustment logic and Step6.2 illumination rising adjustment logic. Note that each adjustment of a parameter, repeat Step3~Step6, until the illumination is moderate or adjustment failure two states.

[0020] Further, Step6.1 illumination reduction adjustment logic, according to three priority adjustment, specifically:

[0021] The first priority, first query the current lens aperture value CurAperture, if CurAperture less than MaxAperture, CurAperture plus step ApertureStep, as the new CurAperture, set to the lens aperture control motor, repeat Step3~Step6; otherwise, the second priority adjustment;

[0022] The second priority, first query the current camera shutter value CurShutter, if CurShutter greater than MinShutter, multiplied by step ShutterStep, as the new CurShutter, set to the camera shutter parameter, repeat Step3~Step6; otherwise, the third priority adjustment;

[0023] Third priority, first query the current light source brightness value CurLight, if CurLight is greater than MinLight, then subtract the step LightStep, as the new CurLight, set to the light source controller, repeat Step3~Step6; Otherwise, the automatic adjustment parameters can all reach the limit, still can not reduce the illumination, return to automatically adjust.

[0024] Further, Step6.2 illumination increase adjustment logic, according to three priorities for adjustment, specifically:

[0025] The first priority, first query the current light source brightness value CurLight, if CurLight is less than MaxLight, then add the step LightStep, as the new CurLight, set to the light source controller, repeat Step3~Step6; Otherwise, the second priority adjustment;

[0026] The second priority, first query the current camera shutter value CurShutter, if CurShutter is less than MaxShutter, then divide the step ShutterStep, as the new CurShutter, set to the camera shutter parameter, repeat Step3~Step6; Otherwise, the third priority adjustment;

[0027] The third priority, first query the current lens aperture value CurAperture, if CurAperture is greater than MinAperture, then CurAperture minus the step ApertureStep, as the new CurAperture, set to the lens aperture control motor, repeat Step3~Step6; Otherwise, the automatic adjustment parameters can all reach the limit, still can not increase the illumination, return to automatically adjust.

[0028] The beneficial effects of the present application are that the present application can adjust the illumination parameters step by step through the adjustment strategy of three adjustment priorities, reduce the steps of intraoperative manual operation, and improve the automation and intelligent level of the endoscope. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 is the automatic illumination multi-stage adjustment flow chart.

[0030] Figure 2 is the illumination reduction adjustment logic flow chart.

[0031] Figure 3 is the illumination increase adjustment logic flow chart. DETAILED DESCRIPTION

[0032] The present application will be further clarified by the following examples and drawings, which should not be interpreted as limiting the scope of the present application.

[0033] As shown in the accompanying drawings and specific embodiments, it should be understood that the following specific embodiments are only used to illustrate the present application and not to limit the scope of the present application. Figure 1 The present application provides an automatic illumination multi-stage adjustment method of intelligent outside mirror, which comprises default parameter setting, image acquisition, illumination calculation, illumination judgment and illumination adjustment in sequence. Specifically as follows:

[0034] Step 1. Start the automatic illumination adjustment function;

[0035] Step 2. Default parameter setting;

[0036] Step 3. Image acquisition;

[0037] Step 4. Illumination calculation;

[0038] Step 5. Illumination judgment;

[0039] Step 6. Illumination adjustment;

[0040] Step 7. End;

[0041] In this embodiment, Step 2 default parameter setting, specifically: light measurement area ROI, light measurement sensitivity threshold T, reference illumination value RefIllumValue, maximum light source brightness upper limit MaxLight, minimum light source brightness lower limit MinLight, light source adjustment step LightStep, maximum camera shutter upper limit MaxShutter, minimum camera shutter lower limit MinShutter, camera shutter adjustment step ShutterStep, maximum lens aperture upper limit MaxAperture, minimum lens aperture upper limit MinAperture, lens aperture adjustment step ApertureStep.

[0042] The light measurement area ROI has the function of limiting the illumination calculation area and reducing the interference of irrelevant areas. Optionally, the user clicks on the target object in the outside mirror field of view on the screen to represent it in the form of a cross plus a rectangular frame, and the default 4 / 5 outside the mirror field of view is the illumination calculation area.

[0043] The light measurement sensitivity threshold T has the function of adjusting the illumination sensitivity. The smaller the value, the higher the sensitivity and the lower the fault tolerance, and the larger the value, the lower the sensitivity and the higher the fault tolerance, and the more stable. Optionally, the light measurement sensitivity threshold T is set to 20 by default.

[0044] The reference illumination value RefIllumValue has the function of providing a suitable illumination reference value. Optionally, the reference illumination value RefIllumValue is set to 128 by default.

[0045] MaxLight, the function is to ensure that no burn, and the human eye straight view of the premise of the organization comfort, the upper limit of the light source brightness in the automatic illumination adjustment process, the greater the value, the higher the adjustable illumination. Alternatively, the maximum light source brightness upper limit MaxLight, the default setting is 60.

[0046] MinLight, the function is the lower limit of the light source brightness in the automatic illumination adjustment process, the smaller the value, the lower the adjustable illumination. Alternatively, the minimum light source brightness lower limit MinLight, the default setting is 5.

[0047] LightStep, the function is to set the unit of increase or decrease when updating the light source brightness, the smaller the value, the higher the adjustable precision, the longer the adjustment time; the greater the adjustable precision, the lower the value, the shorter the adjustment time. Alternatively, the light source adjustment step LightStep, the default setting is 5.

[0048] MaxShutter, the function is the upper limit of the camera shutter in the automatic illumination adjustment process, the greater the value, the higher the adjustable illumination. Alternatively, the maximum camera shutter upper limit MaxShutter, the default setting is 1 / 125.

[0049] MinShutter, the function is the lower limit of the camera shutter in the automatic illumination adjustment process, the smaller the value, the lower the adjustable illumination. Alternatively, the minimum camera shutter lower limit MinShutter, the default setting is 1 / 1000.

[0050] ShutterStep, the function is to set the unit of increase or decrease when updating the camera shutter, the smaller the value, the higher the adjustable precision, the longer the adjustment time; the greater the adjustable precision, the lower the value, the shorter the adjustment time. Alternatively, the camera shutter adjustment step ShutterStep, the default setting is 0.5.

[0051] MaxAperture, the function is the upper limit of the lens aperture value in the automatic illumination adjustment process, the greater the value, the lower the adjustable illumination. Alternatively, the maximum lens aperture upper limit MaxAperture, the default setting is F64.

[0052] MinAperture, the function is the lower limit of the lens aperture value in the automatic illumination adjustment process, the smaller the value, the higher the adjustable illumination. Alternatively, the minimum lens aperture lower limit MinAperture, the default setting is F5.

[0053] Lens aperture adjustment step ApertureStep, the function is to set the unit quantity of increasing or decreasing when updating the lens aperture. Alternatively, a discrete table of aperture values is generated, with the step being the index number corresponding to the aperture value. The aperture is adjusted by changing the current index, and the default setting is 1.

[0054] In this embodiment, Step 3 image acquisition, specifically: under the condition of current brightness value CurLight, current lens aperture value CurAperture, current camera shutter value CurShutter and other parameters, collect image CurImage, input to Step 4 illumination calculation.

[0055] In this embodiment, Step 4 illumination calculation, specifically: calculate the illumination value of CurImage image to get CurIllumValue, input to Step 5 illumination judgment.

[0056] Commonly used image illumination value calculation methods include global average brightness method, histogram equalization improvement method, etc. Alternatively, the average brightness method based on region is used. First, the original image Image is used to extract the target region image block ROIImage using ROI, then the ROIImage is grayed to get GrayImage, and then the average of GrayImage is calculated to get CurIllumValue. The principle of color image graying is shown in the formula:

[0057] Gray(x,y)=R(x,y)*0.299+G(x,y)*0.587+B(x,y)*0.114

[0058] Where (x, y) is the two-dimensional pixel coordinate of the image, R(x, y) is the red channel value of the (x, y) pixel of the color image, G(x, y) is the green channel value, B(x, y) is the blue channel value, and Gray(x, y) is the gray value of the gray output.

[0059] In this embodiment, Step 5 illumination judgment, specifically: CurIllumValue is input for illumination judgment. If CurIllumValue is between RefIllumValue+T and RefIllumValue-T, the illumination is moderate; if CurIllumValue is less than RefIllumValue-T, the illumination is low, and the illumination raising adjustment logic is entered; if CurIllumValue is greater than RefIllumValue+T, the illumination is high, and the illumination lowering adjustment logic is entered.

[0060] In this embodiment, Step 6 is the illumination adjustment, specifically: Step 6.1 is the illumination reduction adjustment logic and Step 6.2 is the illumination increase adjustment logic. Note that one parameter is adjusted at a time, and Steps 3-6 are repeated until the illumination is moderate or the adjustment fails.

[0061] In this embodiment, Step 6.1 is the illumination reduction adjustment logic, as shown in Figure 2 three priorities, specifically: first priority, first query the current lens aperture value CurAperture, if CurAperture is less than MaxAperture, then CurAperture is added to the step size ApertureStep, as the new CurAperture is set to the lens aperture control motor, repeat Steps 3-6; otherwise, the second priority adjustment is performed. Second priority, first query the current camera shutter value CurShutter, if CurShutter is greater than MinShutter, then multiply by the step size ShutterStep, as the new CurShutter is set to the camera shutter parameter, repeat Steps 3-6; otherwise, the third priority adjustment is performed. Third priority, first query the current light source brightness value CurLight, if CurLight is greater than MinLight, then subtract the step size LightStep, as the new CurLight is set to the light source controller, repeat Steps 3-6; otherwise, all parameters can be automatically adjusted to reach the limit, still unable to reduce the illumination, return to the automatic adjustment fails.

[0062] In this embodiment, Step 6.2 is the illumination increase adjustment logic, as shown in Figure 3As shown, according to three priorities, specifically: the first priority, first query the current light source brightness value CurLight, if CurLight is less than MaxLight, then add the step LightStep, as the new CurLight, set to the light source controller, repeat Step3~Step6; Otherwise, the second priority adjustment. Second priority, first query the current camera shutter value CurShutter, if CurShutter is less than MaxShutter, then divided by the step ShutterStep, as the new CurShutter, set to the camera shutter parameters, repeat Step3~Step6; Otherwise, the third priority adjustment. Third priority, first query the current lens aperture value CurAperture, if CurAperture is greater than MinAperture, then CurAperture minus the step ApertureStep, as the new CurAperture, set to the lens aperture control motor, repeat Step3~Step6; Otherwise, the automatic adjustment parameters can all reach the limit, still can not raise the illumination, return to automatic adjustment.

[0063] Optionally, the step is determined by bisection method, and the parameters of each level are updated, which can improve the adjustment speed. The principle of bisection method is that: first, according to the initial Min and Max, the intermediate value Mid is calculated, the image is collected, the illumination value is calculated, and the illumination is judged. If the illumination is low, the Mid value is taken as the new Min, the intermediate value Mid of Min and Max is determined again, and the cycle is continued; If the illumination is high, the Mid value is taken as the new Max, the intermediate value Mid of Min and Max is determined again, and the cycle is continued. Until the illumination is moderate or automatic adjustment is not possible.

[0064] The technical means disclosed in the present application scheme is not limited to the technical means disclosed in the above-mentioned embodiments, but also includes the technical solutions composed of any combination of the above technical features. It should be noted that for ordinary skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can also be made, which are considered to be within the scope of protection of the present application.

Claims

1. A method for automatic multi-level illumination adjustment of an intelligent exterior mirror, characterized in that: The following steps are involved: Step 1. Start the automatic illumination adjustment function; Step 2. Default parameter settings; Step 3. Image acquisition; Step 4. Illumination calculation; Step 5. Illumination determination; Step 6. Illumination adjustment; Step 7. End.

2. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 1, characterized in that: Step2 default parameter settings, specifically: photometric area ROI, photometric sensitivity threshold T, reference illuminance value RefIllumValue, maximum light source brightness upper limit MaxLight, minimum light source brightness lower limit MinLight, light source adjustment step LightStep, maximum camera shutter upper limit MaxShutter, minimum camera shutter lower limit MinShutter, camera shutter adjustment step ShutterStep, maximum lens aperture upper limit MaxAperture, minimum lens aperture upper limit MinAperture, lens aperture adjustment step ApertureStep. Among them, the photometric area ROI is used to limit the illumination calculation area, the photometric sensitivity threshold T is used to adjust the illumination sensitivity, the reference illuminance value RefIllumValue is used to provide a benchmark reference value for appropriate illumination, the maximum light source brightness upper limit MaxLight is used as the upper limit of the light source brightness during the automatic illumination adjustment process, under the premise of ensuring that no burns will occur and the human eye is comfortable looking directly at the surgical field tissue, the minimum light source brightness lower limit MinLight is used as the lower limit of the light source brightness during the automatic illumination adjustment process, the light source adjustment step LightStep is used as the unit of increase or decrease when updating the light source brightness, the maximum camera shutter upper limit MaxShutter utter is used as the upper limit value of the camera shutter during automatic illumination adjustment, the minimum camera shutter lower limit MinShutter is used as the lower limit value of the camera shutter during automatic illumination adjustment, the camera shutter adjustment step ShutterStep is used as the unit amount of increase or decrease when updating the camera shutter, the maximum lens aperture upper limit MaxAperture is used as the upper limit value of the lens aperture value during automatic illumination adjustment, the minimum lens aperture lower limit MinAperture is used as the lower limit value of the lens aperture value during automatic illumination adjustment, and the lens aperture adjustment step ApertureStep is used as the unit amount of increase or decrease when updating the lens aperture.

3. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 2, characterized in that: The metering area ROI uses 4 / 5 of the exoscopic field of view as the illumination calculation area, the metering sensitivity threshold T is 20, the reference illumination value RefIllumValue is 128, the maximum light source brightness upper limit MaxLight is 60, the minimum light source brightness lower limit MinLight is 5, the light source adjustment step LightStep is 5, the maximum camera shutter upper limit MaxShutter is 1 / 125, the minimum camera shutter lower limit MinShutter is 1 / 1000, the camera shutter adjustment step ShutterStep is 0.5, the maximum lens aperture upper limit MaxAperture is F64, the minimum lens aperture lower limit MinAperture is F5, and the lens aperture adjustment step ApertureStep is 1.

4. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 3, characterized in that: Step 3: Image acquisition, specifically: acquiring the image CurImage of the current parameters of light source brightness, camera shutter and lens aperture value.

5. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 4, characterized in that: Step 4: Illumination calculation, specifically: perform illumination calculation on the input CurImage to obtain the illumination value CurIllumValue under the current parameters.

6. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 5, characterized in that: Step 5: Illumination judgment, specifically: perform illumination judgment on the input CurIllumValue. If CurIllumValue is between the range of RefIllumValue+T and RefIllumValue-T, the illumination is moderate and the automatic illumination adjustment ends; if CurIllumValue is less than RefIllumValue-T, the illumination is too low and the illumination increase adjustment logic is entered; if CurIllumValue is greater than RefIllumValue+T, the illumination is too high and the illumination decrease adjustment logic is entered.

7. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 6, characterized in that: Step 6 illumination adjustment specifically includes: Step 6.1 illumination reduction adjustment logic and Step 6.2 illumination increase adjustment logic, repeating Step 3 to Step 6 until the illumination is moderate or the adjustment fails.

8. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 7, characterized in that: Step 6.1 Illumination reduction adjustment logic is adjusted according to three priorities, specifically: The first priority is to query the current lens aperture value CurAperture. If CurAperture is less than MaxAperture, then add the step size ApertureStep to CurAperture to use as the new CurAperture, set it to the lens aperture control motor, and repeat Step 3 to Step 6; otherwise, proceed to the second priority adjustment; The second priority is to first query the current camera shutter value CurShutter. If CurShutter is greater than MinShutter, multiply it by the step size ShutterStep to use it as the new CurShutter, set it to the camera shutter parameter, and repeat Step 3 to Step 6; otherwise, proceed to the third priority adjustment; The third priority is to first query the current light source brightness value CurLight. If CurLight is greater than MinLight, subtract the step size LightStep and use it as the new CurLight. Set it to the light source controller and repeat Step 3 to Step 6. Otherwise, all the automatically adjustable parameters have reached their limits and the illumination cannot be reduced, so the system returns to the state where automatic adjustment cannot be performed.

9. The method for automatic multi-level illumination adjustment of an intelligent exterior mirror according to claim 7, characterized in that: Step 6.2 Illumination increase adjustment logic is adjusted according to three priorities, specifically: First, query the current light source brightness value CurLight. If CurLight is less than MaxLight, add the step size LightStep as the new CurLight and set it to the light source controller, repeating Step 3 to Step 6. Otherwise, proceed to the second priority adjustment. The second priority is to first query the current camera shutter value CurShutter. If CurShutter is less than MaxShutter, divide it by the step size ShutterStep to use as the new CurShutter, set it to the camera shutter parameter, and repeat Step 3 to Step 6; otherwise, proceed to the third priority adjustment; The third priority is to first query the current lens aperture value CurAperture. If CurAperture is greater than MinAperture, then subtract the step size ApertureStep from CurAperture and use it as the new CurAperture. Set it to the lens aperture control motor and repeat Steps 3 to 6. Otherwise, all automatically adjustable parameters have reached their limits and the illumination cannot be increased, so the system returns to the state where automatic adjustment cannot be performed.

Images