Image processing apparatus, image processing method, program, and storage medium

Abstract

To suppress changes in image brightness when the settings of a defogger function are changed.SOLUTION: An image processing device includes acquisition means for acquiring an image, calculation means for calculating the brightness of the image, image processing means for performing image processing to reduce the effects of fog or haze in the image, setting means for setting the intensity of the image processing by the image processing means, and change means for gradually changing the intensity of the image processing on the basis of the intensity set by the setting means.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image processing device, an image processing method, a program, and a storage medium. [Background technology]

[0002] In an image captured by a camera, the visibility of the image may be reduced due to fog or haze. In the past, a technology called a fog and haze removal function has been known to clarify the image by removing fog or haze. Patent Document 1 discloses a technology that determines the presence or absence of fog or haze from an input image and switches the fog and haze removal function between enabled and disabled. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2018-093474 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to suppress a change in image luminance when the settings of a defogging function are changed. [Means for solving the problem]

[0005] In order to solve the above problems, an image processing device according to one embodiment of the present invention is characterized in having an acquisition means for acquiring an image, a calculation means for calculating the brightness of the image, an image processing means for performing image processing to reduce the effects of fog or haze in the image, a setting means for setting the intensity of the image processing by the image processing means, and a change means for gradually changing the intensity of the image processing based on the intensity set by the setting means. Effect of the Invention

[0006] According to the present invention, it is possible to suppress abrupt changes in luminance of an image caused by the defogging function. [Brief description of the drawings]

[0007] [Figure 1] Functional block diagram of the image processing device [Diagram 2] Flowchart showing the operation of the image processing device [Diagram 3] Change in brightness value due to defog [Figure 4] Functional block diagram of the image processing device [Diagram 5] Flowchart showing the operation of the image processing device [Figure 6] Flowchart for calculating change values ​​for de-misting settings of image processing device [Figure 7] Change in brightness value due to defog DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, the embodiment for carrying out the present invention will be described in detail with reference to the attached drawings. The embodiment described below is an example of a means for realizing the present invention, and should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions, and the present invention is not limited to the following embodiment. In addition, a configuration may be made by appropriately combining parts of each embodiment described later.

[0009] <Embodiment 1> (Hardware configuration) The hardware configuration of the image processing device according to this embodiment will be described with reference to FIG. 1(a). As shown in FIG. 1(a), the imaging device 100 includes an imaging optical system 106, an imaging element 107, and an image processing device 110 according to this embodiment. The image processing device 110 may be included in the imaging device 100, but may be separate from the imaging device 100. The imaging optical system 106 includes at least one lens, such as a zoom lens or a focus lens. The imaging optical system 106 may also include an aperture and a shutter. Light from a subject that is incident on the imaging optical system 106 is collected, and an image of the subject is formed on the imaging element 107. The imaging element 107 is a photoelectric conversion element that captures an image of the subject and outputs it as image data.

[0010] The image processing device 110 includes a CPU 101 , a RAM 102 , a ROM 103 , a HDD (hard disk drive) I / F (interface) 104 , a HDD 105 , an input I / F 108 , an output I / F 109 , and a system bus 1010 .

[0011] The CPU 101 executes various processes using computer programs and data stored in the RAM 102 and the ROM 103. As a result, the CPU 101 controls the operation of the entire image processing device 110, and executes (realizes) or controls each process (function) to be performed by the image processing device 110, which will be described later.

[0012] The RAM 102 has an area for storing computer programs and data loaded from the ROM 103 or the HDD 105, and data received from an operation unit (not shown), an external memory, and the image sensor 107 via the input I / F 108. The RAM 102 also has a work area used when the CPU 101 executes various processes. In this way, the RAM 102 can provide various areas as appropriate. The ROM 103 stores setting data and a startup program for the image processing device 110. The HDD I / F 104 is an interface such as a serial ATA (SATA) and is used to connect the HDD 105, which serves as a secondary storage device, to the system bus 1010. The CPU 101 reads and writes information from the HDD 105 via the HDD I / F 104.

[0013] The HDD 105 is an example of a large-capacity information storage device. The HDD 105 stores an OS (operating system) and computer programs for causing the CPU 101 to execute (realize) or control each process (function) to be performed by the image processing device 110, which will be described later. The data stored in the HDD 105 includes information handled by the image processing device 110 as known information in the following description. The computer programs and data stored in the HDD 105 are loaded into the RAM 102 via the HDDI / F 104 as appropriate under the control of the CPU 101, and become the subject of processing by the CPU 101. Note that the secondary storage device is not limited to the HDD 105, and may be a storage device such as an optical disk drive.

[0014] The input I / F 108 is, for example, a serial bus interface such as USB or IEEE1394, and the image processing device 110 is connected to an operation unit, an external memory, and an image sensor 107 (not shown) via the input I / F 108 .

[0015] The output I / F 109 is a video output interface such as DVI or HDMI (registered trademark), and the image processing device 110 is connected to a display unit (not shown) via the output I / F 109. The display unit (not shown) has a liquid crystal screen, a touch panel screen, or the like, and can display the processing results by the CPU 101 as images, characters, and the like.

[0016] The system bus 1010 is a path for transferring various data. The CPU 101, the RAM 102, the ROM 103, the HDD I / F 104, the imaging optical system 106, the imaging element 107, the input I / F 108, and the output I / F 109 are all interconnected via the system bus 1010.

[0017] The configuration of the image processing device according to this embodiment is not limited to the configuration shown in Fig. 1(a). For example, the imaging device 100 and the image processing device 110 may be separate entities, and in that case, the imaging device 100 and the image processing device 110 may be connected via a network.

[0018] (Functional configuration) The functional configuration of the image processing device according to this embodiment is shown with reference to Fig. 1(b). Note that functions realized by hardware in Fig. 1(b) are the same as those in Fig. 1(a), so they are given the same reference numerals and their explanations are omitted. In addition, the functions of each part shown in Fig. 1(b) that will be explained below are all functions that can be realized by software, and are realized by the CPU 101 executing a computer program.

[0019] The demisting unit 111 performs image processing to reduce the influence of fog or haze in an image signal captured and output by the imaging element 107. The demisting setting change unit 112 changes the setting of the demisting unit 111 in accordance with setting data input via the input I / F 108. The input setting data includes on / off of a demisting function and the intensity of the demisting function. In FIG. 1(b), the demisting unit 111 is illustrated separately from the image processing unit 114, but the functions of the demisting unit 111 may be included in the image processing unit 114. Therefore, at least a part of the processing by the demisting unit 111, which will be described later, may be executed by the image processing unit 114.

[0020] The exposure control unit 113 controls the exposure of the image sensor 107. Specifically, the exposure control unit 113 controls so as to change at least one of the aperture of the image sensing optical system 106, the gain added to an image, and the shutter speed of the image sensor 107.

[0021] An image processing unit 114 applies image processing to the image signal output from the image sensor 107. The image processing includes, for example, white balance processing and de-bayer processing.

[0022] (Operation description) Next, the processing executed by the image processing device 110 according to this embodiment will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the processing executed by the image processing device 110 according to this embodiment. The processing shown in this flowchart is executed by the CPU 101 reading a computer program. This processing is started when the image processing device 110 is powered on, and is executed periodically. The flow shown in this flowchart shows the processing for removing mist from an image captured by the image sensor 107.

[0023] Here, the drawbacks of the defogger function will be described with reference to Fig. 7. It is known that an image from which fog or mist has been removed generally suffers from a drop in image luminance. Therefore, when performing automatic exposure control (AE) on an image that has been subjected to the defogger function, the luminance changes due to the defogger function, and it may become difficult to maintain proper exposure. In particular, the greater the change in luminance due to the defogger function, the more difficult it may become for the AE to maintain proper exposure.

[0024] Figure 7 shows the change in brightness of an output image in a configuration where AE is performed after the mist elimination function is applied to an image received by an image sensor. In the figure, the horizontal axis is time, the vertical axis is brightness value, and the solid line shows the brightness value of the output image. The dashed lines L700 and L701 indicate the range of proper exposure, and when the brightness value of the image is within the range of the two dashed lines, the exposure is considered to be proper.

[0025] At time t70, the defog function is disabled and the exposure of the image is correct. When the defog function is enabled at time t71, the brightness of the image decreases and the exposure is no longer correct. Therefore, in order to compensate for the decrease in brightness of the image from time t71 to time t75, AE is used to control the exposure so that it is correct.

[0026] In this way, when the defog function is enabled, the exposure becomes inappropriate, and the exposure remains inappropriate until the exposure is restored to the appropriate level by AE. In particular, with videos, it is preferable to minimize the time when the exposure is inappropriate. In general, the degree to which the brightness of the image changes depends on the strength of the defog function.

[0027] Therefore, since the intensity of the demisting function is changed according to the degree of decrease in the gradation of the input image, the luminance changes every time the intensity is changed, and the AE needs to follow up to compensate for the change in luminance. As described above, it is generally known that changing the setting of the demisting function causes a sudden change in the luminance of the image. The demisting method shown in this flowchart is characterized in that the intensity of the demisting function is changed in stages based on the set intensity of the demisting function. More specifically, the intensity of the demisting function is changed in stages based on the difference between the set intensity and the current intensity of the demisting function. Preferably, the amount of change in luminance of the image acquired before and after changing the intensity of the demisting function is calculated, and the intensity of the demisting function is changed to a target intensity so that the calculated luminance change falls within a predetermined range. Hereinafter, the specific processing of this flowchart will be described.

[0028] In step S200, setting data for the current defogger / mist function being applied by defogger / mist unit 111 is acquired. The setting data for the defogger / mist function acquired here is data related to the current defogger / mist function, and includes whether the defogger / mist function is currently enabled (ON) or disabled (OFF). The setting data for the defogger / mist function also includes a parameter that indicates the strength of the defogger / mist process.

[0029] In step S201, settings input via the input I / F 109 are obtained. The user can input instructions to the input I / F 109 to enable / disable the defogger function. If the defogger function is enabled, the user can also input setting values ​​for parameters that indicate the strength of the defogger processing. In step S201, the instructions and parameters as described above are obtained as defogger settings. The parameters input to the input I / F 109 are temporarily stored in the RAM 102, ROM 103, etc. by the CPU 101 as setting means.

[0030] In step S202, a target demisting / misting setting is updated according to the demisting setting acquired in step S201. It is desirable to handle the demisting / misting setting as a numerical value according to its strength. That is, the enabling / disabling of the demisting / misting function is expressed using a parameter indicating the strength of the demisting / misting process. For example, a parameter of 0 is used when the demisting / misting function is disabled, and a parameter of 1 or more is used when the demisting / misting function is enabled. When the strength of the demisting / misting process is at its minimum, the parameter is set to 1, and the parameter is increased as the strength increases. In this embodiment, the maximum strength of the demisting process is handled as 10.

[0031] In step S203, it is determined whether the current demisting function settings obtained in step S200 have reached the target demisting settings updated in step S202. That is, the difference between the current demisting parameters obtained in step S200 and the target demisting parameters obtained in step S202 is compared. If the difference is equal to or smaller than a predetermined threshold, it is determined that the target demisting settings have been reached. If the target demisting settings have been reached (YES in step S203), the process proceeds to step S206. On the other hand, if the target demisting settings have not been reached (NO in step S203, the difference is greater than the predetermined threshold), the process proceeds to step S204.

[0032] In step S204, a demisting setting change value is calculated. The calculation is based on the difference between the current demisting function settings (parameters) acquired in step S200 and the target demisting settings (parameters) updated in step S202. For example, the difference is divided by a certain ratio to become the demisting setting change value. The difference may be a positive number or a negative number. Here, the division number for the difference may be a fixed value of 2 or more. Preferably, the larger the difference, the larger the division number.

[0033] In step S205, the demisting setting change value calculated in step S204 is added to the current demisting function setting (parameter) acquired in step S200 to change the setting of the demisting unit 111. In step S204, depending on whether the difference is divided finely, the demisting setting change value added to the current demisting setting in step S205 becomes smaller, so that the change in luminance of the image can be further reduced. The more the number of divisions is increased, the smaller the change in luminance will be, but since the addition process in step S205 is repeated until the target demisting setting (parameter) is reached, it may take a long time to reach the target demisting setting (parameter). Therefore, the number of divisions may be determined so that the change in luminance of the image, which changes due to the change value added, falls within a predetermined range.

[0034] In step S206, the defogger 111 performs a process of removing fog or mist from the image captured by the image sensor 107 based on the setting of the defogger function changed in step S205 or on at least one previous setting of the defogger function. Here, the image captured by the image sensor 107 may be acquired at the stage of step S206, or may be acquired in advance at any step prior to step S206. In this case, the CPU 101, as an acquisition unit, temporarily stores the image captured by the image sensor 107 in the RAM 102 or a memory (not shown) as a buffer. It is desirable to acquire and store images captured before and after changing the intensity of the defogger process. The CPU 101, as a calculation unit, calculates the luminance change using the RAM 102 as a calculation area. The luminance of the image may be the average luminance of the entire image, or may be the average luminance in a preset area.

[0035] As described above, the image processing device according to this embodiment is characterized in that the intensity of the demisting process is changed in stages based on the intensity of the demisting process set by the setting means. For example, when the demisting function is switched from enabled (intensity of the process is 1 or more) to disabled (intensity of the process is 0) by the setting means, the demisting setting change unit 112 changes the intensity of the demisting process to be gradually decreased. Conversely, when the demisting function is switched from disabled to enabled, the demisting setting change unit 112 changes the intensity of the demisting process to be gradually increased. The gradual change in the processing intensity is realized by adding or subtracting the demisting setting change value to or from the current processing intensity setting value. The extent to which the processing intensity is changed to the target intensity (in other words, the number of divisions) is adjusted so that the brightness change of the image falls within a predetermined range, as described above.

[0036] In step S207, exposure control is performed, and the process ends. Note that the process shown in this flowchart is executed periodically while the defog function is enabled.

[0037] (Explanation of effect) Next, the brightness of an image when the defrosting of this embodiment is applied will be described with reference to FIG. 3. In FIG. 3, the horizontal axis indicates time, and the vertical axis indicates the brightness value of the image. The dashed lines L300 and L301 indicate the range of proper exposure, and when the brightness value of the image is within the range of the two dashed lines, the exposure is considered to be proper. At time t30, the defrosting function is disabled, and the exposure of the image is also proper. At time t31, the defrosting function is enabled via the input I / F 108, and an input is made to set the strength of the defrosting process to the maximum of 10. The current defrosting setting is disabled, so it is set to 0, and the target defrosting setting is set to 10. Therefore, the difference is 10. At time t31, the defrosting setting is not set to the target defrosting setting of 10, but is changed by adding a defrosting setting change value obtained by dividing the difference 10 at a certain rate. For example, the defrosting setting change value is set to 2. Therefore, the defrosting setting is set to 2 by adding 2 to the current defrosting setting of 0. Changing the demist / haze setting causes the brightness of the image to decrease, but by the exposure control process, the brightness of the image is returned to the appropriate exposure toward time t32. Similarly, from time t32 to time t36, the demist / haze setting change value is added until the current demist / haze setting reaches the target demist / haze setting. Changing the demist / haze setting causes the brightness of the image to change, but by the exposure control process, the brightness of the image is returned to the appropriate exposure.

[0038] With the above-described configuration and method, when there is a difference between the current defogging setting and the target defogging setting, a sudden change in luminance is suppressed by gradually approaching the target defogging setting, and an additional effect of making it easier to return to the appropriate exposure by exposure control is also obtained.

[0039] In this embodiment, the settings of the demisting function are changed in response to an input from the input I / F 108, but the present invention is not limited to this. For example, the effects of the present invention can be achieved by a configuration in which the level of fog or mist is determined from an image, and the settings of the demisting function are changed in response to the determination result.

[0040] In this embodiment, when there is a difference between the current defogger setting and the target defogger setting, the defogger setting is changed in stages. However, when the difference is equal to or smaller than a predetermined value, the defogger setting does not have to be changed in stages.

[0041] <Embodiment 2> The feature of this embodiment is that the settings of the demisting function are changed taking into account the appropriate exposure range. That is, the division number in the first embodiment is determined based on the appropriate exposure range. By changing the demisting setting taking into account the appropriate exposure range, it is possible to obtain a more appropriate exposure. The following describes the parts that are different from the first embodiment, and omits a description of the same configuration and processing as the first embodiment. The hardware configuration of the image processing device according to this embodiment is the same as that of the first embodiment, and therefore a description thereof is omitted.

[0042] (Functional configuration) The functional configuration of the image processing device according to this embodiment will be described with reference to Fig. 4. The image processing device 110 further includes a differential luminance value calculation unit 400.

[0043] The difference luminance value calculation unit 400 calculates the difference between the luminance value of the current image and the appropriate exposure range. The calculation method is to calculate the difference between the large and small boundary values ​​of the appropriate exposure range stored in a memory (not shown) and the luminance value of the current image. The luminance value of the current image may be calculated from the image, or the luminance value used when the exposure control unit 113 controls the exposure may be used.

[0044] A de-misting setting change unit 112 changes the setting of the de-misting unit 111 in accordance with the setting of the exposure removal function input via an input I / F 108 and the difference calculated by a difference luminance value calculation unit 400 .

[0045] (Operation description) Next, the demisting process of the image processing device according to this embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart showing the demisting process of the image processing device according to this embodiment. The operations shown in this flowchart are also realized by the CPU 101 executing a program. Operations similar to those in the first embodiment are given the same reference numerals and will not be described.

[0046] In step S500, the brightness value of the current image is calculated, or the brightness value used when the exposure control unit 113 controls the exposure is acquired.

[0047] In step S501, a proper exposure range (predetermined exposure range) stored in a memory (not shown) is acquired. The predetermined exposure range indicates the range of exposure that can be adjusted by one exposure control operation of the exposure control unit 113. In general, the range of exposure that can be changed by one exposure operation is limited so that a sudden change in brightness does not occur due to exposure control. Therefore, as shown in this specification, if the change in brightness of an image caused by changing the strength of the defogging process exceeds the predetermined exposure range, the exposure of the image cannot be adjusted to an appropriate value by one exposure control operation. Therefore, two or more exposure control operations are required, and it takes time until the exposure of the image is adjusted to an appropriate value.

[0048] Therefore, in step S502, a difference luminance value is calculated. The calculation method is to calculate the difference between the luminance value of the current image calculated in step S500 and the appropriate exposure range acquired in step S501. Specifically, the difference between the large and small boundary values ​​of the appropriate exposure range and the luminance value of the current image is calculated. In other words, the difference between the upper and lower limits of the luminance of the image corresponding to a predetermined exposure range and the luminance of the current image is calculated. In this way, by finding the difference between the luminance range in which the exposure of the image can be appropriately controlled in one exposure control and the luminance of the current image, it is possible to find the amount of change in luminance that can be adjusted in one exposure control.

[0049] In step S503, the amount of change in the luminance value of the image caused by applying the defogger function for each strength of the defogger setting stored in a memory (not shown) is obtained. The amount of change in the luminance value of the image caused by applying the defogger function for each strength of the defogger setting is measured or calculated in advance and stored in a memory (not shown). For example, the amount of change in the luminance value of the image for each strength of the defogger setting is stored as a table.

[0050] In step S204, a change value for the demisting setting is calculated based on the difference between the current demisting function setting obtained in step S200 and the target demisting setting updated in step S202, the difference luminance value calculated in step S502, and the amount of change in luminance value for each strength of the demisting setting obtained in step S503.

[0051] The calculation method will be described with reference to Fig. 6. Fig. 6 shows a calculation flow of the mist elimination setting change value calculated in step S204 in this embodiment.

[0052] In step S600, the amount of change in the luminance value of the image when the target defogging setting updated in step S202 is set is calculated from the amount of change acquired in step S503.

[0053] In step S601, it is determined whether the amount of change in the image brightness value calculated in step S600 is within the difference brightness value calculated in step S502. If it is within the difference brightness value, the process proceeds to step S602. On the other hand, if it is not within the difference brightness value, the process proceeds to step S603.

[0054] In step S602, a change value for changing the defrosting setting to the target defrosting setting updated in step S202 is determined as a defrosting setting change value.

[0055] In step S603, a difference between the current defogging function setting acquired in step S200 and the target defogging function setting updated in step S202 is calculated.

[0056] In step S604, a tentative demisting setting change value is calculated based on the difference calculated in step S603. The calculation method is such that the absolute value of the difference calculated in step S603 becomes small. For example, the demisting setting change value is determined by dividing the difference by a fixed number of divisions or subtracting a fixed ratio. The demisting setting change value may be a positive number or a negative number. Any method may be used as long as it reduces the absolute value of the difference.

[0057] In step S605, the change in the luminance value of the image when the defogger setting is changed based on the provisional demisting setting change value calculated in step S604 or the provisional demisting setting change value updated in step S609 is calculated from the change amount obtained in step S503.

[0058] In step S606, it is determined whether the amount of change in the image brightness value calculated in step S605 is within the difference brightness value calculated in step S502. If it is within the difference brightness value, the process proceeds to step S608. On the other hand, if it is not within the difference brightness value, the process proceeds to step S607.

[0059] In step S607, it is determined whether the temporary demisting setting change value can be changed thereafter. As a method of determination, if the temporary demisting setting change value calculated in step S604 is equal to or less than the minimum resolution of settings that can be set for demisting unit 111, it is determined that the temporary demisting setting change value cannot be changed. If it cannot be changed, the process proceeds to step S608. On the other hand, if it can be changed, the process proceeds to step S609. In this way, by using the difference luminance value calculated in step S502 as a threshold value to calculate the demisting setting change value and gradually changing the strength of the demisting process, it is possible to perform the demisting operation in a luminance range that corresponds to the exposure range that can be adjusted in a single exposure control operation.

[0060] In step S608, the tentative mist / mist removal setting change value calculated in step S604 or the tentative mist / mist removal setting change value updated in step S609 (described later) is determined as the mist / mist removal setting change value.

[0061] In step S609, the temporary change value of the demisting setting is updated so that the absolute value is smaller than that of at least one previous temporary change value of the demisting setting. After that, the process returns to step S605 and the series of processes is repeated.

[0062] In this way, the image processing device according to this embodiment is characterized in that it changes the strength of the de-misting process in stages based on the predetermined exposure range of the exposure control unit 113. In other words, it changes the strength of the de-misting process in stages so that it falls within the range of image luminance change corresponding to the predetermined exposure range of the exposure control unit 113.

[0063] As described above, the configuration and method verify whether the luminance value falls within the appropriate exposure range when the defogger setting is changed in advance, and calculates the change value of the defogger setting so that it falls within the appropriate exposure range. Therefore, it is possible to change the defogger setting taking into account the appropriate exposure range, and to obtain a more appropriate exposure.

[0064] In this embodiment, the brightness value is used, but the present invention is not limited to this as long as it is possible to determine whether the exposure is appropriate. For example, the exposure value may be used. The effect of the present invention can also be obtained by converting the brightness value into the number of steps.

[0065] In this embodiment, the appropriate exposure range is not changed while the defrost setting is being changed, but the effects of the present invention can be obtained even if the appropriate exposure range is changed. For example, by setting the appropriate exposure range narrower than usual, the luminance value is more likely to be located in the center of the appropriate exposure range, so that the next defrost setting change value can be calculated to be larger. Therefore, by calculating the defrost setting change value to be larger, it is possible to shorten the time required to reach the target defrost setting.

[0066] In this embodiment, if the amount of change in luminance value is within the differential luminance value in step S606, a provisional demisting / misting setting change value is immediately determined, but this is not limited to the case as long as the amount of change in luminance value is within the differential luminance value. For example, a plurality of provisional demisting / misting setting change values ​​are calculated. Of the calculated provisional demisting / misting setting change values, the provisional demisting / misting setting change value whose amount of change in luminance value is within the differential luminance value and which is closest to the target demisting / misting setting is determined, thereby making it possible to shorten the time required to reach the target demisting / misting setting.

[0067] <Other embodiments> The present invention can be realized by a process of reading and executing a program that realizes one or more functions of the above-mentioned embodiment 1. This computer program is supplied to a system or device via a network or a storage medium, and is readable and executed by one or more processors in the computer of the system or device. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0068] 110 Image processing device 111 Fog removal section 112 Fog removal setting change section 113 Exposure control section 114 Image processing section

Claims

1. An acquisition means for acquiring an image; A calculation means for calculating the luminance of the image; image processing means for performing image processing to reduce the effects of fog or haze in the image; A setting means for setting the intensity of the image processing by the image processing means; a change means for gradually changing the intensity of the image processing based on the intensity set by the setting means; 13. An image processing device comprising:

2. the calculation means calculates a change in luminance between an image acquired before the intensity of the image processing is changed and an image acquired after the intensity of the image processing is changed; 2. The image processing apparatus according to claim 1, wherein the change means changes the intensity of the image processing in a stepwise manner so that the luminance change falls within a predetermined range.

3. 2 . The image processing device according to claim 1 , wherein the change means changes the intensity of the image processing in a stepwise manner when a difference between the intensity set by the setting means and the current intensity of the image processing is greater than a predetermined threshold value.

4. The image processing device according to claim 2, characterized in that, when a difference between the intensity set by the setting means and the current intensity of the image processing is greater than a predetermined threshold, the change means changes the intensity of the image processing in stages so that the luminance change falls within a predetermined range.

5. the setting means sets whether image processing by the image processing means is to be enabled or disabled; 3. The image processing apparatus according to claim 2, wherein said change means changes the intensity of said image processing so as to decrease in stages when said setting means changes the image processing by said image processing means from enabled to disabled.

6. the setting means sets whether image processing by the image processing means is to be enabled or disabled; 3. The image processing apparatus according to claim 2, wherein the change means changes the intensity of the image processing so as to increase in stages when the setting means changes the image processing by the image processing means from disabled to enabled.

7. The method further comprises:

2. The image processing apparatus according to claim 1, wherein the change means changes the intensity of the image processing in a stepwise manner based on a predetermined exposure range of the exposure control means.

8. An acquisition step of acquiring an image; A calculation step of calculating the luminance of the image; an image processing step for performing image processing to reduce fog or haze effects in the image; a setting step of setting the intensity of the image processing in the image processing step; a change means for gradually changing the intensity of the image processing based on the intensity set in the setting step; 13. An image processing method comprising:

9. In the calculation step, a luminance change between a luminance of an image acquired before the intensity of the image processing is changed and a luminance of an image acquired after the intensity of the image processing is changed is calculated; 2. The image processing method according to claim 1, wherein in said changing step, the intensity of said image processing is changed stepwise so that said luminance change falls within a predetermined range.

10. The image processing method according to claim 2, characterized in that, in the change process, if a difference between the intensity set in the setting process and the current intensity of the image processing is greater than a predetermined threshold, the intensity of the image processing is changed in stages so that the luminance change falls within a predetermined range.

11. The image processing method according to claim 9, characterized in that, in the change process, if a difference between the intensity set in the setting process and the current intensity of the image processing is greater than a predetermined threshold, the intensity of the image processing is changed in stages so that the luminance change falls within a predetermined range.

12. In the setting step, it is set whether the image processing in the image processing step is enabled or disabled; 3. The image processing method according to claim 2, wherein in the changing step, when the image processing in the image processing step is changed from enabled to disabled in the setting step, the intensity of the image processing is changed so as to be gradually decreased.

13. In the setting step, it is set whether the image processing in the image processing step is enabled or disabled; 3. The image processing method according to claim 2, wherein in the change step, when the image processing in the image processing step is changed from disabled to enabled in the setting step, the intensity of the image processing is changed so as to increase in stages.

14. An exposure control step of controlling the exposure of the image is further included, 8. The image processing method according to claim 7, wherein in the changing step, the intensity of the image processing is changed stepwise based on a predetermined exposure range of the exposure control.

15. A computer program for causing a computer to execute the image processing method according to claim 7.

16. A computer-readable storage medium storing the computer program according to claim 15.

Images