Image processing device and method, imaging device, program and storage medium

Abstract

To obtain a skin-beautifying effect desired by a user, in a person in an out-of-focus state.SOLUTION: The presence or absence of execution of predetermined correction processing and a first correction amount when executing the correction processing are set for a correction object area having a predetermined feature in an inputted image. It is determined whether a predetermined condition is satisfied. When the condition is satisfied, it is determined whether or not the first correction amount is equal to or greater than a predetermined threshold. When the first correction amount is equal to or greater than the predetermined threshold, a change to a second correction amount smaller than the first correction amount is made. When the execution of the correction processing is set, the correction processing is executed to the correction object area of the image on the basis of the second correction amount or the first correction amount when the change to the second correction amount is not made by change means.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an image processing device and method, an imaging device, a program, and a storage medium, and more particularly to control of the correction amount in skin beautification processing. [Background technology]

[0002] There are conventionally known imaging devices that apply skin beautification processing to human faces during shooting and record the images. Skin beautification processing is a process that makes skin appear smoother by reducing roughness and removing dullness and blemishes, but because the processed areas lose resolution, it is necessary to apply the effect at an appropriate level.

[0003] For example, Patent Document 1 discloses a technique in which, when a specific area is detected in a captured image, correction is performed with a correction strength associated with a preset correction level.

[0004] Furthermore, Patent Document 2 discloses a technique for invalidating or reducing contour correction for a specific hue when the focus mode is manual and focus adjustment is in progress.

[0005] On the other hand, in recent years, users have been demanding shooting modes and autofocus behaviors that are suited to product reviews. Because the product being reviewed is the main subject in a product review, users want an AF that can quickly focus on a subject in the foreground (hereinafter referred to as "review AF"), rather than a face-priority AF that tracks the person's face or a fixed focus on one point on the screen. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 5083116 [Patent Document 2] Japanese Patent Application Laid-Open No. 2003-18451 Summary of the Invention [Problem to be solved by the invention]

[0007] However, review AF can sometimes result in a situation where a person's face is out of focus. Meanwhile, the prior art disclosed in the above-mentioned Patent Documents 1 and 2 determines the strength of the skin beautification effect of skin beautification processing depending only on the face detection state and the focus mode setting value. Therefore, when skin beautification processing is further applied to a face that is out of focus using review AF, the expected amount of skin beautification effect cannot be achieved.

[0008] FIG. 9 is an explanatory diagram of the autofocus operation and the distance to a person. 9(a), in face-priority AF, imaging device 100 performs an operation of focusing on a position on plane 903 where the face is located, and in review AF, on a position on plane 902 where the product is located. In this case, because the distance between the person and the product is short, even if the focus is on a position on plane 902, a suitable skin beautifying effect can be obtained for the person by skin beautifying processing.

[0009] On the other hand, in FIG. 9(b), the product is closer to the imaging device 100 than in FIG. 9(a), and the position to be focused on during review AF is a position on plane 901. In this case, the person located on plane 903 is out of focus. However, if a face is detected in the captured image, and further skin beautification processing is applied to the out-of-focus face, the resolution will be further reduced and the person will become too blurred.

[0010] The present invention has been made in consideration of the above-mentioned problems, and has as its object to enable a user to obtain a desired skin beautifying effect for a person who is not in a focused light state. [Means for solving the problem]

[0011] In order to achieve the above object, an image processing device of the present invention includes an input means for inputting an image, a setting means for setting whether or not a predetermined correction process is to be performed on a correction target area in the image having a predetermined characteristic, and a first correction amount if the correction process is to be performed; Regarding focus information The image processing device has a determination means for determining whether a predetermined condition is satisfied, and if the condition is satisfied, determining whether the first correction amount is equal to or greater than a predetermined threshold value; a modification means for changing the first correction amount to a second correction amount that is smaller than the first correction amount if the determination means determines that the first correction amount is equal to or greater than the threshold value; and a correction means for performing the correction process on the correction target area of ​​the image based on the second correction amount, or based on the first correction amount if the modification means has not changed the correction amount to the second correction amount, when the correction process is set to be performed. [Effects of the Invention]

[0012] According to the present invention, it is possible to obtain the skin beautifying effect desired by the user for a person who is not in a focused illumination state. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram showing the appearance of an imaging apparatus according to an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram showing the functional configuration of an imaging apparatus according to an embodiment. [Figure 3] 6 is a flowchart showing a process for setting a skin beautifying effect amount in the first embodiment. [Figure 4] 6 is a flowchart showing a cosmetic effect amount correction process according to the first embodiment. [Figure 5] 10 is a flowchart showing a skin beautifying effect amount setting process in the second embodiment. [Figure 6] 10A and 10B are diagrams illustrating the relationship between the distance between the face position and the focus position and the amount of skin beautification effect in the second embodiment. [Figure 7] 11 is a flowchart showing a skin beautifying effect amount setting process according to the third embodiment. [Figure 8] 10 is a flowchart showing a skin beautifying effect amount setting process in the fourth embodiment. [Figure 9] FIG. 10 is a diagram showing the relationship between the focus position and the subject position in a conventional AF mode. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0015] First Embodiment 1 is a block diagram showing the configuration of an image capture device 100 with an image processing function according to an embodiment of the present invention. In this embodiment, a digital camera will be used as an example of image capture device 100, but any electronic device with a camera function may be used, such as a digital video camera or other camera, a camera-equipped mobile phone, a camera-equipped computer, a game console, etc.

[0016] The display unit 28 is provided on the back of the imaging device 100 and displays images and various information. The operation members include a shutter button 61 for issuing shooting instructions, a mode selector switch 60 for switching between various modes, a power switch 72 for switching the power on and off, a rotatable controller wheel 73, other buttons, a touch panel, and other operation members. Instructions from the user are accepted via various operations on the operation members.

[0017] The connector 112 is a connector between the connection cable 111 and the imaging device 100 . The recording medium 200 is a recording medium such as a memory card or a hard disk, and is stored in a recording medium slot 201. The recording medium 200 stored in the recording medium slot 201 is capable of communicating with the imaging device 100. A lid 203 is a lid for the recording medium slot 201.

[0018] FIG. 2 is a block diagram showing the functional configuration of the imaging device 100 according to this embodiment. 2, the photographing lens 103 is a lens group including a zoom lens and a focus lens. The shutter 101 is a shutter with an aperture function. Note that, although the photographing lens 103 is described here as being integral with the imaging device 100, the present invention is not limited to this, and the photographing lens 103 may be configured to be detachable from the imaging device 100.

[0019] The imaging unit 22 is composed of a CCD or CMOS element, etc., and has an A / D conversion processing function. It converts the optical image formed on the imaging surface via the photographing lens 103 and shutter 101 into an electrical signal, A / D converts the obtained electrical signal, and outputs a digital image signal (image data).

[0020] The AF evaluation value detection unit 23 calculates an AF evaluation value from contrast information, phase difference information, etc. obtained from the digital image signal output from the imaging unit 22, and sets the obtained AF evaluation value as AF evaluation value detection unit 23 to the system control unit 50. When the phase difference information is output, at least some of the pixels constituting the imaging unit 22 are configured to be able to acquire the phase difference information, for example, by having a biased light receiving area or being divided into a plurality of light receiving areas.

[0021] The barrier 102 is a protective member that covers the imaging system of the imaging device 100, including the taking lens 103, the shutter 101, and the imaging unit 22, to prevent the imaging system from becoming dirty or damaged. The flashlight 90 can be turned on during photography to compensate for the lack of illumination when photographing a low-light scene or a backlit scene.

[0022] The image processing unit 24 performs various image processing such as predetermined pixel interpolation, resizing (e.g., reduction / enlargement), color conversion, and skin beautification on image data output from the imaging unit 22 or image data from the memory control unit 15. The image processing unit 24 also performs predetermined image processing and arithmetic processing using the image data obtained by capturing an image, and the system control unit 50 performs exposure control and focus control based on the obtained arithmetic results. This allows TTL (through-the-lens) AE (auto exposure) processing and EF (auto flash) processing to be performed. Note that AF (auto focus) processing may be performed in the image processing unit 24 instead of the AF evaluation value detection unit 23.

[0023] Furthermore, the image processing unit 24 also performs predetermined calculation processing using image data obtained by imaging unit 22, and also performs TTL type AWB (auto white balance) processing based on the calculation results obtained.

[0024] The output data output from the imaging unit 22 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 also serves as a memory for image display (video memory), and has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio, and stores image data output from the imaging unit 22 and image data to be displayed on the display unit 28.

[0025] The image data for display written in the memory 32 is converted into an analog signal by the D / A converter 13 and displayed on a display such as an LCD of the display unit 28. The digital image signal that has been A / D converted by the imaging unit 22 and stored in the memory 32 is converted into an analog signal by the D / A converter 13 and sequentially transferred to and displayed on the display unit 28, thereby functioning as an electronic viewfinder and enabling through-image display.

[0026] The nonvolatile memory 56 is an electrically erasable and recordable memory, such as a flash memory, that stores constants, programs, and the like for operation of the system control unit 50. The programs stored in this nonvolatile memory 56 include programs for executing various flowcharts described later in this embodiment.

[0027] The system control unit 50 is a control unit made up of at least one processor or circuit, and controls the entire imaging device 100. It performs various processes described below by executing programs recorded in the nonvolatile memory 56. The system memory 52, for example, is made up of a RAM, and stores constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, and the like. The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0028] The mode selector switch 60, shutter button 61, and operation unit 70 are operation members for inputting various operation instructions to the system control unit 50. The operation unit 70 also includes the controller wheel 73 shown in FIG. 1, other buttons, a touch panel, etc. The power switch 72 can be used to switch between power-on and power-off modes of the imaging device 100 .

[0029] The mode changeover switch 60 switches the operation mode of the system control unit 50 between a still image recording mode, a moving image recording mode, a playback mode, and the like. Still image recording modes include auto shooting mode, auto scene determination mode, manual mode, various scene modes that set the shooting settings for each shooting scene, program AE mode, custom mode, etc. switching Switch 60 allows direct switching to any of these modes included in the still image recording mode. switching Still image with switch 60 recordAfter switching to the still image mode, record Other operating members may be used to switch to any of these modes included in the mode.

[0030] Similarly, in this embodiment, record The mode also includes a plurality of modes, including a still image recording mode and a similar photography mode, as well as a skin beautifying video mode and a product review video mode.

[0031] The skin beautification video mode is a mode that performs skin beautification processing on faces detected in the image as image processing, and the AF mode (mode related to focus adjustment) is set to face priority AF mode by default, which prioritizes focusing on faces among the subjects present within the shooting angle of view. However, in the skin beautification video mode, the AF mode can be changed to another AF mode.

[0032] The product review video mode is a mode that uses the review AF mode, which aims to prioritize focusing on products among the subjects within the shooting angle of view, and focuses on objects that are closer to the camera rather than tracking people or specific subjects. On the other hand, it is possible to change whether or not to use skin beautification processing as an image processing option. In addition, videos other than those mentioned above record In the mode, it may be possible to set whether or not to perform skin beautification processing.

[0033] The first shutter switch 62 is turned on when the shutter button 61 is pressed halfway (a shooting preparation command) during operation, and generates a first shutter switch signal SW1. The first shutter switch signal SW1 starts shooting preparation operations such as AF processing, AE processing, AWB processing, and EF processing.

[0034] The second shutter switch 63 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The second shutter switch signal SW2 causes the system control unit 50 to start a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the obtained image data to the recording medium 200 as an image file.

[0035] Each operating member of the operating unit 70 is assigned a function appropriately according to the displayed content by, for example, selecting and operating various function icons displayed on the display unit 28, and acts as various function buttons. The function buttons include, for example, an end button, a back button, an image forward button, a jump button, a filter button, an attribute change button, etc. For example, when the menu button is pressed, a menu screen on the display unit 28 on which various settings can be made is displayed. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four directional buttons (up, down, left, and right), and the SET button.

[0036] The controller wheel 73 is a rotatable operating member included in the operation unit 70, and is used together with the directional buttons to indicate a selection item, etc. When the controller wheel 73 is rotated, an electrical pulse signal is generated according to the amount of rotation, and the system control unit 50 controls each unit of the imaging device 100 based on this pulse signal. This pulse signal makes it possible to determine the angle at which the controller wheel 73 is rotated, the number of rotations, etc. The controller wheel 73 may be any operating member that can detect a rotation operation. For example, the controller wheel 73 may be a dial operating member that rotates itself in response to a user's rotation operation to generate a pulse signal. Alternatively, the controller wheel 73 may be an operating member made of a touch sensor that does not rotate itself but detects the rotation of the user's finger on the controller wheel 73 (a so-called touch wheel).

[0037] In this embodiment, the user can set whether or not to perform skin beautification processing performed by the image processing unit 24 by operating the operation unit 70 described above. Skin beautification processing involves performing processing on the face portion (the area to be corrected) of a person in a captured image, such as removing or reducing wrinkles and dullness in the skin and blending dark circles under the eyes with the surrounding skin color, and includes, for example, smoothing processing using a smoothing filter. Processing such as reducing bloodshot eyes and whitening teeth may also be performed. The strength of the skin beautification processing is divided into multiple levels, which the user can set as a skin beautification effect setting value using the operation unit 70. Setting information regarding whether or not to perform the set skin beautification processing and the skin beautification effect setting value are stored in memory 32. Note that the various processes related to skin beautification are all well-known techniques in the technical field of image processing, and therefore detailed explanations thereof will be omitted here.

[0038] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage to each unit, including the recording medium 200, for the required period of time. The power supply unit 40 is made up of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as an NiCd battery, an NiMH battery, or a Li battery, an AC adapter, or the like.

[0039] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0040] Next, the process of correcting the amount of skin beautifying effect in the first embodiment will be described with reference to FIGS. 3 is a flowchart showing the skin-beautifying effect amount setting process of the imaging device 100 according to the first embodiment. Note that each process in this flowchart is realized by the system control unit 50 expanding a program stored in the nonvolatile memory 56 into the system memory 52 and executing it.

[0041] When the skin beautifying effect amount setting process starts, the system control unit 50 acquires the set shooting mode in S301. Then, in S302, the acquired shooting mode is determined. If it is the skin beautifying video mode, the process proceeds to S303. If it is the product review video mode, the process proceeds to S304. If it is any other mode, the process proceeds to S305. In S305, it is determined whether or not to perform skin beautifying processing. If it is, the process proceeds to S306. If it is not, the process ends.

[0042] In S303, it is determined whether the review AF mode is set as the AF mode (condition). If the review AF mode is not selected, for example, the default face priority AF mode is assumed to be selected, and the process proceeds to S306. If the review AF mode is set, the process proceeds to S307.

[0043] In S306, the system control unit 50 reads out the currently set skin beauty effect setting value, applies the skin beauty effect amount (correction amount) associated with the read out skin beauty effect setting value, and ends the process.

[0044] On the other hand, in S304, it is determined whether skin beautification processing is set as image processing, and if skin beautification processing is not to be performed, the processing ends, and if it is to be performed, the processing proceeds to S307. In S307, a skin beautifying effect amount correction process is performed. Details of the skin beautifying effect amount correction process performed in S307 will be described later with reference to FIG.

[0045] FIG. 4 is a flowchart showing the skin beautifying effect amount correction process in S307 in FIG. When the skin beautifying effect amount correction process begins, the system control unit 50 acquires the currently set skin beautifying effect setting value in S401. Next, the system control unit 50 compares the skin beautifying effect setting value with a predetermined reference value in S402. If the skin beautifying effect setting value is set to a strength greater than the reference value, the system control unit 50 changes the skin beautifying effect setting value to the reference value in S403. Note that the skin beautifying effect setting value does not necessarily have to be changed to the reference value; it is sufficient if the skin beautifying effect amount can reduce the skin beautifying effect below the currently set skin beautifying effect setting value.

[0046] On the other hand, if it is determined in S402 that the skin beautifying effect setting value is equal to or less than the reference value, the skin beautifying effect setting value that has been set is maintained in S404. Thereafter, in S405, the system control unit 50 calculates the amount of skin beautifying effect (amount of correction) to be actually applied to the image based on the skin beautifying effect setting value determined in S403 or S404, and ends the process.

[0047] Through the above processing, even when using both the product review mode and the skin beautification processing, the user can obtain an image with a suitable skin beautification effect by correcting the amount of skin beautification effect for the product review mode as needed based on the AF mode and the skin beautification effect setting value.

[0048] In this embodiment, the shooting mode is merchandise When the camera is in review video mode and skin beautification processing is enabled, and when the shooting mode is skin beautification video mode and the AF mode is review AF The following two cases are explained when the mode is set. However, the hierarchy of modes and settings is not limited to this, and it is possible to adjust the amount of skin beautification when using an AF setting that does not necessarily prioritize faces in combination with skin beautification processing.

[0049] In this embodiment, the amount of the skin beautifying effect is corrected by correcting the skin beautifying effect setting value, but the amount of the skin beautifying effect may also be corrected by directly attenuating the processing parameters of each process in the skin beautifying process without modifying the skin beautifying effect setting value.

[0050] In addition, when performing skin smoothing in S306, the amount of skin smoothing effect may be varied depending on the shooting mode information determined in S301. For example, if the skin smoothing video mode is determined in S301, merchandise The amount of skin beautification effect may be reduced more than when the review video mode is determined. This is because, in the skin beautification video mode, it is assumed that the photographer's priority is the image quality of the face area, and therefore there is a strong need to suppress excessive correction of the face area by skin beautification.

[0051] On the other hand, in S301 merchandise When the review video mode is determined, the amount of skin beautifying effect may be suppressed more than when the skin beautifying video mode is determined. merchandise In review video mode, it is assumed that product introduction takes priority over the beauty of the facial area, so there is a strong need to prevent over-correction of the facial area from turning the entire image into a failed image.

[0052] <Second embodiment> Next, a second embodiment of the present invention will be described. In the second embodiment, a case where the amount of skin beautifying effect is corrected based on information of a captured image will be described. Note that the second embodiment also uses the imaging device 100 described in the first embodiment, and therefore the description will be omitted.

[0053] 5 is a flowchart showing a skin-beautifying effect amount setting process performed by the imaging device 100 in the second embodiment. Note that each process in this flowchart is realized by the system control unit 50 expanding a program stored in the nonvolatile memory 56 into the system memory 52 and executing it.

[0054] When the skin beautification effect amount correction process starts, the system control unit 50 acquires skin beautification process setting information in S501, and determines whether skin beautification process is set based on the acquired skin beautification process setting information in S502. If skin beautification process is not set, the process ends. On the other hand, if it is determined in S502 that skin beautification process is set, the system control unit 50 proceeds to S503.

[0055] In S503, the system control unit 50 performs face detection processing on the captured image and stores the coordinates of the detected face position in the memory 32. Next, in S504, the system control unit 50 acquires focus position information indicating the position on the image that was focused on during capture. Note that the order of the processing of S503 and S504 may be reversed, or they may be performed in parallel. Then, in S505, the system control unit 50 calculates the distance on the image between the coordinates of the face stored in the memory 32 and the coordinates of the focus position.

[0056] In S506, the system control unit 50 determines whether the calculated distance between the face position and the focus position is equal to or less than a predetermined distance (condition). If it is equal to or less than the predetermined distance, the system control unit 50 applies the skin beautifying effect amount associated with the skin beautifying effect setting value in S507 and ends the process. On the other hand, if it is determined in S506 that it exceeds the predetermined distance, the system control unit 50 performs a skin beautifying effect amount correction process in S508. Note that the skin beautifying effect amount correction process may be the same as the process described with reference to FIG. 4, for example.

[0057] 6 is a diagram illustrating the relationship between the distance between the face position and the focus position and the amount of skin beautification effect in the second embodiment. 601 and 604 indicate the center position of the face, 602 and 605 indicate the focus position at the time of shooting, and 603 and 606 indicate the distance on the image between the center position of the face and the focus position.

[0058] In FIG. 6(a), the distance between the center position 601 of the face and the focus position 602 on the image is short. On the other hand, in FIG. 6(b), the distance between the center position 604 of the face and the focus position 605 on the image is long, and compared to when the distance is short as in FIG. 6(a), the face is likely to be out of focus and not within the depth of field. However, since face detection was successful, skin beautification processing is applied. In the second embodiment, the amount of skin beautification effect in such a scene is reduction This prevents the skin-beautifying effect from being excessive.

[0059] <Third embodiment> Next, the present invention 3 In the third embodiment, a case where the skin beautifying effect amount is corrected based on the depth of field will be described. Note that the third embodiment also uses the imaging device 100 described in the first embodiment, and therefore the description will be omitted.

[0060] 7 is a flowchart showing a skin-beautifying effect amount setting process performed by the image capture device 100 in the third embodiment. Note that each process in this flowchart is realized by the system control unit 50 loading a program stored in the nonvolatile memory 56 into the system memory 52 and executing it. In the following description, the photographing lens 103 is assumed to be detachable from the image capture device 100.

[0061] When the skin beautification effect amount correction process starts, the system control unit 50 acquires skin beautification process setting information in S701, and determines whether skin beautification process is set based on the acquired skin beautification process setting information in S702. If skin beautification process is not set, the process ends. On the other hand, if it is determined in S702 that skin beautification process is set, the system control unit 50 proceeds to S703.

[0062] In S703, the system control unit 50 acquires lens information of the photographing lens 103 attached to the imaging device 100. If the photographing lens 103 is a lens integrated with the imaging device 100, lens information stored in advance in the memory 32 or the like is used. Next, in S704, the system control unit 50 acquires photographing information including the F-number, distance to the focal point, and depth of focus.

[0063] In S705, the system control unit 50 calculates the depth of field at the time of shooting from the lens information and shooting information, and determines whether or not the depth of field is equal to or greater than a predetermined threshold (condition) in S706. If it is determined that the depth of field is equal to or greater than the threshold, the system control unit 50 applies the skin beautifying effect amount associated with the skin beautifying effect setting value in S707 and ends the process. On the other hand, if it is determined in S706 that the depth of field is less than the threshold, the system control unit 50 performs a skin beautifying effect amount correction process in S708. Note that the skin beautifying effect amount correction process may be, for example, the same process as that described with reference to FIG. 4.

[0064] If the depth of field is deep when taking a photo, there is a high possibility that the person is within the depth of field, but if the depth of field is shallow, the person is likely to be outside the depth of field. Inside However, face detection is successful, so it is easy to blur the image. process In the third embodiment, the amount of the skin beautifying effect is reduced in such a scene, so that the skin beautifying effect can be prevented from being applied excessively.

[0065] <Fourth embodiment> Next, a fourth embodiment of the present invention will be described. In the fourth embodiment, a case will be described in which the amount of skin beautifying effect is corrected based on the depth of field and the distance to the face. Note that the fourth embodiment also uses the imaging device 100 described in the first embodiment, and therefore the description will be omitted.

[0066] 8 is a flowchart showing a skin-beautifying effect amount setting process performed by the image capture device 100 in the fourth embodiment. Note that each process in this flowchart is realized by the system control unit 50 loading a program stored in the nonvolatile memory 56 into the system memory 52 and executing it. In the following description, the photographing lens 103 is assumed to be detachable from the image capture device 100.

[0067] The processing from S701 to S705 in FIG. 8 is the same as the processing shown in FIG. 7, and therefore the description thereof will be omitted.

[0068] In S806, the system control unit 50 performs face detection processing on the captured image and determines the distance to the detected face (distance measurement) based on the phase difference information detected by the AF evaluation value detection unit 23. Next, in S807, the system control unit 50 determines whether the detected face is within the depth of field (condition) based on the distance to the focus acquired in S703, the depth of field acquired in S705, and the distance to the face acquired in S806.

[0069] If the detected face is within the depth of field in S807, the system controller 50 applies the skin beautifying effect amount associated with the skin beautifying effect setting value in S808, and ends the process. On the other hand, if it is determined in S807 that the face is not within the depth of field, the system controller 50 performs a skin beautifying effect amount correction process in S809. Note that the skin beautifying effect amount correction process may be the same as the process described with reference to FIG. 4, for example.

[0070] In the above process, the distance to the focus and the distance to the face are detected, but it is also possible to determine whether each face is within the depth of field by generating a so-called defocus map that shows the distance to each subject.

[0071] According to the fourth embodiment, in a scene where a person is outside the depth of field and appears blurred, but face detection is successful, the amount of skin beautifying effect is reduced, thereby preventing excessive skin beautifying effect.

[0072] In the first to fourth embodiments described above, the skin beautification process is performed within the imaging device, but the present invention is not limited to this. For example, a computer, a tablet terminal, or the like may be configured as an image processing device to acquire image data captured by the imaging device and perform skin beautification process on the acquired image data.

[0073] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0074] <Summary> The disclosure of this embodiment includes the following configuration.

[0075] (Item 1) an input means for inputting an image; a setting means for setting whether or not a predetermined correction process is to be performed on a correction target region in the image having a predetermined characteristic, and a first correction amount when the correction process is to be performed; a determination means for determining whether a predetermined condition is satisfied, and, if the condition is satisfied, determining whether the first correction amount is equal to or greater than a predetermined threshold value; a change unit that changes the first correction amount to a second correction amount that is smaller than the first correction amount when the determination unit determines that the first correction amount is equal to or greater than the threshold value; a correction means for performing the correction process on the correction target area of ​​the image based on the second correction amount, or based on the first correction amount if the correction amount has not been changed to the second correction amount by the change means, when the execution of the correction process is set; 1. An image processing device comprising: (Item 2) The camera further includes a selection unit for selecting one of a plurality of focus adjustment modes, including a review AF mode for selecting and focusing on a subject that is close to the imaging device among subjects present within a photographing angle of view, 2. The image processing device according to item 1, wherein the determining unit determines that the condition is met when the review AF mode is selected. (Item 3) 3. The image processing device according to item 1 or 2, characterized in that the determination means determines that the condition is satisfied when the distance between the position of the correction target area and the focus position in the image is longer than a predetermined distance. (Item 4) an acquisition means for acquiring lens information of a photographing lens used to photograph the image and photographing information used to photograph the image; a calculation means for calculating a depth of field based on the lens information and the shooting information, 4. The image processing device according to any one of items 1 to 3, wherein the determining means determines that the condition is satisfied when the depth of field is shallower than a predetermined depth. (Item 5) an acquisition means for acquiring lens information of a photographing lens used to photograph the image and photographing information used to photograph the image; a calculation means for calculating a depth of field based on the lens information and the shooting information; a distance measuring means for determining a distance to a subject in the correction target area, The image processing device described in any one of items 1 to 4, characterized in that the determination means determines that the condition is met when the depth of field centered on the distance to the focus included in the shooting information does not include the distance to the subject. (Item 6) The image processing device further includes a detection unit for detecting a face area from the image as the correction target area, 6. The image processing device according to any one of items 1 to 5, wherein the correction means performs a correction process on the face area. (Item 7) 7. The image processing device according to any one of items 1 to 6, wherein the correction processing includes a smoothing processing. (Item 8) an imaging means for capturing and outputting an image; An image processing device according to any one of items 1 to 7; An imaging device comprising: (Item 9) an input step of inputting an image; a setting step of setting whether or not to perform a predetermined correction process on a correction target region in the image having a predetermined characteristic, and setting a first correction amount if the correction process is to be performed; a determination step of determining whether a predetermined condition is satisfied, and if the condition is satisfied, determining whether the first correction amount is equal to or greater than a predetermined threshold value; a change step of changing the first correction amount to a second correction amount smaller than the first correction amount when it is determined in the determination step that the first correction amount is equal to or greater than the threshold value; a correction step of performing the correction process on the correction target area of ​​the image based on the second correction amount, or based on the first correction amount if the correction amount has not been changed to the second correction amount in the change step, when the execution of the correction process is set; An image processing method comprising: (Item 10) A program for causing a computer to function as each of the means of the image processing device according to any one of items 1 to 7. (Item 11) Item 11. A computer-readable storage medium storing the program described in item 10.

[0076] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0077] 22: imaging unit, 24: image processing unit, 28: display unit, 32: memory, 50: system control unit, 52: system memory, 56: non-volatile memory, 60: mode change switch, 70: operation unit, 73: controller wheel, 100: imaging device, 103: photographing lens

Claims

1. an input means for inputting an image; a setting unit for setting whether or not a predetermined correction process is to be performed on a correction target region in the image having a predetermined characteristic, and a first correction amount if the correction process is to be performed; a determining means for determining whether or not a predetermined condition is satisfied with respect to focus information, and, if the condition is satisfied, determining whether or not the first correction amount is equal to or greater than a predetermined threshold value; a change unit that changes the first correction amount to a second correction amount that is smaller than the first correction amount when the determination unit determines that the first correction amount is equal to or greater than the threshold value; a correction means for performing the correction process on the correction target area of ​​the image based on the second correction amount, or based on the first correction amount if the correction amount has not been changed to the second correction amount by the change means, when the execution of the correction process is set; 1. An image processing device comprising:

2. The camera further includes a selection unit for selecting one of a plurality of focus adjustment modes, including a review AF mode for selecting and focusing on a subject that is close to the imaging device among subjects present within a photographing angle of view, 2. The image processing apparatus according to claim 1, wherein the determining means determines that the condition is satisfied when the review AF mode is selected.

3. 2. The image processing apparatus according to claim 1, wherein the determining means determines that the condition is satisfied when a distance between the position of the correction target area and a focus position in the image is longer than a predetermined distance.

4. an acquisition means for acquiring lens information of a photographing lens used to photograph the image and photographing information used to photograph the image; a calculation means for calculating a depth of field based on the lens information and the shooting information, 2. The image processing apparatus according to claim 1, wherein the determining means determines that the condition is satisfied when the depth of field is shallower than a predetermined depth.

5. an acquisition means for acquiring lens information of a photographing lens used to photograph the image and photographing information used to photograph the image; a calculation means for calculating a depth of field based on the lens information and the shooting information; a distance measuring means for determining a distance to a subject in the correction target area, The image processing device according to claim 1 , wherein the determining means determines that the condition is satisfied when the depth of field, which is centered on the distance to the focus included in the shooting information, does not include the distance to the subject.

6. The image processing device further includes a detection unit for detecting a face area from the image as the correction target area, 2. The image processing apparatus according to claim 1, wherein the correction means performs correction processing on the face area.

7. The image processing device according to claim 1 , wherein the correction processing includes a smoothing processing.

8. an imaging means for capturing and outputting an image; The image processing device according to any one of claims 1 to 7, An imaging device comprising:

9. an input step of inputting an image; a setting step of setting whether or not to perform a predetermined correction process on a correction target region in the image having a predetermined characteristic, and setting a first correction amount if the correction process is to be performed; a determining step of determining whether or not a predetermined condition is satisfied with respect to focus information, and, if the condition is satisfied, determining whether or not the first correction amount is equal to or greater than a predetermined threshold value; a change step of changing the first correction amount to a second correction amount smaller than the first correction amount when it is determined in the determination step that the first correction amount is equal to or greater than the threshold value; a correction step of performing the correction process on the correction target area of ​​the image based on the second correction amount, or based on the first correction amount if the correction amount has not been changed to the second correction amount in the change step, when the execution of the correction process is set; An image processing method comprising:

10. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 7.

11. A computer-readable storage medium storing the program according to claim 10.

Images