Processor of a camera device, camera device, control method of a camera device, and storage medium

Abstract

The present invention provides a processor for an imaging device, an imaging device, a control method for an imaging device, and a storage medium that can improve the performance of image shake correction. A system control unit (18) performs: recording control for performing either a first process of recording a first captured image output from a cropped area (121) of an imaging element (12) or a second process of recording a second captured image output from a light-receiving area (120) wider than the cropped area (121); image shake correction control for correcting image shake of a captured image output from the imaging element (12) by moving the imaging element (12); image processing for generating an instant preview image for displaying a subject image formed in the light-receiving area (120) on a display unit (15); and control for expanding the movable range of the imaging element (12) in image shake correction control when the first process is performed as compared with when the second process is performed.

Description

Technical Field

[0001] The present invention relates to a processor for an imaging device, an imaging device, a control method for an imaging device, and a control program for an imaging device. Background Art

[0002] In Patent Document 1, there is disclosed a device including: an imaging optical system having an imaging sensor; an electronic zoom member that trims a part of an image formed on the imaging sensor to change a subject area; an image shake correction member that causes a shake correction optical element, which is a part of the imaging optical system, to operate in a plane orthogonal to the optical axis according to the magnitude and direction of shake applied to the imaging optical system; a recording member that pre-records area data indicating a change in the size of an effective imaging area corresponding to the subject area when the subject area is changed by the electronic zoom member; and a movable range control member that changes the movable range of the shake correction optical element corresponding to the change in the subject area based on the area data of the recording member according to the operation state of the electronic zoom member.

[0003] In Patent Document 2, there is disclosed a camera including a setting member that sets either a normal imaging mode for printing the entire imaging screen or a trimming imaging mode for obtaining a pseudo-magnified photograph by trimming a part of the imaging screen. When the trimming imaging mode is set, the camera causes a shake detection member that detects shake of an image in the imaging screen to operate.

[0004] Prior Art Documents

[0005] Patent Documents

[0006] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2007-114311

[0007] Patent Document 2: Japanese Unexamined Patent Application Publication No. 4-319923 Summary of the Invention

[0008] Technical Problem to be Solved by the Invention

[0009] An object of the present invention is to provide a processor for an imaging device, an imaging device, a control method for an imaging device, and a control program for an imaging device that improve image shake correction performance.

[0010] Means for Solving the Technical Problem

[0011] One aspect of the present invention is a processor of an imaging device. The imaging device has an imaging element that captures a subject through an imaging optical system. The processor of the imaging device performs: recording control, which performs either a first process of recording a first captured image output from a first area that is a part of the light-receiving area of the imaging element or a second process of recording a second captured image output from a second area that is wider than the first area in the light-receiving area; image blur correction control, which corrects image blur of the captured image output from the imaging element by moving either one or both of the imaging element and a lens included in the imaging optical system; image processing, which generates an instant preview image for displaying a subject image formed in the second area on a display unit; and, when performing the first process, controls to expand a movable range of at least one of the imaging element or the lens in the image blur correction control as compared with the case of performing the second process.

[0012] An imaging device according to one aspect of the present invention includes the above-mentioned processor and the above-mentioned imaging element.

[0013] One aspect of the present invention is a control method for an imaging device. The imaging device has an imaging element that captures a subject through an imaging optical system. The control method for the imaging device performs: recording control, which performs either a first process of recording a first captured image output from a first area that is a part of the light-receiving area of the imaging element or a second process of recording a second captured image output from a second area that is wider than the first area in the light-receiving area; image blur correction control, which corrects image blur of the captured image output from the imaging element by moving either one or both of the imaging element and a lens included in the imaging optical system; image processing, which generates an instant preview image for displaying a subject image formed in the second area on a display unit; and, when performing the first process, controls to expand a movable range of at least one of the imaging element or the lens in the image blur correction control as compared with the case of performing the second process.

[0014] One aspect of the present invention is a control program for an imaging device. The imaging device has an imaging element that captures a subject through an imaging optical system. The control program of the imaging device causes a processor to execute: recording control, performing either a first process of recording a first captured image output from a first region that is a part of a light-receiving region of the imaging element or a second process of recording a second captured image output from a second region that is wider than the first region in the light-receiving region; image blur correction control, correcting image blur of the captured image output from the imaging element by moving either one or both of the imaging element and a lens included in the imaging optical system; image processing, generating an instant preview image for displaying the captured image output from the second region on a display unit; and, when performing the first process, performing control to expand a movable range of at least one of the imaging element or the lens in the image blur correction control as compared with the case of performing the second process.

[0015] Advantages of the Invention

[0016] According to the present invention, image blur correction performance can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 FIG. is a schematic diagram showing a general configuration of a digital camera 1 as an embodiment of the imaging device of the present invention.

[0018] Figure 2 FIG. is a top view schematic diagram of observing a light-receiving region of the imaging element 12 in the direction of the optical axis K.

[0019] Figure 3 FIG. is a diagram schematically showing an instant preview image and a normal recording image in a normal recording mode.

[0020] Figure 4 FIG. is a diagram schematically showing an instant preview image and a cropped recording image in a cropped recording mode.

[0021] Figure 5 FIG. is a schematic diagram for explaining a movable range of the imaging element 12 in a normal recording mode.

[0022] Figure 6 FIG. is a schematic diagram for explaining a movable range of the imaging element 12 in a cropped recording mode.

[0023] Figure 7 FIG. is a diagram showing a state where the imaging element 12 moves to an end of a movable range in a cropped recording mode.

[0024] Figure 8 FIG. is a schematic diagram showing an example of a luminance gain used in luminance shading correction.

[0025] Figure 9 It is a flowchart for explaining the operation of the digital camera 1.

[0026] Figure 10 It is a diagram schematically showing the live preview image after the translucency process.

[0027] Figure 11 It is a flowchart for explaining the operation of the digital camera 1 when the peripheral image quality of the live preview image deteriorates due to the translucency process.

[0028] Figure 12 It is a flowchart for explaining the operation of the digital camera in the fifth modification example.

[0029] Figure 13 It shows Figure 1 a schematic diagram of the sixth modification example of the digital camera 1.

[0030] Figure 14 It is a flowchart for explaining the operation of the cropping recording mode of the digital camera in the sixth modification example.

[0031] Figure 15 It is a diagram showing the appearance of the smartphone 200 which is an embodiment of the imaging device of the present invention.

[0032] Figure 16 It shows Figure 15 a block diagram of the structure of the smartphone 200 shown. Detailed implementation mode

[0033] Figure 1 It is a diagram showing the schematic structure of the digital camera 1 which is an embodiment of the imaging device of the present invention.

[0034] The digital camera 1 includes a camera body 10 and a lens device 20. The lens device 20 is configured to be detachable from the camera body 10, in other words, it can be replaced. The lens device 20 can be integrated with the camera body 10.

[0035] The lens device 20 has an imaging optical system 30 and a lens control unit 40. The imaging optical system 30 includes an imaging lens 31 and an aperture mechanism (not shown). The imaging lens 31 is composed of, for example, a single lens or multiple lenses including a lens for adjusting the focus of the imaging optical system 30. The lens control unit 40 is mainly composed of a processor and drives and controls the imaging optical system 30 under the control of the system control unit 18 described later.

[0036] The camera body 10 includes an imaging element 12, an imaging element displacement mechanism 13, an imaging element drive unit 14, a display unit 15 that is a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display, a memory 16 including a RAM (Random Access Memory) that is a volatile memory for temporarily recording information and a ROM (Read Only Memory) that is a non-volatile memory for pre-recording programs and various information required for its operation, a motion detection sensor 17, a system control unit 18, and a recording medium 19 such as a memory card composed of a non-volatile memory.

[0037] The imaging element 12 captures a subject through the imaging optical system 30. The imaging element 12 is composed of a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor, or the like. The imaging element 12 has a light-receiving area in which a plurality of pixels are two-dimensionally arranged. In addition, when the imaging element 12 is a CMOS image sensor, the imaging element drive unit 14 may be integrated with the CMOS image sensor.

[0038] Figure 2 It is a plan view schematic diagram of observing the light-receiving area of the imaging element 12 in the direction of the optical axis K. In the rectangular light-receiving area 120 of the imaging element 12, a plurality of pixels are two-dimensionally arranged in the row direction X and the column direction Y orthogonal thereto. In the light-receiving area 120, a partial area thereof, that is, a rectangular cropping area 121, and an area other than the cropping area 121, that is, a peripheral area 122, are set. The cropping area 121 constitutes a first area. The light-receiving area 120 constitutes a second area. The peripheral area 122 constitutes a third area. The set of pixel signals output from all the pixels in the light-receiving area 120 or a part of all the pixels (for example, only odd-row pixels, etc.) is recorded as a captured image signal. The value obtained by dividing the size of the light-receiving area 120 (defined by the diagonal length) by the size of the cropping area 121 (defined by the diagonal length) is defined as the cropping magnification β.

[0039] The imaging element displacement mechanism 13 is a mechanism for moving the imaging element 12 in a plane perpendicular to the optical axis K of the imaging optical system 30 to prevent blurring of the subject image formed in the light-receiving area 120 of the imaging element 12.

[0040] The movement detection sensor 17 is a sensor for detecting the movement of the digital camera 1. The movement detection sensor 17 is composed of an acceleration sensor or an angular velocity sensor, or both. In addition, the movement detection sensor 17 can be provided in the lens device 20.

[0041] The system control unit 18 centrally controls the entirety of the digital camera 1, and the hardware configuration is various processors that execute a control program including the imaging device and perform processing.

[0042] As the various processors, it includes: a general-purpose processor that executes a program and performs various processes, namely a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), etc., a processor whose circuit structure can be changed after manufacturing, that is, a programmable logic device (PLD), or an ASIC (Application Specific Integrated Circuit), etc., a processor having a circuit structure specifically designed for executing a specific process, that is, a dedicated circuit, etc. More specifically, the structures of these various processors are circuits formed by combining circuit elements such as semiconductor elements.

[0043] The system control unit 18 can be composed of one of the various processors, or can be composed of a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA).

[0044] The system control unit 18 controls the imaging element driving unit 14 to capture a subject through the imaging element 12, and causes a captured image signal corresponding to the subject image in the light receiving area 120 imaged on the imaging element 12 to be output from the imaging element 12. The system control unit 18 performs image processing on the captured image signal (RAW data) output from the light receiving area 120 of the imaging element 12, thereby generating an image in a form such as JPEG (Joint Photographic Experts Group) that can be reproduced by the digital camera 1 itself or other devices.

[0045] Hereinafter, an image obtained by performing image processing on a captured image signal output from the light-receiving area 120 of the imaging element 12 will be referred to as a captured image output from the light-receiving area 120 of the imaging element 12. The captured image includes: an instant preview image, which is an image for displaying a subject image formed in the light-receiving area 120 on the display unit 15; and a normal recording image, which is an image for recording the subject image formed in the light-receiving area 120 in the recording medium 19. The normal recording image constitutes the second captured image. The instant preview image and the normal recording image include the same subject, but the sizes (number of horizontal and vertical pixels) of the images are different. An image obtained by performing image processing on the captured image signal output from the cropping area 121 in the captured image signal output from the light-receiving area 120 will be referred to as a cropped recording image. The cropped recording image constitutes the first captured image.

[0046] The shooting modes of the digital camera 1 include: a normal recording mode in which a subject is shot by the imaging element 12 at a moment corresponding to a shooting instruction, and a second process of recording the normal recording image (captured image output from the light-receiving area 120) obtained by this shooting in the recording medium 19 is performed; and a cropped recording mode in which a subject is shot by the imaging element 12 at a moment corresponding to a shooting instruction, and a first process of recording the cropped recording image (captured image output from the cropping area 121) obtained by this shooting in the recording medium 19 is performed. In addition, the normal recording image and the cropped recording image can be respectively set to be recorded in the recording medium 19 in the form of RAW data before image processing.

[0047] The system control unit 18 performs the following control: in both the normal recording mode and the cropped recording mode, a subject is shot by the imaging element 12, an instant preview image is generated by performing image processing on the captured image signal output from the light-receiving area 120 of the imaging element 12 by this shooting, and the instant preview image is displayed on the display unit 15.

[0048] In addition, the image processing performed on the captured image signal when generating the instant preview image includes correction processing for correcting possible image quality degradation according to the optical characteristics of the imaging optical system 30 or the pixel structure of the imaging element 12, etc. The correction processing includes brightness shading correction for correcting brightness degradation caused by image height, noise correction for reducing noise increased by the brightness shading correction, contour enhancement processing for correcting sharpness (blur condition) degradation caused by image height, distortion correction for correcting distortion generated in the peripheral part of the image, magnification chromatic aberration correction for correcting chromatic aberration in the peripheral part, and edge correction, etc. In addition, the above correction processing is also included in the image processing when generating the normal recording image and the cropped recording image respectively.

[0049] Figure 3 is a diagram schematically showing an instant preview image and a normal recording image in the normal recording mode. In the normal recording mode, an instant preview image LV is generated from a captured image signal D2 output from a light receiving area 120 of an imaging element 12, and is displayed on a display surface 150 of a display unit 15. If there is a shooting instruction in the normal recording mode, a normal recording image P2 is generated from the captured image signal D2 and recorded in a recording medium 19.

[0050] Figure 4 is a diagram schematically showing an instant preview image and a cropping recording image in the cropping recording mode. In the cropping recording mode, an instant preview image LV is generated from a captured image signal D2 output from a light receiving area 120 of an imaging element 12, and is displayed on a display surface 150 of a display unit 15.

[0051] Figure 4 The shown captured image signal D2 is composed of an image signal D1 output from a cropping area 121 and an image signal D3 output from a peripheral area 122. The instant preview image LV is composed of an image L1 corresponding to the cropping area 121 (an image generated from the image signal D1) and an image L3 corresponding to the peripheral area 122 (an image generated from the image signal D3). If there is a shooting instruction in the cropping recording mode, a cropping recording image P1 is generated from the image signal D1 in the captured image signal D2 and recorded in the recording medium 19. As Figure 4 shown, in the cropping recording mode, in a subject image formed on the light receiving area 120, a range not recorded in the recording medium 19 can also be confirmed as an image L3 on the display unit 15.

[0052] When the system control unit 18 captures a subject through the imaging element 12, it controls an imaging element displacement mechanism 13 according to movement information of the digital camera 1 detected by a movement detection sensor 17 to correct shake (image shake) of a captured image output from the imaging element 12.

[0053] Figure 5 is a schematic diagram for explaining a movable range of the imaging element 12 in the normal recording mode. Figure 5 shows a light receiving area 120 and an image circle 30A of an imaging optical system 30 viewed in the direction of an optical axis K. The image circle 30A represents a range allowing the image quality of a subject image formed on the light receiving area 120 of the imaging element 12. In Figure 5 it, the image circle 30A is set as a perfect circle centered on the optical axis K.

[0054] In a state where the digital camera 1 is stationary, the system control unit 18 controls the position of the imaging element 12 via the imaging element displacement mechanism 13, as Figure 5 shown, to make the center of the light receiving area 120 coincide with the optical axis K.Figure 5 The axes Jx and Jy orthogonal to each other with the optical axis K as the origin are shown. The axis Jx extends in the direction (row direction X) along the long side of the light-receiving area 120. The axis Jy extends in the direction (column direction Y) along the short side of the light-receiving area 120. The imaging element 12 moves in the directions extending along the axis Jx and the axis Jy by the imaging element displacement mechanism 13.

[0055] In the normal recording mode, the system control unit 18 moves the imaging element 12 so that the light-receiving area 120 does not go outside the image circle 30A to perform image shake correction. Thereby, the image quality of the normal recording image can be set to an allowable level. That is, the system control unit 18 controls the movable range (the movable range of the center of the light-receiving area 120) of the imaging element 12 in the normal recording mode within the range of the circle C1 with a radius r1 which is the difference between the radius CR of the image circle 30A and the diagonal length l1 (half of the diagonal length) of the light-receiving area 120.

[0056] Figure 6 It is a schematic diagram for explaining the movable range of the imaging element 12 in the cropping recording mode. In the cropping recording mode, the system control unit 18 moves the imaging element 12 so that the cropping area 121 in the light-receiving area 120 does not go outside the image circle 30A to perform image shake correction. Thereby, the image quality of the cropping recording image can be set to an allowable level. That is, the system control unit 18 controls the movable range of the imaging element 12 in the cropping recording mode within the range of the circle C2 with a radius r2 which is the difference between the radius CR of the image circle 30A and the diagonal length l2 (half of the diagonal length) of the cropping area 121. The diagonal length l2 of the cropping area 121 is the value obtained by dividing the diagonal length l1 of the light-receiving area 120 by the cropping magnification β. That is, the circle C2 with a radius r2 is larger than the circle C1 with a radius r1.

[0057] In this way, the system control unit 18 sets the movable range of the imaging element 12 in the normal recording mode according to the image circle 30A and the size of the light-receiving area 120, and in the cropping recording mode, controls to expand the movable range of the imaging element 12 compared with the normal recording mode according to the cropping magnification β. In addition, multiple values can be set for the cropping magnification β.

[0058] Figure 7 It is a diagram showing the state where the imaging element 12 moves to the end of the movable range in the cropping recording mode. As Figure 7 shown, in the state where the center 120A of the light-receiving area 120 is located on the circumference of the circle C2, a part of the peripheral area 122 of the imaging element 12 protrudes outside the image circle 30A. Thus, in the immediate preview image LV displayed in the cropping recording mode, the part corresponding to the peripheral area 122, that is, the image L3 (refer to Figure 5),the image quality may become unacceptable. On the other hand, in the normal recording mode, the light-receiving area 120 does not extend beyond the image circle 30A. Therefore, the image quality of the part of the live preview image LV corresponding to the peripheral area 122, i.e., the image L3, becomes unacceptable.

[0059] The system control unit 18 controls the image processing parameters related to the visibility of the image L3 in the live preview image LV in the cropping recording mode to be different from the image processing parameters of the image L3 in the normal recording mode (in other words, the parameters used in the image processing of the image signal D3 output from the peripheral area 122 in the captured image signal D2). The visibility of an image is determined by brightness, sharpness, distortion, color, etc.

[0060] The image processing parameters include the brightness gain multiplied by the pixel signal of each pixel for brightness shading correction, the contour enhancement gain multiplied by the pixel signal of each pixel for contour enhancement, the intensity of noise correction for each pixel, the intensity of distortion correction for each pixel, the correction intensity of magnification chromatic aberration for each pixel, and the intensity of edge correction for each pixel, etc.

[0061] Figure 8 is a schematic diagram showing an example of the brightness gain used in brightness shading correction. The data G1 represents the brightness gain used when generating the live preview image in the normal recording mode. The data G2 represents the brightness gain used when generating the live preview image in the cropping recording mode. The image height m1 represents the position of the pixel located at the periphery of the light-receiving area 120. The image height m2 represents the position of the pixel located at the periphery of the cropping area 121.

[0062] As Figure 7 shown, in the cropping recording mode, Figure 8 the ranges of the image height m1 and the image height m2, i.e., the degrees of brightness decrease, sharpness decrease, distortion increase, and color shift increase of the subject image formed in the peripheral area 122 relative to the subject image formed at the center of the light-receiving area 120, can be greater than those in the normal recording mode. Thus, as Figure 8As shown, in the crop recording mode, the luminance gain multiplied by each pixel of the image signal D3 output from the peripheral area 122 is set to a value larger than that in the normal recording mode. Further, in the crop recording mode, the system control unit 18 sets the contour enhancement gain multiplied by each pixel of the image signal D3 output from the peripheral area 122 to a value larger than that in the normal recording mode. Further, in the crop recording mode, the system control unit 18 sets the intensity of noise correction, distortion correction, magnification chromatic aberration correction, and edge correction of the image signal D3 output from the peripheral area 122 to be stronger than that in the normal recording mode. Thereby, in the normal recording mode and the crop recording mode, it is possible to prevent a change in the visibility of the image L3 of the live view image LV.

[0063] Figure 9 is a flowchart for explaining the operation of the digital camera 1. When the power of the digital camera 1 is turned on, the system control unit 18 attempts to communicate with the lens control unit 40 of the lens device 20. When the system control unit 18 cannot communicate with the lens device 20 (step S1: No), as image processing for generating a live view image, setting for omitting the above-described correction processing is performed (step S2).

[0064] When the system control unit 18 can communicate with the lens device 20 (step S1: Yes), the system control unit 18 acquires lens information of the lens device 20 from the lens control unit 40 (step S3). The lens information is information required for determining the image circle 30A of the imaging optical system 30.

[0065] After acquiring the lens information, the system control unit 18 determines which of the normal recording mode and the crop recording mode the shooting mode is (step S4). When the shooting mode is the normal recording mode (step S4: No), the system control unit 18 reads the image processing parameters for the normal recording mode from the ROM of the memory 16 and sets them as parameters to be used when generating a normal recording image and a live view image (step S5).

[0066] When the shooting mode is the crop recording mode (step S4: Yes), the system control unit 18 reads the image processing parameters for the crop recording mode from the ROM of the memory 16 and sets them as parameters to be used when generating a crop recording image and a live view image (step S6).

[0067] After any one of the processes in step S2, step S5, and step S6, the system control unit 18 sets the movable range of the imaging element 12 for performing image shake correction (step S7). After the process in step S5, the system control unit 18 sets a first movable range as the movable range of the imaging element 12. After the process in step S6, the system control unit 18 sets a second movable range wider than the first movable range as the movable range of the imaging element 12. After the process in step S2, the system control unit 18 sets an arbitrary value such as the maximum value or the minimum value that can be set as the movable range of the imaging element 12, for example.

[0068] As described above, according to the digital camera 1, in the crop recording mode, compared with the normal recording mode, the movable range of the imaging element 12 for image shake correction can be expanded, so a larger image shake correction can be performed. Also, since the visibility of the peripheral portion of the live preview image displayed in the crop recording mode can be made the same as that in the normal recording mode, the subject can be confirmed well.

[0069] In addition, if the image quality of the peripheral portion in the normal recording image when the peripheral portion of the light receiving area 120 extends outside the image circle 30A falls within the allowable range (the image quality can be made to fall within the allowable range through image processing), the movable range of the imaging element 12 in the normal recording mode can also be set to a circle larger than the circle C1. That is, the movable range of the imaging element 12 in the normal recording mode can be determined according to the image quality tolerance of the normal recording image. By increasing the movable range of the imaging element 12, the shake correction can be made to work more strongly.

[0070] (First modification example of the digital camera 1)

[0071] So far, in the crop recording mode, the quality of the live preview image LV is improved by preventing the degradation of the peripheral image quality of the live preview image LV. On the contrary, in the crop recording mode, the quality of the live preview image LV can also be improved by making the degradation of the peripheral image quality of the live preview image LV not significant.

[0072] That is, the system control unit 18 can perform the following control: in the live preview image LV generated in the crop recording mode, the visibility of the portion corresponding to the peripheral area 122 is made lower than that in the normal recording mode. Specifically, in the crop recording mode, the system control unit 18 controls the parameters of the image processing performed on the image signal D3 in the captured image signal D2 shown in Figure 4 to a state where the visibility is lower than that in the normal recording mode. That is, in the crop recording mode, the system control unit 18 makes at least one of the brightness (brightness gain) and sharpness (contour enhancement gain) of the image L3 of the live preview image LV lower than that in the normal recording mode.

[0073] More specifically, in the cropping recording mode, the system control unit 18 generates an instant preview image LV using the same image processing parameters as in the normal recording mode, and then performs a semi-transparency process on the image L3, thereby reducing the visibility of the image L3. Figure 10 It is a diagram schematically showing the instant preview image after the semi-transparency process. Figure 10 The shown instant preview image LV is composed of the image L1 and the semi-transparency processed image L3a of the image L3.

[0074] This semi-transparency process is equivalent to a process of reducing the brightness or sharpness of the image L3 compared to the normal recording mode. This semi-transparency process can be performed by the system control unit 18, but it is preferably performed by a driver included in the display unit 15. By performing the semi-transparency process by the display unit 15, the load on the system control unit 18 can be reduced.

[0075] Figure 11 It is a flowchart for explaining the operation of the digital camera 1 when the peripheral image quality of the instant preview image is reduced by performing a semi-transparency process. When the power of the digital camera 1 is turned on, the system control unit 18 attempts to communicate with the lens control unit 40 of the lens device 20. When the system control unit 18 cannot communicate with the lens device 20 (step S11: No), it makes a setting to omit the above correction process as the image processing when generating the instant preview image (step S12).

[0076] When the system control unit 18 can communicate with the lens device 20 (step S11: Yes), it acquires the lens information of the lens device 20 from the lens control unit 40 (step S13).

[0077] After acquiring the lens information, the system control unit 18 reads the image processing parameters for the normal recording mode from the ROM of the memory 16 and sets them as the parameters to be used when generating the normal recording image, the cropping recording image, and the instant preview image respectively (step S14).

[0078] Next, the system control unit 18 sets the movable range of the imaging element 12 when performing image shake correction in the normal recording mode and the movable range of the imaging element 12 when performing image shake correction in the cropping recording mode according to the lens information and the cropping magnification β (step S15).

[0079] Next, if the shooting mode is the normal recording mode (step S16: No), the system control unit 18 processes the captured image signal output from the light receiving area 120 of the imaging element 12 using the image processing parameters set in step S14 to generate an instant preview image, and displays this instant preview image on the display unit 15 (step S17).

[0080] If the imaging mode is the cropping recording mode (step S16: Yes), the system control unit 18 processes the captured image signal output from the light receiving area 120 of the imaging element 12 using the image processing parameters set in step S14 to generate an instant preview image (step S18). Then, the system control unit 18 performs a semi-transparency process on the image corresponding to the peripheral area 122 in the instant preview image, and causes the semi-transparency processed instant preview image to be displayed on the display unit 15 (step S19).

[0081] According to Figure 11 the operations shown, it is possible to make the image processing parameters common to the normal recording mode and the cropping recording mode. Therefore, reduction of the memory capacity, efficiency improvement of the image processing, etc. can be achieved.

[0082] (Second modification example of the digital camera 1)

[0083] When the system control unit 18 cannot communicate with the lens device 20, regardless of whether it is the normal recording mode or the cropping recording mode, the movable range of the imaging element 12 at the time of image blur correction can be set according to the focal length setting value set by the user. Specifically, the larger the focal length setting value of the system control unit 18, the wider the movable range. Thereby, image blur correction performance suitable for the imaging conditions can be obtained.

[0084] (Third modification example of the digital camera 1)

[0085] When the system control unit 18 cannot communicate with the lens device 20, even when the cropping magnification β can be set to multiple values, it is preferable to fix the cropping magnification β to a predetermined value. And when the system control unit 18 cannot communicate with the lens device 20, regardless of whether it is the normal recording mode or the cropping recording mode, it is also preferable to fix the movable range of the imaging element 12 within a predetermined range. Thereby, deterioration of the captured image quality can be prevented.

[0086] (Fourth modification example of the digital camera 1)

[0087] Even in the cropping recording mode, during the period when no imaging instruction is issued (the period of taking pictures for generating the instant preview image), the system control unit 18 controls the movable range of the imaging element 12 to be the same as that in the normal recording mode, and when it becomes the state of taking pictures for recording due to the issuance of the imaging instruction, the movable range of the imaging element 12 can be controlled within the wide range for the cropping recording mode. Thereby, in the cropping recording mode, the image quality can be ensured throughout the entire range of the instant preview image.

[0088] In addition, when shooting for recording ends and shooting for generating an instant preview image resumes, it is preferable to restart the display of the instant preview image after moving the imaging element 12 so that the light-receiving area 120 falls within the movable range of the imaging element 12 in the normal recording mode. Thereby, the user can be prevented from recognizing the movement of the imaging element 12 caused by a sharp change in the movable range.

[0089] (Fifth Modification Example of Digital Camera 1)

[0090] So far, the camera body 10 of the digital camera 1 has an in-body anti-shake function that corrects image blur by moving the imaging element 12. The digital camera 1 of the fifth modification example moves the anti-shake lens included in the imaging optical system 30 of the lens device 20 instead of moving the imaging element 12, thereby having an optical anti-shake function for correcting image blur. In the digital camera 1 having the optical anti-shake function instead of the in-body anti-shake function, the movable range of the aforementioned imaging element 12 is simply replaced with the movable range of the anti-shake lens. That is, in the normal recording mode, the system control unit 18 sets the movable range of the anti-shake lens to, for example, Figure 5 the range of the circle C1, and in the cropped recording mode, sets the movable range of the anti-shake lens to, for example, Figure 6 the range of the circle C2.

[0091] Figure 12 is a flowchart for explaining the operation of the digital camera of the fifth modification example. When the power of the digital camera 1 is turned on, the system control unit 18 communicates with the lens device 20 to determine whether the lens device 20 is equipped with an optical anti-shake function (step S21). If the lens device 20 is not equipped with an optical anti-shake function (step S21: No), the system control unit 18 invalidates the image blur correction function (step S24).

[0092] If the lens device 20 is equipped with an optical anti-shake function (step S21: Yes), the system control unit 18 determines whether the lens device 20 corresponds to a setting (change) from outside the movable range of the anti-shake lens (step S22). If the determination in step S22 is "No", the system control unit 18 invalidates the image blur correction function (step S24).

[0093] If the determination in step S22 is "Yes", the system control unit 18 sets the movable range of the anti-shake lens for image blur correction in the normal recording mode and the movable range of the anti-shake lens for image blur correction in the cropped recording mode according to the lens information of the lens device 20 and the crop ratio β (step S23).

[0094] Thus, even a digital camera having only an optical image stabilization function can achieve an improvement in image shake correction performance and an improvement in the quality of an instant preview image.

[0095] (Sixth modification example of digital camera 1)

[0096] In addition to the in-body image stabilization function, digital camera 1 may also have an optical image stabilization function. Figure 13 It represents Figure 1 A schematic diagram of the sixth modification example of digital camera 1. Figure 13 The hardware structure of the digital camera 1A shown is the same as that of digital camera 1 Figure 1 except that the lens device 20 is changed to a lens device 20A. In addition, the lens device 20A of digital camera 1A can also be replaced with a lens device 20 that does not have an optical image stabilization function.

[0097] The lens device 20A has the same structure as the lens device 20 except that an image stabilization lens 32 and an image stabilization lens drive mechanism 33 for driving the image stabilization lens 32 are added to the imaging optical system 30.

[0098] The image stabilization lens 32 is a lens for correcting image shake. The image stabilization lens drive mechanism 33 moves the image stabilization lens 32 in a direction orthogonal to the optical axis K of the imaging optical system 30 according to an instruction from the lens control unit 40. The image shake is optically corrected by moving the image stabilization lens 32 in a direction orthogonal to the optical axis K.

[0099] In digital camera 1A, according to the movement information of digital camera 1 detected by the movement detection sensor 17, the lens control unit 40 moves the image stabilization lens 32, and the system control unit 18 moves the imaging element 12, thereby correcting the image shake.

[0100] When the system control unit 18 corrects the image shake with both the optical image stabilization function and the in-body image stabilization function, a part of the movement during the movement of digital camera 1A is canceled by the image stabilization lens 32, and the remaining part of the movement is canceled by the imaging element 12, thereby correcting the image shake.

[0101] In the normal recording mode, the system control unit 18, for example, Figure 5 The circle C1 with a radius of difference r1 shown is equally proportionally shared by the image stabilization lens 32 and the imaging element 12. The movable range of the imaging element 12 is set to the range of a circle with a radius of 0.5 times the difference r1, and the movable range of the image stabilization lens 32 is set to the range of a circle with a radius of 0.5 times the difference r1. This sharing ratio is determined according to the mechanical upper limit of the movement of the image stabilization lens 32 in the lens device mounted on the camera body 10 of digital camera 1A and the mechanical upper limit of the movement of the imaging element 12.

[0102] In the cropping recording mode, for example, the system control unit 18 proportionally shares the circle C2 with a radius of difference r2 shown in Figure 6 between the anti-vibration lens 32 and the imaging element 12 according to the cropping magnification β. Specifically, when the cropping magnification β = 1.2, β1 and β2 are set so that the sharing ratio β1:β2 of the anti-vibration lens 32 and the imaging element 12 becomes β1×β2 = 1.2. Then, the range of a circle with a radius of {β1 / (β1 + β2)} times the difference r2 is set as the movable range of the anti-vibration lens 32, and the range of a circle with a radius of {β2 / (β1 + β2)} times the difference r2 is set as the movable range of the imaging element 12. In this way, the system control unit 18 sets at least one of the movable range of the anti-vibration lens 32 and the movable range of the imaging element 12 to be wider than in the normal recording mode according to the sharing ratio based on the cropping magnification β, so that the cropping area 121 does not go outside the image circle 30A.

[0103] Figure 14 is a flowchart for explaining the operation of the cropping recording mode of the digital camera according to the sixth modification example. When the power of the digital camera 1A is turned on, the system control unit 18 communicates with the installed lens device to determine whether the lens device is equipped with an optical anti-vibration function (step S31). When the lens device is not equipped with an optical anti-vibration function (step S31: No), the system control unit 18 sets the movable range of the imaging element 12 according to the cropping magnification β (step S34).

[0104] When the lens device is equipped with an optical anti-vibration function (step S31: Yes), that is, when the lens device 20A is installed, the system control unit 18 determines whether the lens device 20A corresponds to a setting (change) from outside the movable range of the anti-vibration lens 32 (step S32). When the determination in step S32 is "No", the system control unit 18 invalidates the optical anti-vibration function and performs the process of step S34. The determination of "No" in step S32 is, for example, the case where the firmware of the lens device 20A has not been updated yet.

[0105] When the determination in step S32 is "Yes", the system control unit 18 sets the movable ranges of the imaging element 12 and the anti-vibration lens 32 respectively according to the lens information of the lens device 20A and the cropping magnification β (step S33).

[0106] In this way, even for a digital camera that uses both an optical anti-vibration function and an in-body anti-vibration function, it is possible to improve the image shake correction performance and the quality of the instant preview image.

[0107] Next, as an embodiment of the imaging device of the present invention, the structure of a smartphone will be described.

[0108] Figure 15This is a diagram showing the appearance of a smartphone 200, which is an embodiment of the photographic device of the present invention.

[0109] Figure 15 The shown smartphone 200 has a flat plate-shaped housing 201, and on one side of the housing 201, there is a display input unit 204 in which a display panel 202 as a display unit and an operation panel 203 as an input unit are integrated.

[0110] Moreover, such a housing 201 is provided with a speaker 205, a microphone 206, an operation unit 207, and a camera unit 208. In addition, the structure of the housing 201 is not limited to this. For example, a structure in which the display unit and the input unit are independent can be adopted, or a folding structure or a structure having a sliding mechanism can also be adopted.

[0111] Figure 16 This is a diagram showing Figure 15 the structure of the shown smartphone 200.

[0112] As Figure 16 shown, as the main components of the smartphone, there are provided a wireless communication unit 210, a display input unit 204, a call unit 211, an operation unit 207, a camera unit 208, a recording unit 212, an external input / output unit 213, a GNSS (Global Navigation Satellite System) (in Figure 16 this, it is described as GPS (Global Positioning System) as an example) reception unit 214, a motion sensor unit 215, a power supply unit 216, and a main control unit 220.

[0113] Moreover, as the main functions of the smartphone 200, there are provided a wireless communication function for performing mobile wireless communication via a base station device BS (not shown) and a mobile communication network NW (not shown).

[0114] The wireless communication unit 210 performs wireless communication with the base station device accommodated in the mobile communication network according to the instruction of the main control unit 220. Using this wireless communication, various file data such as voice data and image data, email data, etc. are transmitted and received, and network data or streaming data, etc. are received.

[0115] The display input unit 204 is a so-called touch panel that displays images (still images and moving images) or character information, etc. under the control of the main control unit 220 to visually transmit information to the user, and detects user operations on the displayed information, and includes a display panel 202 and an operation panel 203.

[0116] The display panel 202 uses an LCD (Liquid Crystal Display) or an OELD (Organic Electro-Luminescence Display) as a display device.

[0117] The operation panel 203 is a device that visually recognizes an image displayed on the display surface of the display panel 202 and detects one or more coordinates operated by a user's finger or stylus. If this device is operated by a user's finger or stylus, a detection signal generated by the operation is output to the main control unit 220. Subsequently, the main control unit 220 detects the operation position (coordinates) on the display panel 202 based on the received detection signal.

[0118] As Figure 16 shown, in the smartphone 200 illustrated as an embodiment of the photographic device of the present invention, the display panel 202 and the operation panel 203 are integrated to form a display input unit 204, and are configured such that the operation panel 203 completely covers the display panel 202.

[0119] In the case of adopting this configuration, the operation panel 203 can have a function of detecting a user operation on an area other than the display panel 202. In other words, the operation panel 203 can have a detection area for an overlapping portion overlapping with the display panel 202 (hereinafter, referred to as a display area), and a detection area for an outer edge portion other than this that does not overlap with the display panel 202 (hereinafter, referred to as a non-display area).

[0120] In addition, the size of the display area can be made exactly the same as the size of the display panel 202, but it is not necessary for the two to be the same. Also, the operation panel 203 can have two sensing areas, an outer edge portion and an inner portion other than this. Moreover, the width of the outer edge portion can be appropriately designed according to the size of the housing 201 or the like.

[0121] Furthermore, as a position detection method adopted in the operation panel 203, a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitive method, etc. can be cited, and any one of these methods can also be adopted.

[0122] The call unit 211 includes a speaker 205 or a microphone 206, converts the voice of the user input through the microphone 206 into voice data that can be processed by the main control unit 220 and outputs it to the main control unit 220, or decodes the voice data received by the wireless communication unit 210 or the external input / output unit 213 and outputs it from the speaker 205.

[0123] And, as Figure 15As shown, for example, the speaker 205 is mounted on the same surface as the surface where the display input unit 204 is provided, and the microphone 206 can be mounted on the side surface of the housing 201.

[0124] The operation unit 207 is a hardware key using a key switch or the like, and receives instructions from the user. For example, as Figure 16 shown, the operation unit 207 is a push-button switch, which is mounted on the side surface of the housing 201 of the smartphone 200. When pressed with a finger or the like, it is turned on, and when the finger is removed, it returns to the closed state by a restoring force such as a spring.

[0125] The recording unit 212 records the control program and control data of the main control unit 220, application software, address data associating the name or telephone number of the communication partner, etc., data of received and sent e-mails, Web (network) data downloaded through Web (network) browsing, and downloaded content data, and temporarily records stream data, etc. Further, the recording unit 212 is composed of an internal recording unit 217 built in the smartphone and an external recording unit 218 having a detachable external memory slot.

[0126] In addition, each of the internal recording unit 217 and the external recording unit 218 constituting the recording unit 212 is implemented using a storage medium such as a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., MicroSD (registered trademark) memory, etc.), RAM (Random Access Memory), ROM (Read Only Memory).

[0127] The external input / output unit 213 functions as an interface for all external devices connected to the smartphone 200, and is used to directly or indirectly connect to other external devices through communication (e.g., Universal Serial Bus (USB), IEEE1394, etc.) or a network (e.g., Internet, Wireless LAN, Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee (registered trademark), etc.).

[0128] As an external device connected to the smartphone 200, for example, there are: wired / wireless headphones, wired / wireless external chargers, wired / wireless data ports, a memory card connected via a card slot or a SIM (Subscriber Identity Module Card) / UIM (User Identity Module Card), an external audio / video device connected via an audio / video I / O (Input / Output) terminal, a wirelessly connected external audio / video device, a wired / wirelessly connected smartphone, a wired / wirelessly connected personal computer, a wired / wirelessly connected personal computer, headphones, etc.

[0129] The external input / output unit 213 can transfer the data received and transmitted from such an external device to each component inside the smartphone 200, or can transfer the data inside the smartphone 200 to the external device.

[0130] The GPS receiver unit 214 receives GPS signals transmitted from GPS satellites ST1 to STn according to the instructions of the main control unit 220, performs positioning calculation processing based on the received multiple GPS signals, and detects the position composed of the latitude, longitude, and altitude of the smartphone 200. When the GPS receiver unit 214 can obtain position information from the wireless communication unit 210 or the external input / output unit 213 (such as a wireless LAN), it can also use this position information to detect the position.

[0131] The motion sensor unit 215 includes, for example, a three-axis acceleration sensor, etc., and detects the physical movement of the smartphone 200 according to the instructions of the main control unit 220. By detecting the physical movement of the smartphone 200, the moving direction or acceleration of the smartphone 200 is detected. The detection result is output to the main control unit 220.

[0132] The power supply unit 216 supplies the power stored in a battery (not shown) to each part of the smartphone 200 according to the instructions of the main control unit 220.

[0133] The main control unit 220 includes a microprocessor, operates according to the control program and control data recorded in the recording unit 212, and centrally controls each part of the smartphone 200. In addition, the main control unit 220 has a mobile communication control function and an application processing function for controlling each part of the communication system in order to perform voice communication or data communication through the wireless communication unit 210.

[0134] The application processing function is implemented by the main control unit 220 operating according to the application software recorded in the recording unit 212. As application processing functions, for example, there are an infrared communication function for controlling the external input / output unit 213 to perform data communication with a counterpart device, an e-mail function for sending and receiving e-mails, or a web browsing function for browsing web pages, etc.

[0135] Moreover, the main control unit 220 has an image processing function for displaying an image on the display input unit 204 or the like based on image data such as received data or downloaded stream data (data of a still image or a moving image).

[0136] The image processing function means that the main control unit 220 decodes the above-mentioned image data, performs image processing on the decoding result, and displays the image on the display input unit 204.

[0137] Furthermore, the main control unit 220 executes display control of the display panel 202 and operation detection control for detecting a user operation through the operation unit 207 and the operation panel 203.

[0138] By executing the display control, the main control unit 220 displays software keys such as an icon or a scroll bar for starting an application software, or displays a window for creating an e-mail.

[0139] In addition, the scroll bar refers to a software key for receiving an instruction to move an image display part with respect to a large image or the like that cannot be completely accommodated in the display area of the display panel 202.

[0140] Moreover, by executing the operation detection control, the main control unit 220 detects a user operation through the operation unit 207, or accepts an operation on the above-mentioned icon and an input of a string to the input field of the above-mentioned window through the operation panel 203, or accepts a scroll request for the displayed image through the scroll bar.

[0141] In addition, by executing the operation detection control, the main control unit 220 has the following touch panel control function: determining whether the operation position on the operation panel 203 is an overlapping part (display area) overlapping with the display panel 202 or an outer edge part (non-display area) that does not overlap with the display panel 202, and controlling the sensing area of the operation panel 203 or the display position of the software key.

[0142] Furthermore, the main control unit 220 can also detect a gesture operation on the operation panel 203 and execute a preset function based on the detected gesture operation.

[0143] The gesture operation is not a simple touch operation in the past, but refers to an operation of drawing a trajectory with a finger or the like, or simultaneously specifying a plurality of positions, or combining these to draw a trajectory on at least one of the plurality of positions.

[0144] The camera unit 208 includes a structure other than the memory 16 and the system control unit 18 in the digital camera 1 shown. When the smart phone 200 functions as the digital camera 1, the recording unit 212 and the recording medium 19 undertake the functions of the memory 16, and the main control unit 220 undertakes the functions of the system control unit 18. Figure 1 The imaging image data generated by the camera unit 208 can be recorded in the recording unit 212, or output through the external input / output unit 213 or the wireless communication unit 210.

[0145] In the smart phone 200 shown, the camera unit 208 is mounted on the same surface as the display input unit 204, but the mounting position of the camera unit 208 is not limited thereto, and it can also be mounted on the back of the display input unit 204.

[0146] In Figure 15 the smart phone 200 shown, the camera unit 208 is mounted on the same surface as the display input unit 204, but the mounting position of the camera unit 208 is not limited thereto, and it can also be mounted on the back of the display input unit 204.

[0147] Moreover, the camera unit 208 can be used for various functions of the smart phone 200. For example, an image acquired by the camera unit 208 can be displayed on the display panel 202, or the image of the camera unit 208 can be used as one of the operation inputs of the operation panel 203.

[0148] Also, when the GPS receiving unit 214 detects the position, the image from the camera unit 208 can also be referred to for position detection. Moreover, the image from the camera unit 208 can be referred to, without using the three-axis acceleration sensor or in combination with the three-axis acceleration sensor, to determine the optical axis direction of the camera unit 208 of the smart phone 200, or to determine the current usage environment. Of course, the image from the camera unit 208 can also be used within the application software.

[0149] In addition, position information acquired by the GPS receiving unit 214, voice information acquired by the microphone 206 (which can also be converted into text information by voice-to-text conversion by the main control unit or the like), posture information acquired by the motion sensor unit 215, etc. can be added to the still image or moving image data and recorded in the recording unit 212, or output through the external input / output unit 213 or the wireless communication unit 210.

[0150] At least the following matters are described in this specification.

[0151] (1) A processor of an imaging device, the imaging device having an imaging element that captures a subject through an imaging optical system, and the processor of the imaging device performs:

[0152] Recording control, performing either first processing for recording a first captured image output from a first area that is a part of the light-receiving area of the above imaging element or second processing for recording a second captured image output from a second area that is wider than the first area in the above light-receiving area;

[0153] Image blur correction control, correcting image blur of a captured image output from the above imaging element by moving either or both of the above imaging element and a lens included in the above imaging optical system;

[0154] Image processing, generating an instant preview image for displaying a subject image imaged in the above second area on a display unit; and

[0155] In a case of performing the above first processing, compared with a case of performing the above second processing, performing control to expand a movable range of at least one of the above imaging element or the above lens in the above image blur correction control.

[0156] (2) The processor of the imaging device according to (1), wherein,

[0157] In a case of performing the above first processing and a case of performing the above second processing, changing image processing parameters of a portion corresponding to a third area that is an area other than the above first area in the above second area in the above instant preview image.

[0158] (3) The processor of the imaging device according to (2), wherein,

[0159] The above image processing parameters are parameters related to image visibility.

[0160] (4) The processor of the imaging device according to (3), wherein,

[0161] The above parameters are parameters for determining brightness or sharpness.

[0162] (5) The processor of the imaging device according to (4), wherein,

[0163] In a case of performing the above first processing, compared with a case of performing the above second processing, making the above portion brighter or increasing sharpness of the above portion.

[0164] (6) The processor of the imaging device according to (4), wherein,

[0165] In a case of performing the above first processing, compared with a case of performing the above second processing, making the above portion darker or decreasing sharpness of the above portion.

[0166] (7) The processor of the imaging device according to any one of (1) to (6), wherein,

[0167] Determine the movable range during the above-mentioned first process according to the size ratio between the above-mentioned first area and the above-mentioned second area.

[0168] (8) The processor of the imaging device according to (7), wherein,

[0169] In the case of correcting the image blur by moving both the above-mentioned imaging element and the above-mentioned lens, determine the movable range of the above-mentioned imaging element according to the first sharing ratio allocated to the above-mentioned imaging element in the above-mentioned ratio, and determine the movable range of the above-mentioned lens according to the second sharing ratio allocated to the above-mentioned lens in the above-mentioned ratio.

[0170] (9) An imaging device, comprising:

[0171] (1) to (8) Any one of the processors described above; and

[0172] The above-mentioned imaging element.

[0173] (10) A control method for an imaging device, the imaging device having an imaging element that captures a subject through an imaging optical system, and the control method of the imaging device performs:

[0174] Recording control, performing either the first process of recording the first captured image output from a first area of a part of the light-receiving area of the above-mentioned imaging element or the second process of recording the second captured image output from a second area wider than the above-mentioned first area in the above-mentioned light-receiving area;

[0175] Image blur correction control, correcting the image blur of the captured image output from the above-mentioned imaging element by moving one or both of the above-mentioned imaging element and the lens included in the above-mentioned imaging optical system;

[0176] Image processing, generating an instant preview image for displaying the subject image imaged in the above-mentioned second area on the display unit; and

[0177] In the case of performing the above-mentioned first process, compared with the case of performing the above-mentioned second process, perform control to expand the movable range of at least one of the above-mentioned imaging element or the above-mentioned lens in the above-mentioned image blur correction control.

[0178] (11) The control method for an imaging device according to (10), wherein,

[0179] In the case of performing the above-mentioned first process and the case of performing the above-mentioned second process, change the image processing parameters of the part corresponding to the third area, which is the area other than the above-mentioned first area in the above-mentioned second area, in the above-mentioned instant preview image.

[0180] (12) The control method of the imaging device according to (11), wherein,

[0181] The above image processing parameter is a parameter related to image visibility.

[0182] (13) The control method of the imaging device according to (12), wherein,

[0183] The above visibility includes brightness or sharpness.

[0184] (14) The control method of the imaging device according to (13), wherein,

[0185] In the case of performing the above first process, compared with the case of performing the above second process, make the above part brighter or increase the sharpness of the above part.

[0186] (15) The control method of the imaging device according to (13), wherein,

[0187] In the case of performing the above first process, compared with the case of performing the above second process, make the above part darker or reduce the sharpness of the above part.

[0188] (16) The control method of the imaging device according to any one of (10) to (15), wherein,

[0189] Determine the above-mentioned movable range when performing the above first process according to the size ratio of the above first region and the above second region.

[0190] (17) The control method of the imaging device according to (16), wherein,

[0191] In the case of correcting the above image shake by moving both the above imaging element and the above lens, determine the movable range of the above imaging element according to the first sharing ratio allocated to the above imaging element in the above ratio, and determine the movable range of the above lens according to the second sharing ratio allocated to the above lens in the above ratio.

[0192] (18) A control program for an imaging device, the above imaging device has an imaging element that captures an object through an imaging optical system, and the control program of the above imaging device causes a processor to execute:

[0193] Recording control, performing recording of either the first process of recording the first captured image output from a first region of a part of the light-receiving region of the above imaging element or the second process of recording the second captured image output from a second region wider than the above first region in the above light-receiving region;

[0194] Image blur correction control that corrects image blur of a captured image output from the imaging element by moving one or both of the imaging element and the lens included in the imaging optical system;

[0195] Image processing that generates an instant preview image for displaying the captured image output from the second region on the display unit; and

[0196] In the case of performing the first process, compared with the case of performing the second process, control is performed to expand the movable range of at least one of the imaging element or the lens in the image blur correction control.

[0197] As described above, various embodiments have been described with reference to the accompanying drawings. However, the present invention is of course not limited to these examples. For those skilled in the art, various modification examples or correction examples can be obviously conceived within the scope described in the claims, and it can be understood that these examples also belong to the technical scope of the present invention. Moreover, within the scope not departing from the gist of the present invention, the respective constituent elements in the above-described embodiments can be arbitrarily combined.

[0198] In addition, this application claims priority based on Japanese Patent Application No. 2020-079514 filed on April 28, 2020, the content of which is incorporated herein by reference.

[0199] Symbol Explanation

[0200] 1A, 1 - Digital camera, D1, D3 - Image signal, L1, L3a, L3 - Image, P1 - Cropped recorded image, l1, l2 - Diagonal length, r1, r2 - Difference, C1, C2 - Circle, C1, C2 - Data, D2 - Captured image signal, P2 - Normal recorded image, 10 - Camera body, 12 - Imaging element, 13 - Imaging element displacement mechanism, 14 - Imaging element drive unit, 15 - Display unit, 16 - Memory, 17 - Motion detection sensor, 18 - System control unit, 19 - Recording medium, 20A, 20 - Lens device, 30A - Image circle, 30 - Imaging optical system, 31 - Imaging lens, 32 - Anti-vibration lens, 33 - Anti-vibration lens drive mechanism, 40 - Lens control unit, 120A - Center, 120 - Light-receiving area, 121 - Cropping area, 122 - Peripheral area, 150 - Display surface, 200 - Smart phone, 201 - Housing, 202 - Display panel, 203 - Operation panel, 204 - Display input unit, 205 - Speaker, 206 - Microphone, 207 - Operation unit, 208 - Camera unit, 210 - Wireless communication unit, 211 - Call unit, 212 - Recording unit, 213 - External input / output unit, 214 - GPS reception unit, 215 - Motion sensor unit, 216 - Power supply unit, 217 - Internal recording unit, 218 - External recording unit, 220 - Main control unit.

Claims

1. A processor of an imaging device, the imaging device having an imaging element that captures a subject through an imaging optical system, the processor of the imaging device performing: Recording control, performing either a first process or a second process, the first process recording a first captured image output from a first region that is a part of a light-receiving region of the imaging element, the second process recording a second captured image output from a second region in the light-receiving region, the second region being wider than the first region; Image shake correction control, correcting image shake of a captured image output from the imaging element by moving either or both of the imaging element and a lens included in the imaging optical system; Image processing, generating an instant preview image for displaying a subject image imaged in the second region on a display unit; Control for expanding a movable range of at least one of the imaging element or the lens in the image shake correction control when the first process is performed, as compared with the case where the second process is performed; And Control for expanding the movable range when a shooting instruction is given to the imaging element and a shooting state for recording is entered.

2. The processor of the imaging device according to claim 1, Wherein, When the first process is performed and when the second process is performed, an image processing parameter of a portion corresponding to a third region that is a region other than the first region in the second region in the instant preview image is changed.

3. The processor of the imaging device according to claim 2, Wherein, The image processing parameter is a parameter related to the visibility of an image.

4. The processor of the imaging device according to claim 3, Wherein, The parameter is a parameter for determining brightness or sharpness.

5. The processor of the imaging device according to claim 4, Wherein, When the first process is performed, as compared with the case where the second process is performed, the portion is made brighter or the sharpness of the portion is increased.

6. The processor of the imaging device according to claim 4, Wherein, When the first process is performed, as compared with the case where the second process is performed, the portion is made darker or the sharpness of the portion is decreased.

7. The processor of the imaging device according to any one of claims 1 to 6, Wherein, The movable range when the first process is performed is determined according to a ratio of the sizes of the first region and the second region.

8. The processor of the imaging device according to claim 7, Wherein, In the case of correcting the image shake by moving both the imaging element and the lens, the movable range of the imaging element is determined according to a first share ratio allocated to the imaging element in the ratio, and the movable range of the lens is determined according to a second share ratio allocated to the lens in the ratio.

9. An imaging device, comprising: The processor according to any one of claims 1 to 8; and The imaging element.

10. A control method for an imaging device, the imaging device having an imaging element that captures a subject through an imaging optical system, the control method for the imaging device performing: Recording control that performs either a first process or a second process. The first process records a first captured image output from a first region that is a part of the light-receiving region of the imaging element, and the second process records a second captured image output from a second region that is wider than the first region in the light-receiving region; Image shake correction control that corrects image shake of the captured image output from the imaging element by moving either one or both of the imaging element and a lens included in the imaging optical system; Image processing that generates an instant preview image for displaying a subject image formed in the second region on a display unit; Control to expand a movable range of at least one of the imaging element or the lens in the image shake correction control when the first process is performed, as compared with when the second process is performed; And Control to expand the movable range when a shooting instruction is given to the imaging element and a shooting state for recording is entered.

11. The control method for an imaging device according to claim 10, wherein when the first process is performed and when the second process is performed, an image processing parameter corresponding to a portion of the instant preview image corresponding to a third region that is a region in the second region other than the first region is changed.

12. The control method for an imaging device according to claim 11, wherein the image processing parameter is a parameter related to the visibility of the image.

13. The control method for an imaging device according to claim 12, wherein the visibility includes brightness or sharpness.

14. The control method for an imaging device according to claim 13, wherein when the first process is performed, as compared with when the second process is performed, the portion is made brighter or the sharpness of the portion is increased.

15. The control method for an imaging device according to claim 13, wherein when the first process is performed, as compared with when the second process is performed, the portion is made darker or the sharpness of the portion is decreased.

16. The control method for an imaging device according to any one of claims 10 to 15, wherein the movable range when the first process is performed is determined according to the ratio of the sizes of the first region and the second region.

17. The control method for an imaging device according to claim 16, wherein when correcting the image shake by moving both the imaging element and the lens, the movable range of the imaging element is determined according to a first sharing ratio allocated to the imaging element in the ratio, and the movable range of the lens is determined according to a second sharing ratio allocated to the lens in the ratio.

18. A storage medium stores a control program for a imaging device, the imaging device having an imaging element that captures a subject through an imaging optical system, and the control program for the imaging device causes a processor to execute: Recording control that performs either a first process or a second process. The first process records a first captured image output from a first area that is a part of a light-receiving area of the imaging element, and the second process records a second captured image output from a second area in the light-receiving area, the second area being wider than the first area; Image blur correction control that corrects image blur of a captured image output from the imaging element by moving either one or both of the imaging element and a lens included in the imaging optical system; Image processing that generates an instant preview image for displaying the captured image output from the second area on a display unit; Control to expand a movable range of at least one of the imaging element or the lens in the image blur correction control when the first process is performed, as compared with when the second process is performed; and Control to expand the movable range when a shooting instruction is given to the imaging element and a shooting state for recording is entered.

Images