Image capture device, image capture device control method, and program

Abstract

The present invention realizes an operation unit (UI) with which an imaging lens selection process performed by a user, and a digital zoom process performed on a captured image using the selected lens, can be efficiently executed. The present invention has a plurality of lenses that have respectively different lens magnifications and that can be used for image capture, and a display control unit that executes a control of display data outputted to a display unit. The display control unit: displays, on the display unit, a plurality of lens selection units corresponding to each of the plurality of lenses; displays, in accordance with a user operation for selecting one of the plurality of lens selection units displayed on the display unit, a digital zoom adjustment section that makes it possible to adjust the digital zoom of the captured image in accordance with the sliding amount of the lens selection unit selected by the user; and furthermore displays, on the display unit, a digital zoom image executed in accordance with the sliding amount.

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device, an imaging device control method, and a program, and more particularly to an imaging device, an imaging device control method, and a program that improve operability of switching lenses used in the imaging device and digital zoom processing. [Background technology]

[0002] For example, many portable electronic devices such as smartphones are equipped with a camera function. In particular, in recent years, the number of smartphones equipped with multi-lens cameras equipped with multiple different lenses, such as a standard lens, a wide-angle lens, and a telephoto lens, has been increasing. Multi-lens cameras can capture clearer images of subjects from far away to close by, for example, by switching lenses depending on the subject distance.

[0003] However, the standard lens, wide-angle lens, and telephoto lens installed on smartphones are all single-focus lenses with fixed focal lengths. Furthermore, many slim devices, such as smartphones, do not have zoom lenses. Therefore, digital zoom processing is used to generate an intermediate image between an image taken with a standard lens and an image taken with a telephoto lens.

[0004] Digital zoom processing is used to enlarge a captured image. For example, by cropping and enlarging a portion of an image captured with a standard lens, it is possible to create an image that is intermediate between an image captured with a standard lens and an image captured with a telephoto lens. Digital zoom processing is described in, for example, Patent Document 1 (JP 2013-175855 A).

[0005] When taking a picture using a smartphone equipped with a multi-lens camera, the user first selects one of the lenses to use for taking the picture. This lens selection process displays the image captured by the selected lens, a so-called through image, on the smartphone's display. Furthermore, when adjusting the angle of view or size of the image displayed on the display unit, the user performs zoom processing using the digital zoom function, displays the image corrected by the digital zoom on the display unit, and sets the angle of view or size of the image to his / her preference. Then, the shutter is operated to take the picture.

[0006] As described above, when taking pictures using a multi-lens camera, the user needs to sequentially perform two processes: lens selection process and digital zoom process.

[0007] However, most smartphone user interfaces (UIs) are configured with separate UIs for lens selection and digital zoom processing. This means that after selecting a lens, users must switch UIs when attempting to perform digital zoom, which often results in users missing the opportunity to take a photo. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-175855 Summary of the Invention [Problem to be solved by the invention]

[0009] The present disclosure has been made in consideration of, for example, the above-mentioned problems, and aims to provide an imaging device, an imaging device control method, and a program that improve the operability of switching lenses used in imaging devices such as smartphones and digital zoom processing. [Means for solving the problem]

[0010] A first aspect of the present disclosure provides: Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; In response to a user operation to select one of a plurality of lens selection sections displayed on the display section, the imaging device displays a digital zoom adjustment section that allows the digital zoom amount of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user.

[0011] Furthermore, a second aspect of the present disclosure is An imaging device control method executed in an imaging device, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; The imaging device control method displays a digital zoom adjustment section in response to a user operation to select one of a plurality of lens selection sections displayed on the display section, allowing the digital zoom amount of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user.

[0012] Furthermore, a third aspect of the present disclosure is a program for causing an imaging device to execute imaging device control processing, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The program causes the display control unit to a process of displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; The program executes a process of displaying a digital zoom adjustment section in which the amount of digital zoom of a captured image can be adjusted according to the amount of sliding of the lens selection section selected by the user in response to a user operation of selecting one of a plurality of lens selection sections displayed on the display section.

[0013] The program of the present disclosure is a program that can be provided, for example, via a storage medium or communication medium in a computer-readable format to an information processing device or computer system capable of executing various program codes. By providing such a program in a computer-readable format, processing according to the program is realized on the information processing device or computer system.

[0014] Further objects, features, and advantages of the present disclosure will become apparent from the following detailed description of the embodiments of the present disclosure and the accompanying drawings. Note that in this specification, a system refers to a logical collective configuration of multiple devices, and is not limited to devices that are located within the same housing.

[0015] According to the configuration of one embodiment of the present disclosure, an operation unit (UI) is realized that enables a user to efficiently select a photographing lens and perform digital zoom processing of a photographed image using the selected lens. Specifically, for example, the device has a plurality of lenses each having a different lens magnification that can be used for image capture, and a display control unit that controls the display data to be output to the display unit, and the display control unit displays a plurality of lens selection sections corresponding to each of the plurality of lenses on the display unit, and in response to a user operation to select one of the plurality of lens selection sections displayed on the display unit, displays a digital zoom adjustment section that allows the amount of digital zoom of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user, and further displays the digital zoom image that is executed according to the amount of sliding on the display unit. This configuration realizes an operation unit (UI) that enables the user to efficiently select a photographing lens and digitally zoom a photographed image using the selected lens. The effects described in this specification are merely examples and are not limiting, and additional effects may also be present. [Brief explanation of the drawings]

[0016] [Figure 1] 1A and 1B are diagrams illustrating an example of the external configuration of an imaging device. [Figure 2] 10A and 10B are diagrams illustrating examples of images captured by switching lenses. [Figure 3] 10A and 10B are diagrams illustrating an example of display data of a display unit of the imaging device. [Figure 4] 10A to 10C are diagrams illustrating examples of captured images and display data in response to user operation of a lens selection section (lens selection icon). [Figure 5] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 6] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 7] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 8] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 9] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 10] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 11] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 12] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating an imaging device and an example of transition of display data in response to the user operations. [Figure 13]10A to 10C are diagrams illustrating an example of a series of operations by a user operating a lens selection section (lens selection icon) of an imaging device and an example of transition of display data in response to the user operations. [Figure 14] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating a lens selection section (lens selection icon) of an imaging device and an example of transition of display data in response to the user operations. [Figure 15] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating a lens selection section (lens selection icon) of an imaging device and an example of transition of display data in response to the user operations. [Figure 16] 10A to 10C are diagrams illustrating an example of a series of operations by a user operating a lens selection section (lens selection icon) of an imaging device and an example of transition of display data in response to the user operations. [Figure 17] FIG. 10 is a flowchart illustrating a processing sequence executed by the imaging apparatus of the present disclosure. [Figure 18] 10A and 10B are diagrams illustrating a specific example of image enlargement processing in digital zoom processing. [Figure 19] 10A and 10B are diagrams illustrating a specific example of image quality degradation in digital zoom processing. [Figure 20] 10A and 10B are diagrams illustrating a specific example of display data for notifying a user of degradation in image quality due to digital zoom processing. [Figure 21] 10A and 10B are diagrams illustrating a specific example of display data for notifying a user of degradation in image quality due to digital zoom processing. [Figure 22] 10A and 10B are diagrams illustrating a specific example of display data for notifying a user of degradation in image quality due to digital zoom processing. [Figure 23] 10A and 10B are diagrams illustrating a specific example of notifying a user of image quality degradation due to digital zoom processing. [Figure 24] 10A and 10B are diagrams illustrating a specific example of notifying a user of image quality degradation due to digital zoom processing. [Figure 25] FIG. 2 is a diagram illustrating an example of display data of an operation unit (UI unit). [Figure 26] FIG. 2 is a diagram illustrating an example of display data of an operation unit (UI unit). [Figure 27] FIG. 2 is a diagram illustrating an example of display data of an operation unit (UI unit). [Figure 28] 10A and 10B are diagrams illustrating an example of display data of an example unit (UI unit) in a device capable of optical zoom. [Figure 29] 10A and 10B are diagrams illustrating an example of display data of an example unit (UI unit) in a device capable of optical zoom. [Figure 30] 10A and 10B are diagrams illustrating an example of display data of an example unit (UI unit) in a device capable of optical zoom. [Figure 31] 10A and 10B are diagrams illustrating an example of display data of an example unit (UI unit) in a device capable of optical zoom. [Figure 32] 10A and 10B are diagrams illustrating an example of display data of an example unit (UI unit) in a device capable of optical zoom. [Figure 33] 1 is a diagram illustrating an example of the configuration of an imaging device according to the present disclosure. [Figure 34] FIG. 2 is a diagram illustrating an example of a hardware configuration of an imaging apparatus according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0017] The imaging device, imaging device control method, and program of the present disclosure will be described in detail below with reference to the drawings. The description will be made according to the following items. 1. Overview of the configuration of the imaging device and lens switching process of the present disclosure 2. Display control process of the operation unit executed in the imaging device of the present disclosure 3. Operation Unit UI Display Control Processing Sequence Executed by the Imaging Device of the Present Disclosure 4. Display control process to notify users of image quality degradation caused by digital zoom 5.Other display control processing examples 6. Configuration example of the imaging device according to the present disclosure 7. Hardware configuration example of imaging device 8. Summary of the Disclosure

[0018] [1. Overview of the configuration of the imaging device and lens switching process of the present disclosure] First, the configuration of the imaging device according to the present disclosure and an overview of the lens switching process will be described.

[0019] Fig. 1 is a diagram showing an example of the configuration of an imaging device according to the present disclosure, in which a smartphone equipped with a camera function is shown as an example of an imaging device 10 according to the present disclosure. Note that the imaging device of the present disclosure is not limited to such a smartphone, but also includes, for example, a tablet terminal with a camera function, a PC, and further imaging devices such as cameras.

[0020] Fig. 1(a) shows the front side of the imaging device (smartphone) 10, which is provided with a display unit 11. Fig. 1(b) shows the back side of the imaging device (smartphone) 10, which is provided with a camera lens 12.

[0021] The camera lens 12 is composed of a plurality of lenses with different focal lengths. That is, the imaging device 10 shown in Fig. 1 is a smartphone equipped with a multi-lens camera. When capturing an image, the user can select a lens to use from these multiple lenses and switch between them as appropriate, thereby capturing clear images of subjects at various distances.

[0022] The imaging device (smartphone) 10 shown in FIG. 1 has the following four types of lenses. (a) Standard lens 12a (b) Wide-angle lens 12b (c) Telephoto lens 12c (d) Super telephoto lens 12d In the figure, the telephoto lens 12c and the super telephoto lens 12d are shown in one lens section at the bottom of the camera lens 12, but this bottom lens section actually incorporates two lenses, the telephoto lens 12c and the super telephoto lens 12d.

[0023] (a) The standard lens 12a has a focal length of 24 mm and a lens magnification of 1.0. (b) The wide-angle lens 12b has a focal length of 16 mm and a lens magnification of 0.7 times. (c) The telephoto lens 12c has a focal length of 70 mm and a lens magnification of 2.9 times. (d) The super telephoto lens 12d has a focal length of 105 mm and a lens magnification of 4.4 times.

[0024] A user of the imaging device 10 can switch between these lenses 12a to 12d when capturing an image. Note that the focal lengths and lens magnifications of each lens are merely examples, and the processing of the present disclosure can also be applied to device configurations equipped with various lenses having other focal lengths and lens magnifications. Furthermore, the lens types are also just an example, and the number of lens types is not limited to four, and the configuration of the present disclosure can be applied to configurations with two, three, four, five, six, or even more lens types.

[0025] FIG. 2 shows examples of images captured by switching between the lenses 12a to 12d. Figure 2 shows examples of the following four types of captured images. (a) Image taken with a standard lens (b) Wide-angle lens image (c) Image taken with a telephoto lens (d) Image taken with a super telephoto lens

[0026] (a) Standard lens image is an image taken using a standard lens 12a with a focal length of 24 mm and a lens magnification of 1.0. (b) The image photographed with a wide-angle lens is an image photographed using a wide-angle lens 12b with a focal length of 16 mm and a lens magnification of 0.7 times. (c) Telephoto lens image is an image taken using a telephoto lens 12c with a focal length of 70 mm and a lens magnification of 2.9 times. (d) The super telephoto lens image is an image taken using a super telephoto lens 12d with a focal length of 105 mm and a lens magnification of 4.4 times.

[0027] As can be seen from Figure 2, (b) the image taken with a wide-angle lens is the image with the widest field of view, and the order of field of view is (b) the image taken with a wide-angle lens, (a) the image taken with a standard lens, (c) the image taken with a telephoto lens, and (d) the image taken with a super telephoto lens.

[0028] On the other hand, when comparing the sizes of subjects at the same distance from the camera, the image taken with the super telephoto lens (d) is the largest. The order of size of subjects at the same distance is (d) super telephoto lens image, (c) telephoto lens image, (a) standard lens image, and (b) wide-angle lens image, which is the reverse of the order of the field of view.

[0029] In this way, a multi-lens camera can capture a variety of images by switching between lenses.

[0030] 2. Display control process of the operation unit executed in the imaging device of the present disclosure Next, a display control process of the operation unit executed in the imaging device of the present disclosure will be described.

[0031] FIG. 3 is a diagram showing an example in which an operation section is displayed as a user interface (UI) on the display section 11 of the imaging device (smartphone) 10. As shown in FIG. The upper section of the display section 11 is set as a captured image display area 101, and the lower section is set as an operation section display area .

[0032] Note that the images displayed in the captured image display area 101 are not limited to images for which the shooting process has been completed, but also include images before shooting. A so-called through image, that is, an image that the user is about to shoot, is also displayed in the captured image display area 101. While viewing the image displayed in the captured image display area 101, the user shoots an image by operating various operation units such as icons displayed in the operation unit display area 102.

[0033] 3 displays icons as various operation units, such as a shutter 103, a still image / moving image switching unit 104, and a lens selection unit 105. Note that the operation unit (icon) information displayed in the operation unit display area 102 can be switched to various settings.

[0034] To capture an image displayed in the captured image display area 101, the user touches the shutter 103. This process captures the image displayed in the captured image display area 101 and stores it in memory.

[0035] The still image / moving image switching unit 104 is an operation unit for switching between capturing a still image and capturing a moving image. The process of the present disclosure can be applied to both still image capture and video capture, but in the following embodiment, a process example for capturing a still image will be described as a representative example.

[0036] The lens selection unit 105 is an operation unit for switching the lens used for image capture, and displays four lens selection icons for individually selecting the four types of lenses described above with reference to Figure 1.

[0037] FIG. 3 shows the following four lens selection sections (lens selection icons): Wide-angle lens selection section (×0.7) Standard lens selection section (x1.0) Telephoto lens selection section (x2.9) Super telephoto lens selection section (×4.4) The numbers (0.7 to 4.4) inside each icon indicate the magnification of each lens.

[0038] The user can switch the lens to be used by operating (touching) any of the four lens selection sections (lens selection icons).

[0039] FIG. 4 is a diagram showing an example of a display image that can be switched in response to a user operation (touch) on four lens selection sections (lens selection icons), that is, an example of switching of the display image in the captured image display area 101. In FIG.

[0040] FIG. 4 shows examples of the following four types of user operation states. (a) The state when the user operates (touches) the standard lens selection section (standard lens selection icon) (b) The user operates (touches) the wide-angle lens selection section (wide-angle lens selection icon). (c) The state when the user operates (touches) the telephoto lens selection section (telephoto lens selection icon). (d) The state in which the user operates (touches) the super telephoto lens selection section (super telephoto lens selection icon).

[0041] As shown in FIG. 4(a), when a user operates (touches) the standard lens selection section (standard lens selection icon), a process is executed within the imaging device 10 to switch the shooting lens to the standard lens 12a, and an image (through image) captured using the standard lens 12a is displayed on the display unit 11. Also, as shown in FIG. 4(b), when the user operates (touches) the wide-angle lens selection section (wide-angle lens selection icon), a process is executed within the imaging device 10 to switch the shooting lens to the wide-angle lens 12b, and an image (through image) captured using the wide-angle lens 12b is displayed on the display unit 11.

[0042] Also, as shown in FIG. 4(c), when the user operates (touches) the telephoto lens selection section (telephoto lens selection icon), a process is executed within the imaging device 10 to switch the shooting lens to the telephoto lens 12c, and an image (through image) captured using the telephoto lens 12c is displayed on the display unit 11. Also, as shown in Figure 4(d), when the user operates (touches) the super telephoto lens selection section (super telephoto lens selection icon), a process is executed within the imaging device 10 to switch the shooting lens to the super telephoto lens 12d, and an image (through image) captured using the super telephoto lens 12d is displayed on the display unit 11.

[0043] In this way, the user can select (touch) one lens selection icon from the lens selection section (lens selection icon) 105 in the operation unit (UI) to display an image captured with the selected lens on the display unit 11. Thereafter, by touching the shutter 103, the image displayed on the display unit 11 can be photographed and recorded in memory.

[0044] However, the images captured by selecting one lens selection icon from the lens selection section (lens selection icon) 105 in the operation unit (UI) are only four types of images corresponding to the magnification of each lens (0.7x, 1.0x, 2.9x, 4.4x), these four types of magnification.

[0045] For example, the image captured with a standard lens shown in FIG. 4(a) is an image captured according to the lens magnification (1.0x) inherent to the standard lens. The image captured by the telephoto lens shown in FIG. 4(c) is an image captured according to the lens magnification (2.9 times) inherent to the telephoto lens. If one wishes to capture an image that is intermediate between the image captured with a standard lens shown in FIG. 4(a) and the image captured with a telephoto lens shown in FIG. 4(c), digital zoom processing must be performed.

[0046] Digital zoom processing is used to enlarge a captured image. For example, by cropping and enlarging a portion of an image captured with a standard lens, it is possible to create an image that is intermediate between an image captured with a standard lens and an image captured with a telephoto lens.

[0047] Hereinafter, a specific example of a user operation when performing digital zoom processing in the imaging device 10 of the present disclosure will be described.

[0048] 5 to 12 show an example of a series of operations performed by a user operating the imaging device 10. FIG. In response to a user operation, the display state of the display unit 11 of the imaging device 10 transitions sequentially from (step S1) in FIG. 5 to (step S10) in FIG. The display data on the display unit 11 and the user operations in each step will be described below.

[0049] (Step S1) The display data shown in step S1 of FIG. 5 is the initial screen when the camera is started up. When the camera is started, the standard lens 12a is selected by default. In the photographed image display area 101, an image photographed using the standard lens 12 is displayed. In the lens selection section (lens selection icon) 105 of the operation section display area 102, only the standard lens selection icon (1.0) is displayed brighter or in a different color than the other lens selection icons (0.7, 2.9, 4.4) to indicate that the standard lens 12a is selected.

[0050] The user checks the image displayed in the captured image display area 101, i.e., the image captured using the standard lens 12 with a lens magnification of 1.0, and if the user decides that he or she wants to capture and record this image, he or she touches the shutter 103.

[0051] However, if you want to take a picture of a person in a slightly larger size, you can perform digital zoom. In this case, the process is as follows (step S2).

[0052] (Step S2) Step S2 in FIG. 5 is a process performed when the user wants to take a closer picture of a person and starts digital zooming.

[0053] In this case, the user touches the lens selection icon of the standard lens 12a with a lens magnification of 1.0, which is the lens selection section (lens selection icon) of the currently selected lens, and performs a process of sliding this icon.

[0054] A specific sequence of the lens selection icon sliding process will be described with reference to FIG. 6 and subsequent figures.

[0055] (Step S3) When a user operates (touches) the lens selection icon for the standard lens 12a with a lens magnification of 1.0x, the data processing unit inside the imaging device 10 detects the icon touch process and displays a digital zoom ON state identification icon 106 and a digital zoom adjustment section 107, as shown in Figure 6.

[0056] The digital zoom ON state identification icon 106 is an icon for notifying the user that the digital zoom process has been set to a state in which it is possible to perform the digital zoom process. The digital zoom adjustment section 107 is an area in which the lens selection icon can be slid, and is an area in which the digital zoom amount can be set.

[0057] The user can set the amount of digital zoom by sliding the touched lens selection icon within the digital zoom adjustment section 107.

[0058] The user touches the lens selection icon for the standard lens 12a with a lens magnification of 1.0x and slides it within the digital zoom adjustment area. This sliding process allows the user to adjust the amount of digital zoom for an image captured using the selected lens, the standard lens 12a with a lens magnification of 1.0x. This digital zoom amount adjustment process will be described with reference to FIG. 7 and subsequent figures.

[0059] (Step S4) FIG. 7 shows the display data of step S3 described with reference to FIG. 6 and the subsequent display data of step S4.

[0060] The display data in (step S3) shows the digital zoom ON state identification icon 106 and the digital zoom adjustment section 107 displayed in response to the user touching the lens selection icon for the standard lens 12a with a lens magnification of 1.0x.

[0061] Thereafter, the user slides the touched lens selection icon of the standard lens 12a with a lens magnification of 1.0 to the right within the digital zoom adjustment section 107. That is, the lens selection icon of the standard lens 12a with a lens magnification of 1.0 is slid (moved) toward the lens selection icon of the telephoto lens 12c with a lens magnification of 2.9.

[0062] In response to this slide process, the value displayed on the lens selection icon for the standard lens 12a with a lens magnification of 1.0 is changed. In step S4 of FIG. 7, the user touches and slides the lens selection icon for the standard lens 12a with a lens magnification of 1.0 to the right, and at this position, the icon displays (×1.4).

[0063] This indicates that digital zoom processing has been performed to enlarge an image captured using the standard lens 12a with a lens magnification of 1.0 to an image equivalent to an image captured using a lens with a lens magnification of 1.4.

[0064] A digitally zoomed image of an image captured with the standard lens 12a having a lens magnification of 1.0, which is touched by the user, is displayed in the captured image display area 101. In other words, an image equivalent to an image captured with a lens having a lens magnification of 1.4, is displayed.

[0065] The data processing unit of the imaging device executes image correction processing for the image captured by the standard lens 12a with a lens magnification of 1.0x, depending on the amount of sliding of the lens selection icon by the user. The data processing unit of the imaging device executes correction processing for the captured image, i.e., digital zoom processing, by extracting a partial area from the captured image and enlarging the extracted image, and displays the enlarged image in the captured image display area 101.

[0066] The image displayed in the captured image display area in FIG. 7 (step S4) is the image that has been subjected to this digital zoom processing. That is, this image is generated by extracting a partial area from the image captured by the standard lens 12a with a lens magnification of 1.0, which is the image displayed in the captured image display area in Fig. 7 (step S3), and performing digital zoom processing to enlarge the extracted image. This image corresponds to an image captured using a lens with a lens magnification of 1.4.

[0067] The user checks the image displayed in the captured image display area 101, i.e., a digital zoom image similar to an image captured using a lens with a lens magnification of 1.4x, and if the user decides that he or she wants to record this image, he or she touches the shutter 103.

[0068] However, if you want to take a picture of a person in a slightly larger size, you can further perform digital zooming. In this case, the process is as follows (step S5).

[0069] (Step S5) The display data shown in FIG. 8 shows a state in which the user has further slid the lens selection icon for the standard lens 12a with a lens magnification of 1.0 to the right within the digital zoom adjustment section 107. That is, the lens selection icon of the standard lens 12a with a lens magnification of 1.0 is slid (moved) closer to the lens selection icon of the telephoto lens 12c with a lens magnification of 2.9.

[0070] In response to this sliding process, the numerical value displayed on the lens selection icon for the standard lens 12a with a lens magnification of 1.0 is further changed. In (Step S5) of FIG. 8, the lens selection icon for the standard lens 12a with a lens magnification of 1.0, which has been touched by the user, is slid further to the right, and at this position the icon displays (×2.9).

[0071] This indicates that digital zoom processing has been performed to enlarge an image captured using the standard lens 12a with a lens magnification of 1.0 to an image equivalent to an image captured using a lens with a lens magnification of 2.9.

[0072] A digitally zoomed image of an image captured with the standard lens 12a having a lens magnification of 1.0, which is touched by the user, is displayed in the captured image display area 101. In other words, an image equivalent to an image captured with a lens having a lens magnification of 2.9, is displayed.

[0073] As described above, the data processing unit of the imaging device performs image correction processing on the image captured with the standard lens 12a with a lens magnification of 1.0, depending on the amount by which the user slides the lens selection icon. In step S5 of Fig. 8, the slide amount of the lens selection icon is larger than that in step S4 of Fig. 7 described above, and the data processing unit of the imaging device performs digital zoom processing according to this slide amount. Here, an enlarged image equivalent to an image captured using a lens with a lens magnification of 2.9 times is generated.

[0074] The image displayed in the captured image display area in FIG. 8 (step S5) is an image that has been subjected to this digital zoom processing, and corresponds to an image captured using a lens with a lens magnification of 2.9 times.

[0075] (Step S6) FIG. 9 (step S9) is a diagram illustrating a user operation when the user decides that he or she wants to record the image displayed in the captured image display area 101.

[0076] The image displayed in the captured image display area 101 of the display unit 11 of the imaging device shown in FIG. 9 (step S9) is the image displayed in the step S5 described with reference to FIG. That is, this is a digitally zoomed image of an image taken with a standard lens with a lens magnification of 1.0. This image is the same as an image taken with a lens with a lens magnification of 2.9.

[0077] The user checks this displayed image and, if he or she decides that he or she wants to record this image, touches the shutter 103 . By this touch processing, the image displayed in the captured image display area 101 is captured and recorded in memory. The image recorded in the memory is a digitally zoomed image of an image taken with a standard lens with a lens magnification of 1.0.

[0078] Furthermore, if the user wishes to take an image in which the person's face is shown in a larger close-up, the user switches lenses. As shown in FIG. 9, the lens selection icon selected and slid by the user is adjacent to the adjacent lens selection icon (×2.9) with a lens magnification of 2.9x within the digital zoom adjustment section 107, and cannot be slid any further to the right. Therefore, if you want to take a close-up image of a person's face, you switch lenses. This process will be described with reference to FIG.

[0079] (Step S7) In step S6 shown in FIG. 9, after the user captures a digitally zoomed image (an image equivalent to a lens magnification of 2.9x) of an image captured with a standard lens having a lens magnification of 1.0x, if the user wants to capture an image with a close-up of a person's face, the user switches lenses.

[0080] As shown in FIG. 10 (step S7), the user removes his / her finger from the lens selection icon of the standard lens 12a with a lens magnification of 1.0x that has been slid, and touches the lens selection icon of the adjacent telephoto lens 12c with a lens magnification of 2.9x.

[0081] When the user removes his / her finger from the lens selection icon of the standard lens 12a with a lens magnification of 1.0 after the slide process, the digital zoom ON adjustment icon 106 and the digital zoom adjustment section 107 are no longer displayed. Thereafter, the user touches the lens selection icon of the telephoto lens 12c with a lens magnification of 2.9 times.

[0082] (Step S8) The display data shown in FIG. 10 (step S8) is the display data after the user touches the lens selection icon of the telephoto lens 12c with a lens magnification of 2.9 times.

[0083] When the user touches the lens selection icon for the telephoto lens 12c with a lens magnification of 2.9x, the data processing unit inside the imaging device 10 detects the icon touch process and displays a digital zoom ON state identification icon 106 and a digital zoom adjustment section 107, as shown in Figure 10 (step S8).

[0084] The digital zoom ON state identification icon 106 is an icon for notifying the user that the digital zoom process has been set to a state in which it is possible to perform the digital zoom process. The digital zoom adjustment section 107 is an area in which the lens selection icon can be slid, and is an area in which the digital zoom amount can be set.

[0085] The user can set the amount of digital zoom by sliding the touched lens selection icon within the digital zoom adjustment section 107.

[0086] The user touches the lens selection icon for the telephoto lens 12c with a lens magnification of 2.9x and slides it within the digital zoom adjustment area. This sliding process allows the user to adjust the amount of digital zoom for an image captured using the selected telephoto lens 12c with a lens magnification of 2.9x. This digital zoom amount adjustment process will be described with reference to FIG. 11 and subsequent figures.

[0087] (Step S9) FIG. 11 shows the display data when the user slides the touched lens selection icon of the telephoto lens 12c with a lens magnification of 2.9x to the right within the digital zoom adjustment section 107. The user slides (moves) the lens selection icon for the telephoto lens 12c with a lens magnification of 2.9x toward the lens selection icon for the super telephoto lens 12d with a lens magnification of 4.4x.

[0088] In response to this slide process, the value displayed on the lens selection icon for the telephoto lens 12c with a lens magnification of 2.9 times is changed. In (Step S9) of FIG. 11, the lens selection icon of the telephoto lens 12c with a lens magnification of 2.9 times that the user touches is slid to the right, and at this position, the icon displays (×3.5).

[0089] This indicates that digital zoom processing has been performed to enlarge an image captured using the telephoto lens 12c with a lens magnification of 2.9 times to an image equivalent to an image captured using a lens with a lens magnification of 3.5 times.

[0090] A digitally zoomed image of an image captured by the telephoto lens 12c with a lens magnification of 2.9 times that is touched by the user is displayed in the captured image display area 101. In other words, an image equivalent to an image captured using a lens with a lens magnification of 3.5 times is displayed.

[0091] The data processing unit of the imaging device executes image correction processing of the image captured by the telephoto lens 12c with a lens magnification of 2.9x, depending on the amount of sliding of the lens selection icon by the user. The data processing unit of the imaging device executes correction processing on the captured image, i.e., digital zoom processing, by extracting a partial area from the captured image and enlarging the extracted image, and displays the processed image in the captured image display area 101.

[0092] The image displayed in the captured image display area in FIG. 11 (step S9) is the image that has been subjected to this digital zoom processing. That is, this image was generated by extracting a region from an image captured by the telephoto lens 12c with a lens magnification of 2.9x and performing digital zoom processing to enlarge the extracted image. This image corresponds to an image captured using a lens with a lens magnification of 3.5x.

[0093] The user checks the image displayed in the captured image display area 101, i.e., a digital zoom image similar to an image captured using a lens with a lens magnification of 3.5x, and if the user decides that he or she wants to record this image, he or she touches the shutter 103.

[0094] (Step S10) FIG. 12 (step S10) shows a state in which the user touches the shutter 103. That is, it is a diagram for explaining a user operation when the user decides that he or she wants to record the image displayed in the captured image display area 101.

[0095] The image displayed in the captured image display area 101 of the display unit 11 of the imaging device 10 shown in FIG. 12 (step S10) is the image displayed in the step S9 described with reference to FIG. That is, this is a digitally zoomed image of an image taken with a telephoto lens with a lens magnification of 2.9. This image is the same as an image taken with a lens with a lens magnification of 3.5.

[0096] The user checks this displayed image and, if he or she decides that he or she wants to record this image, touches the shutter 103 . By this touch processing, the image displayed in the captured image display area 101 is captured and recorded in memory. The image recorded in the memory is a digitally zoomed image of an image taken with a telephoto lens with a lens magnification of 2.9 times.

[0097] In this way, the imaging device 10 of the present disclosure displays lens selection sections (lens selection icons) 105 for selecting a lens to be used for shooting in the operation section display area 102 of the display section 11. Furthermore, when the user touches one of the lens selection sections (lens selection icons) 105, a digital zoom adjustment section 107 is displayed in which the selected lens selection section (lens selection icon) can be slid.

[0098] Thereafter, when the user slides the selected lens selection section (lens selection icon) within the digital zoom adjustment section 107, the value of the lens magnification corresponding to the virtual lens used realized by the digital zoom processing is displayed within the lens selection icon.

[0099] Furthermore, a captured image (through image) captured using a selected lens corresponding to a lens selection section (lens selection icon) 105 selected by the user is displayed in the captured image display area 101 of the display unit 11. Furthermore, when the user slides the selected lens selection section (lens selection icon) within the digital zoom adjustment section 107, an image that has been subjected to digital zoom processing, i.e., enlargement processing, according to the amount of sliding is displayed.

[0100] By performing these processes, the user can take an ideal subject image of the user and record it in memory simply by selecting the lens selection section (lens selection icon) 105 and performing the slide process.

[0101] In other words, the user does not need to switch the UI of the operation unit when performing two processes, lens selection process and digital zoom process, and these two processes can be performed consecutively by operating the same icon, eliminating the need for processing time such as UI switching, and allowing for shooting processes that do not miss a photo opportunity.

[0102] An example of a user's operation on the lens selection section (lens selection icon) 105 and transition of display data on the operation section in response to the user's operation will be described below with reference to FIGS.

[0103] FIG. 13 shows the range in which the wide-angle lens selection section 105b can slide. When the user touches the wide-angle lens selection section 105b, a digital zoom adjustment section 107 corresponding to the slidable section of the wide-angle lens selection section 105b is displayed.

[0104] The digital zoom adjustment range 107, which corresponds to the sliding range of the wide-angle lens selection section 105b, is the range from the wide-angle lens selection section 105b (min) at the left end (p1) shown in FIG. 13 to the wide-angle lens selection section 105b (max) at the right end (p2) shown in FIG. 13, and the wide-angle lens selection section 105b is slidable within this range (p1 to p2).

[0105] When the wide-angle lens selection section 105b is slid within this slidable section (p1 to p2), the displayed numerical value of the wide-angle lens selection section 105b is updated sequentially. The displayed value in the wide-angle lens selection section 105b indicates the virtual lens magnification when capturing a photographed image or a digitally zoomed image. The displayed value is updated sequentially from 0.7 to 1.0.

[0106] Of the numerical values ​​(0.7 to 1.0) displayed at each slide position, the position "0.7" (p1) is the position of the leftmost wide-angle lens selection section 105b (min), and the position where the slide amount of the wide-angle lens selection section 105b is 0.

[0107] At the position of the wide-angle lens selection section 105b (min) on the left end, the captured image display area 101 displays the image captured by the wide-angle lens 12b with a lens magnification of 0.7. That is, as shown in (b(min)) in the lower part of FIG. 13, the image captured by the wide-angle lens 12b itself, that is, the image captured without digital zoom processing, is displayed.

[0108] On the other hand, when the wide-angle lens selection section 105b is slid to a position other than the leftmost wide-angle lens selection section 105b(min), the value displayed in the wide-angle lens selection section 105b is greater than 0.7 and less than or equal to 1.0. When the wide-angle lens selection section 105b(max) is positioned at the rightmost position (p2) shown in FIG. 13, the maximum lens magnification = 1.0 is displayed.

[0109] During these periods when the wide-angle lens selection section 105b is slid, the digitally zoomed image is displayed in the captured image display area 101. That is, a digitally zoomed image is displayed, which is a corrected version of the image captured by the wide-angle lens 12b with a lens magnification of 0.7. This digitally zoomed image is a corrected image obtained by cutting out and enlarging a portion of the image captured by the wide-angle lens 12b with a lens magnification of 0.7.

[0110] When the wide-angle lens selection section 105b is slid to the position (p2) of the wide-angle lens selection section 105b(max) on the right side, a digitally zoomed image such as that shown in the lower part of Figure 13 (b(max)) is displayed in the captured image display area 101. That is, a corrected image generated by digital zoom processing of an image captured by the wide-angle lens 12b with a lens magnification of 0.7 is displayed. Specifically, a corrected digital zoom image similar to an image captured using a virtual lens with a lens magnification of 1.0 is displayed.

[0111] FIG. 14 shows the slidable range of the standard lens selection section 105a. When the user touches the standard lens selection section 105a, a digital zoom adjustment section 107 corresponding to the slidable section of the standard lens selection section 105a is displayed.

[0112] The digital zoom adjustment range 107, which corresponds to the sliding range of the standard lens selection section 105a, is the range from the standard lens selection section 105a (min) at the left end (p3) shown in FIG. 14 to the standard lens selection section 105a (max) at the right end (p4) shown in FIG. 14, and the standard lens selection section 105a is slidable in this range (p3 to p4).

[0113] When the standard lens selection section 105a is slid within this slidable section (p3 to p4), the displayed numerical value of the standard lens selection section 105a is updated sequentially. The displayed value in the standard lens selection section 105a indicates the virtual lens magnification when capturing a photographed image or a digitally zoomed image. The displayed value is updated sequentially from 1.0 to 2.9.

[0114] Of the numerical values ​​(1.0 to 2.9) displayed at each slide position, the "1.0" position (p3) is the position of the leftmost standard lens selection section 105a (min), and is the position where the slide amount of the standard lens selection section 105a is 0.

[0115] At the position of the standard lens selection section 105a (min) on the left end, the captured image display area 101 displays the image captured by the standard lens 12a with a lens magnification of 1.0. That is, as shown in (a(min)) in the lower part of FIG. 14, the image captured by the standard lens 12a is displayed as it is, without undergoing digital zoom processing.

[0116] On the other hand, when the standard lens selection section 105a is slid to a position other than the leftmost standard lens selection section 105a(min), the numerical value displayed in the standard lens selection section 105a is greater than 1.0 and less than or equal to 2.9. When the standard lens selection section 105a is positioned at the rightmost (p4) standard lens selection section 105a(max) shown in FIG. 14, the maximum lens magnification = 2.9 is displayed.

[0117] During these periods when the standard lens selection section 105a is slid, the digitally zoomed image is displayed in the photographed image display area 101. That is, a digitally zoomed image is displayed, which is a corrected version of the image captured with the standard lens 12a having a lens magnification of 1.0. This digitally zoomed image is a corrected image obtained by cutting out and enlarging a portion of the image captured with the standard lens 12a having a lens magnification of 1.0.

[0118] When the standard lens selection section 105a is slid to the rightmost standard lens selection section 105a(max) position (p4), a digitally zoomed image such as that shown in the lower part of Figure 14 (a(max)) is displayed in the captured image display area 101. That is, a corrected image generated by digital zoom processing of an image captured with the standard lens 12a having a lens magnification of 1.0 is displayed. Specifically, a corrected digital zoom image similar to an image captured using a virtual lens having a lens magnification of 2.9 is displayed.

[0119] FIG. 15 shows the slidable range of the telephoto lens selection section 105c. When the user touches the telephoto lens selection section 105c, a digital zoom adjustment section 107 corresponding to the slidable section of the telephoto lens selection section 105c is displayed.

[0120] The digital zoom adjustment range 107, which corresponds to the range in which the telephoto lens selection section 105c can slide, is the range from the telephoto lens selection section 105c (min) at the left end (p5) shown in FIG. 15 to the telephoto lens selection section 105c (max) at the right end (p6) shown in FIG. 15, and the telephoto lens selection section 105c can slide in this range (p5 to p6).

[0121] When the telephoto lens selection section 105c is slid within this slidable section (p5 to p6), the displayed numerical value of the telephoto lens selection section 105c is updated sequentially. The displayed value in the telephoto lens selection section 105c indicates the virtual lens magnification when capturing a photographed image or a digitally zoomed image. The displayed value is updated sequentially from 2.9 to 4.4.

[0122] Of the numerical values ​​(2.9 to 4.4) displayed at each slide position, the "2.9" position (p5) is the position of the leftmost telephoto lens selection section 105c (min), and is the position where the slide amount of the telephoto lens selection section 105c is 0.

[0123] At the position of the telephoto lens selection section 105c(min) on the left end, the captured image display area 101 displays the image captured by the telephoto lens 12c with a lens magnification of 2.9. That is, as shown in (c(min)) in the lower part of FIG. 15, the image captured by the telephoto lens 12c itself, that is, the image captured without digital zoom processing, is displayed.

[0124] On the other hand, when the telephoto lens selection section 105c is slid to a position other than the leftmost telephoto lens selection section 105c(min), the numerical value displayed in the telephoto lens selection section 105c is greater than 2.9 and less than or equal to 4.4. When the telephoto lens selection section 105c(max) is positioned at the rightmost position (p6) shown in FIG. 15, the maximum lens magnification = 4.4 is displayed.

[0125] During these intervals when the telephoto lens selection section 105c is slid, the digitally zoomed image is displayed in the captured image display area 101. That is, a digitally zoomed image is displayed, which is a corrected version of the image captured by the telephoto lens 12c with a lens magnification of 2.9. This digitally zoomed image is a corrected image obtained by cropping and enlarging a portion of the image captured by the telephoto lens 12c with a lens magnification of 2.9.

[0126] When the telephoto lens selection section 105c is slid to the position (p6) of the rightmost telephoto lens selection section 105c(max), a digitally zoomed image such as that shown in the lower part of Figure 15 (c(max)) is displayed in the captured image display area 101. That is, a corrected image generated by digital zoom processing of an image captured by the telephoto lens 12c with a lens magnification of 2.9 is displayed. Specifically, a corrected digital zoom image similar to an image captured using a virtual lens with a lens magnification of 4.4 is displayed.

[0127] FIG. 16 shows the range in which the super telephoto lens selection section 105d can slide. When the user touches the super telephoto lens selection section 105d, a digital zoom adjustment section 107 corresponding to the slidable section of the super telephoto lens selection section 105d is displayed.

[0128] The digital zoom adjustment range 107, which corresponds to the sliding range of the super telephoto lens selection section 105d, is the range from the super telephoto lens selection section 105d (min) at the left end (p7) shown in FIG. 16 to the super telephoto lens selection section 105d (max) at the right end (p8) shown in FIG. 16, and the super telephoto lens selection section 105d is slidable within this range (p7 to p8).

[0129] When the super telephoto lens selection section 105d is slid within this slidable section (p7 to p8), the displayed numerical value of the super telephoto lens selection section 105d is updated sequentially. The displayed value in the super telephoto lens selection section 105d is a value indicating the virtual lens magnification when capturing a photographed image or a digitally zoomed image. The displayed value is updated sequentially from 4.4 to 8.3.

[0130] Of the numerical values ​​(4.4 to 8.3) displayed at each slide position, the "4.4" position (p7) is the position of the leftmost super telephoto lens selection section 105d (min), and the slide amount of the super telephoto lens selection section 105d is 0.

[0131] At the position of the super telephoto lens selection section 105d(min) on the left end, the captured image display area 101 displays the image captured by the super telephoto lens 12d with a lens magnification of 4.4. That is, as shown in (d(min)) in the lower part of FIG. 16, the image captured by the super telephoto lens 12d itself, that is, the image captured without digital zoom processing, is displayed.

[0132] On the other hand, when the super telephoto lens selection section 105d is slid to a position other than the leftmost super telephoto lens selection section 105d(min), the value displayed in the super telephoto lens selection section 105d is greater than 4.4 and less than or equal to 8.3. When the super telephoto lens selection section 105d(max) is positioned at the rightmost position (p8) shown in Figure 16, the maximum lens magnification = 8.3 is displayed.

[0133] In these sections where the super telephoto lens selection section 105d is slid, the digitally zoomed image is displayed in the captured image display area 101. That is, a digitally zoomed image is displayed that is a corrected version of the image captured by the super telephoto lens 12d with a lens magnification of 4.4. This digitally zoomed image is a corrected image that is obtained by cropping and enlarging a portion of the image captured by the super telephoto lens 12d with a lens magnification of 4.4.

[0134] When the super telephoto lens selection section 105d is slid to the position (p8) of the super telephoto lens selection section 105d(max) on the right side, a digitally zoomed image such as that shown in the lower part of Figure 16 (d(max)) is displayed in the captured image display area 101. That is, a corrected image generated by digital zoom processing of an image captured by the super telephoto lens 12d with a lens magnification of 4.4x is displayed. Specifically, a corrected digital zoom image similar to an image captured using a virtual lens with a lens magnification of 8.3x is displayed.

[0135] 3. Operation Unit UI Display Control Processing Sequence Executed by the Imaging Device of the Present Disclosure Next, an operation unit UI display control process sequence executed by the imaging device of the present disclosure will be described.

[0136] The operation unit UI display control process sequence executed by the imaging device of the present disclosure will be described with reference to the flowchart shown in FIG.

[0137] 17 can be executed in a data processing unit of the imaging device 10 in accordance with a program stored in a storage unit of the imaging device 10. The data processing unit has a processor such as a CPU having a program execution function, and can perform processing in accordance with the flow by program execution processing using the processor. The processing of each step shown in the flowchart of FIG. 17 will be described below.

[0138] (Step S101) First, in step S101, the data processing unit of the imaging device 10 determines whether or not a user touch has been detected on the lens selection unit (lens selection icon) 105 displayed in the operation unit display area 102 of the display unit 11 of the imaging device 10.

[0139] If it is determined that a user touch process on the lens selection section (lens selection icon) 105 has been detected, the process proceeds to step S102.

[0140] On the other hand, in step S101, if a user touch process on the lens selection section (lens selection icon) 105 is not detected, for example, if it is detected that the user has removed his / her finger from the lens selection section 105, the process proceeds to step S107, where it is determined whether or not a user operation (touch) of the shutter 103 has been detected. If a shutter operation (touch) by the user is not detected, the process returns to step S101. On the other hand, if a shutter operation (touch) by the user is detected, the process proceeds to step S108, where image capture is performed and the captured image is recorded in memory.

[0141] (Step S102) If it is determined in step S101 that a user touch on the lens selection section (lens selection icon) 105 has been detected, the data processing section of the imaging device 10 performs a process in step S102 to switch the image capturing lens to the lens touched by the user, i.e., the lens selected by the user.

[0142] For example, if the lens selection section (lens selection icon) touched by the user is the icon for a telephoto lens (lens magnification = 2.9 times), processing is performed to switch the photographing lens to the telephoto lens. This state corresponds to, for example, the state (step S7) in FIG. 10 described above.

[0143] (Step S103) Next, in step S103, the data processing unit of the imaging device 10 displays a digital zoom ON state identification icon 106 on the display unit 11 of the imaging device 10, and further displays a digital zoom adjustment section 107 along which the touched lens selection section can be slid.

[0144] This state corresponds to, for example, the state (step S8) in FIG. 10 described above.

[0145] (Step S104) Next, in step S104, the data processing unit of the imaging device 10 detects whether the touched lens selection unit has been slid by the user.

[0146] If it is detected that the lens selection section has been slid by the user, the process proceeds to step S105.

[0147] On the other hand, if the lens selection section has not been slid by the user, the process returns to step S101, and the following processing is executed.

[0148] The processes (a) to (c2) described below are processes that are executed when it is determined in step S104 that the lens selection section has not been slid by the user. (a) Returning to step S101, it is determined whether a new touch on the lens selection section by the user has been detected. (b1) In step S101, if it is determined that a new touch on the lens selection section by the user has been detected, the process proceeds to step S102. (b2) On the other hand, if a new user touch process on the lens selection section (lens selection icon) 105 is not detected in step S101, for example, if it is detected that the user has removed his / her finger from the lens selection section 105, the process proceeds to step S107, where it is determined whether or not a user operation (touch) of the shutter 103 has been detected. (c1) If a shutter operation (touch) by the user is not detected, the process returns to step S101. (c2) On the other hand, if a shutter operation (touch) by the user is detected, the process proceeds to step S108, where image capture is performed and the captured image is recorded in memory.

[0149] In this way, if it is determined in step S104 that the touched lens selection section has not been slid by the user, the above processes (a) to (c2) are executed. On the other hand, if it is detected in step S104 that the lens selection section has been slid by the user, the process proceeds to step S105. The processing from step S105 onwards will be explained below.

[0150] (Steps S105 to S106) In step S104, if a slide process by the user on the lens selection section (lens selection icon) 105 is detected, the data processing section of the imaging device 10 executes the following processes in steps S105 and S106.

[0151] In step S105, the data processing unit of the imaging device 10 performs digital zoom processing (enlargement processing) of the captured image according to the amount by which the user slides the lens selection unit (lens selection icon), and displays the digitally zoomed image in the captured image display area 101 of the display unit 11.

[0152] Furthermore, in step S106, the data processing unit of the imaging device 10 executes processing to update the lens magnification displayed in the lens selection section (lens selection icon) slid by the user to a numerical value according to the slide amount (digital zoom processing amount).

[0153] The state in which steps S105 and S106 have been executed corresponds to, for example, the state (step S9) in FIG. 11 described above. The process of step S105 and the process of step S106 may be executed in parallel.

[0154] After the processing of steps S105 and S106, the process returns to step S101, and it is determined whether a new touch on the lens selection section by the user has been detected.

[0155] If it is determined that a new touch on the lens selection section by the user has been detected, the process proceeds to step S102. On the other hand, if a new user touch process on the lens selection section (lens selection icon) 105 is not detected, the process proceeds to step S107. For example, if it is detected that the user's finger has been removed from the lens selection section (lens selection icon) 105, the process proceeds to step S107.

[0156] (Step S107) The processing of step S107 is executed when a user touch processing on the lens selection section (lens selection icon) 105 is not detected in step S101, for example, when it is detected that the user's finger has been removed from the lens selection section 105.

[0157] In this case, in step S107, the data processing unit of the imaging device 10 determines whether or not a touch of the shutter 103 by the user has been detected.

[0158] If a shutter operation (touch) by the user is not detected, the process returns to step S101. On the other hand, if a shutter operation (touch) by the user is detected, the process proceeds to step S108.

[0159] (Step S108) If a shutter operation (touch) by the user is detected in step S107, the data processing unit of the imaging device 10 performs image capture in step S108 and records the captured image in memory.

[0160] This image capturing process corresponds to, for example, the image capturing process (step S6) in FIG. 9 or the image capturing process (step S10) in FIG. 12 described above.

[0161] As described above, the imaging device 10 of the present disclosure displays lens selection sections (lens selection icons) 105 for selecting the lens to be used for shooting in the operation section display area 102 of the display section 11, and when the user touches one of the lens selection sections (lens selection icons) 105, displays a digital zoom adjustment section 107 that allows the selected lens selection section (lens selection icon) to be slid.

[0162] Furthermore, when the user slides the selected lens selection section (lens selection icon) within the digital zoom adjustment section 107, the value of the lens magnification corresponding to the virtual lens used realized by the digital zoom processing is displayed within the lens selection icon.

[0163] Furthermore, a captured image (through image) captured using a selected lens corresponding to a lens selection section (lens selection icon) 105 selected by the user is displayed in the captured image display area 101 of the display unit 11. Furthermore, when the user slides the selected lens selection section (lens selection icon) within a digital zoom adjustment section 107, an image that has been subjected to digital zoom processing according to the amount of slide is displayed.

[0164] By performing these processes, the user can take an ideal subject image of the user and record it in memory simply by selecting the lens selection section (lens selection icon) 105 and performing the slide process.

[0165] [4. Display control process to notify the user of image quality degradation due to digital zoom] Next, a display control process for notifying the user of degradation in image quality due to digital zoom executed by the imaging device 10 of the present disclosure will be described.

[0166] As mentioned above, digital zooming is performed to enlarge a captured image. For example, by cropping and enlarging a portion of an image captured with a standard lens, it is possible to generate an image that is intermediate between an image captured with a standard lens and an image captured with a telephoto lens.

[0167] A specific example of image enlargement processing in digital zoom processing will be described with reference to FIG. Figure 18 shows an image (min) captured by setting the standard lens selection unit 105a to the left end (p3) position (lens magnification = 1.0) of the sliding section, and an image (max) captured by setting the standard lens selection unit 105a to the right end (p4) position (lens magnification = 2.9) of the sliding section.

[0168] The image (min) captured with the standard lens selection section 105a set to the left end (p3) of the slide section (lens magnification = 1.0) is the "image (min)" in the bottom row. This is the image captured with the standard lens 12a, and is an image that has not been subjected to digital zoom processing.

[0169] On the other hand, the image (max) captured with the standard lens selection unit 105a set to the right end (p4) of the slide section (lens magnification = 2.9) is the "captured image (max)" in the bottom row. This is a digitally zoomed image of the image captured with the standard lens 12a. That is, the "photographed image (max)" shown on the right side of the lower part of FIG. 18 is generated by cutting out and enlarging the dotted rectangular area of ​​the "photographed image (min)" shown on the left side of the lower part of FIG.

[0170] In this way, the digitally zoomed image can be generated by enlarging a partial area of ​​the original image, that is, a photographed image that has not been subjected to digital zoom processing, at a magnification rate that corresponds to the amount of digital zoom.

[0171] If the number of pixels in a captured image that does not undergo any enlargement processing, for example, the "captured image (min)", is "n x m", the number of pixels in the dotted image area extracted in digital zoom processing is less than "n x m", for example, "s x t". In other words, a digitally zoomed image generated with enlargement processing is created by taking data from an s x t pixel area extracted by digital zoom processing from an n x m pixel area input from the image sensor and supplementing it with data from neighboring pixels to create an n x m pixel image, resulting in a loss of image quality and resolution compared to an image saved from the original n x m pixels without digital zooming.

[0172] The bottom right of Figure 19 shows the following two images: (Image A) An image taken with the standard lens selection section 105a set to the right end (p4) position of the slide section (lens magnification = 2.9) (Image B) An image of the telephoto lens selection section 105c taken without a slide

[0173] (Image A) is a digitally zoomed image. That is, it is a digitally zoomed image generated by cutting out and enlarging the dotted rectangular area of ​​the "photographed image (min)" shown in the lower left of Figure 19, which was taken with the standard lens selection section 105a set to 1.0 (lens magnification) without sliding. On the other hand, (Image B) is an image taken of the telephoto lens selection section 105c without a slide, and is an image that has not been subjected to digital zoom processing.

[0174] Both (Image A) and (Image B) correspond to images taken using a lens with a lens magnification of 2.9 times, and the image angle of view and subject size are the same. However, (Image A) is a digital zoom image created by cutting out and enlarging a partial area (s×t pixels) of the original captured image (n×m pixels), and is an image generated based on pixel data of s×t pixels, which is less than n×m pixels. On the other hand, (Image B) has not been subjected to digital zoom processing (enlargement processing) and has a data amount equivalent to the number of constituent pixels (n×m pixels) of the original captured image.

[0175] That is, the image (image A) that has undergone digital zoom processing (enlargement processing) is an image that has been generated based on less pixel data than the image (image B) that has not undergone digital zoom processing (enlargement processing). As a result, the image A to which digital zoom processing (enlargement processing) has been applied has lower image quality than the image B to which digital zoom processing has not been applied.

[0176] However, users often take digitally zoomed images without noticing this degradation in image quality. Especially on small screens such as smartphones, the degradation in image quality cannot be clearly recognized, so people tend to use digital zoom frequently.

[0177] The embodiment described below is an embodiment in which display control is performed to notify the user of degradation in image quality due to digital zoom processing.

[0178] The imaging device 10 of the present disclosure executes a display process in the operation unit display area 102 of the display unit 11 to notify the user of degradation in image quality due to digital zoom processing. Below, examples of a plurality of display data for notifying degradation of image quality will be described.

[0179] FIG. 20 is a diagram showing an example of display data for notifying of deterioration in image quality due to digital zoom processing.

[0180] FIG. 20 shows states (a), (b), and (c) in which the user slides the standard lens selection section 105a from the leftmost position (lens magnification=1.0) to the right.

[0181] (a) shows the state in which the standard lens selection unit 105a is set to the left end position of the slide section (lens magnification = 1.0). In other words, the slide amount = 0, and the image captured at this position is not subjected to digital zoom processing. When the standard lens selection unit 105a is in this position (the left end of the sliding section), the data processing unit of the imaging device 10 of the present disclosure sets the output light of the standard lens selection unit 105a to white. By setting the output light of the standard lens selection unit 105a to white, the user is notified that the digital zoom amount is 0 and there is no degradation in image quality.

[0182] (b) shows the state in which the standard lens selection section 105a has been slid from the leftmost position (lens magnification = 1.0) to the right, to approximately the center of the slide section. In other words, the amount of sliding is approximately 1 / 2 of the slide section. The image captured at this position is an image that has been digitally zoomed, i.e., cropped and enlarged. However, the magnification is small, so the level of image quality degradation is small. When the standard lens selection unit 105a is in this position (approximately the center of the slide section), the data processing unit of the imaging device 10 of the present disclosure outputs yellow light. By setting the output light of the standard lens selection unit 105a to yellow, the user is notified that the amount of digital zoom is small, but that a small degradation in image quality will occur.

[0183] (c) shows the state in which the standard lens selection section 105a has been slid further to the right, almost to the right end of the slide section. In other words, the amount of sliding is almost the entire slide section. The image captured at this position is an image that has been digitally zoomed, i.e., cropped and enlarged, resulting in a large magnification ratio and a large level of image quality degradation. When the standard lens selection unit 105a is in this position (almost at the right end of the sliding section), the data processing unit of the imaging device 10 of the present disclosure outputs red light. By setting the output light of the standard lens selection unit 105a to red, the user is notified that the amount of digital zoom is large and that a large degradation in image quality will occur.

[0184] In this way, the data processing unit of the imaging device 10 according to the present disclosure executes display control to change the output light of the lens selection unit 105 according to the sliding amount of the lens selection unit 105. By performing such display control, it becomes possible to notify the user of the digital zoom amount and the image quality degradation level according to the sliding amount of the lens selection unit 105. This process allows the user to take measures such as switching the lens to another lens when the degradation in image quality is significant.

[0185] FIG. 21 is a diagram showing an example of different display data notifying of degradation in image quality due to digital zoom processing.

[0186] As in FIG. 20, FIG. 21 also shows states (a), (b), and (c) in which the user slides the standard lens selection section 105a from the leftmost position (lens magnification=1.0) to the right.

[0187] (a) shows a state in which the standard lens selection section 105a is set to the left end position of the slide section (lens magnification=1.0). (b) shows the state in which the standard lens selection section 105a has been slid from the leftmost position (lens magnification=1.0) to the right and moved to approximately the center of the sliding section. (c) shows the state in which the standard lens selection section 105a has been slid further to the right and moved to almost the right end of the sliding section. These are the three states.

[0188] In (a), the data processing unit of the imaging device 10 of the present disclosure sets the output light of the standard lens selection unit 105a to white. By setting the output light of the standard lens selection unit 105a to white, the user is notified that the digital zoom amount is 0 and there is no degradation in image quality. This display control process is the same as that shown in FIG.

[0189] In the state (b), the standard lens selection section 105a outputs yellow light and also changes its shape, that is, changes the shape of the standard lens selection section 105a to a rounded rectangular shape. In the state (c), the output light of the standard lens selection unit 105a is set to red, and the shape is changed to rectangular.

[0190] The example shown in FIG. 21 is a configuration in which display control processing is performed to change the shape of the standard lens selection section 105a in conjunction with changing the color of the output light of the standard lens selection section 105a. By performing such display control, it is possible to notify the user of the digital zoom amount and the image quality degradation level corresponding to the slide amount of the lens selection unit 105 in an easy-to-understand manner.

[0191] Furthermore, as shown in FIG. 22, a display control may be performed in which the size is changed in accordance with the change in color and shape of the output light from the standard lens selection unit 105a.

[0192] Figure 22 also shows the following three states. (a) shows a state in which the standard lens selection section 105a is set to the left end position of the slide section (lens magnification=1.0). (b) shows the state in which the standard lens selection section 105a has been slid from the leftmost position (lens magnification=1.0) to the right and moved to approximately the center of the sliding section. (c) shows the state in which the standard lens selection section 105a has been slid further to the right and moved to almost the right end of the sliding section.

[0193] In the state (a), the output light of the standard lens selection unit 105a is set to white. By setting the output light of the standard lens selection unit 105a to white, the user is notified that the digital zoom amount is 0 and there is no degradation in image quality. This display control process is the same as that shown in FIG.

[0194] In the state (b), the standard lens selection section 105a outputs yellow light, has a rounded angular shape, and is made larger in size. In the state (c), the output light of the standard lens selection section 105a is set to red, the shape is changed to a rectangular shape, and the size of the standard lens selection section 105a is made larger than in the state (b).

[0195] The example shown in FIG. 22 is a configuration for performing display control processing to change the size in accordance with changes in the color and shape of the output light from the standard lens selection unit 105a. By performing such display control, it is possible to notify the user of the digital zoom amount and the image quality degradation level corresponding to the slide amount of the lens selection unit 105 in an easy-to-understand manner.

[0196] Furthermore, as shown in FIG. 23, a configuration may be adopted in which notification is made by vibration. FIG. 23 also shows the following three states. (a) shows a state in which the standard lens selection section 105a is set to the left end position of the slide section (lens magnification=1.0). (b) shows the state in which the standard lens selection section 105a has been slid from the leftmost position (lens magnification=1.0) to the right and moved to approximately the center of the sliding section. (c) shows the state in which the standard lens selection section 105a has been slid further to the right and moved to almost the right end of the sliding section.

[0197] In the state (a), vibration processing is not performed. By not vibrating, the user is notified that the digital zoom amount is 0 and there is no degradation in image quality.

[0198] In the (b) state, a weak vibration is generated. In the (c) state, a strong vibration is generated. In this way, the presence or absence of vibration and the strength of the vibration are controlled to notify the user of the amount of digital zoom and the level of image quality degradation corresponding to the amount of sliding of the lens selection unit 105.

[0199] Furthermore, as shown in FIG. 24, a melody may be output to notify the user. FIG. 24 also shows the following three states. (a) shows a state in which the standard lens selection section 105a is set to the left end position of the slide section (lens magnification=1.0). (b) shows the state in which the standard lens selection section 105a has been slid from the leftmost position (lens magnification=1.0) to the right and moved to approximately the center of the sliding section. (c) shows the state in which the standard lens selection section 105a has been slid further to the right and moved to almost the right end of the sliding section.

[0200] In the state (a), the melody output process is not performed. By not outputting a melody, the user is notified that the digital zoom amount is 0 and there is no degradation in image quality.

[0201] In the state (b), a softer melody is output. In the state (c), a stronger melody is output. In this way, the user is notified of the amount of digital zoom and the level of image quality degradation according to the amount of sliding of the lens selection unit 105 by controlling whether or not a melody is output and the strength of the output sound.

[0202] [5. Other display control processing examples] Next, another example of display control processing different from the above-described embodiment will be described.

[0203] The following four examples of display control processing will be explained in order. (a) Example of processing that allows the use of a digital zoom adjustment icon that is independent of the lens selection section (b) Example of processing to output a message indicating that digital zoom is ON (c) An example of a process that allows the lens selection section and the slide section to be displayed and used independently. (d) Example of display processing for zoom adjustment section in a device with a configuration capable of optical zoom

[0204] (a) Example of a process that allows the use of a digital zoom adjustment icon that is separate from the lens selection section. First, with reference to FIG. 25, "(a) Example of processing in which an icon for adjusting digital zoom independent of the lens selection section is displayed and made available" will be described.

[0205] 25, the lens selection unit 105 displays a slidable digital zoom adjustment range 107, and also displays a zoom amount decrease instruction icon (W) 121 for decreasing the digital zoom amount and a zoom amount increase instruction icon (T) 122 for increasing the digital zoom amount on the left and right of the digital zoom adjustment range 107. Note that "W" stands for "wide" and "T" stands for "tele."

[0206] The user can adjust the amount of digital zoom by sliding the lens selection section 105 within the digital zoom adjustment section 107, but can also adjust the amount of digital zoom by touching the zoom amount down instruction icon (W) 121 or the zoom amount up instruction icon (T) 122.

[0207] When the user touches the zoom amount decrease instruction icon (W) 121, the lens selection section 105 moves to the left within the digital zoom adjustment section 107, and the digital zoom amount can be decreased. Furthermore, when the user touches the zoom amount increase instruction icon (T) 122, the lens selection unit 105 moves to the right within the digital zoom adjustment section 107, and the digital zoom amount can be increased.

[0208] (b) Example of processing to output a message indicating that digital zoom is ON) Next, with reference to FIG. 26, "(b) Example of processing for outputting a message indicating that digital zoom is ON" will be described.

[0209] When the data processing unit of the imaging device 10 detects a user touch on the lens selection unit (lens selection icon) 105, it displays a digital zoom ON state identification icon 106 and a digital zoom adjustment range 107, as shown in FIG. Furthermore, a digital zoom ON state notification message 125 is displayed.

[0210] The digital zoom ON state notification message 125 may include, for example, "Digital zoom is ON" The message is something like this. This message output allows the user to reliably check the processing status of the digital zoom.

[0211] (c) An example of a process that allows the lens selection section and a separate slide section to be displayed and used. Next, with reference to FIG. 27, "(c) Example of processing in which a slide section independent of the lens selection section is displayed and made available" will be described.

[0212] When the data processing unit of the imaging device 10 detects a user touch on the lens selection unit (lens selection icon) 105, it displays a digital zoom ON state identification icon 106 and a digital zoom adjustment range 107, as shown in FIG.

[0213] However, in this processing example, the lens selection section (lens selection icon) 105 and digital zoom adjustment section 107 touched by the user are displayed in a position different from the other lens selection sections (lens selection icons) 105, as shown in FIG.

[0214] Such display processing allows the user to more clearly distinguish between selected and unselected lenses.

[0215] ((d) Example of display processing for zoom adjustment section in a device with optical zoom capability) Next, an example of display processing of a zoom adjustment section in a device having a configuration capable of optical zoom will be described.

[0216] In the above-described embodiment, a device such as a smartphone that does not have a zoom lens has been described. As described above, a device such as a smartphone that does not have a zoom lens performs digital zoom processing when generating an intermediate image between an image captured with a standard lens and an image captured with a telephoto lens.

[0217] However, optical zoom can also be achieved in thin devices such as smartphones by using a configuration that bends the optical axis using, for example, a prism, etc. Specifically, by implementing a periscope-type lens system (bending optical system) that bends the optical axis using a prism, optical zoom can also be achieved in thin devices such as smartphones.

[0218] For example, it is conceivable that only one or two of the four types of lenses described in the above-mentioned embodiments, i.e., wide-angle lens, standard lens, telephoto lens, and super telephoto lens, are periscope-type optical zoom compatible lenses. In the above-described embodiment, if the telephoto lens 12c with a lens magnification of 2.9x is a lens compatible with periscope-type optical zoom, it is possible to capture clear images using optical zoom in the range corresponding to lens magnifications of 2.9x to 4.4x without performing digital zoom at all.

[0219] When the camera is configured to be capable of such optical zoom processing, it is preferable to display a message informing the user that an image will be captured using optical zoom. A display configuration that enables such notification will be described with reference to FIG.

[0220] FIG. 28 shows an example of displaying the following two slidable sections. (A) Slidable section of the standard lens selection section 105a (B) Slidable section of the telephoto lens selection section 105c

[0221] It is assumed that the standard lens 12a is not a periscope-type lens compatible with optical zoom, and the telephoto lens 12c is a periscope-type lens compatible with optical zoom, and is capable of optical zoom.

[0222] In this case, the sliding range (p3 to p4) of the standard lens selection section 105a shown in Figure 28(A) is displayed as a digital zoom adjustment range in which digital zoom images equivalent to lens magnifications of 1.0 to 2.9 times can be captured, as previously described with reference to Figure 14.

[0223] In contrast, in the sliding section of the telephoto lens selection section 105c corresponding to the telephoto lens 12c, which is a periscope-type lens compatible with optical zoom and capable of optical zoom, "optical zoom enabled section identification data 151" is additionally displayed as shown in Figure 28(B). By looking at this "optical zoom enabled section identification data 151", the user can recognize that a clear image will be captured using optical zoom.

[0224] 29, an optical zoom ON state identification icon 152 may be displayed on the display unit 11. By checking this optical zoom ON state identification icon 152, the user can recognize that a clear image will be captured using optical zoom.

[0225] In the example described with reference to Figures 28 and 29, the telephoto lens 12c is an optically zoomable lens and the standard lens 12a is an optically zoomable lens, but all lenses or only some of the lenses may be optically zoomable lenses.

[0226] For example, it is possible to configure all lenses as optical zoom lenses. In this case, optical zoom enabled section identification data 151 as shown in Fig. 28(B) is displayed in the slidable sections of all lens selection sections. In addition, an optical zoom ON state identification icon 152 as shown in Fig. 29 is also displayed.

[0227] Furthermore, even with periscope-type optical zoom lenses, some are configured so that optical zoom is only possible at specific lens magnification points. In such cases, it is necessary to notify the user at which positions optical zoom is possible. FIG. 30 is a diagram showing an example of display data that can notify the user of positions where optical zoom is possible.

[0228] As shown in Figure 30, multiple "optical zoom possible section identification data 153" are displayed discretely in the sliding section of the telephoto lens selection section 105c corresponding to the telephoto lens 12c which is capable of optical zoom only at a specific lens magnification point. By looking at this "optical zoom available section identification data 153", the user can recognize that clear images can be captured using optical zoom only at these multiple positions.

[0229] Furthermore, in this case, it is preferable to set the display unit 11 to display either the digital zoom ON identification icon 106 or the optical zoom ON state identification icon 152 as shown in FIG. 31 depending on the slide position of the telephoto lens selection unit 105c. When the slide position of the telephoto lens selection section 105c within the slidable section is at an optical zoom enabled position, the optical zoom ON state identification icon 152 is displayed as shown in FIG. 31(b). On the other hand, when the slide position of the telephoto lens selection section 105c is at a position where optical zoom is not possible, the digital zoom ON state identification icon 106 is displayed as shown in FIG. 31(a).

[0230] By looking at this display data, the user can reliably determine whether the zoom position is one where image shooting is performed using optical zoom or one where image shooting is performed using digital zoom.

[0231] Furthermore, when the lens selection section is slid to a position where optical zoom is possible, the display mode of the icon in the lens selection section may be changed. A specific example is shown in Figure 32. Figure 32 shows the following two diagrams. (A) Display data when the slide position of the telephoto lens selection section 105c is the digital zoom position (B) Display data when the slide position of the telephoto lens selection section 105c is the optical zoom position

[0232] In the case of (A), that is, when the slide position of the telephoto lens selection section 105c is the digital zoom position, the telephoto lens selection section display data is the normal display data of the telephoto lens selection section 105c. On the other hand, in the case of (B), that is, when the slide position of the telephoto lens selection section 105c is the optical zoom position, the telephoto lens selection section display data is different from that of the normal telephoto lens selection section 105c. That is, the optical zoom available position identification display is displayed as a telephoto lens selection section 155.

[0233] In this way, when the lens selection section is slid to a position where optical zoom is possible, the display mode of the lens selection section may be changed.

[0234] 6. Configuration Example of Imaging Device of the Present Disclosure Next, a configuration example of the imaging device according to the present disclosure will be described.

[0235] An example configuration of an imaging device according to the present disclosure will be described with reference to FIG. The imaging device 200 shown in FIG. 33 corresponds to the imaging device 10 described in the above embodiment.

[0236] As shown in FIG. 33, the imaging device 200 has an operation information analysis unit 201, a lens switching control unit 202, an imaging unit 203, an image processing unit 204, a memory (storage unit) 205, a display control unit 206, a display unit 210, and a device control unit 215. The display control unit 206 includes a captured image display control unit 207 and an operation unit (UI unit) display control unit 208. The display unit 210 includes an image display unit 211 and an operation unit (UI unit) display unit 212.

[0237] The operation information analysis unit 201 analyzes user operations on an operation unit (UI unit) display unit 212 displayed on the display unit 210. For example, touch processing or slide processing of the lens selection section (lens selection icon) 105 described in the previous embodiment, touch processing of the shutter 103, etc. are detected and analyzed.

[0238] The user operation information analyzed by the operation information analysis unit 201 is output to the lens switching control unit 202, the imaging unit 203, the image processing unit 204, the captured image display control unit 207, etc. in accordance with the analyzed user operation.

[0239] For example, if the analyzed user operation is detection of a touch on the lens selection section (lens selection icon) 105, information about the lens to be selected according to the touched lens selection section (lens selection icon) 105 is output to the lens switching control section 202.

[0240] Furthermore, the operation unit (UI unit) display control unit 208 is notified that a touch on the lens selection unit (lens selection icon) 105 has been detected. In response to the notification of touch detection of the lens selection section (lens selection icon) 105, the operation section (UI section) display control section 208 executes display processing of the digital zoom ON state identification icon 106 and the digital zoom adjustment section 107 described in the previous embodiment on the display section 210.

[0241] Furthermore, if the user operation information analyzed by the operation information analysis unit 201 is a detection of sliding of the lens selection unit (lens selection icon) 105, the operation information analysis unit 201 analyzes the amount of sliding and notifies the image processing unit 204 of the analysis result. The image processing unit 204 determines the amount of digital zoom according to the slide amount input from the operation information analysis unit 201, and performs image area selection processing from the captured image input from the imaging unit 203 and image enlargement processing of the selected area according to the determined amount of digital zoom.

[0242] The digital zoom image generated in the image processing unit 204 is output to the image display unit 211 of the display unit 210 via the captured image display control unit 207 and displayed. Furthermore, if the user operation information analyzed by the operation information analysis unit 201 is a shutter operation, the image processing unit 204 is notified that a shutter operation has been performed. In response to this shutter operation detection notification, the image processing unit 204 stores the image captured by the image capturing unit 203 or the digitally zoomed image thereof in the memory (storage unit) 205.

[0243] As described above, the lens switching control unit 202 inputs information about the lens selection unit (lens selection icon) touched by the user from the operation information analysis unit 201, and performs processing to switch the lens to be applied to shooting according to the input information.

[0244] The imaging unit 203 is composed of an imaging control unit, multiple lenses, an imaging element, etc. The imaging unit 203 changes the lens used for imaging in accordance with a lens switching control command input from the lens switching control unit 202, and outputs the captured image to the image processing unit 204.

[0245] The image processing unit 204 performs image processing on the captured image input from the imaging unit 203 , and outputs the processed image to the captured image display control unit 207 to display it on the image display unit 211 of the display unit 210 . When the image processing unit 204 receives slide information of the lens selection unit (lens selection icon) 105 from the operation information analysis unit 201, it determines the amount of digital zoom according to the amount of slide, and performs image area selection processing from the captured image input from the imaging unit 203 and image enlargement processing of the selected area according to the determined amount of digital zoom.

[0246] Furthermore, when the image processing unit 204 receives shutter operation information from the operation information analysis unit 201, the image processing unit 204 stores the image captured by the imaging unit 203 or the digitally zoomed image thereof in a memory (storage unit) 205.

[0247] The captured image display control unit 207 outputs and displays the captured image input by the image processing unit 204 from the imaging unit 203, or the digital zoom processed image generated by the image processing unit 204 based on the captured image input by the imaging unit 203, to the image display unit 211 of the display unit 210.

[0248] The memory (storage unit) 205 records the captured image input by the image processing unit 204 from the imaging unit 203 or a digitally zoomed image generated by the image processing unit 204 based on the captured image input by the imaging unit 203. The memory (storage unit) 205 also stores programs for processes executed by the imaging device 200, parameters used for various processes, and the like.

[0249] An operation unit (UI unit) display control unit 208 executes display control of data to be displayed in the operation unit display area 102 described in the previous embodiment. For example, when the operation information analysis unit 201 notifies that a touch process on the lens selection unit (lens selection icon) 105 by the user has been detected, the operation unit (UI unit) display control unit 208 executes display processing on the display unit 210 of the digital zoom ON state identification icon 106 and the digital zoom adjustment section 107 described in the previous embodiment in response to this touch detection notification.

[0250] The operation unit (UI unit) display control unit 208 further executes display control to change at least one of the output color, shape, and size of the lens selection unit being slid by the user in accordance with the amount of sliding.

[0251] The image display section 211 of the display section 210 corresponds to the captured image display area 101 described in the previous embodiment, and displays the captured image by the imaging section 203 and the digitally zoomed image generated by the image processing section 204 . The operation section (UI section) display section 212 of the display section 210 corresponds to the operation section display area 102 described in the previous embodiment, and displays operation sections (UI sections) such as the lens selection section (lens selection icon) 105, the digital zoom adjustment section 107, and the shutter 103.

[0252] The device control unit 215 executes, for example, vibration processing of an intensity according to the amount of sliding of the lens selection unit (lens selection icon) 105 by the user, music output processing, and the like.

[0253] [7. Hardware configuration example of imaging device] First, the imaging device of the present disclosure can be configured, for example, by a smartphone equipped with a camera function, a tablet terminal, a PC, or the like. An example of the hardware configuration of a smartphone, tablet terminal, or PC, which is an example of the imaging device of the present disclosure, will be described with reference to Fig. 34. The hardware shown in Fig. 34 is an example of a specific hardware configuration of the imaging device of the present disclosure.

[0254] A CPU (Central Processing Unit) 301 functions as a control unit or data processing unit that executes various processes in accordance with programs stored in a ROM (Read Only Memory) 302 or a storage unit 308. For example, it executes processes in accordance with the sequences described in the above-mentioned embodiments. A RAM (Random Access Memory) 303 stores programs and data executed by the CPU 301. The CPU 301, ROM 302, and RAM 303 are interconnected by a bus 304.

[0255] The CPU 301 is connected to an input / output interface 305 via a bus 304, and the input / output interface 305 is connected to an input unit 306 including a camera, various switches, a microphone, a sensor, etc., and an output unit 307 including a display, a speaker, etc. The CPU 301 executes various processes in response to commands input from an input unit 306, and outputs the results of the processes to an output unit 307, for example.

[0256] A storage unit 308 connected to the input / output interface 305 is made up of, for example, a flash memory, and stores various data and programs executed by the CPU 301. A communication unit 309 is made up of a short-range communication unit such as NFC, Wi-Fi communication, Bluetooth (registered trademark) (BT) communication, and other communication units for data communication via a network such as the Internet or a local area network, and communicates with external devices.

[0257] A drive 310 connected to the input / output interface 305 drives removable media 311 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory such as a memory card, and executes recording or reading of data.

[0258] 8. Summary of the Disclosure The embodiments of the present disclosure have been described in detail above with reference to specific examples. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the gist of the present disclosure. In other words, the present invention has been disclosed in the form of examples and should not be interpreted as being limited. To determine the gist of the present disclosure, the claims should be taken into consideration.

[0259] The technology disclosed in this specification can be configured as follows. (1) multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; An imaging device that displays a digital zoom adjustment section in response to a user operation to select one of multiple lens selection sections displayed on the display section, allowing the digital zoom amount of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user.

[0260] (2) The plurality of lenses have different lens magnifications, The display control unit The imaging device according to (1), wherein the lens selection section displays a lens magnification corresponding to the lens selection section.

[0261] (3) The display control unit When the user performs a slide process on the lens selection section, The imaging device according to (1) or (2), wherein the lens magnification displayed in the lens selection section is sequentially changed and displayed.

[0262] (4) The display control unit When the user performs a slide process on the lens selection section, An imaging device described in any one of (1) to (3), wherein the lens selection section displays a virtual lens magnification capable of capturing an image after digital zoom processing of the captured image, which is performed according to the amount of sliding of the lens selection section.

[0263] (5) The display control unit An imaging device described in any one of (1) to (4), which outputs to the display unit, in response to a user operation to select one of a plurality of lens selection sections displayed on the display unit, an image captured using a lens corresponding to the lens selection section selected by the user.

[0264] (6) The display control unit When the user performs a slide process on the lens selection section, The imaging device according to any one of (1) to (5), wherein an image obtained by digital zoom processing of the captured image, which is executed in accordance with the amount of sliding of the lens selection section, is output to the display section.

[0265] (7) The imaging device further comprises: An imaging device described in any one of (1) to (6), which has a lens switching control unit that sets the lens corresponding to the lens selection unit selected by the user as the lens to be applied to the shooting process in response to a user operation to select one of multiple lens selection units displayed on the display unit.

[0266] (8) The imaging device further comprises: When the user performs a slide process on the lens selection section, The imaging device according to any one of (1) to (7), further comprising an image processing unit that executes digital zoom processing of the captured image in accordance with the amount of sliding of the lens selection unit.

[0267] (9) The display control unit The imaging device according to (8), wherein the digitally zoomed image of the captured image generated by the image processing unit is displayed on the display unit.

[0268] (10) The display control unit When the user performs a slide process on the lens selection section, The imaging device according to any one of (1) to (9) executes display control to notify a user of degradation in image quality caused by digital zoom processing of a captured image executed in accordance with a slide amount of the lens selection section.

[0269] (11) The display control unit As a display control to notify the user of the degradation of image quality caused by digital zoom processing of the captured image, The imaging device according to (10) executes display control to change at least one of the output color, shape, and size of the lens selection section during a user's slide in accordance with the amount of slide.

[0270] (12) The imaging device is As a display control to notify the user of the degradation of image quality caused by digital zoom processing of the captured image, The imaging device according to any one of (1) to (11), wherein the device control unit executes vibration processing with an intensity corresponding to the amount of sliding of the lens selection unit, or music output processing with an intensity corresponding to the amount of sliding of the lens selection unit.

[0271] (13) An imaging device control method executed in an imaging device, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; An imaging device control method that displays a digital zoom adjustment section in response to a user operation to select one of a plurality of lens selection sections displayed on the display section, allowing the digital zoom amount of a captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user.

[0272] (14) A program for causing an imaging device to execute imaging device control processing, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The program causes the display control unit to a process of displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; A program that executes a process of displaying a digital zoom adjustment section in which the amount of digital zoom of a captured image can be adjusted according to the amount of sliding of the lens selection section selected by the user, in response to a user operation of selecting one of a plurality of lens selection sections displayed on the display section.

[0273] Furthermore, the series of processes described in this specification can be executed by hardware, software, or a combination of both. When executing processes by software, a program recording the processing sequence can be installed and executed in the memory of a computer incorporated in dedicated hardware, or the program can be installed and executed on a general-purpose computer capable of executing various processes. For example, the program can be pre-recorded on a recording medium. In addition to installing the program on a computer from the recording medium, the program can also be received via a network such as a LAN (Local Area Network) or the Internet and installed on a recording medium such as an internal hard disk.

[0274] The various processes described in this specification may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capabilities of the devices executing the processes or as needed. Furthermore, in this specification, a system refers to a logical collective configuration of multiple devices, and is not limited to devices that are all located in the same housing. [Industrial Applicability]

[0275] As described above, according to the configuration of one embodiment of the present disclosure, an operation unit (UI) is realized that enables a user to efficiently select a photographing lens and perform digital zoom processing of a photographed image using the selected lens. Specifically, for example, the device has a plurality of lenses each having a different lens magnification that can be used for image capture, and a display control unit that controls the display data to be output to the display unit, and the display control unit displays a plurality of lens selection sections corresponding to each of the plurality of lenses on the display unit, and in response to a user operation to select one of the plurality of lens selection sections displayed on the display unit, displays a digital zoom adjustment section that allows the amount of digital zoom of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user, and further displays the digital zoom image that is executed according to the amount of sliding on the display unit. This configuration realizes an operation unit (UI) that enables the user to efficiently select a photographing lens and digitally zoom a photographed image using the selected lens. [Explanation of symbols]

[0276] 10. Imaging device 11 Display section 12. Camera Lens 101 Captured image display area 102 Operation panel display area 103 Shutter 104 Still image / video switching section 105 Lens selection section (lens selection icon) 106 Digital zoom ON status identification icon 107 Digital zoom adjustment section 121 Zoom down icon 122 Zoom up icon 125 Digital zoom ON status notification message 151 Optical zoom available section identification data 152 Optical zoom ON status identification icon 153 Optical zoom available section identification data 200 Imaging device 201 Operation information analysis department 202 Lens switching control unit 203 Imaging unit 204 Image Processing Unit 205 Memory (storage section) 206 Display control unit 207 Captured image display control unit 208 Operation unit (UI unit) display control unit 210 Display section 211 Image display unit 212 Operation section (UI section) display section 215 Device control section 301 CPU 302 ROM 303 RAM 304 Bus 305 Input / Output Interface 306 Input section 307 Output section 308 Storage section 309 Communications Department 310 Drive 311 Removable Media

Claims

1. Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; An imaging device that displays a digital zoom adjustment section in response to a user operation to select one of multiple lens selection sections displayed on the display section, allowing the digital zoom amount of the captured image to be adjusted according to the amount of sliding of the lens selection section selected by the user.

2. The plurality of lenses are lenses having different lens magnifications, The display control unit The imaging device according to claim 1 , wherein the lens selection section displays a lens magnification corresponding to the lens selection section.

3. The display control unit When the user performs a slide process on the lens selection section, The imaging device according to claim 1 , wherein the lens magnification displayed in the lens selection section is changed sequentially.

4. The display control unit When the user performs a slide process on the lens selection section, The imaging device according to claim 1 , wherein the lens selection section displays a virtual lens magnification capable of capturing an image after digital zoom processing of the captured image, which is executed in accordance with the amount of sliding of the lens selection section.

5. The display control unit The imaging device according to claim 1, wherein, in response to a user operation of selecting one of a plurality of lens selection sections displayed on the display section, an image captured using a lens corresponding to the lens selection section selected by the user is output to the display section.

6. The display control unit When the user performs a slide process on the lens selection section, The imaging device according to claim 1 , wherein an image obtained by digital zoom processing of the captured image, which is executed in accordance with the amount of sliding of the lens selection section, is output to the display section.

7. The imaging device further comprises:

2. The imaging device according to claim 1, further comprising a lens switching control unit that, in response to a user operation of selecting one of a plurality of lens selection units displayed on the display unit, sets a lens corresponding to the lens selection unit selected by the user as the lens to be applied to the imaging process.

8. The imaging device further comprises: When the user performs a slide process on the lens selection section, The imaging device according to claim 1 , further comprising an image processing unit that executes digital zoom processing of the captured image in accordance with the amount of sliding of the lens selection unit.

9. The display control unit The imaging device according to claim 8 , wherein the digitally zoomed image of the captured image generated by the image processing unit is displayed on the display unit.

10. The display control unit When the user performs a slide process on the lens selection section, The imaging device according to claim 1 , wherein display control is executed to notify a user of degradation in image quality that occurs due to digital zoom processing of a captured image that is executed in accordance with the amount of sliding of the lens selection section.

11. The display control unit As a display control to notify the user of the degradation of image quality caused by digital zoom processing of the captured image, The imaging device according to claim 10 , wherein the display control is executed to change at least one of the output color, shape, and size of the lens selection section during the user's slide in accordance with the amount of slide.

12. The imaging device is As a display control to notify the user of the degradation of image quality caused by digital zoom processing of the captured image, The imaging device according to claim 1 , wherein the device control unit executes vibration processing with an intensity corresponding to the amount of sliding of the lens selection unit, or music output processing with an intensity corresponding to the amount of sliding of the lens selection unit.

13. An imaging device control method executed in an imaging device, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The display control unit displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; An imaging device control method for displaying a digital zoom adjustment section in response to a user operation to select one of a plurality of lens selection sections displayed on the display section, whereby the digital zoom amount of a captured image can be adjusted according to the amount of sliding of the lens selection section selected by the user.

14. a program for causing an imaging device to execute imaging device control processing, The imaging device is Multiple lenses available for image capture; a display control unit that controls display data to be output to the display unit; The program causes the display control unit to a process of displaying a plurality of lens selection sections corresponding to the plurality of lenses on a display unit; A program that executes a process of displaying a digital zoom adjustment section in which the amount of digital zoom of a captured image can be adjusted according to the amount of sliding of the lens selection section selected by the user in response to a user operation of selecting one of a plurality of lens selection sections displayed on the display section.

Images