Electronic device and control method thereof

Abstract

An electronic device includes a first lens and a second lens on a first side, the second lens having a different viewing angle than the first lens. The electronic device includes: a switching unit configured to switch between a first camera view via the first lens and a second camera view via the second lens; and a control unit configured to control the display of items corresponding to a plurality of camera modes, wherein the control unit is configured to control the first item and the second item to be displayed in different display modes while the second camera view is in progress, the first item corresponding to a camera mode that enables the first camera view and the second camera view, and the second item corresponding to a camera mode that enables the first camera view and disables the second camera view.

Description

Technical Field

[0001] This invention relates to electronic devices and their control methods, and more particularly to techniques for capturing images via multiple lenses. Background Technology

[0002] There are electronic devices capable of capturing images from both the rear and front sides of the electronic device. Patent Document 1 discusses multiple cameras that can be moved to be located on both the rear and front sides of the electronic device.

[0003] Reference List

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2012-222471 Summary of the Invention

[0006] Technical issues

[0007] According to the method in Patent Document 1, if the user first selects the lens and angle of view to use, it is difficult for the user to understand which camera mode to select.

[0008] In view of the above problems, the present invention provides an electronic device that allows the user to select a shooting mode after selecting a lens to be used for shooting from a plurality of lenses.

[0009] Solution to the problem

[0010] To achieve the aforementioned objective, according to one aspect of the present invention, an electronic device includes a first lens and a second lens on a first side, the second lens having a different viewing angle than the first lens. The electronic device includes: a switching unit configured to switch between a first image captured via the first lens and a second image captured via the second lens; and a control unit configured to control the display of items corresponding to a plurality of camera modes, along with captured images, on a display unit to select a camera mode from the plurality of camera modes, the plurality of camera modes including a camera mode in which the first camera and the second camera can be switched and a camera mode in which the first camera is enabled and the second camera is disabled. The control unit is configured to control the first item and the second item to be displayed in different display modes while the second camera is in progress, the first item corresponding to the camera mode in which the first camera and the second camera are enabled, and the second item corresponding to the camera mode in which the first camera is enabled and the second camera is disabled.

[0011] Beneficial effects of the invention

[0012] According to the present invention, after selecting a lens to be used for video recording from a plurality of lenses, the user can easily select the video recording mode. Attached Figure Description

[0013] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments of the invention and serve to describe the principles of the invention together with the description of the exemplary embodiments.

[0014] FIG. 1A This is an external view of a smartphone, which is an example of a device to which the configuration of this exemplary embodiment can be applied.

[0015] FIG. 1B This is an external view of a smartphone, which is an example of a device to which the configuration of this exemplary embodiment can be applied.

[0016] FIG. 2 This is a block diagram illustrating an example configuration of a smartphone, which is an example of a device to which this exemplary embodiment can be applied.

[0017] FIG. 3A This is a diagram used to describe the lens unit of a smartphone 100 according to this exemplary embodiment.

[0018] FIG. 3B This is a diagram used to describe the lens unit of a smartphone 100 according to this exemplary embodiment.

[0019] FIG. 4A This is a diagram used to describe the lens unit of a smartphone 100 according to this exemplary embodiment.

[0020] FIG. 4B This is a diagram used to describe the lens unit of a smartphone 100 according to this exemplary embodiment.

[0021] FIG. 5 This is a flowchart illustrating the camera control process according to this exemplary embodiment.

[0022] FIG. 6 This is a flowchart illustrating the front-facing camera image control process according to this exemplary embodiment.

[0023] FIG. 7A This is a diagram illustrating an example of the display in the camera control process.

[0024] FIG. 7B This is a diagram illustrating an example of the display in the camera control process.

[0025] FIG. 7C This is a diagram illustrating an example of the display in the camera control process.

[0026] FIG. 7D This is a diagram illustrating an example of the display in the camera control process.

[0027] FIG. 7EThis is a diagram illustrating an example of the display in the camera control process.

[0028] FIG. 7F This is a diagram illustrating an example of the display in the camera control process.

[0029] FIG. 7G This is a diagram illustrating an example of the display in the camera control process.

[0030] FIG. 7H This is a diagram illustrating an example of the display in the camera control process.

[0031] FIG. 7I This is a diagram illustrating an example of the display in the camera control process.

[0032] FIG. 7J This is a diagram illustrating an example of the display in the camera control process.

[0033] FIG. 7K This is a diagram illustrating an example of the display in the camera control process.

[0034] FIG. 8 This is a flowchart illustrating the camera mode selection process according to this exemplary embodiment.

[0035] FIG. 9 This is a flowchart illustrating the front camera shooting mode selection process according to this exemplary embodiment.

[0036] FIG. 10A This is a diagram showing an example of the display during the camera mode selection process.

[0037] FIG. 10B This is a diagram showing an example of the display during the camera mode selection process.

[0038] FIG. 10C This is a diagram showing an example of the display during the camera mode selection process.

[0039] FIG. 10D This is a diagram showing an example of the display during the camera mode selection process.

[0040] FIG. 10E This is a diagram showing an example of the display during the camera mode selection process.

[0041] FIG. 11A This is a diagram showing an example of the display during the camera mode selection process.

[0042] FIG. 11B This is a diagram showing an example of the display during the camera mode selection process.

[0043] FIG. 11C This is a diagram showing an example of the display during the camera mode selection process.

[0044] FIG. 11D This is a diagram showing an example of the display during the camera mode selection process. Detailed Implementation

[0045] Preferred exemplary embodiments of the present invention will now be described with reference to the accompanying drawings.

[0046] FIG. 1A and FIG. 1B This is an external view of a smartphone 100, which is an example of an electronic device according to the present invention. FIG. 1A The rear side of the smartphone 100, opposite to the display side, is shown. FIG. 1B The display side of the smartphone 100 is shown.

[0047] Display unit 28 is a display unit that displays images and various types of information, and includes a touchscreen 70a that can detect touch operations on display unit 28. Up button 61 is a button that can issue commands to increase volume and record video. Down button 60 is a button that can issue commands to decrease volume, and when pressed simultaneously with power switch 72, can issue commands to record the image displayed on display unit 28. Power switch 72 is a push button for switching power on and off. Three lens units are arranged on the first side (back) of smartphone 100 where display unit 28 is not located. Two cameras are arranged on the second side (front) where display unit 28 is located. Due to their different focal lengths, they can capture different viewing angles. The user can switch between the lenses on the first side and the lenses on the second side to change whether to capture an image of themselves, including someone standing on the side of display unit 28 and holding smartphone 100. The user can also take an image while checking the image being captured on display unit 28 using the lenses on the second side.

[0048] FIG. 2 This is a block diagram illustrating a configuration example of a smartphone 100 according to this exemplary embodiment.

[0049] The smartphone 100 includes lens units 201 to 205. Lens units 201 and 202 are arranged on the second side, and lens units 203, 204, and 205 are arranged on the first side. Lenses 103a to 103e represent lenses included in the respective lens units. Some lens units may include multiple lenses, but are simplified and shown as each having a single lens.

[0050] Lens unit 201 includes a standard camera, and lens unit 202 is a wide-angle lens. The lens of lens unit 202 can be used to capture images with a wider angle of view than when using the lens of lens unit 201. Lens unit 203 includes a standard lens, lens unit 204 is a wide-angle lens, and lens unit 205 is an ultra-wide-angle lens. Lens unit 204 is capable of capturing images with a wider angle of view than lens unit 203. Lens unit 205 is capable of capturing images with a wider angle of view than lens unit 204. Alternatively, if the lenses on the first side are a standard lens, a wide-angle lens, and a telephoto lens, the configuration is as follows:

[0051] Lens unit 201 includes a standard lens, and lens unit 202 includes a wide-angle lens. The lens of lens unit 202 can be used to capture images with a wider angle of view than when using the lens of lens unit 201. Lens unit 203 includes a telephoto lens, lens unit 204 is a standard lens, and lens unit 205 is a wide-angle lens. Lens unit 204 is capable of capturing images with a wider angle of view than lens unit 203, and lens unit 205 is capable of capturing images with a wider angle of view than lens unit 204.

[0052] Regardless of the type of lens on the first side, the following configurations are the same.

[0053] Shutters 101a to 101e are shutters with aperture functionality. Imaging units 22a to 22e are image sensors including a charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) device for converting optical images into electrical signals. An analog-to-digital (A / D) converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0054] The imaging unit 22 is an image sensor that includes a CCD or CMOS device for converting optical images into electrical signals. An A / D converter 23 converts analog signals into digital signals. The A / D converter 23 is used to convert the analog signals output from the imaging unit 22 into digital signals. The image sensor 20 is typically a CCD or CMOS-based image sensor. The subject image formed on the image sensor 20 through the lens units 201 to 205 is photoelectrically converted and output as an electrical signal.

[0055] Image processing unit 24 performs resizing and color conversion processing, such as predetermined pixel interpolation and reduction, on data from A / D converter 23 or data from memory control unit 15. Image processing unit 24 also performs predetermined calculations using captured image data. System control unit 50 uses the obtained calculation results for exposure control and distance measurement control. This results in through-lens (TTL) autofocus (AF) processing, auto exposure (AE) processing, and electronic flash (EF) (flash pre-emission) processing. Image processing unit 24 also performs predetermined calculations using captured image data and performs TTL automatic white balance (AWB) processing based on the obtained calculation results.

[0056] The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 stores the image data acquired by the camera unit 22 and digitally converted by the A / D converter 23, as well as the image data to be displayed on the display unit 28. The memory 32 has sufficient storage capacity to store a predetermined number of still images or moving images and sounds of a predetermined duration.

[0057] The power control unit 80 includes a battery detection circuit, a DC-DC converter, and a switching circuit for switching which blocks are to be powered, and detects the presence, type, and remaining battery power of the attached battery. Based on the detection results and instructions from the system control unit 50, the power control unit 80 controls the DC-DC converter and supplies the required voltage to various components, including the recording medium 200, for the desired time period. The power switch 72 can turn the smartphone 100 on and off when pressed and held (for a predetermined time, such as 2 or 3 seconds or longer). Furthermore, when pressed for a short time less than the predetermined time, the power switch 72 can switch the display of the display unit 28 between a hidden state and a display state.

[0058] The power supply unit 30 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a nickel-cadmium (NiCd) battery, a nickel metal hydride (NiMH) battery or a lithium-ion (Li) battery, and / or an AC adapter.

[0059] Recording medium interface (I / F) 18 is the I / F with recording medium 200, such as a memory card or hard disk. Recording medium 200 is a recording medium such as a memory card used to record captured images, downloaded music, and video images. Recording medium 200 includes semiconductor memory or a disk.

[0060] The communication unit 54 can be wirelessly connected or connected via a wired cable to send and receive video and audio signals. The communication unit 54 can also be connected to a wireless local area network (LAN) and the Internet. The communication unit 54 can transmit images captured by the camera unit 22 (including pass-through images) and images recorded on the recording medium 200, and can receive image data and other various types of information from external devices.

[0061] The posture detection unit 55 detects the posture of the smartphone 100 relative to the direction of gravity. Based on the posture detected by the posture detection unit 55, it can be determined whether the image captured by the camera unit 22 was captured when the smartphone 100 is in a horizontal position or in a vertical position. The system control unit 50 can add the orientation information based on the posture detected by the posture detection unit 55 to the image file of the image captured by the camera unit 22 or record the rotated image. An accelerometer or gyroscope sensor can be used as the posture detection unit 55.

[0062] System Timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock.

[0063] The mode change switch 60, shutter button 61, and operation unit 70 are operation units used to input various operation commands to the system control unit 50.

[0064] The operating constants and variables of the system control unit 50, as well as the program read from the non-volatile memory 56, are loaded into the system memory 52. ​​The system control unit performs display control by using the random access memory (RAM) control memory 32, the digital-to-analog (D / A) converter 13, and the display unit 28.

[0065] The non-volatile memory 56 is a memory that can be electrically erased and recorded by the system control unit 50. For example, an electrically erasable programmable read-only memory (EEPROM) is used. The operating constants and programs of the system control unit 50 are stored in the non-volatile memory 56. As used herein, "program" refers to a program used to execute the various flowcharts described below in this exemplary embodiment.

[0066] The system control unit 50 includes at least one built-in processor and controls the entire smartphone 100. Various processes of this exemplary embodiment, which will be described below, are implemented by executing the program recorded in the non-volatile memory 56 described above.

[0067] The operation unit 70 includes a touch screen 70a capable of detecting touch operations and a switch for switching to silent mode. An up button 61, a down button 60, and a power switch 72 are also included in the operation unit 70.

[0068] The memory 32 also serves as an image display memory (video memory). The D / A converter 13 converts the image display data stored in the memory 32 into an analog signal and supplies the analog signal to the display unit 28. The image data written to the memory 32 for display is thus displayed on the display unit 28 via the D / A converter 13. The display unit 28 provides a display based on the analog signal from the D / A converter 13 on a display device such as a liquid crystal display (LCD). The digital signal temporarily converted by the A / D converter 23 and accumulated in the memory 32 is converted by the D / A converter 13 into an analog signal and continuously transmitted to the display unit 28 and displayed on the display unit 28, thereby allowing the display unit 28 to function as an electronic viewfinder and provide a through-view image display (live view display).

[0069] Next, FIG. 3A , FIG. 3B , FIG. 4A and FIG. 4B A diagram is shown illustrating the camera angle, focal length, and magnification of each lens unit used to describe the smartphone 100. FIG. 3A and 3B The description covers a scenario where the rear camera, serving as the first side, includes ultra-wide-angle, wide-angle, and standard lenses, and the front camera, serving as the second side, includes wide-angle and standard lenses.

[0070] FIG. 3A The diagram shows lenses included in a lens unit, which comprises a lens unit on one side (rear camera) and a lens unit on the second side (front camera). In the lens unit on the first side, lens unit 205 is an ultra-wide-angle lens with a focal length of 10mm and a viewing angle of 130°. Lens unit 204 is a wide-angle lens with a focal length of 20mm and a viewing angle of 80°. Lens unit 203 is a standard lens with a focal length of 30mm and a viewing angle of 60°. In the lens unit on the second side, lens unit 202 is a wide-angle lens with a focal length of 15mm and a viewing angle of 110°. Lens unit 201 is a standard lens with a focal length of 25mm and a viewing angle of 70°.

[0071] In the first-side lens unit, lens unit 205 captures images with a 130° viewing angle. If the indicated viewing angle is less than 130° but greater than 80°, the viewing angle is narrowed by electronic zoom. If the viewing angle reaches 80°, the camera is switched to use the lens of lens unit 204. Lens unit 204 captures images with an 80° viewing angle. If the indicated viewing angle is less than 80° but greater than 60°, the viewing angle is narrowed by electronic zoom. If the indicated viewing angle reaches 60°, the camera is switched to use the lens of lens unit 203. The method for indicating the viewing angle will be described below. The user can change the viewing angle of the image to be captured by switching lenses. If the user issues a command to change the viewing angle, and thus uses electronic zoom, and issues a command to change the viewing angle to a viewing angle that the next lens unit can capture an image from, the lens unit to capture the image is switched. Similarly, in the case of the second side, lens unit 202 captures images with a 110° viewing angle. If the indicated viewing angle is less than 110° but greater than 70°, the viewing angle is narrowed by electronic zoom. An image captured at the indicated viewing angle (an image captured via the lens based on the indicated viewing angle) is displayed on display unit 28. If the indicated viewing angle reaches 70°, the camera is switched to use the lens of lens unit 201. In this exemplary embodiment, the lens does not necessarily need to be a single-focus lens and can be configured such that the lens position can be moved for optical zoom.

[0072] FIG. 3B A diagram illustrating the switching of the first-side lens unit when optical zoom is enabled is shown. In the first-side lens unit, lens unit 205 captures images with a 130° viewing angle. If the indicated viewing angle is less than 130°, optical zoom is first performed by moving the lens position. If the indicated viewing angle reaches 95°, the viewing angle is narrowed by electronic zoom. If the viewing angle reaches 80°, the camera is switched to use the lens of lens unit 204. Furthermore, if the indicated viewing angle is less than 80°, optical zoom is used to change the viewing angle. If the indicated viewing angle is less than 70°, electronic zoom is performed. If the indicated viewing angle reaches 60°, image is captured using lens unit 203. If the indicated viewing angle is less than 60°, electronic zoom is performed using lens unit 203. The lens of the second-side front camera may consist only of a single-focus lens, while the lens of the first-side rear camera is configured to be capable of optical zoom. FIG. 3A and FIG. 3BIn both cases, the timing for switching the lens unit used to capture the image does not necessarily need to be the same when the camera angle decreases and when the camera angle increases. Depending on the shooting mode and shooting situation, the timing for switching the lens unit used to capture the image can be changed to reduce the impact on the captured image.

[0073] FIG. 4A and FIG. 4B The description covers a scenario where the rear camera, serving as the first side, includes wide-angle, standard, and telephoto lenses, and the front camera, serving as the second side, includes wide-angle and standard lenses.

[0074] FIG. 4A The diagram shows lenses included in a lens unit, which comprises a lens unit on one side (rear camera) and a lens unit on the second side (front camera). In the lens unit on the first side, a wide-angle lens, 205, has a focal length of 15mm and a viewing angle of 110°. A standard lens, 204, has a focal length of 20mm and a viewing angle of 80°. A telephoto lens, 203, has a focal length of 80mm and a viewing angle of 20°. In the lens unit on the second side, a wide-angle lens, 202, has a focal length of 20mm and a viewing angle of 110°. A standard lens, 201, has a focal length of 30mm and a viewing angle of 70°.

[0075] In the first lens unit, lens unit 205 captures images with a 110° viewing angle. If the indicated viewing angle is less than 110° but greater than 80°, the viewing angle is narrowed using electronic zoom. If the viewing angle reaches 80°, the camera is switched to use the lens of lens unit 204. Furthermore, if lens unit 204 captures images with an 80° viewing angle, and the indicated viewing angle is less than 80° but greater than 30°, electronic zoom is used to narrow the viewing angle. Note that the timing for switching to the telephoto lens does not necessarily require the indicated viewing angle to become 30°. If the indicated viewing angle reaches 30°, the camera is switched to use the lens of lens unit 203. The method for indicating the viewing angle will be described below. If the user thus issues a command to change the viewing angle, electronic zoom is used, and when a command is issued indicating the viewing angle from which the next lens unit can capture an image, the lens unit capturing the image is switched. Similarly, in the second case, lens unit 202 captures images with a 110° viewing angle. If the indicated viewing angle is less than 110° but greater than 70°, the viewing angle is narrowed by electronic zoom. If the indicated viewing angle reaches 70°, the camera is switched to use the lens of lens unit 201. In this exemplary embodiment, the lens does not necessarily need to be a single-focus lens and can be configured such that the lens position is movable for optical zoom.

[0076] FIG. 4B A diagram illustrating the switching of the lens unit on the first side when the lens unit is capable of optical zoom is shown. In the lens unit on the first side, lens unit 205 captures images with a viewing angle of 130°. If the indicated viewing angle is less than 130°, optical zoom is first performed by moving the lens position. If the indicated viewing angle reaches 110°, the viewing angle is narrowed by electronic zoom. If the viewing angle reaches 80°, the camera is switched to use the lens of lens unit 204. Furthermore, if the indicated viewing angle is less than 80°, optical zoom is used to change the viewing angle. If the indicated viewing angle is less than 70°, electronic zoom is performed. If the indicated viewing angle reaches 60°, lens unit 203 is used to capture images. If the indicated viewing angle is less than 60°, electronic zoom is performed using lens unit 203. The lens of the front camera on the second side may consist only of a single-focus lens, while the lens of the rear camera on the first side is configured to be capable of optical zoom. FIG. 4A and FIG. 4B In both cases, the timing for switching the lens unit used to capture the image does not necessarily need to be the same when the camera angle decreases and when the camera angle increases. Depending on the shooting mode and shooting conditions, the timing for switching the lens unit used to capture the image can be changed to reduce the impact on the captured image.

[0077] Next, we will refer to FIG. 5 and FIG. 6 The flowchart describes the camera control processing according to this exemplary embodiment. This processing is implemented by loading a program recorded in non-volatile memory 56 into system memory 52 and executing the program by system control unit 50. The processing begins when the smartphone 100 is powered on. FIG. 5 and FIG. 6 The camera control processing is based on the following assumption: the rear camera, acting as the first side, includes wide-angle, standard, and telephoto lenses, and the front camera, acting as the second side, includes wide-angle and standard lenses. In other words, it will assume... FIG. 4A The lens unit arrangement shown is given in the case of a smartphone. However, this is not limiting.

[0078] In step S501, the system control unit 50 determines whether a command to activate the camera function has been issued. This command can be issued via the camera item displayed on the touch display unit 28. If a command to activate the camera function has been issued, the process proceeds to step S502. Otherwise, the process proceeds to step S503.

[0079] In step S502, the system control unit 50 activates the standard lens of the first-side rear camera (i.e., the camera of lens unit 204). In other words, activating the camera function activates the rear camera. As described below, after activating the rear camera, the second-side camera, i.e., the front camera, can be switched.

[0080] In step S503, the system control unit 50 performs other processing. Examples of other processing include playback of images acquired via lens units 201 to 205, internet browsing, and image editing.

[0081] In step S504, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 204 on the display unit 28.

[0082] In step S505, the system control unit 50 displays the settings for capturing images using a standard lens (lens unit 204). FIG. 7A to FIG. 7K It shows FIG. 5 and FIG. 6 The example shown is a display of camera control processing. FIG. 7A This shows an example of the display unit 28 when the rear camera is activated. Item 704 is for changing the aperture value. Item 705 is for changing the skin beautification effect. When taking an image including a person using the standard lens of the rear camera, the face in the image may be large, and therefore a skin beautification effect is desired. FIG. 7B Item 702 is shown as an item for issuing a recording command. Item 703 is an item for switching to recording using the front-facing camera. Items 700 and 708 to 710 are items for switching to various recording modes. When the camera is activated, the photo mode indicated by item 700 is selected. The camera can be activated while the user is in the recording mode selected when the camera was previously activated. Item 708 indicates a motion picture mode that can capture moving images. Item 709 indicates a portrait mode, in which an image of the main subject can be captured even when the background subject is blurred. Item 710 indicates a time-lapse mode. In time-lapse mode, images are captured at predetermined time intervals such as 2 seconds and 5 seconds, and the images are played back continuously.

[0083] In step S506, the system control unit 50 displays a 1.0x (onex) magnification on the display unit 28. For example... FIG. 7A As shown, item 701 indicates that the current camera magnification is displayed as 1.0x upon startup. More specifically, if using... FIG. 4AThe standard lens shown has an 80° field of view during recording, so a 1.0x magnification is displayed. In other words, displaying the field of view of a standard lens without electronic zoom as 1.0x allows the user to recognize that the field of view can be reduced or increased with reference to the currently displayed field of view.

[0084] In step S507, the system control unit 50 determines whether a command to switch to the wide-angle lens has been issued. If a command to switch to the wide-angle lens has been issued, the process proceeds to step S508. Otherwise, the process proceeds to step S512, and the system control unit 50 determines whether a command to switch to the telephoto lens has been issued. In step S512, if a command to switch to the telephoto lens has been issued, the process proceeds to step S513. Otherwise, the process proceeds to step S521. The command to switch to the wide-angle lens can be issued by touching the item 701 displayed on the display unit 28. For example, if a short touch operation is performed on item 701, the wide-angle lens of lens unit 205 is activated. If another touch operation is performed, the telephoto lens of lens unit 203 is activated.

[0085] In step S508, the system control unit 50 activates the wide-angle lens of the rear camera on the first side, namely, the camera of the lens unit 205.

[0086] In step S509, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 205 on the display unit 28.

[0087] In step S510, the system control unit 50 displays the setting that images can be captured using the wide-angle lens (lens unit 205). FIG. 7B An example display of display unit 28 when the wide-angle lens of the rear camera is activated is shown. Item 704 is for changing the aperture value. Item 706 is for performing distortion correction processing. Since the wide-angle lens of the rear camera may cause significant distortion in the captured image, distortion correction image processing can be performed to make the distortion less noticeable. Also shown is... FIG. 7A Other projects similar to this one.

[0088] In step S511, the system control unit 50 displays a 0.5x camera magnification on the display unit 28. For example... FIG. 7B As shown, item 707 indicates the current camera magnification, meaning the display magnification is lower than a standard lens, i.e., the camera angle is wider. Specifically, if using... FIG. 4AThe wide-angle lens shown has a field of view of 110° during recording, so a magnification of 0.5x (less than 1x) is displayed. In other words, displaying the field of view of a wide-angle lens without electronic zoom as 0.5x allows the user to recognize that the currently displayed field of view is larger than the standard.

[0089] In step S513, the system control unit 50 activates the telephoto lens of the rear camera on the first side, namely the camera of the lens unit 203.

[0090] In step S514, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 203 on the display unit 28.

[0091] In step S515, the system control unit 50 displays the settings for capturing images using the telephoto lens (lens unit 203). FIG. 7C This shows an example of the display on display unit 28 when the telephoto lens of the rear camera is activated. Item 704 is for changing the aperture value. Items 705 and 706, which are displayed at other magnifications, are not shown for the telephoto lens of the rear camera. FIG. 7A Other projects similar to the one in question were also displayed.

[0092] In step S516, the system control unit 50 displays a 2.0x magnification on the display unit 28. For example... FIG. 7C As shown, item 708 indicates the current camera magnification, meaning the magnification is higher than a standard lens, resulting in a narrower field of view. Specifically, if using... FIG. 4A The telephoto lens shown has a 30° field of view during recording, so it displays a 2.0x magnification. In other words, displaying the field of view of a wide-angle lens without electronic zoom as 2.0x allows the user to recognize that the currently displayed field of view is smaller than the standard.

[0093] Rear cameras are typically used to capture images of people or landscapes using standard or wide-angle lenses. Telephoto lenses can also be used to capture images of distant subjects. Rear cameras typically include three lenses (i.e., more than the lenses on the second-side front camera) that provide a wider field of view for capturing images. Therefore, a user can identify from a 1.0x display that a lens with a standard magnification (i.e., a lens other than a wide-angle or telephoto lens) is being used, and can also identify the presence of lenses capable of capturing images with a wider or farther field of view than the currently used lens. In other words, if the magnification is displayed as 1.0x when three or more lenses are present, the user can easily identify that the magnification can be changed to below or above 1.0x.

[0094] In step S517, the system control unit 50 determines whether a command to switch to the standard lens has been issued. The wide-angle lens can be switched to the standard lens by touching item 708. Note that touches on items 701, 707, and 708 alternate sequentially to select the magnification. More specifically, the magnification alternates in the order of 1.0x, 0.5x, and 2.0x. However, the order is not limited to this. Alternatively, items 701, 707, and 708 can be displayed constantly along with the live view image, allowing the user to select one of these items. If a command to switch to the standard lens has been issued, the process proceeds to step S502. Otherwise, the process proceeds to step S518.

[0095] In step S518, the system control unit 50 determines whether an operation to change the camera magnification has been performed. To change the camera magnification, long press item 701 to display. FIG. 7D Item 711 is shown. The camera magnification can be changed by touching and moving the touch position on the bar of item 711. Item 711 represents the settable camera magnification, and the user can set the camera magnification by moving the touch position while viewing the live view. When the user releases the touch, item 711 is hidden. If it is determined that an operation to change the camera magnification has been performed, the process proceeds to step S519. Otherwise, the process proceeds to step S521.

[0096] In step S519, the system control unit 50 obtains the magnification indicated by the touch operation on item 711. In step S520, the system control unit 50 determines whether the corresponding lens is a telephoto lens, a standard lens, or a wide-angle lens. For example, if a magnification higher than 1.0x and lower than 2.0x is indicated by the touch operation on item 711, a standard lens is selected. If a magnification lower than 1.0x is selected, a wide-angle lens is selected. If a magnification higher than or equal to 2.0x is selected, a telephoto lens is selected. If it is determined that a standard lens has been selected, the process proceeds to step S502. If it is determined that a wide-angle lens has been selected, the process proceeds to step S508. If it is determined that a telephoto lens has been selected, the process proceeds to step S513.

[0097] In step S521, the system control unit 50 determines whether a camera command has been issued. A camera command can be issued via touch operation on item 702. If a camera command has been issued, the process proceeds to step S522. Otherwise, the process proceeds to step S523.

[0098] In step S522, the system control unit 50 performs image processing. The captured image is recorded on the recording medium 200.

[0099] In step S523, the system control unit 50 determines whether a command to switch to the front-facing camera has been issued, i.e., whether a command to switch to the second-side camera has been issued. This command can be issued via a touch operation on item 703. If it is determined that a command to switch to the front-facing camera has been issued, the process proceeds to... FIG. 6 A and FIG. 6 The front-facing camera image control process is shown in step B. Otherwise, the process proceeds to step S524.

[0100] In step S524, the system control unit 50 determines whether to terminate the camera function. This can be done by pressing the power button 72, scrolling up on the display unit 28, or by a pinch operation similar to pinching a live view image. If it is determined that a command to terminate the camera function has been issued, then... FIG. 5 The processing ends there. Otherwise, the processing proceeds to step S525.

[0101] In step S525, the system control unit 50 determines whether the currently used lens is a standard lens. If the currently used lens is a standard lens, the process proceeds to step S507. Otherwise, the process proceeds to step S517.

[0102] Next, we will refer to FIG. 6 This describes the front-facing camera image control processing according to this exemplary embodiment. If FIG. 5 If the judgment in step S523 is yes, then processing begins.

[0103] In step S601, the system control unit 50 activates the wide-angle lens of the second-side rear camera, i.e., the camera of the lens unit 202. In other words, if a command to activate the front camera is issued, the wide-angle camera is activated initially. Therefore, when a command to activate the front camera is issued, activating the wide-angle lens eliminates the need for the user who wants to capture images on the wide-angle side to change the standard lens to a wider angle of view. Furthermore, activating the wide-angle end allows the user to identify the range of the field of view that cannot be widened due to optical requirements. Since the wide-angle end (i.e., the maximum angle of view that can be captured) can be identified when the front camera is activated, the user can easily check what range of the image can be captured and whether the shooting range should be narrowed.

[0104] In step S602, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 201 on the display unit 28.

[0105] In step S603, the system control unit 50 displays the setting that images can be captured using the wide-angle lens (lens unit 202). FIG. 7EAn example of the display on display unit 28 when the front-facing camera is activated is shown. Item 704 is for changing the aperture value. Item 705 is for changing the skin beautification effect. When using the wide-angle lens of the front-facing camera to capture images including people, the faces in the images may be large, and therefore a skin beautification effect is desired. Although the photo mode indicated by item 700 is selected when the front-facing camera is activated, the camera can be activated immediately after the user has previously activated the video mode.

[0106] In step S604, the system control unit 50 displays a 1.0x magnification on the display unit 28. For example... FIG. 7E As shown, item 712 indicates that the current camera magnification is displayed as 1.0x upon startup. More specifically, if using... FIG. 4B The wide-angle lens shown has a field of view of 110° during recording, so the magnification is displayed as 1.0x. In other words, displaying the field of view of a wide-angle lens without electronic zoom as 1.0x allows the user to recognize that the field of view can be further increased with reference to the currently displayed field of view.

[0107] In step S605, the system control unit 50 determines whether a command to switch to the standard lens has been issued. If a command to switch to the standard lens has been issued, the process proceeds to step S607. Otherwise, the process proceeds to step S610. The command to switch to the standard lens can be issued by touching the item 712 displayed on the display unit 28. For example, if a brief touch operation is performed on item 712, the standard lens of the lens unit 201 is activated.

[0108] In step S606, the system control unit 50 activates the standard lens of the front-facing camera on the second side, namely the camera of the lens unit 201.

[0109] In step S607, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 201 on the display unit 28.

[0110] In step S608, the system control unit 50 displays the settings for capturing images using a standard lens (lens unit 201). FIG. 7F An example of the display unit 28 when the standard lens of the front-facing camera is activated is shown. Item 704 is for changing the aperture value. Item 705 is for changing the skin beautification effect. Also shown is... FIG. 7A Other projects similar to this one.

[0111] In step S609, the system control unit 50 displays a 2.0x magnification on the display unit 28. For example... FIG. 7FAs shown, item 713 indicates the current camera magnification, meaning the display magnification is higher than 1.0x, i.e., the camera angle is narrowed. Specifically, if using... FIG. 4A The standard lens shown has a 70° field of view during recording, so the magnification is displayed as 2.0x. In other words, displaying the field of view as 2.0x when using a standard lens without electronic zoom allows the user to recognize that the currently displayed field of view can be increased. If a standard lens is used and the magnification is displayed as 1.0x, the user can recognize that the magnification can be changed to a higher level than 1.0x through electronic zoom to narrow the current field of view. However, it is not intuitively clear whether the current field of view can be increased. In other words, if the magnification is displayed as 1.0x, it can be seen that electronic zoom can be used to narrow the field of view, but it is difficult to understand whether there is a lens that can shoot with a wider field of view than the currently used lens. In contrast, when a standard lens and a wide-angle lens are present and the standard lens is being used, displaying 2.0x (a magnification higher than 1.0x) allows the user to recognize that the current field of view is a 2.0x magnification of a certain angle. Therefore, the user can recognize that the field of view can be changed to an unmagnified angle, that is, an image can be captured with a wider angle of view. On the other hand, when a standard lens and a wide-angle lens are present and the wide-angle lens is used, displaying 1.0x allows the user to recognize that the magnification can be changed to above 1.0x at least by using electronic zoom. Therefore, the user can recognize that the current camera angle can capture images with a wider field of view within a variable range of angles.

[0112] In step S610, the system control unit 50 detects the size and number of one or more faces being photographed from the live view image.

[0113] In step S611, the system control unit 50 determines whether any or neither of the following conditions is met: the total area (size) of the faces (one or more) obtained in step S610 is less than a predetermined size, and the number of faces is 1. If either condition is met, the process proceeds to step S606. Otherwise, the process proceeds to step S613. If the area of ​​the region (one or more) faces included in the entire live view image is less than a predetermined size (area), such as one-fifth or one-eighth of the entire live view image, then even without wide-angle photography, the camera and the subject (one or more) may be at a sufficient distance. In such a case, a standard lens can be used to capture the user's face at a large size. On the other hand, suppose the user's face is not at a sufficient distance. In such a case, if a standard lens is used to capture the image, and the viewing angle is adjusted so that the hand holding the smartphone is not included, it is difficult to capture the image from a position high enough relative to the face. This may cause the user's face to appear large in the captured image. If the camera and (one or more) subjects are at a sufficient distance, the user may use a standard lens to capture the image; otherwise, a wide-angle lens may be used. By determining the face size as in step S611, and automatically using a standard lens if the face area is small, it may be possible to capture images from an appropriate angle without the user switching lenses.

[0114] If there is only one face, the subject is relatively small relative to the live view image. Therefore, a face shot with a standard lens is unlikely to appear large. Thus, automatic switching to a standard lens reduces user interaction.

[0115] In step S612, the system control unit 50 determines whether a command to switch to the wide-angle lens has been issued. If a command to switch to the wide-angle lens has been issued, the process proceeds to step S601. Otherwise, the process proceeds to step S613. The command to switch to the wide-angle lens can be issued by touching the item 713 displayed on the display unit 28. For example, if a brief touch of item 713 is performed, the wide-angle lens of the lens unit 202 is activated.

[0116] In step S613, the system control unit 50 determines whether a camera command has been issued. A camera command can be issued via touch operation on item 702. If a camera command has been issued, the process proceeds to step S614. Otherwise, the process proceeds to step S615.

[0117] In step S614, the system control unit 50 performs image processing. The captured image is recorded on the recording medium 200.

[0118] In step S615, the system control unit 50 determines whether an operation to change the camera magnification has been performed. To change the camera magnification, long press item 712 to display the image. FIG. 7D Item 711 is an item for changing the camera magnification. The camera magnification can be changed by touching and moving the item's bar. If it is determined that an operation to change the camera magnification is being performed, the process proceeds to step S616. Otherwise, the process proceeds to step S618.

[0119] In step S616, the system control unit 50 obtains the camera magnification indicated by a touch operation on the item displayed in step S615. In step S617, the system control unit 50 determines whether the corresponding lens is a standard lens or a wide-angle lens. For example, if a magnification of 2.0x or higher is indicated by a touch operation on the item displayed in step S615, a standard lens is selected. If a magnification of less than 2.0x is selected, a wide-angle lens is selected. If it is determined that a standard lens has been selected, the process proceeds to step S606. If it is determined that a wide-angle lens has been selected, the process proceeds to step S601.

[0120] In step S618, the system control unit 50 determines whether a command has been issued to initiate a call using the smartphone 100. The command to initiate the call can be issued with or without activating the camera function. If it is determined that a command to initiate the call has been issued, the process proceeds to step S606. Otherwise, the process proceeds to step S619.

[0121] In step S619, the system control unit 50 determines whether a command to switch to the rear camera has been issued, i.e., whether a command to switch to the first-side camera has been issued. This command can be issued via a touch operation on item 703. If it is determined that a command to switch to the rear camera has been issued, the process proceeds to... FIG. 5 Step S502. Otherwise, the process proceeds to step S620.

[0122] In step S620, the system control unit 50 determines whether to terminate the camera function. This can be done by pressing the power button 72, scrolling up on the display unit 28, or by a pinch operation similar to pinching a live view image. If it is determined that a command to terminate the camera function has been issued, then... FIG. 5 The processing ends there. Otherwise, the processing proceeds to step S621.

[0123] In step S621, the system control unit 50 determines whether the currently used lens is a standard lens. If the currently used lens is a standard lens, the process proceeds to step S612. Otherwise, the process proceeds to step S605.

[0124] In the foregoing exemplary embodiments, the items used to change the camera magnification are described as being represented by numbers. However, this exemplary embodiment is not limited to this, and the following display may be used instead. FIG. 7G to FIG. 7K An example of an item for changing the camera magnification is shown. In the aforementioned exemplary embodiment, it is described that if item 701 or 712 is long-pressed, item 711 for changing the camera magnification is displayed. However, such an item can be displayed constantly along with the live view image without any display instruction from the user. FIG. 7G Item 714 is shown for changing the magnification when the rear camera is activated. Line 714a of item 714 indicates the midpoint between the wide-angle end 714c and the telephoto end 714b. Instruction item 714d, which overlaps with line 714a, can be moved, and the magnification can be changed by moving instruction item 714d. The actual field of view at the center of the range of angles between actually selecting the wide-angle end 714c and actually selecting the telephoto end 714b does not need to be a magnification of 1.0. FIG. 7H Item 715 is shown for changing the magnification when the rear camera is activated. Item 715a, included in Item 715, indicates that the standard lens is activated. Item 715a is surrounded by a thick frame to indicate the current shooting using the standard lens at the angle of view without electronic zoom. The magnification can be changed by moving the touch position on Item 715. If Item 715b is selected, the telephoto lens is activated. If Item 715c is selected, the wide-angle lens is activated. If a position on the bar between the items is selected, the magnification can be changed to the electronic zoom magnification. FIG. 7I This shows the display mode of item 714 when the magnification of the rear camera is changed to the telephoto side. The magnification can be changed by moving instruction item 714d to the telephoto side. FIG. 7J Item 716 is shown for changing the magnification when the front-facing camera is activated. Instruction item 716a is used to change the magnification. The magnification can be changed by altering the touch position on item 716. Item 716b represents the telephoto end. The magnification can be increased by moving instruction item 716a until it reaches item 716b. Because instruction item 716a is at the wide-angle end when the front-facing camera is activated, the user can recognize that the current live view image is at its widest angle. FIG. 7KItem 717 is shown for changing the magnification when the front camera is activated. Item 717a corresponds to the magnification when the wide-angle lens is activated, and item 717b corresponds to the magnification when the standard lens is activated. The magnification can be changed by touching item 717. When the front camera is activated, since item 717a is selected, the user can recognize that the current magnification is on the wide-angle side.

[0125] According to the exemplary embodiments described above, when using the front-facing camera to capture images, the user can capture images with a wide field of view without increasing the number of operations.

[0126] Although step S618 describes switching the front-facing camera to the standard lens when a call begins, the standard lens can also be switched when the front-facing camera is activated in the following situations. For example, suppose the background scene behind a person is determined based on the captured image, and it is found that the background is a light-colored wall or the interior of a room. In such a case, the front-facing camera is switched to the standard lens because the user may want to capture a large image of the person. On the other hand, if the background is determined to be a building or landscape, the wide-angle lens is activated because the user may want to capture an image that includes the landscape or building.

[0127] Next, we will refer to FIG. 8 and FIG. 9 The flowchart describes the camera mode selection process according to this exemplary embodiment. This process is implemented by loading a program recorded in non-volatile memory 56 into system memory 52 and executing the program by system control unit 50. This process begins when the smartphone 100 is powered on. FIG. 8 and FIG. 9 The camera mode selection processing is based on the following assumptions: the rear camera (first side) includes ultra-wide-angle, wide-angle, and standard lenses, and the front camera (second side) includes wide-angle and standard lenses. In other words, it will assume... FIG. 3A The lens unit arrangement shown is given in the case of a smartphone. However, this is not limiting. (See reference...) FIG. 5 and FIG. 6 The described camera control process includes instructions on changing the camera magnification. The flowchart below will illustrate the control of changes in camera mode and magnification. FIG. 5 and FIG. 6 Exemplary embodiments and FIG. 8 and FIG. 9 Exemplary embodiments can be performed in combination.

[0128] In step S801, the system control unit 50 determines whether a command to activate the camera function has been issued. This command can be issued via the camera item displayed on the touch display unit 28. If a command to activate the camera function has been issued, the process proceeds to step S802. Otherwise, the process proceeds to step S803.

[0129] In step S802, the system control unit 50 activates the standard lens of the first-side rear camera, i.e., the camera of the lens unit 203. In other words, the rear camera is activated when the camera function is activated. As described below, after activating the rear camera, the second-side camera, i.e., the front camera, can be switched.

[0130] In step S803, the system control unit 50 performs other processing. Examples of other processing include playback of images acquired via lens units 201 to 205, internet browsing, and image editing.

[0131] In step S804, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 203 on the display unit 28.

[0132] In step S805, the system control unit 50 displays candidate camera modes for selection on the display unit 28. The candidate camera modes include photo mode, night scene mode, automatic judgment mode, portrait mode, panorama mode, motion picture mode, time-lapse mode, and manual mode. FIG. 10A to FIG. 10E as well as FIG. 11A to 11D It shows the reference FIG. 8 and FIG. 9 The flowchart description shows an example. FIG. 10A An example of a camera image displayed on display unit 28 when the rear camera is activated is shown. Item group 1016 includes items 1004 to 1011 corresponding to the camera mode, and some of these items are displayed on display unit 28. FIG. 10A The image shows items 1004 to 1006 and 1009, as well as a portion of items 1007 and 1010. Item 1004 represents photo mode, item 1005 represents motion picture mode, item 1006 represents panorama mode, item 1007 represents portrait mode, item 1008 represents manual mode (M mode), and item 1009 represents night scene mode. Additionally, item 1010 represents time-lapse mode, and item 1011 represents automatic judgment mode (artificial intelligence [AI] mode). For descriptive purposes, items corresponding to the actual hidden camera modes are also shown. FIG. 10A to FIG. 10D and FIG. 11BWhen the camera function is activated, the photo mode is selected as the video mode. The corresponding item 1004 is displayed adjacent to the mark 1014 indicating the selection. The video mode corresponding to the item displayed directly below mark 1014 is the selected video mode. Mark 1014 is displayed at the horizontal center of display unit 28, and its position remains unchanged even if the selected video mode changes. When item group 1016 is scrolled to change the selected video mode, the video modes displayed on display unit 28 in item group 1016 change accordingly. Item 1001 represents the current video magnification of 1.0x and is surrounded by a thicker line than items 1002 (0.5x) and 1003 (0.3x) which represent other video magnifications. Therefore, changing the display mode allows the user to identify which video magnification has been selected. By selecting item 1013, the lens can be switched to one of the front cameras on the second side. Item 1012 is the item used to issue a video recording command.

[0133] In step S806, the system control unit 50 determines whether a command to switch to the wide-angle lens has been issued. If a command to switch to the wide-angle lens has been issued, the process proceeds to step S807. Otherwise, the process proceeds to step S811, and the system control unit 50 determines whether a command to switch to the ultra-wide-angle lens has been issued. In step S811, if a command to switch to the ultra-wide-angle lens has been issued, the process proceeds to step S812. Otherwise, the process proceeds to step S815. The command to switch to the wide-angle lens can be issued by touching item 1002 displayed on the display unit 28. The command to switch to the ultra-wide-angle lens can be issued by touching item 1003 displayed on the display unit 28.

[0134] In step S807, the system control unit 50 activates the wide-angle lens of the rear camera on the first side, namely the camera of the lens unit 204.

[0135] In step S808, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 204 on the display unit 28.

[0136] In step S809, the system control unit 50 determines whether the current camera mode is photo mode. If the current camera mode is determined to be photo mode, the process proceeds to step S810. Otherwise, the process proceeds to step S824.

[0137] In step S810, the system control unit 50 highlights the shooting modes suitable for using a wide-angle camera and grays out the unsuitable shooting modes. FIG. 10BAn example of the display unit 28 when switching to the wide-angle lens in photo mode is shown. FIG. 10B As shown, item 1009a, representing Night Scene mode, and item 1005a, representing Motion Picture mode, are displayed distinctly from other items (such as items 1006 and 1010). Distinguishing items means, for example, filling the item with a bright color, displaying the item larger than other items, or displaying the item with slight vibration. Item 1007a, representing Portrait mode, is grayed out to indicate that when a wide-angle lens is selected, photography will not be performed in Portrait mode. The display mode of item 1007a does not have to be grayed out. The item itself can be displayed faintly or at a small size. Alternatively, item 1007a can be hidden. That is, if a wide-angle lens is selected in Photo mode, the user may have a strong intention to take images using a wide-angle lens. Presenting the shooting modes suitable for using a wide-angle lens to the user in an easy-to-understand way allows the user to quickly switch shooting modes. Furthermore, graying out shooting modes that cannot be used with a wide-angle lens allows users to recognize that if a grayed-out shooting mode is selected, images can no longer be captured from a wide-angle perspective. Wide-angle lenses can record a wide range of temporal changes in motion picture mode. Wide-angle lenses can capture images including multiple buildings or large buildings in night scene mode. Shooting modes suitable for wide-angle lenses are not limited to those mentioned above.

[0138] In step S812, the system control unit 50 activates the ultra-wide-angle lens of the rear camera on the first side, namely the camera of the lens unit 205.

[0139] In step S813, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 205 on the display unit 28.

[0140] In step S814, the system control unit 50 determines whether the current camera mode is photo mode. If the current camera mode is determined to be photo mode, the process proceeds to step S815. Otherwise, the process proceeds to step S824.

[0141] In step S815, the system control unit 50 highlights the shooting modes suitable for using an ultra-wide-angle camera and grays out unsuitable shooting modes. FIG. 10C An example of the display unit 28 when switching to the ultra-wide-angle lens in photo mode is shown. FIG. 10CAs shown, item 1009a, representing night scene mode, and item 1015, representing distortion correction mode, are displayed distinctly from other items (such as items 1005 and 1010). Items 1007a, representing portrait mode, and 1006a, representing panorama mode, are grayed out to indicate that shooting will not be performed in portrait or panorama mode when an ultra-wide-angle lens is selected. In other words, if an ultra-wide-angle lens is selected in photo mode, the user likely has a strong intention to shoot images using the ultra-wide-angle lens. Presenting shooting modes suitable for wide-angle lens shooting in an easy-to-understand manner allows users to quickly switch shooting modes. Furthermore, graying out shooting modes that cannot be used with an ultra-wide-angle lens allows users to recognize that if a grayed-out shooting mode is selected, images can no longer be shot from a wide-angle perspective. Shooting with an ultra-wide-angle lens may cause distortion near the image edges, which can be addressed by shooting in distortion correction mode. Therefore, when using an ultra-wide-angle lens, it is desirable to facilitate user identification of shooting in distortion correction mode and recommend shooting in distortion correction mode. Furthermore, because images may not be synthesizable due to distortion occurring near image edges, panoramic shooting is not performed. In step S816, the system control unit 50 determines whether the current lens is a standard lens. If the currently used lens is determined to be a standard lens, the process proceeds to step S824 to perform a shooting mode switching process if all shooting modes are selectable. If not in step S816, the process proceeds to step S817 to perform a shooting mode switching process if some shooting modes are not selectable.

[0142] In step S817, the system control unit 50 determines whether the user has issued a command to scroll through the item group 1016 representing the camera mode. If the command has been issued, the process proceeds to step S818. Otherwise, the process proceeds to step S819.

[0143] In step S818, the system control unit 50 changes the camera mode to the selectable camera mode in the scrolling direction that is closest to the currently selected camera mode. FIG. 11A This is a diagram used to illustrate the selection of shooting modes when choosing a wide-angle lens. For example... FIG. 11A As shown in Figure 2, if the currently selected camera mode is motion picture mode, and item group 1016 scrolls horizontally to the left a distance L along the display unit 28, then item 1006 (panorama mode), located to the right of item 1005 and available for selection, is selected. FIG. 11AAs shown in Figure 1, if the currently selected video mode is Photo mode, and item group 1016 is scrolled to the left by a distance L less than or equal to Ls, item 1005 is selected. Item 1005 corresponds to the Moving Picture mode. By scrolling a smaller amount than usual, Photo mode can be switched to Moving Picture mode, which is the recommended video mode for using a wide-angle lens. As shown in Table 3, if Panorama mode is selected and a left scroll command is issued, the adjacent Portrait mode is usually selected. However, switching to Portrait mode would interfere with video recording using a wide-angle lens. Therefore, even if item group 1016 is scrolled to the left by a distance L, the grayed-out item 1007 representing Portrait mode will not be selected (skipped). Then, item 1008 representing Manual mode is selected, which is the selectable video mode located to the left of item 1006 and closest to item 1006.

[0144] In step S819, the system control unit 50 determines whether any of the items representing the camera mode has been selected by touch. More specifically, the system control unit 50 determines whether an operation (touch operation) has been performed, i.e., touching items 1004 to 1011 and releasing the touch within a predetermined time period such as 0.5 seconds or 0.2 seconds without moving the touch. If a touch selection is determined, the camera mode is switched even if the selected lens cannot be used to capture an image. Therefore, the process proceeds to step S820 to select the touched camera mode. Figure 5 in Figure 11 shows the state of the user tapping item 1007 corresponding to the portrait mode. Although images cannot be captured in portrait mode when the wide-angle lens is selected, item 1007 can be tapped to switch to the state of selecting item 1007 as shown in Figure 6, i.e., portrait mode. FIG. 11B An example of the display in display unit 28 after selecting portrait mode is shown. FIG. 11B As shown, the magnification represented by item 1001 is 1.0x, indicating that the lens has been switched to a standard lens.

[0145] In step S821, the system control unit 50 determines whether the camera mode selected in step S819 is a camera mode that can only use a standard lens to capture images. In other words, the system control unit 50 determines whether the camera mode is a mode like portrait mode that cannot use a wide-angle or ultra-wide-angle lens to capture images. If yes, the process proceeds to step S802 to perform the process of switching to a standard lens. If no, the process proceeds to step S822.

[0146] In step S822, the system control unit 50 determines whether the camera mode selected in step S819 is a camera mode that can capture images using a wide-angle lens. In other words, the system control unit 50 determines whether the camera mode, like the panorama mode, can capture images using both a standard and wide-angle lens, but cannot capture images only when using an ultra-wide-angle lens. In a camera mode where images cannot be captured using an ultra-wide-angle lens, switching to a standard lens would result in a large change in the field of view. Therefore, the system control unit 50 determines whether images can be captured using a wide-angle lens. If images can be captured using a wide-angle lens, the process proceeds to step S807 to switch to the wide-angle lens. This allows video recording in the user-selected camera mode to be performed while preventing large changes in the field of view. If the result is negative in step S822, the process proceeds to step S823.

[0147] In step S823, the system control unit 50 can recognizablely display one or more lenses selectable in the selected camera mode. FIG. 10D This shows an example of the display when panorama mode is selected. Item 1003a, representing the ultra-wide-angle lens, is grayed out. Items 1002, representing the wide-angle lens, and 1001, representing the standard lens, are displayed without being grayed out. The user can therefore identify that the ultra-wide-angle lens is not selectable in panorama mode.

[0148] In step S824, the system control unit 50 performs a process similar to that in step S817.

[0149] In step S825, whenever a scroll command is issued, the system control unit 50 selects the next item corresponding to the currently selected camera mode based on the scroll direction. In step S818, selectable camera modes are chosen when performing the scroll operation, and unselectable camera modes are not selected and are skipped. Conversely, in step S825, the next camera mode is selected whenever the item group 1016 scrolls a distance L. FIG. 11A This diagram illustrates the switching of camera modes as item group 1016 scrolls a distance L. In Figures 1 to 4, whenever the user scrolls item group 1016 to the left by a distance L, the item corresponding to the camera mode directly below marker 1014 is switched to the next item on the right. Since the display position of marker 1014 on display unit 28 remains unchanged, the item displayed within the display unit's range in Figure 1 changes from time-lapse mode to portrait mode, and in Figure 4, it changes from motion picture mode to manual mode.

[0150] Steps S824 to S827 handle the case where the selected lens is a standard lens, or the case where the lens is switched to a wide-angle or ultra-wide-angle lens in a mode other than still photography mode. In other words, any shooting mode can be selected for a standard lens, and there is no specific shooting mode that needs to be made more difficult to select. If the user does not switch the standard lens selected at startup to a wide-angle or ultra-wide-angle lens, the user may also intend to select a lens after selecting a shooting mode. Therefore, all shooting modes are displayed in parallel (some shooting modes are not highlighted or some are grayed out), and some shooting modes are not made more difficult to select. Therefore, users who want to select a lens after selecting a shooting mode can select the shooting mode and lens with high operability.

[0151] In step S828, the system control unit 50 determines whether a camera command has been issued. A camera command can be issued via a touch operation on item 1012. If a camera command has been issued, the process proceeds to step S829. Otherwise, the process proceeds to step S830.

[0152] In step S829, the system control unit 50 performs image processing. The captured image is recorded on the recording medium 200.

[0153] In step S830, the system control unit 50 determines whether a command to switch to the front-facing camera has been issued. This command can be issued via a touch operation on item 1013 to switch to the front-facing camera (i.e., the second side). If yes, the process continues in step S830. FIG. 9 The front camera shooting mode selection process is then performed. Otherwise, the process proceeds to step S831.

[0154] In step S831, the system control unit 50 determines whether to terminate the camera function. This can be done by pressing the power button 72, scrolling up the display unit 28, or performing a pinch operation similar to pinching a live view image. If it is determined that a command to terminate the camera function has been issued, then... FIG. 8 The processing ends there. Otherwise, the processing proceeds to step S832.

[0155] In step S832, the system control unit 50 determines whether a command to switch the rear camera to the standard lens has been issued. This command can be issued via a touch operation on item 1001. If yes in step S832, the process proceeds to step S802. Otherwise, the process proceeds to step S833.

[0156] In step S833, the system control unit 50 determines whether the currently selected lens is a standard lens. If the currently selected lens is determined to be a standard lens, the process proceeds to step S806. Otherwise, the process proceeds to step S817.

[0157] Next, we will refer to FIG. 9 The flowchart describes the front-facing camera mode selection process according to this exemplary embodiment. This process is achieved by loading a program recorded in non-volatile memory 56 into system memory 52 and executing the program by system control unit 50. FIG. 8 If the determination in step S830 is yes, then the process begins.

[0158] In step S901, the system control unit 50 activates the standard lens of the front-facing camera. In other words, the system control unit 50 activates the standard lens of the second-side front-facing camera, namely the camera of the lens unit 201.

[0159] In step S902, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 201 on the display unit 28.

[0160] In step S903, the system control unit 50 displays group 1017 on the display unit 28, which represents the photo mode, motion picture mode and portrait mode. FIG. 11C This shows an example of the display when the standard lens is activated. When the front camera is activated, the user may be taking images of themselves. Therefore, the number of camera modes available is limited compared to when the rear camera is selected.

[0161] In step S904, the system control unit 50 determines whether a command has been issued to switch the front camera lens to a wide-angle lens. This command can be issued via a touch operation on item 1019. If yes in step S904, the process proceeds to step S905. Otherwise, the process proceeds to step S907.

[0162] In step S905, the system control unit 50 activates the wide-angle lens of the front-facing camera. More specifically, the system control unit 50 activates the wide-angle lens of the second-side front-facing camera, namely the camera of the lens unit 202.

[0163] In step S906, the system control unit 50 continuously displays the captured images (live view images) obtained via the lens unit 202 on the display unit 28. FIG. 11DThis illustrates a display example of display unit 28 when the wide-angle lens of the front-facing camera is activated. The front-facing camera includes a standard lens and a wide-angle lens, both of which can capture images in the same shooting mode. In the case of the front-facing camera, because the variable range of the field of view is not as wide as that of the rear camera, the selectable shooting modes are the same. Therefore, there is no need to make the shooting modes easier or harder to select.

[0164] In step S907, the system control unit 50 determines whether a command has been issued to switch the lens of the front-facing camera to the standard lens. The command to switch to the standard lens can be issued via a touch operation on item 1018. If yes in step S904, the process proceeds to step S905. Otherwise, the process proceeds to step S907.

[0165] In step S908, the system control unit 50 determines whether a camera command has been issued. A camera command can be issued via a touch operation on item 1012. If a camera command has been issued, the process proceeds to step S909. Otherwise, the process proceeds to step S910.

[0166] In step S909, the system control unit 50 performs image processing. The captured image is recorded on the recording medium 200.

[0167] In step S910, the system control unit 50 determines whether a command to switch to the rear camera has been issued. This command can be issued via a touch operation on item 1013. If a command to switch to the rear camera has been issued, the process proceeds to step S802 to activate the standard lens of the rear camera. If the command is not issued in step S910, the process proceeds to step S911.

[0168] In step S911, the system control unit 50 determines whether to terminate the camera function. This can be done by pressing the power button 72, scrolling up the display unit 28, or performing a pinch operation similar to pinching a live view image. If it is determined that a command to terminate the camera function has been issued, then... FIG. 9 The processing ends there. Otherwise, the processing proceeds to step S912.

[0169] Processing in steps S912 to S915 FIG. 8 The processing of steps S824 to S827 is similar. After the processing of step S913 or S915 is completed, the processing proceeds to step S908.

[0170] In step S916, the system control unit 50 determines whether the currently selected lens is a standard lens. If the currently selected lens is determined to be a standard lens, the process proceeds to step S904. Otherwise, the process proceeds to step S907.

[0171] According to the exemplary embodiments described above, users can easily identify the shooting modes that can be used to capture images with the selected lens. More specifically, recommended and unrecommended shooting modes are displayed separately for the lens selected in photo mode (if an unrecommended shooting mode is selected, the lens will be switched). Therefore, users can quickly identify the appropriate shooting mode to choose from at the selected viewpoint. Since unrecommended shooting modes are not hidden, if a user wants to prioritize shooting with the features of a shooting mode over the viewpoint, the user can quickly select such a shooting mode without the hassle of switching lenses.

[0172] In the aforementioned exemplary embodiments, the lens used to capture images is described as switching to a lens capable of capturing images if the video mode is switched to a mode where the lens selected in photo mode cannot capture images. However, since switching lenses in photo mode implies a strong intention for the user to capture images from the selected perspective, the selected video mode can be chosen without changing the perspective. Note, for example, if a wide-angle lens is used, the background blur effect may be less effective in portrait mode. In such cases, the user is informed that the background will not be blurred without switching to a standard lens.

[0173] If the user sets the camera's pixel count to a high value, images will be captured using the wide-angle lens, and video recording using the standard lens may be unavailable. This describes situations where the user sets the pixel count to a predetermined value or higher on the menu screen or camera settings screen—a pixel count or higher that cannot be used to capture images without the wide-angle lens. Video modes that can use the wide-angle or ultra-wide-angle lens of the rear camera are highlighted. Video modes that cannot be captured using the wide-angle or ultra-wide-angle lens are grayed out. If the user attempts to select a grayed-out video mode via a tap operation, a notification will be issued that the lens will be switched and the pixel count will be reduced. If the user checks the notification and switches to that video mode, video recording will be performed by reducing the pixel count and switching to the standard lens. Alternatively, some recommended video modes can be simply highlighted without graying out the unrecommended modes. Conversely, some unrecommended video modes can be grayed out while highlighting the recommended modes. When using a newly selected lens, the recommended or unrecommended shooting modes are changed in the display mode, i.e., grayed out or highlighted depending on the lens selection.

[0174] This also prevents the live view image's perspective from changing when a user who has selected a wide-angle lens switches to a video mode that cannot use a wide-angle lens without the user's intention to switch back to a standard lens. In other words, when a user selects a video mode, the live view image's perspective is prevented from switching to standard or back to wide-angle without the user's intention. This improves the user's visibility.

[0175] To indicate the selected camera mode, the display mode of the item corresponding to the selected camera mode in item group 1016 can be changed. For example, the item size can be increased. The text color can be changed. The item color can be changed. Items corresponding to the selected camera mode, items corresponding to the discouraged camera mode, and items corresponding to the recommended camera mode are displayed in their respective different display modes. All of these items are displayed in a different display mode than the display mode of the unselected camera mode, which is neither recommended nor discouraged. In other words, if a lens is selected and the camera mode becomes unable to use the selected lens, the display mode of the item is changed to a less prominent display mode compared to the display modes of other unselected items. Conversely, if the camera mode becomes recommended for the selected lens, the display mode of the item is changed to a more prominent display mode compared to the display modes of other unselected items.

[0176] In some cases, users can choose whether to save camera settings immediately following the initial camera activation. If a user has already saved previous settings, they may not want to change them. Therefore, the camera mode is displayed based on the lens selected in photo mode. More specifically, recommended and discouraged camera modes can be identified for the lens selected in photo mode. Conversely, users who choose not to save previous settings may have a strong intention to prioritize the most recent settings. In such cases, because the user may want to prioritize the currently selected camera mode over the already set lens type, recommended and discouraged camera modes are not displayed identibly based on the lens, even if the lens has been switched.

[0177] The focal lengths and field of view of the standard, wide-angle, and ultra-wide-angle lenses for the rear and front cameras described above with reference to Figures 3 and 4 are merely examples and not limiting. The rear camera is described as including three types of lenses, and the front camera includes two types of lenses. However, this is not limiting, and it is possible to include three types of lenses or only one type of lens.

[0178] The various types of control described above, performed by the system control unit 50, can be performed by a single piece of hardware. Multiple pieces of hardware (such as a central processing unit [CPU], a microprocessor unit [MPU], and dedicated circuits) can control the entire device by sharing processing.

[0179] The present invention has been described in detail based on preferred exemplary embodiments. However, the invention is not limited to these specific exemplary embodiments, and various modes without departing from the spirit of the invention are also included in the invention. The foregoing exemplary embodiments merely illustrate exemplary embodiments of the invention, and these exemplary embodiments can be appropriately combined.

[0180] The foregoing exemplary embodiments have been described by way of applying the invention to a smartphone. However, this example is not limiting, and the invention can be applied to any electronic device that captures images by switching between multiple lenses with different focal lengths. More specifically, the invention can be applied to digital cameras, portable image readers, printers including viewfinders, digital photo frames, music players, game consoles, and e-book readers, etc.

[0181] (Other exemplary embodiments)

[0182] The present invention is also achieved by performing the following process. This process includes supplying software (programs) for implementing the functions of the aforementioned exemplary embodiments to a system or device via a network or various recording media, and having the system or device's computer (or CPU or MPU, etc.) read and execute the program code. In this case, the program and the non-volatile storage medium storing the program constitute the present invention.

[0183] This invention is not limited to the embodiments described above, and various changes and modifications can be made within the spirit and scope of this invention. Therefore, the appended claims are provided to inform the public of the scope of this invention.

[0184] This application claims priority to Japanese Patent Application Publication No. 2020-125164, filed on July 22, 2020, which is incorporated herein by reference.

Claims

1. An electronic device comprising a first lens and a second lens on a first side, the second lens having a viewing angle different from that of the first lens, the electronic device comprising: A switching unit configured to switch between a first camera image transmitted through the first lens and a second camera image transmitted through the second lens; as well as A control unit is configured to control the display of items corresponding to multiple camera modes, along with captured images, on a display unit to select a camera mode from the multiple camera modes, including a camera mode in which the first camera and the second camera can be switched, and a camera mode in which the first camera is enabled and the second camera is disabled. The control unit is configured to control the first item and the second item to be displayed in different display modes when the second camera is in operation. The first item corresponds to a camera mode suitable for both the first and second cameras, and the second item corresponds to a camera mode suitable for the first camera but not suitable for the second camera.

2. The electronic device according to claim 1, wherein, The control unit is configured to control the first item and the second item to be displayed in the same display mode while the first camera is recording.

3. The electronic device according to claim 1 or 2, wherein, The control unit is configured to change the camera mode and switch to the first camera when the second camera is in operation and an instruction is issued to change the camera mode to enable the first camera and disable the second camera.

4. The electronic device according to any one of claims 1 to 3, wherein, The control unit is configured to control the graying of the second item while the second camera is recording.

5. The electronic device according to claim 4, wherein, The control unit is configured to cancel the grayscale display of the second item based on the switching unit switching the second camera to the first camera.

6. The electronic device according to any one of claims 1 to 5, further comprising a receiving unit configured to receive a first operation or a second operation. in, The control unit is configured to control the selection of the second item while the second camera is in operation, such that the second item cannot be selected by the first operation and the second item can be selected by the second operation, and is configured to control the change to the camera mode corresponding to the second item and switch to the first camera based on the selection of the second item by the second operation.

7. The electronic device according to claim 6, wherein, The control unit is configured to, when the second camera is in progress and the second item is selected through the second operation, control the selection of other items corresponding to other camera modes that enable video recording by the second camera, and to change to other camera modes corresponding to said other items.

8. The electronic device according to claim 6 or 7, wherein, The first operation is a touch operation, and the second operation is a swipe operation.

9. The electronic device according to any one of claims 1 to 8 further includes a display unit.

10. A method for controlling an electronic device, the electronic device including a first lens and a second lens on a first side, the second lens having a viewing angle different from that of the first lens, the method comprising: Switch between the first camera view via the first lens and the second camera view via the second lens; as well as The control display unit displays items corresponding to multiple camera modes, along with captured images, to select a camera mode from the multiple camera modes, including camera modes that allow switching between the first camera and the second camera, and camera modes that enable the first camera and disable the second camera. The control includes, while the second camera is in operation, controlling the first item and the second item to be displayed in different display modes, wherein the first item corresponds to a camera mode suitable for both the first and second cameras, and the second item corresponds to a camera mode suitable for the first camera but not suitable for the second camera.

11. A computer program product for enabling a computer to function as a unit of an electronic device according to any one of claims 1 to 9.

12. A computer-readable storage medium storing a program for enabling a computer to function as a unit of an electronic device according to any one of claims 1 to 9.

Images