Electronic device and its control method
By setting multiple lenses on the electronic device and realizing lens switching, the problem of difficulty in quickly adjusting the field angle in the prior art is solved, and wide field angle photography is realized when the photographer himself is a subject.
Patent Information
- Application Number
- CN202180059973.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-07-22
- Filing Date
- 2021-07-08
- Publication Date
- 2025-06-10
- Estimated Expiration
- 2041-07-08
AI Technical Summary
In the prior art, when the photographer himself acts as a subject, it is difficult to quickly adjust the field angle to achieve wide field angle photography.
An electronic device is designed to be equipped with lenses on the first and second sides, and switch between different lenses through a lens switching section to provide a wider camera angle.
It is realized that the photographer can quickly and operablely adjust the field angle when the photographer himself is a subject, and meets the photographer's demand for wide-field angle photography.
Smart Images

Figure CN116158085B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an electronic device and a control method thereof, and more particularly to a technique for performing imaging via a plurality of lenses. Background Art
[0002] There already exist electronic devices capable of performing imaging from the back side and the front side of the electronic device. Patent Document 1 describes that a plurality of cameras can move in such a way as to be arranged on both the back and the front of the electronic device.
[0003] List of Prior Arts
[0004] Patent Documents
[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2012-222471 Summary of the Invention
[0006] Technical Problem
[0007] In the method described in Patent Document 1, the field angle is not changed according to the direction in which the camera faces. Therefore, when the photographer himself / herself is the subject and desires to perform imaging with a wide field angle, the photographer may not be able to quickly perform imaging with the field angle desired by the photographer.
[0008] In view of the above problems, the present invention provides an electronic device capable of setting a field angle with good operability when the photographer himself / herself is the subject.
[0009] Technical Means for Solving the Problem
[0010] To achieve the above object, the electronic device of the present invention is an electronic device having a first surface and a second surface, and includes: a lens switching unit capable of switching between imaging using a first lens arranged on the first surface and imaging using a second lens, the second lens being capable of performing imaging with an angle wider than that of the first lens; a first instruction unit for issuing an instruction to display a captured image obtained via the lens arranged on the first surface on a display unit; a second instruction unit for issuing an instruction to display a captured image obtained via the lens arranged on the second surface including at least a third lens on the display unit; a switching unit capable of switching between imaging with a first field angle and imaging with a second field angle wider than the first field angle on the second surface; and a control unit for controlling the display of the captured image obtained via the first lens on the display unit when the first instruction unit issues an instruction to display the captured image, and controlling the display of the captured image with the second field angle on the display unit when the second instruction unit issues an instruction to display the captured image.
[0011] Advantageous Effects of the Invention
[0012] According to the present invention, when the photographer himself / herself is the subject, the field angle can be set with good operability. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The drawings included in and constituting a part of the specification illustrate exemplary embodiments of the present invention and, together with the description of the present invention, are used to describe the principles of the present invention.
[0014] Figure 1A is an external view of a smart phone as an example of a device having a configuration to which this exemplary embodiment can be applied.
[0015] Figure 1B is an external view of a smart phone as an example of a device having a configuration to which this exemplary embodiment can be applied.
[0016] Figure 2 is a block diagram showing a configuration example of a smart phone as an example of a device having a configuration to which this exemplary embodiment can be applied.
[0017] Figure 3A is a diagram showing each lens unit of the smart phone 100 according to this exemplary embodiment.
[0018] Figure 3B is a diagram showing each lens unit of the smart phone 100 according to this exemplary embodiment.
[0019] Figure 4A is a diagram showing each lens unit of the smart phone 100 according to this exemplary embodiment.
[0020] Figure 4B is a diagram showing each lens unit of the smart phone 100 according to this exemplary embodiment.
[0021] Figure 5 is a flowchart showing the imaging control process according to this exemplary embodiment.
[0022] Figure 6 is a flowchart showing the imaging control process of the front camera according to this exemplary embodiment.
[0023] Figure 7A is a diagram showing an example of the display in the imaging control process.
[0024] Figure 7B is a diagram showing an example of the display in the imaging control process.
[0025] Figure 7C is a diagram showing an example of the display in the imaging control process.
[0026] Figure 7DIt is a diagram showing an example of display in the camera control process.
[0027] Figure 7E It is a diagram showing an example of display in the camera control process.
[0028] Figure 7F It is a diagram showing an example of display in the camera control process.
[0029] Figure 7G It is a diagram showing an example of display in the camera control process.
[0030] Figure 7H It is a diagram showing an example of display in the camera control process.
[0031] Figure 7I It is a diagram showing an example of display in the camera control process.
[0032] Figure 7J It is a diagram showing an example of display in the camera control process.
[0033] Figure 7K It is a diagram showing an example of display in the camera control process.
[0034] Figure 8 It is a flowchart showing the camera mode selection process according to this exemplary embodiment.
[0035] Figure 9 It is a flowchart showing the camera mode selection process of the front camera according to this exemplary embodiment.
[0036] Figure 10A It is a diagram showing an example of display in the camera mode selection process.
[0037] Figure 10B It is a diagram showing an example of display in the camera mode selection process.
[0038] Figure 10C It is a diagram showing an example of display in the camera mode selection process.
[0039] Figure 10D It is a diagram showing an example of display in the camera mode selection process.
[0040] Figure 10E It is a diagram showing an example of display in the camera mode selection process.
[0041] Figure 11A It is a diagram showing an example of display in the camera mode selection process.
[0042] Figure 11B It is a diagram showing an example of display in the camera mode selection process.
[0043] Figure 11C It is a diagram showing an example of the display in the camera mode selection process.
[0044] Figure 11D It is a diagram showing an example of the display in the camera mode selection process. Detailed Description of the Invention
[0045] Hereinafter, preferred exemplary embodiments of the present invention will be described with reference to the accompanying drawings.
[0046] Figure 1A and Figure 1B It is an external view of the smart phone 100 which is an example of the electronic device of the present invention. Figure 1A It shows the back side which is the opposite side of the display surface of the smart phone 100, and Figure 1B it shows the display surface side of the smart phone 100.
[0047] The display unit 28 is a display unit that displays images and various types of information, and includes a touch panel 70a that can detect a touch operation performed on the display unit 28. The up key 61 is a button that can issue a volume increase instruction and a camera instruction. The down key 60 is a button that can issue a volume decrease instruction and, when pressed simultaneously with the power switch 72, a recording instruction for an image displayed on the display unit 28. The power switch 72 is a button for switching between power on and power off. Three lens units are arranged on the first surface (back side), which is the side where the display unit 28 of the smart phone 100 is not provided, and two cameras are arranged on the second surface (front side), which is the side where the display unit 28 is provided. The focal lengths of the lens unit and the camera are different from each other, so the angular field of view that the lens unit and the camera can capture is different. By switching the lens between the lens arranged on the first surface and the lens arranged on the second surface, the user can change whether to stand on the display unit 28 side and take an image including the user holding the smart phone 100. In addition, by using the lens arranged on the second surface, the user can capture an image while checking the image being captured on the display unit 28.
[0048] Figure 2 It is a block diagram showing a configuration example of the smart phone 100 according to the present exemplary embodiment.
[0049] The smart phone 100 includes lens units 201 to 205. The lens units 201 and 202 are arranged on the second surface, and the lens units 203, 204, and 205 are arranged on the first surface. The lenses 103a to 103e indicate the lenses included in each lens unit. Some lens units include a plurality of lenses, but for simplicity, Figure 2 only one lens is shown as the lens included in each lens unit.
[0050] The lens unit 201 is a standard lens, and the lens unit 202 is a wide-angle lens. When using the lens of the lens unit 202, an image can be captured at a wider field angle than when using the lens of the lens unit 201. The lens unit 203 is a standard lens, the lens unit 204 is a wide-angle lens, and the lens unit 205 is an ultra-wide-angle lens. The lens unit 204 can capture an image at a wider field angle than the lens unit 203, and the lens unit 205 can capture an image at a wider field angle than the lens unit 204. Alternatively, in the case where the lenses arranged on the first surface are a standard lens, a wide-angle lens, and a telephoto lens, the following configuration is adopted.
[0051] The lens unit 201 is a standard lens, and the lens unit 202 is a wide-angle lens. When using the lens of the lens unit 202, an image can be captured at a wider field angle than when using the lens of the lens unit 201. The lens unit 203 is a telephoto lens, the lens unit 204 is a standard lens, and the lens unit 205 is a wide-angle lens. The lens unit 204 can capture an image at a wider field angle than the lens unit 203, and the lens unit 205 can capture an image at a wider field angle than the lens unit 204.
[0052] Regardless of the type of the lens arranged on the first surface, the following configuration is obtained as follows.
[0053] The shutters 101a to 101e are shutters having an aperture function. The imaging units 22a to 22e are image sensors each including a charge-coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor that converts an optical image into an electrical signal. The analog-to-digital (A / D) converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.
[0054] A CCD sensor or a CMOS sensor is generally used for an image sensor. The image sensor performs photoelectric conversion on the subject image formed on the image sensor through the lens units 201 to 205, and outputs the converted subject image as an electrical signal.
[0055] The image processing unit 24 performs size adjustment processing (such as predetermined pixel interpolation or reduction, etc.) and color conversion processing on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined calculation processing using the data of the captured image. The system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. Thus, automatic focusing (AF) processing, automatic exposure (AE) processing, and electronic flash pre-flash (EF) processing are performed through the lens (TTL) system. The image processing unit 24 also performs predetermined calculation processing using the data of the captured image, and also performs TTL system automatic white balance (AWB) processing based on the obtained calculation results.
[0056] The output data from the A / D converter 23 is directly written into the memory 32 via the image processing unit 24 and the memory control unit 15, or via the memory control unit 15. The memory 32 stores the image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, and the image data to be displayed on the display unit 28. The storage capacity of the memory 32 is sufficient to store a predetermined number of still images, as well as moving images and voices of a predetermined time length.
[0057] The power control unit 80 includes a battery detection circuit, a direct current (DC)-DC converter, and a switch circuit for switching the blocks to be powered. The power control unit 80 detects whether a battery is attached, the type of the battery, and the remaining battery power. The power control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies a necessary voltage to the components including the recording medium 200 during a necessary time period. If the power switch 72 is long-pressed (continuously pressed for a predetermined time such as more than two seconds or three seconds), the power of the smart phone 100 can be switched between on (ON) and off (OFF). In addition, if the period for pressing the power switch 72 is shorter than the predetermined time, the display state on the display unit 28 can be switched between a non-display state and a display state.
[0058] The power supply unit 30 includes a primary battery (such as an alkaline battery or a lithium battery), a secondary battery (such as a nickel-cadmium (NiCd) battery, a nickel-metal hydride (NiMH) battery, or a lithium-ion (Li) battery), and an alternating current (AC) adapter.
[0059] The recording medium interface (I / F) 18 is an interface with the recording medium 200, such as a memory card or a hard disk, etc. The recording medium 200 is a recording medium (such as a memory card, etc.) for recording captured images, downloaded music, and videos, and includes a semiconductor memory or a disk.
[0060] The communication unit 54 is wirelessly connected or connected via a wired cable, and transmits or receives video signals and audio signals. The communication unit 54 can also be connected to a wireless local area network (LAN) and the Internet. The communication unit 54 can transmit images (including live view) captured by the imaging unit 22 and images recorded on the recording medium 200. The communication unit 54 can also receive image data and various other types of information from external devices.
[0061] The posture detection unit 55 detects the posture of the smart phone 100 relative to the direction of gravity. Based on the posture detected by the posture detection unit 55, it can be determined whether the image captured by the imaging unit 22 is an image captured by the smart phone 100 held horizontally or an image captured by the smart phone 100 held vertically. The system control unit 50 can add posture information corresponding to the posture detected by the posture detection unit 55 to the image file of the image captured by the imaging unit 22, or record the rotated image. As the posture detection unit 55, an acceleration sensor or a gyro sensor can be used.
[0062] The system timer 53 is a time measurement unit for measuring the time for various types of control or the time of the built-in clock.
[0063] The down key 60, the up key 61, and the operation unit 70 function as an operation unit for inputting various operation instructions into the system control unit 50.
[0064] Constants and variables for operating the system control unit 50, and programs read out from the non-volatile memory 56 are loaded into the system memory 52. The system control unit also performs display control by using the random access memory (RAM) to control the memory 32, the digital-to-analog (D / A) converter 13, and the display unit 28.
[0065] The non-volatile memory 56 is a memory that can be electrically erased / recorded by the system control unit 50. For example, an electrically erasable programmable read-only memory (EEPROM) is used for the non-volatile memory 56. Constants and programs for operating the system control unit 50 are stored in the non-volatile memory 56. Here, the program refers to a program for executing various flowcharts described below in this exemplary embodiment.
[0066] The system control unit 50 includes at least one processor and controls the entire smart phone 100. The system control unit 50 implements each process in this exemplary embodiment, which will be described below by executing the above program recorded in the non-volatile memory 56.
[0067] The operation unit 70 includes a touch panel 70a capable of detecting a touch operation, and a switch for switching to a silent mode. The operation unit 70 also includes an up key 61, a down key 60, and a power switch 72.
[0068] The memory 32 also serves as a memory (video memory) for image display. The D / A converter 13 converts the data for image display stored in the memory 32 into an analog signal, and supplies the analog signal to the display unit 28. The image data for display written to the memory 32 in this way is displayed by the display unit 28 via the D / A converter 13. The display unit 28 performs display corresponding to the analog signal from the D / A converter 13 on a display device such as a liquid crystal display (LCD). The digital signal that has been A / D converted once by the A / D converter 23 and stored in the memory 32 is D / A converted by the D / A converter 13, sequentially transmitted to the display unit 28, and displayed thereon. This enables the function as an electronic viewfinder to perform live view display.
[0069] Figure 3A , Figure 3B , Figure 4A and Figure 4B are diagrams showing the imaging field angle, focal length, and display magnification of each lens unit of the smartphone 100. Figure 3A and Figure 3B show the following: The rear camera on the first side includes an ultra-wide-angle lens, a wide-angle lens, and a standard lens, and the front camera on the second side includes a wide-angle lens and a standard lens.
[0070] Figure 3A show the lenses included in each lens unit corresponding to the lens unit (rear camera) on the first side and the lens unit (front camera) on the second side. In the lens unit on the first side, the focal length of the ultra-wide-angle lens corresponding to the lens unit 205 is 10 mm, and the imaging field angle is 130 degrees. In addition, the focal length of the wide-angle lens corresponding to the lens unit 204 is 20 mm, and the imaging field angle is 80 degrees, and the focal length of the standard lens corresponding to the lens unit 203 is 30 mm, and the imaging field angle is 60 degrees. In the lens unit on the second side, the focal length of the wide-angle lens corresponding to the lens unit 202 is 15 mm, and the imaging field angle is 110 degrees, and the focal length of the standard lens corresponding to the lens unit 201 is 25 mm, and the imaging field angle is 70 degrees.
[0071] In the lens unit on the first side, an image is captured by the lens unit 205 at a shooting field angle of 130 degrees, and when the specified shooting field angle is less than 130 degrees and greater than 80 degrees, the electronic zoom is used to reduce the shooting field angle. If the shooting field angle reaches 80 degrees, the shooting is switched to the shooting by the lens of the lens unit 204. In addition, an image is captured by the lens unit 204 at a shooting field angle of 80 degrees, and when the specified shooting field angle is less than 80 degrees and greater than 60 degrees, the electronic zoom is used to reduce the shooting field angle. If the specified shooting field angle reaches 60 degrees, the shooting is switched to the shooting by the lens of the lens unit 203. The method of specifying the shooting field angle will be described below. By switching the lens, the user can change the field angle of the captured image. In this way, if the user issues a field angle change instruction, while using the electronic zoom, at the timing of issuing an instruction to change the field angle to a shooting field angle at which the adjacent lens unit can perform shooting, the lens unit performing the shooting is switched. Similarly, also in the case of the second side, an image is captured by the lens unit 202 at a shooting field angle of 110 degrees, and if the specified shooting field angle becomes less than 110 degrees and greater than 70 degrees, the electronic zoom is used to reduce the shooting field angle. The captured image at the specified field angle (the captured image via the lens suitable for the specified field angle) is displayed on the display unit 28. If the specified shooting field angle reaches 70 degrees, the shooting is switched to the shooting by the lens of the lens unit 201. In the present exemplary embodiment, each lens does not need to be a single-focus lens, and may have a configuration in which the lens position can be changed and optical zoom can be performed.
[0072] Figure 3B FIG. is a diagram showing the switching of the lens unit on the first side when the lens unit can perform optical zoom. In the lens unit on the first side, an image is captured by the lens unit 205 at a shooting field angle of 130 degrees, and if the specified shooting field angle becomes less than 130 degrees, initially optical zoom is performed by moving the position of the lens. Then, if the specified shooting field angle reaches 110 degrees, the electronic zoom is used to reduce the shooting field angle. If the shooting field angle reaches 80 degrees, the shooting is switched to the shooting by the lens of the lens unit 204. In addition, if the specified shooting field angle becomes less than 80 degrees, the optical zoom is used to change the shooting field angle, and if the specified shooting field angle becomes less than 70 degrees, the electronic zoom is performed. If the specified shooting field angle reaches 60 degrees, the shooting is performed using the lens unit 203. If the specified shooting field angle becomes less than 60 degrees, the electronic zoom is performed using the lens unit 203. A configuration can be adopted in which only a single-focus lens is used as the lens of the front camera on the second side, and the lens of the rear camera on the first side can perform optical zoom. In addition, in Figure 3A the case shown in Figure 3BIn the case shown, the timing for switching the lens unit that performs imaging to reduce the imaging field angle does not always need to be the same as the timing for switching the lens unit to increase the imaging field angle. Depending on the imaging mode and imaging conditions, the switching timing of the lens unit that performs imaging can be changed in a manner that reduces the impact on the captured image.
[0073] Figure 4A and Figure 4B shows a case where the rear camera on the first side includes a wide-angle lens, a standard lens, and a telephoto lens, and the front camera on the second side includes a wide-angle lens and a standard lens.
[0074] Figure 4A shows the lenses included in each lens unit corresponding to the lens unit (rear camera) on the first side and the lens unit (front camera) on the second side. In the lens unit on the first side, the focal length of the wide-angle lens corresponding to lens unit 205 is 15 mm, and the imaging field angle is 110 degrees. In addition, the focal length of the standard lens corresponding to lens unit 204 is 20 mm, the imaging field angle is 80 degrees, and the focal length of the telephoto lens corresponding to lens unit 203 is 80 mm, and the imaging field angle is 20 degrees. In the lens unit on the second side, the focal length of the wide-angle lens corresponding to lens unit 202 is 20 mm, and the imaging field angle is 110 degrees, and the focal length of the standard lens corresponding to lens unit 201 is 30 mm, and the imaging field angle is 70 degrees.
[0075] In the lens unit on the first side, an image is captured by the lens unit 205 at a shooting field angle of 110 degrees. And when the specified shooting field angle is less than 110 degrees and greater than 80 degrees, the shooting field angle is reduced using electronic zoom. If the shooting field angle reaches 80 degrees, the shooting is switched to the shooting by the lens of the lens unit 204. In addition, an image is captured by the lens unit 204 at a shooting field angle of 80 degrees. And when the specified shooting field angle is less than 80 degrees and greater than 30 degrees, the shooting field angle is reduced using electronic zoom. However, the timing to switch to the telephoto lens does not always need to be when the specified shooting field angle becomes 20 degrees. If the specified shooting field angle reaches 20 degrees, the shooting is switched to the shooting by the lens of the lens unit 203. The method of specifying the shooting field angle will be described below. In this way, if the user issues a field angle change instruction, while using electronic zoom, at the timing of issuing an instruction to change the field angle to a shooting field angle at which an adjacent lens unit can perform shooting, the lens unit for performing shooting is switched. Similarly, also in the case of the second side, an image is captured by the lens unit 202 at a shooting field angle of 110 degrees. And if the specified shooting field angle becomes less than 110 degrees and greater than 70 degrees, the shooting field angle is reduced using electronic zoom. If the specified shooting field angle reaches 70 degrees, the shooting is switched to the shooting by the lens of the lens unit 201. In this exemplary embodiment, each lens does not need to be a single-focus lens and can have a configuration in which the lens position is movable and optical zoom can be performed.
[0076] Figure 4B FIG. is a diagram showing the switching of the lens unit on the first side when the lens unit can perform optical zoom. In the lens unit on the first side, an image is captured by the lens unit 205 at a shooting field angle of 130 degrees. And if the specified shooting field angle becomes less than 130 degrees, initially optical zoom is performed by moving the position of the lens. Then, if the specified shooting field angle reaches 110 degrees, the shooting field angle is reduced using electronic zoom. If the shooting field angle reaches 80 degrees, the shooting is switched to the shooting by the lens of the lens unit 204. In addition, if the specified shooting field angle becomes less than 80 degrees, the shooting field angle is changed using optical zoom. And if the specified shooting field angle becomes less than 70 degrees, electronic zoom is performed. If the specified shooting field angle reaches 20 degrees, shooting is performed using the lens unit 203. If the specified shooting field angle becomes less than 20 degrees, electronic zoom is performed using the lens unit 203. A configuration can be adopted in which only a single-focus lens is used as the lens of the front camera on the second side, and the lens of the rear camera on the first side can perform optical zoom. In addition, in Figure 4A the situation shown in Figure 4BIn the case shown, the timing for switching the lens unit that performs imaging to reduce the imaging field angle does not always need to be the same as the timing for switching the lens unit to increase the imaging field angle. Depending on the imaging mode and imaging conditions, the switching timing of the lens unit that performs imaging can be changed in a manner that reduces the impact on the captured image.
[0077] Next, the imaging control process according to this exemplary embodiment will be described with reference to the Figure 5 and Figure 6 flowcharts. This process is implemented by loading the program recorded in the non-volatile memory 56 onto the system memory 52 and the system control unit 50 executing this program. When the power of the smart phone 100 is turned on, the process starts. Figure 5 and Figure 6 The imaging control process shown in assumes that the rear camera on the first side includes a wide-angle lens, a standard lens, and a telephoto lens, and the front camera on the second side includes a wide-angle lens and a standard lens. In other words, it will be assumed that the lens units shown in Figure 4A and Figure 4B are arranged on the smart phone for description, but the configuration is not limited to this.
[0078] In step S501, the system control unit 50 determines whether a camera function start instruction has been issued. The camera function start instruction can be issued by touching the camera item displayed on the display unit 28. If it is determined that a camera function start instruction has been issued (Yes in step S501), the process proceeds to step S502. If it is determined that no camera function start instruction has been issued (No in step S501), the process proceeds to step S503.
[0079] In step S502, the system control unit 50 activates the standard lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 204. In other words, if the camera function is activated, the rear camera is activated. As described below, after the rear camera is activated, the rear camera can be switched to the camera on the second side (i.e., the front camera).
[0080] In step S503, the system control unit 50 performs other processing. Examples of other processing include the reproduction of images acquired via the lens units 201 to 205, browsing on the Internet, and image editing.
[0081] In step S504, the system control unit 50 sequentially displays the captured images (live view images) acquired via the lens unit 204 on the display unit 28.
[0082] In step S505, the system control unit 50 displays the imaging settings available for the standard lens (lens unit 204). Figures 7A to 7K Each shows Figure 5 and Figure 6 an example of the display in the imaging control process shown in. Figure 7A An example of the display of the display unit 28 to be displayed when starting the rear camera is shown. Item 704 is an item for changing the aperture value, and item 705 is an item for changing the beauty effect. When an image including a person is captured by the standard lens of the rear camera, the face may appear large. Therefore, it is desirable to provide a beauty effect. In addition, Figure 7A Item 702 shown in is an item for issuing an imaging instruction, and item 703 is an item for switching to imaging with the front camera. Items 700 and 708 to 710 are items for switching the imaging mode. When the camera is started, the photo mode indicated by item 700 is selected, but the camera can be started in a state where the imaging mode set when the user last started the camera is selected. Item 708 indicates the video mode, and video can be captured. Item 709 indicates the portrait mode, and an image can be captured in a state where the subject in the background of the main subject is blurred. Item 710 indicates the delay mode. In the delay mode, images are continuously reproduced by capturing images at predetermined intervals (such as 2 seconds or 5 seconds, etc.).
[0083] In step S506, the system control unit 50 displays "1.0× (1×)" as the imaging magnification on the display unit 28. As Figure 7A shown, item 701 indicates the current imaging magnification, and "1.0×" is displayed at startup. In other words, when the imaging field angle of imaging performed with the Figure 4A shown standard lens is 80 degrees, the imaging magnification is displayed as 1.0×. In other words, by displaying "1.0×" as the field angle set when the standard lens does not perform electronic zoom, the user can recognize that the field angle can be changed by decreasing or increasing the field angle based on the currently displayed field angle.
[0084] In step S507, the system control unit 50 determines whether an instruction to switch to the wide-angle lens has been issued. If it is determined that an instruction to switch to the wide-angle lens has been issued (Yes in step S507), the process proceeds to step S508. If it is determined that an instruction to switch to the wide-angle lens has not been issued (No in step S507), the process proceeds to step S512. In step S512, the system control unit 50 determines whether an instruction to switch to the telephoto lens has been issued. If it is determined in step S512 that an instruction to switch to the telephoto lens has been issued (Yes in step S512), the process proceeds to step S513. If it is determined that an instruction to switch to the telephoto lens has not been issued (No in step S512), the process proceeds to step S521. The instruction to switch to the wide-angle lens can be issued by a touch operation on item 701 displayed on the display unit 28. For example, if a tap operation of briefly touching item 701 is performed, the wide-angle lens of the lens unit 205 is activated, and if a further tap operation is performed again, the telephoto lens of the lens unit 203 is activated.
[0085] In step S508, the system control unit 50 activates the wide-angle lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 205.
[0086] In step S509, the system control unit 50 sequentially displays on the display unit 28 the captured images (live view images) acquired via the lens unit 205.
[0087] In step S510, the system control unit 50 displays the shooting settings available for the wide-angle lens (lens unit 205). Figure 7B Shows a display example of the display unit 28 to be displayed when the wide-angle lens is activated in the lens of the rear camera. Item 704 is an item for changing the aperture value, and item 706 is an item for performing the process of correcting distortion. In the image captured by the wide-angle lens of the rear camera, distortion sometimes becomes obvious. Therefore, by performing the image processing for correcting distortion, the distortion can be made less obvious. In addition to these items, the same items as those Figure 7A shown in are also displayed.
[0088] In step S511, the system control unit 50 displays "0.5×" as the shooting magnification on the display unit 28. As Figure 7B shown, item 707 indicates the current shooting magnification, and it can be seen that the displayed magnification is smaller than that of the standard lens (i.e., the shooting field angle becomes wider). In other words, when using Figure 4AWhen the field angle of view of the imaging performed by the wide-angle lens shown is 110 degrees, the imaging magnification is displayed as 0.5× (less than 1×). In other words, by displaying "0.5×" as the field angle set when the wide-angle lens does not perform electronic zoom, the user can recognize that the currently displayed field angle has become larger than that of the standard lens.
[0089] In step S513, the system control unit 50 activates the telephoto lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 203.
[0090] In step S514, the system control unit 50 sequentially displays the captured images (live view images) acquired via the lens unit 203 on the display unit 28.
[0091] In step S515, the system control unit 50 displays the imaging settings available for the telephoto lens (lens unit 203). Figure 7C The display example of the display unit 28 to be displayed when the telephoto lens is activated in the lens of the rear camera is shown. Item 704 is an item for changing the aperture value. In the imaging performed by the telephoto lens of the rear camera, items 705 and 706 displayed when using other imaging magnifications are not displayed. In addition to these items, the same items as those shown in Figure 7A are also displayed.
[0092] In step S516, the system control unit 50 displays "2.0×" as the imaging magnification on the display unit 28. As Figure 7C shown, item 708 indicates the magnification of the current imaging, and it can be seen that the displayed magnification is greater than that of the standard lens (that is, the field angle of view becomes narrower). In other words, when the field angle of view of the imaging performed by the telephoto lens shown in Figure 4A is 30 degrees, the imaging magnification is displayed as 2.0×. In other words, by displaying "2.0×" as the field angle set when the wide-angle lens does not perform electronic zoom, the user can recognize that the currently displayed field angle has become smaller than that of the standard lens.
[0093] In video shooting using the rear camera, with a standard lens or a wide-angle lens, a person is usually regarded as the subject, or a landscape image is usually shot. In addition, a telephoto lens is used to shoot an image of a distant subject. Moreover, three lenses are provided, the number of which is greater than that of the front camera on the second side, and the range of the field angle for video shooting is also large. Therefore, when "1.0×" is displayed, it can be recognized that the reference shooting magnification (i.e., a lens other than the wide-angle side or telephoto side lens) is used, and it can be recognized that there is a lens capable of shooting video with a wider or more telephoto field angle than the currently used lens. In other words, if "1.0×" is displayed as the shooting magnification in a state where three or more lenses are provided, it is easier for the user to recognize that the magnification can be changed to a magnification less than 1.0× or greater than 1.0×.
[0094] In step S517, the system control unit 50 determines whether an instruction to switch to the standard lens has been issued. The switch from the wide-angle lens to the standard lens can be performed by a touch operation on item 708. By touching items 701, 707, and 708, the shooting magnification is sequentially selected in a switching manner. In other words, the shooting magnification is switched in the order of 1.0×, 0.5×, and 2.0×, but the order is not limited to this. Items 701, 707, and 708 can always be displayed together with the live view image and enable the user to select any one of them. When it is determined that an instruction to switch to the standard lens has been issued (Yes in step S517), the process proceeds to step S502. When it is determined that an instruction to switch to the standard lens has not been issued (No in step S517), the process proceeds to step S518.
[0095] In step S518, the system control unit 50 determines whether an operation to change the shooting magnification has been performed. Regarding the change of the shooting magnification, after a long press operation on item 701, item 711 as shown Figure 7D is displayed, and the shooting magnification can be changed by a touch movement on the bar of item 711. Item 711 indicates the settable shooting magnifications. By moving the touch position, the user can set the shooting magnification while viewing the live view screen. When the user releases the touch, item 711 is hidden. When it is determined that an operation to change the shooting magnification has been performed (Yes in step S518), the process proceeds to step S519. When it is determined that an operation to change the shooting magnification has not been performed (No in step S518), the process proceeds to step S521.
[0096] In step S519, the system control unit 50 acquires the imaging magnification specified by the touch operation on item 711. In step S520, the system control unit 50 determines the lens corresponding to the acquired imaging magnification from among the telephoto lens, the standard lens, and the wide-angle lens. For example, if a magnification greater than 1.0× and less than 2.0× is specified by the touch operation on item 711, the standard lens is selected. If a magnification less than 1.0× is selected, the wide-angle lens is selected, and if a magnification equal to or greater than 2.0× is selected, the telephoto lens is selected. When it is determined that the standard lens is selected, the process proceeds to step S502. When it is determined that the wide-angle lens is selected, the process proceeds to step S508. When it is determined that the telephoto lens is selected, the process proceeds to step S513.
[0097] In step S521, the system control unit 50 determines whether a shooting instruction has been issued. The shooting instruction can be issued by a touch operation on item 702. When it is determined that a shooting instruction has been issued (Yes in step S521), the process proceeds to step S522. When it is determined that no shooting instruction has been issued (No in step S521), the process proceeds to step S523.
[0098] In step S522, the system control unit 50 performs shooting processing. The system control unit 50 records the captured image on the recording medium 200.
[0099] In step S523, the system control unit 50 determines whether an instruction to switch to the front camera has been issued. That is, the system control unit 50 determines whether an instruction to switch to the camera on the second side has been issued. The instruction to switch to the front camera can be issued by a touch operation on item 703. When it is determined that an instruction to switch to the front camera has been issued (Yes in step S523), the process proceeds to Figure 6 the shooting control processing of the front camera shown in. When it is determined that no instruction to switch to the front camera has been issued (No in step S523), the process proceeds to step S524.
[0100] In step S524, the system control unit 50 determines whether to end the camera function. The instruction to end the camera function can be issued by pressing the power switch 72, an operation of scrolling up the display unit 28, or a pinch operation on the live view image. When it is determined that an instruction to end the camera function has been issued (Yes in step S524), Figure 5 the processing shown in ends. When it is determined that no instruction to end the camera function has been issued (No in step S524), the process proceeds to step S525.
[0101] In step S525, the system control unit 50 determines whether the currently used lens is a standard lens. When the currently used lens is a standard lens (Yes in step S525), the process proceeds to step S507. When the currently used lens is not a standard lens (No in step S525), the process proceeds to step S517.
[0102] Next, the imaging control process of the front camera according to the present exemplary embodiment will be described with reference to Figure 6 This process starts when it is determined in step S523 that a command to switch to the front camera has been issued (Yes in step S523) of Figure 5 .
[0103] In step S601, the system control unit 50 activates the wide-angle lens in the lens of the front camera on the second side. That is, the system control unit 50 activates the camera of the lens unit 202. In other words, if a command to activate the front camera is issued, the wide-angle side camera is initially activated. In the case where a command to activate the front camera is issued in this way, a user who desires to perform imaging on the wide-angle side does not need to perform an operation of changing the field angle from the field angle of the standard lens to the wide-angle side by activating the wide-angle side lens. The front camera is activated at the wide-angle end, and the user can thus recognize the limit at which the field angle cannot be made wider due to optical requirements. When the front camera is activated, the user can recognize the wide-angle end (i.e., the maximum field angle at which imaging can be performed), and the user can thus easily consider the range in which imaging can be performed and consider whether to narrow the imaging range.
[0104] In step S602, the system control unit 50 sequentially displays the captured images (live view images) acquired via the lens unit 201 on the display unit 28.
[0105] In step S603, the system control unit 50 displays the imaging settings available for the wide-angle lens (lens unit 202). Figure 7E A display example of the display unit 28 to be displayed when the front camera is activated is shown. Item 704 is an item for changing the aperture value, and item 705 is an item for changing the beauty effect. When an image including a person is captured by the wide-angle lens of the front camera, the face may appear larger. Therefore, it is desirable to provide a beauty effect. When the front camera is activated, the photo mode indicated by item 700 is selected, but the camera can be activated in a state where the imaging mode set when the user last activated the camera is selected.
[0106] In step S604, the system control unit 50 displays "1.0×" as the imaging magnification on the display unit 28. As Figure 7EAs shown, item 712 indicates the magnification of the current shooting, and "1.0×" is displayed at startup. In other words, when the shooting field angle of the shooting performed with the wide-angle lens shown in Figure 4B is 110 degrees, the shooting magnification is displayed as 1.0×. In other words, by displaying "1.0×" as the field angle set when the wide-angle lens does not perform electronic zoom, the user can recognize that if the field angle is changed based on the currently displayed field angle, the field angle will become even larger.
[0107] In step S605, the system control unit 50 determines whether an instruction to switch to the standard lens has been issued. If it is determined that an instruction to switch to the standard lens has been issued (Yes in step S605), the process proceeds to step S607. If it is determined that an instruction to switch to the standard lens has not been issued (No in step S605), the process proceeds to step S610. The instruction to switch to the standard lens can be issued by a touch operation on item 712 displayed on the display unit 28. For example, if a tap operation of briefly touching item 712 is performed, the standard lens of the lens unit 201 is activated.
[0108] In step S606, the system control unit 50 activates the standard lens in the lens of the front camera on the second side. That is, the system control unit 50 activates the camera of the lens unit 201.
[0109] In step S607, the system control unit 50 sequentially displays the captured images (live view images) acquired via the lens unit 201 on the display unit 28.
[0110] In step S608, the system control unit 50 displays the shooting settings available for the standard lens (lens unit 201). Figure 7F Shows a display example of the display unit 28 to be displayed when the standard lens is activated in the lens of the front camera. Item 704 is an item for changing the aperture value, and item 705 is an item for changing the beauty effect. In addition to these items, the same items as those shown in Figure 7A are also displayed.
[0111] In step S609, the system control unit 50 displays "2.0×" as the shooting magnification on the display unit 28. As Figure 7F shown, item 713 indicates the magnification of the current shooting, and it can be seen that the displayed magnification has become greater than 1.0× (i.e., the shooting field angle has become narrower). In other words, when using Figure 4AWhen the field of view angle of the imaging performed by the standard lens shown is 70 degrees, the imaging magnification is displayed as 2.0×. In other words, by displaying "2.0×" as the field of view angle set when the standard lens does not perform electronic zoom, the user can recognize that the currently displayed field of view angle can be made larger. If "1.0×" is displayed as the imaging magnification even when using the standard lens, it can be recognized that the current field of view angle can be changed to a field of view angle corresponding to a magnification greater than 1.0× using electronic zoom, and the field of view angle can be reduced, but it is difficult to intuitively recognize whether the field of view angle can be made larger than the current field of view angle. In other words, when "1.0×" is displayed as the imaging magnification, it can be seen that electronic zoom can be used to reduce the field of view angle, but it is difficult to recognize whether there is a lens capable of imaging with a wider field of view angle than the currently used lens. However, when the standard lens and the wide-angle lens are set, if "2.0×" (a magnification greater than 1.0×) is displayed when using the standard lens, the user can recognize that the current field of view angle is the field of view angle enlarged from a certain field of view angle to 2.0×. Then, the user can recognize that the current field of view angle can be changed to the non-enlarged field of view angle. That is, the user can recognize that imaging can be performed with a wider field of view angle. On the other hand, when the standard lens and the wide-angle lens are set, if "1.0×" is displayed when using the wide-angle lens, the user can at least recognize that the imaging magnification can be changed to a magnification greater than 1.0× using electronic zoom. Therefore, the user can recognize that the current imaging field of view angle is a wider field of view angle within the range of changeable field of view angles, and imaging can be performed with this imaging field of view angle.
[0112] In step S610, the system control unit 50 detects the size of the face and the number of faces in the image being captured from the live view image.
[0113] In step S611, the system control unit 50 determines whether the total area (size) of the face obtained in step S610 is smaller than a predetermined size or the number of faces is one, or whether neither of these conditions is satisfied. In the case where it is determined that any one of the conditions is satisfied ( "Yes" in step S611), the process proceeds to step S606. In the case where it is determined that neither of these conditions is satisfied ( "No" in step S611), the process proceeds to step S613. If the area of the region including the face in the entire live view image is smaller than a predetermined size (area) such as 1 / 5 or 1 / 8 of the entire live view image, then even without using a wide-angle lens for imaging, the camera and the subject may be sufficiently separated from each other. Therefore, in this case, if a standard lens is used for imaging, an image with a relatively large size of the user's face can be captured. On the other hand, if the user's face is not sufficiently separated, then in the case of using a standard lens for imaging, the field angle is adjusted accordingly so as not to include the hand holding the smartphone, making it difficult to perform imaging from a position sufficiently higher than the face. Therefore, sometimes a captured image in which the user's face appears larger is obtained. If the distance between the camera and the subject is sufficiently large, the user is likely to use a standard lens for imaging. If the distance is not large enough, the user is likely to use a wide-angle lens for imaging. By determining the size of the face as in step S611 and automatically using a standard lens for imaging when the area of the face is small, the possibility of performing imaging at an appropriate field angle without the user having to switch lenses becomes higher.
[0114] In the case where the number of faces is one, the subject becomes relatively small with respect to the live view image, and even when using a standard lens for imaging, the possibility that the face appears larger is very low. Therefore, automatically switching to the standard lens reduces the user's operation.
[0115] In step S612, the system control unit 50 determines whether an instruction to switch to a wide-angle lens has been issued. In the case where it is determined that an instruction to switch to a wide-angle lens has been issued ( "Yes" in step S612), the process proceeds to step S601. In the case where it is determined that an instruction to switch to a wide-angle lens has not been issued ( "No" in step S612), the process proceeds to step S613. The instruction to switch to a wide-angle lens can be issued by a touch operation on the item 713 displayed on the display unit 28. For example, if a tap operation of briefly touching the item 713 is performed, the wide-angle lens of the lens unit 202 is activated.
[0116] In step S613, the system control unit 50 determines whether a shooting instruction has been issued. The shooting instruction can be issued by a touch operation on item 702. When it is determined that the shooting instruction has been issued (Yes in step S613), the process proceeds to step S614. When it is determined that the shooting instruction has not been issued (No in step S613), the process proceeds to step S615.
[0117] In step S614, the system control unit 50 performs shooting processing. The system control unit 50 records the captured image on the recording medium 200.
[0118] In step S615, the system control unit 50 determines whether an operation to change the shooting magnification has been performed. Regarding the change of the shooting magnification, after a long press operation on item 712, an item for changing the shooting magnification (such as item 711 shown in Figure 7D is displayed, and the shooting magnification can be changed by touching and moving on the bar of this item. When it is determined that the operation to change the shooting magnification has been performed (Yes in step S615), the process proceeds to step S616. When it is determined that the operation to change the shooting magnification has not been performed (No in step S615), the process proceeds to step S618.
[0119] In step S616, the system control unit 50 acquires the shooting magnification specified by a touch operation on the item displayed in step S615. In step S617, the system control unit 50 determines whether the lens corresponding to the acquired shooting magnification is a standard lens or a wide-angle lens. For example, if a magnification equal to or greater than 2.0× is specified by a touch operation on the item displayed in step S615, the standard lens is selected. If a magnification less than 2.0× is selected, the wide-angle lens is selected. When it is determined that the standard lens is selected, the process proceeds to step S606. When it is determined that the wide-angle lens is selected, the process proceeds to step S601.
[0120] In step S618, the system control unit 50 determines whether a start instruction for the call function has been issued using the smart phone 100. The start instruction for the call function can be made executable when the camera function is being started, or the start instruction for the call function can be made executable even when the camera function is not started. When it is determined that the start instruction for the call function has been issued (Yes in step S618), the process proceeds to step S606. When it is determined that the start instruction for the call function has not been issued (No in step S618), the process proceeds to step S619.
[0121] In step S619, the system control unit 50 determines whether an instruction to switch to the rear camera has been issued. That is, the system control unit 50 determines whether an instruction to switch to the camera on the first side has been issued. The instruction to switch to the rear camera can be issued by a touch operation on item 703. When it is determined that the instruction to switch to the rear camera has been issued (Yes in step S619), the process proceeds to Figure 5 step S502. When it is determined that the instruction to switch to the rear camera has not been issued (No in step S619), the process proceeds to step S620.
[0122] In step S620, the system control unit 50 determines whether to end the camera function. The instruction to end the camera function can be issued by pressing the power switch 72, an operation of scrolling up the display unit 28, or a pinch operation on the live view image. When it is determined that the instruction to end the camera function has been issued, Figure 6 the process shown ends. When it is determined that the instruction to end the camera function has not been issued, the process proceeds to step S621.
[0123] In step S621, the system control unit 50 determines whether the currently used lens is a standard lens. When the currently used lens is a standard lens, the process proceeds to step S612. When the currently used lens is not a standard lens, the process proceeds to step S605.
[0124] In the above-described exemplary embodiment, an example has been described in which items for changing the shooting magnification are indicated by numbers, but this exemplary embodiment is not limited thereto. The following display can be adopted. Figures 7G to 7K Each shows an example of an item for changing the shooting magnification. In the above-described exemplary embodiment, an example has been described in which if item 701 or 712 is long-pressed, item 711 for changing the shooting magnification is displayed. However, this item can be always displayed together with the live view image even without a display instruction from the user. Figure 7G Item 714 for changing the shooting magnification to be displayed when starting the rear camera is shown. Line 714a in item 714 indicates the mid-position between the wide-angle end 714c and the telephoto end 714b. The designated item 714d overlapping line 714a is movable, and the shooting magnification can be changed by moving the designated item 714d. The actual center field angle of the range from the field angle set when actually selecting the wide-angle end 714c to the field angle set when actually selecting the telephoto end 714b does not need to correspond to a shooting magnification of 1.0×. Figure 7HShows item 715 for changing the shooting magnification to be displayed when the rear camera is started. Item 715a in item 715 indicates that the standard lens is started. Item 715a is surrounded by a bold frame and indicates that the standard lens is currently used for shooting at the field angle set without using electronic zoom. By moving the touch position on item 715, the shooting magnification can be changed. If item 715b is selected, the telephoto lens is started, and if item 715c is selected, the wide-angle lens is started. If the position on the bar between the items is selected, the shooting magnification can be changed to the shooting magnification set using electronic zoom. Figure 7I Shows the display mode of item 714 displayed when the shooting magnification of the rear camera is changed to the telephoto side. By moving the specified item 714d to the telephoto side, the shooting magnification can be changed. Figure 7J Shows item 716 for changing the shooting magnification to be displayed when the front camera is started. The specified item 716a is an item for changing the shooting magnification. By changing the touch position on item 716, the shooting magnification can be changed. In addition, item 716b indicates the telephoto end, and if the specified item 716a is moved to item 716b, the shooting magnification can be made larger. Since the specified item 716a exists at the end on the wide-angle side when the front camera is started, the user can recognize that the current live view image is taken at the widest angle. Figure 7K Shows item 717 for changing the shooting magnification to be displayed when the front camera is started. Item 717a corresponds to the shooting magnification set when the wide-angle lens is started, and item 717b corresponds to the shooting magnification set when the standard lens is started. By touching the position on item 717, the shooting magnification can be changed. Since item 717a is selected when the front camera is started, the user can recognize that the current shooting magnification is on the wide-angle side.
[0125] According to the above exemplary embodiments, when shooting with the front camera, the user can shoot at a wide field angle without increasing the number of operation steps.
[0126] The following example has been described, where if a call is started in step S618, the lens is switched to the standard lens. Similarly, in the following cases, when the front camera is started, the lens can be switched to the standard lens. For example, according to the captured image, a scene related to the person's background is determined, and in the case where the background is a light-colored wall or a background in a room, the user is likely to expect to shoot an image with a larger person size, so the lens is switched to the standard lens. In contrast, in the case where a building or a landscape is determined to exist, the user is likely to expect to shoot an image including the landscape or the building, so the wide-angle lens is started.
[0127] Next, it will be referred to Figure 8 and Figure 9The flowchart in describes the camera mode selection process according to this exemplary embodiment. This process is implemented by loading the program recorded on the non-volatile memory 56 onto the system memory 52 and the system control unit 50 executing this program. This process starts when the power of the smart phone 100 is turned on. Figure 8 and Figure 9 The camera mode selection process shown in is premised on the following situation: The rear camera on the first side includes an ultra-wide-angle lens, a wide-angle lens, and a standard lens, and the front camera on the second side includes a wide-angle lens and a standard lens. In other words, it will be assumed that Figure 3A and Figure 3B the lens units shown in are arranged on the smart phone for description, but the structure is not limited to this. In referring to Figure 5 and Figure 6 in the camera control process described, the change in the shooting magnification in the camera function has been described. In the following flowchart, the change in the camera mode in the camera function will be described together with the control of the change in the shooting magnification. Referring to Figure 5 and Figure 6 the exemplary embodiments described and those to be referred to Figure 8 and Figure 9 described can be executed in combination.
[0128] In step S801, the system control unit 50 determines whether a camera function start instruction has been issued. The camera function start instruction can be issued by touching the item of the camera displayed on the display unit 28. If it is determined that a camera function start instruction has been issued (Yes in step S801), the process proceeds to step S802. If it is determined that no camera function start instruction has been issued (No in step S801), the process proceeds to step S803.
[0129] In step S802, the system control unit 50 activates the standard lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 203. In other words, if the camera function is activated, the rear camera is activated. As described below, after the rear camera is activated, the rear camera can be switched to the camera on the second side (i.e., the front camera).
[0130] In step S803, the system control unit 50 performs other processing. Examples of other processing include the reproduction of images acquired via the lens units 201 to 205, browsing on the Internet, and image editing.
[0131] In step S804, the system control unit 50 sequentially displays the captured images (live view images) acquired via the lens unit 203 on the display unit 28.
[0132] In step S805, the system control unit 50 displays candidates for selectable shooting modes on the display unit 28. The candidates for shooting modes include a photo mode, a night view mode, an automatic determination mode, a portrait mode, a panoramic mode, a video mode, a time-lapse mode, and a manual mode. Figures 10A to 10E And Figures 11A to 11D Each shows an example of the display to be described with reference to the flowchart in Figure 8 And Figure 9 below. Figure 10A FIG. shows an example of a shooting screen that will be displayed on the display unit 28 when the rear camera is activated. The item group 1016 includes items 1004 to 1011 corresponding to the shooting modes, and a part of these items is displayed on the display unit 28. In Figure 10A , items 1004 to 1006 and 1009, and a part of items 1007 and 1010 are shown. Item 1004 indicates the photo mode, item 1005 indicates the video mode, item 1006 indicates the panoramic mode, item 1007 indicates the portrait mode, item 1008 indicates the manual mode (M mode), and item 1009 indicates the night view mode. In addition, item 1010 indicates the time-lapse mode, and item 1011 indicates the automatic determination mode (AI mode). In Figures 10A to 10D And Figure 11B , for ease of explanation, items corresponding to shooting modes that are not actually displayed are also shown. When the camera function is activated, the photo mode is selected as the shooting mode, and the corresponding item 1004 is displayed in a state of being in contact with a marker 1014 indicating that the item is selected. The shooting mode corresponding to the item displayed immediately below the marker 1014 is the currently selected shooting mode. The marker 1014 is displayed at the center in the short side direction of the display unit 28, and this position remains unchanged even when the selected shooting mode is changed. Therefore, if the selected shooting mode is changed among the shooting modes included in the item group 1016 by scrolling the item group 1016, the shooting mode displayed on the display unit 28 changes. Item 1001 indicates 1.0× as the current shooting magnification, and is surrounded by a line thicker than the lines surrounding items 1002 (0.5×) and 1003 (0.3×) indicating other shooting magnifications. By changing the display mode in this way, the user can identify the currently selected shooting magnification. If item 1013 is selected, the lens can be switched to the lens of the front camera arranged on the second surface. Item 1012 is an item for issuing a shooting instruction.
[0133] In step S806, the system control unit 50 determines whether an instruction to switch to a wide-angle lens has been issued. If it is determined that the instruction to switch to a wide-angle lens has been issued, the process proceeds to step S807. If it is determined that the instruction to switch to a wide-angle lens has not been issued, the process proceeds to step S811. In step S811, the system control unit 50 determines whether an instruction to switch to an ultra-wide-angle lens has been issued. If it is determined in step S811 that the instruction to switch to an ultra-wide-angle lens has been issued, the process proceeds to step S812. If it is determined that the instruction to switch to an ultra-wide-angle lens has not been issued, the process proceeds to step S816. The instruction to switch to a wide-angle lens can be issued by a touch operation on item 1002 displayed on the display unit 28. The instruction to switch to an ultra-wide-angle lens can be issued by a touch operation on item 1003 displayed on the display unit 28.
[0134] In step S807, the system control unit 50 activates the wide-angle lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 204.
[0135] In step S808, the system control unit 50 sequentially displays on the display unit 28 the captured images (live view images) acquired via the lens unit 204.
[0136] In step S809, the system control unit 50 determines whether the current shooting mode is the photo mode. If it is determined that the current shooting mode is the photo mode (Yes in step S809), the process proceeds to step S810. If it is determined that the current shooting mode is not the photo mode (No in step S809), the process proceeds to step S824.
[0137] In step S810, the system control unit 50 highlights the shooting modes suitable for shooting with a wide-angle camera and displays the unsuitable shooting modes in a grayed-out state. Figure 10B A display example of the display unit 28 to be displayed when the lens is switched to a wide-angle lens in the photo mode is shown. As Figure 10BAs shown, the item 1009a indicating the night scene mode and the item 1005a indicating the video mode are displayed in a distinguishable manner from other items (i.e., 1006, 1010). For example, displaying an item in a distinguishable manner means smearing the item with a prominent color, displaying the item in a larger size than other items, or displaying the item in a slightly vibrating state. In addition, the item 1007a indicating the portrait mode is displayed in a grayed-out state. The grayed-out state indicates that shooting in the portrait mode is not performed when the wide-angle lens is selected. The display mode of the item 1007a does not need to be the grayed-out state, and the item itself can be displayed in a light color or a small size. The item 1007a can be hidden. In other words, when the wide-angle lens is selected in the photo mode, the user is likely to eagerly expect to shoot using the wide-angle lens. Therefore, by presenting to the user in an easy-to-understand manner the shooting modes suitable for shooting using the wide-angle lens, the user can quickly switch the shooting mode. In addition, by displaying in a grayed-out state the shooting modes that disable shooting using the wide-angle lens, the user can recognize that if the shooting mode in the grayed-out state is selected, shooting using the wide-angle lens becomes inexecutable. If the video mode is selected when using the wide-angle lens, time-series changes over a wide range can be recorded. If the night scene mode is selected when using the wide-angle lens, an image including multiple buildings or a large building can be captured. The shooting modes suitable for the wide-angle lens are not limited to the above shooting modes.
[0138] In step S812, the system control unit 50 activates the ultra-wide-angle lens in the lens of the rear camera on the first side. That is, the system control unit 50 activates the camera of the lens unit 205.
[0139] In step S813, the system control unit 50 sequentially displays on the display unit 28 the captured images (live view images) acquired via the lens unit 205.
[0140] In step S814, the system control unit 50 determines whether the current shooting mode is the photo mode. If it is determined that the current shooting mode is the photo mode (Yes in step S814), the process proceeds to step S815. If it is determined that the current shooting mode is not the photo mode (No in step S814), the process proceeds to step S824.
[0141] In step S815, the system control unit 50 highlights the shooting modes suitable for shooting using the ultra-wide-angle camera and displays the unsuitable shooting modes in a grayed-out state. Figure 10C A display example of the display unit 28 to be displayed when the lens is switched to the ultra-wide-angle lens in the photo mode is shown. As Figure 10CAs shown, the item 1009a indicating the night scene mode and the item 1015 indicating the distortion correction mode are displayed in a manner distinguishable from other items (i.e., 1005, 1010). In addition, the item 1007a indicating the portrait mode and the item 1006a indicating the panoramic mode are displayed in a grayed-out state. The grayed-out state indicates that shooting in the portrait mode or the panoramic mode is not performed when the ultra-wide-angle lens is selected. In other words, when the ultra-wide-angle lens is selected in the photo mode, the user is likely to eagerly expect to shoot using the ultra-wide-angle lens. Therefore, by presenting to the user in an easy-to-understand manner the shooting modes suitable for shooting using the ultra-wide-angle lens, the user can quickly switch the shooting mode. In addition, by displaying in a grayed-out state the shooting modes that disable shooting using the ultra-wide-angle lens, the user can recognize that if a shooting mode in the grayed-out state is selected, shooting using the ultra-wide-angle lens becomes infeasible. In shooting using the ultra-wide-angle lens, distortion may occur near the end of the image, so shooting in the distortion correction mode is executable. Therefore, when using the ultra-wide-angle lens, it is desirable to make it easy for the user to recognize that shooting in the distortion correction mode is executable and recommended. In addition, in the panoramic mode, image synthesis may become infeasible due to distortion occurring near the end of the image, and thus shooting is not performed. In step S816, the system control unit 50 determines whether the current lens is a standard lens. If it is determined that the currently used lens is a standard lens (Yes in step S816), the process proceeds to step S824. In step S824, the system control unit 50 performs the shooting mode switching process to be performed when all shooting modes are selectable. If it is determined that the currently used lens is not a standard lens (No in step S816), the process proceeds to step S817. In step S817, the system control unit 50 performs the shooting mode switching process to be performed when a part of the shooting modes is not selectable.
[0142] In step S817, the system control unit 50 determines whether the user has issued an instruction to scroll the group 1016 of items indicating the shooting mode. If it is determined that the user has issued an instruction to scroll the group 1016 of items indicating the shooting mode (Yes in step S817), the process proceeds to step S818. If it is determined that the user has not issued an instruction to scroll the group 1016 of items indicating the shooting mode (No in step S818), the process proceeds to step S819.
[0143] In step S818, the system control unit 50 changes the shooting mode to the selectable shooting mode that exists at the position closest to the currently selected shooting mode among the shooting modes existing in the scrolling direction. Figure 11A FIG. is a diagram showing the selection of shooting modes to be performed when the wide-angle lens is selected. AsFigure 11A As shown in (2) therein, if the currently selected shooting mode is the video mode, then when the item group 1016 scrolls a distance L in the left direction extending along the short side direction of the display unit 28, the item 1006 (panorama mode) that exists in the right direction and is selectable when viewed from the item 1005 is selected. As Figure 11A As shown in (1) therein, if the currently selected shooting mode is the photo mode, then the item 1005 is selected according to the item group 1016 scrolling a distance Ls less than the distance L in the left direction. The item 1005 corresponds to the video mode. By a scrolling amount less than the normal amount, the photo mode can be switched to the video mode, and the video mode is a shooting mode recommended for shooting using a wide-angle lens. As shown in (3), in the case of selecting the panorama mode, if the user issues an instruction to scroll the item group 1016 in the left direction, the adjacent portrait mode is usually selected, but if the panorama mode is switched to the portrait mode, shooting using a wide-angle lens becomes inexecutable. Therefore, even if the item group 1016 scrolls a distance L in the left direction, the item 1007 indicating the portrait mode in the grayed-out state is not selected (skipped). Then, the item 1008 indicating the manual mode is selected, and the manual mode is a selectable shooting mode at the nearest position in the left direction when viewed from the item 1006.
[0144] In step S819, the system control unit 50 determines whether any item indicating a shooting mode has been touched and selected. In other words, the system control unit 50 determines whether the following operation (tap operation) has been performed, which is to touch any one of the items 1004 to 1011 and release the touch without moving the touch position within a predetermined time (such as 0.5 seconds or 0.2 seconds, etc.) as a short time. In the case where it is determined that an item indicating a shooting mode has been touched and selected ( "Yes" in step S819), the process proceeds to step S820 because the shooting mode is switched even in the case where shooting using the selected lens is inexecutable. In step S820, the touched shooting mode is selected. In Figure 11A , (5) shows the state where the user performs a tap operation on the item 1007a corresponding to the portrait mode. When the wide-angle lens is selected, shooting in the portrait mode is inexecutable, but if the item 1007a is tapped, it can result in the state where the item 1007a is selected as shown in (6). That is, the shooting mode can be switched to the portrait mode. Figure 11B shows a display example of the display unit 28 to be displayed after the portrait mode is selected. As Figure 11B shown, it can be seen that the shooting magnification indicated by the item 1001 is 1.0×, and the wide-angle lens has been switched to the standard lens.
[0145] In step S821, the system control unit 50 determines whether the shooting mode selected by the operation in step S819 is a shooting mode for shooting that can be performed only by the standard lens. That is, the system control unit 50 determines whether the shooting mode is a shooting mode for shooting that cannot be performed by the wide-angle lens and the ultra-wide-angle lens, such as the portrait mode. If the shooting mode is a shooting mode for shooting that can be performed only by the standard lens ("Yes" in step S821), the process proceeds to step S802. In step S802, the system control unit 50 performs a process of switching to the standard lens. If the shooting mode is not a shooting mode for shooting that can be performed only by the standard lens ("No" in step S821), the process proceeds to step S822.
[0146] In step S822, the system control unit 50 determines whether the shooting mode selected by the operation in step S819 is a shooting mode for shooting that can be performed by the wide-angle lens. That is, the system control unit 50 determines whether the shooting mode is a shooting mode for shooting that can be performed by the standard lens and the wide-angle lens but cannot be performed only by the ultra-wide-angle lens, such as the panoramic mode. Even when the shooting mode is a shooting mode for shooting that cannot be performed by the ultra-wide-angle lens, if the ultra-wide-angle lens is switched to the standard lens, the change in the field angle will be large. Therefore, it is determined whether shooting using the wide-angle lens is possible, and if shooting using the wide-angle lens is possible ("Yes" in step S822), the process proceeds to step S807. In step S807, the ultra-wide-angle lens is switched to the wide-angle lens. With this configuration, shooting can be performed in the shooting mode selected by the user while preventing the change in the field angle from becoming large. When the shooting mode is not a shooting mode for shooting that can be performed by the wide-angle lens ("No" in step S822), the process proceeds to step S823.
[0147] In step S823, the system control unit 50 displays the lenses that can be selected in the selected shooting mode in a distinguishable manner. Figure 10D A display example to be displayed when the panoramic mode is selected is shown. The item 1003a indicating the ultra-wide-angle lens is displayed in a grayed-out state, and the items 1002 indicating the wide-angle lens and 1001 indicating the standard lens are displayed without being grayed out. Thus, the user can recognize that the ultra-wide-angle lens cannot be selected in the panoramic mode.
[0148] In step S824, the system control unit 50 performs a process similar to the process in step S817.
[0149] In step S825, whenever a scroll instruction is issued, the system control unit 50 selects an adjacent item in the scroll direction when viewed from the item corresponding to the selected shooting mode. In step S818, the shooting mode that can be selected during a scroll operation is selected, and the non-selectable shooting modes are skipped. In contrast, in step S825, whenever the scroll advances by a distance L, an adjacent shooting mode is selected. Figure 11A FIG. is a diagram showing switching of the shooting mode when the scroll advances by a distance L. In (1) to (4), whenever the user scrolls the item group 1016 by a distance L in the left direction, the item corresponding to the shooting mode existing immediately below the mark 1014 is sequentially switched to the item on the right. Since the display position of the mark 1014 on the display unit 28 remains unchanged, the items displayed on the display unit are the items corresponding to the modes from the time-lapse mode to the portrait mode in (1), and these items change to the items corresponding to the modes from the video mode to the manual mode in (6).
[0150] The processes in steps S824 to S827 are processes to be executed when the selected lens is a standard lens or when the lens is switched to a wide-angle lens or an ultra-wide-angle lens in a mode other than the photo mode. In other words, if the selected lens is a standard lens, all shooting modes can be selected, so there is no need to make a specific shooting mode difficult to select. In addition, if the user does not switch the lens from the standard lens selected at startup to a wide-angle lens or an ultra-wide-angle lens, the user is likely to intend to select the lens after selecting the shooting mode. Therefore, all shooting modes are displayed in a parallel relationship (some shooting modes are not highlighted or are grayed out). In addition, part of the shooting modes are not made difficult to select. With this configuration, a user who wishes to select the lens after selecting the shooting mode can select the shooting mode and the lens with good operability.
[0151] In step S828, the system control unit 50 determines whether a shooting instruction has been issued. The shooting instruction can be issued by a touch operation on the item 1012. When it is determined that a shooting instruction has been issued (Yes in step S828), the process proceeds to step S829. When it is determined that no shooting instruction has been issued (No in step S828), the process proceeds to step S830.
[0152] In step S829, the system control unit 50 performs shooting processing. The system control unit 50 records the captured image on the recording medium 200.
[0153] In step S830, the system control unit 50 determines whether an instruction to switch to the front camera has been issued. The instruction to switch to the front camera (i.e., the second side) can be issued by a touch operation on item 1013. When it is determined that the instruction to switch to the front camera has been issued (Yes in step S830), the process proceeds to Figure 9 the imaging mode selection process of the front camera shown in. When it is determined that the instruction to switch to the front camera has not been issued (No in step S830), the process proceeds to step S831.
[0154] In step S831, the system control unit 50 determines whether to end the camera function. The instruction to end the camera function can be issued by pressing the power switch 72, an operation of scrolling up the display unit 28, or a pinch operation on the live view image. When it is determined that the instruction to end the camera function has been issued (Yes in step S831), Figure 8 the process shown in ends. When it is determined that the instruction to end the camera function has not been issued (No in step S831), the process proceeds to step S832.
[0155] In step S832, the system control unit 50 determines whether an instruction to switch the rear camera to the standard lens has been issued. The instruction to switch to the standard lens can be issued by a touch operation on item 1001. When it is determined that the instruction to switch to the standard lens has been issued (Yes in step S832), the process proceeds to step S802. When it is determined that the instruction to switch to the standard lens has not been issued (No in step S832), the process proceeds to step S833.
[0156] In step S833, the system control unit 50 determines whether the currently selected lens is the standard lens. When it is determined that the currently selected lens is the standard lens (Yes in step S833), the process proceeds to step S806. When it is determined that the currently selected lens is not the standard lens (No in step S833), the process proceeds to step S817.
[0157] Next, the imaging mode selection process of the front camera according to the present exemplary embodiment will be described with reference to the Figure 9 flowchart in. This process is implemented by loading the program recorded in the non-volatile memory 56 onto the system memory 52 and the system control unit 50 executing the program. This process starts when it is determined in Figure 8 step S830 that the instruction to switch to the front camera has been issued (Yes in step S830).
[0158] In step S901, the system control unit 50 activates the standard lens of the front camera. In other words, the system control unit 50 activates the standard lens among the lenses of the front camera on the second side. That is to say, the system control unit 50 activates the camera of the lens unit 201.
[0159] In step S902, the system control unit 50 sequentially displays on the display unit 28 the captured images (live view images) acquired via the lens unit 201.
[0160] In step S903, the system control unit 50 displays on the display unit 28 an item group 1017 including a photo mode, a video mode, and a portrait mode. Figure 11C An example of a display example to be displayed when the standard lens is activated is shown. When the front camera is activated, it is highly likely that the user will perform imaging with himself / herself as the subject. Therefore, compared with the case of selecting the rear camera, the number of selectable imaging modes is limited.
[0161] In step S904, the system control unit 50 determines whether an instruction to switch the lens of the front camera to a wide-angle lens has been issued. The instruction to switch to the wide-angle lens can be issued by a touch operation on the item 1019. When it is determined that the instruction to switch to the wide-angle lens has been issued (Yes in step S904), the process proceeds to step S905. When it is determined that the instruction to switch to the wide-angle lens has not been issued (No in step S904), the process proceeds to step S907.
[0162] In step S905, the system control unit 50 activates the wide-angle lens of the front camera. In other words, the system control unit 50 activates the wide-angle lens among the lenses of the front camera on the second side. That is to say, the system control unit 50 activates the camera of the lens unit 202.
[0163] In step S906, the system control unit 50 sequentially displays on the display unit 28 the captured images (live view images) acquired via the lens unit 202. Figure 11D A display example of the display unit 28 to be displayed when the wide-angle lens of the front camera is activated is shown. In the case of the front camera, a standard lens and a wide-angle lens are provided, and the imaging modes executable by the standard lens and the imaging modes executable by the wide-angle lens are the same. In the case of the front camera, the range of the field angle that can be changed is not as large as that of the rear camera, so the selectable imaging modes are also the same. Therefore, it is not necessary to make some imaging modes easy to select or some imaging modes difficult to select.
[0164] In step S907, the system control unit 50 determines whether an instruction to switch the lens of the front camera to the standard lens has been issued. The instruction to switch to the standard lens can be issued by a touch operation on item 1018. When it is determined that the instruction to switch to the wide-angle lens has been issued (Yes in step S907), the process proceeds to step S901. When it is determined that the instruction to switch to the wide-angle lens has not been issued (No in step S907), the process proceeds to step S908.
[0165] In step S908, the system control unit 50 determines whether a shooting instruction has been issued. The shooting instruction can be issued by a touch operation on item 1012. When it is determined that the shooting instruction has been issued (Yes in step S908), the process proceeds to step S909. When it is determined that the shooting instruction has not been issued (No in step S908), the process proceeds to step S910.
[0166] In step S909, the system control unit 50 performs shooting processing. The system control unit 50 records the captured image on the recording medium 200.
[0167] In step S910, the system control unit 50 determines whether an instruction to switch to the rear camera has been issued. The instruction to switch to the rear camera (i.e., the lens on the first side) can be issued by a touch operation on item 1013. When it is determined that the instruction to switch to the rear camera has been issued (Yes in step S910), the process proceeds to step S802. In step S802, the system control unit 50 activates the standard lens of the rear camera. When it is determined that the instruction to switch to the rear camera has not been issued (No in step S910), the process proceeds to step S911.
[0168] In step S911, the system control unit 50 determines whether to end the camera function. The instruction to end the camera function can be issued by pressing the power switch 72, an operation of scrolling up the display unit 28, or a pinch operation on the live view image. When it is determined that the instruction to end the camera function has been issued (Yes in step S911), Figure 9 the processing shown ends. When it is determined that the instruction to end the camera function has not been issued (No in step S911), the process proceeds to step S912.
[0169] The processing in steps S912 to S915 is similar to Figure 8 the processing in steps S824 to S827. However, if the processing in step S913 or S915 ends, the process proceeds to step S908.
[0170] In step S916, the system control unit 50 determines whether the currently selected lens is a standard lens. When it is determined that the currently selected lens is a standard lens (Yes in step S916), the process proceeds to step S904. When it is determined that the currently selected lens is not a standard lens (No in step S916), the process proceeds to step S907.
[0171] According to the above exemplary embodiment, it is easier for the user to identify the shooting mode that can be executed when using the selected lens. In other words, since the recommended shooting modes and non-recommended shooting modes (which are the modes that are switched when the lens is selected) for the lens selected in the photo mode are displayed in a distinguishable manner, the user can quickly identify the recommended shooting mode to be selected in the selected field angle. By avoiding hiding the non-recommended shooting modes, in the case where the user considers prioritizing the characteristics of the shooting mode over the field angle during shooting midway, the user can quickly make a selection without performing a lens switching operation.
[0172] In the above exemplary embodiment, an example has been described in which, when the shooting mode is switched to a shooting mode that cannot be executed by the lens selected in the photo mode, the lens for performing shooting is switched to a lens that can execute shooting. However, in the case where the user has switched the lens in the photo mode, the user is likely to eagerly expect to perform shooting at the field angle selected by the user, so the selected shooting mode can be selected without changing the field angle. However, if a wide-angle lens is used, for example, in the portrait mode, the blurring effect of the background may become less distinguishable, so the user is notified that the background will not be blurred unless the lens is switched to a standard lens.
[0173] When the user sets the pixel count to a high value in the camera function, in some cases, shooting with a wide-angle lens is performed, and shooting with a standard lens becomes inexecutable. When the user sets the pixel count to be equal to or greater than a predetermined value (i.e., sets the pixel count to be equal to or greater than the value of the pixel count at which shooting is inexecutable unless a wide-angle lens is used) in the menu screen or setting screen of the camera function, the following operations are performed. More specifically, the shooting modes that can be executed by the wide-angle lens or ultra-wide-angle lens among the lenses for the rear camera are highlighted, and the shooting modes that cannot be executed by the wide-angle lens or ultra-wide-angle lens are displayed in a grayed-out state. The user is also notified that in the case where the user attempts to select the shooting mode displayed in the grayed-out state by a tap operation, the lens is switched and the pixel count is further reduced. When the user switches the shooting mode after checking the notification, shooting is performed after reducing the pixel count and switching the lens to the standard lens. It may be sufficient to simply highlight the recommended partial shooting modes without graying out the non-recommended shooting modes. As a comparison, the non-recommended partial shooting modes can be grayed out, and the recommended shooting modes can be highlighted. In addition, when using the newly selected lens, the display mode of the non-recommended or recommended shooting modes is changed to a grayed-out state or a highlighted state according to the selected lens.
[0174] When a user who has selected a wide-angle lens does not intend to switch the lens to a standard lens and the shooting mode is switched to a shooting mode that cannot be executed by the wide-angle lens, it is possible to prevent the field angle of the live view image from changing. In other words, when the user is still selecting the shooting mode, the visibility of the user can be improved by preventing the field angle of the live view image from changing to the field angle of the standard lens or returning to the field angle of the wide-angle lens without the user's intention according to the change of the shooting mode.
[0175] To indicate the selected shooting mode, the display mode of the item in group 1016 that corresponds to the selected shooting mode can be changed. For example, the size of the item can be increased, the color of the character can be changed, or the color of the item can be changed. The items corresponding to the selected shooting mode, the items corresponding to the non-recommended shooting modes, and the items corresponding to the recommended shooting modes are displayed in different display modes. All of these items are displayed in a display mode different from the display mode of the shooting modes that are not selected and are neither recommended nor non-recommended. In other words, according to the selected lens, the display mode of the item corresponding to the shooting mode that cannot be executed by the selected lens is changed to a display mode that is less obvious than the other unselected items. Alternatively, the display mode of the item corresponding to the shooting mode recommended for the selected lens is changed to a display mode that is more obvious than the other unselected items.
[0176] In the camera function, sometimes the user is enabled to set whether to store the shooting settings set when the camera function was last started. At this time, in the case where the user tends to store the shooting settings used last time, the user is very likely to eagerly expect that the shooting settings once set are not changed. Therefore, the shooting mode is displayed based on the lens selected in the photo mode. In other words, the recommended shooting mode and the non-recommended shooting mode for the lens selected in the photo mode are made recognizable. In contrast, users who tend not to store the shooting settings used last time are very likely to eagerly expect to give priority to the latest settings. Therefore, even if the lens has been switched, the user is very likely to expect the shooting in the currently selected shooting mode to take precedence over the type of the set lens, so the recommended shooting mode and the non-recommended shooting mode are not displayed in a recognizable manner according to the lens.
[0177] The above reference Figure 3A 、 Figure 3B and Figure 4A 、 Figure 4B The measurements of the focal lengths and the shooting field angles of the standard lens, the wide-angle lens, and the ultra-wide-angle lens of the rear camera and the front camera described above are examples and are not limited thereto. Examples have been described in which three types of lenses are arranged on the rear camera and two types of lenses are arranged on the front camera, but the number of types is not limited thereto and may be three types, or one type may be arranged.
[0178] The above-described various types of control described as being to be performed by the system control unit 50 can be carried out by one piece of hardware, or the entire device can be controlled by sharing the processing among a plurality of pieces of hardware (such as a central processing unit (CPU), a microprocessing unit (MPU), and a dedicated circuit).
[0179] The preferred exemplary embodiments of the present invention have been described in detail, but the present invention is not limited to these specific exemplary embodiments, and various configurations are also included in the present invention without departing from the spirit of the present invention. In addition, the above-described exemplary embodiments merely indicate the exemplary embodiments of the present invention, and the exemplary embodiments can be appropriately combined.
[0180] In the above exemplary embodiments, an example case of applying the present invention to a smart phone has been described. The application examples of the present invention are not limited to this example, and the present invention can be applied to any electronic device as long as the electronic device performs shooting while switching between a plurality of lenses having different focal lengths. More specifically, the present invention can be applied to a digital camera, a portable image viewer, a printer device including a viewfinder, a digital photo frame, a music player, a game machine, and an e-book reader.
[0181] (Other Exemplary Embodiments)
[0182] An exemplary embodiment of the present invention can also be implemented by performing the following processes. More specifically, the processes are as follows: software (program) that implements the functions of the above exemplary embodiment is provided to a system or device via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or device reads the program code and executes the program code. In this case, the program and the non-volatile storage medium storing the program are included in the present invention.
[0183] The present invention is not limited to the above exemplary embodiments, and various changes and modifications can be made without departing from the spirit and scope of the present invention. Therefore, the claims are attached to disclose the scope of the present invention.
[0184] This application claims the priority of Japanese Patent Application No. 2020-125163 filed on July 22, 2020, the entire content of which is incorporated herein by reference.
Claims
1. An electronic device having a first surface and a second surface, the electronic device comprises: a control unit configured to control imaging in a first imaging or a second imaging, and to control imaging in the first imaging using any one of a plurality of lenses including a first lens and a second lens, and to control imaging in the second imaging using any one of a plurality of lenses including a third lens and a fourth lens, the first lens and the second lens being disposed on the first surface, the second lens being capable of performing imaging with a field of view wider than that of the first lens, the third lens and the fourth lens being disposed on the second surface, the fourth lens being capable of performing imaging with a field of view wider than that of the third lens; a first instruction unit configured to receive a first instruction for switching to the first imaging during the second imaging; a second instruction unit configured to receive a second instruction for switching to the second imaging during the first imaging; and a display control unit configured to control the display on a display unit of an image captured using the first lens according to the first instruction, and to control the display on the display unit of an image captured using the fourth lens according to the second instruction, wherein, when an image captured using any one of the first lens and the second lens is displayed on the display unit, an imaging mode suitable for imaging with the lens currently being used and an imaging mode not suitable for imaging with the lens currently being used are displayed on the display unit in a distinguishable manner, and wherein, when an image captured using any one of the third lens and the fourth lens is displayed on the display unit, an imaging mode suitable for imaging with the lens currently being used is displayed on the display unit.
2. The electronic device according to claim 1, further comprises: a first switching unit configured to switch the imaging to be performed in the first imaging between imaging using the first lens and imaging using the second lens, wherein the display control unit controls the display on the display unit of an image captured using the lens switched by the first switching unit.
3. The electronic device according to claim 1 or 2, further comprises: a second switching unit configured to switch the imaging to be performed in the second imaging between imaging using the third lens and imaging using the fourth lens, wherein the display control unit controls the display on the display unit of an image captured using the lens switched by the second switching unit.
4. The electronic device according to any one of claims 1 to 2, wherein, a fifth lens capable of performing imaging with a field of view narrower than that of the first lens is disposed on the first surface.
5. The electronic device according to claim 2, wherein, according to the first instruction, the display control unit controls the display on the display unit of an image captured using the first lens and displays the imaging magnification as 1×.
6. The electronic device according to claim 5, wherein, When the first switching unit switches the imaging to the imaging using the second lens, the display control unit controls to display the image captured using the second lens on the display unit and display the imaging magnification as a value less than 1×.
7. The electronic device according to claim 2, wherein According to a touch operation on a predetermined item on the display unit, the first switching unit switches the imaging to be performed between the imaging using the first lens and the imaging using the second lens.
8. The electronic device according to claim 3, wherein According to the second instruction, the display control unit controls to display the image captured using the fourth lens on the display unit and display the imaging magnification as 1×.
9. The electronic device according to claim 8, wherein When the second switching unit switches the imaging to the imaging using the third lens, the display control unit controls to display the image captured using the third lens on the display unit and display the imaging magnification as a value greater than 1×.
10. The electronic device according to claim 3, wherein According to a touch operation on a predetermined item on the display unit, the second switching unit switches the imaging to be performed between the imaging using the third lens and the imaging using the fourth lens.
11. The electronic device according to any one of claims 1 to 2, wherein includes the display unit.
12. A control method of an electronic device, in which a plurality of lenses including a first lens and a second lens are arranged on a first surface, and a plurality of lenses including a third lens and a fourth lens are arranged on a second surface, the second lens being capable of performing imaging with a field angle wider than that of the first lens, the field angle of the fourth lens being wider than that of the third lens, the control method includes: controlling to perform imaging in a first imaging using any one of the plurality of lenses arranged on the first surface or a second imaging using any one of the plurality of lenses arranged on the second surface; receiving a first instruction for switching to the first imaging during the second imaging; receiving a second instruction for switching to the second imaging during the first imaging; and controlling to display the image captured using the first lens on the display unit according to the first instruction, and controlling to display the image captured using the fourth lens on the display unit according to the second instruction, wherein when displaying the image captured using any one of the first lens and the second lens on the display unit, the imaging modes suitable for imaging with the currently used lens and the imaging modes not suitable for imaging with the currently used lens are displayed in a distinguishable manner on the display unit, and wherein when displaying the image captured using any one of the third lens and the fourth lens on the display unit, the imaging mode suitable for imaging with the currently used lens is displayed on the display unit.
13. A computer program product comprising a computer program which, when read and executed by a computer, causes the computer to function as each part of the electronic device according to any one of claims 1 to 11.
14. A computer-readable storage medium storing a program for causing a computer to function as each part of the electronic device according to any one of claims 1 to 11.
15. A computer program product comprising a computer program which, when read and executed by a computer, causes the computer to execute the control method of the electronic device according to claim 12.
16. A computer-readable storage medium storing a program for causing a computer to execute the control method of the electronic device according to claim 12.
Citation Information
Patent Citations
Multi-eye imaging apparatus and multi-eye imaging method, and mobile information terminal device
JP2012222471A
Baseboard device on elevator car ceiling
JP2020125163A
Digital viewfinder user interface for multiple cameras
CN108353126A
Mobile terminal
KR1020170020069A