Electronic device and control method thereof

Abstract

An electronic device, characterized in that it includes: a first camera unit (203 to 205) for capturing images through a lens placed on a first surface; a second camera unit (201 and 202) for capturing images through a lens placed on a second surface, the second camera unit being switchable between first camera capture using the first lens and second camera capture using a second lens, the second lens having a wider viewing angle than the first lens; and a control unit for providing control whereby, during camera capture by the second camera unit, according to a user operation for changing from a still image capture mode to a moving image capture mode, the still image capture mode is switched to the moving image capture mode, and the first camera capture using the first lens is switched to the second camera capture using the second lens.

Description

Technical Field

[0001] The present invention relates to an electronic device and a control method thereof, and in particular, to an electronic device including a plurality of lenses as lenses for photographing. Background Art

[0002] In electronic devices such as smartphones, a front camera is provided on the front surface side where a display screen is provided as well as a rear camera on the back surface side, so that a user of the electronic device can take a picture of himself or herself. In Patent Document (PTL) 1, two cameras (i.e., a first camera and a second camera capable of taking pictures at a wider angle than the first camera) are provided as the rear camera on the back surface side.

[0003] Reference List

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2017-85339 Summary of the Invention

[0006] Technical issues

[0007] In cited document 1, although multiple cameras with different viewing angles are provided as rear cameras on the back side, a single front camera is provided on the front side. Therefore, the front camera's image capture function is inferior to that of the rear camera. To improve the front camera's function, if multiple cameras are provided as front cameras and if the front camera is used for image capture, the user must switch to the camera of the multiple cameras to be used for image capture. This increases the user's inconvenience.

[0008] In view of the above problems, the present invention relates to an electronic device, which includes: a first camera unit, which is configured to capture images using a lens placed on a first surface; and a second camera unit, which is configured to capture images using a lens placed on a second surface, and is configured to switch to a first camera using the first lens and a second camera using the second lens, the second lens having a wider viewing angle than the first lens, and appropriately controlling the switching to the first camera and the switching to the second camera according to the operating state of the electronic device or the user's operation.

[0009] In particular, the present invention is directed to providing an electronic device that switches to imaging at an appropriate angle of view in response to switching between imaging modes or switching from imaging by a first imaging unit to imaging by a second imaging unit.

[0010] Problem Solution

[0011] According to one aspect of the present invention, an electronic device includes a first surface and a second surface, the electronic device including: a first camera unit, which is configured to capture images using a lens placed on the first surface; a second camera unit, which is configured to capture images using a lens placed on the second surface, the second camera unit being configured to switch to a first camera using the first lens and a second camera using a second lens, the second lens having a wider angle of view than that of the first lens; and a control unit, which is configured to control so as to switch to the motion image capture mode in response to a user operation for changing from a still image capture mode to a motion image capture mode during the capture of the second camera unit, and also to switch from the first camera using the first lens to the second camera using the second lens.

[0012] According to another aspect of the present invention, an electronic device includes a first surface and a second surface, and the electronic device includes: a first camera unit, which is configured to capture images using a lens placed on the first surface; a second camera unit, which is configured to capture images using a lens placed on the second surface, the second camera unit being configured to switch to first imaging using the first lens placed on the second surface and second imaging using the second lens placed on the second surface, the second lens having a wider viewing angle than that of the first lens; and a control unit, which is configured to control whether to switch to first imaging using the first lens or to switch to second imaging using the second lens according to the viewing angle of imaging performed by the first camera unit when imaging by the first camera unit is switched to imaging by the second camera unit.

[0013] Advantageous Effects of the Invention

[0014] According to the present invention, in response to switching between image pickup modes or switching from image pickup by the first image pickup unit to image pickup by the second image pickup unit, it is possible to switch to image pickup at an appropriate angle of view. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The accompanying drawings are incorporated in and constitute a part of the specification, illustrate exemplary embodiments of the present invention, and are used to describe the principles of the present invention together with the description of the exemplary embodiments.

[0016] [ Figure 1A ] is an external view of the smartphone 100.

[0017] [ Figure 1B ] is an external view of the smartphone 100.

[0018] [ Figure 1C ] is an external view of the smartphone 100.

[0019] [ Figure 2 ] is a block diagram of the smartphone 100.

[0020] [ Figure 3 ] is a diagram showing the shooting angle of view and focal length of each camera unit.

[0021] [ Figure 4A ] is a flowchart showing the processing when the camera function of the smartphone 100 is executed.

[0022] [ Figure 4B ] is a flowchart showing the processing when the camera function of the smartphone 100 is executed.

[0023] [ Figure 5A ] is a display example when the camera function of the smartphone 100 is executed.

[0024] [ Figure 5B ] is a display example when the camera function of the smartphone 100 is executed.

[0025] [ Figure 5C ] is a display example when the camera function of the smartphone 100 is executed.

[0026] [ Figure 5D ] is a display example when the camera function of the smartphone 100 is executed.

[0027] [ Figure 5E ] is a display example when the camera function of the smartphone 100 is executed.

[0028] [ Figure 5F ] is a display example when the camera function of the smartphone 100 is executed.

[0029] [ Figure 5G ] is a display example when the camera function of the smartphone 100 is executed.

[0030] [ Figure 6 ] is a diagram showing the correspondence between the rear camera and the front camera. DETAILED DESCRIPTION

[0031] With reference to the accompanying drawings, suitable exemplary embodiments of the present invention will be described below. Although the description is given using a smartphone as an example of an electronic device, the present invention can be implemented by a digital camera, a tablet computer, a game console, or other mobile terminals.

[0032] <Appearance of Smartphone 100>

[0033] Figure 1A 、 Figure 1B and Figure 1C is an external view of the smartphone 100. Figure 1C As shown, the surface of the smartphone 100 on which the touch panel type display (28, 70a) is placed is referred to as the "second surface", and the surface of the smartphone 100 on the opposite side is referred to as the "first surface". Figure 1A is an external view of the first surface, which is the back surface on the opposite side of the display screen of the smartphone 100 . Figure 1B is an external view of the second surface on the display screen side of the smartphone 100 .

[0034] The display unit (display screen) 28 displays images and various information. The display unit 28 includes a touch panel 70a capable of detecting touch operations on the display unit 28. The up key 61 is a button that can be used to increase the volume or to record an image. The down key 60 is a button that can be used to decrease the volume or, by pressing it simultaneously with the power switch 72, to record the image displayed on the display unit 28. The power switch 72 is a button for switching the power on and off. Three camera units are located on the first surface of the smartphone 100, on the side without the display unit 28. Two camera units are located on the second surface of the smartphone 100, on the side with the display unit 28. The camera units located on each surface have different focal lengths and, therefore, different angles of view. Camera units 203, 204, and 205 are located on the first surface. Camera units 201 and 202 are located on the second surface. The camera units 203, 204, and 205 placed on the first surface are referred to as "rear cameras." The camera units 201 and 202 placed on the second surface are referred to as "front cameras." As described above, the smartphone 100 includes two imaging units, namely, a rear camera and a front camera. The user can switch between imaging by the imaging unit on the first surface (rear camera) and imaging by the imaging unit on the second surface (front camera). Typically, the user operates the smartphone 100 while viewing the display, so the user is on the display unit 28 side. Then, the user switches to imaging using the camera unit (front camera) placed on the second surface, and thereby can capture an image including the user himself or herself holding the smartphone 100. When capturing an image, the user can capture the image while viewing the image being captured (live view image) on the display unit 28 placed on the second surface.

[0035] 〈Smartphone Structure〉

[0036] Figure 2 : is a block diagram showing an example of the configuration of the smartphone 100 according to the present exemplary embodiment.

[0037] Smartphone 100 includes camera units 201 to 205. Camera units 201 and 202 are placed on the second surface, and camera units 203, 204, and 205 are placed on the first surface. Lenses 103a to 103e represent lenses included in each camera unit. Although some camera units include multiple lenses, for simplicity, Figure 2 Only a single lens for each camera unit is shown.

[0038] Camera unit 201 is a standard camera including a standard lens 103a. Camera unit 202 is a wide-angle camera including a wide-angle lens 103b. When using camera unit 202, images can be captured with a wider angle of view than when using camera unit 201. Camera unit 203 is a standard camera including a standard lens 103c. Camera unit 204 is a wide-angle camera including a wide-angle lens 103d. Camera unit 205 is an ultra-wide-angle camera including an ultra-wide-angle lens 103e. Therefore, camera unit 204 can capture images with a wider angle of view than camera unit 203. Camera unit 205 can capture images with an even wider angle of view than camera unit 204.

[0039] Shutters 101a to 101e function as aperture shutters. Imaging units 22a to 22e are each an image sensor composed of a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) device, which converts an optical image into an electrical signal. An analog-to-digital (A / D) converter 23 converts the analog signals output from each imaging unit 22a to 22e into digital signals.

[0040] Each imaging unit 22a to 22e is an image sensor composed of a CCD or CMOS sensor that converts an optical image into an electrical signal. The camera units 201 to 205 perform photoelectric conversion on the subject images formed on the imaging units 22a to 22e through the lenses 103a to 103e, respectively, and output the generated images to the A / D converter 23. The A / D converter 23 converts the analog signal into a digital signal. The converted digital data is output to the image processing unit 24 or may be temporarily stored in the memory 32.

[0041] The image processing unit 24 performs predetermined processing on the data from the A / D converter 23 or the data from the memory control unit 15, including pixel interpolation, resizing such as reduction, and color conversion. The image processing unit 24 performs predetermined calculation processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. Thus, autofocus (AF), automatic exposure (AE), and flash pre-emission (EF) processing are performed using the through-the-lens (TTL) method. The image processing unit 24 also performs predetermined calculation processing using the captured image data and, based on the obtained calculation results, performs automatic white balance (AWB) processing using the TTL method. As part of the processing for recording image data, the image processing unit 24 also performs image compression processing.

[0042] The output data from the A / D converter 23 is written directly to the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 stores image data obtained by the respective imaging units 22 a to 22 e and converted into digital data by the A / D converter 23, and image data to be displayed on the display unit 28. The memory 32 has sufficient storage capacity for storing a predetermined number of still images and a predetermined length of time of moving images and audio.

[0043] The memory 32 also functions as a memory (video memory) for image display. The digital-to-analog (D / A) converter 13 converts the image display data stored in the memory 32 into an analog signal and supplies the analog signal to the display unit 28. Thus, the image data for display written in the memory 32 is displayed on the display unit 28 via the D / A converter 13. The display unit 28 displays on a display device such as a liquid crystal display (LCD) based on the analog signal from the D / A converter 13. The analog signal is converted into a digital signal by the A / D converter 23 once, the digital signal is accumulated in the memory 32, and is converted into an analog signal by the D / A converter 13. The analog signal is then sequentially transmitted to the display unit 28 and displayed on the display unit 28, whereby the display unit 28 functions as an electronic viewfinder and can perform a live view image display (live view display).

[0044] The power control unit 80 includes a battery detection circuit, a DC / DC converter, and a switching circuit for switching the current supply. The power control unit 80 detects the presence or absence of an attached battery, the battery type, and the remaining battery life. Based on the detection results and instructions from the system control unit 50, the power control unit 80 controls the DC / DC converter and supplies the required voltage to components including the recording medium 200 for a desired period of time. If the power switch 72 is pressed (for a predetermined time, such as 2 or 3 seconds or longer), the power of the smartphone 100 can be switched on and off. If the power switch 72 is pressed for a short period of time, less than the predetermined time, the smartphone 100 can be switched to and from power saving mode, and the display on the display unit 28 can be switched between a hidden state and a displayed state.

[0045] The power supply unit 30 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a nickel cadmium (NiCd) battery, a nickel metal hydrate (NiMH) battery, or a lithium ion (Li) battery, or an alternating current (AC) adapter.

[0046] The recording medium interface (recording medium I / F) 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, downloaded music and videos, and is composed of a semiconductor memory or a magnetic disk.

[0047] The communication unit 54 is connected wirelessly or by wire, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to the Internet via a mobile phone communication system or a wireless local area network (LAN). The communication unit 54 can transmit images (including live view images) captured by each imaging unit 22a to 22e or images stored in the recording medium 200, and can also receive image data or various other information from external devices.

[0048] The posture detection unit 55 detects the posture of the smartphone 100 relative to the direction of gravity. Based on the posture detected by the posture detection unit 55, it can be determined whether the image captured by each imaging unit 22a to 22e was captured with the smartphone 100 held horizontally or vertically. The system control unit 50 can add posture information based on the posture detected by the posture detection unit 55 to the image file of the image captured by each imaging unit 22, or store the image by rotating the image. An acceleration sensor or a gyro sensor can be used as the posture detection unit 55.

[0049] The system timer 53 is a time measuring unit that measures time used for various types of control and time of a built-in clock.

[0050] The up key 61 , the down key 60 , the power switch 72 , and the operation unit 70 are operation units for inputting various operation instructions to the system control unit 50 .

[0051] The system memory 52 is, for example, a random access memory (RAM). The system control unit 50 reads a program and constants and variables used for the operation of the system control unit 50 from the nonvolatile memory 56 and loads the constants, variables, and program into the system memory 52 .

[0052] The nonvolatile memory 56 is a memory from which data can be electrically erased by the system control unit 50 and in which data can be recorded by the system control unit 50. As the nonvolatile memory 56, for example, an electrically erasable programmable read-only memory (EEPROM) is used. The nonvolatile memory 56 stores programs and constants used for the operation of the system control unit 50. The "program" used here includes programs for executing the various flowcharts described below in this exemplary embodiment.

[0053] The system control unit 50 includes at least one built-in processor and controls the entire smartphone 100. The system control unit 50 executes the program stored in the nonvolatile memory 56 described above, thereby implementing the processing described below in this exemplary embodiment. Furthermore, the system control unit 50 controls the image processing unit 24, the memory control unit 15, the memory 32, the D / A converter 13, and the display unit 28, thereby performing display control. This control includes the display of live view images or captured images stored in the recording medium 200, as well as the display of various setting screens and setting values ​​on the display unit 28.

[0054] The operation unit 70 includes a touch panel 70a capable of detecting touch operations and a switch for switching to silent mode. Furthermore, the operation unit 70 includes an up key 61, a down key 60, and a power switch 72. Through the operation unit, the user can perform operations on the smartphone, such as changing the camera mode or camera settings (camera conditions), giving camera instructions, or giving instructions for executing camera functions.

[0055] Next, refer to Figure 3 , describing the camera angle of view and focal length of each camera unit of the smartphone 100. Figure 3 It is a diagram showing the imaging angle of view and focal length of each camera unit.

[0056] On the first surface, camera units 203 to 205 are placed as rear cameras. The ultra-wide-angle lens 103e of the camera unit (ultra-wide-angle camera) 205 has a focal length of 10 mm and a shooting angle of 130 degrees. The wide-angle lens 103d of the camera unit (wide-angle rear camera) 204 has a focal length of 20 mm and a shooting angle of 80 degrees. The standard lens 103c of the camera unit (standard camera) 203 has a focal length of 30 mm and a shooting angle of 60 degrees. On the second surface, camera units 201 and 202 are placed as front cameras. The wide-angle lens 103b of the camera unit (wide-angle front camera) 202 has a focal length of 15 mm and a shooting angle of 110 degrees. The standard lens 103a of the camera unit (standard camera) 201 has a focal length of 25 mm and a shooting angle of 70 degrees.

[0057] Among the rear cameras, the ultra-wide-angle camera 205 can capture a 130-degree angle of view. If the user instructs to change the angle of view, and the specified angle of view is less than 130 degrees and greater than 80 degrees, the image captured by the ultra-wide-angle camera 205 is electronically zoomed to reduce the angle of view. If the user-specified angle of view reaches 80 degrees, the camera switches to the wide-angle rear camera 204. Conversely, if the user instructs to change the angle of view to 80 degrees or greater while the wide-angle rear camera 204 is capturing images at an angle of view of 80 degrees or less, the camera switches to the ultra-wide-angle camera 205, and electronic zoom is performed to adjust the angle of view. If the user-specified angle of view for the wide-angle rear camera 204 is less than 80 degrees and greater than 60 degrees, the image captured by the wide-angle rear camera 204 is electronically zoomed to reduce the angle of view. If the user-specified angle of view reaches 60 degrees, the camera switches to the standard camera 203. On the other hand, during the imaging of the standard camera 203, if the imaging angle of view specified by the user reaches 60 degrees or more, the imaging is switched to the wide-angle rear camera 204, and electronic zoom is performed to obtain the imaging angle of view. A method for specifying the imaging angle of view will be described below.

[0058] As described above, if the user gives an instruction to change the imaging angle of view, the electronic zoom is used, and if the user gives an instruction to change the imaging angle of view to one suitable for imaging by other camera units, the camera unit performing imaging is switched.

[0059] Similarly, in the case of the second surface, the wide-angle front camera 202 can capture a 110-degree viewing angle. If the user-specified viewing angle is less than 110 degrees and greater than 70 degrees, the image captured by the wide-angle front camera 202 is electronically zoomed to reduce the viewing angle. If the user-specified viewing angle reaches 70 degrees, the image is switched to the standard camera 201. If the user-specified viewing angle is less than 70 degrees, the image captured by the standard camera 201 is electronically zoomed to reduce the viewing angle. During the standard camera 201 capturing, if the user-specified viewing angle exceeds 70 degrees, the image is switched to the wide-angle front camera 202, and electronic zoom is performed to obtain the desired viewing angle.

[0060] Although each lens has a single focus in the present exemplary embodiment, a configuration may be employed in which the position of each lens is movable and optical zooming can be performed.

[0061] <Processing flow of camera functions>

[0062] Next, refer to Figure 4A and Figure 4B , describing the processing when the camera function of the smartphone 100 is executed.

[0063] First, in step S401, the system control unit 50 determines whether the operation of the operation unit 70 by the user is an instruction to execute the camera function of the smartphone 100. If the instruction to execute the camera function is given, the process proceeds to step S403. If the instruction is not an instruction to execute the camera function, the process proceeds to step S402.

[0064] In step S402, the system control unit 50 executes processing corresponding to the operation by the user. In addition, during or after executing this processing, the system control unit 50 determines whether an instruction to execute the camera function of step S401 is given.

[0065] In step S403, the system control unit 50 activates the camera unit (standard rear camera) 203, which is a rear camera including the standard lens 103 c. Then, in step S404, the system control unit 50 displays a display screen of the standard rear camera, including a live view image captured by the standard rear camera 203 and various display items, on the display unit 28. The display of the screen of the standard rear camera, including the live view image captured by the standard camera 203, continues until the display is switched to another camera.

[0066] Figure 5A 2 is a display example of a display screen of a standard rear camera displayed when the standard camera 203 (standard rear camera) among the rear cameras is operating. Figure 5AIn the display example in , display items such as a camera button 501 , a rear camera / front camera switching button 502 , a flash setting icon 503 , a view angle switching icon 504 , and a camera mode setting 505 are displayed together with a live view image 511 .

[0067] The live view image 511 is captured by the standard camera 203. By performing a touch operation on the live view image, the user can change the angle of view of the live view image displayed on the display unit 28. The user can change the angle of view by touching multiple positions (for example, two points) at the same time and performing a pinch-in operation to bring the touch positions closer together or a pinch-out operation to move the touch positions apart from each other. Figure 4A , but if the system control unit 50 detects a pinch-in operation on the live view image, the system control unit 50 makes the angle of view of the live view image wider (larger) in response to the pinch-in operation, thereby zooming out the live view image. Then, if the system control unit 50 detects a pinch-out operation, the system control unit 50 makes the angle of view of the live view image narrower (smaller), thereby zooming in the live view image. In response to the pinch-in operation or the pinch-out operation, the system control unit 50 changes the angle of view of the live view image within the range in which the angle of view can be changed. As shown in FIG. Figure 3 As described above, in response to a pinch-in operation or a pinch-out operation, the system control unit 50 changes the angle of view of the live view image by performing electronic zoom processing and switching between camera units.

[0068] The image capture button 501 is a button for giving an instruction to record a captured image. If the user operates (touches) the button 501, a recording process for recording the captured image is performed.

[0069] The rear camera / front camera switch button 502 is a button for switching between the rear camera and the front camera. During the rear camera (rear camera operation), if the user operates (touches) button 502, the camera switches to the front camera. During the front camera, if the user operates (touches) button 502, the camera switches to the rear camera.

[0070] The flash setting icon 503 is an icon indicating the current flash photography setting. Figure 5A , a flash setting icon 503 indicates that forced emission is set as a flash image pickup setting. The user can change the flash image pickup setting to another setting (eg, automatic, red-eye reduction, or off) by operating (touching) the icon 503.

[0071] The perspective switching icons 504 include a standard icon 504-1, a wide-angle icon 504-2, and an ultra-wide-angle icon 504-3. The user can switch between the standard camera, the wide-angle camera, and the ultra-wide-angle camera by operating (touching) any of these icons. Figure 5A In the example, since the standard camera is capturing images, the standard icon 504-1 is displayed in a selected state (displayed in a different color or with a selection frame). If the angle of view switching icon 504 is operated, the system control unit 50 switches to capturing images using the corresponding camera unit and outputs an image without performing electronic zoom (displaying a live view image). Therefore, the angle of view can be greatly changed with a single operation of the angle of view switching icon 504.

[0072] In the camera mode setting 505, buttons corresponding to a plurality of camera modes that can be set by the camera function are displayed in a row. In this exemplary embodiment, a photo (still image) shooting mode, a moving image shooting mode, a panoramic camera mode, and a portrait camera mode can be set. Figure 5A In the display unit 28, the button corresponding to the photo (still image) shooting mode is displayed in a selected state (displayed in a different color or displayed with a selection frame), so that it can be understood that the currently set shooting mode is the photo (still image) shooting mode. As described above, under the display control of the system control unit 50, display items for making shooting settings and giving shooting instructions are displayed together with the live view image on the display unit 28.

[0073] In this exemplary embodiment, if the camera function is executed, first, the standard rear camera is selected and operated in a photo shooting mode (still image shooting mode). Figure 4A In the flowchart of FIG. , based on the determination in step S401 that an instruction to execute the camera function has been given, the processing of steps S403 and S404 is executed, and image capture with the standard rear camera is started. Alternatively, the wide-angle rear camera may be operated first instead of the standard rear camera. Alternatively, the camera unit and image capture mode selected in the previous use of the camera function may be stored, and the camera unit selected in the previous use of the camera function may be operated in the image capture mode selected in the previous use of the camera function.

[0074] After the system control unit 50 starts executing the camera function and displays a live view image and display items, the system control unit 50 monitors an operation of the operation unit 70 by the user and executes a process in response to the user's operation.

[0075] In step S405, the system control unit 50 determines whether to switch to the wide-angle rear camera 204 among the rear cameras. If the system control unit 50 is to switch to the wide-angle rear camera 204, the process proceeds to step S406. The system control unit 50 then performs the processes of steps S406 and S407, thereby switching from imaging with the current camera to imaging with the wide-angle rear camera 204. If the wide-angle icon 504-2 is touched, or if the imaging angle of view is changed by a pinch-in or pinch-out operation and reaches the angle of view corresponding to the wide-angle rear camera, the system control unit 50 determines that the image is to be switched to the wide-angle rear camera 204.

[0076] In step S406, the system control unit 50 activates the camera unit (wide-angle rear camera) 204, which is a rear camera including the wide-angle lens 103 d, and switches to image capture by the wide-angle rear camera 204. Then, in step S407, the system control unit 50 displays a display screen of the wide-angle rear camera, including a live view image captured by the wide-angle rear camera 204 and various display items, on the display unit 28. The display of the screen of the wide-angle rear camera, including the live view image captured by the wide-angle rear camera 204, continues until switching to another camera.

[0077] After executing the processing of step S406 and step S407, the processing returns to step S405. In step S405, the system control unit 50 monitors the operation of the operation unit 70 by the user and executes processing corresponding to the operation by the user.

[0078] Figure 5B 2 is a display example of a display screen of a wide-angle rear camera displayed when the wide-angle rear camera 204 among the rear cameras is operating. Figure 5B In the display example in , display items such as a camera button 501 , a rear camera / front camera switching button 502 , a flash setting icon 503 , a view switching icon 504 , and a camera mode setting 505 are displayed together with a live view image 512 .

[0079] The live view image 512 is captured by the wide-angle rear camera 204. In addition, on this screen, the user can change the angle of view of the live view image by pinching in or pinching out the live view image. The camera button 501, the rear camera / front camera switch button 502, the flash setting icon 503, the angle of view switch icon 504 and the camera mode setting 505 are Figure 5A The display items in the same display items are displayed in the same position. Figure 5BIn FIG, since the currently set camera mode is the photo (still image) shooting mode, the photo (still image) mode is displayed in a selected state. In addition, since the wide-angle rear camera is operating, the wide-angle icon 504-2 is displayed in a selected state.

[0080] In step S408, the system control unit 50 determines whether to switch to the ultra-wide-angle camera 205 (ultra-wide-angle rear camera) among the rear cameras. If the system control unit 50 is to switch to the ultra-wide-angle rear camera 205, the process proceeds to step S409. The system control unit 50 then performs the processes of steps S409 and S410, thereby switching from recording with the current camera to recording with the ultra-wide-angle rear camera 205. If the ultra-wide-angle icon 504-3 is touched, or if the recording angle of view is changed by a pinch-in or pinch-out operation and reaches the angle of view corresponding to the ultra-wide-angle rear camera, the system control unit 50 determines that the recording is to be switched to the ultra-wide-angle rear camera 205.

[0081] In step S409, the system control unit 50 activates the camera unit (ultra-wide-angle rear camera) 205, which is the rear camera including the ultra-wide-angle lens 103e, and switches to image capture by the ultra-wide-angle rear camera 205. Then, in step S410, the system control unit 50 displays a display screen of the ultra-wide-angle rear camera, including a live view image captured by the ultra-wide-angle rear camera 205 and various display items, on the display unit 28. The display of the screen of the ultra-wide-angle rear camera, including the live view image captured by the ultra-wide-angle rear camera 205, continues until the mode is switched to another camera.

[0082] After executing the processing of step S409 and step S410, the processing returns to step S405. In step S405, the system control unit 50 monitors the operation of the operation unit 70 by the user and executes processing corresponding to the operation by the user.

[0083] Figure 5C 2 is a display example of a display screen of an ultra-wide-angle rear camera displayed when the ultra-wide-angle camera 205 (ultra-wide-angle rear camera) among the rear cameras is operating. Figure 5C In the display example in , display items such as a camera button 501 , a rear camera / front camera switching button 502 , a flash setting icon 503 , a view angle switching icon 504 , and a camera mode setting 505 are displayed together with a live view image 513 .

[0084] The live view image 513 is captured by the ultra-wide-angle rear camera 205. In addition, on this screen, the user can change the angle of view of the live view image by pinching or pinching the live view image. The camera button 501, the rear camera / front camera switch button 502, the flash setting icon 503, the angle of view switch icon 504 and the camera mode setting 505 are Figure 5A and Figure 5B The display items in the same display items are displayed in the same position. Figure 5C In FIG, since the currently set camera mode is the photo (still image) shooting mode, the photo (still image) mode is displayed in a selected state. In addition, since the ultra-wide-angle rear camera is operating, the ultra-wide-angle icon 504-3 is displayed in a selected state.

[0085] In step S411, the system control unit 50 determines whether to switch to the standard camera 203 (standard rear camera) among the rear cameras. If the system control unit 50 is to switch to the standard rear camera 203, the process proceeds to step S403. The system control unit 50 then performs the processes of steps S403 and S404, thereby switching from recording with the current camera to recording with the standard rear camera 203. If the standard icon 504-1 is touched, or if the recording angle of view is changed by a pinch-in or pinch-out operation and reaches the angle of view corresponding to the standard rear camera, the system control unit 50 determines that the camera is to be switched to the standard rear camera 203.

[0086] After executing the processing of step S403 and step S404, the processing returns to step S405. In step S405, the system control unit 50 monitors the operation of the operation unit 70 by the user and executes processing corresponding to the operation by the user.

[0087] In step S412, the system control unit 50 determines whether an instruction to switch the imaging mode has been given by the user operating (touching) any of the displayed icons of the imaging mode setting 505. If an instruction to switch the imaging mode has been given, the process proceeds to step S413. If the instruction is not an instruction to switch the imaging mode, the process proceeds to step S419.

[0088] In step S413, the system control unit 50 executes processing for changing the imaging mode. The system control unit 50 changes image processing according to the imaging mode. Next, in step S414, the system control unit 50 determines whether the imaging mode has been changed to the moving image mode. If the imaging mode has been changed to the moving image mode, the process proceeds to step S418. If the imaging mode has not been changed to the moving image mode, the process proceeds to step S415.

[0089] In step S418 , the system control unit 50 controls to display a magnification change bar on the display unit 28 .

[0090] Reference Figure 5D , describing the magnification change bar. Figure 5D is a display example of a display screen for a standard rear camera in the case of a moving image mode. Figure 5A The same symbols represent the parts Figure 5A , and therefore will not be described again. In the motion image mode for shooting (recording) motion images, the magnification change bar 506 is displayed. The magnification change bar 506 includes a magnification bar 506-1 and a slider 506-2. The magnification bar 506-1 corresponds to the angle of view (magnification) that can be shot by the rear camera (standard rear camera, wide-angle rear camera, and ultra-wide-angle rear camera). The user can change the zoom magnification of the live view image (change the angle of view) by moving the slider 506-2 through a touch operation. Figure 5D As shown in FIG, a standard icon 504-1, a wide-angle icon 504-2, and an ultra-wide-angle icon 504-3 for switching between viewing angles can be displayed at the positions of the corresponding magnifications on the magnification bar 506-1. Such a display enables the user to easily grasp the correspondence between the magnification (viewing angle) and the camera (standard rear camera, wide-angle rear camera, and ultra-wide-angle rear camera). If the camera mode is switched to the motion image mode on the display screen for the wide-angle rear camera or the ultra-wide-angle rear camera instead of the standard rear camera, the video mode is displayed as follows: Figure 5DA magnification change bar 506 is also shown. During moving image capture, if the magnification (angle of view) changes dramatically, particularly during image capture (recording), the resulting video becomes difficult to view. Therefore, it is desirable to smoothly change the magnification (angle of view). Although the user can smoothly change the magnification (angle of view) by performing a pinch-in or pinch-out operation on the live view image, the live view image is hidden by the user's hand, making it difficult to adjust the magnification (angle of view) while viewing the live view image. Therefore, in this exemplary embodiment, when the camera mode is changed to moving image mode, a magnification change bar is displayed in a position where the live view image is not displayed. This allows the user to change the magnification while viewing the live view image, even during moving image capture. To display the magnification change bar in a position that overlaps with the live view image, the bar can be displayed in an area at the edge of the live view image. Displaying the bar in an area at the edge of the live view image allows the user to perform a magnification change operation while viewing the live view image. If the bar is displayed, processing returns to step S405. In step S405, the system control unit 50 monitors user operations on the operation unit 70 and executes processing in response to the user operations. In this exemplary embodiment, the magnification change bar is displayed when the imaging mode is switched to the moving image mode. Alternatively, instead of displaying the magnification change bar when the imaging mode is switched to the moving image mode, the magnification change bar may be displayed when moving image capture starts (moving image recording starts). The magnification change bar may then be hidden when moving image capture ends (moving image recording ends), allowing it to be displayed during moving image recording.

[0091] If it is determined in step S414 that the imaging mode has been switched to an imaging mode other than the moving image mode, then in step S415 the system control unit 50 hides the magnification change bar 506 and changes the display back to the image mode. Figure 5A 、 Figure 5B or Figure 5CThe display shown is displayed. If the magnification change bar 506 is not displayed before the image capture mode is changed, no processing is performed in step S415. Next, in step S416, the system control unit 50 obtains information regarding the lenses (camera units) that can be used in the image capture mode after the change, that is, the currently selected image capture mode. Then, in step S417, if the usable lenses (camera units) obtained in step S416 do not include the currently used lens (camera unit), the system control unit 50 determines that it is necessary to switch to the standard lens 103c (standard rear camera 203). In this exemplary embodiment, in photo (still image) mode and moving image mode, any of the standard lens, wide-angle lens, and ultra-wide-angle lens (camera unit) can be used for image capture. However, only panoramas can be captured with a standard lens (standard camera), and only portraits can be captured with angles of view that can be captured with a standard lens (standard camera). Therefore, if the image capture mode is switched to portrait or panoramic mode, the system control unit 50 determines that it is necessary to switch to the standard camera. The process then proceeds to step S403, causing the system control unit 50 to switch to operation of the standard rear camera. The system control unit 50 then switches to imaging with the standard rear camera 203. If switching to the standard camera is not necessary, the system control unit 50 continues imaging with the current camera unit, and the process returns to step S405. In step S405, the system control unit 50 monitors the user's operation of the operation unit 70 and executes processing in response to the user's operation.

[0092] In this exemplary embodiment, in portrait camera mode, both the standard rear camera 203 and the wide-angle rear camera 204 are used to capture images, and the images captured by these two cameras are synthesized to generate a composite image with a blurred background and a focused subject. Therefore, in reality, not only the standard rear camera 203 is activated, but also the wide-angle rear camera is activated. However, images can only be captured at viewing angles that can be captured by the standard rear camera. Therefore, similar to the display screen of the standard rear camera, the standard icon is displayed in a selected state. In addition, in panoramic camera mode, images cannot be captured by cameras other than the standard camera including a standard lens. Therefore, in portrait camera mode and panoramic camera mode, the wide-angle icon 504-2 and the ultra-wide-angle icon 504-3 can be hidden or grayed out.

[0093] In step S419, the system control unit 50 determines whether an instruction to record an image has been input by the user operating the capture button 501. If an instruction to record an image has been input, the process proceeds to step S420. If the instruction is not an instruction to record an image, the process proceeds to step S421. In step S420, the system control unit 50 performs image recording processing. In this recording processing, the system control unit 50 records the image captured and acquired by the camera unit currently operating and capturing a live view image. In photo mode, the system control unit 50 controls the capture of a still image in response to the operation of the capture button 501 and records the still image in the recording medium 200. In moving image mode, the system control unit 50 controls the recording of a moving image captured from the time the capture button 501 is touched until the time the capture button 501 is touched again. As described above, the system control unit 50 performs recording processing according to the capture mode. In this recording processing, the system control unit 50 controls the recording of an image at the angle of view of the live view image currently displayed on the display unit 28. When the recording process is completed, the process returns to step S405. In step S405, the system control unit 50 monitors the operation of the operation unit 70 by the user, and executes a process in response to the operation by the user.

[0094] In step S421, the system control unit 50 determines whether an instruction to switch to the front camera has been input by the user through a touch operation on the rear camera / front camera switching button 502 during image capture with the rear camera. If an instruction to switch to the front camera has been input, the process proceeds to step S423. If an instruction to switch to the front camera has not been input, the process proceeds to step S422.

[0095] In step S422, the system control unit 50 determines whether an operation for ending the camera function has been performed on the operation unit 70. If an operation for an instruction to end the camera function has been performed, the system control unit 50 ends the camera function, and the processing of the flowchart ends. If an operation for an instruction other than ending the camera function has been performed, the process returns to step S405. In step S405, the system control unit 50 monitors the user's operation of the operation unit 70 and executes processing in response to the user's operation.

[0096] The processing from step S403 to step S422 is the processing flow when an image is captured by the rear camera placed on the first surface (any one of the standard rear camera 203, the wide-angle rear camera 204, and the ultra-wide-angle rear camera 205). Meanwhile, the processing from step S425 to step S440, to be described below, is the processing flow when an image is captured by the front camera placed on the second surface (any one of the standard front camera 201 and the wide-angle front camera 202). The processing from step S423, step S424, step S442, and step S443 is used to determine which angle of view the camera to be activated corresponds to when switching between the rear camera and the front camera.

[0097] If an instruction to switch from the rear camera to the front camera is given in step S421, the system control unit 50 first obtains information about the currently operating rear camera in step S423. Specifically, the system control unit 50 obtains information about which of the camera units 203 to 205 in the rear camera is currently capturing an image. Next, in step S424, based on the information about the currently operating rear camera obtained in step S423 and the information about the correspondence between the rear cameras and the front cameras stored in the non-volatile memory 56, the system control unit 50 determines which of the standard front camera and the wide-angle front camera to activate.

[0098] Figure 6 is a diagram illustrating the correspondence relationship between the rear camera and the front camera according to this exemplary embodiment. Based on the information regarding the correspondence relationship, if an instruction to switch to the front camera is given while the standard rear camera 203 is operating, the system control unit 50 determines to activate the standard front camera 201. If an instruction to switch to the front camera is given while the wide-angle rear camera 204 is operating, the system control unit 50 determines to switch to the wide-angle front camera 202 and activates the wide-angle front camera 202 by performing electronic zoom processing to achieve a specific magnification and an imaging angle of view smaller than that of the wide-angle front camera 202. If an instruction to switch to the front camera is given while the ultra-wide-angle rear camera 205 is operating, the system control unit 50 determines to activate the wide-angle front camera 202.

[0099] As described above, in the smartphone according to this exemplary embodiment, if an instruction to switch from the rear camera to the front camera is given, the smartphone switches to the front camera, and then automatically selects the camera unit 201 including the standard lens 103a or the camera unit including the wide-angle lens 103b for operation, depending on the angle of view of the rear camera (the rear camera unit or lens already used), and switches to the camera unit.

[0100] For example, if a user adjusts the angle of view of the rear camera to include the background and then switches to the front camera because the user wants to capture an image that includes the user himself or herself, it is desirable to activate the front camera with an angle of view that is as close as possible to the angle of view of the rear camera. If the front camera is activated with the angle of view set to the initial setting regardless of the angle of view of the rear camera, the user needs to issue an instruction to switch to the front camera and then further perform an operation to switch between the standard camera and the wide-angle camera of the front camera, which is troublesome. Therefore, in this exemplary embodiment, when switching to the front camera, the angle of view of the rear camera (a standard camera including a standard lens, a wide-angle camera including a wide-angle lens, and an ultra-wide-angle camera including an ultra-wide-angle lens) is associated with the front camera to be activated (a standard camera including a standard lens or a wide-angle camera including a wide-angle lens). Therefore, the trouble of user operations such as switching between camera units of the front camera and adjusting the angle of view after switching to the front camera can be reduced.

[0101] If it is determined in step S424 that the standard front camera is to be activated, then in step S425, the system control unit 50 activates the camera unit (standard front camera) 201 including the standard lens 103a and switches to recording with the standard front camera. Then, in step S426, the system control unit 50 displays a standard front camera display screen on the display unit 28, including a live view image captured by the standard front camera 201 and various display items. The display of the standard front camera screen, including the live view image captured by the standard front camera 201, continues until the camera is switched to another camera. After executing the processing of steps S425 and S426 and switching to recording with the standard front camera, the process proceeds to step S429. In step S429, the system control unit 50 monitors the user's operation of the operation unit 70 and executes processing in response to the user's operation.

[0102] Figure 5E This is a display example of a display screen of a standard front camera that is displayed when an image is captured by the standard camera 201 (standard front camera) of the front camera. Figure 5E In the display example in , display items such as a camera button 501 , a rear camera / front camera switching button 502 , a view angle switching icon 504 , and a camera mode setting 505 are displayed together with a live view image 514 .

[0103] The live view image 514 is captured and obtained by the standard front camera 201. In addition, on this screen, the user can change the perspective of the live view image by pinching or pinching the live view image. The camera button 501, the rear camera / front camera switch button 502, the perspective switch icon 504 and the camera mode setting 505 are Figure 5A The same display items as in . Figure 5E , since the currently set video mode is the photo (still image) shooting mode, the photo (still image) mode is displayed in a selected state. In addition, since the standard front camera is operating, the standard icon 504-1 is displayed in a selected state. In this exemplary embodiment, two front cameras are provided, namely the standard front camera and the wide-angle front camera. Therefore, among the perspective switching icons 504, the standard icon 504-1 and the wide-angle icon 504-2 are displayed, and the ultra-wide-angle icon 504-3 is not displayed. In this exemplary embodiment, the front camera cannot perform panoramic photography. Therefore, in the video mode setting 505, panorama is not displayed, but photos (still images), moving images and portraits are displayed. The video mode can be changed to these video modes. The front camera cannot perform flash photography, so the flash setting icon 503 is not displayed.

[0104] If it is determined in step S424 that the wide-angle front camera is to be activated instead of the standard front camera, then in step S427, the system control unit 50 activates the camera unit (wide-angle front camera) 202 including the wide-angle lens 103b and switches to recording with the wide-angle front camera. Then, in step S428, the system control unit 50 displays a display screen of the wide-angle front camera, including a live view image captured by the wide-angle front camera 202 and various display items, on the display unit 28. The display of the wide-angle front camera screen, including the live view image captured by the wide-angle front camera 202, continues until the camera is switched to another camera. If it is determined in step S424 that the wide-angle front camera is to be activated and electronic zoom processing is to be performed, the system control unit 50 controls the wide-angle front camera 202 to be activated and switches to recording with the wide-angle front camera. The system control unit 50 then controls the wide-angle front camera 202 to be activated, reducing the recording angle of view to a smaller angle than the wide-angle front camera 202 can capture, and displays the live view image.

[0105] After executing the processing of steps S427 and S428 and switching to imaging of the wide-angle front camera, the process proceeds to step S429. In step S429, the system control unit 50 monitors the operation of the operation unit 70 by the user and executes processing in response to the operation by the user.

[0106] Figure 5F 2 is a display example of a display screen of a wide-angle front camera displayed when an image is captured by the wide-angle front camera 202 of the front camera. Figure 5F In the display example in , display items such as a camera button 501 , a rear camera / front camera switching button 502 , a view angle switching icon 504 , and a camera mode setting 505 are displayed together with a live view image 515 .

[0107] The live view image 515 is captured and obtained by the wide-angle front camera 202. In addition, on this screen, the user can change the angle of view of the live view image by pinching or pinching the live view image. The camera button 501, the rear camera / front camera switch button 502, the angle of view switch icon 504 and the camera mode setting 505 are Figure 5E The display items in the same display items are displayed in the same position. Figure 5F , since the currently set camera mode is the photo (still image) shooting mode, the photo (still image) mode is displayed in a selected state. In addition, since the wide-angle front camera is operating, the wide-angle icon 504-2 is displayed in a selected state.

[0108] In step S429, the system control unit 50 determines whether to switch to the standard camera 201 (standard front camera) among the front cameras. If the standard icon 504-1 is touched, or if the shooting angle of view is changed by a pinch-in or pinch-out operation and reaches the angle of view corresponding to the standard front camera, the system control unit 50 determines to switch to the standard front camera 201. If the system control unit 50 is to switch to the standard front camera 201, the process proceeds to step S425. The system control unit 50 then performs the processes of steps S425 and S426, thereby switching from shooting with the current camera (wide-angle front camera) to shooting with the standard front camera 201. If the system control unit 50 is not to switch to the standard front camera, the process proceeds to the next determination (step S430).

[0109] In step S430, the system control unit 50 determines whether to switch to the wide-angle front camera 202 among the front cameras. If the wide-angle icon 504-2 is touched, or if the image capture angle of view is changed by a pinch-in or pinch-out operation and reaches the angle of view corresponding to the wide-angle front camera, the system control unit 50 determines to switch to the wide-angle front camera 202. If the system control unit 50 is to switch to the wide-angle front camera 202, the process proceeds to step S427. The system control unit 50 then performs the processes of steps S427 and S428, thereby switching from image capture by the current camera (the standard front camera) to image capture by the wide-angle front camera 202. If the system control unit 50 is not to switch to the wide-angle front camera, the process proceeds to the next determination (step S431).

[0110] In step S431, the system control unit 50 determines whether an instruction to switch the imaging mode has been given by the user operating (touching) any of the displayed icons of the imaging mode setting 505. If an instruction to switch the imaging mode has been given, the process proceeds to step S432. If an instruction to switch the imaging mode has not been given, the process proceeds to the next determination in step S438.

[0111] In step S432, the system control unit 50 executes processing for changing the imaging mode. The system control unit 50 changes image processing according to the imaging mode. Next, in step S433, the system control unit 50 determines whether the imaging mode has been changed to the moving image mode. If the imaging mode has been changed to the moving image mode, the process proceeds to step S437. If the imaging mode has not been changed to the moving image mode, the process proceeds to step S434.

[0112] If the imaging mode is changed to the moving image mode, then in step S437, the system control unit 50 controls the image to be captured as follows: Figure 5G As shown, a magnification change bar 506 is displayed on the display unit 28. The magnification change bar 506 is similar to the magnification change bar displayed when the shooting mode is changed to the moving image mode in the shooting of the rear camera. However, the magnification bar 506-1 corresponds to the angle of view (magnification) that can be captured by the front camera (standard front camera and wide-angle front camera). The user can change the magnification of the live view image (change the angle of view) by moving the slider 506-2 through a touch operation. Figure 5G As shown, a standard icon 504-1 and a wide-angle icon 504-2 for switching between angles of view are displayed at positions of corresponding magnifications on the magnification bar 506-1. As described above, also in the front camera's image capture, if the image capture mode is changed to a moving image mode for capturing (recording) moving images, the magnification change bar is displayed, making it possible to change the angle of view while viewing a live view image during moving image capture (moving image recording).

[0113] If the image capture mode has been switched to moving image mode, the system control unit displays the magnification change bar 506 in step S437, and processing proceeds to step S427. The system control unit then performs the processing of steps S427 and S428, thereby switching to image capture using the wide-angle front camera 202. If image capture using the wide-angle front camera is already in progress, processing proceeds to step S429 and skips the processing of steps S427 and S428. As described above, in this exemplary embodiment, in response to switching from another image capture mode to moving image mode, the front camera switches to moving image mode and also switches to image capture using the wide-angle front camera. When capturing still images with the front camera, users often capture images of themselves with their face in close-up. However, when capturing moving images with the front camera, users often capture images that include multiple people (including the user), images that include the user's entire body, or images of themselves against a background. In such cases, it is desirable to capture images using the wide-angle front camera. Therefore, in this exemplary embodiment, when the front camera is capturing images, in response to switching to the moving image mode, the front camera switches to capturing images using the wide-angle front camera 202, thereby saving the user the trouble of switching to the wide-angle camera. When capturing images using the rear camera, as described above, even if the image capture mode is switched to the moving image mode, the rear camera does not automatically switch to the wide-angle camera or the ultra-wide-angle camera, and continues capturing images using the camera unit that was in use before switching to the moving image mode.

[0114] If it is determined in step S433 that the imaging mode has been switched to a mode other than moving image mode, the system control unit 50 hides the magnification change bar 506 in step S434. If the magnification change bar 506 was not displayed before the imaging mode was changed, the processing of step S434 can be skipped. Next, in step S435, the system control unit 50 obtains information about lenses (camera units) that can be used in the imaging mode after the change (i.e., the currently selected imaging mode). Then, in step S436, if the usable lenses (camera units) obtained in step S435 do not include the currently used lens (camera unit), the system control unit 50 determines that it is necessary to switch to the standard lens 103a (standard front camera 201). In this exemplary embodiment, imaging can be performed using either the standard lens or the wide-angle lens (camera unit) in both photo (still image) mode and moving image mode. However, portraits can only be captured at angles of view that can be captured by the standard lens (standard camera). Therefore, if the imaging mode is switched to portrait, the system control unit 50 determines that it is necessary to switch to the standard camera. The process then proceeds to step S425, causing the system control unit 50 to switch to operation of the standard front camera. Then, in step S425, the system control unit 50 switches to imaging with the standard front camera 201. If switching to the standard camera is not necessary, the system control unit 50 continues imaging with the current camera unit, and the process returns to step S429. In step S429, the system control unit 50 monitors the user's operation of the operation unit 70 and executes processing in response to the user's operation.

[0115] In the portrait mode of the front camera, similar to the portrait mode of the rear camera, both the standard front camera 201 and the wide-angle front camera 202 capture images, and the images captured by the two cameras are synthesized to generate a composite image with a blurred background and a focused subject.

[0116] In step S438, the system control unit 50 determines whether an instruction to record an image has been input by the user operating the capture button 501. If an instruction to record an image has been input, the process proceeds to step S439. If the instruction is not to record an image, the process proceeds to step S440. In step S439, the system control unit 50 performs image recording processing. In this recording processing, the system control unit 50 records the image captured and acquired by the camera unit currently operating and capturing a live view image. In photo mode, the system control unit 50 controls the capture of a still image in response to the operation of the capture button 501 and records the still image in the recording medium 200. In moving image mode, the system control unit 50 controls the recording of the moving image captured from the time the capture button 501 is touched until the time the capture button 501 is touched again. As described above, the system control unit 50 performs recording processing according to the capture mode. In this recording processing, the system control unit 50 controls the recording of the image at the angle of view of the live view image currently displayed on the display unit 28. When the recording process is completed, the process returns to step S429. In step S429, the system control unit 50 monitors the operation of the operation unit 70 by the user, and executes a process in response to the operation by the user.

[0117] In step S440, the system control unit 50 determines whether an instruction to switch to the rear camera has been input by the user through a touch operation on the rear camera / front camera switch button 502 during image capture by the front camera. If an instruction to switch to the rear camera has been input, the process proceeds to step S442. If an instruction to switch to the rear camera has not been input, the process proceeds to step S441.

[0118] If it is determined in step S440 that an instruction to switch to the rear camera is input, then in step S442, the system control unit 50 acquires information about the front camera currently in operation. Specifically, the system control unit 50 acquires information about which of the camera units 201 and 202 of the front camera has performed image capture. Next, in step S443, based on the information about the operating front camera acquired in step S442 and the information about the correspondence relationship between the rear camera and the front camera stored in the non-volatile memory 56 ( Figure 6), the system control unit 50 determines which of the standard rear camera, the wide-angle rear camera, and the ultra-wide-angle rear camera to start. If an instruction to switch to the rear camera is given during image capture by the standard front camera 201, the system control unit 50 determines to start the standard rear camera 203. Then, the processing proceeds to step S403. In step S403, the system control unit 50 switches to image capture by the standard rear camera. If it is during image capture by the wide-angle front camera 202, the system control unit 50 switches its determination between starting the wide-angle rear camera 204 and starting the ultra-wide-angle rear camera 205, depending on the angle of view being captured by the wide-angle front camera. In the present exemplary embodiment, as Figure 6 As shown, if the wide-angle front camera is capturing images without electronic zoom processing, the system control unit 50 determines that the image should be switched to the ultra-wide-angle rear camera. The process then proceeds to step S406. In step S406, the system control unit 50 switches to capturing images with the ultra-wide-angle rear camera. If the wide-angle front camera is capturing images with electronic zoom processing, the system control unit 50 determines that the image should be switched to the wide-angle rear camera. The process then proceeds to step S409. In step S409, the system control unit 50 switches to capturing images with the wide-angle rear camera.

[0119] As described above, in the smartphone according to this exemplary embodiment, if an instruction to switch from the front camera to the rear camera is given, the smartphone switches to the rear camera, and then automatically selects a camera unit to operate from among the standard rear camera 203 including the standard lens 103c, the wide-angle rear camera 204 including the wide-angle lens 103d, and the ultra-wide-angle camera 205 including the ultra-wide-angle lens 103e, depending on the angle of view of the front camera (the front camera unit or lens already used), and switches to the camera unit.

[0120] In step S441, the system control unit 50 determines whether an operation to terminate the camera function has been performed on the operation unit 70. If an operation to terminate the camera function has been performed, the system control unit 50 terminates the camera function, and the processing in the flowchart ends. If an operation other than an instruction to terminate the camera function has been performed, the process returns to step S429. In step S429, the system control unit 50 monitors the user's operation of the operation unit 70 and executes processing in response to the user's operation.

[0121] In the smartphone 100 according to the present exemplary embodiment, when the camera function is executed, the above-described processing is performed.

[0122] In the exemplary embodiment described above, when switching from the rear camera to the front camera, the smartphone 100 switches the camera unit or lens to be used for the front camera, depending on the camera unit or lens already used for the rear camera. When switching from the front camera to the rear camera, the smartphone 100 switches the camera unit or lens to be used for the rear camera, depending on the camera unit or lens already used for the front camera. However, when switching from the front camera to the rear camera, the smartphone 100 may not switch to the camera unit or lens to be used for the rear camera, but may switch to a specific camera unit, depending on the camera unit or lens already used for the front camera. Examples of situations in which switching from the rear camera to the front camera is performed include situations in which, after adjusting the angle of view using the rear camera to include the background, the user switches to the front camera and captures an image so that the user is included in the image. In such cases, it is desirable to switch to a camera with a close angle of view. However, it is not assumed that after adjusting the angle of view using the front camera so as to include the background, the user switches to the rear camera and captures an image. Therefore, when switching from the front camera to the rear camera, the smartphone 100 may switch to a specific camera unit (e.g., the camera unit set as the initial activation) instead of switching to a camera with a narrow angle of view. Although in this exemplary embodiment, the camera unit set as the initial activation among the rear cameras is the standard rear camera 203, the camera unit set as the initial activation among the rear cameras may be the wide-angle rear camera 204 having a medium-sized angle of view among the three rear cameras.

[0123] When switching between the rear and front cameras, and if specific camera settings are configured, the smartphone 100 can switch to the specific camera, regardless of the corresponding relationship between the rear and front cameras. Depending on the image stabilization setting or the recording resolution, the available cameras may be limited. In this case, the smartphone 100 can switch to the available camera, regardless of the corresponding relationship between the rear and front cameras. For example, when the image stabilization setting is turned on, or when the recording resolution is at maximum size, the available camera may be limited to the standard camera. When such camera settings are configured and the rear and front cameras are switched, the smartphone 100 can switch to the standard camera, even if the wide-angle camera is the associated camera in the corresponding relationship between the rear and front cameras. When other specific camera settings are configured, the smartphone 100 can switch to the wide-angle camera, even if the standard camera is the associated camera.

[0124] When the rear camera is shooting, in response to a user operation, switching between the standard camera, wide-angle camera, and ultra-wide-angle camera, or between viewing angles, and when switching from the rear camera to the front camera, the front camera to be activated can be switched based on the correspondence between the rear camera and the front camera. When the rear camera is shooting, in the case of not switching between the standard camera, wide-angle camera, and ultra-wide-angle camera, or between viewing angles, it is possible to switch to a specific front camera (e.g., the standard front camera) without using the correspondence between the rear camera and the front camera. The same applies to switching from the front camera to the rear camera.

[0125] In the above exemplary embodiment, the rear camera includes three camera units and the front camera includes two camera units. However, the number of camera units is not limited to these numbers. Four camera units may be included in the rear camera, or three camera units may be included in the front camera. In the above exemplary embodiment, the rear camera includes: a standard rear camera including a standard lens, a wide-angle rear camera including a wide-angle lens, and an ultra-wide-angle rear camera including an ultra-wide-angle lens. Alternatively, the rear camera may include a combination of lenses and cameras with other viewing angles, such as a telephoto rear camera including a telephoto lens, a standard rear camera, and a wide-angle rear camera. When switching between the rear camera and the front camera, the correspondence between the rear camera and the front camera is set according to the configuration of the rear camera and the front camera. For example, in the case of three rear cameras including a wide-angle rear camera, a standard rear camera, and a telephoto rear camera, and two front cameras including a wide-angle front camera and a standard front camera, a correspondence is set such that if the wide-angle rear camera is used to capture an image, the wide-angle front camera is switched to, and if the standard rear camera is used to capture an image or the telephoto rear camera is used to capture an image, the standard front camera is switched to. The correspondence can be set according to the angle of view of the rear camera (lens) and the angle of view of the front camera (lens).

[0126] Alternatively, a configuration can be employed in which, instead of having multiple rear cameras, a single rear camera is provided, and this rear camera is capable of optical zoom. For example, if a smartphone includes a single rear camera capable of optical zoom and two front cameras, namely, a wide-angle front camera and a standard front camera, and when optically zooming toward the telephoto side of the rear camera to capture an image, the standard front camera can be used in response to an instruction to switch to the front camera. When optically zooming toward the wide-angle side, the wide-angle front camera can be used in response to an instruction to switch to the front camera. As described above, when switching from the rear camera to the front camera, the smartphone can automatically change which of the multiple front cameras with different angles of view is switched to, depending on the zoom factor during optical zoom, that is, the angle of view changed by the optical zoom. Not only can the front camera be switched based on optical zoom, but the image captured by the front camera can also be electronically zoomed so that the angle of view of the image matches the angle of view already captured by the rear camera.

[0127] In the exemplary embodiment described above, when an instruction is given to switch from the rear camera to the front camera, the front camera (standard front camera or wide-angle front camera) corresponding to the rear camera already in use (standard rear camera, wide-angle rear camera, or ultra-wide-angle rear camera) or the front camera corresponding to the angle of view already captured by the rear camera is operated. However, when the moving image mode is set and the switch from the rear camera to the front camera is performed, the switch to the wide-angle front camera can be performed regardless of the rear camera already in use or the angle of view already captured by the rear camera. As described above, this is because when capturing moving images with the front camera, many users do not capture images of only their faces, but rather capture images of multiple people or capture images that include not only their faces but also their bodies.

[0128] The various types of control performed by the system control unit 50 in the specification may be performed by a single piece of hardware, or may be shared by a plurality of pieces of hardware to control the entire apparatus. The control to be performed by the system control unit 50 may also be performed by other blocks of the smartphone 100.

[0129] Although the present invention has been described in detail based on appropriate exemplary embodiments of the present invention, the present invention is not limited to these specific exemplary embodiments. The present invention also includes various forms that do not depart from the spirit and scope of the present invention. In addition, each of the above exemplary embodiments only illustrates an exemplary embodiment of the present invention, and the exemplary embodiments may also be appropriately combined.

[0130] (Other exemplary embodiments)

[0131] The present invention can also be implemented by providing software (program) for implementing the functions of the above-described exemplary embodiments to a system or device via a network or various storage media, and causing a computer (or central processing unit (CPU) or microprocessor unit (MPU)) of the system or device to read and execute the program code. In this case, the program and the storage medium storing the program constitute the present invention.

[0132] The present invention is not limited to the above embodiments, and various changes and modifications can be made within the spirit and scope of the present invention. Therefore, in order to apprise the public of the scope of the present invention, the following claims are made.

[0133] This application claims the benefit of Japanese Patent Application No. 2020-125166, filed on July 22, 2020, and Japanese Patent Application No. 2020-125165, filed on July 22, 2020, which are hereby incorporated by reference herein in their entirety.

Claims

1. An electronic device, comprising a first surface and a second surface, the electronic device comprising: a first camera unit configured to capture an image using a lens placed on the first surface; a second imaging unit configured to capture an image using a lens placed on the second surface, the second imaging unit configured to switch between first imaging using the first lens and second imaging using a second lens having a wider angle of view than that of the first lens; as well as a control unit configured to perform control to switch to the moving image shooting mode in response to a user operation for changing from the still image shooting mode to the moving image shooting mode during shooting by the second image shooting unit, and also to switch from the first shooting using the first lens to the second shooting using the second lens, The first camera unit performs a third camera and a fourth camera with a wider viewing angle than the third camera, and Here, when a user operation for changing from the still image shooting mode to the moving image shooting mode is received during the third shooting by the first shooting unit, the control unit controls not to switch from the third shooting to the fourth shooting.

2. The electronic device according to claim 1, wherein When a user operation for changing from the still image shooting mode to the motion image shooting mode is received during the first shooting of the second camera unit, the control unit controls to switch from the first shooting to the second shooting, and when a user operation for changing from the still image shooting mode to the motion image shooting mode is received during the second shooting of the second camera unit, the control unit controls to continue the second shooting.

3. The electronic device according to claim 1, further comprising: a display unit configured to display an image obtained by imaging by the first imaging unit or the second imaging unit; a detection unit configured to detect a touch operation on a display screen of the display unit; as well as A display control unit is configured to control display on the display unit.

4. The electronic device according to claim 3, wherein The control unit controls to change a viewing angle of an image obtained by imaging by the first imaging unit or the second imaging unit in response to a pinch-in touch operation or a pinch-out touch operation on a live view image displayed on the display unit.

5. The electronic device according to claim 3, wherein The display control unit controls to display a first display item for switching between the first imaging and the second imaging on the display unit together with a live view image obtained by the imaging during imaging by the second imaging unit.

6. The electronic device according to claim 4 or 5, in, The display control unit displays a second display item for changing the viewing angle of an image obtained by imaging by the first imaging unit or the second imaging unit together with a live view image obtained by imaging by the first imaging unit or the second imaging unit, and In which, in response to a touch operation on the second display item, the control unit switches the lens used for video recording based on the touch position of the touch operation and performs electronic zoom processing, thereby performing control for changing the viewing angle of the image obtained by video recording by the first video recording unit or the second video recording unit.

7. The electronic device according to claim 3, wherein: The display unit is provided on the second surface.

8. The electronic device according to claim 1, wherein The first imaging unit performs a third imaging using a third lens, and performs a fourth imaging using a fourth lens having a wider angle of view than that of the third lens.

9. The electronic device according to claim 1, wherein The electronic device is a smartphone.

10. A method for controlling an electronic device, the electronic device comprising: a first camera unit configured to capture an image using a lens placed on the first surface; and a second imaging unit configured to capture an image using a lens placed on a second surface, the second imaging unit configured to switch between first imaging using the first lens and second imaging using a second lens having a wider angle of view than that of the first lens, the method comprising: performing control by a control unit so as to switch to the moving image shooting mode in response to a user operation for changing from a still image shooting mode to a moving image shooting mode during shooting by the second image shooting unit, and also to switch from the first shooting using the first lens to the second shooting using the second lens, The first camera unit performs a third camera and a fourth camera with a wider viewing angle than the third camera, and Here, when a user operation for changing from the still image shooting mode to the moving image shooting mode is received during the third shooting by the first shooting unit, the control unit controls not to switch from the third shooting to the fourth shooting.

11. A computer program product comprising a computer program, which, when executed by a processor, implements the steps of the method according to claim 10.

12. A computer-readable storage medium storing a program, wherein when the program is executed by a processor, the program implements the steps of the method according to claim 10.

13. An electronic device, comprising a first surface and a second surface, the electronic device comprising: a first camera unit configured to capture an image using a lens placed on the first surface; a second imaging unit configured to capture an image using a lens placed on the second surface, the second imaging unit configured to switch between first imaging using a first lens placed on the second surface and second imaging using a second lens placed on the second surface, the second lens having a wider angle of view than that of the first lens; as well as A control unit configured to control, when the imaging of the first imaging unit is switched to the imaging of the second imaging unit, whether to switch to first imaging using the first lens or to switch to second imaging using the second lens according to the imaging angle of the first imaging unit being used, by associating the imaging angle of the first imaging unit with the imaging angle of the second imaging unit.

14. The electronic device according to claim 13, in, The first camera unit switches to a third camera using a third lens and a fourth camera using a fourth lens, the fourth lens having a wider angle of view than that of the third lens, and In which, when the video recording of the first camera unit is switched to the video recording of the second camera unit, the control unit controls to switch to the first camera when performing the third video recording, and controls to switch to the second camera when performing the fourth video recording.

15. The electronic device according to claim 14, in, The first camera unit switches to fifth camera using a fifth lens having a larger angle of view than the third lens and a smaller angle of view than the fourth lens, and Here, when the imaging by the first imaging unit is switched to the imaging by the second imaging unit, the control unit performs control to switch to the second imaging when the fifth imaging is performed.

16. The electronic device according to claim 15, wherein When the imaging of the first imaging unit is switched to the imaging of the second imaging unit and when the fifth imaging is performed, the control unit controls to switch to the second imaging and acquires the following image, which is an image obtained by the second imaging and electronic zoom processing is performed on the image.

17. The electronic device according to claim 13, in, Changing the viewing angle of the first camera unit by optical zoom, and Wherein, according to the viewing angle changed by the optical zoom, the control unit controls whether to switch to the first camera or the second camera.

18. The electronic device according to any one of claims 13 to 17, further comprising a display unit configured to display an image captured and obtained by the first camera unit or the second camera unit. in, The display unit is provided on the second surface. 19 . The electronic device according to claim 13 , further comprising an operation unit configured to receive an instruction from a user to switch from imaging by the first imaging unit to imaging by the second imaging unit.

20. The electronic device according to claim 13, wherein When the video recording of the first camera unit is switched to the video recording of the second camera unit, based on the correspondence between the viewing angle of the first camera unit and the viewing angle of the second camera unit, and depending on the viewing angle of the first camera unit, the control unit controls whether to switch to the first video recording using the first lens or to switch to the second video recording using the second lens.

21. The electronic device according to claim 20, further comprising a camera setting unit configured to perform camera settings in response to a user operation. in, When a specific camera setting is performed and the camera of the first camera unit is switched to the camera of the second camera unit, regardless of the correspondence between the angle of view of the first camera unit and the angle of view of the second camera unit, the control unit controls to switch to the camera predetermined between the first camera and the second camera.

22. The electronic device according to claim 20, wherein When the second camera unit's camera is switched to the first camera unit's camera, the control unit controls the viewing angle when switching to the first camera unit's camera based on the correspondence between the viewing angles of the first camera unit and the second camera unit.

23. The electronic device according to claim 20, wherein When the video recording of the second video recording unit is switched to the video recording of the first video recording unit, the control unit controls to switch to the video recording predetermined between the first video recording and the second video recording, regardless of the correspondence between the viewing angles of the first video recording unit and the viewing angles of the second video recording unit.

24. The electronic device according to claim 14, further comprising a camera setting unit configured to perform camera settings in response to a user operation. in, When a specific imaging setting is performed and imaging by the first imaging unit is switched to imaging by the second imaging unit, the control unit controls switching to the second imaging even when the third imaging is performed.

25. The electronic device according to claim 24, wherein The specific image capture settings are settings of a moving image capture mode for capturing a moving image.

26. The electronic device according to claim 13, wherein The electronic device is a smartphone.

27. A method of controlling an electronic device comprising a first surface and a second surface, the electronic device comprising: a first camera unit configured to capture an image using a lens placed on the first surface; and a second imaging unit configured to capture an image using a lens placed on the second surface, the second imaging unit configured to switch between first imaging using a first lens placed on the second surface and second imaging using a second lens placed on the second surface, the second lens having a wider angle of view than that of the first lens, the method comprising: In the case where the video recording by the first camera unit is switched to the video recording by the second camera unit, by associating the angle of view of the video recording performed by the first camera unit with the angle of view of the second camera unit, control is exercised over whether to switch to the first video recording using the first lens or to switch to the second video recording using the second lens, depending on the angle of view of the video recording by the first camera unit being used.

28. A computer program product comprising a computer program, which, when executed by a processor, implements the steps of the method according to claim 27.

29. A computer-readable storage medium storing a program, wherein when the program is executed by a processor, the program implements the steps of the method according to claim 27.

Images