Electronic device, electronic device control method, and program

Abstract

To assist imaging using an electronic apparatus whose display unit is changeable in angle.SOLUTION: The electronic apparatus comprises: a first display unit and a second display unit capable of displaying at angles different from each other; acquisition means for acquiring an image; and display control means which in accordance with an angle formed by the first display unit and the second display unit, performs control to display the image on one of the first display unit and the second display unit and display information associated with the image or the image on the other.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program. [Background technology]

[0002] In recent years, smartphones with foldable displays and digital cameras with vari-angle displays have come into use. Related techniques include those proposed in Patent Documents 1 and 2. In the technique of Patent Document 1, the display mode displayed on the first display unit and the second display unit is switched according to a change in the folding angle between the main body and the cover. In the technique of Patent Document 2, a foldable display device having two screens detects a predetermined event and displays a second app image of a second app associated with the predetermined event and the first app when the first app is displayed on the first screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-302957 A [Patent Document 1] JP 2019-67346 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned Patent Document 1, an image for operation can be displayed on the first display section, and an image for observation can be displayed on the second display section, but the information displayed on the first display section is an image for operation. Therefore, the technology of Patent Document 1 does not present information to assist the photographer or the subject in taking a photograph when the photographer takes a photograph. Also, in the technology of Patent Document 2, a first app is displayed on the first screen, and a second app is displayed on the second screen, but the first app and the second app do not assist in taking a photograph.

[0005] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, an object of the present invention is to assist in photographing using an electronic device whose display angle is changeable. [Means for solving the problem]

[0006] In order to achieve the above object, an electronic device of the present invention includes a first display section and a second display section capable of displaying images at different angles from each other, an acquisition means for acquiring an image, and a display control means for controlling, in accordance with an angle formed between the first display section and the second display section, to display the image on one of the first display section and the second display section, and to display information related to the image or the image on the other display section. When it is determined that the first display unit and the second display unit are in a folded state based on the angle, the display control means performs different display controls on the first display unit and the second display unit depending on whether the image includes a human subject. It is characterized by: Effect of the Invention

[0007] According to the present invention, it is possible to assist in photographing using an electronic device whose display angle is changeable. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic device. [Diagram 2] 3A to 3C are diagrams illustrating examples of various states of an electronic device. [Diagram 3] FIG. 2 is a diagram illustrating an example of a pixel array configuration of an imaging unit. [Figure 4] 5 is a flowchart showing an example of a process flow of display control according to the present embodiment. [Diagram 5] FIG. 11 is a diagram showing an example of acquired image data. [Figure 6] 11A and 11B are diagrams illustrating an example of image data displayed on a display unit in a full screen display mode. [Figure 7] FIG. 6 is a diagram showing an example of a defocus map for the image in FIG. [Figure 8] 11A and 11B are diagrams illustrating display examples of an image and a defocus map. [Figure 9] FIG. 13 is a diagram showing an example of a graph used for calculating a display magnification. [Figure 10]13A and 13B are diagrams illustrating an example of an image displayed when the display unit is folded. [Figure 11] 1A to 1C are diagrams illustrating an example of various states of an electronic device in which optical systems are provided on both the display surface side and the rear surface side. [Figure 12] 1A to 1C are diagrams illustrating an example of various states of an electronic device having a display unit on the rear side. [Figure 13] 13A and 13B are diagrams illustrating an example of display of information indicating the type of a subject. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments.

[0010] FIG. 1 is a diagram showing an example of a hardware configuration of an electronic device 100 according to the present embodiment. In the present embodiment, the electronic device 100 is described as a smartphone having a photographing function. The electronic device 100 is not limited to a smartphone, and may be a tablet terminal, a personal computer, or an imaging device such as a digital camera. The electronic device 100 may also be a computer to which a camera is connected. Below, a use case will be described in which a photographer adjusts the focus range while visually checking the display unit (display) of the electronic device 100 to photograph. The display unit is, for example, a liquid crystal screen.

[0011] The electronic device 100 includes a control unit 101, a ROM 102, a RAM 103, an optical system 104, an imaging unit 105, an A / D conversion unit 106, an image processing unit 107, and a recording medium I / F 108. The electronic device 100 also includes a display unit 109, an operation unit 110, an evaluation value acquisition unit 111, a subject detection unit 112, and a rotation angle detection unit 113. The control unit 101 is a processor such as a CPU. The control unit 101 reads out a program for controlling the operation of each block of the electronic device 100 from the ROM 102, and loads and executes the program in the RAM 103. In this way, the control unit 101 controls the operation of each block of the electronic device 100. The control unit 101 corresponds to an acquisition means and a display control means.

[0012] The ROM 102 is a rewritable non-volatile memory, and stores parameters and the like necessary for the operation of each block in addition to programs for controlling each block of the electronic device 100. The RAM 103 is a rewritable volatile memory, and is used as a temporary storage area for data output by each block of the electronic device 100.

[0013] The optical system 104 is an optical mechanism including a lens. An object image from the optical system 104 is formed on the imaging unit 105. The imaging unit 105 is an imaging element such as a CCD or CMOS sensor, and photoelectrically converts the optical image formed on the imaging element by the optical system 104 to generate an analog image signal. The generated analog image signal is output to the A / D conversion unit 106. The A / D conversion unit 106 performs A / D conversion processing on the input analog image signal to generate digital image data (image data). The generated image data is stored in the RAM 103. The image processing unit 107 performs various image processing such as white balance adjustment, reduction / enlargement, noise reduction processing, development processing, etc. on the image data stored in the RAM 103.

[0014] The recording medium I / F 108 is an interface for detachably connecting a recording medium such as a memory card. Image data stored in the RAM 103, image data processed by the image processing unit 107, image data A / D converted by the A / D conversion unit 106, etc. are recorded as recorded images on the recording medium via the recording medium I / F 108. The display unit 109 is a display device such as an LCD, and displays various information and images. For example, a subject image captured by the imaging unit 105 is displayed on the display unit 109. The operation unit 110 is an operation member including a release switch, etc., and receives instructions for operations such as autofocus and release, as well as settings such as a shooting mode, focal length, aperture value, and exposure time.

[0015] The evaluation value acquisition unit 111 calculates evaluation values ​​such as distance and focus from the generated image data. The subject detection unit 112 detects a predetermined subject such as a human face from the generated image data and outputs the size and position of the subject on the image. Some or all of the functions of the image processing unit 107, the evaluation value acquisition unit 111, and the subject detection unit 112 may be realized by the control unit 101. The rotation angle detection unit 113 detects the rotation angle of a rotation axis 200, which will be described later.

[0016] The display unit 109 of the electronic device 100 described above adopts a foldable configuration. FIG. 2 is a diagram showing an example of various states of the electronic device 100. FIG. 2(A) is a diagram showing an example of the display surface side of the display unit 109 in an unfolded state. As shown in FIG. 2(A), the display unit 109 of the electronic device 100 can be folded and unfolded around a rotation axis 200. The display unit 109 is divided into a first display unit 201 and a second display unit 202 around the rotation axis 200. As shown in FIG. 2(A) and FIG. 2(B), the state in which the first display unit 201 and the second display unit 202 are flat is the unfolded state (open state) of the display unit 109. On the other hand, the state in which the first display unit 201 and the second display unit 202 face each other on the display surface or back is the folded state (closed state) of the display unit 109. The electronic device 100 has a structure in which the first display unit 201 and the second display unit 202 can be set at any different angle around the rotation axis 200. In other words, by rotating the first display unit 201 or the second display unit 202, the first display unit 201 and the second display unit 202 can display information, images, etc. at different angles.

[0017] FIG. 2(B) is a diagram showing an example of the back surface (back surface on the display surface side) of the display unit 109 in an unfolded state. As shown in FIG. 2(B), the optical system 104 including a lens is provided on the back surface side of the display unit 109. FIG. 2(C) is a diagram showing an example of the first display unit 201 side in a folded state of the display unit 109. Also, FIG. 2(D) is a diagram showing an example of the opposite surface side of FIG. 2(C). The examples of FIG. 2(C) and FIG. 2(D) show a folded state in which the back surface of the first display unit 201 and the back surface of the second display unit 202 face each other. As shown in FIG. 2(A) to FIG. 2(D), the rotation axis 200 is provided at a maldistributed position, not at the center of the display unit 109. Therefore, the area of ​​the first display unit 201 is larger than the area of ​​the second display unit 202. The optical system 104 is provided on the back surface of the first display unit 201. Therefore, in the state of FIG. 2(D), the optical system 104 is exposed. This allows shooting even when the display unit 109 is folded. In the example of Fig. 2, the first display unit 201 and the second display unit 202 form a continuous area, but the first display unit 201 and the second display unit 202 may be spaced apart.

[0018] Fig. 3 is a diagram showing an example of a pixel array configuration of the imaging unit 105. A pixel 302 is composed of a microlens 301 and a pair of photoelectric conversion units 303A and 304B. In the example shown in Fig. 3, the pixels 302 are arranged two-dimensionally and regularly. Note that the planar shape of the photoelectric conversion units 303A and 304B is not limited to the example in Fig. 3, and other planar shapes may be adopted. Furthermore, the arrangement of the photoelectric conversion units 303A and 304B is not limited to the example in Fig. 3, and other arrangements may be adopted.

[0019] The two-dimensionally and regularly arranged photoelectric conversion units 303A and 304B output images A and B as parallax images, respectively. In addition, an image A+B obtained by adding images A and B is recorded on the recording medium 108 as a recorded still image. By adopting the above-mentioned configuration of the imaging unit 105, a pair of light beams passing through different regions of the pupil of the optical system 104 can be formed as a pair of optical images, which can be output as images A and B. Note that the method of acquiring images A and B is not limited to the above, and various methods can be adopted. For example, images A and B may be acquired by imaging devices such as multiple cameras installed at spatial intervals, and images having parallax from each other may be acquired as images A and B. In addition, parallax images acquired by an imaging device such as a single camera having multiple optical systems and imaging units may be acquired as images A and B, respectively.

[0020] Next, the flow of display control processing of this embodiment will be described. FIG. 4 is a flowchart showing an example of the flow of display control processing of this embodiment. Below, the contents of display control in a portrait scene in which a photographer adjusts the focus position while viewing the display unit 109 and photographs a person as a subject will be described. However, the processing of this embodiment is not limited to display control in a portrait scene. Also, a part of each of the following processes may be executed by an external device (such as a computer). In this case, a configuration may be adopted in which electronic device 100 and the external device communicate with each other to transmit and receive processing requests and processing results.

[0021] In S400, the control unit 101 acquires image data. The control unit 101 may acquire image data in which the image processing unit 107 has performed a predetermined image processing on the subject image captured by the imaging unit 105. The image data in this embodiment is assumed to be a live view image. The control unit 101 may also acquire image data from a camera connected to the electronic device 100. FIG. 5 is a diagram showing an example of the acquired image data. An image 501 (image data) in FIG. 5 is an image captured in a situation in which a person 502, who is a subject, faces the optical system 104 of the electronic device 100.

[0022] In S401, the control unit 101 determines whether the display unit 109 is in a folded state. When the display unit 109 is in an unfolded state as shown in Figs. 2(A) and (B), the control unit 101 determines No in S401. On the other hand, when the display unit 109 is in a folded state as shown in Figs. 2(C) and (D), the control unit 101 determines Yes in S401. The control unit 101 can make the determination in S401 based on the rotation angle of the rotation shaft 200 detected by the rotation angle detection unit 113.

[0023] For example, the rotation angle in the unfolded state shown in Figs. 2(A) and (B) is 0 degrees, and the rotation angle in the folded state shown in Figs. 2(C) and (D) is ±180 degrees. The control unit 101 may determine that the display unit 109 is unfolded when the rotation angle of the rotation shaft 200 is 0 degrees or is within a first angle range with respect to 0 degrees. In this case, the result of S401 is No. The control unit 101 may also determine that the display unit 109 is folded when the rotation angle of the rotation shaft 200 is ±180 degrees or is within a second angle range with respect to ±180 degrees. In this case, the result of S401 is Yes. The first angle range and the second angle range may be different or the same. When the display unit 109 is in an unfolded state as shown in Figures 2(A) and (B), it is assumed that the first display unit 201 and the second display unit 202 face the photographer. This is so that the photographer can check the composition and the like while viewing the so-called live view. When the display unit 109 is in a folded state as shown in Figures 2(C) and (D), it is assumed that the first display unit 201 faces the photographer and the second display unit 202 faces the subject. This is assumed to be the case where the photographer points the optical system 104 at a subject other than the photographer while viewing the live view.

[0024] When the control unit 101 judges No in S401, the control unit 101 advances the flow to S402. In S402, the control unit 101 judges whether the setting of the display unit 109 is the full screen display mode or the split display mode. The full screen display mode is a mode in which the image data acquired in S400 is displayed as one area by combining two areas of the first display unit 201 and the second display unit 202. The split display mode is a mode in which the image data acquired in S400 is displayed on the first display unit 201, and information related to the image data is displayed on the second display unit 202. The information related to the image data is, for example, information that assists in shooting, such as information indicating the depth of the image, such as a defocus map. The setting of the full screen display mode or the split display mode may be set in advance by the photographer using the operation unit 110.

[0025] When the control unit 101 judges Yes in S402, the flow proceeds to S403. On the other hand, when the control unit 101 judges No in S402, the flow proceeds to S404. In S403, the control unit 101 performs control to display the acquired image data in one area that is a combination of the first display unit 201 and the second display unit 202 of the display unit 109. FIG. 6 is a diagram showing an example of image data displayed on the display unit 109 in the full screen display mode. As shown in FIG. 6, the image data is displayed large using the first display unit 201 and the second display unit 202 as one area. After executing the process of S403, the control unit 101 ends the process.

[0026] In S404, the control unit 101 acquires images A and B, which are a pair of parallax images, from the imaging unit 105, and generates data representing a spatial distribution of defocus amounts in the shooting range based on the parallax images. The process of S404 may be executed by the evaluation value acquisition unit 111. Hereinafter, the data representing the spatial distribution of defocus amounts is referred to as a defocus map. The defocus amount is a type of distance information since it is a deviation in focus from the distance at which the optical system 104 is focused. Any method may be used to acquire the defocus amount. The defocus amount may be calculated using any method for calculating a phase difference between parallax images.

[0027] Fig. 7 is a diagram showing an example of a defocus map for image 501 in Fig. 5. Defocus map 701 is expressed in a continuous grayscale value that becomes whiter (higher pixel value) as the distance becomes closer. As shown in Fig. 7, an area 702 corresponding to person 502, which is an in-focus area (i.e., a defocus amount of zero), is expressed in gray.

[0028] In S405, the control unit 101 performs control to display the image 501 on the first display unit 201 and the defocus map 701 on the second display unit 202. FIG. 8 is a diagram showing a display example of the image 501 and the defocus map 701. The process of S405 is executed in a state where the display unit 109 is unfolded. Therefore, the first display unit 201 and the second display unit 202 face the photographer side. Therefore, the photographer can visually recognize the defocus map 701 displayed on the second display unit 202 while visually recognizing the image 501 displayed on the first display unit 201. In other words, the photographer can confirm where the focus is at the time of shooting and whether the desired part is within the depth, and perform shooting while making adjustments. The control unit 101 may perform control to display the defocus map 701 on the first display unit 201 and the image 501 on the second display unit 202.

[0029] As shown in FIG. 4, when the control unit 101 determines Yes in S401, the control unit 101 advances the flow to S406. In S406, the control unit 101 determines whether or not the image 501 includes a person as a subject. The process of S406 may be executed by the subject detection unit 112. Any method may be applied as a method for determining whether or not the image 501 includes a person. For example, a method may be adopted in which a limited area in the image 501 is matched with a standard face pattern to determine whether or not the image 501 includes a person. In addition, whether or not the image 501 includes a person may be determined based on a portion other than the person's face.

[0030] If the control unit 101 determines "Yes" in S406, it advances the flow to S407. In S407, the control unit 101 determines whether the subject distance is within a predetermined range. At this time, the control unit 101 refers to the defocus amount calculated in S404 and converts the defocus amount of the face area of ​​the person as the subject into an actual distance value (distance value). A method of converting the defocus amount into a distance value using the imaging formula of the optical system will be described.

[0031] The image distance from the rear principal point position of the optical system 104 to the imaging surface is defined as S(0) for the focused object and as "S(0)+def1" for the unfocused object. def1 is the calculated defocus amount. In addition, the distance from the front principal point position of the optical system 104 to the focused object is defined as OBJ(0), and the distance to the unfocused object is defined as OBJ(def1). For the distance to the focused object, OBJ(0), the following equation (1) is established using the focal length f of the lens of the optical system 104. "1 / OBJ(0)+1 / S(0)=1 / f...(1)" Using equation (1), the distance OBJ(0) to the object can be calculated using the known values ​​of S(0) and f. Similarly, the following equation (2) holds for the distance OBJ(def1) to an out-of-focus object. "1 / OBJ(def1)+1 / (S(0)+def1)=1 / f...(2)" In equation (2), the distance OBJ(def1) to the out-of-focus object can be calculated by using the values ​​of S(0) and def1.

[0032] The control unit 101 judges whether the calculated distance value of the face region is within a predetermined range. For example, the control unit 101 may judge Yes in S407 when the calculated distance value of the face region is "D1 = 50 cm or more and D2 = 10 m or less". The predetermined range that is the criterion for the judgment in S407 can be set to any range. Here, the predetermined range will be explained. The predetermined range is D1 or more and D2 or less as described above. If the calculated distance value of the face region is less than D1, it is assumed that the photographer is taking a selfie (the photographer takes a picture of himself as the subject). Also, if the calculated distance value of the face region exceeds D2, it is assumed that the subject person is out of the distance range where the screen of the display unit 109 can be seen. The predetermined range that is the criterion for the judgment in S407 is not limited to the above range.

[0033] That is, in S407, the control unit 101 determines whether a selfie is being taken or whether the subject person is out of the distance range where the screen of the display unit 109 can be viewed. Whether a selfie is being taken may be determined based on, for example, whether the photographer has performed an operation on the operation unit 110 to select a selfie mode from a plurality of modes or an operation to switch to the in-camera (lens facing the photographer).

[0034] When the control unit 101 judges that S407 is Yes, the control unit 101 advances the flow to S408. In S408, the control unit 101 calculates a magnification for displaying an image on the display unit 109 according to the distance value to the face region calculated in S407. FIG. 9 is a diagram showing an example of a graph used for calculating the display magnification. In the example of FIG. 9, the horizontal axis indicates the distance value to the face region calculated in S407, and the vertical axis indicates the magnification. When the distance to the face region is 1 m or less, the control unit 101 performs control to display the image at the same magnification without enlarging it. In addition, the control unit 101 performs control to continuously increase the enlargement magnification until the distance to the face region exceeds 1 m and reaches 5 m, and when the distance to the face region reaches 5 m, to enlarge and display the image at a magnification of 10 times. This makes it easier for the person as the subject to check the image when viewing the display unit 109, even if the distance from the electronic device 100 to the person as the subject becomes farther. That is, control unit 101 controls the magnification of the image displayed on display unit 109 in accordance with the distance from electronic device 100 to a person as a subject, thereby improving the visibility of the image.

[0035] In S409, the control unit 101 displays the image 501 on the first display unit 201, and displays the image at the magnification calculated in S408 on the second display unit 202. If the magnification calculated in S408 is the same (×1), the control unit 101 displays the entire image 501 as is on the second display unit 202. If the magnification calculated in S408 is not the same, the control unit 101 enlarges and displays the face area of ​​the subject included in the image 501 according to the calculated magnification, and displays an image centered on the position of the face detected in S406 on the second display unit 202.

[0036] FIG. 10 is a diagram showing an example of an image display when the display unit 109 is folded. FIG. 10(A) is an example of a screen display displayed on the first display unit 201. Since the first display unit 201 faces the photographer, the photographer can view the image 1000 displayed on the first display unit 201. FIG. 10(B) is an example of a screen display displayed on the second display unit 202. Since the display unit 109 is folded, the second display unit 202 faces the subject, and the subject can view the image 1001 displayed on the second display unit 202. This allows the photographer to check the image quality of the person who is the subject when taking a picture of the electronic device 100. In the example of FIG. 10(B), the image 1001 is enlarged according to the distance from the electronic device 100 to the person who is the subject. This allows the person who is the subject to check the image quality with good visibility.

[0037] 4, if the control unit 101 determines No in S407, the flow proceeds to S410. In S410, the control unit 101 displays the image 501 on the first display unit 201, and turns off (hides) the display on the second display unit 202. As a result, when a selfie is being taken or a person as a subject is far away from the electronic device 100, the screen facing away from the photographer is turned off, thereby reducing power consumption.

[0038] If the control unit 101 determines No in S406, it displays the image 501 on the first display unit 201 and turns off (hides) the display on the second display unit 202. This makes it possible to reduce power consumption by turning off the screen that faces the opposite side of the photographer and is not visible to anyone if the subject is not a person. After the process of S409, S410, or S411, the control unit 101 ends the flowchart of Fig. 4. The control unit 101 may repeatedly perform the process of the flowchart of Fig. 4 until it receives an instruction to capture an image, an instruction to turn off the power of the electronic device 100, or the like.

[0039] As described above, the electronic device 100, which has a foldable display portion, controls the display of the first display portion 201 and the second display portion 202 depending on the angle between the first display portion 201 and the second display portion 202, that is, whether the electronic device 100 is in a folded state. When the display portion is in an unfolded state, the electronic device 100 displays image data on one of the first display portion 201 and the second display portion 202, and displays a defocus map 701 on the other. This allows the photographer to take a picture while visually checking the focus position along with the image of the subject. Also, when the display portion is in a folded state, the electronic device 100 displays image data on one of the first display portion 201 and the second display portion 202, and displays the image data at the same magnification or enlarged size on the other. This allows not only the photographer but also the subject to check the image. Therefore, by controlling the information and image displayed on the screen depending on the shooting situation, it is possible to perform shooting while visually checking the information required by the photographer and the subject. Therefore, it is possible to assist shooting using an electronic device with a changeable display angle.

[0040] In the above example, the judgment processes of S406 and S407 are provided to hide the second display unit 202 from the perspective of power saving, but this process may not be performed and image data may be automatically displayed on both the first display unit 201 and the second display unit 202 if the display unit is folded.

[0041] In the above example, the distance information is generated based on the phase difference between multiple subject images generated by light beams arriving from different regions of the pupil of the imaging optical system as shown in Fig. 3, but the distance information may be generated using other methods. For example, by using a configuration capable of measuring distance using a Time Of Flight (TOF) camera or ultrasonic waves, it is possible to improve the performance of generating distance measurement information for a subject with little change in pattern.

[0042] In the above example, the optical system 104 provided on the rear side of the display surface of the electronic device 100 operates regardless of whether the display portion is folded. In this regard, optical systems may be provided on both the display surface side and the rear surface side of the electronic device. FIG. 11 is a diagram showing an example of various states of the electronic device 1100 in which optical systems are provided on both the display surface side and the rear surface side. In the example of FIG. 11, the optical system 1103 is provided on the display surface side of the electronic device 1100, and the optical system 1104 is provided on the rear surface side. In addition, the first display unit 1101 and the second display unit 1102 can be folded around a rotation axis 1105. Both the optical system 1103 and the optical system 1104 are imaging units. That is, the electronic device 1100 is provided with a plurality of imaging units. For example, the optical system 1103 is an optical system of an in-camera, and the optical system 1104 is an optical system of an out-camera.

[0043] As shown in FIGS. 11A and 11B, when the electronic device 1100 is in an unfolded state, the electronic device 1100 operates the optical system 1104 among the optical systems 1103 and 1104 provided on the display surface side. Also, as shown in FIGS. 11C and 11D, when the electronic device 1100 is in a folded state, the electronic device 1100 operates the optical system 1103 among the optical systems 1103 and 1104 provided on the display surface side. That is, the electronic device 1100 selects the optical system to be used for shooting among the optical systems 1103 and 1104 according to the angle between the first display unit 1101 and the second display unit 1102. Therefore, in the electronic device 100 of the example of FIG. 11, the photographer can switch between normal shooting and selfie shooting without changing the position of the electronic device 1100 to change the direction in which the optical system or the display unit faces.

[0044] A display unit may also be provided on the rear side of the electronic device. FIG. 12 is a diagram showing an example of various states of an electronic device 1200 having a display unit on the rear side. As shown in FIG. 12(A), the first display unit 1201 and the second display unit 1202 can be folded around a rotation axis 1204. This is the same as FIG. 2. As shown in FIG. 12(B), the rear side is provided with an optical system 1203 and a display unit 1205 (another display unit). With this, when the display portion is unfolded, image data can be displayed on the first display unit 1201, a defocus map can be displayed on the second display unit 1202, and the image data can be displayed at the same magnification or enlarged on the display unit 1205. Therefore, the photographer can visually recognize the image data and the defocus map, and the subject can also visually recognize the image data.

[0045] In the above example, the defocus map for checking the focus position and depth is displayed as the information related to shooting. However, other information may be displayed as the information related to shooting. For example, information indicating the state of the subject included in the image, such as information indicating the luminance distribution, color distribution, and distribution of the brightness contrast degree of the subject, may be displayed as map information similar to the defocus map. In addition, for example, when the subject detection unit 112 detects the type of subject from the image data, the control unit 101 may display information indicating the type of the detected subject. FIG. 13 is a diagram showing an example of displaying information indicating the type of subject. In the example of FIG. 13, information indicating the type of the detected subject, namely, "person", "plant", and "sky", is displayed for three areas of the image 1301. The photographer can easily check what kind of subject is in which area by visually checking the image 1301 of FIG. 13. The information indicating the type of subject may be displayed by being superimposed on the image data or may be displayed by being superimposed on the defocus map. In this case, the information indicating the type of subject may be displayed on either the first display section or the second display section, or may be displayed on both.

[0046] The electronic device described above is an example of a foldable smartphone, but it can also be applied to a camera having a vari-angle monitor and a viewfinder. In this case, the photographer takes a picture while viewing the viewfinder, and by directing the screen of the vari-angle monitor toward the person who is the subject, the photographed image can be shown to the subject, and the subject can check how it is photographed. In addition, for example, if the electronic device is a foldable smartphone, the present embodiment can also be applied to an electronic device in which three or more display units can be changed to any angle around two or more rotation axes.

[0047] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0048] 100 Electronic equipment 101 Control section 104 Optical system 109 Display section 111 Evaluation value acquisition unit 112 Subject detection unit 113 Rotation angle detection unit 201 1st display section 202 2nd display section

Claims

1. A first display unit and a second display unit capable of displaying at different angles from each other; An acquisition means for acquiring an image; a display control means for controlling to display the image on one of the first display unit and the second display unit and to display information related to the image or the image on the other display unit according to an angle between the first display unit and the second display unit; Equipped with The electronic device is characterized in that, when it is determined that the first display unit and the second display unit are folded based on the angle, the display control means performs different display controls on the first display unit and the second display unit depending on whether the image includes a human subject.

2. The electronic device according to claim 1 , wherein the first display unit and the second display unit are capable of being folded and unfolded about a rotation axis.

3. 3. The electronic device according to claim 1, wherein the related information is information indicating a depth of the image.

4. The electronic device described in any one of claims 1 to 3, characterized in that when it is determined that the first display unit and the second display unit are in an unfolded state based on the angle, the display control means controls whether to display the image on the first display unit and the related information on the second display unit, or to treat the first display unit and the second display unit as a single area and display the image in that area.

5. The electronic device described in any one of claims 1 to 4, characterized in that when it is determined that the first display unit and the second display unit are folded based on the angle and when the image does not include a human subject, the display control means controls to hide either the first display unit or the second display unit.

6. The electronic device described in any one of claims 1 to 5, characterized in that when it is determined that the first display unit and the second display unit are folded based on the angle and when a distance to a person subject included in the image is not within a predetermined range, the display control means controls to hide either the first display unit or the second display unit.

7. The electronic device described in any one of claims 1 to 6, characterized in that when it is determined that the first display unit and the second display unit are folded based on the angle and when the distance to the human subject included in the image is within a predetermined range, the display control means controls to display the image on one of the first display unit and the second display unit, and to enlarge and display the image on the other unit at a display magnification corresponding to the distance to the human subject.

8. The electronic device described in any one of claims 1 to 7, characterized in that when the image contains a specified subject, the display control means displays information indicating a type of the subject on either or both of the first display unit and the second display unit.

9. A plurality of imaging units are further provided, 9. The electronic device according to claim 1, wherein an imaging section to be used for photographing is selected from among the plurality of imaging sections depending on an angle between the first display section and the second display section.

10. 10. The electronic device according to claim 1, further comprising: another display unit provided on a surface on which the first display unit is provided or on a rear surface on which the second display unit is provided.

11. A method for controlling an electronic device having a first display unit and a second display unit capable of displaying at different angles, comprising the steps of: acquiring an image; performing control to display the image on one of the first display unit and the second display unit and to display information related to the image or the image on the other of the first display unit and the second display unit according to an angle between the first display unit and the second display unit; Equipped with The control method for an electronic device is characterized in that, when it is determined that the first display unit and the second display unit are in a folded state based on the angle, different display controls are performed on the first display unit and the second display unit depending on whether the image includes a human subject.

12. A computer-executable program that causes a computer to function as each of the means of the electronic device according to any one of claims 1 to 10.

Images