Electronic apparatus

Abstract

To provide a technique to facilitate easy checking of an image with strain.SOLUTION: An electronic apparatus of the present invention has: extraction means that extracts, from a picked-up image, an area where a subject has larger strain than another area; processing means that performs image processing of reducing the strain on the area extracted by the extraction means to acquire a corrected image; and control means that controls to display the corrected image.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to electronic devices, and more particularly to a technique for processing captured images. [Background technology]

[0002] Patent Document 1 discloses a technique for automatically enlarging and displaying each area of ​​a captured (recorded) image immediately after the image is captured (recorded). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-166086 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the technology disclosed in Patent Document 1, when a fisheye lens is used to take a photograph (record an image of a subject), a distorted image (distortion of the subject) is displayed, making it difficult to confirm the image.

[0005] An object of the present invention is to provide a technique that makes it easy to check a distorted image. [Means for solving the problem]

[0006] The electronic device of the present invention is characterized by having an extraction means for extracting an area of ​​a captured image in which the distortion of the subject is greater than in other areas, a processing means for performing image processing on the area extracted by the extraction means to reduce the distortion, thereby obtaining a corrected image, and a control means for controlling the display of the corrected image. [Effects of the Invention]

[0007] According to the present invention, it becomes possible to easily check a distorted image. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram of an imaging device. [Figure 2] FIG. 2 is a schematic diagram of an effective image area. [Figure 3] FIG. 2 is a schematic diagram of an effective image area and a display screen. [Figure 4] FIG. 2 is a schematic diagram of an effective image area and a display screen. [Figure 5] 3A and 3B are schematic diagrams of a captured image and a display screen. [Figure 6] 10 is a flowchart of a confirmation display process according to the first embodiment. [Figure 7] 10 is a flowchart of a display / non-display determination process. [Figure 8] 3A and 3B are schematic diagrams of a captured image and a display screen. [Figure 9] FIG. 2 is a schematic diagram of a captured image. [Figure 10] 10 is a flowchart of a confirmation display process according to a second embodiment. [Figure 11] FIG. 1 is a schematic diagram of a system. [Figure 12] 10 is a flowchart of a confirmation display process according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] (First embodiment) A first embodiment of the present invention will be described below. Fig. 1 is a hardware block diagram of an image capturing apparatus 100 as an example of an electronic device according to the first embodiment.

[0010] The CPU 101 controls the entire imaging device 100. The flash memory 102 (semiconductor non-volatile memory) stores various data (information). For example, the flash memory 102 pre-stores various programs (e.g., application programs) that can be executed by the CPU 101. The dynamic random access memory (DRAM) 103 temporarily stores various data (information). For example, the DRAM 103 temporarily stores captured images (captured images, images obtained by capturing) and conversion results of the captured images.

[0011] The imaging unit 104 captures images. For example, the imaging unit 104 includes a fisheye lens, an imaging sensor, and a signal processing circuit. The display unit 105 displays various images recorded in the DRAM 103. For example, the display unit 105 is an LCD (Liquid Crystal Display). The operation unit 106 accepts operations by a user (user operations). For example, the operation unit 106 includes buttons, a four-way keypad, and a touch panel. The communication unit 107 communicates with external devices (devices external to the imaging device 100). The recording unit 108 records various data (information) in an internal storage or an external storage (not shown). For example, the recording unit 108 records (photographs) captured images in the internal storage or the external storage. The captured images may be recorded directly in the internal storage or the external storage, or image processing may be performed on the captured images, and the processed images may be recorded in the internal storage or the external storage.

[0012] In the first embodiment, it is assumed that the flash memory 102 stores the following programs that can be executed by the CPU 101. -A program for determining the effective image area in a captured image A distortion area extraction program that extracts (detects) areas of the image where the subject has greater distortion than other areas (distortion areas). A program that determines whether the angle of view (imaging range) of a distorted area is approximately the same (including completely the same) as the angle of view of another distorted area. -Area classification program for classifying distortion areas - Image conversion program that converts distortion areas (performs image processing to reduce distortion in distortion areas) A reflection detection program that determines whether or not unintended reflections occur in the distorted area (whether or not a specific subject is included in the distorted area).

[0013] 2 is a schematic diagram of an effective image area 201 captured through a fisheye lens. In the first embodiment, information about the lens of the imaging unit 104 (lens information) is stored in advance in the flash memory 102, and the CPU 101 executes an effective image area determination program to determine the effective image area 201 based on the lens information. If the imaging device 100 is an interchangeable lens camera (an imaging device with a detachable lens (lens unit)), the lens information may be acquired from the lens. The lens information used is information about the lens used for imaging. The effective image area 201 may be interpreted as the area of ​​a circular fisheye image or the area of ​​an image circle.

[0014] When a fisheye lens is used, distortion of the subject in the effective image area increases from the center toward the edge of the effective image area. CPU 101 executes a distorted area extraction program and extracts area 203, which includes part of edge 202 of effective image area 201, as a distorted area. The correspondence between the effective image area and the distorted area is predetermined, and the distorted area may be determined and extracted based on the effective image area. Image processing may be performed to detect the distorted area from the effective image area, and the detected distorted area may be extracted.

[0015] 3 is a schematic diagram of an effective image area 301 captured through a fisheye lens and a screen (display screen) 311 displayed on the display unit 105. As described with reference to FIG. 2, when a fisheye lens is used, distortion of the subject in the effective image area increases from the center toward the edge of the effective image area. Therefore, even if a user (photographer) simply checks the effective image area 301, they cannot easily see the details of an edge 302 (an area with large distortion) of the effective image area 301. Therefore, in the first embodiment, the following processing is performed.

[0016] 2, CPU 101 first executes an effective image area determination program to determine effective image area 301 based on lens information. CPU 101 then executes a distorted area extraction program to extract area 303 that includes part of edge 302 of effective image area 301 as a distorted area.

[0017] Next, the CPU 101 executes an image conversion program to convert the distorted area 303 into a corrected image 313 in which the distortion has been reduced.

[0018] Then, CPU 101 executes a reflection determination program to determine whether or not an unintended reflection has occurred in corrected image 313 (whether or not a specific subject is included in corrected image 313). At this time, a different subject is used as the specific subject depending on the distortion area. The specific subject is not particularly limited, but for example, because distortion area 303 corresponding to corrected image 313 is an area below effective image area 301, it is determined whether or not feet are included in corrected image 313. If the distortion area corresponding to the corrected image is an area above the effective image area, it may be determined whether or not a face is included in the corrected image. In the case of FIG. 3, it is determined that unintended reflection has occurred in corrected image 313.

[0019] Next, CPU 101 executes an area classification program and classifies corrected image 313 (distortion area 303) based on the determination result of the reflection determination program. For example, CPU 101 does not determine a corrected image in which no unintended reflection occurs as a display object, but determines a corrected image in which unintended reflection occurs as a display object. Because corrected image 313 has unintended reflection, corrected image 313 is determined to be a display object.

[0020] Then, CPU 101 displays the corrected image to be displayed on display unit 105. By displaying only the corrected image in which distortion in the distorted area where the unintended reflection occurs is reduced, the user can easily notice the occurrence of the unintended reflection.

[0021] Since reducing distortion makes it easier to detect unintended reflections, the method that has been achieved involves performing a reflection detection program (and classification by an area classification program) on the corrected image. However, this is not limiting, and for example, the reflection detection program and area classification program may be performed on a distorted image. In this case, conversion (image processing) by an image conversion program may be performed only on the distorted image to be displayed.

[0022] 4, a plurality of corrected images (corrected images 411 to 414) corresponding to a plurality of distortion areas (distortion areas 401 to 404) may be displayed. Among the plurality of corrected images, a corrected image in which an unintended reflection occurs (corrected image 413) may be displayed in a distinguishable manner (highlighted).

[0023] 5 is a schematic diagram showing an example in which the imaging unit 104 has two fisheye lenses. In this case, the following processing is performed. Note that the number of fisheye lenses (optical systems) is not particularly limited, and if the imaging unit 104 has three or more fisheye lenses, processing similar to the following processing may be performed.

[0024] 2 and 3, CPU 101 first executes an effective image area determination program and determines an effective image area in captured image 500 based on lens information. In the case of Fig. 5, two effective image areas 511 and 521 corresponding to the two fisheye lenses are determined. CPU 101 then executes a distorted area extraction program and extracts, as distorted areas, area 512 including a portion of the edge of effective image area 511 and area 522 including a portion of the edge of effective image area 521.

[0025] 3, CPU 101 executes an image conversion program to convert distorted area 512 into corrected image 532 with reduced distortion. CPU 101 executes a reflection determination program to determine that unintended reflection has occurred in corrected image 532. CPU 101 then executes a region classification program to determine corrected image 532 as the display target.

[0026] Next, CPU 101 executes a program for determining whether the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512 (a distorted region already determined as a display target). In the case of FIG. 5, it is determined that the angle of view is substantially the same. CPU 101 then executes a program for determining whether the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512 (a distorted region already determined as a display target). CPU 101 then executes a program for determining whether the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512. Then, CPU 101 executes a program for determining whether the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512. In the case of FIG. 5, it is determined that the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512. Then, CPU 101 executes a program for determining whether the angle of view of distorted region 522 is substantially the same as the angle of view of distorted region 512. Therefore, distorted region 522 is not determined as a display target.

[0027] In this way, when multiple distorted areas with different effective image areas and substantially the same angle of view are extracted, only one of the multiple distorted areas may be displayed, but two or more of the multiple distorted areas will not be displayed. This allows for a simple display screen, such as display screen 530 in Figure 5.

[0028] Although a distorted area may be extracted from only one effective image area, unintended reflections do not necessarily occur in the same way in all effective image areas. For example, unintended reflections may not occur in effective image area 511, but may occur in effective image area 521. In such a case, if a distorted area is extracted only from effective image area 511, the unintended reflections will be overlooked. With the above-described method, distorted areas are detected from both effective image area 511 and effective image area 521, making it possible to prevent unintended reflections from being overlooked.

[0029] Fig. 6 is a flowchart of confirmation display processing performed in the imaging device 100. The confirmation display processing in Fig. 6 is realized by the CPU 101 loading a program stored in the flash memory 102 into the DRAM 103 and executing it. For example, the CPU 101 controls the imaging unit 104 and the recording unit 108 in response to a user operation, and after recording a captured image in internal storage or external storage (i.e., after shooting), starts the confirmation display processing in Fig. 6 to allow confirmation of the recorded captured image. Note that the timing of the confirmation display processing is not limited to after a captured image is recorded. For example, the confirmation display processing may be performed in response to a user operation for confirming a captured image (live view image) during live view display.

[0030] In step S601, the CPU 101 executes the effective image area determination program. Based on the lens information, the area of ​​the image circle in the captured image is determined as the effective image area.

[0031] In S602, CPU 101 executes a distorted area extraction program and extracts areas (distorted areas) where the subject has greater distortion than other areas from the effective image area determined in S601. Here, it is assumed that N distorted areas R1, R2, ...RN are extracted. When there are multiple effective image areas, distorted areas R1 to RN are not limited to distorted areas extracted from the same effective image area, and may include two or more distorted areas extracted from two or more different effective image areas.

[0032] In S603, the CPU 101 initializes a variable n to 1 and initializes a display area set Q to an empty set. The display area set Q is a set of distorted areas determined as display targets from among the distorted areas extracted in S602.

[0033] In S604, the CPU 101 performs a display / hide determination process for the distorted region Rn. In the display / hide determination process, the distorted region Rn (and a corrected image in which the distortion of the distorted region Rn has been reduced) is determined as a display target or a non-display target. Details of the display / hide determination process will be described later with reference to FIG. 7.

[0034] In S605, the CPU 101 updates the variable n by adding 1 to the variable n.

[0035] In S606, the CPU 101 determines whether or not the variable n is greater than N (the number of distortion areas extracted in S602). If the variable n is greater than N, the process proceeds to S607, and if not, the process proceeds to S604.

[0036] In S607, the CPU 101 displays on the display unit 105 the corrected image determined in S604 as the image to be displayed (an image in which the distortion in the distorted region determined as the image to be displayed has been reduced).

[0037] 7 is a flowchart of the display / hide determination process (S604 in FIG. 6). As described above, in the display / hide determination process, the distorted region Rn (and the corrected image in which the distortion in the distorted region Rn has been reduced) is determined as a display target or a non-display target.

[0038] In S701, the CPU 101 initializes a variable m to 1.

[0039] In S702, the CPU 101 determines whether or not the distorted region Rm is included in the display region set Q. If the distorted region Rm is included in the display region set Q, the process proceeds to S703, and if not, the process proceeds to S704.

[0040] In S703, CPU 101 executes a program for determining whether the angle of view of distorted region Rn is substantially the same as the angle of view of distorted region Rm. If the angle of view of distorted region Rn is substantially the same as the angle of view of distorted region Rm, the process proceeds to S710 (determining distorted region Rn as a candidate for display); otherwise, the process proceeds to S704.

[0041] In S704, the CPU 101 updates the variable m by adding 1 to the variable m.

[0042] In S705, the CPU 101 determines whether or not the variable m is greater than the variable n. If the variable m is greater than the variable n, the process proceeds to S706, and if not, the process proceeds to S702.

[0043] In S706, the CPU 101 executes an image conversion program to convert the distorted region Rn into a corrected image Rn2 in which the distortion has been reduced. Here, the conversion for reducing the distortion is, for example, This is a process of generating a three-dimensional model from the effective image area 201, performing perspective projection transformation on the portion corresponding to the distorted area 203, and generating a corrected image Rn2 as an image for VR display.

[0044] In S707, the CPU 101 executes a reflection determination program to determine whether or not unintended reflection has occurred in the corrected image Rn2 (whether or not a specific subject is included in the corrected image Rn2). If unintended reflection has occurred in the corrected image Rn2, the process proceeds to S708; otherwise, the process proceeds to S710.

[0045] In S708, the CPU 101 determines the distorted region Rn (corrected image Rn2) as the display target.

[0046] In S709, the CPU 101 adds the distorted region Rn to the display region set Q.

[0047] In S710, the CPU 101 determines the distorted region Rn (corrected image Rn2) as a non-display target.

[0048] As described above, according to the first embodiment, a distorted area is extracted from a captured image, a corrected image in which distortion in the distorted area is reduced is generated, and the corrected image is displayed. This makes it easy to check the content of the distorted image. Also, it is determined whether or not an unintended object has occurred in the distorted area (corrected image), and the determination result is reflected in the display of the corrected image. This allows the user to be notified of the occurrence of an unintended object, making it easier for the user to notice the unintended object, improving usability.

[0049] It is also possible to extract a plurality of distorted areas corresponding to a plurality of effective image areas, respectively, without performing the determination by the same angle of view determination program, and display a plurality of corrected images corresponding to the plurality of distorted areas. Fig. 8 is a schematic diagram of a captured image 800 and a display screen 830. In Fig. 8, distorted areas 811-814 are extracted from an effective image area 810 of the captured image 800, and distorted areas 821-824 are extracted from an effective image area 820 of the captured image 800. Corrected images 831-834 corresponding to the distorted areas 811-814 and corrected images 835-838 corresponding to the distorted areas 821-824 are displayed on the display screen 830. The arrangement of the corrected images 831-834 is the same as the arrangement of the distorted areas 811-814, and the arrangement of the corrected images 835-838 is the same as the arrangement of the distorted areas 821-824. The arrangement of the distortion regions 811 to 814 and the arrangement of the distortion regions 821 to 824 are also similar.

[0050] (Second embodiment) A second embodiment of the present invention will be described. In the first embodiment, the effective image area was determined based on lens information. FIGS. 9(A) and 9(B) are schematic diagrams of captured images. As shown in FIGS. 9(A) and 9(B), the recording area of ​​the captured image (the area to be recorded, at least a part of the area obtained by the imaging unit 104) changes depending on the recording format, and the effective image area to be recorded also changes. Therefore, in the second embodiment, the effective image area is determined based on the recording format of the captured image. The method for setting the recording format is not particularly limited, but for example, the user can specify and set the recording format by operating a menu screen. Information about the set recording format is recorded in the DRAM 103.

[0051] Fig. 10 is a flowchart of the confirmation display process according to the second embodiment. The confirmation display process in Fig. 10 is realized by the CPU 101 loading a program stored in the flash memory 102 into the DRAM 103 and executing it.

[0052] In S1001, the CPU 101 executes an effective image area determination program and determines an effective image area based on information about the recording format recorded in the DRAM 103. The area of ​​the image circle in the recorded captured image (at least a part of the area of ​​the image circle obtained by the imaging unit 104) is determined as the effective image area.

[0053] S1002 to S1007 are the same as S602 to S607 in FIG.

[0054] As described above, according to the second embodiment, the effective image area is determined based on the recording format. This allows the area to be recorded as the effective image area to be determined, and the area to be recorded as the distorted area to be extracted, making it easy to check the area to be recorded. Furthermore, the user can be notified of the occurrence of unintended reflections in the area to be recorded.

[0055] (Third embodiment) A third embodiment of the present invention will be described. Depending on the playback format, the playback area of ​​a captured image (the area to be played back, at least a part of the recorded area) changes, and the effective image area to be played back also changes. Therefore, in the third embodiment, the effective image area is determined based on the playback format of the captured image.

[0056] Fig. 11 is a schematic diagram showing the configuration of a system according to the third embodiment. In Fig. 11, an imaging device 100 and a playback device 1100 are connected to each other so that they can communicate with each other. The playback device 1001 is a device capable of playing back captured images recorded by the imaging device 100, such as a television or a head-mounted display. The CPU 101 of the imaging device 100 controls the communication unit 107 to acquire information on the playback format of the captured images from the playback device 1100.

[0057] Fig. 12 is a flowchart of the confirmation display process according to the third embodiment. The confirmation display process in Fig. 12 is realized by the CPU 101 loading a program stored in the flash memory 102 into the DRAM 103 and executing it.

[0058] In S1201, the CPU 101 controls the communication unit 107 to acquire information on the playback format of the captured image from the playback device 1100. The CPU 101 records the acquired information in the DRAM 103.

[0059] In S1202, the CPU 101 executes an effective image area determination program and determines an effective image area based on playback format information recorded in the DRAM 103. An area that is at least a part of the image circle area in the recorded captured image and that is played back by the playback device 1100 is determined as the effective image area.

[0060] S1203 to S1208 are the same as S602 to S607 in FIG.

[0061] As described above, according to the third embodiment, the effective image area is determined based on the playback format. This allows the area to be determined as the effective image area, and the area to be played back as the distorted area to be extracted, making it easy to check the area to be played back. Furthermore, the user can be notified of the occurrence of unintended reflections in the area to be played back.

[0062] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or a circuit). It is also possible for multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) to share the processing. The entire device may be controlled by the controller.

[0063] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0064] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0065] For example, although an example has been described in which an effective image area is determined and a distorted area is extracted based on the determined effective image area, the method of extracting the distorted area is not limited to this. Information about the distorted area may be prepared in advance within the imaging device 100, and the distorted area may be extracted based on this information. If the imaging device 100 is an interchangeable lens camera (an imaging device with a detachable lens (lens unit)), information about the distorted area may be acquired from the lens. Furthermore, although an example in which the present invention is applied to a digital camera has been described, the present invention is applicable to various electronic devices capable of performing processing using captured images. For example, the present invention is applicable to personal computers (PCs), smartphones, tablet terminals, and the like. The present invention is also applicable when using a PC or the like to check captured images or to search for captured images that do not contain (or contain) unintended objects among multiple captured images.

[0066] (Other embodiments) The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0067] The disclosure of this embodiment includes the following configuration, method, program, and medium. (Configuration 1) an extraction means for extracting an area of ​​the captured image in which the distortion of the subject is greater than that of other areas; a processing means for performing image processing for reducing the distortion on the region extracted by the extraction means, thereby acquiring a corrected image; a control means for controlling the display of the corrected image; An electronic device comprising: (Configuration 2) When an area not including a specific subject and an area including the specific subject are extracted by the extraction means, the control means performs control so as not to display a corrected image obtained by performing the image processing on the area not including the specific subject, but to display a corrected image obtained by performing the image processing on the area including the specific subject. 2. The electronic device according to configuration 1. (Configuration 3) The control means controls the display so that a corrected image obtained by performing the image processing on an area including a specific subject is identifiable. 2. The electronic device according to configuration 1. (Configuration 4) a determining means for determining whether the specific subject is included in the area extracted by the extracting means; Further having 4. The electronic device according to configuration 2 or 3. (Configuration 5) The specific subject differs depending on the area extracted by the extraction means. 5. The electronic device according to any one of configurations 2 to 4. (Configuration 6) A determining means for determining an effective image area in the captured image and The extraction means extracts an area from the effective image area where the distortion of the subject is greater than that of other areas. 6. The electronic device according to any one of configurations 1 to 5. (Configuration 7) The determining means determines the effective image area based on the lens used for capturing the image. 7. The electronic device according to configuration 6. (Configuration 8) The determining means determines the effective image area based on the recording format of the captured image. 7. The electronic device according to configuration 6. (Configuration 9) The determining means determines the effective image area based on the playback format of the captured image. 7. The electronic device according to configuration 6. (Configuration 10) the captured image includes a plurality of effective image areas captured through a plurality of optical systems; When a first area in a first effective image area of ​​the plurality of effective image areas and a second area in a second effective image area of ​​the plurality of effective image areas, the second area corresponding to an angle of view substantially the same as an angle of view corresponding to the first area, are extracted by the extraction means, and a corrected image obtained by performing the image processing on the first area is displayed, the control means performs control so as not to display the corrected image obtained by performing the image processing on the second area. 10. The electronic device according to any one of configurations 6 to 9. (Configuration 11) the captured image includes a plurality of effective image areas captured through a plurality of optical systems; the extraction means extracts a plurality of areas corresponding to the plurality of effective image areas, respectively, as areas in which distortion of the subject is greater than other areas; The control means controls to display a plurality of corrected images respectively corresponding to the plurality of regions extracted by the extraction means. 10. The electronic device according to any one of configurations 6 to 9. (Configuration 12) The image processing for reducing distortion is a process of generating a three-dimensional model from the captured image, performing perspective projection transformation on the portion corresponding to the extracted region, and generating the corrected image. 12. The electronic device according to claim 1, wherein the electronic device is a semiconductor device. (method) extracting an area of ​​the captured image where the distortion of the subject is greater than that of other areas; performing image processing on the extracted region to reduce the distortion, thereby obtaining a corrected image; a step of controlling the display of the corrected image; 1. A method for controlling an electronic device, comprising: (program) 13. A program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 12. (medium) 13. A computer-readable storage medium storing a program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 12. [Explanation of symbols]

[0068] 100: Imaging device 101: CPU

Claims

1. an extraction means for extracting an area of ​​the captured image in which the distortion of the subject is greater than that of other areas; a processing means for performing image processing for reducing the distortion on the region extracted by the extraction means, thereby acquiring a corrected image; a control means for controlling the display of the corrected image; An electronic device comprising:

2. When an area not including a specific subject and an area including the specific subject are extracted by the extraction means, the control means performs control so as not to display a corrected image obtained by performing the image processing on the area not including the specific subject, but to display a corrected image obtained by performing the image processing on the area including the specific subject.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. The control means controls the display so that a corrected image obtained by performing the image processing on an area including a specific subject is identifiable.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

4. a determining means for determining whether the specific subject is included in the area extracted by the extracting means; Further having 3. The electronic device according to claim 2.

5. The specific subject differs depending on the area extracted by the extraction means.

3. The electronic device according to claim 2.

6. A determining means for determining an effective image area in the captured image and The extraction means extracts an area from the effective image area where the distortion of the subject is greater than that of other areas.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

7. The determining means determines the effective image area based on the lens used for capturing the image.

7. The electronic device according to claim 6.

8. The determining means determines the effective image area based on the recording format of the captured image.

7. The electronic device according to claim 6.

9. The determining means determines the effective image area based on the playback format of the captured image.

7. The electronic device according to claim 6.

10. the captured image includes a plurality of effective image areas captured through a plurality of optical systems; When a first area in a first effective image area of ​​the plurality of effective image areas and a second area in a second effective image area of ​​the plurality of effective image areas, the second area corresponding to an angle of view substantially the same as an angle of view corresponding to the first area, are extracted by the extraction means, and a corrected image obtained by performing the image processing on the first area is displayed, The control means controls so as not to display a corrected image obtained by performing the image processing on the second region.

7. The electronic device according to claim 6.

11. the captured image includes a plurality of effective image areas captured through a plurality of optical systems; the extraction means extracts a plurality of areas corresponding to the plurality of effective image areas, respectively, as areas in which distortion of the subject is greater than other areas; The control means controls to display a plurality of corrected images respectively corresponding to the plurality of regions extracted by the extraction means.

7. The electronic device according to claim 6.

12. The image processing for reducing distortion is a process of generating a three-dimensional model from the captured image, performing perspective projection transformation on the portion corresponding to the extracted region, and generating the corrected image.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

13. extracting an area of ​​the captured image where the distortion of the subject is greater than that of other areas; performing image processing on the extracted region to reduce the distortion, thereby obtaining a corrected image; a step of controlling the display of the corrected image; 1. A method for controlling an electronic device, comprising:

14. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 12.

15. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 12.

Images