Electronic device including camera and shooting method

Abstract

An electronic device according to various embodiments disclosed in this document may include a camera and a processor operatively connected to the camera, and the processor may be prepared to acquire images with at least two different angles of view through the camera, analyze the state of a subject included in the images acquired through the camera, determine a shooting angle of view based on the analysis, and provide a preview image and an image with the determined shooting angle of view. Various other embodiments may also be possible.

Description

Technology Field

[0001] The various embodiments disclosed in this document relate to an electronic device including a camera and a method of taking images through a camera included in the electronic device. Background Technology

[0003] As the performance of cameras mounted on electronic devices improves, the number of users utilizing these cameras is also gradually increasing.

[0004] The camera of the electronic device can provide shooting at various angles of view through cropping or multiple cameras.

[0005] Recently, there has been a growing number of attempts to incorporate artificial intelligence or machine learning technologies into cameras. Technologies that detect or recognize subjects within the frame and automatically change the shooting mode based on the detected or recognized subjects are also being actively developed. The problem to be solved

[0007] Although electronic device cameras support shooting at various angles of view, there may be instances where users cannot easily determine which angle to use in specific situations.

[0008] In addition, in conventional systems, there are issues such as the real-time video (preview video) displayed on the screen cutting out when changing the shooting angle, or the inability to receive video scaled to the resolution determined during pipeline configuration (digital zoom).

[0009] According to various embodiments disclosed in this document, an electronic device and a shooting method including a camera can determine an optimal shooting angle according to the shooting situation and continuously provide a preview image without interruption during the process of changing the angle of view. means of solving the problem

[0011] An electronic device according to various embodiments disclosed in this document may include a camera and a processor operatively connected to the camera, and the processor may be prepared to acquire images with at least two different angles of view through the camera, analyze the state of a subject included in the images acquired through the camera, determine a shooting angle of view based on the analysis, and provide a preview image and an image with the determined shooting angle of view.

[0012] A camera shooting method according to various embodiments disclosed in this document may include an operation to prepare to acquire images with at least two different angles of view through a camera, an operation to analyze the state of a subject included in the images acquired through the camera, an operation to determine a shooting angle of view based on the analysis, and an operation to provide a preview image and an image with the determined shooting angle of view.

[0013] An electronic device according to various embodiments disclosed in this document may include a plurality of cameras having different viewing angles and a processor operatively connected to the plurality of cameras, and the processor may be prepared to acquire images with at least two different viewing angles through the plurality of cameras, analyze the state of a subject included in an image acquired through one of the plurality of cameras, determine one of the plurality of cameras based on the analysis, and provide a preview image and an image through the determined camera. Effects of the invention

[0015] According to the various embodiments disclosed in this document, the shooting angle of view can be changed to an optimal shooting angle of view depending on the state of the subject present in the preview image.

[0016] In addition, it can provide a smooth preview video without interruption or image degradation, even when the shooting angle changes. Brief explanation of the drawing

[0018] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a block diagram of an electronic device according to various embodiments disclosed in this document. FIG. 3 is a flowchart of various embodiments disclosed in this document. FIG. 4 is a conceptual diagram of a pipeline corresponding to various shooting angles according to various embodiments disclosed in this document. FIG. 5 is a flowchart of a shooting method according to various embodiments disclosed in this document. FIGS. 6a to 6d are drawings for explaining the switching of shooting angles according to various embodiments disclosed in this document. FIG. 7 is a flowchart of a shooting method according to various embodiments disclosed in this document. Specific details for implementing the invention

[0019] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.

[0020] In relation to the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of the noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise.

[0021] In this document, each of the phrases such as “A or B,” “at least one of A and B,” “or at least one of B,” “A, B or C,” “at least one of A, B and C,” and “B, or at least one of C” may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationly,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0023] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input device (150), sound output device (155), display device (160), audio module (170), sensor module (176), interface (177), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., display device (160) or camera module (180)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components may be implemented as a single integrated circuit. For example, a sensor module (176) (e.g., fingerprint sensor, iris sensor, or light sensor) can be implemented embedded in a display device (160) (e.g., display).

[0024] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can load commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) into volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) and an auxiliary processor (123) (e.g., a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor) that can be operated independently or together with it. Additionally or generally, the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0025] The auxiliary processor (123) can control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display device (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)).

[0026] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, software (e.g., program (140)) and input data or output data for related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0027] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0028] The input device (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input device (150) may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus pen). According to various embodiments, the input device (150) may recognize the user's voice. The input device (150) may receive commands via the user's voice. The input device (150) may be a multi-microphone device corresponding to a 360-degree direction so as to recognize voice occurring around the electronic device (101).

[0029] The sound output device (155) can output a sound signal to the outside of the electronic device (101). The sound output device (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as multimedia playback or recording playback, and the receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0030] The display device (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display device (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display device (160) may include a touch circuitry configured to detect a touch, or a sensor circuitry configured to measure the intensity of the force generated by said touch (e.g., a pressure sensor).

[0031] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through an input device (150) or output sound through an audio output device (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) that is directly or wirelessly connected to the electronic device (101).

[0032] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0033] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0034] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, a display port (DP), or an audio connector (e.g., a headphone connector).

[0035] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0036] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0037] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) may be implemented, for example, as at least part of a power management integrated circuit (PMIC). The power supplied to the electronic device (101) may be supplied via a wired or wireless method. For example, the electronic device (101) may include a wireless charging module (not shown) to receive power wirelessly. The wireless charging module may be a device that receives power via magnetic induction or resonant induction. The wireless charging module may include a wireless charging coil wound with a conductive metal wire.

[0038] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0039] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi Direct, or IrDA (infrared data association)) or a second network (199) (e.g., a cellular network, the Internet, or a long-range communication network such as a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify and authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0040] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module may include a single antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., an RFIC) may be additionally formed as part of the antenna module (197). According to various embodiments, the antenna module (197) can transmit and receive 5G communication signals so that the electronic device (101) can support 5G communication. For example, the antenna module (197) can transmit and receive signals in the multi-gigahertz band and in the tens to hundreds of gigahertz band (e.g., mmWave). The antenna module can generate an RF beam by including a plurality of antennas (e.g., a plurality of patch array antennas).

[0041] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0042] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the electronic devices (102, 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

[0044] FIG. 2 is a block diagram of an electronic device according to various embodiments disclosed in this document.

[0045] According to various embodiments, an electronic device (e.g., the electronic device (101) of FIG. 1) may include a camera (270) (e.g., the camera module (180) of FIG. 1) and a processor (230) (e.g., the processor (120) of FIG. 1).

[0046] According to various embodiments, the camera (270) may be positioned on the front and / or rear of an electronic device. The camera (270) may capture a subject and generate an image signal. The camera (270) may include an image sensor equipped with a device that converts light into an electrical signal (e.g., CMOS (complementary metal-oxide-semiconductor), CCD (charge-coupled device)). The camera (270) may capture images with various angles of view (or field of view). Here, the angle of view can be understood as the range of the image captured by the camera (270). For example, a wide angle of view means that the image is captured over a wide range, and a narrow angle of view means that the image is captured over a narrow range. The angle of view may be changed by adjusting the range of light incident on the image sensor through a lens, or by cropping the image. For example, if a portion of the image information received by the image sensor is cropped, an image with a narrower angle of view compared to the original image may be obtained. When cropping an image to adjust the field of view, the resolution of the image may be changed. For example, when the image sensor of the camera (270) has a maximum resolution of 8000 x 6000, the image can be cropped to obtain an image with a resolution of 7680 x 4320. In the following description, changing the resolution by cropping will be equated with adjusting the field of view.

[0047] According to various embodiments, the processor (230) can process an image signal received from the camera (270) to display an image on the display (210) (e.g., the display device (160) of FIG. 1). For example, the processor (230) can display a preview image (e.g., the preview image (421) of FIG. 4) on the display (210). The preview image may refer to a real-time image captured by the camera (270). The user can check the area to be shot, the exposure level, the composition, etc., while viewing the preview image. The processor (230) can process the image signal received by the camera (270) to match the specifications (e.g., resolution) of the preview image and display it on the display (210). For example, the processor (230) can convert the image signal to FHD (full HD, 1920 X 1080) specifications (e.g., resizing) and display it on the display (210). The processor (230) can convert and display the image of the currently set shooting angle of view into a preview image. If the shooting angle of view changes, the image of the changed angle of view can be converted and displayed into a preview image. According to various embodiments, the processor (230) can generate a preview command. The processor (230) can display a preview image on the display (210) according to the generated preview command. The preview command can be generated by various triggers. For example, when a user runs a camera (270) related application, a preview command can be generated.

[0048] According to various embodiments, the processor (230) may generate and provide an image (e.g., the first angle of view image (431) or the second angle of view image (441) of FIG. 4) with a currently set angle of view. The processor (230) may receive various inputs from a user (e.g., touch input, voice input, and gesture input, etc.) and generate a shooting command. Based on the shooting command, the processor (230) may process the image signal received by the camera (270) at the time the user's input is received to generate an image with a currently set angle of view.

[0049] According to various embodiments, the processor (230) can analyze the state of a subject included in an image (e.g., a preview image) obtained through the camera (270). The processor (230) can determine the shooting angle based on the state of the subject included in the image. A preview image and an image may be provided according to the determined shooting angle. The processor (230) can prepare in advance so that the preview image can be provided without interruption even if the shooting angle changes.

[0050] According to various embodiments, as illustrated in FIG. 2, the processor (230) may include an image composition unit (231), an image provision unit (232), and an image analysis unit (233). The image composition unit (231), the image provision unit (232), and the image analysis unit (233) are distinguished merely for convenience of explanation and may not be physically distinct components. The image composition unit (231) may generate a preview command for displaying a preview image and a shooting command for generating an image. The image provision unit (232) may receive an image signal from a camera (270) and provide an image under the control of the image composition unit (231). The image analysis unit (233) may determine the shooting angle of view by analyzing the state of a subject included in the image provided by the image provision unit (232). The subject analyzed by the image analysis unit (233) may be, for example, a human face or an animal face. In some cases, the user may directly select a subject of interest. In this case, the video analysis unit (233) may analyze the subject selected by the user.

[0051] According to various embodiments, the electronic device may include an image signal processor (250) (ISP). The image signal processor (250) can post-process an image signal received from an image sensor of a camera (270). The image signal processor (250) can improve the quality of the image by removing noise, etc., from the original image signal received by the image sensor. The image signal processor (250) may be configured as a separate integrated circuit (IC). According to various embodiments, the image signal processor (250) may be included in the processor (230) or in the camera (270).

[0053] FIG. 3 is a flowchart of various embodiments disclosed in this document, and FIG. 4 is a conceptual diagram of a pipeline corresponding to various shooting angles according to various embodiments disclosed in this document.

[0054] According to various embodiments, the image configuration unit (231) may transmit a pipeline preparation request to the image providing unit (232) (311). The image providing unit (232) may receive the pipeline preparation request and configure the pipeline (312). The image providing unit (232) may configure a preview pipeline (420) and a field of view pipeline (e.g., a first field of view pipeline (430), a second field of view pipeline (440)).

[0055] According to various embodiments, a pipeline may refer to a series of data processing structures that process an image signal to generate a preview image (421) or an image (e.g., a first field of view image (431), a second field of view image (441)). Data processing performed in the pipeline may be carried out through hardware or software. For example, data processing may be carried out in an image processing block and software (e.g., a camera-related application) that are physically connected (e.g., hard-wired) for a specific purpose. An image signal received from the image sensor of a camera may be converted into a preview image (421) or an image through various processing steps. For example, the image signal may be processed through at least one of a camera, a processor, and an image signal processor. The image processing (410) of the pipeline may include defective pixel correction, color interpolation, color error correction, gamma correction, conversion of the RGB color gamut to YCrCb, noise reduction, edge enhancement, and corrections and encodings such as exposure, contrast, gradation, and white balance. An image signal input to the pipeline may be converted into a preview image (421) or an image that can be displayed on the display of an electronic device while undergoing such post-processing through the pipeline.

[0056] According to various embodiments, the preview pipeline (420) prepared by the image provider (232) can process a preview image (421) that displays the image being captured in real time. The preview pipeline (420) can receive an image signal in real time and convert it into a preview image (421). The preview pipeline (420) can convert the image to a preset resolution (e.g., resize).

[0057] According to various embodiments, the angle of view pipeline prepared by the image providing unit (232) can receive an image signal and convert it into a still image that matches the angle of view. The angle of view pipeline may include, for example, a first angle of view pipeline (430) and a second angle of view pipeline (440). Here, the first angle of view may refer to an angle of view that is wider than the second angle of view. The first angle of view pipeline (430) can receive an image signal and convert it into a first angle of view image (431). The second angle of view pipeline (440) can receive an image signal and convert it into a second angle of view image (441). The first angle of view image (431) may be an image captured over a wider range than the second angle of view image (441).

[0058] In the conventional case, when the shooting angle of view changes, it is required to remove the configured pipeline and prepare a new pipeline corresponding to the changed angle of view. During this process, the reception of the image signal must be interrupted, which may cause a problem where the output of the preview image to the display is interrupted during the change of the angle of view. The electronic device according to the various embodiments disclosed in this document may pre-configure a preview pipeline (420) and angle pipelines (430, 440) corresponding to a plurality of angles of view. Therefore, even if the shooting angle of view changes, it is not necessary to remove the pipeline. Since the image signal can be continuously received through the pre-configured pipeline, the preview image (421) can be continuously output to the display even during the process of changing the shooting angle of view. As a result, the electronic device according to the various embodiments disclosed in this document may be able to provide a seamless preview image (421) without image quality degradation even when the shooting angle of view changes.

[0059] According to various embodiments, the image providing unit (232) can transmit a pipeline ready signal to the image configuration unit (231) when the pipeline configuration is completed (313).

[0060] According to various embodiments, the image configuration unit (231) may transmit a preview command to the image providing unit (232) (321). The preview command may be generated by various triggers. For example, when a user runs a camera-related application, a preview command may be generated. The preview command may include the currently set shooting angle of view. The image providing unit (232) may receive an image signal and process the image signal through a pre-configured preview pipeline (420) to generate a preview image (421) (322). At this time, the image providing unit (232) may convert (e.g., resize) the preview image (421) to match the currently set shooting angle of view.

[0061] According to various embodiments, a preview image (421) generated by an image providing unit (232) may be provided to an image composition unit (231) (323) and may be provided to an image analysis unit (233) (324). The image composition unit (231) may transmit a request for analysis of the preview image (421) to the image analysis unit (233) (331). The image analysis unit (233) may receive the request for analysis of the preview image (421) and analyze the preview image (421). The image analysis unit (233) may determine the shooting angle of view by analyzing the state of the subject included in the preview image (421) (332). The image analysis unit (233) may determine whether to change the shooting angle of view and provide the determined shooting angle of view to the image composition unit (231) (333).

[0062] For example, while a preview image (421) is currently being provided with a first angle of view, the image analysis unit (233) may decide to change the shooting angle of view to a second angle of view. The image analysis unit (233) may determine the shooting angle of view to a second angle of view and provide the determined angle of view to the image composition unit (231). The image composition unit (231) may transmit a preview command to the image providing unit (232) according to the changed shooting angle of view (325). The image providing unit (232) may receive an image signal and process the image signal through a pre-configured preview pipeline (420) to generate a preview image (421) with a second angle of view (326). The preview image (421) with a second angle of view generated by the image providing unit (232) may be provided to the image composition unit (231) (327) and to the image analysis unit (233) (328). If the image analysis results of the image analysis unit (233) indicate that a change in the shooting angle is not necessary, the operation of transmitting a preview command (325) according to the changed shooting angle and providing a preview image (327) of the changed shooting angle described above may be omitted.

[0063] According to various embodiments, the image composition unit (231) can generate a shooting command and transmit it to the image providing unit (232) (341). The shooting command can be generated by various inputs from the user (e.g., touch input, voice input, and gesture input, etc.). The image providing unit (232) can receive the shooting command and generate an image using a pre-configured angle of view pipeline (e.g., a first angle of view pipeline (430) or a second angle of view pipeline (440)) (342). The image providing unit (232) can generate an image using an angle of view pipeline corresponding to the current shooting angle of view. For example, if the current shooting angle of view is the first angle of view, the first angle of view image (431) can be generated using the first angle of view pipeline (430). If the current shooting angle of view is the second angle of view, the second angle of view image (441) can be generated using the second angle of view pipeline (440). The image providing unit (232) can provide the generated image to the image composition unit (231) (343). The image composition unit (231) can store the image received from the image providing unit (232) in memory (e.g., memory (130) of FIG. 1) (344).

[0065] FIG. 5 is a flowchart of a shooting method according to various embodiments disclosed in this document, and FIGS. 6a to 6d are drawings for explaining the switching of shooting angles according to various embodiments disclosed in this document. Hereinafter, the same reference numerals used in FIG. 2 will be used for components identical to the configuration described in FIG. 2.

[0066] According to various embodiments, the image analysis unit (233) can determine the shooting angle of view in the order shown in FIG. 5. The order shown in FIG. 5 is merely an example, and the image analysis unit (233) can determine the shooting angle of view in various other orders.

[0067] According to various embodiments, the image analysis unit (233) can receive a preview image (e.g., the preview image (421) of FIG. 4) provided by the image providing unit (232) (510). The image analysis unit (233) can receive an image analysis request transmitted from the image composition unit (231). The user can select whether to use the automatic angle of view change function (560) in the settings of the camera-related application. If the user selects to use the automatic angle of view change function, an image analysis request may be transmitted along with the reception of the preview image. According to various embodiments, the user may also select whether to use the automatic angle of view change function through a user interface (UI) displayed along with the preview image. If the user selects whether to use the automatic angle of view change function, an image analysis request may be transmitted from the image composition unit (231). According to various embodiments, the operation (560) of receiving whether the user selects whether to use the automatic angle of view change function may be omitted.

[0068] According to various embodiments, the image analysis unit (233) can detect and recognize subjects included in the preview image (520). Subject detection may refer to the operation of distinguishing between the background and the subject in the preview image. In the subject detection operation, the image analysis unit (233) may detect the number of subjects included in the preview image. Subject recognition may refer to the operation of identifying the detected subjects. For example, the image analysis unit (233) may recognize the type of subject or, if the subject is a person, recognize the person by performing face recognition.

[0069] According to various embodiments, the image analysis unit (233) can analyze the state of a detected and recognized subject (530). The state of the subject may include, for example, at least one of the number, size, location, and exposure degree of the subject. The image analysis unit (233) can analyze the state of the subject and, if a change in the shooting angle of view is required, determine a change in the shooting angle of view and transmit the determined shooting angle of view to the image composition unit (231) (540). If a change in the shooting angle of view is not required, the current shooting angle of view is maintained and transmit to the image composition unit (231) that the current shooting angle of view is maintained (550). The user can check the current shooting angle of view through the UI (630) displayed on the display (600). The UI (630) may include a first indicator (631) indicating that the current shooting angle of view is a first angle of view and a second indicator (633) indicating that the current shooting angle of view is a second angle of view. Here, the first angle of view may mean an angle of view wider than the second angle of view.

[0070] According to various embodiments, when there are many subjects, the image analysis unit (233) can determine the shooting angle of view so that the shooting angle of view becomes wider. As illustrated in FIG. 6a, when there are many subjects, the image analysis unit (233) can determine to change the shooting angle of view to a shooting angle of view (e.g., first angle of view) that is wider than the current shooting angle of view (e.g., second angle of view). For example, in the case of FIG. 6a (a), since the second indicator (633) is selected, it can be seen that the current shooting angle of view in FIG. 6a (a) is the second angle of view. The angle of view may be changed as a result of analysis by the image analysis unit (233). As in FIG. 6a (b), when the first indicator (631) is selected, it can be seen that the current shooting angle of view is the first angle of view. According to various embodiments, the image analysis unit (233) can reflect the recognition result of the subjects in the change of the shooting angle of view. For example, if two or more subjects included in the preview video are all registered persons in the electronic device, the shooting angle of view may be widened. If a subject included in the preview video is a person not registered in the electronic device, the shooting angle of view may not be changed. Additionally, even if multiple subjects are detected, the shooting angle of view may not be changed if the subjects are moving at a speed greater than a reference speed. In some cases, it may also be possible to change the shooting angle of view by analyzing the user's preferred image. For example, the image analysis unit (233) can analyze photos stored in the electronic device to confirm that the user prefers to photograph the subject in a large size. In such cases, the image analysis unit (233) may not change the shooting angle of view even if the subject is photographed somewhat large due to the current narrow shooting angle of view.

[0071] According to various embodiments, the image analysis unit (233) can change the shooting angle of view by considering the position of the subject within the preview image. The image analysis unit (233) can change the shooting angle of view to be wider when a part of the subject is not included in the preview image, as shown in FIG. 6b. In the case of FIG. 6b (a), since the second indicator (633) is selected, it can be seen that the current shooting angle of view is the second angle of view. In the case of FIG. 6b (b), where the shooting angle of view has been changed, since the first indicator (631) is selected, it can be seen that the current shooting angle of view is the first angle of view. When the shooting angle of view is widened, a part of the subject that was not included in the preview image can be included in the preview image. Additionally, the image analysis unit (233) can change the shooting angle of view to be narrower when the subject is located at the edge of the preview image, as shown in FIG. 6c. In the case of FIG. 6c (a), since the first indicator (631) is selected, it can be seen that the current shooting angle is the first angle. In the case of FIG. 6c (b), where the shooting angle has been changed, since the second indicator (633) is selected, it can be seen that the current shooting angle is the second angle. Distortion may occur at the edges or periphery of the image due to the optical characteristics of the camera. Additionally, the image quality in the periphery may be lower than that in the center. The image analysis unit (233) can change the shooting angle to narrow it to induce the user to move the subject to the center of the preview image. According to various embodiments, the image analysis unit (233) may reflect the recognition result of the subject in the change of the shooting angle. For example, if the subject located in the periphery of the preview image is a person not registered in the electronic device, the shooting angle may not be changed.

[0072] According to various embodiments, the image analysis unit (233) can change the shooting angle of view by considering the degree of exposure of the subject. For example, as shown in FIG. 6d, if a bright light source (e.g., sun and lighting) is present with the subject in the preview image, the exposure of the subject may be excessively reduced depending on the metering method of the camera. This may result in insufficient exposure of the subject. If shooting is performed in this state, the subject may be captured darkly. The image analysis unit (233) can change the shooting angle of view to narrow so that the bright light source present in the preview image is removed from the preview image. In the case of FIG. 6d (a), since the first indicator (631) is selected, it can be seen that the current shooting angle of view is the first angle of view. In the case of FIG. 6d (b), where the shooting angle of view has been changed, since the second indicator (633) is selected, it can be seen that the current shooting angle of view is the second angle of view.

[0073] According to various embodiments, if the conditions for changing the shooting angle conflict depending on the state of the subject described above, the image analysis unit (233) can change the shooting angle by applying a higher priority standard according to a preset priority.

[0074] Previously, it was explained that the image analysis unit (233) determines the shooting angle based on the state of the subject and that the shooting angle changes, but the shooting angle determined by the image analysis unit (233) may also be displayed on the display. In this case, the shooting angle may or may not change depending on the user's selection.

[0076] FIG. 7 is a flowchart of a shooting method according to various embodiments disclosed in this document. Hereinafter, the same reference numerals used in FIG. 2 will be used for components identical to the configuration described in FIG. 2.

[0077] According to various embodiments, the analysis of the subject's state by the image analysis unit (233) may be performed in the order shown in FIG. 7. The order shown in FIG. 7 is merely an example, and the image analysis unit (233) may analyze the state of the subject in various other orders and methods. The subject analyzed by the image analysis unit (233) may be, for example, a human face or an animal face. In some cases, the user may directly select a subject of interest. In this case, the image analysis unit (233) may analyze the subject selected by the user.

[0078] According to various embodiments, the image analysis unit (233) can determine whether the current preview image (e.g., the preview image (421) of FIG. 4) is provided at the widest angle of view supported by the electronic device (710). If the current preview image is not at the widest angle of view, the image analysis unit (233) can determine the number of subjects (721). If there are two or more subjects, the shooting angle of view can be expanded (723) (e.g., FIG. 6a). Expanding the shooting angle of view may mean changing the shooting angle of view to be wide. If there is only one subject, the image analysis unit (233) can determine whether the position of the subject is at the edge (722). If the subject is at the edge of the preview image and part of it is cut off, the shooting angle of view can be expanded (723) (e.g., FIG. 6b).

[0079] According to various embodiments, the image analysis unit (233) can check whether saturation due to overexposure occurs in the current preview image (730). Saturation may mean that light of a brightness level that the image sensor cannot distinguish exists in the preview image. If saturation occurs, the image analysis unit (233) can check whether the configuration causing saturation exists only in the currently set shooting angle of view (740).

[0080] According to various embodiments, if a configuration that causes saturation (e.g., a bright light source) is not present only in the currently set shooting angle of view, it can be determined whether the subject is located at the edge (741). If the subject is located at the edge, distortion may occur in the subject. The image analysis unit (233) can reduce the shooting angle of view (751). Reducing the shooting angle of view may mean changing the shooting angle of view to be narrow. By reducing the shooting angle of view, the user can be induced to move the subject located at the edge to the center (e.g., FIG. 6c).

[0081] According to various embodiments, if the configuration causing saturation exists only in the currently set shooting angle, the state of the subject (e.g., cropping) can be analyzed when the shooting angle is changed (750). If the subject does not change even when the shooting angle is changed, the shooting angle can be reduced (751) (e.g., FIG. 6d). If the subject changes when the shooting angle is changed, the shooting angle can be maintained.

[0082] According to various embodiments, the shooting angle determined by the image analysis unit (233) is provided to the image composition unit (231), and the image composition unit (231) can transmit a shooting command according to the determined shooting angle to the image providing unit (232). The image providing unit (232) can convert an image signal received from an image sensor into an image of the determined shooting angle (e.g., the first angle pipeline (430) or the second angle pipeline (440) of FIG. 4) using an angle pipeline corresponding to the determined shooting angle (e.g., the first angle image (431) or the second angle image (441) of FIG. 4). The image composition unit (231) can acquire the converted image (760).

[0084] According to various embodiments, the electronic device may include a plurality of cameras having different angles of view. For example, the electronic device may include a standard angle of view camera, a wide-angle camera, and a telephoto camera. The processor of the electronic device may preconfigure angle of view pipelines corresponding to the angles of view of the plurality of different cameras. For example, it may preconfigure an angle of view pipeline corresponding to the standard angle of view camera, an angle of view pipeline corresponding to the wide-angle camera, and an angle of view pipeline corresponding to the telephoto camera.

[0085] According to various embodiments, the image analysis unit may analyze the state of a subject and select one of a plurality of cameras based on the analyzed state of the subject. The image configuration unit (231) may transmit a shooting command including the selected camera to the image providing unit (232). The image providing unit (233) may generate an image from an image signal received from the selected camera using a pre-configured field of view pipeline.

[0087] An electronic device according to various embodiments disclosed in this document may include a camera and a processor operatively connected to the camera, and the processor may be prepared to acquire images with at least two different angles of view through the camera, analyze the state of a subject included in the images acquired through the camera, determine a shooting angle of view based on the analysis, and provide a preview image and an image with the determined shooting angle of view.

[0088] Additionally, the processor may include an image providing unit that receives an image signal from the camera and provides a preview image and an image having at least two angles of view based on at least one of a preview command and a shooting command; an image analysis unit that analyzes the state of a subject included in the preview image to determine a shooting angle of view; and an image configuration unit that generates at least one of the preview command and the shooting command according to the shooting angle of view determined by the image analysis unit.

[0089] Additionally, the image configuration unit may prepare a preview pipeline and a plurality of angle pipelines corresponding to images of different angles of view in the image providing unit, the preview pipeline may be a data processing structure that converts an image signal received from the camera into the preview image, and the plurality of angle pipelines may be data processing structures that convert an image signal received from the camera into images of different angles of view.

[0090] Additionally, the image configuration unit may prepare a preview pipeline, a first angle of view pipeline, and a second angle of view pipeline in the image providing unit, and the first angle of view pipeline may be a data processing structure that converts an image signal received from the camera into an image of the first angle of view, and the second angle of view pipeline may be a data processing structure that converts an image signal received from the camera into an image of the second angle of view, which is an angle of view different from the first angle of view.

[0091] Additionally, the image providing unit may provide the preview image using the preview pipeline according to the preview command to at least one of the first angle of view and the second angle of view, and may provide an image captured using at least one of the first angle of view and the second angle of view using at least one of the first angle of view pipeline and the second angle of view pipeline according to the shooting command.

[0092] In addition, the image providing unit may change the data processing structure from at least one of the first angle of view pipeline and the second angle of view pipeline to the other of the first angle of view pipeline and the second angle of view pipeline based on the shooting command, and may continuously receive an image signal from the camera during the change process to provide the preview image without interruption.

[0093] In addition, the image analysis unit may determine the shooting angle based on at least one of the number, location, and size of the subjects included in the preview image.

[0094] In addition, the image analysis unit can determine the shooting angle based on at least one of the number, location, and size of the registered subjects.

[0095] In addition, the image analysis unit can determine the shooting angle based on the degree of exposure of the subject included in the preview image.

[0097] A camera shooting method according to various embodiments disclosed in this document may include an operation to prepare to acquire images with at least two different angles of view through a camera, an operation to analyze the state of a subject included in the images acquired through the camera, an operation to determine a shooting angle of view based on the analysis, and an operation to provide a preview image and an image with the determined shooting angle of view.

[0098] Additionally, the image providing unit may receive an image signal from the camera and provide a preview image and an image having at least two or more angles of view based on at least one of a preview command and a shooting command, the image analysis unit may determine a shooting angle of view by analyzing the state of a subject included in the preview image, and the image composition unit may generate at least one of the preview command and the shooting command according to the shooting angle of view determined by the image analysis unit.

[0099] Additionally, the image configuration unit may prepare a preview pipeline and a plurality of angle-of-view pipelines corresponding to images of different angles of view in the image providing unit, the preview pipeline may be a data processing structure that converts an image signal received from the camera into the preview image, and the plurality of angle-of-view pipelines may be data processing structures that convert an image signal received from the camera into images of different angles of view.

[0100] Additionally, the image configuration unit may prepare a preview pipeline, a first angle of view pipeline, and a second angle of view pipeline in the image providing unit, and the first angle of view pipeline may be a data processing structure that converts an image signal received from the camera into an image of the first angle of view, and the second angle of view pipeline may be a data processing structure that converts an image signal received from the camera into an image of the second angle of view, which is an angle of view different from the first angle of view.

[0101] Additionally, the image providing unit may provide the preview image using the preview pipeline according to the preview command to at least one of the first angle of view and the second angle of view, and may provide an image captured using at least one of the first angle of view and the second angle of view using at least one of the first angle of view pipeline and the second angle of view pipeline according to the shooting command.

[0102] In addition, the image providing unit may change the data processing structure from at least one of the first angle of view pipeline and the second angle of view pipeline to the other of the first angle of view pipeline and the second angle of view pipeline based on the shooting command, and may continuously receive an image signal from the camera during the change process to provide the preview image without interruption.

[0103] In addition, the image analysis unit may determine the shooting angle based on at least one of the number, location, and size of the subjects included in the preview image.

[0104] In addition, the image analysis unit can determine the shooting angle based on at least one of the number, location, and size of the registered subjects.

[0105] In addition, the image analysis unit can determine the shooting angle based on the degree of exposure of the subject included in the preview image.

[0107] An electronic device according to various embodiments disclosed in this document may include a plurality of cameras having different viewing angles and a processor operatively connected to the plurality of cameras, and the processor may be prepared to acquire images with at least two different viewing angles through the plurality of cameras, analyze the state of a subject included in an image acquired through one of the plurality of cameras, determine one of the plurality of cameras based on the analysis, and provide a preview image and an image through the determined camera.

[0108] Additionally, the processor may prepare a preview pipeline and a plurality of angle-of-view pipelines corresponding to images of different angles of view, the preview pipeline may be a data processing structure that converts an image signal received from one of the plurality of cameras into the preview image, and the plurality of angle-of-view pipelines may be data processing structures that convert an image signal received from the plurality of cameras into images of different angles of view, respectively.

[0110] Furthermore, the embodiments disclosed in this specification and drawings are merely specific examples presented to facilitate the explanation of the technical content according to the embodiments disclosed in this document and to aid in understanding the embodiments disclosed in this document, and are not intended to limit the scope of the embodiments disclosed in this document. Accordingly, the scope of the various embodiments disclosed in this document should be interpreted to include all modifications or variations derived based on the technical concept of the various embodiments disclosed in this document, in addition to the embodiments disclosed herein. Explanation of the symbols

[0112] 210: Display 230: Processor 231: Video Composition Section 232: Video Provision Section 233: Image Analysis Unit 250: Image Signal Processor 270: Camera

Claims

Claim 1 An electronic device comprising: a camera providing at least two angles of view; and a processor operatively connected to the camera; wherein the processor analyzes the state of a subject included in an image acquired through the camera, determines a shooting angle of view based on the analyzed state of the subject, and provides a preview image and an image with the determined shooting angle of view; wherein the state of the subject includes the number, location, size, speed, exposure level of the subject, and whether the subject is registered in the electronic device; and wherein the processor, when the number of analyzed subjects is two or more, widens the shooting angle of view when the two or more subjects are registered in the electronic device, and does not change the shooting angle of view when the two or more subjects are not registered in the electronic device. Claim 2 An electronic device according to claim 1, wherein the processor comprises: an image providing unit that receives an image signal from the camera and provides a preview image and an image having at least two angles of view based on at least one of a preview command and a shooting command; an image analysis unit that analyzes the state of a subject included in the preview image and determines a shooting angle of view; and an image configuration unit that generates at least one of the preview command and the shooting command according to the shooting angle of view determined by the image analysis unit. Claim 3 delete Claim 4 An electronic device according to paragraph 2, wherein the image configuration unit prepares a preview pipeline, a first angle of view pipeline, and a second angle of view pipeline in the image providing unit, wherein the first angle of view pipeline is a data processing structure that converts an image signal received from the camera into an image of the first angle of view, and the second angle of view pipeline is a data processing structure that converts an image signal received from the camera into an image of the second angle of view which is a different angle of view from the first angle of view. Claim 5 delete Claim 6 An electronic device according to claim 4, wherein the image providing unit changes the data processing structure from at least one of the first angle of view pipeline and the second angle of view pipeline to the other of the first angle of view pipeline and the second angle of view pipeline based on the shooting command, and continuously receives an image signal from the camera during the change process to provide the preview image without interruption. Claim 7 In paragraph 2, the image analysis unit is an electronic device that determines the shooting angle based on the number, location, size, and exposure degree of subjects included in the preview image. Claim 8 delete Claim 9 delete Claim 10 A camera shooting method comprising: analyzing the state of a subject included in an image obtained through the camera; determining a shooting angle based on the analyzed state of the subject; providing a preview image and an image with the determined shooting angle; wherein the state of the subject includes the number, location, size, speed, exposure level of the subject, and whether the subject is registered in an electronic device; wherein the method, when the number of analyzed subjects is two or more, if the two or more subjects are subjects registered in the electronic device, widens the shooting angle; and if the two or more subjects are not subjects registered in the electronic device, does not change the shooting angle. Claim 11 A camera shooting method according to claim 10, wherein an image providing unit receives an image signal from the camera and provides a preview image and an image having at least two angles of view based on at least one of a preview command and a shooting command, an image analysis unit analyzes the state of a subject included in the preview image to determine a shooting angle of view, and an image composition unit generates at least one of the preview command and the shooting command according to the shooting angle of view determined by the image analysis unit. Claim 12 delete Claim 13 In claim 11, the image composition unit prepares a preview pipeline, a first angle of view pipeline, and a second angle of view pipeline in the image providing unit, wherein the first angle of view pipeline is a data processing structure that converts an image signal received from the camera into an image of the first angle of view, and the second angle of view pipeline is a data processing structure that converts an image signal received from the camera into an image of the second angle of view which is a different angle of view from the first angle of view, a camera shooting method. Claim 14 delete Claim 15 A camera shooting method according to claim 13, wherein the image providing unit changes the data processing structure from at least one of the first angle of view pipeline and the second angle of view pipeline to the other of the first angle of view pipeline and the second angle of view pipeline based on the shooting command, and continuously receives an image signal from the camera during the changing process to provide the preview image without interruption. Claim 16 In claim 11, the image analysis unit determines the shooting angle based on the number, location, size, and exposure degree of subjects included in the preview image. Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete

Images