Method for providing image and electronic device for supporting same

Abstract

An electronic device according to an embodiment may comprise a microphone, a camera, a display, at least one processor including a processing circuit, and a memory for storing instructions. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to, on the basis of a camera application being executed, track, using sound acquired through the microphone, a direction of a sound source that generates the sound. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to, on the basis of the tracking, determine a first time point at which the sound source is to enter a field-of-view area of the camera and a direction of the sound source at the first time point. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to, on the basis of an image acquired at a second time point corresponding to the first time point through the camera, acquire a direction of a subject at the second time point corresponding to an area where movement has been detected in the image. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to, on the basis that the determined direction of the sound source corresponds to the acquired direction of the subject, control a setting of the camera on the basis of the area.

Description

Method for providing images and electronic devices supporting the same

[0001] The present disclosure relates to a method for providing an image and an electronic device supporting the same.

[0002] Humans can understand and perceive the real world through the five senses: sight, touch, hearing, smell, and taste. Among the five senses, sight and hearing are more important than touch, smell, and taste, and the combination of sight and hearing has complementary characteristics. For example, while sight is precise and accurate, its detection range is limited to a certain field of view at close range and can be sensitive to lighting conditions during the day and night. Conversely, hearing has the advantage of being able to detect events from relatively far away and is not restricted by day or night, but it can suffer from the precision of location estimation and the accuracy of event analysis.

[0003] An electronic device can acquire an image through a camera based on camera settings set based on user input. For example, the electronic device can display a preview image acquired through a camera while a camera application is running. While the preview image is displayed, the electronic device can set camera settings (e.g., focus, exposure) based on a region selected by the user input within the preview image based on a user input (e.g., touch input) input for the preview image. The electronic device can acquire a preview image through the camera based on the set camera settings and display the acquired preview image. While the acquired preview image is displayed, the electronic device can acquire an image (e.g., a captured image) based on the user input.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] A user may want to capture a moving object (e.g., an object, a person, or an animal) that generates sound using the camera of an electronic device in a noisy environment. For example, the user may want to capture a fast-moving object that generates sound, such as a train, fireworks, or a car racing in a car race. In such cases, the user may have difficulty accurately touching the desired area (or object) for camera settings (e.g., focus, exposure) within the preview image captured by the camera. Furthermore, the user may not have enough time to immediately input an input to capture a captured image after touching the desired area for camera settings (e.g., focus, exposure) within the preview image. For example, when the user inputs an input to capture a captured image using the electronic device, the object the user wishes to capture may be outside the camera's field of view (also referred to as the "field of view"). In such cases, the user may have difficulty capturing an image of the object.

[0006] Various embodiments of the present disclosure relate to a method for providing an image, which allows a user to instantly capture a desired image by controlling the settings of a camera based on the direction of a sound source acquired using a sound acquired through a microphone in a noisy environment and the direction of a subject acquired using an image acquired through a camera, and an electronic device supporting the same.

[0007] Various embodiments of the present disclosure can enable an electronic device to capture an image desired by a user in a noisy environment, using not only sight but also hearing (e.g., using an image acquired through a camera and a sound acquired through a microphone).

[0008] The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An electronic device according to one embodiment may include a microphone, a camera, a display, at least one processor including a processing circuit, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to track a direction of a sound source generating a sound using a sound acquired through the microphone based on the execution of a camera application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the tracking, a first point in time at which the sound source enters a field of view area of ​​the camera and a direction of the sound source at the first point in time. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire, based on an image acquired at a second point in time corresponding to the first point in time through the camera, a direction of a subject at a second point in time corresponding to an area in which movement is detected within the image. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to control the settings of the camera based on the area, based on whether the direction of the determined sound source corresponds to the direction of the acquired subject.

[0010] A method for providing an image in an electronic device according to one embodiment may include an operation of tracking a direction of a sound source generating a sound using a sound acquired through a microphone of the electronic device based on execution of a camera application. The method may include an operation of determining, based on the tracking, a first point in time at which the sound source enters a field of view area of ​​a camera of the electronic device, and a direction of the sound source at the first point in time. The method may include an operation of acquiring, based on an image acquired at a second point in time corresponding to the first point in time through the camera, a direction of a subject at the second point in time corresponding to an area in which movement is detected within the image. The method may include an operation of controlling a setting of the camera based on the area, based on the correspondence of the determined direction of the sound source to the acquired direction of the subject.

[0011] An electronic device according to one embodiment may include a microphone, a camera, a display, at least one processor including a processing circuit, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a direction of a sound source generating the sound using a sound acquired through the microphone based on the execution of a camera application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a direction of an object corresponding to an area in which movement is detected within the image based on the image through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control a setting of the camera based on a correspondence between the direction of the acquired sound source and the direction of the acquired object.

[0012] In one embodiment, a non-transitory computer-readable storage medium having computer-executable instructions recorded thereon may cause an electronic device, when individually or collectively executed by at least one processor, to track a direction of a sound source generating a sound using a sound acquired through a microphone of the electronic device based on a camera application being executed. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to determine, based on the tracking, a first point in time at which the sound source enters a field of view of a camera of the electronic device and a direction of the sound source at the first point in time. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to acquire, based on an image acquired at a second point in time corresponding to the first point in time through the camera, a direction of a subject at the second point in time corresponding to an area in which movement is detected within the image. The computer-executable instructions, when executed individually or collectively by at least one processor, may cause the electronic device to control the settings of the camera based on the area, based on whether the direction of the determined sound source corresponds to the direction of the acquired subject.

[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0014] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0015] FIG. 3 is a flowchart illustrating a method for providing an image according to one embodiment.

[0016] FIG. 4 is a drawing for explaining a method for determining a direction of a sound source at a first point in time and at a first point in time, according to one embodiment.

[0017] FIG. 5 is a drawing for explaining a method for obtaining the direction of a subject at a second point in time according to one embodiment.

[0018] FIG. 6 is a flowchart illustrating a method for providing an image according to one embodiment.

[0019] FIG. 7 is a diagram illustrating a method for providing an image according to one embodiment.

[0020] FIG. 8 is a diagram illustrating a method for providing an image according to one embodiment.

[0021] FIG. 9 is a diagram illustrating a method for providing an image according to one embodiment.

[0022] FIG. 10 is a flowchart illustrating a method for providing an image according to one embodiment.

[0023] FIG. 11 is a diagram illustrating a method for providing an image according to one embodiment.

[0024] FIG. 12 is a flowchart illustrating a method for providing an image according to one embodiment.

[0025] FIG. 13 is a drawing for explaining a method for providing an image according to one embodiment.

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.

[0027] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0050] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0051] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0052] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0053] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0054] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0055] FIG. 2 is a block diagram of an electronic device (201) according to one embodiment.

[0056] Referring to FIG. 2, in one embodiment, the electronic device (201) may be the electronic device (101) of FIG. 1.

[0057] In one embodiment, the electronic device (201) may include a microphone (210), a camera (220), a display (230), memory (240), and / or a processor (250).

[0058] In one embodiment, a microphone (210) (also referred to as a “microphone”) may be included in the input module (150) of FIG. 1.

[0059] In one embodiment, the microphone (210) may include three or more microphones. For example, the microphone (210) may include three microphones positioned at different locations on the electronic device (201). For example, the microphone (210) may include three microphones positioned at different locations on the electronic device (201) facing different directions. However, the present invention is not limited thereto.

[0060] In one embodiment, a microphone (210) can acquire sound coming from a sound source (hereinafter referred to as a "sound source") that generates sound. Based on the acquired sound, the direction of the sound source can be acquired (or determined). The operation of acquiring the direction of the sound source based on the sound acquired through the microphone (210) will be described below.

[0061] In one embodiment, the camera (220) may be included in the camera module (180) of FIG. 1.

[0062] In one embodiment, the camera (220) may acquire an image (hereinafter referred to as a “preview image”) to be displayed as a preview based on the execution of the camera application. The camera (220) may acquire a capture image (hereinafter also referred to as a “capture image”) (e.g., a still image) based on a user input (or when a specified condition is satisfied) while the preview image is displayed through the display (230).

[0063] In one embodiment, the display (230) may be included in the display module (160) of FIG. 1.

[0064] In one embodiment, the display (230) may display a preview image and / or a captured image.

[0065] In one embodiment, the memory (240) may be included in the memory (130) of FIG. 1.

[0066] In one embodiment, the memory (240) may store information for performing an operation to provide an image. For example, the memory (240) may store instructions for performing an operation to provide an image when executed by the processor (250).

[0067] In one embodiment, the processor (250) may be included in the processor (120) of FIG. 1.

[0068] In one embodiment, a processor (250) (e.g., a processor including "processing circuitry") may control the overall operation of providing an image. In one embodiment, the processor (250) may include one or more processors (250) for providing an image. For example, the processor (250) may correspond to multiple processors that divide (or individually) or collectively perform multiple operations among the processors (250). The operation of the processor (250) for providing an image will be described in detail below with reference to FIGS. 3 to 13.

[0069] Although the electronic device (201) in FIG. 2 is illustrated as including a microphone (210), a camera (220), a display (230), a memory (240), and / or a processor (250), the present invention is not limited thereto. For example, the electronic device (201) may further include at least one component (e.g., a sensor module (176)) among one or more components of the electronic device (101) illustrated in FIG. 1.

[0070] FIG. 3 is a flowchart (300) for explaining a method of providing an image according to one embodiment.

[0071] Referring to FIG. 3, in operation 301, in one embodiment, the processor (250) may track the direction of a sound source generating the sound using the sound acquired through the microphone (210) based on the execution of the camera application.

[0072] In one embodiment, the processor (250) may execute a camera application based on user input. Based on the execution of the camera application, the processor (250) may acquire an image through the camera (220). The processor (250) may display the acquired image as a preview image through the display (230).

[0073] In one embodiment, the processor (250) may acquire sound through the microphone (210) based on the execution of the camera application. The processor (250) may acquire (e.g., calculate) the direction of the sound source generating the sound based on the sound acquired through the microphone (210).

[0074] In one embodiment, when multiple sounds are acquired through the microphone (210), the processor (250) may acquire the direction of a sound source based on the loudest sound among the multiple sounds. For example, when multiple sounds are acquired through the microphone (210), the processor (250) may acquire the direction of a sound source corresponding to the loudest sound among the multiple sounds, excluding other sounds.

[0075] In one embodiment, when a plurality of sounds including a user's (e.g., a user of an electronic device (201)) sound are acquired through a microphone (210), the processor (250) may obtain a direction of a sound source based on the remaining sounds excluding the user's sound among the plurality of sounds. For example, when a plurality of sounds are acquired through the microphone (210), the processor (250) may determine whether the user's sound is included in the plurality of sounds based on the user's vocal tract. When the user's sound is included in the plurality of sounds, the processor (250) may obtain a direction of a sound source based on the remaining sounds excluding the user's sound among the plurality of sounds.

[0076] In one embodiment, the direction of the sound source may be the direction of the sound source relative to the direction in which the camera (220) is facing (e.g., an axis passing through the center of the lens of the camera (220) and / or the center of the image sensor, also referred to as the “optical axis of the camera (220)”) (hereinafter referred to as the “relative direction of the sound source”).

[0077] In one embodiment, the relative direction of the sound source can be obtained based on the direction in which the optical axis of the camera (220) faces and the absolute direction of the sound source, based on the position of the camera (220).

[0078] In one embodiment, the absolute direction of the sound source (hereinafter referred to as “the absolute direction of the sound source”) may be the direction in which the position of the electronic device (201) (e.g., the position of the camera (220) and / or the position of the microphone (210)) faces the position of the sound source (or the direction in which the position of the sound source faces the position of the electronic device (201). For example, the absolute direction of the sound source may be the direction in which the position of the camera (220) faces the position of the sound source on a virtual line connecting the position of the camera (220) and the position of the sound source.

[0079] In one embodiment, the processor (250) can track the direction of a sound source (e.g., the relative direction of the sound source) by obtaining the direction of the sound source (e.g., the relative direction of the sound source) at specified time intervals (e.g., at specified cycles). For example, the processor (250) can track the directions of the sound source (e.g., the relative directions of the sound source) at each of a plurality of points in time by obtaining the direction of the sound source at specified time intervals.

[0080] In one embodiment, the processor (250) may acquire sound through the microphone (210) at the specified time interval. The processor (250) may calculate the direction of the sound source (e.g., the relative direction of the sound source) at the specified time interval based on the sound acquired at the specified time interval. In the above example, the time interval for acquiring sound through the microphone (210) and the time interval for calculating the direction of the sound source (e.g., the relative direction of the sound source) are described as being the same, but are not limited thereto. The time interval for acquiring sound through the microphone (210) and the time interval for calculating the direction of the sound source (e.g., the relative direction of the sound source) may not be the same. For example, the processor (250) may acquire sound through the microphone (210) at a first time interval. The processor (250) may calculate the direction of the sound source (e.g., the relative direction of the sound source) at a second time interval calculated by multiplying the first time interval by a specified integer.

[0081] In one embodiment, the processor (250) can obtain a plurality of directions of the sound source (e.g., a plurality of relative directions of the sound source) corresponding to each of a plurality of time points by calculating the direction of the sound source (e.g., a plurality of relative directions of the sound source) at the specified time interval.

[0082] In one embodiment, the processor (250) may obtain (e.g., calculate) the direction of a sound source (e.g., the absolute direction of the sound source) using three microphones (or four microphones).

[0083] In one embodiment, the processor (250) may calculate the direction of the sound source (e.g., the absolute direction of the sound source) based on the differences in the times at which the three microphones acquire sound, respectively (e.g., the time delay of arrival (TDOA)). For example, if the electronic device (201) includes a first microphone, a second microphone, and a third microphone, the processor (250) may set three coordinates corresponding to the position of the first microphone, the position of the second microphone, and the position of the third microphone, respectively, within a coordinate system having the position of the camera (220) as the origin. The processor (250) may calculate the differences in the times at which the first microphone, the second microphone, and the third microphone acquire sound from each other based on the sound (e.g., the frequency of the sound) acquired from the sound source by the first microphone, the second microphone, and the third microphone. The processor (250) can calculate the direction of the sound source (e.g., the absolute direction of the sound source) based on the differences between the three coordinates set above and the calculated times.

[0084] In one embodiment, the electronic device (201) may include three microphones positioned at different locations on the electronic device (201) and facing in different directions (or facing in different directions and having unidirectionality). The processor (250) may calculate the direction of a sound source (e.g., the absolute direction of the sound source) based on the loudness (and frequencies) of sounds captured by the three microphones.

[0085] However, the operation of obtaining the direction of the sound source (e.g., the absolute direction of the sound source) using three microphones is not limited to the examples described above. For example, if the electronic device (201) includes four microphones positioned at different locations of the electronic device (201), the processor (250) can calculate the location of the sound source (e.g., the coordinates of the sound source) using the four microphones. The processor (250) can calculate the direction of the sound source (e.g., the absolute direction of the sound source) based on the calculated location of the sound source.

[0086] In one embodiment, the processor (250) can obtain the direction of the sound source relative to the direction in which the optical axis of the camera (220) is directed, based on the absolute direction of the sound source and the direction in which the optical axis of the camera (220) is directed.

[0087] Hereinafter, for convenience of explanation, the direction of a sound source may refer to the relative direction of the sound source.

[0088] In one embodiment, while an operation of providing an image is performed, the direction in which the optical axis of the camera (220) faces may change due to the rotation (and movement) of the electronic device (201). In this case, the processor (250) may detect the degree of change in the direction in which the optical axis of the camera (220) faces based on sensing data acquired through an inertial sensor (e.g., an acceleration sensor, a gyro sensor, and / or a geomagnetic sensor). The processor (250) may acquire the direction in which the optical axis of the camera (220) faces at the time of acquiring the direction of the sound source based on the first optical axis direction in which the optical axis of the camera (220) faces at a reference time (e.g., a time of executing a camera application) and the sensing data acquired through the inertial sensor. The processor (250) may acquire the relative direction of the sound source based on the direction in which the optical axis of the camera (220) faces at the time of acquiring the direction of the sound source and the absolute direction of the sound source at the time. In the following, for convenience of explanation, it is assumed that the direction in which the optical axis of the camera (220) faces does not change over time.

[0089] In operation 303, in one embodiment, the processor (250) can determine, based on the tracking, a point in time when the sound source enters the field of view of the camera (220) (hereinafter referred to as “first point in time”) and the direction of the sound source at the first point in time.

[0090] In one embodiment, the processor (250) may perform operation 303 based on the absence of a subject having a direction corresponding to the direction of the sound source. For example, the processor (250) may use image frames (e.g., preview images) sequentially acquired through the camera (220) based on the execution of the camera application (e.g., through motion detection between the image frames) to determine whether a moving subject (e.g., a moving subject) exists within the field of view (also referred to as “field of view”) of the camera (220). If it is determined that no moving subject exists within the field of view of the camera (220), the processor (250) may determine that no subject exists having a direction corresponding to the direction of the sound source. If it is determined that a moving subject exists within the field of view of the camera (220), the processor (250) may obtain the direction of the subject. The operation of obtaining the direction of the subject will be described in detail later. The processor (250) can determine whether the direction of the sound source corresponds to the direction of the acquired subject. Based on the determination that the direction of the sound source does not correspond to the direction of the acquired subject, the processor (250) can determine that there is no subject having a direction corresponding to the direction of the sound source. The operation performed by the processor (250) when the direction of the sound source is determined to correspond to the direction of the acquired subject will be described below. Hereinafter, the operation of determining the direction of the sound source at the first time point and at the first time point will be described with reference to FIG. 4.

[0091] FIG. 4 is a drawing for explaining a method for determining a direction of a sound source at a first point in time and at a first point in time, according to one embodiment.

[0092] Referring to FIG. 4, in one embodiment, reference numeral 410 in FIG. 4 may indicate the position of the camera (220) (and microphone (210)), and reference numeral 420 may indicate a field of view area determined by lines (421, 422).

[0093] In one embodiment, in FIG. 4, reference numeral 430 may represent the position of a sound source at a first time point, and reference numerals 430-1, 430-2, and 430-3 may represent positions of sound sources acquired at time points of a specified time interval prior to the first time point, respectively. For example, the sound source may be sequentially located at position (430-3), position (430-2), and position (430-1) according to a specified time interval prior to the first time point, as indicated by arrow (450).

[0094] In one embodiment, the processor (250) can obtain the directions of the sound source at each of the points in time prior to the first point in time by tracking the direction of the sound source. For example, in FIG. 4, the processor (250) can obtain the directions of the sound source (440-1, 440-2, 440-3) at points in time prior to the first point in time by tracking the direction of the sound source.

[0095] In one embodiment, the processor (250) may predict the direction of the sound source at the first time point and the first time point based on the directions of the sound source acquired at each of the time points prior to the first time point (and / or changes in the directions of the sound source acquired at each of the time points prior to the first time point). For example, the processor (250) may predict the direction (440) of the sound source at the first time point and the first time point based on the directions of the sound source acquired at each of the time points prior to the first time point using a designated algorithm or artificial intelligence model.

[0096] In one embodiment, in FIG. 4, the processor (250) can determine a first point in time at which the sound source is predicted to move from outside the field of view area (420) to inside the field of view area (420), and a direction (440) of the sound source predicted to be acquired at the first point in time, based on the directions of the sound source acquired at each of the points in time prior to the first point in time (e.g., directions of the sound source (440-1, 440-2, 440-3)).

[0097] In operation 305, the processor (250) can obtain the direction of the subject at the second point in time corresponding to the area where movement is detected within the image based on an image obtained at the point in time corresponding to the first point in time (hereinafter also referred to as the “second point in time”) through the camera (220).

[0098] In one embodiment, the second point in time may be substantially the same as the first point in time at which the subject is determined (e.g., predicted) to enter the field of view of the camera (220) via operation 303.

[0099] In one embodiment, the second time point may be a time point within a time range that includes the first time point. For example, the second time point may be a time range that includes a time point before a specified time from the first time point to a time point after a specified time from the first time point.

[0100] Hereinafter, with reference to Fig. 5, the operation of obtaining the direction of the subject at the second point in time will be described.

[0101] FIG. 5 is a drawing for explaining a method for obtaining the direction of a subject at a second point in time according to one embodiment.

[0102] Referring to FIG. 5, in one embodiment, in reference numeral 501, reference numeral 510 may represent an image acquired through the camera (220) at a time point immediately prior to the second time point (hereinafter referred to as “the second-first time point”). In one embodiment, in reference numeral 502, reference numeral 520 may represent an image acquired through the camera (220) at the second time point.

[0103] In one embodiment, the processor (250) may divide the image (510) and the image (520) into a plurality of regions (also referred to as “patches” or “blocks”), as illustrated by reference numerals 501 and 502. For example, the image (510) may be divided into a plurality of regions (e.g., a plurality of regions including regions (521, 522, 531, 532, 533, and 534)). The image (520) may be divided into a plurality of regions (e.g., a plurality of regions including regions (531-1, 532-1, 533-1, and 534-1)). Comparing reference numerals 501 and 502, the locations of the regions of the image (510) and the locations of the regions of the image (520) may correspond to each other. For example, the positions of areas (531, 532, 533, 534) of the image (510) may correspond to the positions of areas (531-1, 532-1, 533-1, 534-1) of the image (520), respectively.

[0104] In one embodiment, reference numerals 511 and 512 may represent centers (locations of centers) of image (510) and image (520), respectively.

[0105] In one embodiment, the processor (250) can determine an area where motion is detected (hereinafter referred to as a “area where motion is detected”) by comparing an image (e.g., image (510)) acquired at a second point in time with an image (e.g., image (520)) acquired at a second point in time. For example, the processor (250) can confirm that the image (510) acquired at a second point in time does not include areas corresponding to a subject. The processor (250) can confirm that the image (520) acquired at a second point in time includes areas (531-1, 532-1, 533-1, 534-1) corresponding to a subject (e.g., areas including a portion (540) corresponding to a subject). The processor (250) may determine the areas (531-1, 532-1, 533-1, 534-1) as areas where motion is detected. In the above example, it is described that the image (510) acquired at time 2-1 does not include areas corresponding to the subject, but this is not limited thereto. For example, if the image (510) acquired at time 2-1 includes areas corresponding to the subject, the processor (250) may determine the areas (531-1, 532-1, 533-1, 534-1) as areas where motion is detected by comparing the areas corresponding to the subject in the image (510) acquired at time 2-1 and the areas corresponding to the subject in the image (520) acquired at time 2.

[0106] In one embodiment, the processor (250) may obtain (e.g., calculate) the direction of the subject corresponding to the area where the motion is detected based on the area where the motion is detected and the image acquired at the second point in time. For example, in reference numeral 502, the ratio of the angle between the direction of the camera (220) and the direction of the subject with respect to the angle obtained by dividing the angle of view of the camera (220) by 2 (angle of view / 2) may be substantially equal to the ratio of the distance (d1) between the center (512) of the image (520) and the center (551) of the area where the motion is detected with respect to the distance (d2) between the location of the corner of the image (520) from the center (512) of the image (520). The processor (250) can obtain the direction of the subject corresponding to the area where the movement is detected (e.g., the relative direction of the subject with respect to the direction in which the camera (220) is facing) based on the direction in which the camera (220) is facing, the angle of view of the camera (220), and the coordinates of the area where the movement is detected within the image (520) (e.g., the coordinates of the center (551)).

[0107] In one embodiment, the processor (250) may perform an operation of acquiring the direction of the subject at the second time point based on determining that there is an area in which motion is detected within the image acquired at the second time point. The processor (250) may not perform an operation of acquiring the direction of the subject at the second time point based on determining that there is no area in which motion is detected within the image acquired at the second time point.

[0108] In operation 307, in one embodiment, the processor (250) may control the settings of the camera (220) based on the area where the motion is detected, based on whether the determined direction of the sound source corresponds to the direction of the acquired subject. For example, the processor (250) may adjust the settings of the camera (220) based on the area where the motion is detected, based on whether the direction of the sound source at the first time point predicted through operation 303 (hereinafter referred to as the “first direction of the sound source”) corresponds to the direction of the subject (e.g., the subject corresponding to the area where the motion is detected) at the second time point acquired through operation 305 (hereinafter referred to as the “first direction of the subject”).

[0109] In one embodiment, the processor (250) may compare a first direction of a sound source and a first direction of a subject. Based on confirmation that the first direction of the sound source and the first direction of the subject are the same, the processor (250) may determine that the first direction of the sound source corresponds to the first direction of the subject. Based on confirmation that the first direction of the sound source and the first direction of the subject are not the same, the processor (250) may determine that the first direction of the sound source does not correspond to the first direction of the subject. However, the present invention is not limited thereto. For example, the processor (250) may compare a difference between the first direction of the sound source and the first direction of the subject with a threshold value. Based on confirmation that the difference between the first direction of the sound source and the first direction of the subject is less than or equal to the threshold value, the processor (250) may determine that the first direction of the sound source corresponds to the first direction of the subject. The processor (250) can determine that the first direction of the sound source does not correspond to the first direction of the subject based on a difference between the first direction of the sound source and the first direction of the subject exceeding a threshold value.

[0110] In one embodiment, the processor (250) may determine that the sound source and the subject are the same object based on the first direction of the sound source corresponding to the first direction of the subject. The processor (250) may determine that the sound source and the subject are different objects based on the first direction of the sound source not corresponding to the first direction of the subject.

[0111] In one embodiment, the settings of the camera (220) may include camera settings related to at least one of exposure, focus, or white balance. However, the settings of the camera (220) are not limited to the examples described above.

[0112] In one embodiment, the processor (250) may set the focus of the camera (220) based on an area where motion is detected (e.g., areas (531-1, 532-1, 533-1, 534-1) of FIG. 5) based on whether the first direction of the sound source corresponds to the first direction of the subject. For example, the processor (250) may set the focus of the camera (220) so that the focus is set on an area where motion is detected based on whether the first direction of the sound source corresponds to the first direction of the subject.

[0113] In one embodiment, the processor (250) may set the exposure of the camera (220) based on the area where motion is detected, based on whether the first direction of the sound source corresponds to the first direction of the subject. For example, the processor (250) may assign a higher weight to the area where motion is detected compared to other areas of the image acquired at the second point in time, based on whether the first direction of the sound source corresponds to the first direction of the subject. The processor (250) may set the exposure of the camera (220) based on the brightness value of the area where motion is detected, the weight assigned to the area where motion is detected, the brightness value of the other area, and the weight assigned to the other area.

[0114] In one embodiment, the processor (250) may set the white balance of the camera (220) based on an area where motion is detected, based on whether the first direction of the sound source corresponds to the first direction of the subject. For example, the processor (250) may obtain a color temperature of an area where motion is detected, based on whether the first direction of the sound source corresponds to the first direction of the subject. The processor (250) may set the obtained color temperature as the color temperature of the camera (220) (e.g., a color temperature to be applied to an image to be obtained at a point in time following the second point in time).

[0115] In one embodiment, the processor (250) may control camera settings based on camera settings that are set as default or by user input, based on determining that the first direction of the sound source does not correspond to the first direction of the subject. For example, the processor (250) may set the focus of the camera (220) based on an area touched by the user or an area including the center of the image, based on determining that the first direction of the sound source does not correspond to the first direction of the subject. For example, the processor (250) may assign equal weights to each of the areas of the image acquired at the second time point, based on determining that the first direction of the sound source does not correspond to the first direction of the subject, and may set the exposure of the camera (220) based on the areas of the image acquired at the second time point and the weights. For example, the processor (250) may set (e.g., maintain) a color temperature set by default or by user input as the color temperature of the camera (220) based on the fact that the first direction of the sound source does not correspond to the first direction of the subject.

[0116] In one embodiment, the processor (250) may control the camera settings based on camera settings that are set as default or by user input, based on determining that no area in which motion is detected exists within the image acquired at the second point in time.

[0117] In one embodiment, although the examples described above describe controlling camera settings based on a region where motion is detected based on the first direction of the sound source corresponding to the first direction of the subject, the present invention is not limited thereto. For example, the processor (250) may set an region (e.g., a “first region” to be described later) having the same center as the center (e.g., center (551)) of the region where motion is detected (e.g., regions (531-1, 532-1, 533-1, 534-1)) and having a fixed size. The processor (250) may set the settings of the camera (220) based on the set region.

[0118] In one embodiment, the processor (250) sets the settings of the camera (220) based on the area where the movement is detected based on the correspondence between the first direction of the sound source and the first direction of the subject, and then, based on the set settings of the camera (220), an image can be acquired through the camera (220) at a time point following a second time point. For example, the processor (250) can acquire an image through the camera (220) at a time point immediately following the second time point (e.g., a time point one cycle after the second time point during which the camera (220) acquires an image) or at a time point after a specified time interval from the second time point (e.g., a time point after a time calculated by multiplying the cycle during which the camera (220) acquires an image from the second time point by an integer).

[0119] In one embodiment, the examples described above describe the processor (250) controlling the settings of the camera (220) based on the area where motion is detected based on the correspondence between the first direction of the sound source and the first direction of the subject, but are not limited thereto. In one embodiment, the processor (250) may correct an image acquired through the camera (220) at a second point in time based on the area where motion is detected based on the correspondence between the first direction of the sound source and the first direction of the subject. For example, the processor (250) may adjust the focus, exposure, and / or white balance of an image acquired through the camera (220) at a second point in time based on the area where motion is detected based on the correspondence between the first direction of the sound source and the first direction of the subject.

[0120] In one embodiment, the processor (250) may sequentially display, as a preview, an image acquired through the camera (220) at a second point in time and images acquired through the camera (220) at points in time after the second point in time through the display (230).

[0121] FIG. 6 is a flowchart (600) for explaining a method of providing an image according to one embodiment.

[0122] FIG. 7 is a diagram illustrating a method for providing an image according to one embodiment.

[0123] In one embodiment, the operations of FIG. 6 may be operations performed at points in time after the second point in time, including the second point in time described above. Additionally, the operations of FIG. 6 may be operations performed after the subject enters the field of view of the camera (220) (e.g., when the subject is within the field of view of the camera (220).

[0124] Referring to FIGS. 6 and 7, in operation 601, in one embodiment, the processor (250) may obtain the direction of a sound source using the sound acquired through the microphone (210). For example, the processor (250) may obtain the direction of a sound source using the sound acquired through the microphone (210) at each of the time points after the second time point.

[0125] The operation of obtaining the direction of the sound source of operation 601 is at least partially identical or similar to operation 301 of FIG. 3, so a detailed description thereof will be omitted.

[0126] In operation 603, in one embodiment, the processor (250) may acquire the direction of the subject corresponding to the area where motion is detected within the image based on the image through the camera (220). For example, the processor (250) may acquire the image through the camera (220) at each of the time points after the second time point. The processor (250) may acquire the direction of the subject corresponding to the area where motion is detected based on the acquired image.

[0127] In one embodiment, in reference numeral 701, reference numeral 710 may represent an image acquired through the camera (220) at a time point (hereinafter, referred to as “the 3-1 time point”) immediately before a third time point (hereinafter, referred to as “the 3rd time point”) after the second time point. In one embodiment, in reference numeral 702, reference numeral 720 may represent an image acquired through the camera (220) at the third time point.

[0128] In one embodiment, the processor (250) can segment the image (710) and the image (720) into a plurality of regions, as illustrated by reference numerals 701 and 702. For example, the image (710) can be segmented into a plurality of regions (e.g., a plurality of regions including regions (741, 742, 743, and 744)). The image (720) can be segmented into a plurality of regions (e.g., a plurality of regions including regions (751, 752, 753, and 754)).

[0129] In one embodiment, reference numerals 711 and 712 may represent centers (locations of centers) of image (710) and image (720), respectively.

[0130] In one embodiment, regions (741, 742, 743, 744) may be regions that include a portion (730-1) corresponding to a subject within the image (710). Regions (751, 752, 753, 754) may be regions that include a portion (730-2) corresponding to a subject within the image (720).

[0131] In one embodiment, the processor (250) can determine, at a third point in time, that the regions (751, 752, 753, 754) are regions in which motion was detected by comparing the image (710) and the image (720).

[0132] In one embodiment, the processor (250) can obtain the direction of a subject corresponding to the area where motion is detected (e.g., the relative direction of the subject with respect to the direction in which the camera (220) is facing) based on the direction in which the camera (220) is facing, the angle of view of the camera (220), and the coordinates of the area where motion is detected within the image (720) (e.g., the coordinates of the center (752)).

[0133] In operation 605, in one embodiment, the processor (250) may control the settings of the camera (220) based on the area where the motion is detected, based on whether the direction of the sound source corresponds to the direction of the subject. For example, the processor (250) may adjust the settings of the camera (220) based on the area where the motion is detected (e.g., areas (751, 752, 753, 754)), based on whether the direction of the sound source acquired at a third point in time corresponds to the direction of the subject acquired at the third point in time.

[0134] Since operation 605 is at least partially identical or similar to operation 307 of FIG. 3, a detailed description thereof will be omitted.

[0135] In one embodiment, although not shown in FIG. 6, the processor (250) may perform operations 601 through 605 at multiple points in time (e.g., points in time determined by the cycle at which the camera (220) acquires images).

[0136] In one embodiment, the processor (250) may obtain a capture image based on a user input while performing operations 601 to 605 at each of a plurality of points in time. For example, the processor (250) may display a preview image obtained through the camera (220) based on the camera settings set through operation 605 (and operation 307) while performing operations 601 to 605 at each of a plurality of points in time through the display (230). The processor (250) may obtain a capture image based on a user input (e.g., a touch input to a button to which a function of obtaining a capture image is mapped) while the preview image is displayed through the display (230). However, the present invention is not limited thereto. For example, the processor (250) may confirm that the area where the motion is captured includes the center of the preview image while displaying the preview image. The processor (250) can automatically (e.g., without user input for obtaining a capture image) obtain a capture image based on the area where the motion is captured including the center of the preview image.

[0137] In one embodiment, a function (or mode) performed by the electronic device (201) through an operation of providing an image (e.g., the operations of FIG. 3 and the operations of FIG. 6) may be referred to as a “moment capture function” (or “moment capture mode”).

[0138]

[0139] FIG. 8 is a diagram illustrating a method for providing an image according to one embodiment.

[0140] Referring to FIG. 8, in one embodiment, reference numeral 810 may represent a scene (810) including a moving sound source (820) (e.g., a train).

[0141] In one embodiment, the arrow (821) may indicate the direction in which sound generated from an object (820) of an electronic device (201) is introduced into a microphone (210).

[0142] In one embodiment, the processor (250) may perform the operations of FIG. 3 and FIG. 6 described above. For example, the processor (250) may determine, at each of the viewpoints, whether the direction of the sound source (e.g., the object (820)) corresponds to the direction of the subject (e.g., the object (820)). Based on whether the direction of the sound source (e.g., the object (820)) corresponds to the direction of the subject (e.g., the object (820)), the processor (250) may control the settings of the camera (220) based on a portion (e.g., an area where movement is detected) corresponding to the subject (e.g., the object (820)) within the images (e.g., the preview image (821)) acquired through the camera (220) corresponding to the viewpoints.

[0143] In one embodiment, in FIG. 8, an arrow (840) may indicate the direction in which the area in which motion is detected moves based on the setting of the camera (220) within the preview image (821).

[0144] FIG. 9 is a diagram illustrating a method for providing an image according to one embodiment.

[0145] Referring to FIG. 9, in one embodiment, as described above, the processor (250) may set an area (hereinafter referred to as a “first area”) having the same center as the center (e.g., center (551)) of the area where the movement is detected (e.g., areas (531-1, 532-1, 533-1, 534-1)) and having a fixed size. The processor (250) may set the settings of the camera (220) based on the set area.

[0146] In one embodiment, the processor (250) may display an indication (also referred to as an “object” or a “user interface”) representing the first area, images acquired through the camera (220).

[0147] In one embodiment, in FIG. 9, the processor (250) may display an indication (931) indicating a first area corresponding to an area (920) in which movement is detected (e.g., an area in which the direction of a sound source and the direction of a moving subject correspond and movement is detected) on the preview image (910) through the display (230). In FIG. 9, the indications (932, 633, 634, 935) may indicate first areas corresponding to areas in which movement was detected in the direction indicated by the arrow (940). The processor (250) may display indications indicating the first areas through the display (230) at each point in time, thereby allowing the user to know that the electronic device (201) is performing an operation of providing an image.

[0148] FIG. 10 is a flowchart (1000) illustrating a method for providing an image according to one embodiment.

[0149] FIG. 11 is a diagram illustrating a method for providing an image according to one embodiment.

[0150] In one embodiment, the operations of FIG. 10 may include operations performed in addition to operations 303, 305, and 307 of FIG. 3 or operations performed in place of operations 303, 305, and 307 of FIG. 3.

[0151] Referring to FIGS. 10 and 11, in operation 1001, in one embodiment, the processor (250) may determine an area in which motion is to be detected within an image acquired through the camera (220) at a first point in time and a second point in time.

[0152] In one embodiment, the processor (250) may perform an operation (e.g., operation 301 of FIG. 3) of tracking the direction of a sound source that generates the sound using a sound acquired through a microphone (210) based on the execution of a camera application.

[0153] In one embodiment, the processor (250) can predict a first point in time when the sound source enters the field of view area of ​​the camera (220) and an area in which movement is to be detected within an image acquired through the camera (220) at the first point in time by performing an operation of tracking the direction of the sound source.

[0154] In one embodiment, in reference numeral 1001 of FIG. 11, reference numeral 1110 may represent an image to be acquired through a camera (220) at a first point in time. The image (1110) may include a plurality of segmented regions (e.g., a plurality of regions including regions (1121, 1122, 1123, 1124)). The processor (250) may predict a region (1120) in which motion is to be detected (e.g., a region including regions (1121, 1122, 1123, 1124)) within the image (1110) by performing an operation of tracking the direction of a sound source.

[0155] In operation 1003, in one embodiment, the processor (250) may acquire an area in which motion is detected based on an image acquired through the camera (220) at a second time corresponding to the first time.

[0156] In one embodiment, in reference numeral 1102 of FIG. 11, reference numeral 1120 may include a plurality of segmented regions (e.g., a plurality of regions including regions (1121, 1122, 1123, 1124)).

[0157] In one embodiment, the processor (250) may acquire, based on the image (1120) (and images acquired prior to the time at which the image (1120) was acquired), an area (1130) within the image (1120) in which motion is to be detected (e.g., an area including areas (1121-1, 1122-1, 1123-1, 1124-1, 1125, 1126)).

[0158] In operation 1005, in one embodiment, the processor (250) may control the settings of the camera (220) based on the second area, based on the area where the motion is detected (hereinafter referred to as the “second area”) acquired through operation 1003 corresponding to the area where the motion is determined to be detected (hereinafter referred to as the “third area”) through operation 1001.

[0159] In one embodiment, the processor (250) may determine that the second region corresponds to the third region based on whether at least a portion of the second region overlaps with the third region. For example, in FIG. 11, the processor (250) may determine that the positions of regions (1122-1, 1124-1) included in the region (1130) as the second region correspond to (e.g., are the same as) the positions of regions (1122, 1124) included in the region (1120) as the third region. The processor (250) may determine that the regions (1122-1, 1124-1) included in the region (1130) as the second region overlap with the regions (1122, 1124) included in the region (1120) as the third region. The processor (250) can determine that the second region corresponds to the third region based on the determination that a portion (1122, 1124) of the region (1130) overlaps a portion (1122-1, 1124-1) of the region (1120).

[0160] In one embodiment, the processor (250) can control the settings of the camera (220) based on the second area, based on determining that the second area corresponds to the third area.

[0161] In one embodiment, the operation of controlling the settings of the camera (220) based on the second area is at least partially the same or similar to the operation of controlling the settings of the camera (220) based on the area where the movement of operation 307 of FIG. 3 is detected, so a detailed description thereof will be omitted.

[0162] In one embodiment, although not illustrated in FIG. 10, in operation 1001, the processor (250) may determine (e.g., predict) a direction of a sound source (e.g., a first direction of the sound source) at a first point in time, a third area, and a first point in time. In operation 1003, the processor (250) may obtain a second area and a direction of a subject (e.g., a first direction) based on the second area. In operation 1005, the processor (250) may control a setting of the camera (220) based on the third area based on the correspondence between the second area and the third area and the correspondence between the first direction of the sound source and the first direction of the subject. The processor (250) can set the camera (220) based on camera settings set by default or by user input, based on whether the second area and the third area do not correspond, or whether the first direction of the sound source and the first direction of the subject do not correspond.

[0163] FIG. 12 is a flowchart (1200) illustrating a method of providing an image according to one embodiment.

[0164] In one embodiment, although FIG. 3 illustrates that operations 301 and 303 are performed when a subject having a direction corresponding to the direction of the sound source does not exist within the field of view of the camera (220), the present invention is not limited thereto. For example, the processor (250) may not perform operations 301 and 303 when a subject having a direction corresponding to the direction of the sound source does not exist within the field of view of the camera (220). The processor (250) may acquire the direction of the sound source and the direction of the subject at each of the time points while the instant capture function is executed, regardless of whether the subject having a direction corresponding to the direction of the sound source exists within the field of view of the camera (220). The processor (250) may control the camera settings by comparing the acquired direction of the sound source and the acquired direction of the subject at each of the time points.

[0165] Referring to FIG. 12, in operation 1201, in one embodiment, the processor (250) may obtain the direction of a sound source using the sound acquired through the microphone (210). For example, the processor (250) may obtain the direction of a sound source using the sound acquired through the microphone (210) while displaying a preview image through the display (230) based on the execution of the instantaneous capture function.

[0166] The operation of obtaining the direction of the sound source of operation 1201 is at least partially identical or similar to operation 301 of FIG. 3, so a detailed description thereof will be omitted.

[0167] In operation 1203, in one embodiment, the processor (250) may acquire the direction of the subject corresponding to the area where motion is detected within the image based on the image through the camera (220). For example, the processor (250) may acquire an image (e.g., a preview image) through the camera (220) based on the execution of the instantaneous capture function. The processor (250) may acquire the direction of the subject corresponding to the area where motion is detected based on the acquired image.

[0168] Action 1203 is at least partially identical or similar to Action 603, so a detailed description thereof will be omitted.

[0169] In operation 1205, in one embodiment, the processor (250) may control the settings of the camera (220) based on the area where the motion is detected, based on whether the direction of the sound source corresponds to the direction of the subject.

[0170] Action 1205 is at least partially identical or similar to Action 605, so a detailed description thereof will be omitted.

[0171] FIG. 13 is a drawing for explaining a method for providing an image according to one embodiment.

[0172] Referring to FIG. 13, in one embodiment, the electronic device (201) may be a wearable electronic device (201), such as an augmented reality glass (AR glass), a virtual reality glass (VR glass), or a head mounted display (HMD) device.

[0173] In one embodiment, reference numeral 1310 in FIG. 13 may represent a screen displayed on an electronic device (201) (e.g., a video see through (VST) device).

[0174] In one embodiment, the processor (250) may display a screen (1310) including a portion corresponding to a subject (and a sound source) based on an image acquired through the display (230) while the instant capture function is being executed. In FIG. 13, reference numeral 1322 may indicate a portion corresponding to a subject (and a sound source) displayed through the display (230) at a third point in time, and reference numeral 1331 may indicate a portion corresponding to a subject (and a sound source) displayed through the display (230) at a point in time following the third point in time.

[0175] In one embodiment, the processor (250) can obtain a capture image by recognizing a user gesture (e.g., a user's hand corresponding to a portion (1330)) to which a function for capturing an image is mapped while the screen (1310) is displayed through the display (230).

[0176] An electronic device (201) according to one embodiment may include a microphone (210), a camera (220), a display (230), at least one processor (250) including a processing circuit, and a memory (240) storing instructions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to track a direction of a sound source generating a sound using a sound acquired through the microphone (210) based on the execution of a camera application. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine a first point in time at which the sound source enters a field of view area of ​​the camera (220) and a direction of the sound source at the first point in time based on the tracking. The above commands, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to obtain, based on an image acquired at a second time point corresponding to the first time point through the camera (220), a direction of an object at a second time point corresponding to an area in which movement is detected within the image. The above commands, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to control a setting of the camera (220) based on the area, based on the correspondence of the determined direction of the sound source to the acquired direction of the object.

[0177] In one embodiment, the camera settings may include camera settings related to at least one of exposure, focus, and white balance. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to adjust the settings of the camera (220) based on the area, based on whether the direction of the determined sound source corresponds to the direction of the acquired subject, and then acquire an image through the camera (220) based on the adjusted settings of the camera (220).

[0178] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine, based on the tracking, a first area in which motion corresponding to the motion of the sound source is to be detected within an image acquired at the first point in time through the camera (220) and the first point in time. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to acquire the area in which the motion is detected within the image acquired at the second point in time through the camera (220). The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to control a setting of the camera (220) based on the acquired area, based on the acquired area corresponding to the determined first area.

[0179] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may further cause the electronic device (201) to control the settings of the camera (220) and then obtain a direction of the sound source using the sound acquired through the microphone (210). The instructions, when individually or collectively executed by the at least one processor (250), may further cause the electronic device (201) to control the settings of the camera (220) and then obtain a direction of the subject corresponding to a second area in which movement is detected within the image based on an image acquired through the camera (220). The above commands, when executed individually or collectively by the at least one processor (250), may further cause the electronic device (201) to control the settings of the camera (220), and then control the settings of the camera (220) based on the second area in which movement is detected within the image, based on whether the direction of the acquired subject corresponds to the direction of the acquired sound source.

[0180] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to acquire a third region having a center coextensive with the center of the region and a specified size, based on whether the direction of the sound source corresponds to the direction of the subject. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to control the settings of the camera (220) based on the third region.

[0181] In one embodiment, the instructions, when executed individually or collectively by the at least one processor (250), may further cause the electronic device (201) to display, through the display (230), an indication indicating the first area on an image acquired through the camera (220).

[0182] In one embodiment, the instructions, when executed individually or collectively by the at least one processor (250), may further cause the electronic device (201) to set the camera (220) to a default setting or a setting set by user input based on the direction of the sound source not corresponding to the direction of the subject.

[0183] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to acquire a plurality of sounds through the microphone (210) based on the execution of the camera application. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to track the direction of a sound source based on a sound having a loudest volume among the plurality of sounds.

[0184] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may further cause the electronic device (201) to segment the image into a plurality of regions. The instructions, when individually or collectively executed by the at least one processor (250), may further cause the electronic device (201) to acquire a region within the plurality of regions in which the motion is detected based on the image and an image acquired at a time point prior to the second time point.

[0185] A method for providing an image in an electronic device (201) according to one embodiment may include an operation of tracking a direction of a sound source generating a sound using a sound acquired through a microphone (210) of the electronic device (201) based on execution of a camera application. The method may include an operation of determining a first point in time when the sound source enters a field of view area of ​​a camera (220) of the electronic device (201) and a direction of the sound source at the first point in time based on the tracking. The method may include an operation of acquiring a direction of a subject at a second point in time corresponding to an area in which movement is detected within the image based on an image acquired at a second point in time corresponding to the first point in time through the camera (220). The method may include an operation of controlling a setting of the camera (220) based on the area, based on the correspondence of the determined direction of the sound source to the acquired direction of the subject.

[0186] In one embodiment, the camera settings may include camera settings related to at least one of exposure, focus, and white balance. The method may further include adjusting the settings of the camera (220) based on the area based on whether the direction of the determined sound source corresponds to the direction of the acquired subject, and then acquiring an image through the camera (220) based on the adjusted settings of the camera (220).

[0187] In one embodiment, the method may further include an operation of determining, based on the tracking, a first region in which a movement corresponding to the movement of the sound source is to be detected within an image acquired at the first time point through the camera (220) and the first time point. The method may further include an operation of acquiring, within the image acquired at the second time point through the camera (220), the region in which the movement is detected. The method may further include an operation of controlling a setting of the camera (220) based on the acquired region, based on whether the acquired region corresponds to the determined first region.

[0188] In one embodiment, the method may further include an operation of obtaining the direction of the sound source using the sound acquired through the microphone (210) after performing an operation of controlling the settings of the camera (220). The method may further include an operation of obtaining, based on an image acquired through the camera (220), the direction of the subject corresponding to a second area in which movement is detected within the image, after performing an operation of controlling the settings of the camera (220). The method may further include an operation of controlling the settings of the camera (220) based on the second area in which movement is detected within the image, based on the correspondence of the acquired direction of the subject to the acquired direction of the sound source, after performing an operation of controlling the settings of the camera (220).

[0189] In one embodiment, the operation of controlling the settings of the camera (220) based on the area may further include an operation of obtaining a third area having the same center as the center of the area and a specified size based on whether the direction of the sound source corresponds to the direction of the subject. The operation of controlling the settings of the camera (220) based on the area may further include an operation of controlling the settings of the camera (220) based on the third area.

[0190] In one embodiment, the method may further include an operation of displaying an indication indicating the third area on an image acquired through the camera (220) through a display (230) of the electronic device (201).

[0191] In one embodiment, the method may further include setting the camera (220) to a default setting or a setting set by user input, based on the direction of the sound source not corresponding to the direction of the subject.

[0192] In one embodiment, the operation of tracking the direction of the sound source may include an operation of acquiring a plurality of sounds through the microphone (210) based on the execution of the camera application. The operation of tracking the direction of the sound source may include an operation of tracking the direction of the sound source based on a sound having the largest volume among the plurality of sounds.

[0193] In one embodiment, the method may further include an operation of dividing the image into a plurality of regions. The method may further include an operation of acquiring a region in which the motion is detected within the plurality of regions based on the image and an image acquired at a time point prior to the second time point.

[0194] An electronic device (201) according to one embodiment may include a microphone (210), a camera (220), a display (230), at least one processor (250) including a processing circuit, and a memory (240) storing instructions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to obtain a direction of a sound source generating a sound using a sound obtained through the microphone (210) based on the execution of a camera application. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to obtain a direction of a subject corresponding to an area in which movement is detected within the image based on the image through the camera (220). The above commands, when executed individually or collectively by the at least one processor (250), may cause the electronic device (201) to control the settings of the camera (220) based on the area, based on a correspondence between the direction of the acquired sound source and the direction of the acquired subject.

[0195] In one embodiment, the camera settings may include camera settings related to at least one of exposure, focus, or white balance. The instructions, when individually or collectively executed by the at least one processor (250), may further cause the electronic device (201) to adjust the settings of the camera (220) based on the area, based on whether the direction of the determined sound source corresponds to the direction of the acquired subject, and then acquire an image through the camera (220) based on the adjusted settings of the camera (220).

[0196] In one embodiment, a non-transitory computer-readable storage medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when individually or collectively executed by at least one processor (250), cause the electronic device (201) to track a direction of a sound source generating the sound using a sound acquired through a microphone (210) of the electronic device (201) based on the execution of a camera application. The computer-executable instructions, when individually or collectively executed by at least one processor (250), cause the electronic device (201) to determine, based on the tracking, a first point in time at which the sound source enters a field of view of a camera (220) of the electronic device (201), and a direction of the sound source at the first point in time. The computer-executable instructions, when individually or collectively executed by at least one processor (250), may cause the electronic device (201) to acquire, based on an image acquired at a second time point corresponding to the first time point through the camera (220), a direction of an object at a second time point corresponding to an area in which movement is detected within the image. The computer-executable instructions, when individually or collectively executed by at least one processor (250), may cause the electronic device (201) to control a setting of the camera (220) based on the area, based on the determined direction of the sound source corresponding to the acquired direction of the object.

Claims

In the electronic device (201), Microphone (210); Camera (220); display (230); At least one processor (250) comprising processing circuitry; and Includes a memory (240) that stores instructions, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the execution of the camera application, the direction of the sound source generating the sound is tracked using the sound acquired through the microphone (210), Based on the above tracking, the first point in time at which the sound source enters the field of view of the camera (220) and the direction of the sound source at the first point in time are determined, Based on the image acquired at the second point in time corresponding to the first point in time through the camera (220), the direction of the subject at the second point in time corresponding to the area where movement is detected in the image is acquired, and An electronic device (201) that causes the setting of the camera (220) to be controlled based on the area, based on the direction of the sound source determined above corresponding to the direction of the acquired subject. In the first paragraph, The settings of the above camera (220) include camera settings related to at least one of exposure, focus, or white balance, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: An electronic device (201) that adjusts the settings of the camera (220) based on the area based on the direction of the determined sound source corresponding to the direction of the acquired subject, and then causes an image to be acquired through the camera (220) based on the adjusted settings of the camera (220). In claim 1 or 2, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the above tracking, the first point in time and the first area in which the movement corresponding to the movement of the sound source is to be detected within the image acquired at the first point in time through the camera (220) are determined, Acquire the area where the movement is detected within the image acquired at the second point in time through the camera (220), and An electronic device (201) that causes the settings of the camera (220) to be controlled based on the acquired area, based on the acquired area corresponding to the determined first area. In any one of claims 1 to 3, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: After controlling the settings of the above camera (220): The direction of the sound source is obtained by using the sound obtained through the microphone (210), Based on the image acquired through the camera (220), the direction of the subject corresponding to the second area in which movement is detected in the image is acquired, and An electronic device (201) further causing the camera (220) to be controlled based on the second area in which movement is detected within the image, based on the direction of the acquired subject corresponding to the direction of the acquired sound source. In any one of claims 1 to 4, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the direction of the sound source corresponding to the direction of the subject, a third area having the same center as the center of the area and having a specified size is obtained, and An electronic device (201) causing the camera (220) to be set to control the settings based on the third area. In paragraph 5, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: An electronic device (201) that further causes an indication to be displayed on an image obtained through the camera (220) through the display (230) indicating the third area. In any one of claims 1 to 6, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: An electronic device (201) further causing the camera (220) to be set to a default setting or a setting set by user input, based on the direction of the sound source not corresponding to the direction of the subject. In any one of claims 1 to 7, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the execution of the above camera application, a plurality of sounds are acquired through the microphone (210), and An electronic device (201) that causes the direction of a sound source to be tracked based on the sound having the largest volume among the above-mentioned plurality of sounds. In any one of claims 1 to 8, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Divide the above image into multiple regions, An electronic device (201) that further causes the acquisition of an area in which the movement is detected within the plurality of areas based on the image and an image acquired at a time point prior to the second time point. In a method for providing an image in an electronic device (201), An operation of tracking the direction of a sound source generating the sound by using the sound acquired through the microphone (210) of the electronic device (201) based on the execution of the camera application; Based on the above tracking, an operation of determining a first point in time at which the sound source enters the field of view area of ​​the camera (220) of the electronic device (201) and a direction of the sound source at the first point in time; An operation of acquiring the direction of the subject at the second point in time corresponding to the area where movement is detected within the image based on an image acquired at the second point in time corresponding to the first point in time through the camera (220); and A method including an operation of controlling the settings of the camera (220) based on the area, based on the direction of the sound source determined above corresponding to the direction of the acquired subject. In paragraph 10, The settings of the above camera include camera settings related to at least one of exposure, focus, or white balance, A method further comprising: adjusting the settings of the camera (220) based on the area based on the direction of the determined sound source corresponding to the direction of the acquired subject; and then acquiring an image through the camera (220) based on the adjusted settings of the camera (220). In claim 10 or 11, Based on the above tracking, an operation of determining a first area in which a movement corresponding to the movement of the sound source is to be detected within an image acquired at the first point in time through the camera (220); An operation of acquiring the area in which the movement is detected within the image acquired at the second point in time through the camera (220); and A method further comprising an operation of controlling the settings of the camera (220) based on the acquired area, based on whether the acquired area corresponds to the determined first area. In any one of claims 10 to 12, After performing the operation to control the settings of the above camera (220): An operation of obtaining the direction of the sound source by using the sound obtained through the microphone (210); An operation of obtaining the direction of the subject corresponding to the second area in which movement is detected within the image based on the image obtained through the camera (220); and A method further comprising an operation of controlling the settings of the camera (220) based on the second area in which movement is detected within the image, based on the direction of the acquired subject corresponding to the direction of the acquired sound source. In any one of claims 10 to 13, The operation of controlling the settings of the camera (220) based on the above area is: An operation of obtaining a third area having the same center as the center of the area and having a specified size based on the direction of the sound source corresponding to the direction of the subject; and A method further comprising an operation of controlling the settings of the camera (220) based on the third area. In a non-transitory computer-readable storage medium having recorded thereon computer-executable instructions, said computer-executable instructions, when individually or collectively executed by at least one processor (250) of an electronic device (201), cause said electronic device (201) to: Based on the execution of the camera application, the direction of the sound source generating the sound is tracked using the sound acquired through the microphone (210), Based on the above tracking, the first point in time at which the sound source enters the field of view of the camera (220) and the direction of the sound source at the first point in time are determined, Based on the image acquired at the second point in time corresponding to the first point in time through the camera (220), the direction of the subject at the second point in time corresponding to the area where movement is detected in the image is acquired, and A computer-readable storage medium that causes the settings of the camera (220) to be controlled based on the area, based on the direction of the sound source determined above corresponding to the direction of the acquired subject.

Images