Method for capturing image including animal, and electronic device therefor

WO2025048305A1PCT designated stage expired Publication Date: 2025-03-06SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/011471
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-14
Filing Date
2024-08-05
Publication Date
2025-03-06

Smart Images

  • Figure KR2024011471_06032025_PF_FP_ABST
    Figure KR2024011471_06032025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device according to one embodiment disclosed in the present document may comprise a camera, a display, a processor and a memory in which instructions are stored. When the instructions are executed, the processor can be configured to: identify the movement of an animal included in a preview image acquired using the camera while the preview image is displayed on the display; acquire an image captured on the basis of a first exposure value through the camera if the size of the identified movement is greater than a threshold value; and acquire an image captured on the basis of a second exposure value that is greater than the first exposure value through the camera if the size of the identified movement is less than the threshold value. Other various embodiments identified through the present document are possible.
Need to check novelty before this filing date? Find Prior Art

Description

Method for capturing images including animals and electronic device thereof

[0001] The present disclosure relates to a method for capturing an image including an animal and an electronic device thereof.

[0002] As the possession of mobile electronic devices has become more common in daily life, the use of their camera functions has increased significantly. Taking pictures with these devices has become an essential feature, to the point where camera functions are becoming a criterion for selecting a mobile electronic device. Recently, with the significant increase in the number of pet owners, the demand for features related to animal photography has also increased. For example, if an electronic device recognizes an animal as the subject, it can reduce the shutter speed to minimize motion blur or adjust settings like sharpness and color to better capture the animal's characteristics, thereby obtaining an image optimized for the animal.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] An electronic device according to an embodiment of the present disclosure may include a camera, a display, a processor, and a memory storing instructions. The processor may be configured to, when the instructions are executed, identify movement of an animal included in a preview image acquired using the camera while displaying the preview image on the display. The processor may be configured to, when the instructions are executed, if the magnitude of the identified movement is greater than a threshold value, acquire an image captured through the camera based on a first exposure value. The processor may be configured to, when the instructions are executed, if the magnitude of the identified movement is less than the threshold value, acquire an image captured through the camera based on a second exposure value greater than the first exposure value.

[0005] According to an embodiment of the present disclosure, a method of operating an electronic device may include an operation of checking a movement of an animal included in a preview image while displaying the preview image on a display using a camera. The method of operating the electronic device may include an operation of obtaining a captured image based on a first exposure value through the camera if the magnitude of the checked movement is greater than a threshold value. The method of operating the electronic device may include obtaining a captured image based on a second exposure value greater than the first exposure value through the camera if the magnitude of the checked movement is less than the threshold value.

[0006] A computer-readable recording medium according to one embodiment of the present disclosure may include programs executable on a computer. The programs may perform an operation of checking the movement of an animal included in a preview image acquired using a camera while displaying the preview image on a display. The programs may perform an operation of acquiring a captured image based on a first exposure value through the camera if the magnitude of the identified movement is greater than a threshold value. The programs may perform an operation of acquiring a captured image based on a second exposure value greater than the first exposure value through the camera if the magnitude of the identified movement is less than the threshold value.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0008] FIG. 2 is a block diagram illustrating a camera module according to various embodiments.

[0009] FIG. 3 is a drawing illustrating a configuration of an electronic device according to one embodiment.

[0010] FIG. 4 is a drawing illustrating a method for determining movement of an arm or leg when photographing an animal, according to one embodiment.

[0011] FIG. 5 is a drawing illustrating a method for calculating speed according to animal movement, according to one embodiment.

[0012] FIG. 6 is a drawing illustrating a method for determining movement of a head or torso when photographing an animal, according to one embodiment.

[0013] FIG. 7 is a flowchart illustrating a method for capturing an image by taking into account the movement of an animal in an electronic device according to one embodiment.

[0014] FIG. 8 is a flowchart illustrating a method of operating an electronic device according to one embodiment.

[0015] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0016] Hereinafter, various embodiments disclosed in this document will be described with reference to the attached drawings. It should be understood that this is not intended to limit the various embodiments of the present disclosure to a specific form, but rather to encompass various modifications, equivalents, and / or alternatives of the present disclosure.

[0017] As animal photography increases, various methods are being attempted to obtain optimized animal images. Electronic devices such as smartphones can use AI-based image recognition technology to identify animals from preview images during shooting. Typically, when an animal is detected during shooting, the device can adjust shooting parameters to reduce the shutter speed or enhance sharpness or color. These devices can uniformly set or change shooting parameters regardless of the animal's behavior or movement. For example, dogs are constantly moving, while cats are relatively inert. However, these behavioral characteristics and movements may not be taken into account when capturing animals. This can result in images with inappropriate noise boosting and / or excessive sharpness or color, which can be uncomfortable for users attempting to capture animals.

[0018] In various embodiments of this document, various embodiments can be provided for obtaining an image of a scene optimized for an animal by detecting the movement of an animal recognized from a preview image when photographing an animal, predicting the speed of the animal whose movement is detected, and setting photographing parameters.

[0019] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary knowledge in the technical field to which this document pertains.

[0020] FIG. 1 is a diagram illustrating an electronic device within a network environment (100) according to one embodiment.

[0021] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0022] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0023] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0024] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0025] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0026] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0027] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0028] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0029] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0030] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0031] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0032] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0033] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0034] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0035] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0036] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0037] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0038] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0039] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0040] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0041] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0042] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0043] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to various embodiments.

[0044] Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is a target of image capturing. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies. A lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0045] The flash (220) can emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) can include one or more light-emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. The image sensor (230) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) can include one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0046] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operating characteristics of the image sensor (230) (e.g., adjusting the read-out timing, etc.) in response to the movement of the camera module (180) or the electronic device (101) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image. In one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (180). In one embodiment, the image stabilizer (240) can be implemented as, for example, an optical image stabilizer. The memory (250) can temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing task. For example, when image acquisition is delayed due to the shutter, or when multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and a corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (250) can be acquired and processed, for example, by the image signal processor (260). According to one embodiment, the memory (250) can be configured as at least a portion of the memory (130) or as a separate memory that operates independently therefrom.

[0047] The image signal processor (260) can perform one or more image processing operations on an image acquired through an image sensor (230) or an image stored in a memory (250). The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor (260) may perform control (e.g., exposure time control, read-out timing control, etc.) for at least one of the components included in the camera module (180) (e.g., image sensor (230)). An image processed by the image signal processor (260) may be stored back in the memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may include at least one of the processors (120). It may be configured as a separate processor that is configured as a part of the processor (120) or operates independently of the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display module (160) as is or after undergoing additional image processing by the processor (120).

[0048] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different properties or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera, and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera, and at least another may be a rear camera.

[0049] FIG. 3 is a drawing illustrating the configuration of an electronic device (300) according to one embodiment.

[0050] Referring to FIG. 3, an electronic device (300) is a device that determines the movement of a subject (or object) including an animal from a preview image acquired through a camera when photographing the subject, and sets photographing parameters in consideration of the determined movement of the subject, and may include one or more cameras (310), a display (320), and at least one processor (330) or memory (340). In FIG. 3, the electronic device (300) may correspond to the electronic device (101) illustrated in FIG. 1.

[0051] In one embodiment, one or more cameras (310) (e.g., camera module (180) of FIG. 1) may capture a subject according to a user's operation. For example, when a camera application is executed, one or more cameras (310) may acquire a preview image including the subject on a frame-by-frame basis, and when a user input for capturing an image (e.g., shutter button input) is received while displaying the preview image, the camera may capture an image including the subject. According to various embodiments, one or more cameras (310) may set capturing parameters (e.g., shutter speed, sharpness, and / or color correction) in consideration of the movement of the subject, and perform capturing based on one or more of the set capturing parameters.

[0052] In one embodiment, the display (320) (e.g., the display module (160) of FIG. 1) may display images captured using one or more cameras (310). For example, the display (320) may display preview images acquired from one or more cameras (310) when a camera application is executed.

[0053] In one embodiment, the display (320) may be configured with at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), a flexible display, and a 3-dimensional display. In addition, some of these displays may be configured as transparent or light-transmitting so that the outside can be viewed through them. This may be configured in the form of a transparent display including a TOLED (transparent OLED).

[0054] In one embodiment, the memory (340) (e.g., the memory (130) of FIG. 1) may store instructions that, when executed, control at least one processor (330) (e.g., the processor (120) of FIG. 1) to perform various operations. For example, the at least one processor (330) may perform operations for predicting the movement and speed of an animal when photographing an animal and setting photographing parameters.

[0055] In one embodiment, at least one processor (330) may display a preview image acquired from a camera (310) on a display (320) when a camera application is executed. While displaying the preview image, the processor (330) may detect at least one object included in the preview image. For example, the at least one object may include an animal. According to various embodiments, while providing the preview image, the at least one processor (330) may use AI-based image recognition technology to determine in real time whether an object entering the preview image includes an animal.

[0056] In one embodiment, when an animal is detected from the preview image, at least one processor (330) may obtain first information for identifying a body part of the animal and second information for determining whether movement of the animal occurs. For example, the first information may indicate whether the animal is detected in a plurality of regions included in the preview image. In another example, the second information may indicate whether movement of the animal occurs in a plurality of regions included in the preview image.

[0057] In one embodiment, at least one processor (330) may determine a body part of an animal included in the preview image based on the first information. At least one processor (330) may divide the preview image into a specified number of regions (e.g., 12 width x 9 height) and analyze a region in which the animal is detected among the divided regions. At least one processor (330) may determine a body part of the animal included in the preview image based on the analysis of the region in which the animal is detected. According to various embodiments, the body part of the animal may include at least one of a head, a torso, a tail, an arm, or a leg.

[0058] In one embodiment, at least one processor (330) may determine whether movement of an animal included in the preview image has occurred based on the second information. At least one processor (330) may divide the preview image into a specified number of regions (e.g., 12 width x 9 height) and analyze pixel changes for each of the divided regions. At least one processor (330) may identify a region in which movement has been detected within the preview image based on the analysis of pixel changes for each region. According to various embodiments, at least one processor (330) may detect a region in which the animal has been detected within the preview image and a region in which movement has been detected within the preview image, and if there is a region that satisfies both conditions, it may determine that movement of the animal has occurred. For example, if a body part including at least one of an arm and a leg of the animal is detected from the preview image based on the first information, the at least one processor (330) may determine whether movement has occurred for the animal based on the second information. If the above determination result indicates that movement has occurred for the animal, at least one processor (330) may calculate a speed according to the movement of the animal. For example, the speed may be calculated by utilizing optical flow for the preview image. At least one processor (330) may check a difference in pixel values ​​with respect to a plurality of frames acquired at a specified time interval prior to the preview image, and may extract the optical flow based on the checked difference in pixel values ​​and the relationship with surrounding pixels. At least one processor (330) may estimate pixel movement within the preview image based on the extracted optical flow, and may calculate a speed according to the movement of the animal based on the estimated pixel movement.For another example, at least one processor (330) may determine that the animal's movement is not as fast as when an arm or leg is detected, if the animal's arms and / or legs are not detected from the preview image based on the first information, and a body part including at least one of a head, ears, torso, or tail is detected. In this case, even if the at least one processor (330) determines that movement has occurred for the animal, it may estimate that the animal's movement magnitude is less than a threshold value.

[0059] In one embodiment, at least one processor (330) may set the exposure value of one or more cameras (310) based on the estimated speed of the body part of the animal. If the estimated speed is greater than or equal to a reference speed, the at least one processor (330) may determine that the magnitude of the movement of the animal is greater than a threshold value. If the estimated speed is less than the reference speed, the at least one processor (330) may determine that the magnitude of the movement of the animal is less than the threshold value. Here, the reference speed is a speed that serves as a reference for determining the magnitude of the movement of the animal for setting at least one shooting parameter, and may be determined according to the settings of the manufacturer or user of the electronic device (300). For example, if the at least one processor (330) determines that the magnitude of the movement of the animal is greater than the threshold value, the at least one processor (330) may set a first exposure value for the one or more cameras (310) and capture an image including the animal based on the first exposure value. At least one processor (330) may set a second exposure value greater than the first exposure value for the one or more cameras (310) when it is determined that the size of the movement of the animal is less than the threshold value, and may capture an image including the animal based on the second exposure value. The exposure value set for the one or more cameras (310) may be related to a shutter speed setting of the one or more cameras (310). For example, the shutter speed may be set slower as the exposure value increases, and the shutter speed corresponding to the second exposure value setting may exhibit a slower value than the shutter speed corresponding to the first exposure value setting.

[0060] According to various embodiments, at least one processor (330) may determine the shutter speed (or exposure value) of one or more cameras (310) stepwise or in parallel corresponding to the estimated speed.

[0061] For example, at least one processor (330) may set one or more cameras (310) to have a faster shutter speed as the estimated speed increases, thereby minimizing motion blur caused by the movement of the animal included in the preview image. At least one processor (330) may predefine shutter speed levels applicable to each range corresponding to the movement speed of the animal, and may differentially determine the shutter speed according to the range to which the estimated speed belongs. For example, if the shutter speed according to the default setting is 1 / 60 s, the electronic device (300) may determine that the setting value of the shutter speed gradually decreases by applying different rates based on 1 / 60 s according to the range. If the estimated speed of the animal is less than a first threshold, the at least one processor (330) may capture an image based on the shutter speed according to the default setting without adjusting the shutter speed. If the estimated speed is greater than or equal to the first threshold and less than or equal to the second threshold, the at least one processor (330) may adjust the shutter speed to have a setting value of about 0.8 times the shutter speed according to the default setting. At least one processor (330) may adjust the shutter speed to have a setting value approximately 0.6 times higher than the shutter speed according to the default setting if the estimated speed is greater than or equal to the second threshold value and less than or equal to the third threshold value. At least one processor (330) may adjust the shutter speed to have a setting value approximately 0.4 times higher than the shutter speed according to the default setting if the estimated speed is greater than or equal to the third threshold value. Here, the contents regarding the range and setting value numerical values ​​for the shutter speed setting are only examples and may not be limited thereto.

[0062] According to various embodiments, the at least one shooting parameter may further include, in addition to the exposure value (or shutter speed), at least one of a sharpness or a color correction level of one or more cameras (310). For example, if the at least one processor (330) determines that the magnitude of the movement of the animal is greater than the threshold value, the at least one processor (330) may set a first level of sharpness or color correction level for the one or more cameras (310). If the at least one processor (330) determines that the magnitude of the movement of the animal is less than the threshold value, the at least one processor (330) may set the sharpness or color correction level of the one or more cameras (310) to a second level lower than the first level. As another example, the at least one processor (330) may determine the sharpness and / or color correction level of one or more cameras (310) in steps or in parallel in response to the estimated speed. At least one processor (330) may set the sharpness and / or color correction level of one or more cameras (310) to be higher as the estimated speed increases, so that the characteristics of the animal included in the preview image (e.g., fur, eye color) are well expressed. At least one processor (330) may predefine the sharpness and / or color correction level to be applied for each range corresponding to the movement speed of the animal, and may differentially determine the sharpness and / or color correction level according to the range to which the estimated speed belongs. At least one processor (330) may capture an image based on the sharpness and / or color correction level according to the default setting without adjusting the sharpness and / or color correction level if the estimated speed of the animal is less than a first threshold value. At least one processor (330) may set the sharpness and / or color correction level to be about 1.2 times higher than the default setting if the estimated speed is equal to or greater than the first threshold value and less than a second threshold value.At least one processor (330) may set the sharpness and / or color correction level to be about 1.4 times higher than the default setting if the estimated speed is greater than or equal to the second threshold and less than or equal to the third threshold. At least one processor (330) may set the sharpness and / or color correction level to be about 1.6 times higher than the default setting if the estimated speed is greater than or equal to the third threshold. Here, the range and the setting value numerical value for the sharpness and / or color correction level setting are only examples and may not be limited thereto.

[0063] According to various embodiments, at least one processor (330) may determine at least one shooting parameter based on at least one of movement, position, or focus setting of each animal when multiple animals are detected from the preview image. For example, at least one processor (330) may set the at least one shooting parameter based on an animal detected to have the fastest movement speed among the multiple animals. As another example, at least one processor (330) may set the at least one shooting parameter based on an animal located at a position corresponding to a user's area of ​​interest in the preview image. In this case, the area of ​​interest may correspond to a central portion of the screen of the display (320) or an area focused or selected by the user.

[0064] In one embodiment, at least one processor (330) can acquire an image including the animal based on the set shooting parameters. According to various embodiments, the setting of the sharpness and / or color correction level can be performed as a post-processing of the captured image after capturing the image of the animal. If movement of the animal is detected while the preview image is provided, the at least one processor (330) can improve the characteristic expression of the animal by correcting the sharpness and / or color of the captured image instead of changing the setting values ​​related to sharpness and / or color correction before capturing.

[0065]

[0066] FIG. 4 is a drawing illustrating a method for determining movement of an animal's arms or legs when photographing an animal, according to one embodiment.

[0067] Referring to FIG. 4, the electronic device (300) may detect an object from a preview image obtained from one or more cameras (e.g., the camera module (180) of FIG. 1 or the camera (310) of FIG. 3) while providing the preview image. The object may include an animal such as a dog or a cat.

[0068] In one embodiment, when the electronic device (300) recognizes that an object included in the preview image is an animal (e.g., a dog), the electronic device (300) may obtain a first map (410) indicating whether the animal is detected in a plurality of areas included in the preview image, and a second map (420) indicating whether movement of the animal occurs in a plurality of areas included in the preview image. According to various embodiments, the plurality of areas may correspond to a plurality of grids generated by dividing the preview image at a specified ratio or a plurality of pixel units included in the preview image.

[0069] In one embodiment, the electronic device (300) may identify an area in which the animal is detected among a plurality of areas in the preview image based on the first map (410), and determine a body part of the animal included in the preview image based on an analysis of the area in which the animal is detected. For example, the electronic device (300) may identify an area (411) in which an arm or leg of the animal is detected from the first map (410).

[0070] In one embodiment, the electronic device (300) can identify an area (421) in which movement is detected among a plurality of areas in the preview image based on the second map (420). The electronic device (300) can determine whether pixel values ​​of each of the plurality of areas change, and can identify the area (421) in which movement is detected based on the determination result.

[0071] In one embodiment, the electronic device (300) can determine whether movement has occurred in an area where an arm or leg of the animal is detected based on the first map (410) and the second map (420). For example, the electronic device (300) can check whether there is an overlapping area (431) between an area (411) where an arm or leg of the animal is detected identified from the first map (410) and an area (421) where movement is detected identified from the second map (420) in the preview image (400). If it is confirmed that the overlapping area (431) exists in the preview image (400), the electronic device (300) can calculate a speed according to the movement of the animal. Specific details regarding the speed calculation according to the movement of the animal will be described with reference to FIG. 5.

[0072] FIG. 5 is a diagram illustrating a method of calculating a speed according to an embodiment of the present invention. Referring to FIG. 5, when the electronic device (300) detects movement of the animal's arm or leg from the preview image, the electronic device (300) can calculate an expected speed according to the animal's movement. In one embodiment, the electronic device (300) can check a pixel change based on a plurality of frames (500) acquired at a specified time interval before the preview image (400). The electronic device (300) can extract an optical flow for the overlapping area (e.g., the overlapping area (431) of FIG. 4) within the preview image (400) by using the pixel value difference between the preview image (400) and the plurality of frames (500). According to various embodiments, the electronic device (300) can estimate the optical flow based on the Lucas-Kanade algorithm. In this case, the electronic device (300) can estimate the optical flow based on three conditions of brightness consistency, temporal persistence, and spatial coherency for the preview image (400) and the plurality of frames (500). Here, brightness constancy means that the value of a pixel on an object in an image does not change even if the frame changes, and temporal persistence may mean that the movement of the object is not large between consecutive frames because time changes more quickly than the movement of the object in the image. Spatial coherence may mean that points that are spatially adjacent to each other in the image are likely to belong to the same object and have the same movement, and thus the optical flow of the window area N(y,x) centered on the pixel (y,x) is the same.For example, the electronic device (300) can calculate the optical flow for the overlapping area (431) within the preview image (400) using mathematical expression 1.

[0073]

[0074] In one embodiment, the electronic device (300) can estimate pixel movement within the preview image (400) based on the calculated optical flow, and predict a speed according to the movement of the animal based on the estimated pixel movement.

[0075] Referring back to FIG. 4, the electronic device (300) may stepwise set at least one shooting parameter according to the predicted speed of the animal based on the optical flow of the overlapping area (431) in the preview image (400). The at least one shooting parameter may include at least one of a shutter speed (or exposure value), sharpness, or color correction of one or more cameras (310). In one embodiment, the electronic device (300) may predefine a setting level of a shooting parameter for each range corresponding to the movement speed of the animal, and determine the at least one shooting parameter according to a setting level applied in a range to which the predicted speed of the animal belongs. For example, the electronic device (300) may set the setting level to level 1 when the predicted speed of the animal is less than a first threshold. When set to level 1, the electronic device (300) may capture an image based on a default setting without adjusting the at least one parameter (e.g., shutter speed, sharpness, or color correction level). The electronic device (300) may set the setting level to level 2 if the predicted animal speed is greater than or equal to the first threshold and less than the second threshold. When set to level 2, the electronic device (300) may set the shutter speed to a value about 0.8 times lower than the default setting, and may set the sharpness and / or color correction level to about 1.2 times higher than the default setting. The electronic device (300) may set the setting level to level 3 if the predicted animal speed is greater than or equal to the second threshold and less than the third threshold. When set to level 3, the electronic device (300) may set the shutter speed to a value about 0.6 times lower than the default setting, and may set the sharpness and / or color correction level to about 1.4 times higher than the default setting.The electronic device (300) may set the setting level to level 4 if the predicted speed of the animal is greater than or equal to the third threshold value. When set to level 4, the electronic device (300) may set the shutter speed to a value about 0.4 times lower than the default setting, and may set the sharpness and / or color correction level to a value about 1.6 times higher than the default setting. According to various embodiments, the electronic device (300) may determine the setting value for the shutter speed among the shooting parameters before capturing an image of the animal (e.g., before pressing the shutter button), and may determine the setting value for the sharpness and / or color correction level after capturing an image of the animal (e.g., after pressing the shutter button) through post-processing of the image.

[0076] FIG. 6 is a drawing illustrating a method for determining movement of an animal's head or torso when photographing an animal, according to one embodiment.

[0077] Referring to FIG. 6, the electronic device (300) may detect an object from a preview image obtained from one or more cameras (e.g., the camera module (180) of FIG. 1 or the camera (310) of FIG. 3) while providing the preview image. The object may include an animal such as a dog or a cat.

[0078] In one embodiment, when the electronic device (300) recognizes that an object included in the preview image is an animal (e.g., a dog), the electronic device (300) may obtain a first map (610) indicating whether the animal is detected in a plurality of areas included in the preview image, and a second map (620) indicating whether movement of the animal occurs in a plurality of areas included in the preview image. According to various embodiments, the plurality of areas may correspond to a plurality of grids generated by dividing the preview image at a specified ratio or a plurality of pixel units included in the preview image.

[0079] In one embodiment, the electronic device (300) may determine an area in which the animal is detected among a plurality of areas in the preview image based on the first map (610), and may determine that the animal's arms or legs are not detected in the preview image, but the animal's head (including ears) and torso are detected based on an analysis of the area in which the animal is detected. For example, the electronic device (300) may determine an area (611) in which the animal's head (including ears) and torso are detected from the first map (610).

[0080] In one embodiment, the electronic device (300) can identify an area (621) in which movement is detected among a plurality of areas within the preview image based on the second map (620). The electronic device (300) can determine whether pixel values ​​for each of the plurality of areas change, and can identify the area (621) in which movement is detected based on the determination result.

[0081] In one embodiment, the electronic device (300) may determine whether movement has occurred in the area where the head (including ears) and torso are detected based on the first map (610) and the second map (620). For example, the electronic device (300) may determine whether there is an overlapping area (631) between the area (611) where the head (including ears) and torso of the animal identified from the first map (610) are detected and the area (621) where the movement is detected identified from the second map (620) in the preview image (600). If it is determined that the overlapping area (631) exists in the preview image (600), the electronic device (300) may adjust the shutter speed to have a lower value by a predetermined ratio (e.g., about 0.8-0.9 times) than the shutter speed according to the default setting, or may set the sharpness and / or color correction level to be higher by a predetermined ratio (e.g., about 1.2-1.3 times) than the default setting. According to various embodiments, the electronic device (300) may determine the setting value for the shutter speed before capturing the image of the animal (e.g., before pressing the shutter button), and may determine the setting value for the sharpness and / or color correction level through post-processing of the image after capturing the image of the animal (e.g., after pressing the shutter button).

[0082] According to various embodiments, if the head (including ears) and torso of the animal are detected from the preview image (600), the electronic device (300) may determine that the animal is not moving quickly, and may capture an image based on default settings without adjusting at least one parameter (e.g., shutter speed, sharpness, or color correction level) regardless of whether motion is detected.

[0083] FIG. 7 is a flowchart illustrating a method for capturing an image by taking into account the movement of an animal in an electronic device (300) according to one embodiment. The operations described in FIG. 7 may be understood as functions performed by at least one processor included in the electronic device (300) (e.g., the processor (120) of FIG. 1 or the processor (330) of FIG. 3).

[0084] Referring to FIG. 7, in operation 710, the electronic device (300) may determine whether an animal is identified in the preview image while displaying a preview image acquired from one or more cameras (e.g., the camera module (180) of FIG. 1 or the camera (310) of FIG. 3) through a display (e.g., the display module (160) of FIG. 1 or the display (320) of FIG. 3). For example, the electronic device (300) may determine whether an object corresponding to an animal is recognized in real time from the preview image using AI-based image recognition technology while providing the preview image.

[0085] As a result of the above determination, if an animal is identified in the preview image (operation 710-Yes), the electronic device (300) can detect a body part of the animal included in the preview image in operation 720. The electronic device (300) can determine an area in which the animal is detected among a plurality of areas in the preview image based on a first map indicating whether the animal is detected in a plurality of areas included in the preview image, and can detect a body part of the animal included in the preview image based on analysis of the area in which the animal is detected. The body part of the animal can include at least one of a head, a torso, a tail, an arm, or a leg.

[0086] As a result of the above determination, if an animal is not identified in the preview image (operation 710-No), the electronic device (300) may maintain the default setting without adjusting at least one shooting parameter in operation 780.

[0087] According to one embodiment, in operation 730, the electronic device (300) can determine whether a body part of an arm or a leg of the animal is detected from the preview image. Based on the first map, the electronic device (300) can determine whether there is an area among a plurality of areas in the preview image where an arm or a leg of the animal is detected.

[0088] As a result of the above determination, if an arm or a leg of the animal is detected in the preview image (Operation 730-Yes), the electronic device (300) can determine whether movement of the animal is detected from the preview image in operation 735. The electronic device (300) can confirm an area in the preview image in which movement of the animal is detected based on a second map indicating whether movement of the animal occurs in a plurality of areas included in the preview image. As a result of the above determination, if movement of the animal is not detected from the preview image (Operation 735-No), the electronic device (300) can maintain a default setting without adjusting at least one shooting parameter in operation 780. As a result of the above determination, if movement of the animal is detected from the preview image (Operation 735-Yes), the electronic device (300) can calculate a speed according to the movement of the animal in operation 750.

[0089] According to one embodiment, in operation 750, the electronic device (300) can calculate the speed according to the movement of the animal by utilizing the optical flow for the preview image. The electronic device (300) can check the pixel change based on a plurality of frames acquired at a specified time interval before the preview image, and can extract the optical flow for the area where the arm or leg of the animal is detected in the preview image by utilizing the pixel value difference between the preview image and the plurality of frames. The electronic device (300) can estimate the speed of the animal based on the extracted optical flow. For example, when the animal approaches the electronic device (300) head-on, the electronic device (300) can check that the size of the area where the animal is detected is gradually increasing from the plurality of frames, and can estimate the movement direction and speed of the animal based on the pixel change between the preview image and the plurality of frames.

[0090] According to one embodiment, in operation 760, the electronic device (300) may select a setting value of at least one shooting parameter based on the calculated speed of the animal. The at least one shooting parameter may include at least one of a shutter speed (or an exposure value), sharpness, or a color correction level of one or more cameras (310). According to various embodiments, the electronic device (300) may select a setting value of the at least one shooting parameter in steps according to a range corresponding to the speed of the animal. If the speed of the animal is less than a first threshold value, the electronic device (300) may select a setting value according to a default setting without adjusting the at least one shooting parameter. If the speed of the animal is within a range greater than or equal to the first threshold value and less than or equal to the second threshold value, the electronic device (300) may select a setting value of the shutter speed that is about 0.8 times lower than the default setting, and may select a sharpness and / or color correction level that is about 1.2 times higher than the default setting. If the speed of the animal is within a range greater than or equal to the second threshold and less than or equal to the third threshold, the electronic device (300) may select a shutter speed setting value that is about 0.6 times lower than the default setting, and a sharpness and / or color correction level that is about 1.4 times higher than the default setting. If the speed of the animal is greater than or equal to the third threshold, the electronic device (300) may select a shutter speed setting value that is about 0.4 times lower than the default setting, and a sharpness and / or color correction level that is about 1.6 times higher than the default setting.

[0091] According to one embodiment, in operation 770, the electronic device (300) can capture an image including the animal based on the at least one selected capturing parameter.

[0092] Meanwhile, if, as a result of the determination in operation 730, the animal's arms or legs are not detected in the preview image (operation 730-No), the electronic device (300) may determine that the animal's head, ears, torso, or tail is detected from the preview image in operation 740. The electronic device (300) may identify an area in which the animal's head, ears, torso, or tail is detected among a plurality of areas in the preview image based on the first map.

[0093] According to one embodiment, in operation 745, the electronic device (300) may determine whether movement of the animal is detected from the preview image. The electronic device (300) may check an area in the preview image where movement of the animal is detected based on the second map. As a result of the determination, if movement of the animal is not detected from the preview image (operation 745-No), the electronic device (300) may maintain a default setting without adjusting the at least one shooting parameter in operation 780. As a result of the determination, if movement of the animal is detected from the preview image (operation 745-Yes), the electronic device (300) may select at least one shooting parameter to have a setting value adjusted by a predetermined ratio from the default setting in operation 760. In operation 760, the electronic device (300) may adjust the shutter speed to have a lower value by a predetermined ratio (e.g., about 0.8-0.9 times) than the shutter speed according to the default setting, or may set the sharpness and / or color correction level to be higher by a predetermined ratio (e.g., about 1.2-1.3 times) than the default setting. According to various embodiments, when the head, ears, torso, or tail of the animal is detected from the preview image, the electronic device (300) may select a setting value according to the default setting without adjusting the at least one shooting parameter regardless of the determination result of operation 745. According to one embodiment, in operation 770, an image including the animal may be captured based on the selected at least one shooting parameter.

[0094] FIG. 8 is a flowchart illustrating an operating method of an electronic device (300) according to an embodiment. According to an embodiment, the electronic device (300) is a device that determines the movement of a subject including an animal from a preview image acquired through a camera when photographing a subject, and sets photographing parameters in consideration of the determined movement of the subject, and may correspond to the electronic device (101) illustrated in FIG. 1. The operations of FIG. 8 may be performed by at least one processor included in the electronic device (300) (e.g., the processor (120) of FIG. 1 or the processor (330) of FIG. 3).

[0095] Referring to FIG. 8, in operation 810, the electronic device (300) may display a preview image acquired from one or more cameras (e.g., the camera module (180) of FIG. 1 or the camera (310) of FIG. 3) on a display (e.g., the display module (160) of FIG. 1 or the display (320) of FIG. 3) in response to the execution of a camera application, and may confirm the movement of an animal included in the preview image. According to various embodiments, in operation 810, the electronic device (300) may use AI-based image recognition technology while providing the preview image to confirm in real time whether an object entering the preview image includes an animal.

[0096] According to one embodiment, in operation 810, the electronic device (300) may, in response to detection of the animal, determine movement of the animal. The electronic device (300) may obtain first information for identifying a body part of the animal and second information for determining whether movement of the animal occurs, and may determine movement of the animal based on the first information and the second information. For example, the first information may indicate whether the animal is detected in a plurality of areas included in the preview image. As another example, the second information may indicate whether movement of the animal occurs in a plurality of areas included in the preview image.

[0097] According to one embodiment, in operation 810, the electronic device (300) may determine a body part of an animal included in the preview image based on the first information. For example, the electronic device (300) may divide the preview image into a specified number of regions (e.g., 12 width x 9 height) and analyze a region in which the animal is detected among the divided regions. The electronic device (300) may determine a body part of the animal included in the preview image based on the analysis of the region in which the animal is detected. The body part of the animal may include at least one of a head, a torso, a tail, an arm, or a leg.

[0098] According to one embodiment, in operation 810, the electronic device (300) may determine whether movement occurs in the animal included in the preview image based on the second information. For example, the electronic device (300) may divide the preview image into a specified number of regions (e.g., 12 width x 9 height) and analyze pixel changes in each of the divided regions to identify a region in which movement is detected in the preview image. The electronic device (300) may detect a region in which the animal is detected in the preview image and a region in which movement is detected in the preview image, and if there is a region that satisfies both conditions, it may determine that movement has occurred in the animal.

[0099] According to various embodiments, when a body part including at least one of an arm or a leg of the animal is detected from the preview image, the electronic device (300) may determine whether movement has occurred in the animal based on the second information. If the determination result indicates that movement has occurred in the animal, the electronic device (300) may calculate a speed according to the movement of the animal. For example, the speed of the animal may be calculated using optical flow for the preview image. The electronic device (300) may check a pixel value difference with respect to a plurality of frames acquired at a specified time interval prior to the preview image, and may extract the optical flow based on the checked pixel value difference and the relationship between the surrounding pixels. The electronic device (300) may estimate pixel movement within the preview image based on the extracted optical flow, and may calculate a speed according to the movement of the animal based on the estimated pixel movement.

[0100] According to various embodiments, if the animal's arms and / or legs are not detected from the preview image, and a body part including at least one of the head, ears, torso, or tail is detected, the electronic device (300) may determine that the animal's movement is not as fast as when an arm or leg is detected. In this case, even if the electronic device (300) determines that movement has occurred for the animal, it may estimate that the animal's movement magnitude is below a threshold value.

[0101] According to one embodiment, in operation 820, the electronic device (300) may determine whether the magnitude of the movement identified for the animal is greater than a threshold value. For example, if a body part including at least one of an arm or a leg of the animal is detected from the preview image, and if a speed according to the movement of the animal is greater than or equal to a reference speed, the electronic device (300) may determine that the magnitude of the movement of the animal is greater than a threshold value. If the speed according to the movement of the animal is less than the reference speed, the electronic device (300) may determine that the magnitude of the movement of the animal is less than the threshold value. Here, the reference speed is a speed that serves as a reference for determining the magnitude of the movement of the animal for setting at least one shooting parameter, and may be determined according to the settings of the manufacturer or user of the electronic device (300). As another example, if a body part including at least one of the head, ears, torso, or tail of the animal is detected from the preview image, the electronic device (300) may determine that the magnitude of the movement of the animal is less than a threshold value.

[0102] As a result of the above determination, if the movement size of the animal is greater than the threshold value (operation 820-Yes), the electronic device (300) can set a first exposure value for the camera (310) in operation 830.

[0103] As a result of the above determination, if the movement size of the animal is less than the threshold value (operation 820-No), the electronic device (300) may set a second exposure value greater than the first exposure value for the camera (310) in operation 840. The exposure value set for the camera (310) may be related to a shutter speed setting of the camera (310). For example, the shutter speed may be set slower as the exposure value increases, and the shutter speed corresponding to the second exposure value setting may exhibit a slower value than the shutter speed corresponding to the first exposure value setting.

[0104] According to various embodiments, the at least one shooting parameter may further include, in addition to an exposure value (or shutter speed), at least one of a sharpness or color correction level of the camera (310). If the electronic device (300) determines that the magnitude of the movement of the animal is greater than the threshold value, the electronic device (300) may set a first level of sharpness or color correction level for the camera (310). If the electronic device (300) determines that the magnitude of the movement of the animal is less than the threshold value, the electronic device (300) may set the sharpness or color correction level of the camera (310) to a second level lower than the first level.

[0105] According to various embodiments, the electronic device (300) may determine a setting value of at least one shooting parameter in steps or in parallel in response to the estimated speed in operation 830 and / or operation 840. For example, the electronic device (300) may set the camera (310) to have a lower shutter speed as the estimated speed increases, thereby minimizing motion blur caused by the movement of the animal included in the preview image. The electronic device (300) may predefine shutter speed levels applicable to each range corresponding to the movement speed of the animal, and may differentially determine the shutter speed according to the range to which the estimated speed belongs. If the estimated speed for the animal is less than a first threshold value, the electronic device (300) may capture an image based on a shutter speed according to a default setting without adjusting the shutter speed. If the estimated speed is greater than or equal to the first threshold value and less than or equal to the second threshold value, the electronic device (300) may adjust the shutter speed to have a setting value of about 0.8 times the shutter speed according to the default setting. If the estimated speed is greater than or equal to the second threshold and less than the third threshold, the electronic device (300) may adjust the shutter speed to have a setting value approximately 0.6 times higher than the shutter speed according to the default setting. If the estimated speed is greater than or equal to the third threshold, the electronic device (300) may adjust the shutter speed to have a setting value approximately 0.4 times higher than the shutter speed according to the default setting. Here, the range and setting value numerical values ​​for the shutter speed setting are only examples and may not be limited thereto. As another example, the electronic device (300) may set the sharpness or color correction level of the camera (310) higher as the estimated speed increases, so that the characteristics of the animal included in the preview image (e.g., fur, eye color) are well expressed.The electronic device (300) may predefine the sharpness and / or color correction levels to be applied for each range corresponding to the movement speed of the animal, and may differentially determine the sharpness and / or color correction levels according to the range to which the estimated speed belongs. If the estimated speed of the animal is less than a first threshold, the electronic device (300) may capture an image based on the sharpness and / or color correction levels according to the default settings without adjusting the sharpness and / or color correction levels. If the estimated speed is greater than or equal to the first threshold and less than the second threshold, the electronic device (300) may set the sharpness and / or color correction levels to be about 1.2 times higher than the default settings. If the estimated speed is greater than or equal to the second threshold and less than the third threshold, the electronic device (300) may set the sharpness and / or color correction levels to be about 1.4 times higher than the default settings. If the estimated speed is greater than or equal to the third threshold, the electronic device (300) may set the sharpness and / or color correction levels to be about 1.6 times higher than the default settings. Here, the range and setting value values ​​for the sharpness and / or color correction level settings are provided as an example and may not be limited thereto.

[0106] According to one embodiment, in operation 850, the electronic device (300) may acquire a captured image based on the set exposure value. According to various embodiments, among at least one shooting parameter set for the camera (310), the setting of sharpness and / or color correction level may be performed as a post-processing for the captured image after capturing the animal. If movement of the animal is detected while the preview image is provided, the electronic device (300) may improve the characteristic expression of the animal by correcting sharpness and / or color for the captured image of the animal instead of changing the setting value related to sharpness and / or color correction before capturing.

[0107] An electronic device (e.g., electronic device (300)) according to an embodiment includes a camera (310), a display (320), a processor (330), and a memory (340) storing instructions, wherein the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to display a preview image acquired using the camera (310) on the display (320) while checking a movement of an animal included in the preview image, and if the magnitude of the identified movement is greater than a threshold value, obtain a captured image based on a first exposure value through the camera (310), and if the magnitude of the identified movement is less than the threshold value, obtain a captured image based on a second exposure value greater than the first exposure value through the camera (310).

[0108] In one embodiment, the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to obtain first information for identifying a body part of the animal and second information for determining whether movement of the animal occurs while displaying the preview image on the display (320), and to confirm movement of the animal included in the preview image based on the first information and the second information.

[0109] In one embodiment, the processor (330) may be configured to cause the electronic device (300) to divide the preview image into a plurality of regions when the instructions are executed, and to analyze a region in which the animal is detected among the plurality of regions to identify a body part of the animal.

[0110] In one embodiment, the processor (330) may be configured such that when the instructions are executed, the electronic device (300) divides the preview image into a plurality of regions and analyzes pixel movement for each of the plurality of regions to determine whether movement of the animal has occurred.

[0111] In one embodiment, the processor (330) may be configured to determine whether movement has occurred in the animal based on the second information when the electronic device (300) determines that the body part of the animal corresponds to at least one of an arm and a leg when the instructions are executed, and to calculate an expected speed according to the movement of the animal when it is determined that movement has occurred in the animal.

[0112] In one embodiment, the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to extract optical flow from a plurality of frames acquired at a specified time interval while providing the preview image, estimate pixel movement within the preview image based on the extracted optical flow, and calculate the expected velocity based on the estimated pixel movement.

[0113] In one embodiment, the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to determine that the magnitude of movement identified for the animal is greater than the threshold value if the calculated expected speed is greater than or equal to the reference speed, and to capture an image including the animal based on the first exposure value.

[0114] In one embodiment, the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to determine that the magnitude of the movement identified for the animal is less than the threshold value if the calculated expected speed is less than the reference speed, and to capture an image including the animal based on the second exposure value.

[0115] In one embodiment, the processor (330) may be configured to, when the instructions are executed, determine that the body part of the animal corresponds to at least one of the head, ears, torso, or tail, estimate that the magnitude of the movement identified for the animal is less than the threshold value, and capture an image including the animal based on the second exposure value.

[0116] In one embodiment, the processor (330) may be configured to, when the instructions are executed, cause the electronic device (300) to set the sharpness or color correction level of the camera (310) to a first level if the magnitude of the identified movement is greater than the threshold value, and to set the sharpness or color correction level of the camera (310) to a second level lower than the first level if the magnitude of the identified movement is less than the threshold value.

[0117] A method of operating an electronic device (e.g., electronic device (300)) according to an embodiment may include an operation of checking a movement of an animal included in a preview image obtained using a camera (310) while displaying the preview image on a display (320), an operation of obtaining an image captured based on a first exposure value through the camera (310) if the size of the confirmed movement is greater than a threshold value, and an operation of obtaining an image captured based on a second exposure value greater than the first exposure value through the camera (310) if the size of the confirmed movement is less than the threshold value.

[0118] In one embodiment, the operation of confirming the movement of the animal included in the preview image may include an operation of obtaining first information for identifying a body part of the animal and second information for determining whether movement of the animal has occurred while displaying the preview image on the display (320), and an operation of confirming the movement of the animal included in the preview image based on the first information and the second information.

[0119] In one embodiment, the operation of obtaining the first information may include an operation of dividing the preview image into a plurality of regions, and an operation of analyzing a region in which the animal is detected among the plurality of regions to identify a body part of the animal.

[0120] In one embodiment, the operation of obtaining the second information may include an operation of dividing the preview image into a plurality of regions, and an operation of analyzing pixel movement in each of the plurality of regions to determine whether movement of the animal has occurred.

[0121] In one embodiment, the operation of checking the movement of the animal included in the preview image may include an operation of determining whether movement has occurred for the animal based on the second information if it is determined that the body part of the animal corresponds to at least one of an arm and a leg, and an operation of calculating an expected speed according to the movement of the animal if it is determined that movement has occurred for the animal.

[0122] In one embodiment, the operation of calculating an expected speed based on the movement of the animal may include an operation of extracting optical flow from a plurality of frames acquired at a specified time interval while providing the preview image, an operation of estimating pixel movement within the preview image based on the extracted optical flow, and an operation of calculating the expected speed based on the estimated pixel movement.

[0123] In one embodiment, the method may further include an operation of determining that a magnitude of movement identified for the animal is greater than the threshold value if the calculated expected speed is greater than or equal to the reference speed, and an operation of capturing an image including the animal based on the first exposure value.

[0124] In one embodiment, the method may further include an operation of determining that a magnitude of movement identified for the animal is less than the threshold value if the calculated expected speed is less than the reference speed, and an operation of capturing an image including the animal based on the second exposure value.

[0125] In one embodiment, the operation of identifying the movement of the animal included in the preview image may include an operation of estimating that the magnitude of the identified movement of the animal is less than the threshold value if it is determined that the body part of the animal corresponds to at least one of the head, ears, torso, or tail, and an operation of capturing an image including the animal based on the second exposure value.

[0126] In one embodiment, the method may further include an operation of setting the sharpness or color correction level of the camera (310) to a first level if the magnitude of the identified movement is greater than the threshold value, and an operation of setting the sharpness or color correction level of the camera (310) to a second level lower than the first level if the magnitude of the identified movement is less than the threshold value.

[0127] In one embodiment, a computer-readable recording medium having recorded thereon computer-executable programs may be caused by the computer to perform an operation of checking a movement of an animal included in a preview image acquired using a camera while displaying the preview image on a display, an operation of obtaining a captured image based on a first exposure value through the camera if the magnitude of the identified movement is greater than a threshold value, and an operation of obtaining a captured image based on a second exposure value greater than the first exposure value through the camera if the magnitude of the identified movement is less than the threshold value.

[0128] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0129] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0130] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0131] The term "module" as used herein may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0132] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0133] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0134] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (300), Camera (310); display (320); Processor (330); and Contains a memory (340) for storing instructions, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, While displaying the preview image acquired using the above camera (310) on the display (320), the movement of the animal included in the preview image is confirmed, If the size of the movement confirmed above is greater than the threshold value, an image captured based on the first exposure value is acquired through the camera, An electronic device, wherein the electronic device is set to acquire an image captured based on a second exposure value greater than the first exposure value through the camera if the size of the movement confirmed above is less than the threshold value.

2. In claim 1, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, While displaying the above preview image on the display (320), first information for identifying a body part of the animal and second information for determining whether movement of the animal occurs are obtained, An electronic device configured to identify movement of an animal included in the preview image based on the first information and the second information.

3. In claim 2, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, Divide the above preview image into multiple regions, By analyzing the area in which the animal is detected among the above multiple areas, the body part of the animal is identified, An electronic device configured to analyze the movement of pixels in each of the plurality of regions to determine whether movement of the animal has occurred.

4. In claim 2, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, If it is determined that the body part of the above animal corresponds to at least one of an arm or a leg, it is determined whether movement has occurred for the animal based on the second information, An electronic device configured to calculate an expected speed according to the movement of the animal when it is determined that movement has occurred in the animal.

5. In claim 4, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, Extracting optical flow from multiple frames acquired at specified time intervals while providing the above preview image, Estimate the pixel movement within the preview image based on the extracted optical flow, An electronic device configured to calculate the expected speed based on the estimated pixel movement.

6. In claim 4, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, If the above calculated expected speed is greater than or equal to the reference speed, the size of the movement confirmed for the animal is judged to be greater than the threshold value, An electronic device configured to capture an image including the animal based on the first exposure value.

7. In claim 4, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, If the above calculated expected speed is less than the reference speed, the size of the movement confirmed for the animal is judged to be less than the threshold value, An electronic device configured to capture an image including the animal based on the second exposure value.

8. In claim 1, The above processor (330) causes the electronic device (300) to, when the above instructions are executed, If it is determined that the body part of the animal corresponds to at least one of the head, ears, torso or tail, it is estimated that the magnitude of the movement identified for the animal is less than the threshold value. An electronic device configured to capture an image including the animal based on the second exposure value.

9. In the operating method of the electronic device (300), An action of checking the movement of an animal included in a preview image obtained using a camera (310) while displaying the preview image on a display (320); If the size of the above-determined movement is greater than a threshold value, an operation of acquiring an image captured based on a first exposure value through the camera (310); and If the size of the movement confirmed above is smaller than the threshold value, an operation of acquiring a captured image based on a second exposure value greater than the first exposure value through the camera (310) A method comprising:

10. In claim 9, The action of checking the movement of the animal included in the above preview image is, An operation of obtaining first information for identifying a body part of the animal and second information for determining whether movement of the animal occurs while displaying the preview image on the display (320); and A method including an action of confirming the movement of an animal included in the preview image based on the first information and the second information.

11. In claim 10, The action of checking the movement of the animal included in the above preview image is, If it is determined that the body part of the animal corresponds to at least one of an arm or a leg, an action of determining whether movement has occurred for the animal based on the second information; and A method comprising calculating an expected speed according to the movement of the animal when it is determined that movement has occurred with respect to the animal.

12. In claim 11, The action of calculating the expected speed according to the movement of the above animal is, An operation of extracting optical flow from a plurality of frames acquired at specified time intervals while providing the above preview image; An operation of estimating pixel movement within the preview image based on the extracted optical flow; and A method comprising the operation of calculating the expected velocity based on the estimated pixel movement.

13. In claim 11, An action of determining that the size of the movement confirmed for the animal is greater than the threshold value if the calculated expected speed is greater than or equal to the reference speed; and A method further comprising the action of capturing an image including the animal based on the first exposure value.

14. In claim 11, If the calculated expected speed is less than the reference speed, an action is taken to determine that the size of the movement confirmed for the animal is less than the threshold value; and A method further comprising the action of capturing an image including the animal based on the second exposure value.

15. In a computer-readable recording medium on which programs executable on a computer are recorded, The above programs are, An action of checking the movement of an animal included in a preview image obtained using a camera while displaying the preview image on a display; If the size of the above-determined movement is greater than a threshold value, an operation of acquiring an image captured based on a first exposure value through the camera; and A recording medium caused by the computer to perform an operation of acquiring a captured image based on a second exposure value greater than the first exposure value through the camera if the size of the above-determined movement is less than the threshold value.

Citation Information

Patent Citations

  • How to control automatic exposure of the camera

    KR100404088B1

  • Electronic device for capturing image based on difference between a plurality of images and method thereof

    KR1020180090695A

  • Eco-friendly oxygen water spray system for reducing organic contaminant

    KR1020250018288A

  • Method for improving subject recognition rate using thermal sensor and camera using the same

    KR102513818B1

  • Motion based exposure control

    US11671714B1