ELECTRONIC EQUIPMENT, METHODS OF PHOTOGRAPHING EVENTS, AND STORAGE MEDIA

Abstract

The invention relates to an electronic device, a method of capturing images with a sequence of events, and a storage medium. In accordance with the invention, the electronic device (101) may consist of a camera (180, 380), a screen (160, 360), at least one processor (120, 320), and memory (130, 330). In one scheme, the memory may store instructions configured so that, when executed by at least one processor, the electronic device may perform: display the camera-acquired preview image on the screen; receive first input to capture a still image while displaying the preview image on the screen; in response to receiving first input, detect the amount of change of an object in the preview image; on the basis of the amount of change of the object, determine whether an event has occurred in the preview image; When it is determined that an event has occurred in the preview image, define an event segment including the start and end times of the event; and store the animation corresponding to the event segment along with the still image.

Description

Electronic device for taking pictures including event sections, method of operation thereof and storage medium

[0001] One embodiment disclosed in this document relates to an electronic device for taking pictures including an event section, a method of operating the same, and a storage medium.

[0002] As the variety of services and additional features offered through electronic devices such as smartphones continues to increase, a variety of applications capable of running on these devices are being developed. Furthermore, the hardware and / or software components of these devices are also continuously evolving.

[0003] For example, there are camera applications that capture images (e.g., still images or videos) using cameras installed on electronic devices, and the number of users using camera applications to capture and view videos is increasing. Furthermore, there is a need to share user-created content (UCC, user-created content) captured or created by users to capture moments they don't want to miss with other users via social network services (SNS, social network services). For example, when taking photos using cameras on electronic devices, new types of shooting functions that are different from existing photos or videos are being developed. Therefore, if videos of unforgettable moments can be provided along with photos, user convenience can be increased.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] According to one embodiment, the electronic device (101) may include a camera (180, 380), a display (160, 360), at least one processor (120, 320), and a memory (130, 330). According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to display a preview image acquired through the camera on the display.

[0006] In one embodiment, the instructions may be configured to cause the electronic device to receive a first input for capturing a still image while displaying the preview image on the display.

[0007] According to one embodiment, the instructions may be configured to cause the electronic device to detect a change in an object included in the preview image in response to receiving the first input.

[0008] According to one embodiment, the instructions may be configured to cause the electronic device to identify whether an event occurs within the preview image based on a change in the object.

[0009] In one embodiment, the instructions may be configured to cause the electronic device to determine an event segment including a start time and an end time of the event when the electronic device identifies that the event has occurred within the preview image.

[0010] According to one embodiment, the instructions may be configured to cause the electronic device to store a moving image corresponding to the event section together with the still image.

[0011] According to one embodiment, a method for taking a picture including an event section in an electronic device may include an action of displaying a preview image acquired through a camera.

[0012] According to one embodiment, the method may include receiving a first input for capturing a still image while displaying the preview image.

[0013] According to one embodiment, the method may include an operation of detecting a change amount of an object included in the preview image in response to receiving the first input.

[0014] According to one embodiment, the method may include an operation of identifying whether an event occurs within the preview image based on a change amount of the object.

[0015] According to one embodiment, the method may include an operation of determining an event section including a start time and an end time of the event, if the event is identified as having occurred within the preview image.

[0016] In one embodiment, the method may include storing a video corresponding to the event section together with the still image.

[0017] According to one embodiment, in a non-transitory storage medium storing instructions, the instructions, when executed by at least one processor (120, 320) of an electronic device (101), are configured to cause the electronic device to perform at least one operation, wherein the at least one operation may include an operation of displaying a preview image acquired through a camera.

[0018] In one embodiment, the at least one operation may include receiving a first input for capturing a still image while displaying the preview image.

[0019] According to one embodiment, the at least one operation may include an operation of detecting a change amount of an object included in the preview image in response to receiving the first input.

[0020] In one embodiment, the at least one action may include an action of identifying whether an event occurs within the preview image based on a change amount of the object.

[0021] In one embodiment, the at least one operation may include an operation of determining an event section including a start time and an end time of the event, if the event is identified as having occurred within the preview image.

[0022] In one embodiment, the at least one action may include storing a video corresponding to the event section together with the still image.

[0023] A computer-readable non-transitory recording medium according to one embodiment of the present disclosure may store at least one command and / or instructions that, when executed, cause an electronic device to perform the method or operation of the electronic device described above.

[0024] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0025] Figure 2 is a drawing for explaining a method of acquiring a moving image together with a still image when taking a photo.

[0026] Figure 3 is an internal block diagram of an electronic device according to one embodiment.

[0027] FIG. 4 is a file structure diagram including a video of an event section stored together with a still image according to one embodiment.

[0028] FIG. 5 is a flowchart illustrating an operation of an electronic device for taking pictures including an event section according to an embodiment.

[0029] FIG. 6 is a flowchart illustrating an operation of an electronic device for identifying an event section when taking a photo according to one embodiment.

[0030] FIG. 7 is a diagram illustrating a method for determining an event section according to one embodiment.

[0031] Figure 8 is an example screen before and after taking a photo according to one embodiment.

[0032] FIG. 9 is a flowchart illustrating the operation of an electronic device for playing back an image according to an embodiment.

[0033] FIG. 10 is a diagram for explaining a playback method that varies depending on event properties according to one embodiment.

[0034] FIG. 11 is a diagram illustrating a method for playing a video at a playback speed determined according to an event attribute according to one embodiment.

[0035] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0036] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0037] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0038] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0039] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0040] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0041] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0042] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0043] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0044] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0045] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0046] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0047] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0048] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0049] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0050] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0051] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0052] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0053] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0054] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0055] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0056] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0057] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0058] In the detailed description below, reference numerals in the drawings may be used interchangeably or omitted for configurations that can be easily understood through the preceding embodiments, and their detailed descriptions may also be omitted. The electronic device (101) according to one embodiment disclosed in this document may be implemented by selectively combining configurations of various embodiments, and the configurations of one embodiment may be replaced by the configurations of another embodiment. For example, it should be noted that the present disclosure is not limited to specific drawings or embodiments.

[0059] Before describing the present disclosure, a method for capturing a portion of a moving picture or video used in the present disclosure as a photograph will be described with reference to FIG. 2. FIG. 2 is a diagram for explaining a method for acquiring a moving picture along with a still image when taking a photo.

[0060] Referring to FIG. 2, the electronic device (101) can provide various shooting modes. For example, the camera application can provide a motion photo mode in which a video is shot along with a still image as a shooting mode.

[0061] In the case of motion photo mode, if the user presses the button (e.g., shutter) (210) for taking (or capturing) a still image while the motion photo function is turned on (or activated), the user can save a video (220) of a specified period of time before or after the still image taking time. Therefore, even if the user takes pictures in the same way as taking general pictures, the user can simultaneously obtain a video (240) having a playback section for the still image (250). In this way, the motion photo function can automatically create and save a video together with a still image (or photograph) of a specific moment, but the section in which the video is saved can be fixed to a certain period of time based on the time at which the button (e.g., shutter) (210) for taking a still image is pressed, for example, a specified time before the taking time (e.g., from -3 seconds to the capturing time), a specified time before or after the taking time (e.g., from -1.5 seconds to 1.5 seconds), or a specified time after the taking time (e.g., from +3 seconds to the capturing time). If the user presses the shooting button (210) at the moment of jumping as illustrated in FIG. 2, the electronic device (101) can acquire (or capture) a still image (250) at the time the shooting button is pressed (210). The electronic device (101) can store a video (240) corresponding to a video storage section (220) of a specified time based on the shooting time together with a still image (250) in the form of a jpeg file. In this way, when a video of a fixed time based on the shooting time is stored when taking a still image, a video unrelated to the event occurrence section (230) corresponding to the actual jumping moment may be stored. Therefore, if a video of a moment that the user does not want to miss can be provided together with a photo, the user's convenience can be increased.

[0062] According to one embodiment, the present invention relates to an electronic device for taking pictures including an event section, an operating method thereof, and a storage medium, which can determine an event section for a specific moment in a preview image when taking a picture and provide a video including the event section.

[0063] Figure 3 is an internal block diagram of an electronic device according to one embodiment.

[0064] Referring to FIG. 3, the electronic device (101) may include at least one processor (320), memory (330), display (360), and / or camera (380). The electronic device (101) of FIG. 3 may be the electronic device (101) of FIG. 1. Here, not all components illustrated in FIG. 3 are essential components of the electronic device (101), and the electronic device (101) may be implemented with more or fewer components than the components illustrated in FIG. 3. In addition, FIG. 4 will be referred to when describing FIG. 3. FIG. 4 is a file structure diagram including a moving picture regarding an event section stored together with a still image according to an embodiment.

[0065] Referring to FIG. 3, the processor (320) can control the camera (380) to be driven when a camera application (e.g., a program or function) is executed. The processor (320) can identify that there is a shooting request and execute the camera application when an input by an execution icon (e.g., an object, a graphic element, a menu, a button, or a shortcut image) (not shown) representing a camera application displayed on a home screen (not shown) of the display (360), a designated button input, or an input by a designated gesture is received, for example.

[0066] According to one embodiment, the processor (320) may control at least one camera (380) to activate and execute content capture upon execution of a camera application. The processor (320) may control the display (360) to display a preview screen when capturing content. Among the shooting modes provided by the camera application, the motion photo mode may be provided in the form of a menu on the preview screen. In addition, the motion photo mode may be preset through a separate setting menu.

[0067] For example, when the user has turned on (or activated) the motion photo function while the preview screen is displayed, when the user presses a button (e.g., shutter) to take (or capture) a still image, the processor (320) may activate at least one microphone (e.g., microphone (150) of FIG. 1) to receive an audio signal (or sound signal) corresponding to a sound generated by the user, the subject, or the surroundings of the subject while generating a still image and a part of the still image as a video based on the preview screen during photo taking. The content may be, for example, video content taken by the user. In the following description, the video content may include a visual image and an auditory sound, and the still image may be a photo file in a format (e.g., jpeg format) captured at the time the shooting button is pressed.

[0068] In this way, the processor (320) can capture still images using the camera (380), and when capturing still images, can create a video together with the still image to create and / or store a single still image file (e.g., a jpeg file). In one embodiment, a file in which a still image and a video are composed as a single file can be played back as a still image and a video, respectively.

[0069] Referring to FIG. 3, an image acquired (projected) through an image sensor (381) (e.g., a front sensor or a rear sensor) of a camera (380) can be signal-processed into an image for display (360)-based preview output, a still image actually captured, and a video including a section where an event occurred, through an image signal processor (ISP) (383).

[0070] For example, the image signal processor (383) may provide an image (or a first image or a low-resolution image) having a smaller resolution than the size of an actual captured image to the display (360) as a preview image to be displayed on the display (360) of the electronic device (101). The image signal processor (383) may provide the preview image to the processor (320). According to one embodiment, the first image in the image signal processor (383) may be provided as a path for displaying the preview image by the display (360) and as a path for acquiring a moving image by the processor (320).

[0071] The image signal processor (383) may provide the processor (320) with a still image (or a second image or a high-resolution image) of higher quality and resolution than the preview image in response to a user input (e.g., pressing a shooting button). According to one embodiment, the second image may be captured based at least in part on a shooting option (e.g., resolution, quality, or size) set in the electronic device (101), and may be captured with various qualities and resolutions depending on the shooting option.

[0072] According to one embodiment, the electronic device (101) may not include an image signal processor (383) in the camera (380). For example, the image signal processor (383) may be configured independently in the electronic device (101) or may be configured in the processor (320).

[0073] The processor (320) may include, for example, a data generation unit (310) and a data reproduction unit (315). The data generation unit (310) may be configured to include a video storage unit (311), a still image storage unit (312), and a splitter (313). The video storage unit (311) and the still image storage unit (312) may be configured to include at least one buffer. The data reproduction unit (315) may be configured to include a file analysis unit (316) and a video reproduction unit (317). Here, each component included in the processor (320) may be provided in the electronic device (101) in the form of a 'module' or 'unit', or may be provided in the form of software in the memory (330).

[0074] According to one embodiment, the processor (320) may receive user settings (e.g., shooting resolution, focus, or shooting button) and control changing camera settings, shooting still images, shooting videos, and storing them. The processor (320) may receive a first image (e.g., a video, a preview image) and a second image (e.g., a still image) from the image signal processor (383), store (e.g., buffer) the first image through the video storage unit (311), and store (e.g., buffer) the second image through the still image storage unit (312). The processor (320) may combine the first image (e.g., a video) and the second image (e.g., a still image) stored in the video storage unit (311) and the still image storage unit (312), respectively, into one file through the splitter (313).

[0075] According to one embodiment, the processor (320) may operate to acquire (or generate) a video based on an image of a section in which an event occurred at the time of capturing a still image based on a user input. For example, when the processor (320) detects a still image capture, the processor (320) may operate to store the still image in the still image storage unit (312) and store a buffered video of the section in which an event occurred based on the time of capturing the still image in the video storage unit (311).

[0076] In one embodiment, the processor (320) may, in response to an input to capture a still image while displaying the preview image on the display (360), identify whether an event occurs within the preview image.

[0077] The preview image may include an object corresponding to the subject. "Subject" refers to the object being photographed, and can be used to refer to people or objects. The preview image may include an object corresponding to the subject.

[0078] For example, the processor (320) can compare a plurality of consecutive image frames of a certain time interval included in the preview image based on the still image shooting time (or capture time). For example, in the case of the optical flow method, the movement in the image can be distinguished by calculating and extracting the motion of each pixel through the relationship between the pixel value and the surrounding pixels by using the difference between the previous frame and the current frame. In this way, the section for comparing image frames used to identify whether an event is included can be defined as a video analysis section.

[0079] According to one embodiment, the processor (320) (or data generation unit (310)) may perform operations of video analysis section detection, event section determination, and / or video storage section generation to determine an event section for a specific moment in a preview image when taking a photo and provide a video including the event section.

[0080] According to one embodiment, the video analysis section may be a section from a time specified before the still image capture time to the time at which the user ends the capture (or capture duration). For example, if the start time of the video analysis section is m1, the end time is m2, and the still image capture time is c, m1 may be a time obtained by subtracting a specified time (e.g., 3 seconds) from the still image capture time (c), and m2 may be a capture end time instructed by the user. For example, m1 may be a time at which the user ends the action of lifting the electronic device (101) to start capturing while the preview screen is displayed, i.e., a time at which the movement of the electronic device (101) stops. In addition, the capture end time instructed by the user may be a time at which the user puts down the electronic device (101) after holding it for capturing and no longer wants to capture. Accordingly, the processor (320) can detect an intended movement to start or end shooting using movement information of the electronic device (101) using at least one sensor (e.g., the sensor module (176) of FIG. 1). In addition, since the user can shoot still images as many times as desired from the still image shooting time point (c) until the shooting is ended by the user, the video analysis section can be determined for each still image shooting time point (c).

[0081] In one embodiment, the processor (320) (or data generation unit (310)) can identify whether an event has occurred by comparing a plurality of image frames corresponding to the video analysis section.

[0082] In one embodiment, the processor (320) may predefine a primary object (e.g., a person, a pet, food, or an object) and / or an action of the object (e.g., jumping, dancing, running, eating, or exercising) to be focused on within a plurality of image frames, and detect image frames in which the predefined primary object or the primary action of the object is recognized. For example, the processor (320) may identify whether an event has occurred by recognizing a primary object and / or an action of the object within the image frame using a learning network model acquired through learning.

[0083] In one embodiment, the processor (320) may identify the amount of change in an object within a plurality of image frames. For example, the processor (320) may identify the amount of change in an object based on at least one of an event occurrence location, direction, size, or speed within a plurality of image frames corresponding to the video analysis section within a preview image. The processor (320) may identify that the event has occurred within the preview image when the amount of change in the object is greater than or equal to a threshold value. On the other hand, the processor (320) may identify that the event has not occurred within the preview image when the amount of change in the object is less than the threshold value.

[0084] In one embodiment, the processor (320) can identify whether an event has occurred by detecting a change in motion information within a plurality of image frames. The processor (320) can calculate the change in motion information between image frames using changes in size, position, direction, speed, and / or color of the motion.

[0085] In one embodiment, the processor (320) may determine at least one frame in which the average value of the motion vector for each image frame from among a plurality of image frames is continuously greater than the sequence average value of the motion vector for the plurality of image frames by a preset number of frames or more, as a section including an event. In addition, the processor may determine at least one frame in which the average value of the motion vector for each image frame is continuously greater than a threshold value by a preset number of frames or more, as a section including an event. Here, the threshold value may be set based on various conditions, such as the resolution of the preview image.

[0086] As described above, the types of events within the preview video may vary, and accordingly, the methods for identifying whether an event has occurred and determining the event section may also vary, and thus may not be limited thereto.

[0087] In one embodiment, if the processor (320) (or the data generation unit (310)) identifies that an event has occurred within a plurality of image frames corresponding to a video analysis section, the processor (320) may determine an event section. For example, the processor (320) may detect an amount of change in an object within the plurality of image frames. If the amount of change in an object is greater than or equal to a threshold value, the start time of the event may be determined based on the amount of change in the object greater than or equal to the threshold value. If the amount of change in the object changes to be less than the threshold value, the end time of the event may be determined based on the amount of change in the object less than the threshold value, thereby determining the event section. The processor (320) may estimate event-related information in the event section and generate meta information about the event section. Here, the meta information about the event section may include the location, direction, size, and / or speed of the event occurrence.

[0088] In one embodiment, the processor (320) (or data generation unit (310)) may determine a video storage section such that an event section in which an event occurs is included in the video storage section, and store a video corresponding to the determined video storage section together with a still image in the memory (330).

[0089] In one embodiment, the processor (320) may use the start time of an event, the still image capture time, and / or the capture end time instructed by the user when determining the video storage section.

[0090] In one embodiment, the processor (320) may determine the video storage section by determining the start time of the video storage section as the start time of the event section when the start time of the event section is before the still image capture time, and determining the end time of the video storage section as the time after a specified time has elapsed from the start time of the event section.

[0091] In one embodiment, the processor (320) determines the end point of the video storage section as the end point of the shooting instructed by the user when the start point of the event section is before the still image shooting point, and determines the start point of the video storage section as the time obtained by subtracting the specified time from the end point of the shooting, thereby determining the video storage section.

[0092] In one embodiment, the processor (320) determines the end point of the video storage section as the end point of the shooting indicated by the user when the start point of the event section is after the still image shooting point, and determines the start point of the video storage section as the time obtained by subtracting the specified time from the end point of the shooting, thereby determining the video storage section.

[0093] As described above, by adaptively adjusting the video storage section based on the start time of the event, the still image capture time, and / or the capture end time instructed by the user, the processor (320) can acquire a video storage section including the event section. Accordingly, the processor (320) can acquire a video corresponding to the video storage section and store it in the video storage unit (311), and the video may include videos of the event section. A method for determining such a video storage section will be described later with reference to FIG. 7.

[0094] The processor (320) can operate to integrate (add) a video stored in the video storage unit (311) to a still image (e.g., the front or back part of the still image) stored in the still image storage unit (312) through the splitter (313) to form a single file. The processor (320) can form a still image and a video into a single file and store the formed file in the memory (330).

[0095] Refer to Fig. 4 to see an example of the configuration of a file stored in memory (330).

[0096] FIG. 4 illustrates an example of a single file structure in which still images and videos are integrated, wherein still images (410) and videos (420) can be separated and configured as a single file. As illustrated in FIG. 4, the still image (410) may be a video (414) of a specified format (e.g., jpeg file format) regarding a specific moment in the form of a single video frame (412). On the other hand, the video (420) may be a video (420) regarding an event section (424) in the form of a plurality of video frames (422). For example, the processor (320) may acquire videos at a high speed (or a specified frame rate) when recording the video (420) in order to output (or play, display) the video in slow motion, and may store the videos acquired at a high speed based on a normal speed. To this end, the processor (320) may store metadata regarding the event section together with the video (420). Accordingly, the processor (320) can play a video with a slow motion effect based on the meta information for the event section.

[0097] In FIG. 4, a case is exemplified where still images (410) and videos (420) are not stored and managed in different memory areas, but are stored and managed as a single file. However, video linkage information, rather than the video (420) itself, may be stored and managed as a single file with the still image (410). That is, the video (420) may be stored in a different location in the memory (330) separately from the still image (410), and the still image (410) may be created as a still image file by adding linkage information (e.g., link information) of the video stored in a different location in the memory (330) to the still image (e.g., the front or back of the still image). For example, the still image and the video may be stored and managed in different memory areas. The linkage information may include, for example, the location in the memory (330) where the video is stored and / or the file name of the video. According to one embodiment, the linkage information may include meta information about the event section.

[0098] According to one embodiment, the processor (320) may play a file composed of a still image and a moving image in response to a user input (e.g., a video playback input) and display the same through the display (360). In response to detecting a user input for playing the file stored in the memory (330), the processor (320) may analyze and distinguish (or separate) a still image portion (e.g., a still image (410) of FIG. 4) and a moving image portion (e.g., a moving image (420) of FIG. 4) from the file through the file analysis unit (316).

[0099] According to one embodiment, the processor (320) may display a guide for playing a video while a still image is displayed on the display (360). In response to receiving a user input for playing the video, the processor (320) may check meta information to play a portion of the video including an event section.

[0100] The processor (320) may control the video playback unit (317) to play a video portion from the file and display it through the display (360). According to one embodiment, the processor (320) may cause a still image application (e.g., a gallery application) (not shown) to display a still image portion from the file, and may cause the video playback unit (317) to play a video portion from the file based on the meta information. Accordingly, a portion of the video corresponding to the event section may be played at a playback speed corresponding to the meta information. According to one embodiment, the processor (320) may perform video playback from the start position of the video after the still image in the file based on the meta information. The processor (320) may end video playback at the end position of the video and display the still image again.

[0101] According to one embodiment, the electronic device (101) may include a camera (180, 380), a display (160, 360), at least one processor (120, 320), and a memory (130, 330). According to one embodiment, the memory may store instructions that, when executed by the at least one processor, cause the electronic device to display a preview image acquired through the camera on the display.

[0102] In one embodiment, the instructions may be configured to cause the electronic device to receive a first input for capturing a still image while displaying the preview image on the display.

[0103] According to one embodiment, the instructions may be configured to cause the electronic device to detect a change in an object included in the preview image in response to receiving the first input.

[0104] According to one embodiment, the instructions may be configured to cause the electronic device to identify whether an event occurs within the preview image based on a change in the object.

[0105] In one embodiment, the instructions may be configured to cause the electronic device to determine an event segment including a start time and an end time of the event when the electronic device identifies that the event has occurred within the preview image.

[0106] According to one embodiment, the instructions may be configured to cause the electronic device to store a moving image corresponding to the event section together with the still image.

[0107] According to one embodiment, the instructions may be configured to cause the electronic device to play the video based on meta information about the event segment in response to receiving a second input for playing the video.

[0108] According to one embodiment, the instructions may be configured to cause the electronic device to identify an amount of change in the object based on at least one of an event occurrence location, direction, size, or speed within the preview image, and to identify that the event has occurred within the preview image in response to the amount of change in the object being greater than or equal to a threshold value, and to identify that the event has not occurred within the preview image in response to the amount of change in the object being less than the threshold value.

[0109] According to one embodiment, the instructions may be configured to generate meta information for the event interval indicating the amount of change of the object, and store the meta information for the event interval in association with the video.

[0110] According to one embodiment, the instructions may be configured to determine a video storage section including the determined event section and to store the video corresponding to the determined video storage section.

[0111] According to one embodiment, the instructions may be configured to determine the start time of the video storage section as the start time of the event section when the start time of the event section is before the time of receiving the first input, and to determine the end time of the video storage section as a time after a specified time has elapsed from the start time of the event section.

[0112] According to one embodiment, the instructions may be set to determine the end time of the video storage section as the shooting end time instructed by the user when the start time of the event section is before the reception time of the first input, and to determine the start time of the video storage section as the time obtained by subtracting the specified time from the shooting end time.

[0113] According to one embodiment, the instructions may be set to determine the end time of the video storage section as the shooting end time instructed by the user when the start time of the event section is after the time of receiving the first input, and to determine the start time of the video storage section as the time obtained by subtracting the specified time from the shooting end time.

[0114] According to one embodiment, the instructions may be configured to detect an amount of movement of the electronic device using at least one sensor of the electronic device, and determine a shooting end point instructed by the user based on the amount of movement.

[0115] According to one embodiment, the instructions may be configured to display a guide for playing the video while the still image is displayed on the display, and, in response to receiving a second input for playing the video, check meta information for the event section, and play a portion of the video corresponding to the event section at a playback speed corresponding to the meta information.

[0116] FIG. 5 is a flowchart illustrating an operation of an electronic device for taking a picture including an event section according to an embodiment. Referring to FIG. 5, the operation method may include operations 505 to 525. Each operation of the operation method of FIG. 5 may be performed by an electronic device (e.g., the electronic device (101) of FIGS. 1 and 3 )) and at least one processor of the electronic device (e.g., the processor (120) of FIG. 1 and the processor (320) of FIG. 3 ). In an embodiment, at least one of operations 505 to 525 may be omitted, the order of some operations may be changed, or another operation may be added.

[0117] Referring to FIG. 5, when a camera application is selected by a user, the electronic device (101) can display a preview image acquired through the camera (380) on the display (360) in operation 505.

[0118] In operation 510, the electronic device (101) can receive a first input for capturing a still image while displaying the preview image.

[0119] In operation 515, the electronic device (101) can detect the amount of change in an object included in the preview image in response to receiving the first input.

[0120] In operation 520, the electronic device (101) can identify whether an event occurs within the preview image based on the amount of change in the object.

[0121] According to one embodiment, the electronic device (101) may identify the amount of change in the object based on at least one of the location, direction, size, or speed of the event occurrence within the preview image. The electronic device (101) may identify that the event has occurred within the preview image in response to the amount of change in the object being greater than or equal to a threshold value. On the other hand, the electronic device (101) may identify that the event has not occurred within the preview image in response to the amount of change in the object being less than the threshold value.

[0122] In operation 525, if the electronic device (101) identifies that the event has occurred within the preview image, it can determine an event section including the start time and end time of the event.

[0123] In operation 530, the electronic device (101) can store a video corresponding to the event section together with the still image.

[0124] According to one embodiment, the electronic device (101) can generate meta information for the event section indicating the amount of change of the object, and store the meta information for the event section in association with the video.

[0125] According to one embodiment, the electronic device (101) can determine a video storage section to include the determined event section, and store the video corresponding to the determined video storage section.

[0126] According to one embodiment, the electronic device (101) may determine the start time of the video storage section as the start time of the event section when the start time of the event section is before the time of receiving the first input, and determine the end time of the video storage section as the time after a specified time has elapsed from the start time of the event section.

[0127] According to one embodiment, the electronic device (101) may determine the end time of the video storage section as the shooting end time instructed by the user when the start time of the event section is after the time of receiving the first input, and may determine the start time of the video storage section as the time obtained by subtracting the specified time from the shooting end time.

[0128] According to one embodiment, the electronic device (101) can check the amount of movement of the electronic device (101) using at least one sensor of the electronic device (101) and determine the shooting end time instructed by the user based on the amount of movement.

[0129] According to one embodiment, the electronic device (101) may, in response to receiving a second input for playing the video, play the video based on meta information about the event section.

[0130] According to one embodiment, the electronic device (101) may display a guide for playing the video while the still image is displayed, and in response to receiving a second input for playing the video, check meta information for the event section, and play a part of the video corresponding to the event section at a playback speed corresponding to the meta information.

[0131] FIG. 6 is a flowchart illustrating an operation of an electronic device for identifying an event section during photo shooting according to an embodiment. Referring to FIG. 6, the operation method may include operations 605 to 660. Each operation of the operation method of FIG. 6 may be performed by an electronic device (e.g., the electronic device (101) of FIGS. 1 and 3 )) and at least one processor of the electronic device (e.g., the processor (120) of FIG. 1 and the processor (320) of FIG. 3 ). In an embodiment, at least one of operations 605 to 660 may be omitted, the order of some operations may be changed, or other operations may be added. In addition, when describing FIG. 6 , reference will be made to FIG. 7 . FIG. 7 is a diagram illustrating a method for determining an event section according to an embodiment.

[0132] Referring to FIG. 6, the electronic device (101) can execute a camera application and activate the camera (380). The electronic device (101) can display a preview image corresponding to signals input from the camera (380). The preview image may be a preview image that shows the image to be captured in advance through the display (360) before capturing.

[0133] In operation 605, while operating in motion photo mode, the electronic device (101) can identify whether there is a still image capture request in operation 610. In response to receiving a still image capture request, the electronic device (101) can determine a video analysis section in operation 615. In operation 610, if a still image capture request is not received, the electronic device (101) can continue to display a preview image.

[0134] For example, referring to FIG. 7, when the start time of a video analysis section (m) is m1, the end time is m2, and the capture time (or still image capture time) is C, m1 may be the capture time (C) minus a specified time (e.g., 3 seconds), and m2 may be the shooting end time (S) instructed by the user. The shooting end time (S) instructed by the user may be the time when the user puts down the electronic device (101) after holding it for shooting.

[0135] In operation 620, the electronic device (101) can analyze an event. For example, the electronic device (101) can analyze an event in a video analysis section (m= m1~m2). The electronic device (101) can analyze a plurality of image frames in the video analysis section to detect a change in motion between the image frames or a change in an object included in the image frames. The electronic device (101) can compare the change in motion or the change in the object with a threshold value.

[0136] In operation 625, the electronic device (101) can identify whether an event has occurred. For example, the electronic device (101) can identify the amount of change in the object based on at least one of the location, direction, size, or speed of the event occurrence within the preview image, and can identify that the event has occurred within the preview image in response to the amount of change in the object being greater than or equal to a threshold value.

[0137] On the other hand, if the amount of change in the object is less than the threshold value, it can be determined that no event has occurred in the preview image. For example, if a person or object moves at a location far from the camera (380) in the preview image, but the object's movement, e.g., the amount of change in the object, is not greater than the threshold value, it can be determined that no event has occurred in multiple image frames.

[0138] If it is determined that an event has not occurred, the electronic device (101) may perform operation 655. In operation 655, the electronic device (101) may set the video storage section (M) to a specified time before or after the capture time point (C). For example, as illustrated in 710 of FIG. 7, when the start time of the video storage section (M) is M1 and the end time is M2, if the event has not occurred, the video storage section (M = T1 to T2) may be determined as a section of a specified time (e.g., 3 seconds). For example, a section (e.g., C - 3 seconds) before the capture time point (C) may be determined as the video storage section (M). In addition, a section (e.g., C + 3 seconds) after the capture time point (C) may be determined as the video storage section (M).

[0139] On the other hand, if an event is identified as occurring, in operation 630, the electronic device (101) can determine the event interval (e.g., start / end). Here, E1 may represent the start time of the event, and E2 may represent the end time of the event.

[0140] In operation 635, the electronic device (101) can estimate event-related information. For example, the event-related information may include the location, direction, size, or speed of the event occurrence, and may be meta information about the event section.

[0141] In operation 640, the electronic device (101) can identify whether the event start time (E1) is before the capture time (C). If the event start time (E1) is before the capture time (C), in operation 645, the electronic device (101) can set a video storage section and record meta information about the event section together. For example, meta information that synchronizes information such as position, direction, size, or speed to correspond to the start time and end time of the event section can be generated and recorded. For example, referring to FIG. 7, when the start time of a video storage section (M) is M1, the end time is M2, and the capture time (C), the start time (M1) of the video storage section (M) can be determined by distinguishing whether the start time (E1) of the event is before or after the capture time (C).

[0142] As illustrated in 720 to 740 of FIG. 7, if the event start time (E1) is before the capture time (C), the start time (M1) of the video storage section can be determined as the event start time (E1), and the end time (M2) can be determined as a time point (e.g., E1+3 seconds) after a specified time (e.g., 3 seconds) has elapsed from the event start time (E1). Here, if the start time (M1) of the video storage section is referred to as the event start time (E1) or A, and the end time (M2) is referred to as B, the section between A and B can correspond to a specified time (e.g., 3 seconds).

[0143] In addition, as illustrated in 750 of FIG. 7, although the event start time (E1) is earlier than the capture time (C), the time from the event start time (E1) to the recording end time (S) may be less than a specified time (e.g., 3 seconds). For example, if the time from the event start time (E1) to the user's recording end time (S) is less than a specified time (e.g., 3 seconds), the video storage start time (M1=A) may be determined as time A (S-3 seconds) so that the specified time (e.g., 3 seconds) can be secured until the user's recording end time (S).

[0144] Accordingly, the electronic device (101) may determine the end time (M2) of the video storage section as the shooting end time (S) instructed by the user when the event start time (E1) is before the capture time (C), and may determine the start time (M1) of the video storage section as the time obtained by subtracting the specified time (e.g., 3 seconds) from the shooting end time (S). In addition, the electronic device (101) may determine the end time (M2=B=S) of the video storage section as the shooting end time (S).

[0145] On the other hand, if the event start time (E1) is later than the capture time (C), in operation 650, the electronic device (101) can set a video storage section and record meta information about the event section together. Here, the video storage section can be determined using the shooting end time (S) instructed by the user. If the event start time (E1) is later than the capture time (C), the electronic device (101) can determine the start time (M1) of the video storage section based on the shooting end time (S), regardless of the event start time (E1).

[0146] As illustrated in 760 and 770 of FIG. 7, the end point (M2) of the video storage section may be determined as the shooting end point (S) instructed by the user, and the start point (M1) of the video storage section may be determined as the time obtained by subtracting the specified time (e.g., 3 seconds) from the shooting end point (S). In addition, the electronic device (101) may determine the end point (M2=B=S) of the video storage section as the shooting end point (S).

[0147] In one embodiment, when a video storage section (M) including an event section (E) is determined in the same manner as in 710 to 770 of FIG. 7, the electronic device (101) can store a video including the event section as a motion photo together with a still image in operation 660. In addition, the electronic device (101) can acquire the video at a high speed (or a specified frame rate) when storing the video corresponding to the determined video storage section (M) in order to output (or play, display) the video in slow motion, and can record meta information about the video together.

[0148] Figure 8 is an example screen before and after taking a photo according to one embodiment.

[0149] Fig. 8 (a) illustrates a screen (810) where a preview image is displayed when a camera application is executed. Referring to Fig. 8 (a), in response to a user's selection of an object (820) indicating a motion photo function, the electronic device (101) can operate in motion photo mode. Accordingly, while operating in motion photo mode, the electronic device (101) can store a video including an event section together with a still image in response to an input to a button (830) for capturing a still image.

[0150] A user can check the stored video through a video-related application (e.g., a gallery application). FIG. 8 (b) illustrates a screen (860) in which thumbnail images (850) of a plurality of videos stored in the memory (330) are displayed when a video-related application (e.g., a gallery application) is executed. As shown in FIG. 8 (b), the electronic device (101) can intuitively recognize a video captured in the normal mode and a video captured in the motion photo mode by displaying an object (or indicator) (870) called 'View Motion Photo'. Accordingly, in response to a user selection of the object (870), the electronic device (101) can automatically output (or play) a video stored in conjunction with a still image. In one embodiment, since meta-information about an event section is stored in conjunction with a video, video playback can be controlled based on the meta-information. This will be described with reference to FIGS. 9 to 11.

[0151] FIG. 9 is a flowchart illustrating an operation of an electronic device for playing back a video according to an embodiment. Referring to FIG. 9, the operation method may include operations 905 to 950. Each operation of the operation method of FIG. 9 may be performed by an electronic device (e.g., the electronic device (101) of FIGS. 1 and 3 )) and at least one processor of the electronic device (e.g., the processor (120) of FIG. 1 and the processor (320) of FIG. 3 ). In an embodiment, at least one of operations 905 to 950 may be omitted, the order of some operations may be changed, or another operation may be added.

[0152] Referring to FIG. 9, in operation 905, the electronic device (101) may display an image in the gallery. In operation 910, the electronic device (101) may identify whether the image has an event section. In one embodiment, the electronic device (101) may display a plurality of thumbnail images as an application related to the image (e.g., a gallery application) is executed. For example, as in FIG. 8 (b), when one of the thumbnail images of the plurality of images is selected, it may be identified whether the selected image has an event section.

[0153] If the video does not have an event section, the electronic device (101) can play the video at a normal speed for a specified time (e.g., 3 seconds) in operation 940. For example, the video can be played at a specified speed (e.g., a fixed speed of 30 fps). For example, a compensation technology for specified speed playback is called frame interpolation or FRC (frame rate up conversion), and the electronic device (101) can generate and play the video at a selected FPS (frame per second) through the technology.

[0154] On the other hand, in operation 915, the electronic device (101) may extract meta information associated with the event section in response to identifying that the video has an event section. The meta information may include at least one of the location, size, direction, or speed of the event.

[0155] In operation 920, the electronic device (101) may determine a specific event within the event interval as the main event. For example, the main event may be determined by comparing at least one of the location, size, direction, or speed of the event with a threshold value. Here, the location, size, direction, or speed of the event, which are components of the meta information, may be compared with the threshold value through numerical quantification. Alternatively, components corresponding to each of the location, size, direction, or speed of the event may be created in a table format and used to determine the main event.

[0156] In operation 925, by identifying whether there is a main event section, in response to identifying that there is a main event section, the electronic device (101) can determine a playback speed corresponding to meta information during the main event section in operation 930.

[0157] In response to identifying that there is no main event section in operation 935, the electronic device (101) can determine a playback speed corresponding to the meta information during the event section in operation 935.

[0158] In operation 945, the electronic device (101) can vary the playback speed based on the playback speed determined in operations 930 to 940, and accordingly, in operation 950, the electronic device (101) can output (or play) the video in the gallery. For example, the playback speed can be switched between a normal playback speed and a variable playback speed (e.g., 30 fps to variable fps).

[0159] For example, referring to FIGS. 10 and 11, which are drawings for explaining a playback method that varies depending on an event attribute according to an embodiment, in a motion photo capture operation (1010, 1110), in order to output (or play, display) a video in slow motion, when saving a video, an image can be acquired at a high speed (or a specified frame rate). For example, when recording a video, the electronic device (101) can acquire an image at a high speed (or a specified frame rate), store the high-speed acquired images based on a normal speed, and when playing back, can play the video at a different playback speed by referring to meta information about the event section.

[0160] In the motion photo storage operation (1020, 1120), the electronic device (101) can store high-speed acquired images based on the normal speed, and can store event-related information such as event location, size, direction, or speed as meta information in synchronization with the video. Accordingly, in the motion photo display operation (1030, 1130), the electronic device (101) can play the video at a variable playback speed for the main event section if the main event section exists in the event section. For example, if there is an event section (or event occurrence section) (E) and a main event section (mE) (see operation 930), the playback speed can be varied at 30 fps if the main event section (mE) within the event section (E) is 3 seconds, and at 3*30 fps if it is 1 second. (For example, the motion photo showing operation (1030) of FIG. 10) For example, referring to the motion photo showing operation (1030) of FIG. 10, if there is a main event section (mE) within the event section (E), the video can be played at a first playback speed in the event section (E), and the video can be played at a second playback speed that is faster than the first playback speed for the main event section (mE) included in the event section (E).

[0161] For example, if the entire event section (E) is 3 seconds and the main event section (mE) included in the event section (E) is 3 seconds, the second playback speed for the main event section (mE) may be (3 / mE(e.g., 3 seconds))*30fps. In addition, if the entire event section (E) is 3 seconds and the main event section (mE) included in the event section (E) is 1 second, the video may be played at a first playback speed of (3 / E(e.g., 2 seconds))*30fps in the event section (e.g., 2 seconds) excluding the main event section (mE), and the video may be played at a second playback speed of (3 / mE(e.g., 1 second))*30fps in the main event section (mE). In addition, for the remaining event sections (E - mE) (e.g., 2 seconds) excluding the main event section (mE), the video may be played at a variable speed of the second playback speed (e.g., 90 fps) only for the main event section (mE) (e.g., 1 second), without performing an operation of varying the playback speed to the first playback speed (e.g., 45 fps).

[0162] For example, in order to output (or play back, display) a video in slow motion, when recording the video, images are acquired at a high speed (or a specified frame rate) and the high-speed acquired images are stored based on the normal speed. However, more frames are stored for the main event section (mE) than for the event section (E), but the video can be output at a different playback speed, so that the user can visually confirm the event section (E) and the main event section (mE) while watching the video played back at different playback speeds.

[0163] On the other hand, even if the main event section (mE) does not exist (see operation 935), the electronic device (101) can vary the playback speed depending on the length of the event section (E). Accordingly, the playback speed (or speed) of the event section (E) can be (3 seconds / E seconds)*30 fps. (Example: motion photo display operation (1130) of FIG. 11)

[0164] According to one embodiment, the electronic device (101) can play a video with a slow motion effect based on meta information for the main event section as well as the event section.

[0165] According to one embodiment, slow motion with variable playback speed is described as an example in FIG. 9, but for example, a zooming effect may be applied to an event section depending on the size or direction of the event, and the visual effects applicable to the event section may not be limited thereto.

[0166] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0167] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0168] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0169] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0170] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0171] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0172] According to one embodiment, in a non-transitory storage medium storing instructions, the instructions, when executed by at least one processor (120, 320) of an electronic device (101), are configured to cause the electronic device to perform at least one operation, wherein the at least one operation may include an operation of displaying a preview image acquired through a camera.

[0173] In one embodiment, the at least one operation may include receiving a first input for capturing a still image while displaying the preview image.

[0174] According to one embodiment, the at least one operation may include an operation of detecting a change amount of an object included in the preview image in response to receiving the first input.

[0175] In one embodiment, the at least one action may include an action of identifying whether an event occurs within the preview image based on a change amount of the object.

[0176] In one embodiment, the at least one operation may include an operation of determining an event section including a start time and an end time of the event, if the event is identified as having occurred within the preview image.

[0177] In one embodiment, the at least one action may include storing a video corresponding to the event section together with the still image.

[0178] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0179] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

Claims

1. In an electronic device (101), Camera (180, 380); Display (160, 360) At least one processor (120, 320); and Contains a memory (130, 330) for storing instructions, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: A preview image obtained through the above camera is displayed on the above display, Receiving a first input for capturing a still image while displaying the above preview image on the above display, In response to receiving the first input, detecting the amount of change in an object included in the preview image, Based on the amount of change in the above object, identify whether an event occurs within the above preview image, If the event is identified as occurring within the above preview video, an event section including the start and end points of the event is determined, An electronic device set to store a video corresponding to the above event section together with the still image.

2. In the first paragraph, the instructions cause the electronic device to: An electronic device, configured to play the video based on meta information about the event segment, in response to receiving a second input for playing the video.

3. In the first or second paragraph, the instructions cause the electronic device to: Identifying the amount of change of the object based on at least one of the location, direction, size or speed of the event occurrence in the above preview image, In response to the change amount of the above object being greater than or equal to a threshold value, the event is identified as having occurred within the above preview image, An electronic device configured to identify that no event has occurred within the preview image in response to the change amount of the object being less than the threshold value.

4. In any one of paragraphs 1 to 3, the instructions cause the electronic device to: Generate meta information for the event interval representing the amount of change in the object, An electronic device configured to store meta information about the above event segment in association with the above video.

5. In any one of paragraphs 1 to 4, the instructions cause the electronic device to: Determine the video storage section to include the event section determined above, An electronic device set to store the video corresponding to the video storage section determined above.

6. In any one of paragraphs 1 to 5, the instructions cause the electronic device to: If the start time of the above event section is before the time of receiving the first input, the start time of the video storage section is determined as the start time of the above event section, An electronic device set to determine the end point of the above video storage section as a point in time after a specified time has elapsed from the start point of the above event section.

7. In any one of paragraphs 1 to 6, the instructions cause the electronic device to: If the start time of the above event section is before the time of receiving the first input, the end time of the video storage section is determined as the end time of shooting indicated by the user, An electronic device set to determine the start time of the above video storage section as the time obtained by subtracting the specified time from the end time of the above shooting.

8. In any one of paragraphs 1 to 7, the instructions cause the electronic device to: If the start time of the above event section is after the time of receiving the first input, the end time of the video storage section is determined as the end time of shooting indicated by the user, An electronic device set to determine the start time of the above video storage section as the time obtained by subtracting the specified time from the end time of the above shooting.

9. In any one of paragraphs 1 to 8, the instructions cause the electronic device to: detecting the amount of movement of the electronic device by using at least one sensor of the electronic device; An electronic device set to determine the end point of shooting as instructed by the user based on the amount of movement.

10. In any one of paragraphs 1 to 9, the instructions cause the electronic device to: While the still image is displayed on the display, a guide for playing the video is displayed, In response to receiving a second input for playing the above video, the meta information for the event section is checked, An electronic device set to play a portion of the video corresponding to the event section at a playback speed corresponding to the meta information.

11. A method for taking pictures including an event section in an electronic device, An action that displays a preview image acquired through a camera; An action of receiving a first input for capturing a still image while displaying the above preview image; In response to receiving the first input, an operation of detecting the amount of change in an object included in the preview image; An action to identify whether an event occurs within the preview image based on the amount of change in the object; If the event is identified as occurring within the above preview image, an action of determining an event section including the start time and the end time of the event; and A method for taking a photograph including an event section, comprising the action of saving a moving image corresponding to the event section together with the still image.

12. In paragraph 11, A method for taking a picture including an event section, comprising: in response to receiving a second input for playing back the video, an action of playing back the video based on meta information about the event section.

13. In clause 11 or 12, the operation of determining the event section is: An action to identify the amount of change in the object based on at least one of the location, direction, size or speed of an event occurrence in the preview image; An action to identify that the event has occurred within the preview image in response to the change amount of the object being greater than or equal to a threshold value; and A method for taking a picture including an event section, the method including an action of identifying that no event has occurred within the preview image in response to the amount of change of the object being less than the threshold value.

14. In any one of clauses 11 to 13, the operation of storing a video corresponding to the event section together with the still image is as follows: An operation for generating meta information for the event interval representing the amount of change of the object; and A method for taking a picture including an event section, comprising an action of storing meta information about the event section in association with the video.

15. In a non-transitory storage medium storing instructions, the instructions are set to cause the electronic device (101) to perform at least one operation when executed by at least one processor (120, 320), the at least one operation being: An action that displays a preview image acquired through a camera; An action of receiving a first input for capturing a still image while displaying the above preview image; In response to receiving the first input, an operation of detecting the amount of change in an object included in the preview image; An action to identify whether an event occurs within the preview image based on the amount of change in the object; If the event is identified as occurring within the above preview image, an action of determining an event section including the start time and the end time of the event; and A storage medium including an action of storing a moving image corresponding to the above event section together with the still image.

Images