Electronic device and operation method of electronic device

The electronic device merges images within its camera application, addressing the need for separate editing programs and battery consumption by allowing users to merge images post-recording, enhancing user experience and storage efficiency.

WO2024242336A1PCT designated stage expired Publication Date: 2024-11-28SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005461
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-14
Filing Date
2024-04-23
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing electronic devices require separate editing programs to merge multiple images, leading to increased storage capacity usage and battery consumption due to continuous camera application operation during video recording pauses.

Method used

An electronic device with a camera and processor that displays a user interface for starting and ending video recording, allowing users to merge images without a separate editing program by identifying user inputs for merge shooting, acquiring images, and generating a merged image for storage.

Benefits of technology

Enables efficient merging of multiple images into one without additional editing software, improving user experience by allowing video selection and merging post-recording, while reducing battery consumption and storage needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005461_28112024_PF_FP_ABST
    Figure KR2024005461_28112024_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device is disclosed. An electronic device according to an embodiment of the present disclosure may comprise a camera, a memory, and at least one processor electrically connected to the camera and the memory, wherein the at least one processor is configured to: display a first user interface including a first object relating to a start and an end of video recording and a second object for merged image-capturing; identify a first user input through the first user interface; acquire a first image in response to identifying a user input relating to a start and an end of recording through the first object; identify a second image to be merged with the first image; generate a merged image by merging the first image and the second image; and store the generated merged image and merging information in the memory, wherein the first user input is one of a user input for selecting the second object and a press input for pressing the first object for a predetermined time or longer.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic devices and methods of operating electronic devices

[0001] Embodiments disclosed in this document relate to electronic devices and methods of operating electronic devices.

[0002] Electronic devices, such as smartphones, that include cameras can provide the ability to capture photos or videos using the camera. In this regard, applications are being developed not only for capturing videos but also for editing videos stored on the electronic device. Sometimes, a user's requested video requires multiple videos captured at different locations, times, or angles. In such cases, the aforementioned applications can be used to merge the multiple videos into one, or the pause function of the device's default camera application can be used to merge them into one.

[0003] When using a separate editing program to merge multiple videos into a single one, the user must launch the editing application separately and perform multiple editing steps. This process generates multiple video data, which can increase storage capacity. Using the camera application's video recording pause function requires the camera application to remain running, which can increase battery drain on the electronic device if there is a time gap between multiple shots.

[0004] Based on the discussion described above, the present disclosure provides a method and device for efficiently merging multiple images without using a separate editing program.

[0005] An electronic device according to one embodiment of the present disclosure includes a camera, a memory, and at least one processor electrically connected to the camera and the memory, wherein the at least one processor is configured to display a first user interface including a first object for starting and ending video recording and a second object for merged shooting, identify a first user input through the first user interface, and in response to identifying the user input for starting and ending recording through the first object, acquire a first image, identify a second image to be merged with the first image, merge the first image and the second image to generate a merged image, and store the generated merged image and merge information in the memory, wherein the first user input may be any one of a user input for selecting the second object or a press input for pressing the first object for a predetermined time or more.

[0006] An operating method of an electronic device according to one embodiment of the present disclosure includes: displaying a first user interface including a first object for starting and ending video recording and a second object for merging shooting; identifying a first user input through the first user interface; acquiring a first image in response to identifying the user input for starting and ending recording through the first object; identifying a second image to be merged with the first image; generating a merged image by merging the first image and the second image; and storing the generated merged image and merge information in the memory, wherein the first user input may be any one of a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time or longer.

[0007] An electronic device according to one embodiment of the present disclosure may include a camera, at least one processor, and a memory. The memory may include instructions that, when executed by the at least one processor, cause the electronic device to perform at least one operation. The at least one operation may include displaying a first user interface including a first object for starting and ending video recording and a second object for merged shooting. The at least one operation may include identifying a first user input through the first user interface. The at least one operation may include acquiring a first image in response to identifying a user input for starting and ending recording through the first object. The at least one operation may include identifying a second image to be merged with the first image. The at least one operation may include generating a merged image by merging the first image and the second image. The at least one operation may include storing instructions that cause the generated merged image and merge information to be stored in the memory. The first user input may be either a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time.

[0008] Embodiments of the present disclosure provide the effect of merging multiple images into one image without using a separate editing program.

[0009] Additionally, it provides an improved user experience for video shooting by allowing users to select a previous video after finishing video shooting and merge it with the captured video.

[0010] The effects that can be obtained from the present disclosure are not limited to the effects mentioned in the various embodiments, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0011] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0012] FIG. 2 illustrates an example of a first user interface according to one embodiment.

[0013] Figure 3 illustrates an operational flow of an electronic device according to one embodiment.

[0014] Figure 4 illustrates an example of a first user input according to one embodiment.

[0015] FIG. 5 illustrates an example of image merging of an electronic device according to one embodiment.

[0016] FIG. 6 illustrates an example of image merging of an electronic device according to one embodiment.

[0017] FIG. 7 illustrates an example of image merging of an electronic device according to one embodiment.

[0018] FIG. 8 illustrates an example of a user interface for merging a first image and a second image according to one embodiment.

[0019] FIG. 9 illustrates an example of a second user interface according to one embodiment.

[0020] FIG. 10 illustrates an example of editing a merged image of an electronic device according to one embodiment.

[0021] FIG. 11 illustrates an example of editing a merged image of an electronic device according to one embodiment.

[0022] FIG. 12 illustrates an example of editing a merged image of an electronic device according to one embodiment.

[0023] FIG. 13 illustrates an example of a second user interface according to one embodiment.

[0024] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0025] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0027] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0028] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0029] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0030] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0031] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0032] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0033] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0034] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0035] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0036] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0037] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0038] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0039] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0041] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0042] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0044] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197). According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] Fig. 2 illustrates an example of a first user interface according to one embodiment. The electronic device of Fig. 2 may include a device corresponding to the electronic device (100) of Fig. 1.

[0048] Referring to FIG. 2, a first user interface (210, 220) according to one embodiment may represent a user interface displayed when an application for taking a photo or video through a camera of an electronic device is executed.

[0049] The first user interface (210) may include a user interface displayed before the start of video recording. The first user interface (220) may include a user interface displayed before the start of video recording and before the end of video recording.

[0050] The first user interface (210, 220) may include first objects (212, 224) for identifying user inputs for starting and ending video recording. The first user interface (210) may include a first object (212) for identifying a user input for starting video recording. The first user interface (220) may include a first object (224) for identifying a user input for ending video recording. The electronic device may identify a user input for immediately ending recording and a user input for pausing recording through the first object (224).

[0051] The electronic device can identify a user input to start recording a video through the first object (212). The electronic device can identify a user input to pause recording a video through the first object (224-1). The electronic device can identify a user input to complete recording a video through the first object (224-2).

[0052] The first user interface (210, 220) may include a second object (214) for identifying user input for merge shooting.

[0053] The electronic device may perform a merged shooting operation when it identifies a first user input for selecting (tapping, touching) a second object (214) through the first user interface (210) before recording a video. The electronic device may perform a merged shooting operation even during video recording when it identifies a first user input for selecting (tapping, touching) a second object (224) through the first user interface (220). The above-described merged shooting operation is described in detail in the description of FIG. 3.

[0054] When the electronic device identifies a first user input for selecting a second object (214) of the first user interface (210) and then identifies a user input for starting video recording through the first object (212), the second object (214) of the first user interface (220) may be displayed blurry. In other words, depending on whether merge shooting is activated or not, the second object (214) of the first user interface (220) displayed during recording may be displayed as a solid line or a dotted line.

[0055] FIG. 3 illustrates an operation flow of an electronic device according to one embodiment. FIG. 4 illustrates an example of a first user input according to one embodiment. The electronic devices of FIGS. 3 and 4 may correspond to the electronic device (100) of FIG. 1. The first user interface of FIGS. 3 and 4 may correspond to the first user interface (210) of FIG. 2. In the description of FIGS. 3 and 4, any content that overlaps with the content described in the description of FIGS. 1 and 2 may be omitted.

[0056] According to one embodiment, in operation 310, the electronic device may display a first user interface including a first object for starting and ending video recording and a second object for merged shooting.

[0057] The electronic device can identify a user input to start recording a video through the first object. The electronic device can identify a user input to pause recording of the video through the first object. The electronic device can identify a user input to complete recording of the video through the first object. The first object of FIG. 3 may correspond to the first object (212, 224) of FIG. 2.

[0058] An electronic device can identify a user input for merged photography through a second object. In the following description, the user input for merged photography may be referred to as a first user input. Merged photography may refer to photography for merging multiple images into a single image. An image captured after identifying the first user input may be merged with another image and stored as a single image in the electronic device without using an editing program. In other words, an image captured after identifying the first user input may not be stored independently, but may be merged with another image and stored. In the following description, an image acquired through the first object after identifying the first user input may be referred to as a first image.

[0059] The second object may be placed in a predetermined area of ​​the first user interface. For example, referring to FIG. 2, the second object may be placed in the first user interface in the form of an icon displayed at the upper right corner of the screen. The shape or position of the second object illustrated in FIG. 2 is merely an example, and the second object may have various shapes and positions. For example, although not illustrated in the drawing, the second object may be placed in various positions, such as at the top, bottom, left, or right of the screen, or to the left or right of the first object. For example, although not illustrated in the drawing, the second object may have a shape different from that illustrated in FIG. 2, and may be various types of UI components (e.g., FAB, button, pop-up window displayed when a specific condition is satisfied, etc.) in addition to icons.

[0060] According to one embodiment, in operation 320, the electronic device may identify a first user input through the first user interface. The first user input may refer to a user input for initiating a process for merged photography.

[0061] The first user input may include a user input (401) for selecting a second object. For example, referring to FIG. 4, the first user input may be a user input for selecting a second object (214) included in the first user interface (210). In the following description, the user input for selecting the second object (214) is described as a user input for touching or tapping the second object (214), but this is merely an example, and the first user input may include various forms of user input.

[0062] Although not depicted in the drawing, the first user input may also be identified through the first user interface (220) displayed during video recording. For example, a user input selecting a second object (224) of the first user interface (220) may be the first user input.

[0063] The first user input may include a user input of pressing the first object for a predetermined period of time or longer. For example, referring to FIG. 4, the first user input may be a press (or hold) input (403) of pressing the first object (212) for a predetermined period of time (e.g., 3 seconds). When the user presses the first object (212) according to the press input (403), an image in the form of an arrow rotating clockwise around the first object may be displayed. When the first object (2120) is pressed and a predetermined period of time elapses, the object (405) may be displayed.

[0064] The above-described examples of the first user input are merely examples, and the first user input may be other types of user input. For example, the first user input may be a user input of double-tapping the first object, a user input of dragging the first object in a specific direction, or a user input of swiping. Furthermore, for example, the first user input may include recognizing a voice requesting merged shooting while the first user interface is displayed, or identifying a specific motion while the first user interface is displayed (e.g., shaking the electronic device, touching the back, etc.).

[0065] According to one embodiment, in operation 330, the electronic device can acquire a first image in response to identifying at least two consecutive user inputs regarding the start and end of recording through the first object.

[0066] For example, the electronic device may identify a user input tapping the first object (212) at a first point in time. Accordingly, video recording may start and the first object (224) may be displayed. After the video recording starts, after a certain period of time has elapsed, the electronic device may identify a user input tapping the first object (224) at a second point in time. When the user input tapping the first object (224) is identified, the electronic device may acquire the video captured from the first point in time to the second point in time. Two consecutive user inputs for starting and ending recording may refer to the user inputs identified at the first and second points in time as described above.

[0067] According to one embodiment, at operation 340, the electronic device may identify a second image to be merged with the first image.

[0068] In one embodiment, the electronic device may identify the most recently acquired image through the electronic device before the first image is acquired as the second image. The second image may be the most recently acquired image among the images acquired through the first user interface of the electronic device before the first image is acquired. For example, the second image may include the most recently captured image before the first image is acquired. For example, the second image may be the image most recently received through the communication unit (e.g., downloaded from a server, newly saved through editing of an existing image) before the first image is acquired.

[0069] In one embodiment, the electronic device can identify at least one image selected from a plurality of images stored in a memory of the electronic device as a second image.

[0070] The electronic device may, in response to identifying a first user input, display a second user interface that displays a plurality of images stored in the electronic device. The second user interface may refer to a user interface displayed when an application related to an album (or gallery) for viewing images and videos stored in the electronic device is executed. The electronic device may display a plurality of images stored in the electronic device in the form of thumbnails through the second user interface. When the electronic device identifies a user input for selecting at least one image from among the plurality of images displayed on the second user interface, the electronic device may identify the selected at least one image as a second image.

[0071] In one embodiment, the electronic device can identify, as a second image, at least one image selected from among a plurality of images stored in a memory of the electronic device and recommended to be merged into a first image through a machine learning model or the like.

[0072] In response to capturing a first image, the electronic device may identify analysis information of the first image using a machine learning model to extract metadata of the first image. For example, the analysis information may include information about a subject included in the image. Information about the subject may include information about the type of subject (e.g., person, animal, object, etc.), the number of subjects, the shape (pose) of the subjects, etc. For example, the analysis information may include background information of the image. The background information may include information about the space that serves as the background. For example, the analysis information may include information about the location where the image was captured. Information about the location where the image was captured may include global positioning system (GPS) information of the image. For example, the analysis information may include color information of the image. The color information may include information about brightness, saturation, color distribution, etc. of the image. For example, the analysis information may include information about the time at which the image was captured.

[0073] The electronic device may display at least one recommended image to be merged with the first image based on the identified analysis information. The at least one recommended image may be an image having analysis information corresponding to the analysis information of the first image. For example, if the subject included in the first image is an animal (e.g., a dog), an image of an animal similar to the animal included in the first image may be identified as at least a recommended image. For example, if the first image is an image of a sunset and the image was captured in the evening, the electronic device may display an image of a sunset captured in the evening among a plurality of images stored in the electronic device as a recommended image.

[0074] The electronic device can determine at least one recommended image selected from among the displayed at least one recommended image as the second image.

[0075] In one embodiment, the second image may be a single image merged from multiple images. For example, if the most recently captured image before the first image was acquired is an image merged based on the first user input described above, the second image may be a merged image of multiple images.

[0076] In one embodiment, the second image may be a plurality of images. The second image may be a single image or a plurality of images. For example, when identifying a user input for selecting two or more images from among images displayed through the second user interface, the electronic device may merge the first image and the plurality of images corresponding to the user input to generate a merged image. For example, when identifying a user input for selecting two or more images from among at least one recommended image displayed on the electronic device, the electronic device may merge the first image and the plurality of images corresponding to the user input to generate a merged image.

[0077] As described above, the second image may be at least one of the following: the most recently acquired image before the first image was acquired, an image selected from among multiple images stored on the electronic device, or an image recommended by the electronic device to be merged with the first image through an artificial intelligence model. The specific user interface displayed during the above process is described in detail in the descriptions of FIGS. 5 to 7 below.

[0078] According to one embodiment, in operation 350, the electronic device may merge the first image and the second image to generate a merged image.

[0079] In one embodiment, the electronic device can merge the first image and the second image by considering the time at which the first image and the second image were captured. For example, the merged image can be generated to have the order of the second image - the first image. For example, the merged image can be generated to have the order of the first image - the second image. Although not shown in the drawing, a user input for determining the order of the first image and the second image constituting the merged image can be identified. In this case, the electronic device can generate the merged image according to the order corresponding to the identified user input. The images constituting the generated merged image can be changed (e.g., changing the order or deleting any one of the plurality of images constituting the merged image) according to a user input for changing the configuration, which is described in detail in the descriptions with respect to FIGS. 11 and 12 .

[0080] In one embodiment, the electronic device may display a pop-up window to identify a user input regarding whether to merge the first image and the second image. If the electronic device identifies the user input to merge the first image and the second image through the pop-up window, the electronic device may merge the first image and the second image to generate a merged image. The pop-up window may include an image regarding the second image to be merged with the first image. The image regarding the second image included in the pop-up window may be a thumbnail of the second image.

[0081] According to one embodiment, in operation 360, the electronic device may store a merged image and merged information in memory. The merged information may include information regarding a plurality of images constituting the merged image, and the plurality of images may include a first image and a second image.

[0082] In one embodiment, the electronic device may store the first and second images in memory as a single merged image, rather than storing them separately. Accordingly, the second image previously stored in the electronic device may be replaced with the newly generated merged image. Although not illustrated in the drawing, to achieve this, the electronic device may delete the existing second image and store the merged image, which is a merged image of the first and second images, in memory. By storing the multiple images that make up the merged image as a single image rather than storing them separately, the duplicate storage of the same image can be prevented, thereby enabling efficient use of storage space.

[0083] In one embodiment, the merged information may include information regarding the multiple images that constitute the merged image. For example, analysis information regarding the merged image, such as the shooting time of the first and second images that constitute the merged image, the video length, and the shooting location, may be stored separately. Such merged information may be displayed when a user input for selecting the merged image is identified through the second user interface and a user input for checking the metadata of the merged image is identified.

[0084] In one embodiment, the second user interface may include a merged image and merged information. An image (e.g., a thumbnail) of the merged image may be displayed on the second user interface, and upon identifying a user input selecting an image of the merged image, the electronic device may display objects for playing the merged image, editing the merged image, or viewing information about the merged image.

[0085] In one embodiment, the image of the merged image displayed on the second user interface may include information indicating that the merged image was captured through merged photography and information regarding the number of images constituting the merged image. This may be described in detail in the description of FIG. 9.

[0086] FIG. 5 illustrates an example of image merging in an electronic device according to one embodiment. The electronic device of FIG. 5 may correspond to the electronic devices of FIGS. 1 to 4. FIG. 5 illustrates a user interface displayed on the electronic device to generate a merged image by merging a second image and a first image, the most recently acquired image before the acquisition of the first image. The first user interface (510, 530) of FIG. 5 may be a user interface corresponding to the first user interface (210) of FIG. 2, and the first user interface (520, 540) of FIG. 5 may be a user interface corresponding to the second user interface (220) of FIG. 2.

[0087] Referring to FIG. 5, the electronic device can identify a user input (501) for starting video recording through a first object (212) of a first user interface (510). Thereafter, the electronic device can identify a user input (502) for ending video recording through a first object (224-2) of a first user interface (520). A second image can be acquired through the user input (501) and the user input (502). Although not illustrated in the drawing, a user input (not illustrated) for pausing video recording between the user input (501) and the user input (502) can be identified through the object (224-1).

[0088] After the second image is identified through the user input (501) and the user input (502), the electronic device can display the first user interface (530). The electronic device can identify the first user input (503) through the second object (214) of the first user interface (530). In response to the electronic device identifying the first user input (503) through the second object (214), the electronic device can perform merged shooting. Thereafter, the electronic device can identify the user input (504) for starting video recording through the first object (212) and can identify the user input (505) for ending video recording through the first object (224-2) of the first user interface (540). Accordingly, the electronic device can acquire the first image. The electronic device can generate a merged image by merging a first image and a second image, which is an image acquired through a user input (501) and a user input (502) immediately before the first image is acquired. Although not shown in the drawing, the first user input (503) may be a press input of pressing the first object (212) for a predetermined period of time. According to the embodiment illustrated in FIG. 5, an image captured immediately before (the second image) can be merged with the currently captured first image simply by selecting an icon for merged shooting displayed in the camera application without using a separate editing program, thereby providing an improved user experience related to video production.

[0089] FIG. 6 illustrates an example of image merging in an electronic device according to one embodiment. The electronic device of FIG. 6 may correspond to the electronic devices of FIGS. 1 to 4. FIG. 6 relates to an example of acquiring a first image after a first user input for merged shooting is input, and then merging one image selected from among a plurality of images stored in the electronic device. The first user interface (610) of FIG. 6 may be a user interface corresponding to the first user interface (530) of FIG. 5. The first user interface (620) of FIG. 6 may be a user interface corresponding to the first user interface (540) of FIG. 5.

[0090] Referring to FIG. 6, an electronic device may display a first user interface (610). The electronic device may identify a first user input (601) through a second object (214) of the first user interface (610). In response to the electronic device identifying the first user input (601) through the second object (214), the electronic device may perform merged shooting. The electronic device may identify a user input (602) for starting video recording through the first object (212), and may identify a user input (603) for ending video recording through the first object (224-2) of the first user interface (620). Accordingly, the electronic device may acquire a first image.

[0091] In one embodiment, the electronic device may then display a second user interface (630) in response to acquiring the first image. The second user interface may display multiple images or images stored in the electronic device. The multiple images stored in the electronic device may be displayed on the second user interface in the form of images (e.g., thumbnails) related to the images.

[0092] In one embodiment, the electronic device can identify a user input (604) for selecting one of a plurality of images displayed on the second user interface (630). The user can select an image to be merged with the acquired first image among the plurality of images stored in the electronic device, and the user input (604) can refer to a user input for selecting an image to be merged with the first image. The electronic device can identify the image selected by the user input (604) as a second image.

[0093] In one embodiment, in response to identifying the second image, the electronic device may display a first user interface (640). The first user interface (640) may include a pop-up window (642) asking whether to merge the first image and the second image. The pop-up window (642) may include an object (646) for identifying a user input to merge the first image and the second image, and an object (648) for identifying a user input to not merge the first image and the second image. The pop-up window (642) may include an image (644) relating to the second image to be merged with the first image. The image (644) may mean a thumbnail image of the selected second image.

[0094] In one embodiment, when the electronic device identifies a user input (605) selecting an object (646), the first image and the second image may be merged to create a merged image. In one embodiment, when the electronic device identifies a user input (not shown) selecting an object (648), the first image and the second image may not be merged, but only the first image may be stored in the memory of the electronic device.

[0095] FIG. 7 illustrates an example of image merging in an electronic device according to one embodiment. The electronic device of FIG. 7 may correspond to the electronic devices of FIGS. 1 to 4. FIG. 7 relates to an example of acquiring a first image after a first user input for merged shooting is input, and then merging one of at least one recommended image displayed thereafter with the first image. The first user interface (710) of FIG. 7 may be a user interface corresponding to the first user interface (530) of FIG. 5. The first user interface (720) of FIG. 7 may be a user interface corresponding to the first user interface (540) of FIG. 5.

[0096] Referring to FIG. 7, an electronic device may display a first user interface (710). The electronic device may identify a first user input (701) through a second object (214) of the first user interface (710). In response to the electronic device identifying the first user input (701) through the second object (214), the electronic device may perform merged shooting. The electronic device may identify a user input (702) for starting video recording through the first object (212), and may identify a user input (703) for ending video recording through the first object (224-2) of the first user interface (720). Accordingly, the electronic device may acquire a first image.

[0097] In one embodiment, the electronic device may display a second user interface (730) in response to acquiring the first image. The second user interface (730) may include at least one recommended image (732) that can be merged with the first image. The at least one recommended image (732) may be displayed on the second user interface in the form of an image (e.g., a thumbnail) related to the image. The at least one image may be an image stored on the electronic device or an image received from another device (e.g., a server, etc.).

[0098] In one embodiment, the electronic device may identify a user input (705) selecting a second image (734) from among at least one recommended image (732) displayed on a second user interface (730). The user may select an image to be merged with the acquired first image from among the at least one recommended recommended image, and the user input (704) may refer to a user input for selecting an image to be merged with the first image. The electronic device may identify the image selected by the user input (704) as the second image.

[0099] In one embodiment, in response to identifying the second image, the electronic device may display a first user interface (740). The first user interface (740) may include a pop-up window (742) asking whether to merge the first image and the second image. The pop-up window (742) may include an object (746) for identifying a user input to merge the first image and the second image, and an object (748) for identifying a user input to not merge the first image and the second image. The pop-up window (742) may include an image (744) relating to the second image to be merged with the first image. The image (744) may mean a thumbnail image of the selected second image.

[0100] In one embodiment, when the electronic device identifies a user input (not shown) selecting an object (746), the first image and the second image may be merged to create a merged image. In one embodiment, when the electronic device identifies a user input (not shown) selecting an object (648), the first image and the second image may not be merged, but only the first image may be stored in the memory of the electronic device.

[0101] FIG. 8 illustrates an example of a user interface for merging a first image and a second image according to one embodiment. The user interface (800) of FIG. 8 may represent a user interface corresponding to the user interface (640) of FIG. 6 and the user interface (740) of FIG. 7.

[0102] Referring to FIG. 8, the electronic device can acquire a first image and identify a second image to be merged with the first image, as in the examples illustrated in FIGS. 5 to 7. After acquiring the first image and identifying the second image, the electronic device can merge the first image directly, or display an object to identify a user input asking whether to merge the first and second images.

[0103] In one embodiment, the pop-up window (810) may include information asking whether to merge the first image and the second image, an object (812) for identifying a user input to merge the first image and the second image, and an object (814) for identifying a user input not to merge the first image and the second image.

[0104] In one embodiment, the pop-up window (810) may include an image (816) of a second image to be merged with the first image. The image (816) may include a thumbnail image of the second image.

[0105] The electronic device may not directly merge the first image and the second image, but may display a user interface (800) and generate a merged image based on user input received through the user interface (800).

[0106] FIG. 9 illustrates an example of a second user interface according to one embodiment. The second user interface (900) illustrated in FIG. 9 may refer to a user interface displayed when executing an application related to an album or gallery that allows viewing images or videos stored in an electronic device.

[0107] Referring to FIG. 9, the second user interface may include information regarding images and videos stored in the electronic device. The second user interface may include videos stored in the electronic device in the form of thumbnail images of the videos.

[0108] In one embodiment, the merged image (910) may refer to an image captured based on the first user input for the above-described merged capture. The merged image (910) may be an image generated and stored through the operation of FIG. 3 described above.

[0109] In one embodiment, the merged image (910) displayed on the second user interface (900) may include an icon (912) indicating that the merged image (910) was captured based on a first user input for merge capturing. For example, the icon (912) may be displayed at the upper right corner of a thumbnail image of the merged image (910). The shape or position of the icon (912) illustrated in FIG. 9 is merely an example, and the thumbnail image of the merged image (910) may be displayed through an icon of a different shape from the icon illustrated in FIG. 9, and the position of the icon may also be displayed at various locations such as the upper left corner, the lower left corner, or the lower right corner, rather than the upper right corner.

[0110] In one embodiment, the merged image (910) displayed on the second user interface (900) may include information (914) regarding the number of images constituting the merged image. The information (914) regarding the number of images constituting the merged image may be displayed in the form of an icon indicating the number of images constituting the merged image. For example, if the number of images constituting the merged image is four, the information may be displayed in the form of “4” as illustrated in FIG. 9. The number of images constituting the merged image, four, as illustrated in FIG. 9, is merely an example, and may be another number greater than or equal to two.

[0111] Fig. 10 illustrates an example of editing a merged image of an electronic device according to one embodiment. The electronic device of Fig. 10 may represent an electronic device corresponding to the electronic device (100) of Fig. 1, and in the description of Fig. 10, any content that overlaps with the content described in Figs. 1 to 9 may be omitted.

[0112] Referring to FIG. 10, the electronic device may display a user interface (1010). The user interface (1010) may refer to a user interface displayed when a user input for selecting a merged image is identified in a second user interface (e.g., the second user interface (900)). In other words, when a merged image is selected from an album, the user interface (1010) may be displayed.

[0113] In one embodiment, the user interface (1010) may include an icon (1012) indicating that the selected image has been captured based on a first user input for merged capture. For example, as illustrated in FIG. 9 , the icon (1012) may be displayed in the upper left corner of the user interface (1010). The shape and position of the icon (1012) are merely exemplary, and the icon (1012) may be displayed using icons having different shapes and positions.

[0114] In one embodiment, the user interface (1010) may include an object (1021) for identifying user input to display a pop-up window (e.g., a pop-up window (1022)) for performing various actions (e.g., editing, viewing information, moving a location, setting a background image, etc.) with respect to the selected image.

[0115] In one embodiment, the electronic device may display a user interface (1020) when it identifies a user input through an object (1021) of the user interface (1010). The user interface (1020) may include a pop-up window (1022).

[0116] In one embodiment, the pop-up window (1022) may include information regarding multiple actions that the user can perform on the selected image. For example, the pop-up window (1022) may include an object for checking detailed information about the image, an object for reconstructing the image (e.g., remastering the image), an object for exporting the image, an object for copying the image, an object for deleting the image, and in the case of a merged image, an object for uncomposing the merged image.

[0117] In one embodiment, when the electronic device identifies a user input via an object (1024), the electronic device may display a user interface (1030). The object (1024) may represent an object for identifying a user input for viewing information about an image.

[0118] In one embodiment, the user interface (1030) may include merge information indicating information about multiple images that constitute an image (e.g., merge information of FIG. 3 ). For example, the information about the multiple images may include information about the time the image was created (January 24, 2021), the file name, the location (e.g., Seoul, Republic of Korea), etc.

[0119] In one embodiment, information about a plurality of images may include information (1032) about each of the plurality of images that constitute the merged image. The information about each of the plurality of images may include information about the time at which the plurality of images were acquired, information about the order of the plurality of images, and the like.

[0120] In one embodiment, when the electronic device identifies a user input via an object (1026) of the user interface (1020), the electronic device may de-merge the images that make up the merged image. For example, if there are four images that make up the merged image, the four images may each be stored as independent images.

[0121] In one embodiment, when the electronic device identifies a user input through an object (1026) to unmerge images forming a merged image, the electronic device may display a user interface (1040). The user interface (1040) may store the merged image, which was originally stored as a single image, as separate images and display them in the form of four thumbnails (1042).

[0122] FIG. 11 illustrates an example of editing a merged image of an electronic device according to one embodiment. The electronic device of FIG. 11 may correspond to the electronic device (100) of FIG. 1. In the description of FIG. 11, any content that overlaps with the content described in FIGS. 1 to 10 may be omitted.

[0123] Referring to FIG. 11, the user interface (1010) may include an icon (1101) and a video playback bar (1110). The icon (1101) may mean an object corresponding to the icon (1012). The video playback bar (1110) may be a component that displays playback information of videos (1111, 1112, 1113, 1114) that constitute a merged video, and the video playback bar (1110) may be displayed based on a thumbnail image and the length of each video (1111, 1112, 1113, 1114). For example, referring to FIG. 11, the video playback bar (1110) may include a thumbnail image of each of a plurality of videos (1111, 1112, 1113, 1114) that constitute the merged video, and the size of the thumbnail image may correspond to the length of each video. The video playback bar (1110) may include an object for identifying a user input for playing or pausing the video.

[0124] In one embodiment, when the electronic device identifies a user input (1102) through the image playback bar (1110), the order of the multiple images (1111, 1112, 1113, 1114) that constitute the merged image may be changed. For example, the user input (1102) may be a user input of dragging the image (1113) between the images (1111) and (1112). In this case, the order of the merged image may be changed to the order of the images (1111), (1113), (1112), and (1114). Also, for example, the user input (1102) may be a user input of dragging the image (1113) behind the image (1114). In this case, the image (1113) may have the last order of the merged image.

[0125] In one embodiment, when the electronic device identifies a user input (1104) through the image playback bar (1110), the electronic device can delete the image for which the user input (1104) is identified. For example, referring to FIG. 11, when the electronic device identifies a user input of dragging or swiping the image (1113) in the +y-axis or -y-axis direction, the image (1113) among the multiple images can be deleted from the merged image.

[0126] The example shown in Fig. 11 is only an example, and the merged image may be composed of more than or less than four images, and although the order of the third image is changed or the third image is deleted, the first, second or other images may also be changed or deleted.

[0127] Fig. 12 illustrates an example of editing a merged image of an electronic device according to one embodiment. Fig. 13 illustrates an example of a second user interface according to one embodiment. The electronic devices of Figs. 12 and 13 may correspond to the electronic device (100) of Fig. 1. In the description of Figs. 12 and 13, any content that overlaps with the content described in Figs. 1 to 11 may be omitted.

[0128] The user interface (1200) of FIG. 12 may be a user interface corresponding to the user interface (1020) of FIG. 10.

[0129] In one embodiment, the user interface (1200) may include a pop-up window (1022). When the electronic device identifies a user input (1201) through an object (1212) of the pop-up window (1022), the electronic device may display the pop-up window (1220). The object (1212) may refer to an object for identifying a user input (1201) for remastering an image constituting a merged image.

[0130] In one embodiment, when the electronic device identifies a user input (1201), it may display a pop-up window (1220). The pop-up window (1220) may be a pop-up window containing information (1032) regarding the merged image of FIG. 10.

[0131] In one embodiment, when the electronic device identifies a user input (1202) of dragging one of the multiple images forming the merged image up or down in a pop-up window (1220), the order of the selected images can be changed to an order corresponding to the position where the drag input of the user input (1202) is released.

[0132] In one embodiment, when the electronic device identifies a press input or a user input (1203) of swiping left or right on one of the multiple images that make up the merged image of the pop-up window (1220) for a predetermined period of time or longer, the selected image can be deleted from the merged image.

[0133] In one embodiment, when one of the multiple images constituting the merged image is deleted through image remastering, the merged image, which was stored as a single image on the electronic device, may be stored separately as an image composed of an image selected to be deleted from the merged image and an image remaining after the selected image is deleted from the merged image. For example, before a portion of the images constituting the merged image is deleted or unmerged, the merged image may be displayed as a single merged image (1321) through the second user interface (1310). However, when a portion of the images constituting the merged image is deleted or unmerged, the merged image may be correspondingly separated and displayed as images (1302) and (1303).

[0134] An electronic device according to one embodiment of the present disclosure may include a camera, a memory, and at least one processor electrically connected to the camera and the memory. In one embodiment, the at least one processor may display a first user interface including a first object for starting and ending video recording and a second object for merged shooting. In one embodiment, the at least one processor may identify a first user input through the first user interface. In one embodiment, the at least one processor may acquire a first image in response to identifying a user input for starting and ending recording through the first object. In one embodiment, the at least one processor may identify a second image to be merged with the first image, and generate a merged image by merging the first image and the second image. The generated merged image and merge information may be stored in the memory. In one embodiment, the first user input may be either a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time.

[0135] In one embodiment, the second image may be the most recently acquired image before the first image is acquired.

[0136] In one embodiment, the at least one processor may, in response to identifying the first user input, display a second user interface displaying a plurality of images stored in the electronic device. In one embodiment, the second image may be at least one image selected from the plurality of images.

[0137] In one embodiment, the at least one processor, in response to acquiring the first image, may identify analysis information of the first image using at least one machine learning model. In one embodiment, the at least one processor may display at least one recommended image to be merged with the first image based on the identified analysis information. In one embodiment, the second image may be one or more images selected from the at least one recommended image.

[0138] In one embodiment, the analysis information of the first image may include any one of information regarding the subject of the first image, information regarding the location where the first image was captured, and information regarding the time at which the first image was captured. In one embodiment, the at least one recommended image may be an image that includes information corresponding to the analysis information of the first image.

[0139] In one embodiment, the at least one processor may display a pop-up window through the first user interface to identify a user input regarding whether to merge the first image and the second image. In one embodiment, the at least one processor may, when identifying a second user input for merging the first image and the second image through the pop-up window, merge the first image and the second image to generate the merged image.

[0140] In one embodiment, the second object may have the form of an icon displayed in some area of ​​the first user interface.

[0141] In one embodiment, the merge information may include information about two or more images that constitute the merged image. In one embodiment, the two or more images may include the first image and the second image.

[0142] In one embodiment, the at least one processor may display information indicating that the merged image was captured through merge capturing and information regarding the number of images constituting the merged image.

[0143] In one embodiment, the at least one processor may display a third object representing the selected second image through the first user interface while the first image is being acquired.

[0144] In one embodiment, the at least one processor may display the second user interface when identifying a user input through the third object.

[0145] In one embodiment, the at least one processor may be configured not to identify the second image when, while the first image is being acquired, the processor identifies a user input selecting the second object.

[0146] In one embodiment, the at least one processor may display a second user interface that displays a plurality of images stored in the electronic device. In one embodiment, the at least one processor may identify a user input for selecting the merged image through the second user interface. In one embodiment, when the at least one processor identifies a user input for de-merging the merged image, the at least one processor may separate and store the plurality of images constituting the merged image.

[0147] According to one embodiment of the present disclosure, a method of operating an electronic device may include an operation of displaying a first user interface including a first object for starting and ending video recording and a second object for merged shooting. In one embodiment, the method of operating the electronic device may include an operation of identifying a first user input through the first user interface. In one embodiment, the method of operating the electronic device may include an operation of acquiring a first image in response to identifying a user input for starting and ending recording through the first object. In one embodiment, the method of operating the electronic device may include an operation of identifying a second image to be merged with the first image. In one embodiment, the method of operating the electronic device may include an operation of generating a merged image by merging the first image and the second image. In one embodiment, the method of operating the electronic device may include an operation of storing the generated merged image and merge information in the memory. In one embodiment, the first user input may be either a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time or more.

[0148] In one embodiment, the second image may be the most recently acquired image before the first image is acquired.

[0149] In one embodiment, a method of operating an electronic device may include, in response to identifying the first user input, displaying a second user interface displaying a plurality of images stored in the electronic device. In one embodiment, the second image may be at least one image selected from the plurality of images.

[0150] In one embodiment, a method of operating an electronic device may include, in response to acquiring the first image, identifying analysis information of the first image using at least one machine learning model. In one embodiment, the method of operating the electronic device may include, based on the identified analysis information, displaying at least one recommended image to be merged with the first image. In one embodiment, the second image may be one or more images selected from the at least one recommended image.

[0151] In one embodiment, the analysis information of the first image may include any one of information regarding the subject of the first image, information regarding the location where the first image was captured, and information regarding the time at which the first image was captured. In one embodiment, the at least one recommended image may include information corresponding to the analysis information of the first image.

[0152] In one embodiment, the method of operating an electronic device may include an operation of displaying a pop-up window for identifying a user input regarding whether to merge the first image and the second image through the first user interface. In one embodiment, the method of operating an electronic device may include an operation of merging the first image and the second image to generate the merged image when a second user input for merging the first image and the second image is identified through the pop-up window.

[0153] In one embodiment, the second object may have the form of an icon displayed in some area of ​​the first user interface.

[0154] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0155] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0156] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0157] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0158] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0159] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, camera; at least one processor; and Contains memory, The above memory, when executed by the at least one processor, causes the electronic device to: Displaying a first user interface including a first object for starting and stopping video recording and a second object for merging shots; Identifying a first user input through the first user interface, In response to identifying a user input regarding the start and end of recording through the first object, a first image is acquired, Identify a second image to be merged with the first image, The first image and the second image are merged to create a merged image, Storing instructions that cause the generated merged image and merged information to be stored in the memory, A device wherein the first user input is either a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time.

2. In claim 1, A device wherein the second image is the most recently acquired image before the first image is acquired.

3. In claim 1, The above memory, when executed by the at least one processor, causes the electronic device to: In response to identifying said first user input, store instructions that cause a second user interface to be displayed that displays a plurality of images stored on said electronic device; A device wherein the second image is at least one image selected from among the plurality of images.

4. In claim 1, The above memory, when executed by the at least one processor, causes the electronic device to: In response to acquiring the first image, identifying analysis information of the first image using at least one machine learning model, storing commands that cause at least one recommended image to be merged into the first image based on the identified analysis information; A device wherein the second image is one or more images selected from the at least one recommended image.

5. In claim 4, The analysis information of the first image includes any one of information about the subject of the first image, information about the location where the first image was taken, or information about the time when the first image was taken. A device wherein said at least one recommended image is an image including information corresponding to the analysis information of said first image.

6. In any one of claims 1 to 5, The above memory, when executed by the at least one processor, causes the electronic device to: Through the first user interface, a pop-up window is displayed to identify user input regarding whether to merge the first image and the second image, A device that stores commands that cause the first image and the second image to be merged to generate the merged image when a second user input for merging the first image and the second image is identified through the pop-up window.

7. In any one of claims 1 to 6, A device wherein the second object has the form of an icon displayed in some area of ​​the first user interface.

8. In any one of claims 1 to 7, The above merge information includes information about two or more images that constitute the merged image, A device wherein the two or more images include the first image and the second image.

9. In any one of claims 1 to 8, The above memory, when executed by the at least one processor, causes the electronic device to: A device storing commands that cause the merged image to be displayed, the commands causing the merged image to be displayed to indicate that the merged image was captured through merge shooting and the commands causing the merged image to be displayed to indicate the number of images that make up the merged image.

10. In claim 3, The above memory, when executed by the at least one processor, causes the electronic device to: A device storing commands that cause a third object representing the selected second image to be displayed through the first user interface while the first image is being acquired.

11. In claim 10, The above memory, when executed by the at least one processor, causes the electronic device to: A device that stores commands that cause the second user interface to be displayed when identifying a user input through the third object.

12. In any one of claims 1 to 11, The above memory, when executed by the at least one processor, causes the electronic device to: A device storing commands that cause the second image not to be identified when identifying a user input selecting the second object while the first image is being acquired.

13. In any one of claims 1 to 12, The above memory, when executed by the at least one processor, causes the electronic device to: Displaying a second user interface that displays a plurality of images stored in the electronic device; Identifying a user input for selecting the merged image through the second user interface; A device that stores commands that cause a plurality of images constituting the merged image to be separated and stored when identifying a user input for demerging the merged image.

14. In the method of operating an electronic device, An action for displaying a first user interface including a first object for starting and stopping video recording and a second object for merging shots; An action of identifying a first user input through the first user interface; In response to identifying a user input regarding the start and end of recording through the first object, an action of acquiring a first image; An operation of identifying a second image to be merged with the first image; An operation of generating a merged image by merging the first image and the second image, and Including an operation of storing the generated merged image and merged information in the memory, A method according to claim 1, wherein the first user input is either a user input for selecting the second object or a press input for pressing the first object for a predetermined period of time.

15. In claim 14, A method wherein the second image is the most recently acquired image before the first image is acquired.

Citation Information

Patent Citations

  • Method for creating video file taken by camera module of mobile device

    KR101595451B1

  • Apparatus and method for recording moving picture

    KR1020070023946A

  • Mobile terminal and method for controlling the same

    KR1020110054175A

  • Method for synthesizing valid images in mobile terminal having multi camera and the mobile terminal therefor

    KR1020140104806A

  • Method and apparatus for decomposing and recycling thermosetting resin composite material, and composition used therein

    KR1020230164606A