Electronic device and driving method thereof

Abstract

Embodiments of the present disclosure relate to an electronic device and a driving method thereof. An electronic device (101) according to an embodiment may comprise: a display module; a memory (130) storing a plurality of images and instructions; and a processor (120), wherein the instructions, when executed by the processor (120), may cause the electronic device (101) to: display the plurality of images in a list form on the basis of execution of an application; receive a first user input selecting a first image (710) from among the plurality of images; in response to the first user input, display a guide object (712) proposing a 3D conversion for the first image (710) together with the first image (710); and in response to receiving a second user input (701) selecting the guide object (712), display a first video (810) in a 3D form generated on the basis of the first image (710).

Description

Electronic device and method of driving the same

[0001] Embodiments of the present disclosure relate to an electronic device and a method of driving the same.

[0002] With the development of digital technology, various types of electronic devices such as smart phones, digital cameras, and / or wearable devices are being widely used.

[0003] Users can capture images using electronic devices. For example, the electronic device may include at least one camera device (e.g., a camera module) and support the user's image capture through the at least one camera device. Recently, the use of image capture functions using electronic devices has been increasing. For example, users are utilizing the image capture functions of easily portable electronic devices without time and / or location (or space) constraints.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] Recently, research and development are being conducted on various functions (or services) to provide users with convenience and interest in taking videos on electronic devices.

[0006] Embodiments of the present disclosure can provide an electronic device and a method of driving the same, which can provide convenience and interest to a user in taking pictures by providing a user interface for converting a captured 2D (2 dimensional) image into a 3D (3 dimensional) video.

[0007] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0008] An electronic device (101) according to one embodiment of the present disclosure includes a display module, a memory (130) storing a plurality of images and commands, and a processor (120), wherein the commands, when executed by the processor (120), cause the electronic device (101) to display the plurality of images in a list format based on the execution of an application, receive a first user input for selecting a first image (710) from among the plurality of images, display a guide object (712) proposing a 3D transformation for the first image (710) together with the first image (710) in response to the first user input, and display a first video (810) in a 3D form generated based on the first image (710) in response to receiving a second user input (701) for selecting the guide object (712).

[0009] A method for driving an electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying a plurality of images stored in a memory (130) in a list format based on execution of an application, an operation of receiving a first user input for selecting a first image (710) from among the plurality of images, an operation of displaying a guide object (712) proposing a 3D transformation for the first image (710) together with the first image (710) in response to the first user input, and an operation of displaying a first video (810) in a 3D form generated based on the first image (710) in response to receiving a second user input (701) for selecting the guide object (712).

[0010] According to embodiments of the present disclosure, convenience and interest in video shooting can be provided to users by providing a user interface for converting a captured 2D image into a 3D video.

[0011] In addition, various effects may be provided, either directly or indirectly, through this document.

[0012] Other aspects, features and advantages according to specific embodiments of the present disclosure will become more apparent from the accompanying drawings and the corresponding description.

[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0014] FIG. 2 is a perspective view of the front of an electronic device (e.g., a mobile electronic device) according to various embodiments of the present disclosure.

[0015] FIG. 3 is a perspective view of the rear surface of the electronic device of FIG. 1 according to various embodiments of the present disclosure.

[0016] FIG. 4 is a block diagram illustrating a generative artificial intelligence module according to one embodiment.

[0017] Figure 5 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0018] FIG. 6 is a drawing showing an example of an execution screen of an application of an electronic device according to one embodiment.

[0019] FIG. 7 is an example of a screen of a first user interface displaying a first image according to one embodiment.

[0020] FIG. 8 is an example of a screen of a second user interface displaying a first video in 3D form according to one embodiment.

[0021] FIG. 9 is an example of a screen of a third user interface for adjusting the style of a first video according to one embodiment.

[0022] FIG. 10 is an example of a screen of a fourth user interface for adjusting the style of a first video according to one embodiment.

[0023] FIG. 11 is an example of a screen of a fifth user interface for changing the effect of a first video according to one embodiment.

[0024] FIG. 12 is an example of a screen of a sixth user interface for changing the effect of a first video according to one embodiment.

[0025] FIG. 13 is an example of a screen of a seventh user interface for executing a motion detection mode according to one embodiment.

[0026] FIG. 14 is a drawing for explaining changes in a first video according to a motion detection mode according to one embodiment.

[0027] FIG. 15 is an example of a screen of an eighth user interface for changing a central object of a first video according to one embodiment.

[0028] FIG. 16 is an example of a screen of a ninth user interface for redrawing some objects included in a first video according to one embodiment.

[0029] Figure 17 is a drawing showing an example of the result of redrawing some objects included in the first video of Figure 16.

[0030] FIG. 18 is an example of a screen of a tenth user interface for redrawing a background included in a first video according to one embodiment.

[0031] Fig. 19 is a drawing showing an example of a screen resulting from redrawing the background included in the first video of Fig. 18.

[0032] FIG. 20 is an example of a screen of an eleventh user interface for correcting a background included in a first video according to one embodiment.

[0033] Fig. 21 is a drawing showing an example of a screen resulting from correcting the background included in the first video of Fig. 20.

[0034] FIG. 22 is an example of a screen of a twelfth user interface for adding a background to a first video according to one embodiment.

[0035] Figure 23 is a drawing showing an example of a screen with a background added to the first video of Figure 22.

[0036] FIG. 24 is an exemplary diagram illustrating a method for determining an effect to be applied when an electronic device converts a first image into a first video in 3D form according to one embodiment.

[0037] Fig. 25 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0038] FIG. 26 is an example of a screen of a first user interface displaying images stored in an electronic device according to one embodiment.

[0039] FIG. 27 is an example of a screen of a second user interface displaying a first image according to one embodiment.

[0040] FIG. 28 is an example of a screen of a third user interface displaying a guide object according to one embodiment.

[0041] FIG. 29 is an example of an effect screen displayed while converting a first image into a first video in 3D form according to one embodiment.

[0042] FIG. 30 is an example of a screen of a fourth user interface displaying a first video in 3D form according to one embodiment.

[0043] FIG. 31 is an example of an effect screen displayed while saving a first video in 3D form according to one embodiment.

[0044] FIG. 32 is an example of a screen of a first user interface displaying images stored in an electronic device according to one embodiment.

[0045] Each of the embodiments described with reference to the drawings of the present disclosure can be independently configured as a single embodiment. For example, the embodiments of FIG. 1 and FIG. 2 can each be independently configured. Each of the embodiments described with reference to the drawings of the present disclosure can operate independently as a single embodiment. For example, the embodiments of FIG. 1 and FIG. 2 can each operate independently.

[0046] At least two embodiments described with reference to the drawings of the present disclosure may be combined and configured. For example, at least a portion of the embodiment of FIG. 1 and at least a portion of the embodiment of FIG. 2 may be combined and configured. At least two embodiments described with reference to the drawings of the present disclosure may be combined and operated. For example, at least a portion of the embodiment of FIG. 1 and at least a portion of the embodiment of FIG. 2 may be combined and operated.

[0047] When at least two embodiments described with reference to the drawings of the present disclosure are combined, at least some of the components and / or at least some of the operations included in each embodiment may be omitted. For example, when the embodiment of FIG. 1 and the embodiment of FIG. 2 are combined, at least some of the components and / or at least some of the operations included in the embodiment of FIG. 1 may be omitted, and at least some of the components and / or at least some of the operations included in the embodiment of FIG. 2 may be omitted.

[0048] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0049] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0050] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0051] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0052] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0053] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0054] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0055] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0056] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0057] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0058] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0059] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0060] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0061] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0062] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0063] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0064] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0065] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0066] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0067] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0068] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0069] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0070] Electronic devices according to various embodiments disclosed in the present disclosure may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0071] The various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In the present disclosure, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among the phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0072] The term "module" used in various embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0073] Various embodiments of the present disclosure may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0074] According to one embodiment, the method according to various embodiments disclosed in the present disclosure may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0075] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0076] FIG. 2 is a perspective view of the front of an electronic device (101) (e.g., a mobile electronic device) according to various embodiments of the present disclosure. FIG. 3 is a perspective view of the rear of the electronic device (101) of FIG. 1 according to various embodiments of the present disclosure.

[0077] Referring to FIGS. 2 and 3 , an electronic device (101) according to one embodiment (e.g., the electronic device (101) of FIG. 1 ) may include a housing (210) that includes a first side (or front side) (210A), a second side (or back side) (210B), and a side surface (210C) that surrounds a space between the first side (210A) and the second side (210B). In another embodiment, the housing (210) may refer to a structure that forms a portion of the first side (210A), the second side (210B), and the side surface (210C) of FIG. 1 . According to one embodiment, the first side (210A) may be formed by a front plate (202) that is at least partially substantially transparent (e.g., a glass plate or a polymer plate including various coating layers). The second side (210B) may be formed by a substantially opaque back plate (211). The back plate (211) may be formed of, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the materials. The side surface (210C) may be formed by a side bezel structure (218) (or “side member”) that is coupled to the front plate (202) and the back plate (211) and comprises a metal and / or polymer. In some embodiments, the back plate (211) and the side bezel structure (218) may be formed integrally and comprise the same material (e.g., a metal material such as aluminum).

[0078] In the illustrated embodiment, the front plate (202) may include a first region (210D) that extends seamlessly from the first side (210A) toward the back plate (211), at both ends of a long edge of the front plate (202). In the illustrated embodiment (see FIG. 2), the back plate (211) may include a second region (210E) that extends seamlessly from the second side (210B) toward the front plate (202), at both ends of the long edge. In some embodiments, the front plate (202) or the back plate (211) may include only one of the first region (210D) or the second region (210E). In some embodiments, the front plate (202) may not include the first region and the second region, but may only include a flat plane that is arranged parallel to the second side (210B). In embodiments, when viewed from the side of the electronic device, the side bezel structure (218) may have a first thickness (or width) on the side that does not include the first region (210D) or the second region (210E), and may have a second thickness that is thinner than the first thickness on the side that includes the first region (210D) or the second region (210E).

[0079] According to one embodiment, the electronic device (101) may include at least one of a display (201) (e.g., the display module (160) of FIG. 1), an input device (203) (e.g., the input module (150) of FIG. 1), an audio output device (207, 214) (e.g., the audio output module (155) of FIG. 1), a sensor module (204, 219) (e.g., the sensor module (176) of FIG. 1), a camera module (205, 212) (e.g., the camera module (180) of FIG. 1), a key input device (217), an indicator, and a connector (208). In some embodiments, the electronic device (101) may omit at least one of the components (e.g., the key input device (217) or the indicator) or may additionally include other components.

[0080] The display (201) may be exposed, for example, through an upper portion of the front plate (202). In some embodiments, at least a portion of the display (201) may be exposed through the front plate (202), which forms a first area (210D) of a first surface (210A) and a side surface (210C). The display (201) may be coupled to or disposed adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer for detecting a magnetic field-type stylus pen. In some embodiments, at least a portion of the sensor modules (204, 219), and / or at least a portion of the key input device (217), may be disposed in the first area (210D), and / or the second area (210E).

[0081] The input device (203) may include a microphone (203). In some embodiments, the input device (203) may include a plurality of microphones (203) arranged to detect the direction of sound. The audio output device (207, 214) may include speakers (207, 214). The speakers (207, 214) may include an external speaker (207) and a call receiver (214). In some embodiments, the microphone (203), the speakers (207, 214), and the connector (208) may be arranged at least partially in the internal space of the electronic device (101) and may be exposed to the external environment through at least one hole formed in the housing (210). In some embodiments, the hole formed in the housing (210) may be used in common for the microphone (203) and the speakers (207, 214). In some embodiments, the audio output device (207, 214) may include a speaker (e.g., a piezo speaker) that operates without the hole formed in the housing (210).

[0082] The sensor module (204, 219) can generate an electrical signal or data value corresponding to an internal operating state of the electronic device (101) or an external environmental state. The sensor module (204, 219) can include, for example, a first sensor module (204) (e.g., a proximity sensor) and / or a second sensor module (e.g., a fingerprint sensor) disposed on a first surface (210A) of the housing (210), and / or a third sensor module (219) (e.g., an HRM sensor) disposed on a second surface (210B) of the housing (210). The fingerprint sensor can be disposed on the first surface (210A) of the housing (210) (e.g., a home key button), a portion of the second surface (210B), and / or under the display (201). The electronic device (101) may further include at least one of a sensor module not shown, for example, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, a proximity sensor, or an illuminance sensor.

[0083] The camera modules (205, 212) may include a first camera module (205) disposed on a first side (210A) of the electronic device (101), a second camera module (212) disposed on a second side (210B), and / or a flash (213). The camera modules (205, 212) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (213) may include, for example, a light emitting diode or a xenon lamp. In some embodiments, two or more lenses (a wide-angle lens, an ultra-wide-angle lens, or a telephoto lens) and image sensors may be disposed on one side of the electronic device (101).

[0084] The key input device (217) may be positioned on a side surface (210C) of the housing (210). In other embodiments, the electronic device (101) may not include some or all of the mentioned key input devices (217), and the key input devices (217) that are not included may be implemented in other forms, such as soft keys, on the display (201). In another embodiment, the key input device (217) may be implemented using a pressure sensor included in the display (201).

[0085] The indicator may be disposed, for example, on the first surface (210A) of the housing (210). The indicator may provide, for example, status information of the electronic device (101) in the form of light (e.g., a light-emitting element). In another embodiment, the light-emitting element may provide, for example, a light source that is linked to the operation of the camera module (205). The indicator may include, for example, an LED, an IR LED, and / or a xenon lamp.

[0086] The connector hole (208) may include a first connector hole (208) that can accommodate a connector (e.g., a USB (universal serial bus) connector) for transmitting and receiving power and / or data with an external electronic device, and / or a second connector hole (or earphone jack) that can accommodate a connector for transmitting and receiving audio signals with an external electronic device.

[0087] Some of the camera modules (205, 212), some of the sensor modules (204, 219), or indicators may be arranged to be exposed through the display (201). For example, the camera module (205), the sensor module (204), or the indicator may be arranged to be in contact with the external environment through a through-hole formed from the internal space of the electronic device (101) to the front plate (202) of the display (201). In another embodiment, some of the sensor modules (204) may be arranged to perform their functions without being visually exposed through the front plate (202) in the internal space of the electronic device. For example, an area of ​​the display (201) facing the sensor module may not require a through-hole.

[0088] FIG. 4 is a block diagram illustrating a generative artificial intelligence module (400) according to one embodiment.

[0089] Referring to FIG. 4, an electronic device (101) according to an embodiment may provide functions related to a camera module (e.g., the camera module of FIG. 1) using a generative artificial intelligence (AI) module (400). For example, the electronic device (101) may automatically perform 3D (3 dimensional) transformation on a first image (710) stored in a memory (130) (e.g., the memory (130) of FIG. 1) using the generative AI module (400) and provide a first video (810) in which the 3D transformation has been performed to a user. The electronic device (101) may display the first image (710) through an execution screen of an application in response to a user input. While displaying the first image (710) through the execution screen of the application, the electronic device (101) may display a guide object (712) suggesting a 3D transformation on the first image (710). The electronic device (101) may display a first video (810) in 3D form generated based on a first image (710) in response to receiving a user input for selecting a guide object (712).

[0090] The term "generative AI module (400)" used in various embodiments of the present disclosure may be used interchangeably with terms such as generative AI system or AI system. The term "3D video" used in various embodiments of the present disclosure may refer to a moving image generated based on a first image (710), and may refer to an image to which a depth effect is applied to at least some objects included in the first image (710). The term "3D video" used in various embodiments of the present disclosure may be used interchangeably with terms such as 3D image or second image.

[0091] According to one embodiment, the generative AI module (400) may be configured inside an electronic device (101) (e.g., the electronic device (101) of FIG. 1) or may be configured in a server.

[0092] According to one embodiment, the generative AI module (400) may include a user interface (410), a database (420), an application and service component (430), an AI framework (450), and a generative AI model (470).

[0093] According to one embodiment, a user interface (410) may receive a user query. The user query may be in the form of natural language, images, and videos. The user interface (410) may receive context information along with the user query. The user query may include non-natural language input that does not generate natural language, such as a design request or modification. The user query may include a mixed form of natural language, images, sounds, or context information. The user interface (410) may provide the user with a result processed by a generative AI model (470). The result processed by the generative AI model (470) may be in the form of natural language or specific content, and may be in the form of an action requested by the user.

[0094] According to one embodiment, an AI framework (450) can control components for processing corresponding to a user's intention. The AI ​​framework (450) can include a prompt design component (451), an application and plug-in management component (APIs / Plugins Management component) (453), and an output modification component (455).

[0095] In one embodiment, a user query or action entered into the user interface (410) may be transmitted to a prompt design component (451). The prompt design component (451) may generate prompts suitable for input into large language models (hereinafter, “LLMs”) or large multi-modal models (hereinafter, “LMMs”). The prompt design component (451) may be an AI component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (451) may access a knowledge component containing user preference data, a prompt library, and prompt examples to generate prompts and transmit them to the LLM or LMM.

[0096] In one embodiment, the application and plug-in management component (453) may establish a channel for external communication via an application programming interface (API). If the application or service ultimately needs to perform an action that fulfills a user query, the application and plug-in management component (453) may request the action via the API.

[0097] The output modification component (455) can perform verification on content generated by the LLM or LMM. The output modification component (455) can determine to what extent the content generated by the LLM or LMM matches the result desired by the user. If the output modification component (455) determines that additional processing is necessary, it can perform the process. The output modification component (455) can generate hints to prevent the output of undesired results and provide the generated hints to the user.

[0098] A generative AI model (470) generally refers to an artificial intelligence neural network that creates new types of data based on user input information, and may be named LLM or LMM. A generative AI model (470) may include a model that generates images, and representative examples thereof include a generative adversarial network (GAN) and a variational auto encoder (VAE), and recently, a diffusion-based generative model that uses a VAE and a transformer structure. A generative AI model (470) refers to a model trained to output the most statistically appropriate output value based on an input value, and representative examples thereof include models such as CHAT-GPT 3 and CHAT-GPT 4.

[0099] FIG. 5 is a flowchart illustrating the operation of an electronic device (101) according to one embodiment. FIG. 6 is a diagram illustrating an example of an execution screen of an application of an electronic device (101) according to one embodiment. FIG. 7 is an example of a screen of a first user interface (700) displaying a first image (710) according to one embodiment. FIG. 8 is an example of a screen of a second user interface (800) displaying a first video (810) in a 3D format according to one embodiment.

[0100] The operations illustrated in FIG. 5 may be performed by instructions stored in a memory (130) (e.g., the memory (130) of FIG. 1). For example, the instructions, when executed by a processor (120) (e.g., the processor (120) of FIG. 1), may cause the electronic device (101) (e.g., the electronic device (101) of FIG. 1) to perform the operations illustrated in FIG. 5. According to one embodiment, the instructions, when executed by the processor (120), may cause the electronic device (101) to perform at least some of the operations illustrated in FIG. 5 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0101] At least some of the operations illustrated in FIG. 5 may be omitted. At least some of the operations mentioned with reference to other drawings in this disclosure may be additionally inserted before or after at least some of the operations illustrated in FIG. 5.

[0102] According to one embodiment, at least some of the operations illustrated in FIG. 5 may be performed sequentially.

[0103] According to one embodiment, at least some of the operations illustrated in FIG. 5 can be performed in parallel (simultaneously).

[0104] Hereinafter, the operation of an electronic device (101) according to one embodiment will be described with reference to FIGS. 5 to 8.

[0105] In operation 510, an electronic device (101) according to an embodiment (e.g., the electronic device (101) of FIG. 1) may display a plurality of images in a list format based on the execution of an application. For example, referring to FIG. 6, the electronic device (101) may execute an application that displays images stored in a memory (130) based on a user input. For example, the application may be a gallery application. The electronic device (101) may display an execution screen (600) of the executed application, and the execution screen (600) may display images (610) stored in the memory (130) in a list format or a tile format.

[0106] In operation 520, an electronic device (101) according to an embodiment may receive a first user input (601) for selecting a first image (710) from among a plurality of images (610). For example, referring to FIG. 6, the electronic device (101) may receive a first user input (601) for selecting a first image (710) from among the images (610) while displaying images (610) stored in a memory (130).

[0107] In operation 530, the electronic device (101) according to one embodiment may, in response to a first user input (e.g., the first user input (601) of FIG. 6), display a first image (710) and a guide object (712) suggesting a 3D transformation for the first image (710). For example, referring to FIG. 7, when the electronic device (101) receives a first user input (601) for selecting the first image (710) from among images stored in the memory (130) (e.g., the images (610) of FIG. 6), the electronic device (101) may display a first user interface (700). The screen of the first user interface (700) may include the first image (710), meta information (711) regarding the first image (710), or a guide object (712) suggesting a 3D transformation for the first image (710). Meta information (711) about the first image (710) may include information about the resolution of the first image (710), the ISO (international standards organization) value, the aperture value, the exposure value, the shutter speed, the performance of the camera, or the location information.

[0108] According to one embodiment, the electronic device (101) may identify the type of the first image (710) and determine whether to display the guide object (712) based on the identified type. For example, the electronic device (101) may display the guide object (712) when the first image (710) is of a designated type, such as a portrait or an animal portrait. The electronic device (101) may suggest a 3D transformation of the first image (710) to the user when the first image (710) is a portrait or an animal portrait. In another embodiment, the designated type of the first image (710) may not be limited to a portrait or an animal portrait.

[0109] In operation 540, the electronic device (101) according to one embodiment may display a first video (810) in a 3D form generated based on a first image (710) in response to receiving a second user input (701) selecting a guide object (712). For example, referring to FIGS. 7 and 8 , the electronic device (101) may receive a second user input (701) selecting a guide object (712) displayed on a screen of the first user interface (700). In response to receiving the second user input (701), the electronic device (101) may display a second user interface (800). The screen of the second user interface (800) may display the first video (810) generated by the electronic device (101) based on the first image (710). For example, the first video (810) is a video that expresses an object in a 3D form, and may be a video in which a depth effect is applied to at least some objects included in the first image (710).

[0110] According to one embodiment, the electronic device (101) may determine one of a plurality of effects when displaying the first video (810), and display the first video (810) with the determined effect applied. For example, the plurality of effects for displaying the first video (810) may refer to the forms in which the first video (810) is displayed. The plurality of effects for displaying the first video (810) will be described in detail later with reference to FIG. 24.

[0111] According to one embodiment, the plurality of effects that the electronic device (101) displays when the first video (810) is displayed may include the first effect, the second effect, the third effect, or the fourth effect, but the present disclosure is not limited thereto. For example, the electronic device (101) may provide various effects in addition to the first effect, the second effect, the third effect, or the fourth effect as the plurality of effects that the electronic device (101) displays when the first video (810).

[0112] The first effect may be an effect in which the position of a specific object included in the first video (810) is fixed while the background is enlarged (e.g., zoomed in).

[0113] The second effect may be an effect in which the background is reduced (e.g., zoomed out) while the position of a specific object included in the first video (810) is fixed.

[0114] The third effect may be an effect in which the position of a specific object included in the first video (810) remains fixed while the viewpoint from which the specific object is viewed moves. For example, the first video (810) with the third effect applied may provide an effect of moving from a viewpoint from the front of a specific person to a viewpoint from the side of the person.

[0115] The fourth effect may be an effect in which the entire screen of the first video (810) moves in a specific direction (e.g., upward, downward, left, or right).

[0116] According to one embodiment, the electronic device (101) may determine one of the plurality of effects as the optimal effect and apply the determined effect to the first video (810). According to one embodiment, when determining one of the plurality of effects as the optimal effect, the electronic device (101) may calculate a user preference score for each of the plurality of effects. The electronic device (101) may apply the effect with the highest preference score as the optimal effect to the first video (810).

[0117] According to one embodiment, the electronic device (101) may refer to the user history in calculating the user preference score for each of the plurality of effects.

[0118] In one embodiment, the electronic device (101) may count the number of times the user has previously selected each effect and calculate a user preference score based on the counted number of times for each effect. The electronic device (101) may determine the effect most frequently selected by the user as the optimal effect. The electronic device (101) may assign a lower preference score to an effect that is selected relatively infrequently by the user.

[0119] According to one embodiment, the electronic device (101) can count the number of times the user has previously stored a first video (810) with a specific effect applied thereto in the memory (130), or the number of times the user has previously transmitted a video with a specific effect applied thereto to an external device (e.g., the electronic device (102), the electronic device (104), or the server (108) of FIG. 1). The electronic device (101) can calculate a preference score of the user based on the counted number of times. The electronic device (101) can determine the effect that has been stored by the user the most times or transmitted by the user to an external device (e.g., the electronic device (102), the electronic device (104), or the server (108) of FIG. 1) the most times as the optimal effect. In the present disclosure, the operation of the electronic device (101) transmitting the first video (810) to an external device (e.g., the electronic device (102), the electronic device (104), or the server (108) of FIG. 1) may include an operation of the electronic device (101) uploading the first video (810) to a server providing a social network service (SNS) service through an application associated with the SNS. In the present disclosure, the operation of the electronic device (101) transmitting the first video (810) to an external device (e.g., the electronic device (102), the electronic device (104), or the server (108) of FIG. 1) may include an operation of the electronic device (101) transmitting the first video (810) to another device located around the electronic device (101) using short-range communication such as Bluetooth.

[0120] In operation 550, the electronic device (101) according to one embodiment may display a plurality of adjustment objects (821, 822) for adjusting the style of the first video (810) while the first video (810) is displayed. For example, referring to FIG. 8, the screen of the second user interface (800) may include the first video (810), a plurality of adjustment objects (821, 822), including a first adjustment object (821) for adjusting the playback speed of the first video (810), a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810), a motion detection object (823) for executing a motion detection mode, a sharing object (824) for sharing the first video (810) with a user of another electronic device (101), or a storage object (825) for storing the first video (810) in the memory (130).

[0121] The motion detection mode may refer to a mode in which the electronic device (101) detects the movement of the electronic device (101) and varies the first video (810) based on the detected movement of the electronic device (101). For example, when a user holding the electronic device (101) moves the electronic device (101), the electronic device (101) may detect this and vary the first video (810). The term "motion detection mode" used in various embodiments of the present disclosure may be used interchangeably with terms such as motion detection state or first state.

[0122] In operation 560, the electronic device (101) according to one embodiment may display a second video having an adjusted style of the first video (810) based on receiving a third user input (e.g., 901 of FIG. 9 and 1001 of FIG. 10) for at least some of the plurality of adjustment objects (821, 822). For example, referring to FIG. 8, the electronic device (101) may display, as the plurality of adjustment objects (821, 822), a first adjustment object (821) for adjusting the playback speed of the first video (810), or a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810). The electronic device (101) can adjust the style of the first video (810) based on a third user input (e.g., 901 of FIG. 9, 1001 of FIG. 10) selecting either the first adjustment object (821) or the second adjustment object (822). The term "style of the first video (810)" used in various embodiments of the present disclosure means the speed at which the first video (810) is played or the depth of an object included in the first video (810), and can be used interchangeably with terms such as the shape of the first video (810) or the properties of the first video (810).

[0123] FIG. 9 is an example of a screen of a third user interface (900) for adjusting the style of a first video (810) according to one embodiment. According to one embodiment, commands stored in the memory (130) of the electronic device (101), when executed by the processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interface illustrated in FIG. 9 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0124] Referring to FIG. 9, when the electronic device (101) displays a second user interface (800) (e.g., the second user interface (800) of FIG. 8) that displays a first video (810) in a 3D form, the electronic device (101) may receive a third user input (901) for at least some of the plurality of adjustment objects (821, 822).

[0125] According to one embodiment, the plurality of adjustment objects (821, 822) may include a first adjustment object (821) for adjusting the playback speed of the first video (810), and a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810). For example, the third user input (901) may be a user input for selecting the second adjustment object (822) for adjusting depth information of at least one object included in the first video (810).

[0126] According to one embodiment, the electronic device (101) may, in response to a third user input (901), display an adjustment object (910) in the form of a slide bar for adjusting the style of the first video (810). For example, the electronic device (101) may adjust depth information of at least one object included in the first video (810) as the style of the first video (810).

[0127] According to one embodiment, the electronic device (101) may display an adjustment object (910) in the form of a slide bar adjacent to a second adjustment object (822). When the electronic device (101) receives a designated user input (902) (e.g., a drag input) for the adjustment object (910) in the form of a slide bar, the electronic device (101) may adjust depth information of at least one object included in the first video (810). The electronic device (101) may dynamically adjust depth information of at least one object included in the first video (810) in response to the designated user input (902) (e.g., a drag input) for the adjustment object (910) in the form of a slide bar, and display the adjusted first video (810).

[0128] According to one embodiment, the electronic device (101) may store a setting value selected by the user in relation to the depth information of an object, and determine the user's preference based on the stored setting value. The electronic device (101) may consider the determined user's preference in a subsequent operation of converting the first image (710) into the first video (810). For example, if the user selects 3 from a range of 1 to 10 as the setting value related to the depth information of the object, the electronic device (101) may set the depth information of the object to 3 in a subsequent operation of converting the first image (710) into the first video (810).

[0129] FIG. 10 is an example of a screen of a fourth user interface (1000) for adjusting the style of a first video (810) according to one embodiment. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interface illustrated in FIG. 10 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0130] Referring to FIG. 10, when the electronic device (101) displays a second user interface (800) (e.g., the second user interface (800) of FIG. 8) that displays a first video (810) in a 3D form, the electronic device (101) may receive a third user input (1001) for at least some of the plurality of adjustment objects (821, 822).

[0131] According to one embodiment, the plurality of adjustment objects (821, 822) may include a first adjustment object (821) for adjusting the playback speed of the first video (810), and a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810). For example, the third user input (1001) may be a user input for selecting the first adjustment object (821) for adjusting the playback speed of the first video (810).

[0132] According to one embodiment, the electronic device (101) may, in response to a third user input (1001), display an adjustment object (1010) in the form of a slide bar for adjusting the style of the first video (810). For example, the electronic device (101) may adjust the playback speed of the first video (810) as the style of the first video (810).

[0133] According to one embodiment, the electronic device (101) may display a slide bar-shaped adjustment object (1010) adjacent to a second adjustment object (822). When the electronic device (101) receives a designated user input (1002) (e.g., a drag input) for the slide bar-shaped adjustment object (1010), the electronic device (101) may adjust the playback speed of the first video (810). The electronic device (101) may dynamically change the playback speed of the first video (810) in response to a designated user input (1002) (e.g., a drag input) for the slide bar-shaped adjustment object (1010).

[0134] According to one embodiment, the electronic device (101) may store a setting value selected by the user with respect to the playback speed of the first video (810) and determine the user's preference based on the stored setting value. The electronic device (101) may consider the determined user's preference in a subsequent operation of converting the first image (710) into the first video (810). For example, if the user selects 7 from a range of 1 to 10 as the setting value with respect to the playback speed of the first video (810), the electronic device (101) may set the playback speed of the first video (810) to 7 in a subsequent operation of converting the first image (710) into the first video (810).

[0135] FIG. 11 is an example of a screen of a fifth user interface (1100) for changing the effect of a first video (810) according to one embodiment. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interface illustrated in FIG. 11 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0136] Referring to FIG. 11, when the electronic device (101) displays a first video (810) in a 3D form, the electronic device (101) may provide a fifth user interface (1100) for changing the effect of the first video (810). For example, if the electronic device (101) can change the effect of the first video (810), the electronic device (101) may change the second user interface (800) (e.g., the second user interface (800) of FIG. 8) for displaying the first video (810) to the fifth user interface (1100) for changing the effect of the first video (810). In one embodiment, the fifth user interface (1100) of FIG. 11 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0137] According to one embodiment, the electronic device (101) may receive a fifth user input (1101) that invokes an effect menu while displaying a fifth user interface (1100). For example, the fifth user input (1101) that invokes the effect menu may include a designated user input (e.g., a drag input) to a handler object (1110) for controlling movement of the effect menu.

[0138] According to one embodiment, when the electronic device (101) displays a second user interface (800) (e.g., the second user interface (800) of FIG. 8) displaying a first video (810), the electronic device (101) may display a handler object (1110) adjacent to a plurality of adjustment objects (821, 822). For example, the electronic device (101) may display the handler object (1110) below the plurality of adjustment objects (821, 822), but the present disclosure is not limited thereto.

[0139] According to one embodiment, the electronic device (101) may receive a user input of dragging a handler object (1110) from bottom to top as a fifth user input (1101). In response to receiving the fifth user input (1101), the electronic device (101) may display a sixth user interface (1200) as illustrated in FIG. 12 (e.g., the sixth user interface (1200) of FIG. 6).

[0140] FIG. 12 is an example of a screen of a sixth user interface (1200) for changing the effect of a first video (810) according to one embodiment. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interface illustrated in FIG. 12 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0141] Referring to FIG. 12, an electronic device (101) according to one embodiment may receive a fifth user input (e.g., 1101 of FIG. 11) that calls up an effect menu when displaying a fifth user interface (1100) for changing an effect of a first video (810). For example, the electronic device (101) may receive a designated user input (e.g., the fifth user input (1101)) for a handler object. In response to the fifth user input (1101), the electronic device (101) may provide a sixth user interface (1200).

[0142] According to one embodiment, the sixth user interface (1200) may include an effect menu including at least one effect object (1211, 1212, 1213) representing at least some of a plurality of effects for converting the first image (710) into a 3D video. According to one embodiment, the electronic device (101) may, in response to a sixth user input (1201) selecting at least one effect object (1211, 1212, 1213) included in the effect menu, display a third video in a 3D format to which an effect corresponding to the selected effect object is applied. For example, the electronic device (101) may receive a designated user input (e.g., a drag input) for at least a portion of the effect menu. For example, the electronic device (101) may receive a user input for dragging at least a portion of an effect menu in a left-right direction (or an up-down direction), and may display at least one effect object (1214, 1215, 1216) corresponding to the effects that were not displayed based on the received user input. Each effect of the effect objects (1214, 1215, 1216) that were not displayed means a different effect of the first video (810) that the electronic device (101) can support.

[0143] According to one embodiment, when displaying an effect menu, at least one effect object (1211, 1212, 1213) may be displayed in order of user preference among a plurality of effects (i.e., effect objects (1211, 1212, 1213, 1214, 1215, 1216)).

[0144] According to one embodiment, the electronic device (101) may provide a plurality of effects for displaying the first video (810), namely, a first effect, a second effect, a third effect, or a fourth effect. The first effect may be an effect in which the background is enlarged (e.g., zoomed in) while the position of a specific object included in the first video (810) is fixed. The second effect may be an effect in which the background is reduced (e.g., zoomed out) while the position of a specific object included in the first video (810) is fixed. The third effect may be an effect in which the viewpoint for viewing a specific object included in the first video (810) moves while the position of the specific object is fixed. For example, the first video (810) with the third effect applied may provide an effect in which the viewpoint for viewing the front of a specific person moves to a viewpoint for viewing the side of the specific person. The fourth effect may be an effect in which the entire screen of the first video (810) moves in a specific direction (e.g., upward, downward, left, or right).

[0145] According to one embodiment, the electronic device (101) may preferentially display an effect having a high user preference or a high recommendation among the first effect, the second effect, the third effect, or the fourth effect in the effect menu. For example, it may be assumed that among the first effect, the second effect, the third effect, or the fourth effect, the first effect, the second effect, and the third effect have a high user preference or a high recommendation. In this case, the electronic device may preferentially display a first effect object (1211), a second effect object (1212), and a third effect object (1213) corresponding to the first effect, the second effect, and the third effect, respectively, in the effect menu.

[0146] According to one embodiment, the electronic device (101) may receive a user input for dragging at least a portion of an effect menu in a left-right direction (or an up-down direction), and may display at least one effect object corresponding to effects that were not displayed based on the received user input, for example, a fourth effect object (1214) corresponding to a fourth effect. According to one embodiment, the electronic device (101) may further display at least one effect object corresponding to effects that were not displayed, a fifth effect object (1215) corresponding to a fifth effect, or a sixth effect object (1216) corresponding to a sixth effect. Each of the fourth effect, the fifth effect, and the sixth effect may be an effect to which a plurality of effects selected from the first effect, the second effect, the third effect, or the fourth effect are applied.

[0147] According to one embodiment, the electronic device (101) may display score objects (not shown) indicating a recommendation score or a user preference score for each effect when displaying each of a plurality of effect objects (1211, 1212, 1213, 1214, 1215, 1216) in the effect menu. The score objects may be displayed adjacent to the effect objects (1211, 1212, 1213, 1214, 1215, 1216), but the present disclosure is not limited thereto.

[0148] Fig. 13 is an example of a screen of a seventh user interface (800) for executing a motion detection mode according to one embodiment. Fig. 14 is a diagram for explaining a change in a first video (810) according to a motion detection mode according to one embodiment. According to one embodiment, the commands stored in the memory (130) of the electronic device (101), when executed by the processor (120), may be set so that the electronic device (101) provides at least a part of the user interfaces illustrated in Figs. 13 and 14 using a generative AI module (e.g., the generative AI module of Fig. 4).

[0149] Referring to FIG. 13, an electronic device (101) according to one embodiment may display a motion detection object (823) for executing a motion detection mode when displaying a first video (810) in a 3D format. In one embodiment, the seventh user interface (800) of FIG. 13 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0150] According to one embodiment, the electronic device (101) may execute a motion detection mode based on receiving a fourth user input (1301) selecting a motion detection object (823).

[0151] Referring to FIG. 14, when the motion detection mode is executed, the electronic device (101) can detect the movement of the electronic device (101) using a motion sensor. The motion sensor may include, for example, a gyro sensor or an acceleration sensor.

[0152] According to one embodiment, the electronic device (101) can vary the first video (810) in response to the detected movement of the electronic device (101) (or the posture of the electronic device (101). For example, the electronic device (101) can dynamically change the viewpoint expressed by the first video (810) in response to the movement of the electronic device (101). According to one embodiment, the electronic device (101) can change from a screen (1410) including a first video (1411) expressed in a first viewpoint to a screen (1420) including a first video (1421) expressed in a second viewpoint in response to detecting that the electronic device (101) is moving in a first direction (1011) (e.g., a horizontal direction or a first rotational direction). According to one embodiment, the electronic device (101) may change the first video (810) represented in a third viewpoint to a video represented in a fourth viewpoint in response to detecting that the electronic device (101) is moving in a second direction (1021) (e.g., a vertical direction or a second rotational direction).

[0153] According to one embodiment, when the motion detection mode is executed, the electronic device (101) may remove a plurality of adjustment objects (821, 822) from the screen. For example, the electronic device (101) may not display a plurality of adjustment objects (821, 822) (e.g., the plurality of adjustment objects (821, 822) of FIG. 8) on the screen while dynamically changing the viewpoint expressed by the first video (810) in conjunction with the movement of the electronic device (101).

[0154] FIG. 15 is an example of a screen of an eighth user interface (1510, 1520) for changing a central object of a first video (810) according to one embodiment. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interface illustrated in FIG. 15 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0155] Referring to FIG. 15, an electronic device (101) according to one embodiment may provide an eighth user interface (1510, 1520) for changing a central object of the first video (810) when displaying a first video (810) in a 3D form. In one embodiment, the eighth user interface (1510, 1520) of FIG. 15 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0156] According to one embodiment, when a plurality of objects (M1, M2) are included in the first video (810), the electronic device (101) may apply a 3D effect only to a specific object among the plurality of objects (M1, M2). For example, when the electronic device (101) applies a 3D effect to all of the plurality of objects (M1, M2), the 3D effect may be reduced. Therefore, the electronic device (101) may apply a 3D effect only to a specific object among the plurality of objects (M1, M2).

[0157] According to one embodiment, when applying a 3D effect to only a specific object among multiple objects (M1, M2), priority may be given to an object with a high user preference. For example, a specific object given a high priority by the electronic device (101) may be selected as the central object to which the 3D effect is applied.

[0158] For example, it can be assumed that a first video (810) includes a first user (M1) corresponding to a user of an electronic device (101) and a second user (M2) corresponding to a friend of the first user (M1) as multiple objects (M1, M2). In this case, the electronic device (101) can give a high priority to the first user (M1) corresponding to the user of the electronic device (101) and determine the first user (M1) as a central object. The electronic device (101) can display a screen (1510) including a first video (1511) with a 3D effect applied centered on the first user (M1) as the central object.

[0159] For example, it can be assumed that a first video (810) includes a third user (not shown) and a fourth user (not shown) who are not users of the electronic device (101) as multiple objects (M1, M2). In this case, the electronic device (101) can give a high priority to a user who interacts relatively more with the first user (M1), which corresponds to the user of the electronic device (101), and determine the user as a central object. If the first user (M1), which corresponds to the user of the electronic device (101), interacts more with the third user than with the fourth user through a designated application, the electronic device (101) can give a high priority to the third user and determine the third user as a central object. Here, the designated application may include an application related to a social network service (SNS), an application related to a call, or an application related to a message, but the present disclosure is not limited thereto.

[0160] According to one embodiment, when selecting a central object among a plurality of objects (M1, M2), the size of the object and / or the distance from the object may be taken into consideration. For example, the electronic device (101) may determine the largest object among the plurality of objects (M1, M2) as the central object. For example, the electronic device (101) may determine the closest object among the plurality of objects (M1, M2) as the central object.

[0161] According to one embodiment, while the electronic device (101) displays a first video (1511) with a 3D effect applied centered on a specific object (e.g., the first user (M1)) among a plurality of objects (M1, M2) included in the first video (810), the electronic device (101) may receive a user input (1501) for selecting another object (e.g., the second user (M2)) other than the specific object (e.g., the first user (M1)). For example, while the electronic device (101) displays the first video (1511) with the first user (M1) as the central object, the electronic device (101) may receive a user input (1501) for selecting the second user (M2). For example, the user input (1501) for selecting the second user (M2) may include a long press touch or a long touch for long-touching the corresponding object as a designated user input for the second user (M2) included in the first video (1511).

[0162] According to one embodiment, the electronic device (101) may display a first video (1521) with a changed central object in response to the user input (1501). For example, if the electronic device (101) receives a user input (1501) selecting a second user (M2) while displaying a first video (810) with a first user (M1) as a central object, the electronic device (101) may display a first video (1521) with the second user (M2) as the central object.

[0163] Fig. 16 is an example of a screen of a ninth user interface (800) for redrawing some objects included in a first video (810) according to one embodiment. Fig. 17 is a diagram showing an example of a result of redrawing some objects included in the first video (810) of Fig. 16. According to one embodiment, the commands stored in the memory (130) of the electronic device (101), when executed by the processor (120), may be set so that the electronic device (101) provides at least a part of the user interfaces shown in Figs. 16 and 17 using a generative AI module (e.g., the generative AI module of Fig. 4).

[0164] Referring to FIG. 16, an electronic device (101) according to one embodiment may provide a ninth user interface (800) for redrawing some objects included in the first video (810) when displaying a first video (810) in a 3D form. In one embodiment, the ninth user interface (800) of FIG. 16 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0165] According to one embodiment, when the electronic device (101) converts the first image (710) into the first video (810), it can identify the outline of an object included in the first video (810). The electronic device (101) can determine whether the first video (810) does not completely include the entire outline of a specific object. For example, as in the illustrated example, it can be assumed that the first image (710) is an image including a puppy, and that the image is an image in which a portion corresponding to an ear among the puppy's face area is cropped. When converting the first video (810), the electronic device (101) can provide a ninth user interface (800) for redrawing the ear portion (811) of the puppy as a part of the object included in the first video (810).

[0166] In one embodiment, the ninth user interface (800) may include a pop-up message (1610) suggesting additional drawing for at least some objects along with the first video (810). For example, the pop-up message (1610) of the ninth user interface (800) may include text suggesting application of an in-painting function to redraw a portion of the dog's ear (811).

[0167] Referring to FIG. 17, an electronic device (101) according to one embodiment may display a screen (1700) including a converted video (1720) to which additional drawing is applied to at least some objects included in a first video (810) based on receiving a seventh user input (e.g., 1601 of FIG. 16) accepting a suggestion of a pop-up message. For example, when converting the first video (810), the electronic device (101) may redraw an ear part (811) of a puppy as some objects included in the first video (810). Accordingly, the electronic device (101) may provide the user with a converted video that fully includes the entire outline of a specific object, as illustrated in FIG. 17.

[0168] According to one embodiment, when displaying a transformed video (1720), the electronic device (101) may temporarily provide a visual highlight effect (1721) for a portion of a specific object added by applying a redrawing function (or in-painting function) of the electronic device (101). For example, the visual highlight effect (1721) may include blinking of a portion of an ear of an added puppy, but the present disclosure is not limited thereto.

[0169] The term "redrawing" as used in various embodiments of the present disclosure may mean an operation of additionally creating a portion of a specific object or a portion of the background.

[0170] FIG. 18 is an example of a screen of a tenth user interface (1800) for redrawing a background (1710) included in a first video (810) according to one embodiment. FIG. 19 is a diagram showing an example of a screen resulting from redrawing a background (1710) included in the first video (810) of FIG. 18. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be set such that the electronic device (101) provides at least a portion of the user interfaces illustrated in FIGS. 18 and 19 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0171] Referring to FIG. 18, an electronic device (101) according to one embodiment may provide a tenth user interface (1800) for redrawing a background (1710) included in the first video (810) when displaying a first video (810) in a 3D form. In one embodiment, the tenth user interface (1800) of FIG. 18 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0172] According to one embodiment, when converting a first image (e.g., the first image (710) of FIG. 7) into a first video (810), the electronic device (101) may identify a distance between an object (1711) and a background (1710) included in the first video (810). For example, the electronic device (101) may determine whether at least one of a first condition in which a specific object (1711) and a background (1710) of the first video (810) are relatively far apart, a second condition in which the background (1710) of the first video (810) corresponds to a wide angle, or a third condition in which a specific object (1711) in the first video (810) is in focus while the background (1710) is an out-of-focus image is satisfied. The electronic device (101) may provide a tenth user interface (1800) for redrawing a background (1710) included in the first video (810) when any one of the first condition, the second condition, or the third condition is satisfied. For example, as in the illustrated example, the first video (810) may assume that the first condition is satisfied in that a specific object of the first video (810) and the background (1710) are relatively far apart. When converting the first video (810), the electronic device (101) may provide a tenth user interface (1800) for redrawing the background (1710) included in the first video (810).

[0173] According to one embodiment, the tenth user interface (1800) may include a pop-up message (1820) suggesting additional drawing for the background (1710) along with the first video (810). For example, the pop-up message (1820) of the tenth user interface (1800) may include text suggesting application of an out-painting function to redraw the background (1710) of the tree path. According to one embodiment, the electronic device (101) may receive a seventh user input (1821) accepting the suggestion of the pop-up message (1820).

[0174] Referring to FIG. 19, an electronic device (101) according to an embodiment may display a converted video (1920) to which an additional drawing (1821) is applied to a background (1710) included in a first video (810) based on receiving a seventh user input (e.g., 1821 of FIG. 18) accepting a suggestion of a pop-up message (e.g., 1820 of FIG. 18). For example, when converting the first video (810), the electronic device (101) may redraw the background (1710) included in the first video (810). Accordingly, the electronic device (101) may provide a user with a screen (1900) including a converted video (1920) in which the distance and composition between a person (1711) and a background (1710) are adjusted, as illustrated in FIG. 19.

[0175] According to one embodiment, when displaying a transformed video (1920), the electronic device (101) may temporarily provide a visual highlight effect for a portion of a background (1921) added by applying a redrawing function (or out-painting function) of the electronic device (101). For example, the visual highlight effect may include blinking (1922) for a portion of the added background (1921), but the present disclosure is not limited thereto.

[0176] FIG. 20 is an example of a screen of an eleventh user interface (2000) for correcting a background included in a first video (810) according to one embodiment. FIG. 21 is a diagram showing an example of a screen resulting from correcting a background included in the first video (810) of FIG. 20. According to one embodiment, commands stored in a memory (130) of an electronic device (101), when executed by a processor (120), may be set such that the electronic device (101) provides at least a portion of the user interfaces illustrated in FIGS. 20 and 21 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0177] Referring to FIG. 20, an electronic device (101) according to one embodiment may provide an eleventh user interface (2000) for correcting a background included in the first video (810) when displaying a first video (810) in a 3D form. In one embodiment, the eleventh user interface (2000) of FIG. 20 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0178] According to one embodiment, when converting a first image (710) into a first video (810), the electronic device (101) may analyze a background (2010) included in the first video (810). The electronic device (101) may determine whether the 3D effect of the first video (810) can be further enhanced by performing correction on the analyzed background (2010). If the electronic device (101) determines that the 3D effect of the first video (810) can be further enhanced by performing correction on the background (2010), the electronic device (101) may provide an eleventh user interface (2000) for correcting the background (2010).

[0179] In one embodiment, the eleventh user interface (2000) may include a pop-up message (2020) suggesting correction for the background (2010) along with the first video (810). For example, the pop-up message (2020) of the eleventh user interface (2000) may include text suggesting application of a background AI correction function to further enhance the 3D effect by correcting the background (2010).

[0180] Referring to FIG. 21, an electronic device (101) according to an embodiment may perform correction on a background (2010) included in a first video (810) and display a converted video (2110) on which correction has been performed based on receiving an eighth user input (e.g., 2021 of FIG. 20) accepting a suggestion of a pop-up message (2010). For example, when converting the first video (810), the electronic device (101) may modify at least one of color, tone, and brightness of the background (e.g., 2010 of FIG. 20) included in the first video (810). For example, the electronic device (101) may adjust saturation to be low and brightness to be dark for a first part (2112) of the background that is located relatively far from a person (2111).

[0181] FIG. 22 is an example of a screen of a twelfth user interface (2200) for adding a background to a first video (810) according to one embodiment. FIG. 23 is a diagram showing an example of a screen in which a background is added to the first video (810) of FIG. 22. According to one embodiment, the commands stored in the memory (130) of the electronic device (101), when executed by the processor (120), may be configured to cause the electronic device (101) to provide at least a portion of the user interfaces illustrated in FIGS. 22 and 23 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0182] Referring to FIG. 22, an electronic device (101) according to one embodiment may provide a twelfth user interface (2200) for adding a background to a first video (810) when displaying a first video (810) in a 3D form. In one embodiment, the twelfth user interface (2200) of FIG. 22 and the second user interface (800) described with reference to FIG. 8 may be substantially the same.

[0183] According to one embodiment, when converting a first image (710) into a first video (810), the electronic device (101) may analyze a background (2210) included in the first video (810). If the first video (810) does not include a background (2210), the electronic device (101) may provide a twelfth user interface (2200) that generates a background (2210) that matches an object included in the first video (810).

[0184] In one embodiment, the twelfth user interface (2200) may include a pop-up message (2220) suggesting background generation along with the first video (810). For example, the pop-up message (2220) of the twelfth user interface (2200) may include text suggesting application of a background AI correction function to further enhance the 3D effect through background generation.

[0185] Referring to FIG. 23, an electronic device (101) according to an embodiment may perform correction to generate a background (2311) for an object included in a first video (810) based on receiving a ninth user input (e.g., 2221 of FIG. 22) accepting a suggestion of a pop-up message (2220), and display a converted video (2310) on which correction has been performed. For example, when converting the first video (810), the electronic device (101) may suggest to the user the application of a background AI correction function to generate a new background if the background included in the first video (810) (e.g., the background (2210) of FIG. 22) is a solid color, a gradient background, or an area of ​​an object (e.g., the object (2211) of FIG. 22)) is larger than a specified ratio with respect to the entire first video (810). According to one embodiment, the electronic device (101) can further enhance the 3D effect by changing the real-life image into a drawing or animation form.

[0186] FIG. 24 is an exemplary diagram illustrating a method for determining an effect to be applied when an electronic device (101) converts a first image (710) into a first video (810) in a 3D format according to one embodiment. For example, FIG. 24 may be an example related to operation 540 of the electronic device (101) described with reference to FIG. 5.

[0187] Referring to FIG. 24, the plurality of effects that the electronic device (101) displays when displaying the first video (810) according to one embodiment may include the following first effect, second effect, third effect, or fourth effect. The electronic device (101) may further provide various effects in addition to the first effect, second effect, third effect, or fourth effect as the plurality of effects that display the first video (810).

[0188] The first effect may be an effect in which the position of a specific object included in the first video (810) is fixed while the background is enlarged (e.g., zoomed in).

[0189] The second effect may be an effect in which the background is reduced (e.g., zoomed out) while the position of a specific object included in the first video (810) is fixed.

[0190] The third effect may be an effect in which the position of a specific object included in the first video (810) remains fixed while the viewpoint from which the specific object is viewed moves. For example, the first video (810) with the third effect applied may provide an effect of moving from a viewpoint from the front of a specific person to a viewpoint from the side of the person.

[0191] The fourth effect may be an effect in which the entire screen of the first video (810) moves in a specific direction (e.g., upward, downward, left, or right).

[0192] According to one embodiment, when generating the first video (810), at least one of the first effect, the second effect, the third effect, or the fourth effect may be selected, and the criteria for selecting the effect may be as follows. However, the description below is only an example, and various embodiments of the present disclosure are not limited thereto.

[0193] According to one embodiment, the electronic device (101) can divide an object included in a first image (710) into a plurality of regions and analyze the divided object. The electronic device (101) can define a left region (2411) and a right region (2412) of the first image (710) using virtual vertical lines (2401, 2402) that cross the object included in the first image (710) in a vertical direction. The electronic device (101) can define an upper region (2413) and a lower region (2414) of the first image (710) using virtual horizontal lines (2403, 2404) that cross the object included in the first image (710) in a horizontal direction. According to one embodiment, the electronic device (101) may determine an effect to be applied to the first video (810) based on the left region (2411), the right region (2412), the upper region (2413), or the lower region (2414) defined for the first image (710) as follows.

[0194] 1. The electronic device (101) can apply the following effect when the size of the face of an object included in the first image (710) is about 6% or more of the entire area.

[0195] 1-1. When the face is located in the right area (2412), the electronic device (101) can apply an effect of the background moving away from the right area (2412) to the first video (810).

[0196] 1-2. When the face is located in the left area (2411), the electronic device (101) can apply an effect of the background moving away from the left area (2411) to the first video (810).

[0197] 2. When two or more faces of an object are detected in the first image (710), the electronic device (101) can apply an effect of the entire screen sliding left and right without a reference point to the first video (810).

[0198] 3. The electronic device (101) can apply the following effect when the face of the object is located in the upper region (2413) in the first image (710).

[0199] 3-1. The electronic device (101) can apply an effect of the gaze moving from the upper left to the upper right to the first video (810) when the face is located in the right area (2412).

[0200] 3-2. The electronic device (101) can apply an effect of the gaze moving from the upper right to the upper left to the first video (810) when the face is in the left area (2411).

[0201] 4. The electronic device (101) can apply the following effect when there is only one face of the object in the first image (710).

[0202] 4-1. The electronic device (101) can apply an effect of moving the gaze from the left area (2411) to the right area (2412) based on the object to the first video (810) when the first image (710) is a photograph of the upper body of the object and the object is looking at the right area (2412).

[0203] 4-2. The electronic device (101) can apply an effect of moving the gaze from the right area (2412) to the left area (2411) based on the object to the first video (810) when the first image (710) is a photograph of the upper body of the object and the object is looking at the left area (2411).

[0204] 4-3. When the face of an object in the first image (710) is positioned toward the right area (2412) in the middle area between the upper area (2413) and the lower area (2414), the electronic device (101) can apply an effect of the gaze moving from the upper part of the right area (2412) to the lower part of the left area (2411) to the first video (810).

[0205] 4-4. When the face of an object in the first image (710) is located in the left region (2411) in the middle region between the upper region (2413) and the lower region (2414), the device can apply an effect of the gaze moving from the upper part of the left region (2411) to the lower part of the right region (2412) to the first video (810).

[0206] 4-5. When the face of an object in the first image (710) is positioned from the lower area (2414) to the right area (2412), the electronic device (101) can apply an effect of moving the gaze from the lower part of the right area (2412) to the upper part of the left area (2411) to the first video (810).

[0207] 4-6. If the face of the object in the first image (710) is positioned from the lower area (2414) to the left area (2411), the electronic device (101) can apply an effect of moving the gaze from the lower part of the left area (2411) to the upper part of the right area (2412) to the first video (810).

[0208] According to one embodiment, the electronic device (101) may randomly select any one of the multiple effects mentioned in the present disclosure and apply it to the first video (810) if the first image (710) does not meet the conditions of the exemplary scenarios.

[0209] Fig. 25 is a flowchart illustrating the operation of an electronic device (101) according to one embodiment.

[0210] The operations illustrated in FIG. 25 may be performed by instructions stored in a memory (130) (e.g., the memory (130) of FIG. 1). For example, the instructions, when executed by a processor (120) (e.g., the processor (120) of FIG. 1), may cause the electronic device (101) (e.g., the electronic device (101) of FIG. 1) to perform the operations illustrated in FIG. 25. According to one embodiment, the instructions, when executed by the processor (120), may cause the electronic device (101) to perform at least some of the operations illustrated in FIG. 25 using a generative AI module (e.g., the generative AI module of FIG. 4).

[0211] At least some of the operations illustrated in FIG. 25 may be omitted. At least some of the operations mentioned with reference to other drawings in this disclosure may be additionally inserted before or after at least some of the operations illustrated in FIG. 25.

[0212] According to one embodiment, at least some of the operations illustrated in FIG. 25 may be performed sequentially.

[0213] According to one embodiment, at least some of the operations illustrated in FIG. 25 can be performed in parallel (simultaneously).

[0214] Hereinafter, the operation of an electronic device (101) according to one embodiment will be described with reference to FIG. 25.

[0215] In operation 2510, an electronic device (101) according to one embodiment (e.g., the electronic device (101) of FIG. 1 ) may display a plurality of images in a list format based on the execution of an application. Operation 2510 may be at least partially similar to or substantially identical to operation 510 described with reference to FIG. 5 .

[0216] In operation 2520, an electronic device (101) according to an embodiment may receive a first user input (e.g., a first user input (601) of FIG. 6) selecting a first image (e.g., a first image (710) of FIG. 7) from among a plurality of images (e.g., a plurality of images (610) of FIG. 6). Operation 2520 may be at least partially similar to or substantially identical to operation 520 described with reference to FIG. 5.

[0217] In operation 2530, the electronic device (101) according to one embodiment may display a guide object (e.g., a guide object (712) of FIG. 7) suggesting a 3D transformation for the first image (710) together with a first image (710) in response to a first user input (e.g., the first user input (601) of FIG. 6). Operation 2530 may be at least partially similar to or substantially identical to operation 530 described with reference to FIG. 5.

[0218] In operation 2540, the electronic device (101) according to one embodiment may display a first video (e.g., the first video (810) of FIG. 8) in a 3D form generated based on the first image (710) in response to receiving a second user input (e.g., the second user input (701) of FIG. 7) selecting a guide object (712). The electronic device (101) according to one embodiment may store the first video (810). Operation 2540 may be at least partially similar to or substantially identical to operation 540 described with reference to FIG. 5.

[0219] FIG. 26 is an example of a screen of a first user interface displaying images stored in an electronic device according to one embodiment.

[0220] Referring to FIG. 26, an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment may display a plurality of images in a list format based on the execution of an application. For example, the electronic device (101) may execute an application that displays images stored in a memory (e.g., the memory (130) of FIG. 1) based on a user input. For example, the application may be a gallery application. When the gallery application is executed, the electronic device (101) may display a first user interface (2600) that displays the stored images.

[0221] According to one embodiment, the screen of the first user interface (2600) may include a plurality of folders (2601) containing stored images. When one folder (2610) among the plurality of folders (2601) is selected, images (2620) contained in the selected folder (2610) may be displayed together with the plurality of folders (2601). The arrangement form in which the images (2620) contained in the folders (2610) are displayed may be a list form or a matrix form, but the present invention may not be limited thereto.

[0222] According to one embodiment, the electronic device (101) may receive a user input for selecting a first image (2621) from among images (2620) included in a folder (2610), and in response to the user input, display a screen of a second user interface (e.g., the second user interface (2700) of FIG. 27) as illustrated in FIG. 27.

[0223] FIG. 27 is an example of a screen of a second user interface displaying a first image according to one embodiment.

[0224] Referring to FIG. 27, an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment may receive a user input for selecting a first image (2621) on a screen of a first user interface (e.g., the first user interface (2600) of FIG. 26) and display a screen of a second user interface (2700) in response to the user input.

[0225] According to one embodiment, the screen of the second user interface (2700) includes a first image (2621), and around the first image (2621), for example, below the first image (2621), images (e.g., images (2620) of FIG. 26) included in a folder (e.g., folder (2610) of FIG. 26) in which the first image (2621) is stored may be displayed in a designated arranged form (2710). For example, the designated arranged form (2710) may be a horizontal arrangement form, but the present invention may not be limited thereto.

[0226] According to one embodiment, the electronic device (101) may receive a user's designated gesture input (2701) for at least a portion of the first image (2621) on the screen of the second user interface (2700). For example, the electronic device (101) may receive a drag input for dragging at least a portion of the first image (2621) in a designated direction (e.g., upward direction), but the present invention is not limited thereto. According to one embodiment, the electronic device (101) may display a screen of a third user interface (e.g., the third user interface (2800) of FIG. 28) as illustrated in FIG. 28 in response to the user's designated gesture input (2701) for at least a portion of the first image (2621).

[0227] FIG. 28 is an example of a screen of a third user interface displaying a guide object according to one embodiment.

[0228] Referring to FIG. 28, an electronic device (e.g., electronic device (101) of FIG. 1) according to one embodiment may receive a user's designated gesture input (e.g., gesture input (2701) of FIG. 27) for at least a portion of a first image (2621) on a screen of a second user interface (e.g., second user interface (2700) of FIG. 27), and display a screen of a third user interface (2800) in response to the designated gesture input (2701).

[0229] According to one embodiment, the screen of the third user interface (2800) includes a first image (2621), and around the first image (2621), for example, below the first image (2621), a guide object (2821) suggesting a 3D transformation for the first image (2621) may be displayed. The guide object (2821) may be an icon with a name such as “live effect.” According to one embodiment, the name of the icon representing the guide object (2821) is not limited to “live effect” and may be changed to various terms such as “3D transformation.”

[0230] According to one embodiment, the screen of the third user interface (2800) may further include, in addition to the guide object (2801), at least one icon, for example, an icon (2822) related to a background blur effect, an icon (2823) related to a remastering function (e.g., a picture quality enhancement function), but the present invention is not limited thereto. According to one embodiment, the screen of the third user interface (2800) may further include meta information (2810) related to the first image (2621) (e.g., meta information (711) of FIG. 7). The meta information (2810) may include at least one of a resolution of the first image (2621), an international standards organization (ISO) value, an aperture value, an exposure value, a shutter speed, information about camera performance, or location information.

[0231] According to one embodiment, the electronic device (101) may receive a user input (2801) for selecting a guide object (2821) on a screen of a third user interface (2800). According to one embodiment, in response to the user input (2801) for selecting a guide object (2821), the electronic device (101) may display an effect processing screen (e.g., an effect screen (2900) of FIG. 29) as illustrated in FIG. 29, and may display a screen of a fourth user interface (e.g., a fourth user interface (3000) of FIG. 30) as illustrated in FIG. 30.

[0232] FIG. 29 is an example of an effect screen displayed while converting a first image into a first video in 3D form according to one embodiment. FIG. 30 is an example of a screen of a fourth user interface displaying a first video in 3D form according to one embodiment.

[0233] Referring to FIG. 29, an electronic device (e.g., electronic device (101) of FIG. 1) according to one embodiment may receive a user input (2801) for selecting a guide object (2821) on a screen of a third user interface (e.g., third user interface (2800) of FIG. 28), and in response to the user input (2801), may display an effect processing screen, for example, an effect screen (2900).

[0234] According to one embodiment, the effect screen (2900) may be a screen displayed during a process in which the electronic device (101) converts the first image (2621) into a 3D image. For example, the effect screen (2900) may be displayed at least temporarily while the electronic device (101) converts the first image (2621) into a 3D image. According to one embodiment, the effect screen (2900) may include the first image (2621), but the first image (2621) may be expressed with a dimming effect in which the brightness is expressed darkly. According to one embodiment, the effect screen (2900) may include a text message (2901) that is overlaid with at least a portion of the first image (2621). The text message (2901) may be a message indicating that the electronic device (101) is in the process of 3D converting the first image (2621), and may include, for example, a message such as “Adding live effects,” but the present invention is not limited thereto.

[0235] According to one embodiment, in the effect screen (2900), an icon (2911) related to a sharing function and / or an icon (2912) related to a saving to another file function may be displayed around the first image (2621), for example, below the first image (2621).

[0236] According to one embodiment, when the electronic device (101) completes the operation of 3D converting the first image (2621), it can display the screen of the fourth user interface (3000), as illustrated in FIG. 30.

[0237] According to one embodiment, the screen of the fourth user interface (3000) may include a first video (3010) (e.g., the first video (810) of FIG. 8) generated by the electronic device (101) based on the first image (2621). The first video (3010) may be a video that represents an object in a 3D form, and may be a video in which a depth effect is applied to at least some objects included in the first image (2621).

[0238] According to one embodiment, on the screen of the fourth user interface (3000), an icon (2911) related to a sharing function and / or an icon (2912) related to a saving to another file function may be displayed around the first video (3010), for example, below the first video (3010).

[0239] According to one embodiment, the electronic device (101) may receive a user input (3001) for selecting an icon (2912) related to a function of saving as another file on a screen of a fourth user interface (3000). According to one embodiment, in response to the user input (3001) for selecting an icon (2912) related to a function of saving as another file, the electronic device (101) may display an effect processing screen (e.g., effect screen (3100) of FIG. 31) as illustrated in FIG. 31, and may display a screen of a first user interface (e.g., first user interface (2600) of FIG. 32) as illustrated in FIG. 32.

[0240] FIG. 31 is an example of an effect screen displayed while storing a first video in a 3D format according to one embodiment. FIG. 32 is an example of a screen of a first user interface displaying images stored in an electronic device according to one embodiment.

[0241] Referring to FIG. 31, an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1) may receive a user input (e.g., user input (3001) of FIG. 30) selecting an icon (e.g., icon (2912) of FIG. 30) related to a function of saving as another file on a screen of a fourth user interface (3000), and may display an effect processing screen, e.g., an effect screen (3100), in response to the user input (3001).

[0242] According to one embodiment, the effect screen (3100) may be a screen displayed during the process of the electronic device (101) storing the first video (3010). For example, the effect screen (3100) may be displayed at least temporarily while the electronic device (101) stores the first video (3010). According to one embodiment, the effect screen (3100) may include a pop-up message (3101) indicating that the first video (3010) is being stored. According to one embodiment, the pop-up message (3101) may be displayed in a form that is overlaid with at least a portion of the first video (3010). According to one embodiment, the pop-up message (3101) may include text such as “saving edited image,” but the present invention is not limited thereto.

[0243] According to one embodiment, when the electronic device (101) completes the operation of storing the first video (3010), it may display a screen of a first user interface (2600) that displays images stored in the electronic device. The screen of the first user interface (2600) may be at least partially similar to or substantially identical to the screen of the first user interface (3100) described with reference to FIG. 26. For example, the screen of the first user interface (3100) illustrated in FIG. 32 has a difference from the screen of the first user interface (3100) illustrated in FIG. 26 in that the first video (3010) is added to the folder (2610) in which the first image (2621) is stored.

[0244] An electronic device (101) according to one embodiment of the present disclosure includes a display module, a memory (130) storing a plurality of images and commands, and a processor (120), wherein the commands, when executed by the processor (120), cause the electronic device (101) to display the plurality of images in a list format based on the execution of an application, receive a first user input for selecting a first image (710) from among the plurality of images, display a guide object (712) proposing a 3D transformation for the first image (710) together with the first image (710) in response to the first user input, and display a first video (810) in a 3D form generated based on the first image (710) in response to receiving a second user input (701) for selecting the guide object (712).

[0245] The above instructions, when executed by the processor (120), cause the electronic device (101) to display a plurality of adjustment objects (821, 822) for adjusting the style of the first video (810) while the first video (810) is displayed, and to display a second video having the style of the first video (810) adjusted based on receiving a third user input for at least some of the plurality of adjustment objects (821, 822), wherein the plurality of adjustment objects (821, 822) may include a first adjustment object (821) for adjusting the playback speed of the first video (810), and a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810).

[0246] The above commands, when executed by the processor (120), may cause the electronic device (101) to display an adjustment object in the form of a slide bar for adjusting the style of the first video (810) when receiving a third user input for at least some of the plurality of adjustment objects (821, 822).

[0247] The above instructions, when executed by the processor (120), may cause the electronic device (101) to display a motion detection object (823) for executing a motion detection mode while the first video (810) is displayed, execute the motion detection mode based on receiving a fourth user input for selecting the motion detection object (823), and, when the motion detection mode is executed, vary the first video (810) based on the motion of the electronic device (101).

[0248] The above commands, when executed by the processor (120), can cause the electronic device (101) to detect the posture and movement of the electronic device (101) using a motion sensor when the motion detection mode is executed, and to change the first video (810) based on the detected posture and movement of the electronic device (101).

[0249] The above commands, when executed by the processor (120), can cause the electronic device (101) to remove the plurality of adjustment objects (821, 822) being displayed from the screen when the motion detection mode is executed.

[0250] The above instructions, when executed by the processor (120), may cause the electronic device (101) to receive a fifth user input for calling an effect menu while the first video (810) is displayed, and, in response to the fifth user input, display at least one effect object representing at least some of a plurality of effects for converting the first image (710) into a 3D video through the effect menu, and, in response to a sixth user input for selecting the at least one effect object, display a third video in a 3D format to which an effect corresponding to the selected effect object has been applied.

[0251] The above commands, when executed by the processor (120), may cause the electronic device (101) to determine a user preference for each of the plurality of effects based on the sixth user input selecting the at least one effect object, and to display the at least one effect object among the plurality of effects in order of increasing user preference when displaying the effect menu.

[0252] The above commands, when executed by the processor (120), determine a user preference for each of the plurality of effects based on a user history of the electronic device (101) transmitting the third video to an external device, and when displaying the effect menu, display at least one effect object among the plurality of effects in order of the highest user preference.

[0253] The above instructions, when executed by the processor (120), may cause the electronic device (101) to display a pop-up suggesting additional drawing for at least some of the objects and backgrounds included in the first video (810) based on analyzing the first video (810), and to display a transformed video with the additional drawing applied for at least some of the objects and backgrounds included in the first video (810) based on a seventh user input accepting the suggestion.

[0254] A method for driving an electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying a plurality of images stored in a memory (130) in a list format based on execution of an application, an operation of receiving a first user input for selecting a first image (710) from among the plurality of images, an operation of displaying a guide object (712) proposing a 3D transformation for the first image (710) together with the first image (710) in response to the first user input, and an operation of displaying a first video (810) in a 3D form generated based on the first image (710) in response to receiving a second user input (701) for selecting the guide object (712).

[0255] The method of driving the electronic device (101) further includes an operation of displaying a plurality of adjustment objects (821, 822) for adjusting the style of the first video (810) while the first video (810) is displayed, and an operation of displaying a second video having the style of the first video (810) adjusted based on receiving a third user input for at least some of the plurality of adjustment objects (821, 822), wherein the plurality of adjustment objects (821, 822) may include a first adjustment object (821) for adjusting the playback speed of the first video (810), and a second adjustment object (822) for adjusting depth information of at least one object included in the first video (810).

[0256] The driving method of the electronic device (101) may further include an operation of displaying an adjustment object in the form of a slide bar for adjusting the style of the first video (810) when receiving a third user input for at least some of the plurality of adjustment objects (821, 822).

[0257] The method of driving the electronic device (101) may further include an operation of displaying a motion detection object (823) for executing a motion detection mode while the first video (810) is displayed, an operation of executing the motion detection mode based on receiving a fourth user input for selecting the motion detection object (823), and an operation of changing the first video (810) based on a motion of the electronic device (101) when the motion detection mode is executed.

[0258] The driving method of the electronic device (101) may further include an operation of detecting the posture and movement of the electronic device (101) using a motion sensor when the motion detection mode is executed, and an operation of varying the first video (810) based on the detected posture and movement of the electronic device (101).

[0259] The driving method of the electronic device (101) may further include an operation of removing the plurality of adjustment objects (821, 822) being displayed from the screen when the motion detection mode is executed.

[0260] The driving method of the electronic device (101) may further include an operation of receiving a fifth user input for calling an effect menu while the first video (810) is displayed, an operation of displaying at least one effect object representing at least some of a plurality of effects for converting the first image (710) into a 3D video through the effect menu in response to the fifth user input, and an operation of displaying a third video in a 3D format to which an effect corresponding to the selected effect object is applied in response to a sixth user input for selecting the at least one effect object.

[0261] The driving method of the electronic device (101) may further include an operation of determining a user preference for each of the plurality of effects based on the sixth user input of selecting the at least one effect object, and an operation of displaying the at least one effect object in the order of the highest user preference among the plurality of effects when displaying the effect menu.

[0262] The driving method of the electronic device (101) may further include an operation of determining a user preference for each of the plurality of effects based on a user history of transmitting the third video to an external device, and an operation of displaying at least one effect object in the order of the highest user preference among the plurality of effects when displaying the effect menu.

[0263] The method of driving the electronic device (101) may further include an operation of displaying a pop-up suggesting additional drawing for at least some of the objects and backgrounds included in the first video (810) based on analyzing the first video (810), and an operation of displaying a transformed video to which additional drawing is applied for at least some of the objects and backgrounds included in the first video (810) based on a seventh user input accepting the suggestion.

Claims

1. In an electronic device (101), display module; A memory (130) for storing multiple images and commands; and Includes a processor (120), The above commands, when executed by the processor (120), cause the electronic device (101) to: Display the above multiple images in a list format based on the execution of the application, Receiving a first user input for selecting a first image (710) from among the plurality of images; In response to the first user input, display a guide object (712) suggesting a 3D transformation for the first image (710) together with the first image (710), In response to receiving a second user input (701) selecting the above guide object (712), displaying a first video (810) in a 3D shape generated based on the first image (710). Electronic device (101).

2. In paragraph 1, The above commands, when executed by the processor (120), cause the electronic device (101) to: While the first video (810) is displayed, a plurality of adjustment objects (821, 822) are displayed for adjusting the style of the first video (810), and Based on receiving a third user input for at least some of the plurality of adjustment objects (821, 822), display a second video with the style of the first video (810) adjusted, The above multiple adjustment objects (821, 822) A first adjustment object (821) for adjusting the playback speed of the first video (810); and A second adjustment object (822) for adjusting depth information of at least one object included in the first video (810), Electronic device (101).

3. In paragraph 2, The above commands, when executed by the processor (120), cause the electronic device (101) to: When receiving a third user input for at least some of the above plurality of adjustment objects (821, 822), display an adjustment object in the form of a slide bar for adjusting the style of the first video (810). Electronic device (101).

4. In paragraph 1, The above commands, when executed by the processor (120), cause the electronic device (101) to: While the first video (810) is displayed, a motion detection object (823) for executing the motion detection mode is displayed, Based on receiving a fourth user input selecting the above motion detection object (823), executing the motion detection mode, When the above motion detection mode is executed, the first video (810) is varied based on the motion of the electronic device (101). Electronic device (101).

5. In paragraph 4, The above commands, when executed by the processor (120), cause the electronic device (101) to: When the above motion detection mode is executed, the posture and movement of the electronic device (101) are detected using the motion sensor, and Based on the posture and movement of the detected electronic device (101), the first video (810) is varied. Electronic device (101).

6. In paragraph 5, The above commands, when executed by the processor (120), cause the electronic device (101) to: When the above motion detection mode is executed, the plurality of adjustment objects (821, 822) being displayed are removed from the screen. Electronic device (101).

7. In paragraph 1, The above commands, when executed by the processor (120), cause the electronic device (101) to: Receive a fifth user input that calls up the effect menu while the first video (810) is displayed; In response to the fifth user input, displaying at least one effect object representing at least some of a plurality of effects for converting the first image (710) into a 3D video through the effect menu, and In response to a sixth user input selecting at least one effect object, displaying a third video in a 3D shape with an effect corresponding to the selected effect object applied. Electronic device (101).

8. In paragraph 7, The above commands, when executed by the processor (120), cause the electronic device (101) to: determining a user preference for each of the plurality of effects based on the sixth user input selecting at least one effect object; and When displaying the above effect menu, display at least one effect object in the order of user preference among the plurality of effects. Electronic device (101).

9. In paragraph 7, The above commands, when executed by the processor (120), cause the electronic device (101) to: Based on the user history of transmitting the third video to an external device, determine the user preference for each of the plurality of effects, and When displaying the above effect menu, display at least one effect object in the order of user preference among the plurality of effects. Electronic device (101).

10. In paragraph 1, The above commands, when executed by the processor (120), cause the electronic device (101) to: Based on analyzing the first video (810), displaying a pop-up suggesting additional drawing of at least some of the objects and backgrounds included in the first video (810), and Based on a seventh user input accepting the above suggestion, display a transformed video with additional drawing applied to at least some of the objects and at least some of the background included in the first video (810). Electronic device (101).

11. In a driving method of an electronic device (101), An operation of displaying multiple images stored in memory (130) in a list format based on the execution of the application. An action of receiving a first user input for selecting a first image (710) from among the plurality of images; In response to the first user input, an action of displaying a guide object (712) suggesting a 3D transformation for the first image (710) together with the first image (710), and In response to receiving a second user input (701) selecting the above guide object (712), an action of displaying a first video (810) in a 3D shape generated based on the first image (710) is included. method.

12. In paragraph 11, The driving method of the above electronic device (101) An operation of displaying a plurality of adjustment objects (821, 822) for adjusting the style of the first video (810) while the first video (810) is displayed, and Further comprising an action of displaying a second video having the style of the first video (810) adjusted based on receiving a third user input for at least some of the plurality of adjustment objects (821, 822), The above multiple adjustment objects (821, 822) A first adjustment object (821) for adjusting the playback speed of the first video (810); and A second adjustment object (822) for adjusting depth information of at least one object included in the first video (810), method.

13. In paragraph 12, The driving method of the above electronic device (101) Further comprising an action of displaying an adjustment object in the form of a slide bar for adjusting the style of the first video (810) when receiving a third user input for at least some of the plurality of adjustment objects (821, 822). method.

14. In paragraph 11, The driving method of the above electronic device (101) An action of displaying a motion detection object (823) for executing a motion detection mode while the above first video (810) is displayed; An operation of executing the motion detection mode based on receiving a fourth user input selecting the motion detection object (823), and When the above motion detection mode is executed, the first video (810) further includes an operation of varying the first video (810) based on the motion of the electronic device (101). method.

15. In paragraph 14, The driving method of the above electronic device (101) When the above motion detection mode is executed, an operation of detecting the posture and movement of the electronic device (101) using a motion sensor, and Further including an action of changing the first video (810) based on the posture and movement of the detected electronic device (101). method.

Images