Electronic device for changing attributes of image on basis of reference image, and control method therefor

The electronic device simplifies image property modifications by using reference images to change object postures in videos, addressing the challenge of requiring specialized terminology in conventional systems.

WO2026024078A1PCT designated stage Publication Date: 2026-01-29SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/010873
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-08-26
Filing Date
2025-07-23
Publication Date
2026-01-29

AI Technical Summary

Technical Problem

Conventional electronic devices require specialized terminology or detailed text descriptions for modifying image properties, making it difficult for users to achieve desired image modifications using AI models.

Method used

An electronic device that allows users to change image properties based on a reference image without requiring technical terms or detailed text inputs, by obtaining user inputs to select reference images and apply object postures to videos through a touchscreen display.

Benefits of technology

Enables users to easily modify image properties by selecting reference images and applying object postures, providing a desired result without the need for specialized terminology or detailed text descriptions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025010873_29012026_PF_FP_ABST
    Figure KR2025010873_29012026_PF_FP_ABST
Patent Text Reader

Abstract

Provided are an electronic device for changing an attribute of an image on the basis of a reference image, and a control method therefor. The electronic device according to an embodiment of the present disclosure may be configured to: acquire a third user input for selecting at least one frame to which a posture of a first reference object included in a first reference image is to be applied; on the basis of the acquisition of the third user input, change the posture of the at least one object included in the at least one frame to the posture of the first reference object included in the first reference image; and generate a second video including the at least one frame including the changed posture and display same through a touch screen display.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device for changing properties of an image based on a reference image and a method for controlling the same

[0001] The present disclosure relates to an electronic device for changing properties of an image based on a reference image and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices that offer diverse features and differentiate themselves from competitors. Accordingly, the various functions offered through wearable devices are also becoming increasingly sophisticated.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] Conventional electronic devices, when modifying image properties (e.g., changing the shape of an object in a video) via an AI model, require prompts that include specialized terminology for image modification or require extremely detailed text descriptions. This means that even a single keyword, unintentionally altered by an AI model, can prevent the user from achieving the desired result.

[0005] According to one embodiment of the present disclosure, an electronic device can be provided that can provide a user with a desired result without requiring a prompt containing technical terms or inputting detailed text by changing the properties of an original image based on a reference image.

[0006] According to one embodiment of the present disclosure, a method of controlling an electronic device can be provided that can provide a user with a desired result without requiring a prompt containing technical terms or inputting detailed text by changing an attribute of an original image based on a reference image.

[0007] An electronic device according to one embodiment of the present disclosure includes a touchscreen display, at least one processor, and a memory, wherein the memory is configured to store a plurality of instructions, and the plurality of instructions, when executed by the at least one processor, cause the electronic device to: obtain, through the touchscreen display, a first user input for changing a posture of at least one object included in a first video displayed on the touchscreen display; display, through the touchscreen display, a plurality of reference images, each including at least one reference object; obtain, through the touchscreen display, a second user input for selecting a first reference image from among the plurality of reference images to change a posture of at least one object included in the first video; display, through the touchscreen display, a plurality of frames corresponding to a plurality of scenes included in the first video; and select, from among the plurality of displayed frames, at least one frame to which a posture of a first reference object included in the first reference image is to be applied, based on the acquisition of the first user input. The method may include instructions for obtaining a third user input, changing the pose of the at least one object included in the at least one frame to the pose of the first reference object included in the first reference image based on the obtaining of the third user input, and generating a second video including the at least one frame including the changed pose and displaying the second video through the touchscreen display.

[0008] A method for controlling an electronic device according to an embodiment of the present disclosure comprises: obtaining a first user input for changing a posture of at least one object included in a first video displayed on a touchscreen display of the electronic device; displaying, through the touchscreen display based on the obtaining of the first user input, a plurality of reference images each including at least one reference object; obtaining a second user input for selecting a first reference image from among the plurality of reference images to change the posture of at least one object included in the first video; displaying, through the touchscreen display based on the obtaining of the second user input, a plurality of frames corresponding to a plurality of scenes included in the first video; obtaining a third user input for selecting, from among the plurality of displayed frames, at least one frame to which the posture of the first reference object included in the first reference image is to be applied; and, based on the obtaining of the third user input, changing the posture of the at least one object included in the at least one frame to the first reference image. It may include an action of changing the posture of the first reference object included in the image, and an action of generating a second video including at least one frame including the changed posture and displaying the second video through the touchscreen display.

[0009] According to one embodiment of the present disclosure, a computer-readable non-transitory recording medium is configured to store a plurality of instructions, which, when executed by at least one processor of an electronic device, cause the electronic device to obtain, through a touchscreen display of the electronic device, a first user input for changing a posture of at least one object included in a first video displayed on the touchscreen display, display, through the touchscreen display, a plurality of reference images each including at least one reference object, based on obtaining the first user input, a second user input for selecting a first reference image from among the plurality of reference images to change the posture of at least one object included in the first video, display, through the touchscreen display, a plurality of frames corresponding to a plurality of scenes included in the first video, based on obtaining the second user input, and a third user input for selecting, from among the plurality of displayed frames, at least one frame to which the posture of the first reference object included in the first reference image is to be applied. The method may include instructions for acquiring, and based on the acquisition of the third user input, changing the pose of the at least one object included in the at least one frame to the pose of the first reference object included in the first reference image, and generating a second video including the at least one frame including the changed pose and displaying the second video through the touchscreen display.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.

[0011] FIG. 2 is an exemplary drawing for explaining a function or operation of an electronic device according to one embodiment of the present disclosure to change properties of an original image based on a reference image.

[0012] FIGS. 3A and 3B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device obtaining a selection of a plurality of images from among a plurality of still images stored in the electronic device from a user in order to generate an original video (e.g., a first image) according to one embodiment of the present disclosure.

[0013] FIG. 4 is an exemplary drawing for explaining, from a user interface perspective, a function or operation of an electronic device according to one embodiment of the present disclosure to display a screen (e.g., a first screen) for changing properties of an original video.

[0014] FIGS. 5A and 5B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device displaying a plurality of reference images stored in the electronic device and obtaining at least one reference image among the plurality of reference images from a user in order to change the properties of an original video (e.g., a first image) according to one embodiment of the present disclosure.

[0015] FIGS. 6A and 6B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device according to one embodiment of the present disclosure to use an image captured through a camera application as a reference image to change the properties of an original video (e.g., a first image).

[0016] FIGS. 7A and 7B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device according to one embodiment of the present disclosure, displaying a deformed image in which the pose of an object included in a reference image selected by a user is deformed, and obtaining a selection for the displayed deformed image.

[0017] FIG. 8 is an exemplary drawing for explaining, from a user interface perspective, a function or operation of selecting one object by an artificial intelligence model or user of an electronic device when a reference image according to one embodiment of the present disclosure includes a plurality of objects (e.g., main subjects).

[0018] FIGS. 9A and 9B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device according to an embodiment of the present disclosure to change an attribute of an original video into a pose corresponding to a pose of an object included in a reference image, based on a selection input for a plurality of frames included in the original video.

[0019] FIGS. 10A and 10B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device according to an embodiment of the present disclosure to re-transform a deformed posture by a user's text input or an artificial intelligence model of the electronic device.

[0020] FIG. 11 is an exemplary drawing for explaining a function or operation of an electronic device according to one embodiment of the present disclosure to identify a composition, color, and / or mood of a reference image and apply the composition, color, and / or mood of the identified reference image to an original video.

[0021] FIG. 12a is an exemplary drawing for explaining the composition of a reference image according to one embodiment of the present disclosure.

[0022] FIG. 12b is an exemplary drawing for explaining the color of a reference image according to one embodiment of the present disclosure.

[0023] FIG. 12c is an exemplary drawing for explaining the mood of a reference image according to one embodiment of the present disclosure.

[0024] FIG. 13 is an exemplary drawing for explaining a function or operation of an electronic device according to one embodiment of the present disclosure to identify a material related to a main subject of a reference image and apply the identified material to an original video.

[0025] FIG. 14a and FIG. 14b are example drawings for explaining the function or operation described in FIG. 13 from a user interface perspective.

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0027] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049] FIG. 2 is an exemplary drawing for explaining a function or operation of an electronic device (101) according to one embodiment of the present disclosure to change the properties of an original image (410) based on a reference image (510).

[0050] Referring to FIG. 2, an electronic device (101) according to an embodiment of the present disclosure may, in operation 210, obtain a first user input for changing a posture of at least one object (e.g., a first object (410)) included in a first video (e.g., an original image (410)) displayed on a touchscreen display (e.g., a display module (160) of FIG. 1). The electronic device (101) according to an embodiment of the present disclosure may generate the first video based on a plurality of still images. FIGS. 3A and 3B are exemplary drawings for explaining, from a user interface perspective, a function or operation of obtaining a selection of a plurality of images from among a plurality of still images stored in the electronic device (101) from a user in order to generate an original video (e.g., an original image (410)). Referring to FIGS. 3A and 3B , an electronic device (101) according to an embodiment of the present disclosure may display a screen (e.g., a first execution screen (300)) for generating a video on a display module (160). The first execution screen (300) according to an embodiment of the present disclosure may include at least one image (e.g., a still image (310)) stored in the electronic device or transmitted from an external electronic device. As illustrated in FIG. 3B , the electronic device (101) according to an embodiment of the present disclosure may obtain a selection for a plurality of images (e.g., a first still image (310a), a second still image (310b), and / or a third still image (310c)) to generate a video.An electronic device (101) according to one embodiment of the present disclosure can generate a video (e.g., original video (410)) by an artificial intelligence model stored in the electronic device (101) based on a selection input for a plurality of images (e.g., a first still image (310a), a second still image (310b), and / or a third still image (310c)) and a selection input for a first visual object (312) set to generate a video (e.g., original video (410)). An artificial intelligence model (e.g., LLM) according to one embodiment of the present disclosure can generate a video (e.g., original video (410)) by using, for example, a frame interpolation technique.

[0051] An electronic device (101) according to one embodiment of the present disclosure may also generate a video (e.g., an original video (410)) based on a query from a user via an intelligent assistant module, rather than a selection input for a first visual object (312). For example, an electronic device (101) according to an embodiment of the present disclosure may obtain a query requesting the generation of a video (e.g., an original video (410)) through a designated application (e.g., an intelligent assistance module, such as Samsung® Galaxy Bixby). The type of query according to an embodiment of the present disclosure may include a natural language, an image, and / or a video, or a combination thereof. The type of query according to an embodiment of the present disclosure may also include a non-natural language form, such as a form in which a user selects a designated menu on an application execution screen. An electronic device (101) according to an embodiment of the present disclosure may output a result (e.g., an original video (410)) corresponding to the query based on the obtained query. For example, an electronic device (101) according to an embodiment of the present disclosure may generate a prompt suitable to be input to an artificial intelligence model (e.g., LLM). An electronic device according to an embodiment of the present disclosure may generate a prompt suitable for being input to an artificial intelligence model (e.g., LLM). The device (101) can generate a result (e.g., an original video (410)) corresponding to a query using the generated prompt and an artificial intelligence model (e.g., LLM) included in the electronic device (101). The electronic device (101) according to one embodiment of the present disclosure can output the generated result. The result according to one embodiment of the present disclosure can be output in a natural language form and / or a specified content form (e.g., a still image and / or a video form).A model for generating an image according to one embodiment of the present disclosure may include, for example, a generative adversarial network (GAN) and / or a variational autoencoder (VAE), and may include a diffusion-based generative model using a VAE and a transformer structure. The result according to one embodiment of the present disclosure may include at least one indicator (e.g., a watermark) representing an artificial intelligence model (e.g., Samsung® Galaxy AI). According to one embodiment of the present disclosure, a video file stored in an electronic device (101) may be selected. According to one embodiment of the present disclosure, a video (e.g., an original video (410)) may be generated by an external electronic device (e.g., an LLM server) that is operable with the electronic device (101). To this end, the electronic device (101) according to one embodiment of the present disclosure may transmit information about a plurality of images selected by a user (e.g., a first still image (310a), a second still image (310b), and / or a third still image (310c)) to the external electronic device.

[0052] FIG. 4 is an exemplary drawing for explaining, from a user interface perspective, a function or operation of an electronic device (101) according to one embodiment of the present disclosure to display a screen (e.g., a first execution screen (410)) for changing the properties of an original video (410).

[0053] Referring to FIG. 4, an electronic device (101) according to an embodiment of the present disclosure may display a first execution screen (410) including a video generated by an artificial intelligence model (e.g., an original video (410)) through a display module (160). The first execution screen (410) according to an embodiment of the present disclosure may include at least one of the original video (410), a first menu (420) for changing a posture of a first object (410a) (e.g., a main subject, for example, a person) included in the original video (410), a second menu (430) for changing a color of the original video (410), a third menu (440) for changing a mood of the original video (410), and / or a fourth menu (450) for changing the composition of the original video (410) and / or the material of the first object (410a). A first execution screen (410) according to one embodiment of the present disclosure may include at least one of a first text (460) for describing an original video and a second visual object (470) configured to obtain a user input for changing a property of the original video (410). An electronic device (101) according to one embodiment of the present disclosure may also change and display the property of the original video (410) based on a user input for modifying the first text (460). An electronic device (101) according to one embodiment of the present disclosure may obtain a user input for a first menu (420) on the displayed first screen (410).

[0054] An electronic device (101) according to an embodiment of the present disclosure may, at operation 220, display a plurality of reference images (510) each including at least one reference object (512) (e.g., a main subject, for example, a person) through a touchscreen display (e.g., a display module (160)) based on acquisition of a first user input. An electronic device (101) according to an embodiment of the present disclosure may, at operation 230, acquire a second user input for selecting a first reference image (510a) from among the plurality of reference images (510) to change a pose of at least one object included in a first video (e.g., an original video (410)).

[0055] FIGS. 5A and 5B are exemplary drawings for explaining, from a user interface perspective, a function or operation of displaying a plurality of reference images (510) stored in the electronic device (101) and obtaining at least one reference image (e.g., a first reference image (510a)) from among the plurality of reference images (510) from a user in order to change the properties of an original video (410) by the electronic device (101) according to one embodiment of the present disclosure. An artificial intelligence model (e.g., Samsung® Galaxy AI) according to one embodiment of the present disclosure may select at least one image including a main subject (e.g., a person) from among a plurality of images stored in the electronic device (101) and display (e.g., recommend) the selected at least one image. The plurality of reference images (510) recommended by the artificial intelligence model according to one embodiment of the present disclosure may include at least one person having a specified pose. An electronic device (101) according to one embodiment of the present disclosure may display a second execution screen (500) including a plurality of reference images (510), a third visual object (520) set to execute a camera application to generate a reference image by a user through the camera application, and / or a fourth visual object (530) set to proceed to a next step after selecting a first reference image (510a).

[0056] FIGS. 6A and 6B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device (101) according to an embodiment of the present disclosure using an image captured through a camera application as a reference image (e.g., a first reference image (510a)) to change the properties of an original video (410). Referring to FIGS. 6A and 6B , the electronic device (101) according to an embodiment of the present disclosure may execute a camera application (e.g., activate at least one camera) as illustrated in FIG. 6A based on obtaining a user input for a third visual object (520). The electronic device (101) according to an embodiment of the present disclosure may identify a main subject (e.g., a person, the first main subject (610)) and a pose of the main subject in an image captured through the camera application. An electronic device (101) according to one embodiment of the present disclosure can display an identified main subject so as to be visually distinct from the background, as illustrated in FIG. 6b.

[0057] FIGS. 7A and 7B are exemplary drawings for explaining a function or operation of displaying a transformed image (in which a posture of an object included in a reference image (e.g., a first reference image (510a)) selected by a user, and obtaining a selection for the displayed transformed image) by an electronic device (101) according to an embodiment of the present disclosure from a user interface perspective. Referring to FIGS. 7A and 7B, the electronic device (101) according to an embodiment of the present disclosure, based on obtaining a selection input for the first reference image (510a) from a user, displays an original reference image (702) including a posture of a main subject of the first reference image (510a) and / or at least one transformed reference image (e.g., a first transformed reference image (710a), a second transformed reference image (710b), and / or a subject having a transformed posture based on a manner in which the posture of the main subject of the first reference image (510a) is specified. The third deformed reference image (710c) can be displayed. The electronic device (101) according to one embodiment of the present disclosure can deform the pose of the main subject of the first reference image (510a) using an artificial intelligence model. For example, the electronic device (101) according to one embodiment of the present disclosure can identify a description of the main subject and determine deformable elements based on the order of strong features in the identified description. According to one embodiment of the present disclosure, the order of features may be predetermined and stored in the electronic device (101) or the features may be determined by the user. For example, the features according to one embodiment of the present disclosure may include at least one of the shape of a part of the subject (e.g., a body part) (e.g., when the arm is spread), the direction in which the subject is looking (e.g., whether looking straight ahead), the place where the subject is located, and the background around the subject.An electronic device (101) according to an embodiment of the present disclosure may generate and display a deformed reference image (e.g., a first deformed reference image (710a), a second deformed reference image (710b), and / or a third deformed reference image (710c)) based on some of the characteristics among a plurality of characteristics. For example, an electronic device (101) according to an embodiment of the present disclosure may identify, as characteristics (e.g., descriptions), that a main subject has arms outstretched, legs bent, is looking straight ahead, and that the subject is currently positioned on a road. An electronic device (101) according to an embodiment of the present disclosure may determine, among the identified characteristics, a pose of the subject (e.g., a pose with arms outstretched and legs bent) as a deformable element. According to one embodiment of the present disclosure, some of the characteristics for generating a deformation reference image (e.g., a first deformation reference image (710a), a second deformation reference image (710b), and / or a third deformation reference image (710c)) may be pre-specified or may be specified by a user. The electronic device (101) according to one embodiment of the present disclosure may display a third execution screen (700) including at least one deformation reference image (e.g., a first deformation reference image (710a), a second deformation reference image (710b), and / or a third deformation reference image (710c)), as illustrated in FIG. 7A . Each of the deformed reference images (e.g., the first deformed reference image (710a), the second deformed reference image (710b), and / or the third deformed reference image (710c)) according to one embodiment of the present disclosure may include a shape (710a) of a posture included in the original reference image (702) and a shape (710b) of a deformed posture. The electronic device (101) according to one embodiment of the present disclosure may display the shape (710a) of the posture included in the original reference image (702) and the shape (710b) of the deformed posture so as to be visually distinguished from each other.A third execution screen (700) according to one embodiment of the present disclosure may include a fifth visual object (740) configured to obtain a query for modifying a pose of an object included in a transformed reference image (e.g., a first transformed reference image (710a), a second transformed reference image (710b), and / or a third transformed reference image (710c)) and / or an original reference image (702). According to one embodiment of the present disclosure, when a user input is obtained for selecting one of the deformation reference images (e.g., the third deformation reference image (710c)) among the deformation reference images (e.g., the first deformation reference image (710a), the second deformation reference image (710b), and / or the third deformation reference image (710c)), the electronic device (101) may enlarge and display the selected deformation reference image (e.g., the third deformation reference image (710c)), as illustrated in FIG. 7b. An electronic device (101) according to one embodiment of the present disclosure may obtain a user input (e.g., a second user input) for selecting one of a modified reference image (e.g., a first modified reference image (710a), a second modified reference image (710b), and / or a third modified reference image (710c)) and / or an original reference image (702) on a third execution screen (700).

[0058] FIG. 8 is an exemplary diagram for explaining, from a user interface perspective, a function or operation of selecting one object by an artificial intelligence model of an electronic device (101) or a user when a reference image (e.g., an original reference image (702)) according to an embodiment of the present disclosure includes a plurality of objects (e.g., a second main subject (810), a third main subject (820)). Referring to FIG. 8, the electronic device (101) (e.g., an artificial intelligence model) according to an embodiment of the present disclosure may select one object from among a plurality of objects included in the selected reference image based on an object selection criterion. For example, the object selection criterion according to an embodiment of the present disclosure may be specified to select a subject occupying the largest area (e.g., a person), a subject based on a result learned according to the user's object selection history, and a subject facing the front. An electronic device (101) according to one embodiment of the present disclosure can display an object (e.g., a second main subject (810)) selected by an artificial intelligence model or a user so as to be visually distinguished from other subjects. According to one embodiment of the present disclosure, a function or operation of selecting a plurality of objects (e.g., a second main subject (810), a third main subject (820)) can be performed even before a reference image is selected.

[0059] According to an embodiment of the present disclosure, in operation 240, the electronic device (101) may display a plurality of frames (e.g., a first frame (910a), a second frame (910b), a third frame (910c)) corresponding to a plurality of scenes included in a first video (e.g., an original video (410)) through a touchscreen display (e.g., a display module (160)) based on acquisition of a second user input. According to an embodiment of the present disclosure, in operation 250, the electronic device (101) may obtain a third user input for selecting at least one frame to which a posture of a first reference object included in a first reference image (e.g., an original reference image (702)) is to be applied, from among the displayed plurality of frames (e.g., the first frame (910a), the second frame (910b), the third frame (910c)). According to one embodiment of the present disclosure, the function or operation of obtaining a third user input for selecting at least one frame to which the pose of the first reference object included in the first reference image (e.g., the original reference image (702)) is to be applied may be performed before operation 220 and / or operation 230. In other words, the third user input for selecting at least one frame to which the pose of the first reference object included in the first reference image (e.g., the original reference image (702)) is to be applied may be obtained before displaying a plurality of reference images (510) each including at least one reference object (512) (e.g., a main subject, e.g., a person).

[0060] FIGS. 9A and 9B are exemplary drawings for explaining, from a user interface perspective, a function or operation of changing the properties of an original video (410) to a posture corresponding to the posture of an object included in a reference image (e.g., original reference image (702)) according to a selection input for a plurality of frames (e.g., a first frame (910a), a second frame (910b), and a third frame (910c)) included in an original video (410) by an electronic device (101) according to an embodiment of the present disclosure. Referring to FIGS. 9A and 9B , an electronic device (101) according to an embodiment of the present disclosure may display a fourth execution screen (900) including a plurality of frames (e.g., a first frame (910a), a second frame (910b), and a third frame (910c)) constituting the original video (410) and the original video (410). An electronic device (101) according to an embodiment of the present disclosure may display an image corresponding to a frame in which a bar (912) is located as an original video (410) on a fourth execution screen (900). An electronic device (101) according to an embodiment of the present disclosure may obtain a user input (e.g., a third user input) for any one frame among a plurality of frames (e.g., a first frame (910a), a second frame (910b), a third frame (910c)). Alternatively, an electronic device (101) according to an embodiment of the present disclosure may obtain a user input (e.g., a third user input) for an area (e.g., a first area (914)) between a plurality of frames (e.g., a first frame (910a), a second frame (910b), a third frame (910c)). An electronic device (101) according to one embodiment of the present disclosure may, based on acquisition of a user input (e.g., a third user input), display a frame or area in which the user input is acquired so as to be visually distinguished from other frames or areas.According to one embodiment of the present disclosure, when a user's selection input for an area (e.g., the first area (914)) is obtained, the electronic device (101) may display a guidance message (e.g., "Create additional") guiding additional creation of frames on the fourth execution screen (900), as illustrated in FIG. 9A. According to one embodiment of the present disclosure, when a selection input for an area between frames (e.g., the first area (914)) is obtained, the electronic device (101) may expand the area designated by the user and display it so as to be visually distinguished from other areas, as illustrated in FIG. 9B.

[0061] An electronic device (101) according to an embodiment of the present disclosure may select a start frame and an end frame to which the posture of a first reference object is to be applied. When a start frame and an end frame to which the posture of the first reference object is to be applied are selected, the electronic device (101) according to an embodiment of the present disclosure may change the posture of an object included in at least one frame existing between the start frame and the end frame, including the start frame and the end frame, to correspond to the posture of the first reference object. The start frame and the end frame according to an embodiment of the present disclosure may be different frames or may be the same frames. Instead of the start frame and / or the end frame, the electronic device (101) according to an embodiment of the present disclosure may select a designated area (e.g., the first area (914)). Based on the selection of a frame and / or an area, the electronic device (101) according to an embodiment of the present disclosure may display a preview image (930) for a posture to be changed. An electronic device (01) according to an embodiment of the present disclosure may change the posture of an object included in at least one frame having a posture similar to one of the selected frames (e.g., when the difference in posture is within a specified error range) to a posture corresponding to the posture of the first reference object, based on a selection input being obtained for one of the frames to which the posture of the first reference object is to be applied. For example, an electronic device (01) according to an embodiment of the present disclosure may determine a start frame and an end frame among a plurality of frames having postures similar to one of the selected frames, and change the posture of an object included in at least one frame existing between the start frame and the end frame to a posture corresponding to the posture of the first reference object.

[0062] According to an embodiment of the present disclosure, the electronic device (101) may, at operation 260, change the pose of at least one object included in at least one frame to the pose of the first reference object included in the first reference image based on acquisition of a third user input. According to an embodiment of the present disclosure, the electronic device (101) may, at operation 270, display a second video including the changed pose through a touchscreen display. According to an embodiment of the present disclosure, the electronic device (101) may, at operation 270, change the pose of at least one object included in at least one frame and / or area to the pose corresponding to the pose of the first reference object based on acquisition of a selection input from the user for the sixth visual object (916) set to change the pose to the pose of the reference object included in the preview image (930). According to an embodiment of the present disclosure, when an area (e.g., the first area (914)) is selected, the electronic device (101) may newly generate a frame including a subject including the pose of a first reference object (e.g., a main subject included in the original reference image (702)). According to an embodiment of the present disclosure, the electronic device (101) may generate a second video using a frame interpolation technique based on frames before and after the area (e.g., the first area (914)) and the newly generated frame. Alternatively, according to an embodiment of the present disclosure, when a frame (e.g., the first frame (910a)) is selected, the electronic device (101) may change the pose of the main subject included in the selected frame (e.g., change it to an image of holding a basketball with arms outstretched and / or change it to an image of riding a skateboard with arms outstretched) so as to correspond to the pose of the first reference object (e.g., the main subject included in the original reference image (702). In this disclosure, an embodiment of changing the pose of an object included in an original video (410) based on the original video (410) is described, but this is an example for explanation.According to one embodiment of the present disclosure, a still image may be selected instead of a video, and the electronic device (101) may change the pose of an object included in the selected still image, according to various embodiments mentioned in the present disclosure.

[0063] FIG. 10A and FIG. 10B are exemplary drawings for explaining, from a user interface perspective, a function or operation of an electronic device (101) according to one embodiment of the present disclosure to change a changed posture again by a user's text input or an artificial intelligence model of the electronic device (101).

[0064] Referring to FIGS. 10A and 10B , an electronic device (101) according to an embodiment of the present disclosure may obtain a user input (e.g., a user input for a fifth visual object (740)) for re-deforming a posture of an object having a deformed posture. As illustrated in FIG. 10A , the electronic device (101) according to an embodiment of the present disclosure may obtain an input (e.g., a text input, “Raise your arm a little more in that posture”) from a user for re-deforming a deformed posture. The electronic device (101) according to an embodiment of the present disclosure may re-deform a posture of a reference object included in a reference image according to the user’s input. Alternatively, the electronic device (101) according to an embodiment of the present disclosure may obtain a voice command from a user, as illustrated in FIG. 10B . An electronic device (101) according to an embodiment of the present disclosure may, while acquiring a user's voice command, display a first indicator (1010) indicating that a voice command is being acquired. An electronic device (101) according to an embodiment of the present disclosure may re-deform the posture of a reference object included in a reference image according to a user's input (e.g., a speech input). An electronic device (101) according to an embodiment of the present disclosure may also deform and display a posture before being deformed according to a user's input (e.g., a text input and / or a speech input).

[0065] FIG. 11 is an exemplary drawing for explaining a function or operation of an electronic device (101) according to one embodiment of the present disclosure to identify a composition, color, and / or mood of a reference image (e.g., a first reference image (510a)) and apply the composition, color, and / or mood of the identified reference image (e.g., the first reference image (510a)) to an original video (410).

[0066] Referring to FIG. 11, an electronic device (101) according to an embodiment of the present disclosure may, in operation 1110, acquire a first user input for changing a posture of at least one object (e.g., a first object (410)) included in a first video (e.g., an original image (410)) displayed on a touchscreen display (e.g., a display module (160) of FIG. 1). In operation 1120, the electronic device (101) according to an embodiment of the present disclosure may, based on acquisition of the first user input, display a plurality of reference images (510) each including at least one reference object (512) (e.g., a main subject, for example, a person) through the touchscreen display (e.g., the display module (160)). An electronic device (101) according to one embodiment of the present disclosure may, in operation 1130, obtain a second user input for selecting a first reference image (510a) from among a plurality of reference images (510) to change a pose of at least one object included in a first video (e.g., original video (410)).

[0067] An electronic device (101) according to an embodiment of the present disclosure may identify a composition, color, and / or mood of a first reference image (510a) in operation 1140. FIG. 12A is an exemplary diagram for explaining the composition of a reference image (e.g., the first reference image (510a)) according to an embodiment of the present disclosure. An electronic device (101) according to an embodiment of the present disclosure may identify the composition of a reference image (e.g., the first reference image (510a)) by, for example, dividing the reference image (e.g., the first reference image (510a)) into three parts. An electronic device (101) according to an embodiment of the present disclosure may change the composition of an original video (410) based on a user input for applying the composition of the reference image to the original video (410). FIG. 12B is an example diagram for explaining the color of a reference image (e.g., a first reference image (510a)) according to an embodiment of the present disclosure. An electronic device (101) according to an embodiment of the present disclosure may, for example, identify a color value (e.g., an RGB value) of a reference image (e.g., a first reference image (510a)) and apply the identified color value to an original video (410). FIG. 12C is an example diagram for explaining the mood of a reference image (e.g., a first reference image (510a)) according to an embodiment of the present disclosure. An electronic device (101) (e.g., an artificial intelligence model) according to an embodiment of the present disclosure may, for example, identify a mood (e.g., loneliness, desolation) of a reference image (e.g., the first reference image (510a)). An electronic device (101) according to one embodiment of the present disclosure can control the color values ​​of the original video (410) by applying a color value corresponding to an identified mood to the original video (410) so that a mood that can be felt by a user in a reference image can also be felt in the original video (410).An electronic device (101) according to one embodiment of the present disclosure may, in operation 1150, apply the composition, color, and / or mood of an identified first reference image (510a)) to a first video (e.g., an original video (410)) to generate a second video, and display the generated second video.

[0068] FIG. 13 is an exemplary drawing for explaining a function or operation of an electronic device according to one embodiment of the present disclosure to identify a material related to a main subject of a reference image and apply the identified material to an original video.

[0069] Referring to FIG. 13, an electronic device (101) according to an embodiment of the present disclosure may, in operation 1310, acquire a first user input for changing a posture of at least one object (e.g., a first object (410)) included in a first video (e.g., an original image (410)) displayed on a touchscreen display (e.g., a display module (160) of FIG. 1). In operation 1320, the electronic device (101) according to an embodiment of the present disclosure may, based on acquisition of the first user input, display a plurality of reference images (510) each including at least one reference object (512) (e.g., a main subject, for example, a person) through the touchscreen display (e.g., the display module (160)). An electronic device (101) according to one embodiment of the present disclosure may, in operation 1330, obtain a second user input for selecting a first reference image (510a) from among a plurality of reference images (510) to change a pose of at least one object included in a first video (e.g., an original video (410)).

[0070] An electronic device (101) according to an embodiment of the present disclosure may identify a material (e.g., a hat worn by a subject) related to a main object of a first reference image (510a) in operation 1340. FIGS. 14A and 14B are exemplary drawings for explaining the function or operation described in FIG. 13 from a user interface perspective. Referring to FIG. 14A, an electronic device (101) according to an embodiment of the present disclosure may obtain a user input for a fourth menu (450). An electronic device (101) according to an embodiment of the present disclosure may identify a material related to a main subject included in a first reference image (510a) based on the user input for the fourth menu (450). The material related to the main subject according to an embodiment of the present disclosure may include various objects such as the gender of the subject, clothes worn by the subject, and / or accessories, and items carried by the subject. When an electronic device (101) according to an embodiment of the present disclosure obtains a user input (e.g., a user input for the sixth menu (1430)) for applying a material related to a reference object to an object included in an original video (410), the electronic device (101) may apply the material related to the reference object to the object included in the original video (410) and display it. As illustrated in FIG. 14b, the electronic device (101) according to an embodiment of the present disclosure may display information (1440) about a first reference image (510a) together with the original video (410).

[0071] An electronic device according to one embodiment of the present disclosure includes a touchscreen display, at least one processor, and a memory, wherein the memory is configured to store a plurality of instructions, and the plurality of instructions, when executed by the at least one processor, cause the electronic device to: obtain, through the touchscreen display, a first user input for changing a posture of at least one object included in a first video displayed on the touchscreen display; display, through the touchscreen display, a plurality of reference images, each including at least one reference object; obtain, through the touchscreen display, a second user input for selecting a first reference image from among the plurality of reference images to change a posture of at least one object included in the first video; display, through the touchscreen display, a plurality of frames corresponding to a plurality of scenes included in the first video; and select, from among the plurality of displayed frames, at least one frame to which a posture of a first reference object included in the first reference image is to be applied, based on the acquisition of the first user input. The method may include instructions for obtaining a third user input, changing the pose of the at least one object included in the at least one frame to the pose of the first reference object included in the first reference image based on the obtaining of the third user input, and generating a second video including the at least one frame including the changed pose and displaying the second video through the touchscreen display.

[0072] A method for controlling an electronic device according to an embodiment of the present disclosure comprises: obtaining a first user input for changing a posture of at least one object included in a first video displayed on a touchscreen display of the electronic device; displaying, through the touchscreen display based on the obtaining of the first user input, a plurality of reference images each including at least one reference object; obtaining a second user input for selecting a first reference image from among the plurality of reference images to change the posture of at least one object included in the first video; displaying, through the touchscreen display based on the obtaining of the second user input, a plurality of frames corresponding to a plurality of scenes included in the first video; obtaining a third user input for selecting, from among the plurality of displayed frames, at least one frame to which the posture of the first reference object included in the first reference image is to be applied; and, based on the obtaining of the third user input, changing the posture of the at least one object included in the at least one frame to the first reference image. It may include an action of changing the posture of the first reference object included in the image, and an action of generating a second video including at least one frame including the changed posture and displaying the second video through the touchscreen display.

[0073] According to one embodiment of the present disclosure, a computer-readable non-transitory recording medium is configured to store a plurality of instructions, which, when executed by at least one processor of an electronic device, cause the electronic device to obtain, through a touchscreen display of the electronic device, a first user input for changing a posture of at least one object included in a first video displayed on the touchscreen display, display, through the touchscreen display, a plurality of reference images each including at least one reference object, based on obtaining the first user input, a second user input for selecting a first reference image from among the plurality of reference images to change the posture of at least one object included in the first video, display, through the touchscreen display, a plurality of frames corresponding to a plurality of scenes included in the first video, based on obtaining the second user input, and a third user input for selecting, from among the plurality of displayed frames, at least one frame to which the posture of the first reference object included in the first reference image is to be applied. The method may include instructions for acquiring, and based on the acquisition of the third user input, changing the pose of the at least one object included in the at least one frame to the pose of the first reference object included in the first reference image, and generating a second video including the at least one frame including the changed pose and displaying the second video through the touchscreen display.

[0074] Electronic devices according to various embodiments disclosed in the present disclosure may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0075] The various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In the present disclosure, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among the phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0076] The term "module" used in various embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0077] Various embodiments of the present disclosure may be implemented as software (e.g., a program (2540)) including one or more instructions stored in a storage medium (e.g., an internal memory (2536) or an external memory (2538)) readable by a machine (e.g., an electronic device (2501)). For example, a processor of the machine (e.g., the electronic device (2501)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0078] According to one embodiment, the method according to various embodiments disclosed in the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0079] According to one embodiment of the present disclosure, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to one embodiment of the present disclosure, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment of the present disclosure, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, Touchscreen display, At least one processor, and A memory comprising: a memory configured to store a plurality of instructions; wherein the plurality of instructions, when executed by the at least one processor, cause the electronic device to: Obtaining a first user input for changing the posture of at least one object included in a first video displayed on the touchscreen display through the touchscreen display; Based on acquisition of the first user input, a plurality of reference images, each including at least one reference object, are displayed through the touchscreen display, and each of the plurality of reference images includes at least one reference object used to change the posture of the at least one object. Obtaining a second user input for selecting a first reference image from among the plurality of reference images to change the pose of at least one object included in the first video; An electronic device characterized in that it includes instructions for changing the pose of the at least one object included in at least one frame among a plurality of frames of the first video to the pose of the first reference object included in the first reference image based on acquisition of the second user input.

2. In paragraph 1, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: An electronic device characterized in that it further includes instructions for generating at least one modified reference pose in which the pose of the first reference object is modified based on the pose of the first reference object, and displaying the generated at least one modified reference pose together with the pose of the first reference object through the touch screen display.

3. In paragraph 1 or 2, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: An electronic device characterized in that, when the first reference image includes a plurality of first reference objects, the electronic device further includes an instruction for selecting one reference object for changing the posture of at least one object among the plurality of first reference objects based on the acquired fourth user input.

4. In any one of paragraphs 1 to 3, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: Based on the acquisition of the second user input, the method further includes an instruction for displaying a plurality of frames corresponding to a plurality of scenes included in the first video through the touchscreen display, and obtaining a third user input for selecting at least one frame to which the posture of the first reference object included in the first reference image is to be applied among the displayed plurality of frames. An electronic device, characterized in that the plurality of reference images include images selected by an artificial intelligence model of the electronic device from among a plurality of images stored in the electronic device.

5. In any one of paragraphs 1 to 4, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: An electronic device, characterized in that it further includes instructions for applying at least one of the composition, color, or mood of the first reference image to the at least one selected frame.

6. In any one of paragraphs 1 to 5, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: Further comprising instructions for generating a second video including at least one frame including the changed posture and displaying the second video through the touchscreen display; An electronic device, characterized in that the at least one deformation reference pose is displayed together with the pose of the first reference object within one selectable image, and the at least one deformation reference pose and the pose of the first reference object are displayed so as to be visually distinct from each other.

7. In any one of paragraphs 1 to 6, The above plurality of instructions, when executed by the at least one processor, cause the electronic device to: An electronic device characterized in that, when the first reference image includes a plurality of first reference objects, the artificial intelligence model further includes an instruction to select one reference object among the plurality of first reference objects for changing the posture of at least one object.

8. In a method of controlling an electronic device, An operation of obtaining a first user input for changing a posture of at least one object included in a first video displayed on the touchscreen display of the electronic device, Based on acquisition of the first user input, an operation of displaying a plurality of reference images, each of which includes at least one reference object, through the touchscreen display, wherein each of the plurality of reference images includes at least one reference object used to change a posture of the at least one object, An operation of obtaining a second user input for selecting a first reference image from among the plurality of reference images to change the pose of at least one object included in the first video; A method for controlling an electronic device, characterized in that it includes an operation of changing the posture of the at least one object included in at least one frame among a plurality of frames of the first video to the posture of the first reference object included in the first reference image based on acquisition of the second user input.

9. In paragraph 8, A method for controlling an electronic device, characterized in that the method further includes an operation of generating at least one transformed reference posture, in which the posture of the first reference object is transformed, based on the posture of the first reference object, and displaying the generated at least one transformed reference posture together with the posture of the first reference object through the touch screen display.

10. In paragraph 8 or 9, A method for controlling an electronic device, characterized in that the method further includes an operation of selecting one reference object for changing the posture of at least one object among the plurality of first reference objects based on the acquired fourth user input when the first reference image includes a plurality of first reference objects.

11. In any one of paragraphs 8 to 10, A method for controlling an electronic device, characterized in that the plurality of reference images include images selected by an artificial intelligence model of the electronic device from among a plurality of images stored in the electronic device.

12. In any one of paragraphs 8 to 11, A method for controlling an electronic device, characterized in that the method further includes an operation of applying at least one of the composition, color, or mood of the first reference image to the at least one selected frame.

13. In any one of paragraphs 8 to 12, A method for controlling an electronic device, wherein the at least one deformation reference pose is displayed together with the pose of the first reference object within one selectable image, and the at least one deformation reference pose and the pose of the first reference object are displayed so as to be visually distinct from each other.

14. In any one of paragraphs 8 to 13, A method for controlling an electronic device, characterized in that the method further includes an operation in which, when the first reference image includes a plurality of first reference objects, the artificial intelligence model selects one reference object among the plurality of first reference objects for changing the posture of at least one object.

15. In a computer-readable non-transitory recording medium, the non-transitory recording medium is configured to store a plurality of instructions, and the plurality of instructions, when executed by at least one processor of an electronic device, cause the electronic device to: Obtaining a first user input for changing the posture of at least one object included in a first video displayed on the touchscreen display of the electronic device, Based on acquisition of the first user input, a plurality of reference images, each including at least one reference object, are displayed through the touchscreen display, and each of the plurality of reference images includes at least one reference object used to change the posture of the at least one object. Obtaining a second user input for selecting a first reference image from among the plurality of reference images to change the pose of at least one object included in the first video; A non-transitory recording medium, characterized in that it includes instructions for changing the pose of the at least one object included in at least one frame among the plurality of frames of the first video to the pose of the first reference object included in the first reference image based on acquisition of the second user input.

Citation Information

Patent Citations

  • Human body posture migration method, mobile terminal and computer storage medium

    CN111027438A

  • Electromagnetic Ultrasonic Sensor Mounting Structure of Mobile Inspection Robot

    KR1020230069449A

  • Image and data processing methods and apparatuses

    US20210271919A1

  • Artificial intelligence-based image generation method, device and apparatus, and storage medium

    US20220237829A1

  • Providing contextual augmented reality photo pose recommendations

    US20230031646A1