Electronic device for editing image and operation method therefor

Abstract

According to one embodiment, an electronic device may comprise a first display, at least one processor, and a memory for storing instructions. The instructions, when executed by the at least one processor, may instruct the electronic device to select a first image on the basis of a first user input for selecting the first image. The instructions, when executed by the at least one processor, may instruct the electronic device to identify first depth information about objects included in the first image. The instructions, when executed by the at least one processor, may instruct the electronic device to identify a first object and a background object among the objects included in the first image on the basis of the first depth information. The instructions, when executed by the at least one processor, may instruct the electronic device to control the first display to display a second object generated by converting the first object into a three-dimensional object on the basis of the first depth information, and a background image corresponding to the background object. The instructions, when executed by the at least one processor, may instruct the electronic device to control the first display to display a first mark indicating that the second object is a target object, on the basis of identifying that the first object is an object to which three-dimensional editing is applicable. Various other embodiments are also possible.

Description

Electronic device for editing images and method of operation thereof

[0001] The present disclosure relates to an electronic device for editing an image and a method of operating the same, according to one embodiment.

[0002] An electronic device may provide a program for editing an image. The image may include object(s), and the user may edit the object(s) included in the image through the image editing program.

[0003] Meanwhile, images can be generated using AI algorithms (e.g., generative AI). AI algorithms can receive an image as input and generate a new image based on the input image.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device may include a first display, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to select a first image based on a first user input selecting the first image. The instructions, when executed by the at least one processor, may cause the electronic device to identify first depth information for objects included in the first image. The instructions, when executed by the at least one processor, may cause the electronic device to identify a first object and a background object among the objects included in the first image based on the first depth information. The instructions, when executed by the at least one processor, may cause the electronic device to control the first display to display a second object generated by converting the first object into a three-dimensional object based on the first depth information, and a background image corresponding to the background object. The instructions, when executed by the at least one processor, may cause the electronic device to control the first display to display a first mark indicating that the second object is a target object based on the first object being identified as an object to which three-dimensional editing is applied.

[0006] According to one embodiment, a method of operating an electronic device may include an operation of selecting a first image based on a first user input of selecting the first image. The method may include an operation of checking first depth information for objects included in the first image. The method may include an operation of checking a first object and a background object among the objects included in the first image based on the first depth information. The method may include an operation of displaying a second object generated by converting the first object into a three-dimensional object based on the first depth information, and a background image corresponding to the background object. The method may include an operation of displaying a first mark indicating that the second object is a target object based on the first object being checked as an object to which three-dimensional editing is applied.

[0007] According to one embodiment, a storage medium storing computer-readable instructions may cause the wearable device to perform at least one operation when the instructions are executed by at least one processor of the electronic device. The at least one operation may include selecting a first image based on a first user input selecting the first image. The at least one operation may include checking first depth information for objects included in the first image. The at least one operation may include checking a first object and a background object among the objects included in the first image based on the first depth information. The at least one operation may include displaying a second object generated by converting the first object into a three-dimensional object based on the first depth information, and a background image corresponding to the background object. The at least one action may include an action of displaying a first mark indicating that the second object is a target object based on the first object being identified as an object to which 3D editing is applied.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0009] FIG. 2 is a drawing showing the front of an electronic device according to one embodiment.

[0010] FIG. 3 is a drawing showing the rear side of an electronic device according to one embodiment.

[0011] FIG. 4 is a block diagram of an electronic device and a server according to one embodiment.

[0012] FIG. 5 is a diagram illustrating an editing module according to one embodiment.

[0013] FIG. 6 is a flowchart of a method of operation of an electronic device for editing an image, according to one embodiment.

[0014] FIG. 7 is a drawing illustrating an operation of editing an image according to one embodiment.

[0015] FIG. 8 is a flowchart of a method of operating an electronic device for displaying a three-dimensional object, according to one embodiment.

[0016] FIG. 9 is a flowchart of a method of operation of an electronic device for displaying a mark indicating a target object, according to one embodiment.

[0017] FIG. 10 is a drawing illustrating a view point of editing according to one embodiment.

[0018] FIG. 11 is a flowchart of a method of operation of an electronic device for displaying a background of an editing space according to one embodiment.

[0019] FIG. 12 is a drawing illustrating an editing space according to one embodiment.

[0020] FIG. 13 is a flowchart of an operation method of an electronic device for sensing a surrounding environment and setting a portion of the surrounding environment as an editing space, according to one embodiment.

[0021] FIG. 14 is a diagram illustrating a mode transition according to one embodiment.

[0022] FIG. 15 is a flowchart of an operation method of an electronic device for checking depth information based on a field of view (FOV), according to one embodiment.

[0023] FIG. 16 is a diagram illustrating a change in FOV according to one embodiment.

[0024] FIG. 17 is a flowchart of a method of operation of an electronic device displaying a preview according to one embodiment.

[0025] FIG. 18 is a drawing illustrating a preview according to one embodiment.

[0026] FIG. 19 is a flowchart of a method of operation of an electronic device for transforming an object into three dimensions based on a plurality of images, according to one embodiment.

[0027] FIG. 20 is a flowchart of a method of operation of an electronic device for transforming an object into three dimensions by extracting feature points, according to one embodiment.

[0028] FIG. 21 is a flowchart of a method of operation of an electronic device applying matte painting according to one embodiment.

[0029] FIG. 22 is a drawing illustrating an operation of converting an image into three dimensions according to one embodiment.

[0030] FIG. 23 is a drawing illustrating editing of an image according to one embodiment.

[0031] FIG. 24 is a flowchart of a method of operation of an electronic device providing a preset, according to one embodiment.

[0032] FIG. 25 is a drawing illustrating editing of an image according to one embodiment.

[0033] FIG. 26 is a drawing illustrating editing of an image according to one embodiment.

[0034] FIG. 27 is a drawing illustrating editing of an image according to one embodiment.

[0035] FIG. 28 is a drawing illustrating editing of an image according to one embodiment.

[0036] FIG. 29 is a diagram illustrating an operation of providing a preset according to one embodiment.

[0037] FIG. 30 is a diagram illustrating a change in the properties of an object according to one embodiment.

[0038] FIG. 31 is a diagram illustrating a change in the properties of a space according to one embodiment.

[0039] FIG. 32 is a diagram illustrating gaze tracking according to one embodiment.

[0040] FIG. 33 is a drawing illustrating an operation indicating that editing is in progress, according to one embodiment.

[0041] FIG. 34 is a drawing illustrating an icon indicating that editing is in progress, according to one embodiment.

[0042] FIG. 35 is a drawing illustrating an operation of displaying an editing status on an external display according to one embodiment.

[0043] FIG. 36 is a drawing illustrating copying of an object to another image according to one embodiment.

[0044] FIG. 37 is a drawing illustrating copying of an object into an empty space or surrounding environment according to one embodiment.

[0045] FIG. 38 is a diagram illustrating the transformation history of an object's properties according to one embodiment.

[0046] FIG. 39 is a diagram illustrating editing by multiple users according to one embodiment.

[0047] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0048] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0049] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0050] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0051] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0052] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0053] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0054] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0055] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0056] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0057] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0058] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0059] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0060] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0061] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0062] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0063] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0064] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0065] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing 1eMBB, a loss coverage (e.g., 164 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for realizing URLLC.

[0066] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0067] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0068] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0069] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0070] According to one embodiment, the electronic device (101) may be a device worn by a user. For example, the electronic device (101) may be a smart glass or a head mounted display (HMD) device, but there is no limitation on the type of the electronic device (101). According to one embodiment, the electronic device (101) may also be a device not worn by a user. For example, the electronic device (101) may be a laptop or a mobile phone, but there is no limitation on the type of the electronic device (101). The operations of the electronic device (101) described below may be applied to an electronic device (101) worn by a user and an electronic device (101) not worn by a user. An example of an electronic device (101) worn by a user will be described with reference to FIGS. 2 and 3 .

[0071] FIG. 2 is a drawing showing the front of an electronic device (101) according to one embodiment.

[0072] FIG. 3 is a drawing showing the rear side of an electronic device (101) according to one embodiment.

[0073] Referring to FIGS. 2 and 3, in one embodiment, a VST (video see through) camera module (211, 212), a plurality of camera modules (213, 214, 215, 216), a depth sensor (217), and / or a second display (230) may be disposed on a second side (210) of the housing. For example, the VST camera module (211, 212), the plurality of camera modules (213, 214, 215, 216), the depth sensor (217), and / or the second display (230) may be exposed through an opening formed in the second side (210) of the housing. In one embodiment, the second side (210) of the housing may be the opposite side of the first side (220) of the housing that faces the face when the electronic device (101) is worn on the face of the user.

[0074] In one embodiment, the VST camera modules (211, 212) may acquire images related to the surrounding environment of the electronic device (101). For example, the images acquired by the VST camera modules (211, 212) may be provided to the user as at least a portion of VST content.

[0075] In one embodiment, the plurality of camera modules (213, 214, 215, 216) can acquire images while the electronic device (101) is worn by the user. The images acquired through the plurality of camera modules (213, 214, 215, 216) can be used for simultaneous localization and mapping (SLAM), 6 degrees of freedom (6DoF), object recognition, and / or tracking. In one embodiment, the depth sensor (217) can be used for the purpose of confirming the distance to an object, such as time of flight (TOF). In one embodiment, instead of or in addition to the depth sensor (217), the plurality of camera modules (213, 214, 215, 216) can confirm the distance to an object.

[0076] In one embodiment, the second display (230) (also referred to as an “external display”) may be a display for providing a screen before (and after) the electronic device (101) is worn on a user (e.g., the user’s face). For example, the second display (230) may display a screen when the electronic device (101) is not worn on the user after the electronic device (101) is powered on. For example, the second display (230) may display a screen when the electronic device (101) is worn on the user after the electronic device (101) is powered on.

[0077] In one embodiment, the second display (230) may include a touch sensor (or touch panel) for receiving user input. For example, the second display (230) may include a touch sensor for receiving user input to execute a function of the electronic device (101) while a screen is displayed through the second display (230) before (and after) the electronic device (101) is worn by the user.

[0078] In one embodiment, the size of the second display (230) may be implemented differently depending on the embodiment. For example, the size of the second display (230) may be implemented so that the second display (230) does not overlap with the VST camera modules (211, 212) and the depth sensor (217). For example, the size of the second display (230) may be implemented so that the second display covers the VST camera modules (211, 212) and the depth sensor (217), as illustrated in FIG. 2. For example, the size of the second display (230) may be implemented so as to be substantially the same as the size of the second surface (210) of the housing.

[0079] In one embodiment, when the size of the second display (230) is implemented to cover the VST camera modules (211, 212) or to be substantially the same as the size of one side of the housing, the VST camera modules (211, 212) may be under display cameras (UDCs) positioned under the second display.

[0080] In one embodiment, the second display (230) may be implemented in various forms. For example, the second display (230) may be implemented in a U-cut or notch form so as not to overlap with the VST camera modules (211, 212) and the depth sensor (217).

[0081] According to one embodiment, a camera module (225, 226) for facial recognition and / or a first display (221) (and / or lens) may be arranged on the first side (220) of the housing.

[0082] In one embodiment, a camera module (225, 226) for facial recognition can be used to recognize a user's face.

[0083] In one embodiment, the first display (221) (also referred to as an “inner display”) (and / or a lens) may be disposed on a first side (220) of the electronic device (101) facing the face of the user when the electronic device (101) is worn on the user’s face. In one embodiment, the first display (221) (and / or the lens) may display a screen when the electronic device (101) is worn on the user. According to one embodiment, the first display (221) may include a first sub-display (221a) corresponding to the user’s right eye and a second sub-display (221b) corresponding to the user’s left eye. For example, an image displayed on the first display (221) may include a first sub-image displayed on the first sub-display (221a) and a second sub-image displayed on the second sub-display (221b). For example, a user can recognize a three-dimensional image (or a three-dimensional object) by perceiving a first sub-image with the right eye and a second sub-image with the left eye. For example, a user can also recognize a two-dimensional image (or a two-dimensional object) by perceiving a first sub-image with the right eye and a second sub-image with the left eye.

[0084] In one embodiment, although not illustrated in FIGS. 2 and 3, the electronic device (101) may further include one or more components. For example, the electronic device (101) may include a proximity sensor, a touch sensor, and / or a pressure sensor for detecting that the electronic device (101) is worn on a user (e.g., the user's face). For example, the electronic device (101) may include a fingerprint sensor (an optical or ultrasonic fingerprint sensor). For example, the electronic device (101) may include at least one key (or button). For example, the electronic device (101) may include a sensor for tracking the user's gaze.

[0085] In one embodiment, the electronic device (101) may not include some of the configurations illustrated in FIGS. 2 and 3. For example, the electronic device (101) may not include camera modules (215, 216) among the plurality of camera modules (213, 214, 215, 216).

[0086] In one embodiment, the electronic device (101) may include at least one configuration among the configurations of the electronic device (101) illustrated in FIG. 1.

[0087] FIG. 4 is a block diagram of an electronic device (101) and a server (400) according to one embodiment.

[0088] According to one embodiment, the server (400) of FIG. 4 may be the server (108) of FIG. 1.

[0089] According to one embodiment, referring to FIG. 4, the electronic device (101) may include a processor (120) and a memory (130). The processor (120) of the electronic device (101) may be the processor (120) of FIG. 1. The memory (130) of the electronic device (101) may be the memory (130) of FIG. 1.

[0090] According to one embodiment, the processor (120) of the electronic device (101) may be referred to as a controller. The operation of the electronic device (101) according to one embodiment may be controlled by the processor (120) of the electronic device (101). When the electronic device (101) performs a specific operation, the electronic device (101) or a component included in the electronic device (101) may be controlled by the processor (120) of the electronic device (101). The processor (120) may be a circuit that performs processing. The electronic device (101) may include one or more processors (120). The operation(s) of the electronic device (101) may be processed by one processor (120). Some of the operations of the electronic device (101) may be processed by some of the processors (120) among the plurality of processors (120), and other of the operations of the electronic device (101) may be processed by other processors (120) among the plurality of processors (120). Hereinafter, even when a plurality of processors (120) are implemented, for convenience of explanation, the terms “operation of the electronic device (101)” or “operation of the processor (120)” will be used. According to one embodiment, the memory (130) may include instructions that are set to cause at least one operation. When the instructions are executed by the processor (120) of the electronic device (101), the instructions may cause the electronic device (101) to perform at least one operation. The electronic device (101) may include one or more memories (130). Hereinafter, “memory (130)” may be one memory (130) or a plurality of memories (130). Instructions may be stored in one memory (130). Some of the instructions may be stored in some of the plurality of memories (130), and other of the instructions may be stored in other of the plurality of memories (130).Hereinafter, even when a plurality of memories (130) are implemented, they will be referred to as "memories (130)" for convenience of explanation. According to one embodiment, in relation to the electronic device (101), a computer-readable storage medium storing instructions configured to cause at least one operation may be proposed.

[0091] According to one embodiment, referring to FIG. 4, the electronic device (101) may include a communication circuit (413) (e.g., a circuit included in the communication module (190) of FIG. 1). The electronic device (101) may include a display (414) (e.g., a display included in the display module (160) of FIG. 1). For example, when the electronic device (101) is implemented as a device worn by a user, the display (414) may include the first display (221) of FIG. 3 and the second display (230) of FIG. 2.

[0092] According to one embodiment, the artificial intelligence algorithm may be included in the electronic device (101). According to one embodiment, the artificial intelligence algorithm may be included in the server (400). According to one embodiment, the artificial intelligence algorithm may be included in both the electronic device (101) and the server (400). According to one embodiment, some of the artificial intelligence algorithms may be included in the electronic device (101), and other of the artificial intelligence algorithms may be included in the server (400). The method in which the artificial intelligence algorithm is applied in the electronic device (101) may be referred to as the on-device method. The method in which the artificial intelligence algorithm is applied in the server (101) may be referred to as the server method. For example, in the on-device method, the electronic device (101) may process data based on the artificial intelligence algorithm included in the electronic device (101). For example, in the case of a server method, the electronic device (101) can transmit data to the server (400) through the communication circuit (413) and receive the result of data processing based on the artificial intelligence algorithm included in the server (400) through the communication circuit (413) from the server (400). The electronic device (101) can use an on-device method and / or a server method. Except for cases where the on-device method and the server method are described separately, the following embodiments can be applied to the on-device method and the server method.

[0093] In one embodiment, the artificial intelligence algorithm may include a first artificial intelligence algorithm and a second artificial intelligence algorithm. In one embodiment, the first artificial intelligence algorithm may be an algorithm for three-dimensional transformation of an image or an object included in the image. For example, the first artificial intelligence algorithm may be trained to receive an image or an object included in the image as input and output a result of three-dimensional transformation of the image or an object included in the image. There is no limitation on the implementation method of the first artificial intelligence algorithm. In one embodiment, the second artificial intelligence algorithm may be an algorithm for identifying an object to which three-dimensional editing is applied (e.g., an object capable of three-dimensional editing) among objects included in the image. For example, the second artificial intelligence algorithm may be trained to receive an image or an object included in the image as input and output an object to which three-dimensional editing is applied (e.g., an object capable of three-dimensional editing) among objects included in the image. There is no limitation on the implementation method of the second artificial intelligence algorithm.

[0094] FIG. 5 is a diagram illustrating an editing module according to one embodiment.

[0095] Referring to FIG. 5, according to one embodiment, the editing module (500) may include a three-dimensional transformation module (510), a two-dimensional image storage module (520), and a frame storage module (530). The editing module (500) may have a hardware structure and / or a software structure. For example, the editing module (500) may be implemented in hardware. For example, the editing module (500) may be implemented in software. For example, the editing module (500) may be implemented in a combination of hardware and software. According to one embodiment, the editing module (500) (e.g., 510, 520, 530) of FIG. 5 may be included in the electronic device (101). According to one embodiment, the editing module (500) (e.g., 510, 520, 530) of FIG. 5 may be included in the server (400). In one embodiment, some of the editing modules (500) (e.g., 510, 520, 530) of FIG. 5 may be included in the electronic device (101), and other of the editing modules (500) (e.g., 510, 520, 530) of FIG. 5 may be included in the server (400).

[0096] According to one embodiment, the 3D transformation module (510) may include a depth information storage module (511), a feature point clustering module (512), and a cluster stereoscopic module (513). The depth information storage module (511) may be a module that stores depth information. For example, the depth information storage module (511) may store depth information based on a first artificial intelligence algorithm. The feature point clustering module (512) may be a module that clusters feature points of an image or an object(s) included in the image. The cluster stereoscopic module (513) may be a module that stereoscopically converts a cluster. For example, when the 3D transformation module (510) is included in the electronic device (101), the electronic device (101) may use the 3D transformation module (510) to convert the image or an object included in the image into a 3D image. For example, when a 3D transformation module (510) is included in the server (400), the server (400) can use the 3D transformation module (510) to transform an image or an object included in the image into 3D, and the electronic device (101) can receive the result of the 3D transformation performed in the server (400) through the communication circuit (413) from the server (400). According to one embodiment, the 2D image storage module (520) may be a module that stores a 2D image. For example, the 2D image storage module (520) may store a 2D image input to the 3D transformation module (510). For example, the 2D image storage module (520) may store a 2D image generated including the result of the 3D transformation based on the 3D transformation module (510). According to one embodiment, the frame storage module (530) may be a module that stores a frame of an image.

[0097] The descriptions of FIGS. 1 through 5 can be applied to the embodiments described below. When describing the embodiments described below, portions that overlap with the descriptions of FIGS. 1 through 5 may be omitted. Any portions omitted from the descriptions of each drawing or each embodiment can be understood by referring to the descriptions of other drawings or embodiments.

[0098]

[0099] The operations of the electronic device (101) are briefly described as follows. According to one embodiment, the electronic device (101) (e.g., processor (120)) may select a two-dimensional image (e.g., a first image). The electronic device (101) may convert the two-dimensional image into three dimensions in order to edit the image. By converting the two-dimensional image into three dimensions, the electronic device (101) may display a three-dimensional editing space on the display (414). Displaying the three-dimensional editing space may mean displaying a screen including an object to which three-dimensional editing is applied (or an object capable of three-dimensional editing). For example, converting a two-dimensional image into three dimensions (or displaying a three-dimensional editing space) may be converting an object included in the two-dimensional image into a three-dimensional object, and placing the converted object in a surrounding space sensed by the VST (e.g., an image related to the surrounding environment acquired through the VST camera modules (211, 212)) (e.g., a first mode described below). For example, converting a two-dimensional image into three dimensions (or displaying a three-dimensional editing space) may be converting an object included in the two-dimensional image (e.g., a candidate object described below) into a three-dimensional object, and generating a background (e.g., a background image described below) to be included in the three-dimensional image based on the background of the two-dimensional image (e.g., a background object described below) (e.g., a second mode described below). For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display an image corresponding to the 3D editing space on the second display (230) while displaying the 3D editing space on the first display (221). The electronic device (101) can edit an image (or an object included in the image) in the 3D editing space. The electronic device (101) can display an object whose properties have been changed (or an image including an object whose properties have been changed) based on the editing on the display (414).For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display an object whose properties have been changed (or an image including an object whose properties have been changed) based on editing on the first display (221), while displaying an object corresponding to the object whose properties have been changed (or an image including an object corresponding to the object whose properties have been changed) on the second display (230). The electronic device (101) may display a preview in a three-dimensional editing space. The preview may correspond to a two-dimensional image (e.g., a first image). The preview may indicate a result of editing or a direction of editing. The electronic device (101) may generate a two-dimensional image (e.g., a second image) reflecting the result of editing in the three-dimensional editing space based on the end of editing. The operations of the electronic device (101) can be described in detail with reference to the embodiments described above (e.g., the embodiments of FIGS. 1 to 5) and the embodiments described below (e.g., the embodiments of FIGS. 6 to 39). Although each embodiment is disclosed in a separate drawing and a separate paragraph, this is merely for convenience of explanation, and at least some of the embodiments described above and at least some of the embodiments described below can be applied together. At least some of the embodiments described above and at least some of the embodiments described below may be omitted.

[0100] Fig. 6 is a flowchart of an operating method of an electronic device (101) according to one embodiment. Fig. 6 can be explained with reference to the previously described embodiments and the embodiments described below.

[0101] At least some of the operations of FIG. 6 may be omitted. The order of the operations of FIG. 6 may be changed. Operations other than those of FIG. 6 may be performed before, during, or after the operations of FIG. 6.

[0102] Referring to FIG. 6, in operation 601, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select a first image. The electronic device (101) may select the first image based on a first user input for selecting the first image. The electronic device (101) may select the first image based on a first user input for selecting the first image from among at least one image stored in the memory (130). The electronic device (101) may select the first image based on a first user input for selecting the first image from among at least one image while the execution screen of the gallery application is displayed. The electronic device (101) may select a portion corresponding to the first area of ​​the screen displayed on the display (414) as the first image based on a first user input for selecting a first area of ​​the screen (e.g., a screen displaying an image or video). The electronic device (101) may select a screenshot of the screen as a first image based on a first user input that causes the creation of a screenshot of the screen while the screen (e.g., a screen displaying an image or video) is displayed on the display (414).

[0103] According to one embodiment, the electronic device (101) may provide different object separation methods, placement methods, and target objects for 3D transformation depending on the type of image selected in operation 601 (e.g., depending on whether it is a landscape photo or a portrait photo). This will be described later.

[0104] According to one embodiment, the electronic device (101) can check the first depth information for objects included in the image selected in operation 601. For example, the electronic device (101) can check the first depth information for objects included in the image selected in operation 601 based on the first artificial intelligence algorithm. For example, in the case of the on-device method, the electronic device (101) can check the first depth information by checking the first depth information for objects included in the selected image based on the first artificial intelligence algorithm included in the electronic device (101). For example, in the case of the server method, the electronic device (101) can check the first depth information by transmitting information about the selected image to the server (400) and receiving the first depth information from the server (400). The server (400) can check first depth information for objects included in an image based on a first artificial intelligence algorithm included in the server (400) and transmit the first depth information to an electronic device (101).

[0105] In operation 603, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may identify objects (e.g., the first object and / or background objects) included in the first image selected in operation 601. For example, the first image may include a person object, a living object, an object object, a landscape object, and / or a background object, and there is no limitation on the type of objects. The electronic device (101) may identify object(s) included in the first image based on first depth information for the first image. For example, the electronic device (101) may include candidate objects and / or background objects included in the first image based on the first depth information for the first image. A “background object” may be an object among the object(s) included in the first image that does not satisfy a specified criterion (e.g., a criterion related to depth, size, or focus). There are no restrictions on the specified criteria (e.g., criteria related to depth, size, or focus). A "candidate object" may be an object that satisfies the specified criteria (e.g., criteria related to depth, size, or focus) among the object(s) included in the first image. A candidate object may be an object other than a background object. A candidate object may be a target object or other objects. A "target object" may be an object to which 3D editing is applied (e.g., an object capable of 3D editing). An "other object" may be an object to which 3D editing is not applied (e.g., an object that is not capable of 3D editing). Target objects and other objects will be described later. The electronic device (101) can identify a first object (e.g., 711 of FIG. 7, 1011 of FIG. 10, or 1411 of FIG. 14) and / or a background object that is a candidate object included in the first image based on the first depth information for the first image.

[0106] In operation 605, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may identify a target object from among the object(s) identified in operation 603. The electronic device (101) may identify the first object as the target object based on the identification of the first object in operation 603 as an object to which 3D editing is applied (e.g., an object capable of 3D editing). For example, the electronic device (101) may identify the first object as the target object based on the identification of the first object in operation 603 as an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on a second artificial intelligence algorithm. Operation 605 may be an operation of selecting an object to which 3D editing is applied (e.g., an object capable of 3D editing) from among the object(s) included in the first image. For example, the content of the image (e.g., a birthday party) may be determined through scene analysis of the image, and a target object related to the content of the image (e.g., an object related to the birthday party) may be determined. For example, the tendencies of a user of the electronic device (101) may be analyzed, and a target object related to the tendencies of the user may be determined. There is no limitation on the method by which the target object is identified. According to one embodiment, in the case of an on-device method, the electronic device (101) may identify the target object by selecting an object to which 3D editing is applied (e.g., an object capable of 3D editing) from among the object(s) included in the first image based on a second artificial intelligence algorithm included in the electronic device (101). According to one embodiment, in the server method, the electronic device (101) can identify a target object by transmitting information about the first image to the server (400) and receiving information about an object to which 3D editing is applied (e.g., an object capable of 3D editing) among the object(s) included in the first image from the server (400).The server (400) can select an object to which 3D editing is applied (e.g., an object capable of 3D editing) from among the object(s) included in the first image based on a second artificial intelligence algorithm included in the server (400), and transmit information about the target object to the electronic device (101).

[0107] In operation 607, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may enter an editing space. Entering the editing space may mean that a screen for editing an image is displayed on the display (414). For example, in the case of the electronic device (101) of FIGS. 2 and 3 , the electronic device (101) may display a screen for editing an image (e.g., a screen including a three-dimensionally converted object, as described below) on the first display (221). For example, a user wearing the electronic device (101) may view the screen for editing an image. According to one embodiment, as described below, the electronic device (101) may display a screen corresponding to the screen for editing an image (e.g., a screen including an object corresponding to a three-dimensionally converted object, as described below) on the second display (230). For example, another user located around the electronic device (101) may view a screen corresponding to the screen for editing an image. According to one embodiment, the electronic device (101) may enter an editing space (e.g., display a screen for editing) based on the start of editing of an image. The electronic device (101) may enter the editing space based on an event (e.g., a user input) that causes entry into the editing space, and there is no limitation on the type of event. For example, the electronic device (101) may enter the editing space based on operation 601 (e.g., a first user input selecting a first image). For example, the electronic device (101) may enter the editing space based on a user input (e.g., a user input different from the first user input of operation 601) that causes the start of editing of a selected image (e.g., the first image). Entering the editing space may mean starting editing of an image. The "editing space" may be a space for editing an image. For example, the editing space may include an editing space in a first mode and an editing space in a second mode.For example, the "first mode" (e.g., full immersive mode) (e.g., VR mode) may be to edit an image or an object included in an image in a VR (virtual reality) space corresponding to the selected image. The VR space may mean that all objects displayed on the display (414) are virtual objects. For example, the "second mode" (e.g., half immersive mode) (e.g., AR mode) may be to edit a selected image or an object included in the selected image in an AR (augmented reality) space. The AR space may mean that an object included in an image is converted into a three-dimensional virtual object, and the converted object is placed in a surrounding space sensed by the VST (e.g., an image related to the surrounding environment acquired through the VST camera modules (211, 212)). In order to enter the editing space of operation 607, operation 609 may be performed.

[0108] In operation 609, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may convert the first image (or the object included in the first image) into a three-dimensional object based on first depth information based on a first artificial intelligence algorithm for the first image (or the object included in the first image). For example, the electronic device (101) may convert the first object (e.g., the candidate object) into a three-dimensional object based on the first depth information, and display a second object obtained by converting the first object (e.g., the candidate object) into a three-dimensional object on the display (414). For example, the electronic device (101) may display a background image corresponding to the background object on the display (414) based on the first depth information. For example, in a first mode (e.g., a VR mode), a second object generated by converting the first object into a three-dimensional object, and a background image corresponding to the background object may be displayed together. For example, in the second mode (e.g., AR mode), a second object generated by converting a first object into a three-dimensional object and a surrounding space sensed by VST (e.g., an image related to the surrounding environment acquired through the VST camera modules (211, 212)) may be displayed together. For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display a second object generated by converting a first object into a three-dimensional object, and / or a background image on the first display (221). In the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display an object corresponding to the second object generated by converting a first object into a three-dimensional object, and / or an image corresponding to the background image on the second display (230). The operation of displaying an object converted into a three-dimensional form and / or the operation of displaying a background image will be described with reference to the embodiments described below.

[0109] In operation 611, according to one embodiment, the electronic device (101) (e.g., the processor (120)) can change the properties of a target object (e.g., the second object of operation 609) based on a second user input for editing the object. The electronic device (101) can change the properties of the target object based on the second user input for editing the object in the editing space. The electronic device (101) can change the properties of the target object based on the second user input for editing the object while an image (or object) for editing is displayed. The electronic device (101) can change the properties of the target object based on the second user input for editing the object among object(s) converted into a three-dimensional object (e.g., a user input for editing the target object). For example, the electronic device (101) can raise the nose of a person, change the posture of a person, change the size of an object, or modify the appearance of an object, and there is no limitation on the way in which the properties of the target object are changed. For example, the electronic device (101) can display an object on the display (414) that reflects a change in the properties of an object that has been converted into three dimensions of the 609 operation. For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display a third object that reflects a change in the properties of a second object on the first display (221). For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display an object corresponding to the third object that reflects a change in the properties of the second object on the second display (230).

[0110] In operation 613, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may terminate editing based on an event that causes the end of editing. For example, the electronic device (101) may terminate editing based on a user input that causes the end of editing.

[0111] In operation 615, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may generate a second image based on the end of editing. The electronic device (101) may generate a two-dimensional second image reflecting the result of editing (e.g., a change in the property of the object due to operation 611) based on the end of editing. The second image of operation 615 may include a result of transforming the property of the object included in the first image of operation 601. For example, in the embodiment of FIG. 7, the first image may include a person, and based on editing to raise the nose of the person in the three-dimensional editing space, the second image may include the person with the raised nose.

[0112] This will be explained in more detail with reference to Fig. 7.

[0113] FIG. 7 is a drawing illustrating an operation of editing an image according to one embodiment.

[0114] According to one embodiment, 710 of FIG. 7 is a part describing the selection of an image. The electronic device (101) (e.g., the processor (120)) may select a first image (e.g., the image of 710) based on a user input. The first image may include a person object (711). The first image may include a background object (712). The electronic device (101) may start editing (713) the first image based on an event that causes the start of editing of the image.

[0115] According to one embodiment, 720 of FIG. 7 is a part that describes selection of a target object. The electronic device (101) (e.g., processor (120)) can identify an object to which 3D editing is applied (e.g., an object capable of 3D editing) among the object(s) included in the first image. For example, the electronic device (101) (e.g., processor (120)) can identify an object to which 3D editing is applied (e.g., an object capable of 3D editing) among the object(s) included in the first image based on a second artificial intelligence algorithm. For example, the electronic device (101) can identify a person object (721) included in the first image as a target object based on an analysis (723) of the first image based on the second artificial intelligence algorithm. The electronic device (101) can confirm that the background object (722) included in the first image is not an object to which 3D editing is applied (e.g., an object capable of 3D editing). For example, the electronic device (101) can confirm that the background object (722) included in the first image is not an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on the second artificial intelligence algorithm. The electronic device (101) can convert the first image (or an object included in the first image) into 3D in order to enter the editing space. The electronic device (101) can confirm first depth information for the object(s) included in the first image. For example, the electronic device (101) can confirm first depth information for the object(s) included in the first image based on the first artificial intelligence algorithm. The method of checking depth information can be on-device or server-based, as described above.

[0116] According to one embodiment, 739 of FIG. 7 is a part describing an object converted into a three-dimensional form. The electronic device (101) (e.g., processor (120)) may, based on first depth information about the object(s) included in the first image, convert a person object (721) of the first image into a three-dimensional object, and display the obtained person object (731) on the display (414). For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display the obtained person object (731) on the first display (221) by converting the person object (721) of the first image into a three-dimensional object. In the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display an object corresponding to a person object (731) obtained by converting a person object (721) of the first image into a three-dimensional object on the second display (230). According to one embodiment, when entry into the first mode (e.g., VR mode) is requested, in 739 of FIG. 7, 732 may be a background image corresponding to the background object (722) of the first image based on the first depth information. According to one embodiment, when entry into the second mode (e.g., AR mode) is requested, in 739 of FIG. 7, 732 may be a surrounding space sensed by VST (e.g., an image related to the surrounding environment obtained through VST camera modules (211, 212)). The electronic device (101) can detect rotation (733) after a three-dimensional character object (731) is displayed. The detection of rotation (733) may be detection of a user input that rotates the object (e.g., 731). The detection of rotation (733) may be detection of a change in the field of view (FOV). For example, the electronic device (101) can detect a change in the FOV by detecting a change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing. 733 may be described in detail with reference to FIGS. 15 and 16 .

[0117] According to one embodiment, 740 of FIG. 7 is a part that describes the confirmation of new depth information. The electronic device (101) (e.g., the processor (120)) can confirm second depth information based on the rotation (733) (e.g., rotation of the object, or change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing) based on the detection of the rotation (733) based on the first artificial intelligence algorithm. The first artificial intelligence algorithm can be applied in an on-device manner or a server manner. The electronic device (101) can display a human object (741) that reflects a change in the property of the human object (731) (e.g., a change in the direction in which the object is viewed, or a change in the shape of the object due to a change in the direction in which the object is viewed) based on the second depth information. For example, the electronic device (101) may display a person object (731) based on first depth information in a first direction at 739, and then check second depth information in a second direction at 740, and display a person object (741) based on the second depth information. For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display the person object (741) on the first display (221). In the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display an object corresponding to the person object (741) on the second display (230). The electronic device (101) may display the person object (741) together with 742 (e.g., a background image in the first mode, or a surrounding environment in the second mode). If 742 is a background image, 742 may be an image based on second depth information.

[0118] In one embodiment, the electronic device (101) may store previously identified first depth information in a memory (130) (e.g., a buffer) based on displaying a person object (741) based on second depth information. Thereafter, if display of an object in a first direction is requested, the electronic device (101) may display the person object (731) based on the first depth information stored in the memory (130).

[0119] In one embodiment, at 740, the electronic device (101) can confirm selection (743) of an object based on a user input. The selection (e.g., 743) of the object may be selection of a target object (e.g., 741) or selection of a portion of the target object (e.g., 741) (e.g., a sub-object (e.g., a nose) included in the target object (e.g., a person)).

[0120] According to one embodiment, 750 of FIG. 7 is a part that describes the selection of an object to be edited. The electronic device (101) (e.g., the processor (120)) can identify a portion (753) to be edited in a target object (751) based on the selection of the object (e.g., 743). For example, the electronic device (101) can display a mark indicating that it is the portion (753) to be edited. Similar to 740, in 750, 752 can be a background image in the first mode or the surrounding environment in the second mode. The electronic device (101) can identify a user input for editing (754) the portion (753) to be edited in the target object (751).

[0121] According to one embodiment, 760 of FIG. 7 is a part that describes a change in the properties of an object due to editing. The electronic device (101) (e.g., the processor (120)) may change the properties of a target object (761) (or a portion (763) of the target object (761)) based on a user input for editing (e.g., 754). For example, in 760, the electronic device (101) may increase the nose (763) of the person object (761) based on the user input for editing (e.g., 754). The electronic device (101) may display an object reflecting the change in the properties on the display (414). For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) may display an object reflecting the change in the properties on the first display (221). In the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display an object corresponding to an object reflecting a change in properties on the second display (230). Similar to 740, in 760, 762 can be a background image in the first mode or a surrounding environment in the second mode. After displaying the target object (761) whose properties have been changed, the electronic device (101) can identify an event that causes the end of editing (764).

[0122] According to one embodiment, 770 of FIG. 7 is a part that describes the generation of a two-dimensional image reflecting the result of editing. The electronic device (101) (e.g., the processor (120)) may generate a second image reflecting the result of editing based on an event that causes the end of editing (e.g., 764). The second image at 770 may include a person object (771) that reflects a change in the attribute of the person object (711) included in the first image at 710 (e.g., a higher nose). The second image at 770 may include a background object (727) corresponding to the background object (712) of the first image at 710. According to one embodiment, the second image generated at 770 may be an image corresponding to a direction in which the target object (761) is viewed at a time when the end of editing (e.g., 764) is confirmed. For example, the second image generated at 770 may be an image corresponding to the field of view (FOV) at the time of confirming the end of editing (e.g., 764). In one embodiment, the second image generated at 770 may be an image corresponding to the direction of the first image of 710, while reflecting the result of editing in a three-dimensional editing space.

[0123] FIG. 8 is a flowchart of an operation method of an electronic device (101) for displaying a three-dimensional object according to one embodiment. FIG. 8 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIGS. 9 and 10). FIG. 9 is a flowchart of an operation method of an electronic device for displaying a mark indicating a target object according to one embodiment. FIG. 10 is a diagram explaining an editing viewpoint according to one embodiment.

[0124] Referring to Fig. 8, the display of a three-dimensional object and a background image can be described.

[0125] At least some of the operations of FIG. 8 may be omitted. The order of the operations of FIG. 8 may be changed. Operations other than those of FIG. 8 may be performed before, during, or after the operations of FIG. 8.

[0126] Referring to FIG. 8, in operation 801, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select a first image. Operation 801 may be understood with reference to operation 601 of FIG. 6. Duplicate descriptions will be omitted. For example, the electronic device (101) may select the first image based on a first user input for selecting the first image. For example, referring to FIG. 10, the electronic device (101) may select an image (1010) including a landscape object (1012) (e.g., a mountain), an object object (1011) (e.g., an airplane), and a background object (1013) (e.g., the sky).

[0127] In operation 803, according to one embodiment, the electronic device (101) (e.g., processor (120)) may check depth information for objects included in the first image (e.g., 1011, 1012, 1013 of FIG. 10). For example, the electronic device (101) (e.g., processor (120)) may check depth information for objects included in the first image (e.g., 1011, 1012, 1013 of FIG. 10) based on the first artificial intelligence algorithm. As described above, the method of checking the depth information may be an on-device method or a server method.

[0128] In operation 805, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may identify a first object (e.g., 1011 and / or 1012 of FIG. 10) and a background object (e.g., 1013 of FIG. 10) in the first image based on the identified depth information. Operation 805 may be understood with reference to operation 603 of FIG. 6. Duplicate descriptions will be omitted. For example, as described above, a “background object” may be an object among the object(s) included in the first image that does not satisfy a specified criterion (e.g., a criterion related to depth, size, or focus). For example, referring to FIG. 10, the electronic device (101) may identify an object (1013) that does not satisfy a specified criterion (e.g., a criterion related to depth, size, or focus) among objects (1011, 1012, 1013) included in the first image as a background object. For example, referring to FIG. 10, the electronic device (101) may identify a landscape object (1012) (e.g., a mountain) and an object object (1011) (e.g., an airplane) as objects that are not background objects (e.g., objects that satisfy a specified criterion (e.g., a criterion related to depth, size, or focus)).

[0129] In operation 807, according to one embodiment, the electronic device (101) (e.g., processor (120)) may display a second object (e.g., 1021 and / or 1022 of FIG. 10, or 1031 and / or 1032 of FIG. 10) obtained by converting a first object (e.g., 1011 and / or 1012 of FIG. 10) into a three-dimensional object, and a background image (e.g., 1023 of FIG. 10, or 1030 of FIG. 10) corresponding to a background object (e.g., 1013 of FIG. 10) on the display (414). For example, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display a second object (e.g., 1021 and / or 1022 of FIG. 10, or 1031 and / or 1032 of FIG. 10) obtained by converting a first object (e.g., 1011 and / or 1012 of FIG. 10) into a three-dimensional object, and a background image (e.g., 1023 of FIG. 10, or 1030 of FIG. 10) corresponding to a background object (e.g., 1013 of FIG. 10) on the first display (221). In the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) can display an object corresponding to a second object (e.g., 1021 and / or 1022 of FIG. 10 , or 1031 and / or 1032 of FIG. 10 ) and an image corresponding to a background image (e.g., 1023 of FIG. 10 , or the background image of 1030 of FIG. 10 ) on the second display (230). As described above, displaying the second object (e.g., 1021 and / or 1022 of FIG. 10 , or 1031 and / or 1032 of FIG. 10 ) and the background image (e.g., 1023 of FIG. 10 , or the background image of 1030 of FIG. 10 ) can be expressed as displaying an editing space.

[0130] With respect to the 807 operation, the viewpoint of editing can be described with reference to FIG. 10. For example, 1020 of FIG. 10 may be an omniscient viewpoint. For example, 1030 of FIG. 10 may be a first-person viewpoint. An "omniscient viewpoint" may be a viewpoint looking down on an editing space (e.g., 1020 of FIG. 10) generated based on a two-dimensional image (e.g., 1010 of FIG. 10), as in 1020 of FIG. 10. A "first-person viewpoint" may be a viewpoint from which a user appears to be in an editing space (e.g., 1030 of FIG. 10) generated based on a two-dimensional image (e.g., 1010 of FIG. 10), as in 1030 of FIG. 10. For example, in FIG. 10, the omniscient viewpoint may be a viewpoint looking down on a model including a mountain and an airplane, as in 1020 of FIG. 10. For example, in FIG. 10, the first-person viewpoint may be a viewpoint looking at an airplane while tracking a mountain, as in 1030 of FIG. 10. The electronic device (101) may display the editing space of the omniscient viewpoint and the editing space of the first-person viewpoint by switching between them. For example, in FIG. 10, the electronic device (101) may display the editing space (1020) of the omniscient viewpoint, and switch the editing space (1020) of the omniscient viewpoint to the editing space (1030) of the first-person viewpoint based on a user input that causes a switch in the viewpoint (e.g., a user input that selects a switch icon (1024)). For example, in FIG. 10, the electronic device (101) can display a first-person view editing space (1030) and, based on a user input that causes a change in viewpoint, switch the first-person view editing space (1030) to an omniscient view editing space (1020). For example, the electronic device (101) can display a second object (e.g., 1021 and / or 1022 of FIG. 10) and a background image (e.g., 1023 of FIG. 10) in a first viewpoint (e.g., an omniscient viewpoint) based on the first depth information in operation 807.Thereafter, the electronic device (101) can identify a user input that causes a change in viewpoint. Based on the user input that causes the change in viewpoint, the electronic device (101) can identify second depth information related to a second viewpoint (e.g., a first-person viewpoint). For example, the electronic device (101) can identify second depth information related to a second viewpoint (e.g., a first-person viewpoint) based on a first artificial intelligence algorithm based on the user input that causes the change in viewpoint. The electronic device (101) may display a third object (e.g., 1031 and / or 1032 of FIG. 10) corresponding to a second object (e.g., 1021 and / or 1022 of FIG. 10) and a background image (e.g., background image 1030 of FIG. 10) from a second viewpoint (e.g., first-person viewpoint) based on the second depth information. At this time, the electronic device (101) may store the first depth information in the memory (130) based on confirming the second depth information. The electronic device (101) may display a second object (e.g., 1021 and / or 1022 of FIG. 10) and a background image (e.g., 1023 of FIG. 10) in the first viewpoint (e.g., omniscient viewpoint) based on first depth information stored in the memory (130) based on a change (e.g., user input causing a viewpoint change) from a second viewpoint (e.g., first-person viewpoint) to a first viewpoint (e.g., omniscient viewpoint). With respect to the embodiment of viewpoint switching, an embodiment of switching from a second viewpoint (e.g., first-person viewpoint) to a first viewpoint (e.g., omniscient viewpoint) may be understood similarly.

[0131] In operation 809, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may display a mark indicating that a second object generated by converting a first object into a three-dimensional object is a target object. For example, in FIG. 10, the electronic device (101) may display a mark (1034) indicating that the second object (e.g., an airplane (1031) of 1030 in FIG. 10) is a target object. In FIG. 10, the mark (1034) is implemented in the form of a dotted line surrounding the target object (e.g., an airplane (1031)), but this is merely an example, and there is no limitation on the form of the mark. Operation 809 may be omitted. Operation 809 will be described in detail with reference to FIG. 9.

[0132] At least some of the operations of FIG. 9 may be omitted. The order of the operations of FIG. 9 may be changed. Operations other than those of FIG. 9 may be performed before, during, or after the operations of FIG. 9.

[0133] Referring to FIG. 9, in operation 901, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may identify a target object. For example, the electronic device (101) may identify a target object among objects included in the image (1010) of FIG. 10 (e.g., a landscape object (1012) (e.g., a mountain), an object object (1011) (e.g., an airplane), and a background object (1013) (e.g., the sky)). For example, the electronic device (101) may identify the object object (1011) (e.g., an airplane) as a target object based on the fact that the object object (1011) (e.g., an airplane) of FIG. 10 is identified as an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on a second artificial intelligence algorithm. Likewise, the electronic device (101) may identify the landscape object (1012) (e.g., a mountain) as a target object based on the fact that the landscape object (1012) (e.g., a mountain) of FIG. 10 is identified as an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on the second artificial intelligence algorithm. As described above, the method for identifying the target object may be an on-device method or a server method.

[0134] In operation 903, according to one embodiment, the electronic device (101) (e.g., processor (120)) may display a mark indicating that it is a target object. For example, FIG. 10 illustrates a case where a thing object (1011) (e.g., an airplane) is identified as a target object. At this time, the electronic device (101) may display a mark (e.g., 1034) (e.g., in the form of a dotted line surrounding the target object (1021 or 1031)) indicating that an object (1021 or 1031) obtained by converting the thing object (1011) (e.g., an airplane) included in a two-dimensional image (1010) into a three-dimensional object is a target object.

[0135] Thereafter, according to one embodiment, the electronic device (101) may edit a target object based on a user input, such as operations 611, 613, and 615 of FIG. 6, and generate a two-dimensional image (e.g., 1040 of FIG. 10) reflecting the editing of the target object based on the end of the editing. The two-dimensional image (1040) generated in FIG. 10 may include a landscape object (e.g., 1042 corresponding to 1012) (e.g., a mountain) and a background object (e.g., 1043 corresponding to 1013) (e.g., the sky) included in the existing image (1010), and may include an object (1041) reflecting a change in the properties (e.g., size, position, shape, type) of an object (1011) (e.g., an airplane) included in the existing image (1010).

[0136] FIG. 11 is a flowchart illustrating a method of operation of an electronic device for displaying a background of an editing space, according to one embodiment. FIG. 11 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIG. 12). FIG. 12 is a diagram illustrating an editing space, according to one embodiment.

[0137] With reference to FIGS. 11 and 12, the first mode (e.g., full immersive mode) (e.g., VR mode) and outdrawing can be described.

[0138] At least some of the operations of FIG. 11 may be omitted. The order of the operations of FIG. 11 may be changed. Operations other than those of FIG. 11 may be performed before, during, or after the operations of FIG. 11.

[0139] Referring to FIG. 11, in operation 1101, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select a first image. Operation 1101 may be understood with reference to operation 601 of FIG. 6. Duplicate descriptions will be omitted. For example, the electronic device (101) may select the first image based on a first user input for selecting the first image. For example, referring to FIG. 12, the electronic device (101) may select an image (1210) that includes a landscape object (e.g., a mountain), an object object (e.g., an airplane), and a background object (e.g., the sky).

[0140] In operation 1103, according to one embodiment, the electronic device (101) (e.g., processor (120)) can identify a target object and a background object among objects included in a first image (e.g., image (1210)). Operation 1103 can be understood with reference to operations 603 and 605 of FIG. 6 and operations 803 and 805 of FIG. 8 . Duplicate descriptions will be omitted. The electronic device (101) can identify depth information for the first image (e.g., object(s) included in the first image). For example, the electronic device (101) can identify depth information for the first image (e.g., object(s) included in the first image) based on a first artificial intelligence algorithm. As described above, the method for identifying the depth information may be an on-device method or a server method. The electronic device (101) can identify an object that does not satisfy a specified criterion (e.g., a criterion related to depth, size, or focus) as a background object based on depth information, and can identify an object that satisfies the specified criterion (e.g., a criterion related to depth, size, or focus) as a candidate object. For example, the electronic device (101) can identify the first object (e.g., an airplane of 1210) as a target object based on the fact that the first object (e.g., an airplane of 1210) among the object(s) included in the first image is identified as an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on the second artificial intelligence algorithm.

[0141] In operation 1105, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may perform outdrawing on the background of the editing space using a background object based on depth information. For example, the electronic device (101) (e.g., the processor (120)) may perform outdrawing on the background of the editing space using a background object based on depth information based on a first artificial intelligence algorithm. For example, in FIG. 12, the electronic device (101) may perform outdrawing (1211) on the background of the editing space (1220) using a background object (e.g., the sky) included in a two-dimensional image (1210) based on depth information. The outdrawing may be generating a 360-degree background (e.g., a background image) based on the background object (e.g., the sky) of the two-dimensional image (e.g., 1210). In FIG. 12, “360 outdrawing (1211)” may be generating a background (e.g., a background image) that surrounds the editing space (1220) by 360 degrees. For example, in FIG. 12, the electronic device (101) may perform outdrawing (1211) on the background of the editing space (1220) using a background object based on an event that causes the generation (1212) of the 360-degree editing space.

[0142] In operation 1107, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may convert an object into a three-dimensional object based on depth information. The electronic device (101) (e.g., the processor (120)) may convert an object into a three-dimensional object based on depth information based on a first artificial intelligence algorithm. Operation 1107 may be understood with reference to operations 607 and 609 of FIG. 6 and operation 807 of FIG. 8. Duplicate descriptions will be omitted. For example, in FIG. 12, the electronic device (101) may convert a landscape object (e.g., a mountain) and an object object (e.g., an airplane) included in a two-dimensional image into a three-dimensional object based on depth information. For example, in FIG. 12, the electronic device (101) can convert a two-dimensional object into a three-dimensional object (1221) based on depth information based on a first artificial intelligence algorithm, based on an event that causes the creation (1222) of a three-dimensional object.

[0143] In operation 1109, according to one embodiment, the electronic device (101) (e.g., processor (120)) may place a three-dimensionally transformed object in an editing space (e.g., 1230). In FIG. 12 , the editing space (1230) may include a background image of operation 1105. For example, in operation 1107, the three-dimensionally transformed object may be displayed on the display (414) together with a background image obtained by outdrawing of operation 1105 by operation 1109.

[0144] In operation 1111, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may edit a target object based on user input. Operation 1111 may be understood with reference to operation 611 of FIG. 6 . Duplicate descriptions will be omitted. For example, the electronic device (101) may display an object reflecting a change in properties due to editing on the display (414).

[0145] In operation 1113, according to one embodiment, the electronic device (101) (e.g., processor (120)) may terminate editing based on an event that causes the termination of editing. Operation 1113 may be understood with reference to operation 613 of FIG. 6. Duplicate descriptions will be omitted.

[0146] In operation 1115, according to one embodiment, the electronic device (101) (e.g., processor (120)) may generate a two-dimensional second image reflecting the result of editing based on the completion of editing. Operation 1115 may be understood with reference to operation 615 of FIG. 6. Duplicate descriptions will be omitted.

[0147] FIG. 13 is a flowchart illustrating an operating method of an electronic device that senses a surrounding environment and sets a portion of the surrounding environment as an editing space, according to one embodiment. FIG. 13 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIG. 14). FIG. 14 is a diagram illustrating a mode transition, according to one embodiment.

[0148] Referring to FIGS. 13 and 14, the second mode (e.g., half immersive mode) (e.g., AR mode) and mode switching can be described.

[0149] At least some of the operations of FIG. 13 may be omitted. The order of the operations of FIG. 13 may be changed. Operations other than those of FIG. 13 may be performed before, during, or after the operations of FIG. 13.

[0150] Referring to FIG. 13, in operation 1301, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select a first image. Operation 1301 may be understood with reference to operation 601 of FIG. 6. Duplicate descriptions will be omitted. For example, the electronic device (101) may select the first image based on a first user input for selecting the first image. For example, referring to FIG. 14, the electronic device (101) may select an image (1410) that includes a landscape object (e.g., a mountain), an object object (1411) (e.g., an airplane), and a background object (e.g., the sky).

[0151] In operation 1303, according to one embodiment, the electronic device (101) (e.g., the processor (120)) can identify an object included in the first image. Operation 1103 can be understood with reference to operations 603 and 605 of FIG. 6 and operations 803 and 805 of FIG. 8 . Duplicate descriptions will be omitted. For example, the electronic device (101) can identify depth information for the first image (e.g., object(s) included in the first image). As described above, the method for identifying the depth information may be an on-device method or a server method. Based on the depth information, the electronic device (101) can identify an object that does not satisfy a specified criterion (e.g., a criterion related to depth, size, or focus) as a background object, and identify an object that satisfies the specified criterion (e.g., a criterion related to depth, size, or focus) as a candidate object. For example, the electronic device (101) may identify the first object (e.g., the airplane (1411) of 1410) as a target object based on the fact that the first object (e.g., the airplane (1411) of 1410) among the object(s) included in the first image is identified as an object to which 3D editing is applied (e.g., an object capable of 3D editing) based on the second artificial intelligence algorithm. For example, in FIG. 14, the electronic device (101) may identify a landscape object (e.g., a mountain), an object object (1411) (e.g., an airplane), and a background object (e.g., the sky) included in the image (1410). For example, in FIG. 14, the electronic device (101) may identify the object object (1411) (e.g., an airplane) as a target object.

[0152] In operation 1305, according to one embodiment, the electronic device (101) (e.g., processor (120)) may sense the surrounding environment. For example, referring to FIG. 14, the electronic device (101) may sense the surrounding environment (1420) using VST. For example, the electronic device (101) may display the surrounding environment sensed by VST (e.g., an image (e.g., 1430) related to the surrounding environment acquired through VST camera modules (211, 212)) on the display (414). Although 1430 of FIG. 14 is depicted as an empty space, this is for convenience of explanation, and 1430 may be the surrounding environment (or an image related to the surrounding environment) displayed on the display (414).

[0153] In operation 1307, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may set a portion of the surrounding environment (e.g., a first portion) as an editing space. A three-dimensional object, as described below, may be placed in the editing space set in the portion of the surrounding environment.

[0154] In operation 1309, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may transform a target object (e.g., 1411 of FIG. 14) into a three-dimensional object based on depth information. The electronic device (101) (e.g., the processor (120)) may transform a target object (e.g., 1411 of FIG. 14) into a three-dimensional object based on depth information based on a first artificial intelligence algorithm. Operation 1309 may be understood with reference to operations 607 and 609 of FIG. 6, and operation 807 of FIG. 8. Duplicate descriptions will be omitted.

[0155] In operation 1311, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may place a three-dimensionally transformed object in an editing space. For example, in FIG. 14 , the electronic device (101) may place a target object (1431) that was three-dimensionally transformed in operation 1309 in an editing space set in a portion of the surrounding environment (1430).

[0156] According to one embodiment, referring to FIG. 14, the electronic device (101) can switch modes. In FIG. 14, 1430 may be an editing space of a second mode (e.g., half immersive mode) (e.g., AR mode). In FIG. 14, 1440 may be an editing space of a first mode (e.g., full immersive mode) (e.g., VR mode). 1440 may include an object (1441) converted into three dimensions. The electronic device (101) can switch between 1430 and 1440 and display them. For example, in FIG. 14, the electronic device (101) may display an editing space (1430) of a second mode (e.g., half immersive mode) (e.g., AR mode), and, based on a user input causing a mode switch, switch the editing space (1430) of the second mode (e.g., half immersive mode) (e.g., AR mode) to an editing space (1440) of a first mode (e.g., full immersive mode) (e.g., VR mode). An operation of displaying the editing space (1440) of the first mode (e.g., full immersive mode) (e.g., VR mode) may be understood with reference to FIG. 11. For example, in FIG. 14, the electronic device (101) may display an editing space (1440) of a first mode (e.g., full immersive mode) (e.g., VR mode), and may switch the editing space (1440) of the first mode (e.g., full immersive mode) (e.g., VR mode) to an editing space (1430) of a second mode (e.g., half immersive mode) (e.g., AR mode) based on a user input that causes a switch of modes.

[0157] In operation 1313, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may edit an object based on user input. Operation 1313 may be understood with reference to operation 611 of FIG. 6 . Duplicate descriptions will be omitted. For example, the electronic device (101) may display an object reflecting a change in properties due to editing on the display (414).

[0158] In operation 1315, according to one embodiment, the electronic device (101) (e.g., processor (120)) may terminate editing based on an event that causes the termination of editing. Operation 1315 may be understood with reference to operation 613 of FIG. 6. Duplicate descriptions will be omitted.

[0159] In operation 1317, according to one embodiment, the electronic device (101) (e.g., processor (120)) may generate a two-dimensional second image reflecting the result of editing based on the end of editing. Operation 1317 may be understood with reference to operation 615 of FIG. 6. Duplicate descriptions will be omitted.

[0160] FIG. 15 is a flowchart illustrating an operation method of an electronic device for verifying depth information based on a field of view (FOV), according to one embodiment. FIG. 15 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIG. 16). FIG. 16 is a diagram illustrating a change in FOV, according to one embodiment.

[0161] Referring to FIGS. 15 and 16, an operation of determining new depth information based on a change in FOV can be described. FIG. 16 is a diagram exemplarily illustrating an embodiment of an editing space in a second mode (e.g., half immersive mode) (e.g., AR mode). The description of FIG. 16 can also be applied to an embodiment of an editing space in a first mode (e.g., full immersive mode) (e.g., VR mode).

[0162] At least some of the operations of FIG. 15 may be omitted. The order of the operations of FIG. 15 may be changed. Operations other than those of FIG. 15 may be performed before, during, or after the operations of FIG. 15.

[0163] Referring to FIG. 15, in operation 1501, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may check the first depth information. The electronic device (101) (e.g., the processor (120)) may check the first depth information based on the first artificial intelligence algorithm. Operation 1501 may be understood with reference to operation 601 of FIG. 6 and operations 801 and 803 of FIG. 8. Duplicate descriptions will be omitted. For example, the electronic device (101) may select a first image and check the first depth information based on the first artificial intelligence algorithm for the first image (or object(s) included in the first image). As described above, the method of checking the depth information may be an on-device method or a server method. Referring to FIG. 16, the first depth information of the 1501 operation may correspond to the first FOV (1601). For example, in FIG. 16, the first depth information in the first direction may be identified based on the first FOV (1601) formed by the position of the electronic device (101) or the direction in which the electronic device (101) is facing.

[0164] In operation 1503, according to one embodiment, the electronic device (101) (e.g., processor (120)) may, based on first depth information, convert a first object (e.g., an airplane) included in a two-dimensional image into a three-dimensional object, and display the obtained second object (e.g., 1601 of FIG. 16) on the display (414). Operation 1503 may be understood with reference to operations 607 and 609 of FIG. 6 and operation 807 of FIG. 8. Duplicate descriptions will be omitted. For example, in the second mode (e.g., half immersive mode) (e.g., AR mode), the electronic device (101) may display a first surrounding environment (e.g., an image related to the first surrounding environment) corresponding to a first FOV (e.g., 1601 of FIG. 16) sensed by the VST on the display (414), set a part of the first surrounding environment (e.g., an image related to the first surrounding environment) as an editing space (1610), and display a second object (e.g., 1611 of FIG. 16) acquired based on the first depth information in the set editing space (1610). For example, in a first mode (e.g., full immersive mode) (e.g., VR mode), the electronic device (101) may display a first background image corresponding to a first FOV (e.g., 1601 of FIG. 16) and display a second object (e.g., 1611 of FIG. 16) acquired based on the first depth information together with the first background image.

[0165] In operation 1505, according to one embodiment, the electronic device (101) (e.g., the processor (120)) can determine a change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing. The electronic device (101) can determine a change in the FOV by determining a change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing. For example, in FIG. 16 , the electronic device (101) can determine that the FOV has changed from the first FOV (1601) to the second FOV (1602), or that the FOV has changed from the first FOV (1601) to the third FOV (1603). The change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing can occur, for example, when a user wearing the electronic device (101) moves or turns his / her head.

[0166] In operation 1507, according to one embodiment, the electronic device (101) (e.g., processor (120)) can determine second depth information based on a change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing. When the position of the electronic device (101) or the direction in which the electronic device (101) is facing changes, the FOV changes, and thus the second depth information can be determined based on the first artificial intelligence algorithm by reflecting the change in the FOV. For example, in the case of an on-device method, the electronic device (101) can determine second depth information that reflects a change in the position of the electronic device (101) or the direction in which the electronic device (101) is facing, based on the first artificial intelligence algorithm included in the electronic device (101). For example, in the case of a server method, the electronic device (101) can transmit information about a change in the location of the electronic device (101) or the direction in which the electronic device (101) is facing to the server (400). The server (400) can check second depth information reflecting the change in the location of the electronic device (101) or the direction in which the electronic device (101) is facing, based on a first artificial intelligence algorithm included in the server (400). The server (400) can transmit the second depth information to the electronic device (101). The electronic device (101) can receive the second depth information from the server (400).

[0167] In operation 1509, according to one embodiment, the electronic device (101) (e.g., processor (120)) may display a third object (e.g., 1621 or 1631 of FIG. 16) on the display (414) that reflects a change in a first attribute (e.g., a viewing direction) of a second object (e.g., 1611 of FIG. 16) based on the second depth information. For example, in the second mode (e.g., half immersive mode) (e.g., AR mode), the electronic device (101) may display a second surrounding environment (e.g., an image related to the second surrounding environment) corresponding to the second FOV (e.g., 1602 of FIG. 16) sensed by the VST on the display (414), set a part of the second surrounding environment (e.g., an image related to the second surrounding environment) as an editing space (e.g., 1620), and display a third object (e.g., 1621 of FIG. 16) acquired based on the second depth information in the set editing space (e.g., 1620). The case of the third FOV (e.g., 1603 of FIG. 16) may be understood similarly. For example, in a first mode (e.g., full immersive mode) (e.g., VR mode), the electronic device (101) may display a second background image (e.g., 1620) corresponding to a second FOV (e.g., 1602 of FIG. 16) and display a third object (e.g., 1621 of FIG. 16) acquired based on the second depth information together with the second background image. The case of the third FOV (e.g., 1603 of FIG. 16) may be understood similarly.

[0168] FIG. 17 is a flowchart illustrating a method of operation of an electronic device displaying a preview according to one embodiment. FIG. 17 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIG. 18). FIG. 18 is a diagram illustrating a preview according to one embodiment.

[0169] Referring to FIGS. 17 and 18, the operation of displaying a preview can be understood.

[0170] At least some of the operations of FIG. 17 may be omitted. The order of the operations of FIG. 17 may be changed. Operations other than those of FIG. 17 may be performed before, during, or after the operations of FIG. 17.

[0171] Referring to FIG. 17, in operation 1701, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select a first image. Operation 1701 may be understood with reference to operation 601 of FIG. 6. Duplicate descriptions will be omitted. For example, the electronic device (101) may select the first image based on a first user input for selecting the first image. For example, referring to FIG. 18, the electronic device (101) may select an image (1810) that includes a landscape object (e.g., a mountain), an object object (e.g., an airplane), and a background object (e.g., the sky).

[0172] In operation 1703, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may transform an object into a three-dimensional object based on depth information for a first image (e.g., object(s) included in the first image). For example, the electronic device (101) (e.g., the processor (120)) may transform an object into a three-dimensional object based on depth information based on a first artificial intelligence algorithm for the first image (e.g., object(s) included in the first image). Operation 1703 may be understood with reference to operations 607 and 609 of FIG. 6 and operation 807 of FIG. 8. Duplicate descriptions will be omitted. For example, in FIG. 18, the electronic device (101) can convert a landscape object (e.g., a mountain) and an object (e.g., an airplane) included in a two-dimensional image (1810) into three dimensions based on depth information.

[0173] In operation 1705, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may place a three-dimensionally transformed object in an editing space (e.g., 1820). In FIG. 18, the editing space (1820) may include a background image generated by outdrawing using a background object (e.g., the sky) of the first image. For example, in operation 1703, the three-dimensionally transformed object may be displayed on the display (414) together with the background image generated by outdrawing. For example, the editing space of operation 1705 may be a portion of a surrounding environment sensed by a VST (e.g., an image related to the surrounding environment acquired through VST camera modules (211, 212)).

[0174] In operation 1707, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may display a preview while displaying a three-dimensionally transformed object in the editing space. For example, in FIG. 18 , the electronic device (101) may display a preview (1830) in a portion of the display (414) while displaying a three-dimensionally transformed object in the editing space (1820). As described above, the preview (e.g., 1830) may correspond to a two-dimensional image (e.g., the first image of operation 1701 (e.g., 1810 of FIG. 18 )). The preview (e.g., 1830) may indicate a result of editing (e.g., operation 1709) or a directionality of editing (e.g., operation 1709). If the preview indicates a result of editing, the preview may include an object whose properties have been changed by the editing. If the preview indicates the direction of the edit, the preview may indicate how the edit by the user input will be applied. Fig. 18 is a diagram exemplarily illustrating an embodiment of an omniscient viewpoint in a first mode (e.g., full immersive mode) (e.g., VR mode). The description of the display of the preview in Fig. 18 can be similarly applied to an embodiment of a first-person viewpoint in a first mode (e.g., full immersive mode) (e.g., VR mode) or an embodiment of a second mode (e.g., half immersive mode) (e.g., AR mode).

[0175] In operation 1709, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may edit an object based on user input. Operation 1709 may be understood with reference to operation 611 of FIG. 6 . Duplicate descriptions will be omitted. For example, the electronic device (101) may display an object reflecting a change in properties due to editing on the display (414).

[0176] In operation 1711, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may change the properties of an object included in a preview based on editing. The electronic device (101) may display a preview (e.g., 1830) in which the properties of an object (e.g., an airplane included in 1830) included in the preview (e.g., 1830) have been changed based on the change in the properties of the object (e.g., an airplane included in 1820). For example, in FIG. 18, based on the change in the properties of an object (e.g., an airplane included in 1820) included in the edit space (1820), the properties of an object (e.g., an airplane included in 1830) included in the preview (1830) corresponding to the object (e.g., an airplane included in 1820) in which the properties have been changed may be changed.

[0177] In operation 1713, according to one embodiment, the electronic device (101) (e.g., processor (120)) may terminate editing based on an event that causes the termination of editing. Operation 1713 may be understood with reference to operation 613 of FIG. 6. Duplicate descriptions will be omitted.

[0178] In operation 1715, according to one embodiment, the electronic device (101) (e.g., processor (120)) may generate a two-dimensional second image reflecting the result of the editing based on the completion of the editing. Operation 1715 may be understood with reference to operation 615 of FIG. 6. Duplicate descriptions will be omitted.

[0179] FIG. 19 is a flowchart illustrating a method of operating an electronic device for transforming an object into three dimensions based on a plurality of images, according to one embodiment. FIG. 19 can be described with reference to the previously described embodiments and the embodiments described below.

[0180] At least some of the operations of FIG. 19 may be omitted. The order of the operations of FIG. 19 may be changed. Operations other than those of FIG. 19 may be performed before, during, or after the operations of FIG. 19.

[0181] Referring to Fig. 19, an embodiment of converting a person object into a three-dimensional object can be described. The description of Fig. 19 can also be similarly applied to an embodiment of converting a landscape object into a three-dimensional object.

[0182] Referring to FIG. 19, in operation 1901, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may obtain a plurality of first images including the same object. According to one embodiment, the electronic device (101) may select a first image, identify a first object included in the first image, and obtain a plurality of first images including an object corresponding to the first object from among a plurality of images stored in the memory (130). For example, when an image including a person is selected, the electronic device (101) may obtain other images including the person. According to one embodiment, the electronic device (101) may select a first image, identify a first object included in the first image, and obtain a plurality of first images including an object corresponding to the first object from among a plurality of images stored in the server (400). Action 1903 may be performed after action 1903 is performed, or action 1903 may be omitted if action 1903 is unnecessary.

[0183] In operation 1903, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may generate a plurality of second images based on the plurality of first images of operation 1901. For example, if the electronic device (101) determines that it is not appropriate to perform operation 1905 based on the plurality of first images, the electronic device (101) may perform operation 1903. The electronic device (101) may generate a plurality of second images having different FOVs for the first object based on the plurality of first images including an object corresponding to the first object. For example, after acquiring a plurality of first images including a person, the electronic device (101) may generate a plurality of second images representing viewing the person from a plurality of directions (e.g., directions such as the front, side, and back of the person) based on the plurality of first images. According to one embodiment, the generation of the second images may be performed in the electronic device (101). According to one embodiment, the generation of the second images may be performed via the server (400). For example, the electronic device (101) may transmit information about a plurality of first images to the server (400), and the server (400) may generate a plurality of second images based on the plurality of first images and transmit the plurality of second images to the electronic device (101).

[0184] In operation 1905, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may calculate pose information between a plurality of images. The plurality of images of operation 1905 may be a plurality of first images of operation 1901 and / or a plurality of second images of operation 1903. For example, using a plurality of images including a person, the electronic device (101) may calculate pose information for the person included in the plurality of images. The pose information may be information indicating a pose of the body of the person included in the plurality of images. For example, the pose information may include depth information corresponding to each part of the object.

[0185] In operation 1907, according to one embodiment, the electronic device (101) (e.g., processor (120)) may determine a three-dimensional parameter corresponding to an object based on the posture information. The three-dimensional parameter may indicate the position of each part of the object.

[0186] In operation 1909, according to one embodiment, the electronic device (101) (e.g., processor (120)) may transform an object into three dimensions based on three-dimensional parameters.

[0187] FIG. 20 is a flowchart illustrating a method of operating an electronic device for transforming an object into three dimensions by extracting feature points, according to one embodiment. FIG. 20 can be described with reference to the previously described embodiments and the embodiments described below.

[0188] At least some of the operations of FIG. 20 may be omitted. The order of the operations of FIG. 20 may be changed. Operations other than those of FIG. 20 may be performed before, during, or after the operations of FIG. 20.

[0189] Referring to Fig. 20, an embodiment of converting a landscape object into a three-dimensional object can be described. The description of Fig. 20 can also be similarly applied to an embodiment of converting a person object into a three-dimensional object.

[0190] Referring to FIG. 20, in operation 2001, according to one embodiment, an electronic device (101) (e.g., processor (120)) may obtain a two-dimensional image.

[0191] In operation 2003, according to one embodiment, the electronic device (101) (e.g., processor (120)) may extract feature points of an object included in an acquired two-dimensional image. For example, the electronic device (101) may extract feature points of a landscape object included in the acquired two-dimensional image.

[0192] In operation 2005, according to one embodiment, the electronic device (101) (e.g., processor (120)) may cluster feature points. For example, the electronic device (101) may cluster feature points corresponding to each part of a landscape object.

[0193] In operation 2007, according to one embodiment, the electronic device (101) (e.g., processor (120)) can stereoscopically visualize a cluster based on depth information of a two-dimensional image. For example, the electronic device (101) can confirm depth information for the two-dimensional image of operation 2001. For example, the electronic device (101) can confirm depth information for the two-dimensional image of operation 2001 based on a first artificial intelligence algorithm. The electronic device (101) can stereoscopically visualize the cluster of operation 2005 based on the confirmed depth information.

[0194] In operation 2009, according to one embodiment, the electronic device (101) (e.g., processor (120)) may convert an object into three dimensions based on operation 2007. For example, the electronic device (101) may convert a landscape object into three dimensions by clustering feature points corresponding to each part of a landscape object included in a two-dimensional image and stereoscopically converting the clusters.

[0195] FIG. 21 is a flowchart illustrating an operation method of an electronic device applying matte painting according to one embodiment. FIG. 21 may be described with reference to the previously described embodiments and the embodiments described below (e.g., FIG. 22). FIG. 22 is a diagram illustrating an operation of converting an image into three dimensions according to one embodiment.

[0196] At least some of the operations of FIG. 21 may be omitted. The order of the operations of FIG. 21 may be changed. Operations other than those of FIG. 20 may be performed before, during, or after the operations of FIG. 21.

[0197] Referring to FIG. 21, in operation 2101, according to one embodiment, the electronic device (101) (e.g., processor (120)) may obtain a two-dimensional image. For example, referring to FIG. 22, the electronic device (101) may obtain a two-dimensional image (2210).

[0198] In operation 2103, according to one embodiment, the electronic device (101) (e.g., processor (120)) may convert object(s) included in a two-dimensional image into three dimensions. For example, in FIG. 22, the electronic device (101) may convert object(s) included in a two-dimensional image (2210) into three-dimensional object(s) (e.g., 2221, 2222, 2223, 2224) based on depth information.

[0199] In operation 2105, according to one embodiment, the electronic device (101) (e.g., processor (120)) may apply matte painting to the transformed object(s) (e.g., 2221, 2222, 2223, 2224). The electronic device (101) may display a three-dimensional image (2230) with matte painting applied on the display (414).

[0200] FIG. 23 is a diagram illustrating image editing according to one embodiment. FIG. 23 can be explained with reference to the previously described embodiments and the embodiments described below.

[0201] Referring to FIG. 23, editing of an image including multiple character objects can be described.

[0202] Referring to FIG. 23, according to one embodiment, an electronic device (101) (e.g., processor (120)) may select a first image (2310). The first image (2310) may include a plurality of person objects. The electronic device (101) may start editing the first image (2310) based on a user input. The electronic device (101) may check depth information for the first image (2310) (e.g., a plurality of person objects included in the first image (2310)). For example, the electronic device (101) may check depth information for the first image (2310) (e.g., a plurality of person objects included in the first image (2310)) based on a first artificial intelligence algorithm. The electronic device (101) can convert (2320) a first image (2310) (e.g., a plurality of person objects included in the first image (2310)) into three dimensions based on depth information. The electronic device (101) can change (2330) the properties of at least some of the plurality of person objects converted into three dimensions based on a user input for directly editing the object or a user input for selecting a preset described below. The electronic device (101) can generate a two-dimensional image (2340) reflecting the result of the editing based on a user input that causes the end of the editing. For example, referring to FIG. 23, the electronic device (101) can change the expression or posture of some of the person objects by editing a wedding photo including a plurality of person objects.

[0203] FIG. 24 is a flowchart illustrating an operation method of an electronic device providing a preset according to one embodiment. FIG. 24 may be described with reference to previously described embodiments and embodiments described below (e.g., FIGS. 25, 26, 27, 28, and 29). FIG. 25 is a diagram illustrating image editing according to one embodiment. FIG. 26 is a diagram illustrating image editing according to one embodiment. FIG. 27 is a diagram illustrating image editing according to one embodiment. FIG. 28 is a diagram illustrating image editing according to one embodiment. FIG. 29 is a diagram illustrating an operation of providing a preset according to one embodiment.

[0204] At least some of the operations of Fig. 24 may be omitted. The order of the operations of Fig. 24 may be changed. Operations other than those of Fig. 24 may be performed before, during, or after the operations of Fig. 24.

[0205] Referring to FIG. 24, in operation 2401, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may transform an object into a three-dimensional object based on depth information for a first image (e.g., object(s) included in the first image). For example, the electronic device (101) (e.g., the processor (120)) may transform an object into a three-dimensional object based on depth information based on a first artificial intelligence algorithm for the first image (e.g., object(s) included in the first image). Operation 2401 may be understood with reference to operations 607 and 609 of FIG. 6, and operation 807 of FIG. 8. Duplicate descriptions will be omitted.

[0206] In operation 2403, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select preset editing. For example, the electronic device (101) may select preset editing based on a user input selecting preset editing. If preset editing is selected, the electronic device (101) may perform operations 2405, 2407, and 2409.

[0207] In operation 2405, according to one embodiment, the electronic device (101) (e.g., processor (120)) may provide presets for editing an image. For example, the electronic device (101) may display a screen (or list) for selecting one of a plurality of presets for editing an image. The electronic device (101) may display a screen for selecting one of a plurality of presets for editing an image by analyzing an image to be edited. Examples of presets may be described with reference to the embodiments described below (e.g., FIGS. 25, 26, 27, 28, and 29).

[0208] In operation 2407, according to one embodiment, the electronic device (101) (e.g., processor (120)) may select one of a plurality of presets for editing an image based on a user input. In operation 2409, according to one embodiment, the electronic device (101) (e.g., processor (120)) may apply the selected preset to the image.

[0209] In relation to operations 2405, 2407, and 2409, referring to FIG. 25, the electronic device (101) (e.g., the processor (120)) may select a two-dimensional image (e.g., the image (2310) of FIG. 23) including a plurality of person objects, and transform objects included in the selected image into three dimensions (2510). In FIG. 25, the electronic device (101) may provide a preset that changes the size of the person objects, a preset that changes the pose of the person objects, or a preset that recommends a dynamic pose of the person objects. Based on selection of a preset that changes the size of the person objects, the electronic device (101) may display an image (2520) to which the change in the size of the person objects is applied on the display (414). The electronic device (101) can display an image (2530) to which the pose of the person objects has been changed, on the display (414), based on selection of a preset that changes the pose of the person objects. The electronic device (101) can display an image (2540) reflecting the dynamic pose of the person objects, on the display (414), based on selection of a preset that recommends the dynamic pose of the person objects. After the preset is applied, the electronic device (101) can generate a two-dimensional image reflecting the result of the editing, based on an event that causes the end of the editing.

[0210] In connection with operations 2405, 2407, and 2409, referring to FIG. 26, the electronic device (101) (e.g., the processor (120)) may select a two-dimensional image (e.g., the image (2310) of FIG. 23) including a plurality of human objects, and may convert (2610) the objects included in the selected image into three dimensions. For example, the converted image (2610) may include a plurality of objects including a first object (2611) and a second object (2612). In FIG. 26, the electronic device (101) may provide a preset for changing the height of the first object (2611) among the human objects, a preset for changing the hairstyle of the second object (2612) among the human objects, or a preset for changing the body proportions of the human objects. The electronic device (101) can display, on the display (414), an image (2620) including an object (2621) reflecting a change in the height of the first object (2611) based on selection of a preset that changes the height of the first object (2611) among the person objects. The electronic device (101) can display, on the display (414), an image (2630) including an object (2632) reflecting a change in the hairstyle of the second object (2612) based on selection of a preset that changes the hairstyle of the second object (2612) among the person objects. The electronic device (101) can display, on the display (414), an image (2640) reflecting a change in the body proportions of the person objects based on selection of a preset that changes the body proportions of the person objects. After the preset is applied, the electronic device (101) can generate a two-dimensional image reflecting the result of the editing based on an event that causes the end of the editing.

[0211] In connection with operations 2405, 2407, and 2409, referring to FIG. 27, the electronic device (101) (e.g., the processor (120)) may select a two-dimensional image (e.g., the image (2310) of FIG. 23) including a plurality of person objects, and may convert objects included in the selected image into three dimensions (2710). In FIG. 27, the electronic device (101) may provide a preset for changing the color of the pants of the person objects, or a preset for changing the color of the skin of the person objects. Based on selection of the preset for changing the color of the pants of the person objects, the electronic device (101) may display an image (2720) reflecting the change in the color of the pants of the person objects on the display (414). The electronic device (101) can display an image (2730) reflecting a change in the skin color of the person objects on the display (414) based on a selection of a preset that changes the skin color of the person objects. After the preset is applied, the electronic device (101) can generate a two-dimensional image reflecting the result of the editing based on an event that causes the end of the editing.

[0212] In operation 2411, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may select direct editing. For example, the electronic device (101) may select direct editing based on a user input selecting direct editing. If direct editing is selected, the electronic device (101) may perform operation 2413.

[0213] In operation 2413, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may edit (e.g., directly edit) a target object based on a user input. For example, referring to FIG. 28, a two-dimensional image (e.g., the image (2310) of FIG. 23) including a plurality of person objects may be selected, and objects included in the selected image may be converted into a three-dimensional image (2810). The electronic device (101) may display an image (2820) reflecting a change in pose (2821) on the display (414) based on a user input for changing a pose of the plurality of person objects. The electronic device (101) may display an image (2840) reflecting a change in pose of a person object (2841) on the display (414) based on a user input for changing a pose of one person object among the plurality of person objects. The electronic device (101) can display an image (2830) reflecting a change in the position and posture of a plurality of person objects on the display (414) based on a user input that changes the position and posture of a plurality of person objects. For example, in FIG. 28, the electronic device (101) can change the pose of a person object by bending (rigging) the elbow of the person object based on the user input.

[0214] In connection with operations 2405, 2407, and 2409, referring to FIG. 29, the electronic device (101) (e.g., the processor (120)) may select a two-dimensional image including a landscape object (e.g., a mountain), an object object (e.g., an airplane), and a background object (e.g., the sky), and may convert objects included in the selected image into three dimensions (2900). In FIG. 29, the electronic device (101) may identify a target object (2901) and provide a preset for the target object (2901). For example, the electronic device (101) may provide a preset (2910) that changes a logo included in the appearance of a target object (2901) (e.g., an airplane), a preset (2920) that changes the appearance (e.g., a wheel) of the target object (2901) (e.g., an airplane), or a preset (2930) that changes the color of the target object (2901) (e.g., an airplane). For example, the electronic device (101) may provide presets (e.g., 2940, 2950, ​​2960) that recommend objects of a category (e.g., an airplane) that is the same as or similar to the category of the target object (2901) (e.g., an airplane). For example, the electronic device (101) may provide presets (e.g., 2970 recommending a hot air balloon, 2980 recommending a bird, 2990 recommending a spaceship) that recommend objects of a category associated with the category of the target object (2901) (e.g., an airplane).

[0215] In relation to operation 2413, referring to FIG. 30, the electronic device (101) may display an icon that causes editing of an object for direct editing by user input. For example, in FIG. 30, the electronic device (101) may select a two-dimensional image including a landscape object (e.g., a mountain), an object object (e.g., an airplane), and a background object (e.g., the sky), and may convert objects included in the selected image into three dimensions (3000). The electronic device (101) may identify a target object (3001). The electronic device (101) may display an icon that causes editing of the target object (3001). For example, at 3010, the electronic device (101) may display an icon (3011) for rotating the target object. For example, at 3020, the electronic device (101) may display an icon (3021) for changing the size of the target object. For example, in 3030, the electronic device (101) may display an icon (3031) for moving the location of the target object. The electronic device (101) may edit the target object based on a user input for the icon that causes editing of the object.

[0216] Referring to FIG. 31, according to one embodiment, the electronic device (101) (e.g., the processor (120)) can change the properties of space. For example, in FIG. 31, the electronic device (101) can display an image (3110) representing that light is shining in a first direction (3111) on the display (414). Based on a user input causing the direction in which the light is shining to change, the electronic device (101) can display an image (3120) representing that light is shining in a second direction (3121) on the display (414). Based on a user input causing the illuminance to change, the electronic device (101) can display an image (3130) representing that the illuminance has been changed on the display (414).

[0217] FIG. 32 is a diagram illustrating gaze tracking according to one embodiment.

[0218] Referring to FIG. 32, according to one embodiment, an electronic device (101) (e.g., a processor (120)) may place a target object (3210) in an editing space (3200). The electronic device (101) may track a user's gaze. The electronic device (101) may display an icon (3220) indicating the user's gaze in the editing space (3200). While the icon (3220) indicating the user's gaze is displayed, the electronic device (101) may edit the target object (3210) based on the user's gaze and / or gesture.

[0219] FIG. 33 is a diagram illustrating an operation indicating that editing is in progress, according to one embodiment. FIG. 34 is a diagram illustrating an icon indicating that editing is in progress, according to one embodiment. FIG. 35 is a diagram illustrating an operation of displaying an editing status on an external display, according to one embodiment. FIGS. 33, 34, and 35 can be described with reference to the previously described embodiments and the embodiments described below.

[0220] Referring to FIG. 33, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) (e.g., processor (120)) may display a screen indicating that editing is in progress (e.g., a screen including text (3300) saying “editing”) on the second display (230) while a screen for editing is displayed on the first display (221).

[0221] Referring to FIG. 34, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) (e.g., processor (120)) may display a screen indicating that editing is in progress (e.g., a screen including an icon (3400) indicating that editing is in progress) on the second display (230) while a screen for editing is displayed on the first display (221).

[0222] Referring to FIG. 35, in the case of the electronic device (101) of FIGS. 2 and 3, the electronic device (101) (e.g., processor (120)) can display a screen corresponding to the screen for editing (e.g., a screen including an object (3500) corresponding to the object being edited) on the second display (230) while the screen for editing is displayed on the first display (221).

[0223] FIG. 36 is a diagram illustrating copying an object to another image according to one embodiment. FIG. 37 is a diagram illustrating copying an object to an empty space or surrounding environment according to one embodiment. FIG. 36 and FIG. 37 can be described with reference to the previously described embodiments and the embodiments described below.

[0224] Copying of an object can be explained with reference to FIGS. 36 and 37.

[0225] For example, in FIG. 36, the electronic device (101) (e.g., the processor (120)) can select a two-dimensional first image (3610) and a two-dimensional second image (3630). The first image (3610) can include a target object (3611). The electronic device (101) can display a third image (3620) that is a three-dimensional conversion of the first image (3610) and a fourth image (3640) that is a three-dimensional conversion of the second image (3630) together in an editing space. The electronic device (101) can display an object (3641) corresponding to the target object (3621) in the fourth image (3640) based on a user input that causes a copy of the target object (3621) included in the third image (3620).

[0226] For example, in FIG. 37, the electronic device (101) (e.g., the processor (120)) may select a two-dimensional first image (3710). The first image (3710) may include a target object (3711). The electronic device (101) may display a second image (3720) that is a three-dimensional conversion of the first image (3710). Based on a user input that causes a copy of the target object (3721) included in the second image (3720), the electronic device (101) may place an object (3741) corresponding to the target object (3721) in an editing space (3740) (e.g., an empty space or an image related to the surrounding environment (e.g., an image related to the surrounding environment acquired through the VST camera modules (211, 212)).

[0227] FIG. 38 is a diagram illustrating the transformation history of an object's properties according to one embodiment. FIG. 38 can be explained with reference to the previously described embodiments and the embodiments described below.

[0228] At least some of the operations of Fig. 38 may be omitted. The order of the operations of Fig. 38 may be changed. Operations other than those of Fig. 38 may be performed before, during, or after the operations of Fig. 38.

[0229] Referring to FIG. 38, in operation 3801, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may store a transformation history based on the editing of an object. For example, the electronic device (101) may store the transformation history based on the editing of an object in the memory (130). The electronic device (101) may check the transformation history stored in the memory (130). For example, the electronic device (101) may transmit the transformation history based on the editing of an object to the server (400). The electronic device (101) may receive information related to the transformation history from the server (400).

[0230] In operation 3803, according to one embodiment, the electronic device (101) (e.g., the processor (120)) may provide presets based on the conversion history. For example, the electronic device (101) may set priorities based on the number of times a preset has been selected from among the plurality of presets based on the conversion history. For example, the electronic device (101) may set priorities based on the most recently used history among the plurality of presets based on the conversion history. The electronic device (101) may recommend the plurality of presets based on the priorities.

[0231] In operation 3805, according to one embodiment, the electronic device (101) (e.g., processor (120)) may perform transformation of an image (e.g., an object included in the image) based on a transformation history.

[0232] FIG. 39 is a diagram illustrating editing by multiple users according to one embodiment.

[0233] For example, referring to FIG. 39, a first user may wear a first electronic device (3910) (e.g., a device corresponding to 101), and a second user may wear a second electronic device (3920) (e.g., a device corresponding to 101). The first electronic device (3910) may display an editing space (3900) including a target object (3901). The second electronic device (3920) may display an editing space (3900) including a target object (3901). A first FOV of the first electronic device (3910) may be identified based on a location of the first electronic device (3910) or a direction in which the first electronic device (3910) is facing. Based on the first FOV of the first electronic device (3910), the direction in which the editing space (3900) and the target object (3901) are displayed on the first electronic device (3910) can be determined. Based on the position of the second electronic device (3920) or the direction in which the second electronic device (3920) is facing, the second FOV of the second electronic device (3920) can be identified. Based on the second FOV of the second electronic device (3920), the direction in which the editing space (3900) and the target object (3901) are displayed on the second electronic device (3920) can be determined. Regardless of the first FOV and the second FOV, the first electronic device (3910) and the second electronic device (3920) may display the editing space (3900) and the target object (3901) in the same direction. The screen displayed on the first electronic device (3910) and the screen displayed on the second electronic device (3920) can be understood with reference to the previously described embodiments.

[0234] According to one embodiment, in FIG. 39, when an edit occurs by a first user of a first electronic device (3910), a screen reflecting the edit by the first user may be displayed on the first electronic device (3910). At this time, a screen reflecting the edit by the first user may also be displayed on the second electronic device (3920). Similarly, when an edit occurs by a second user of a second electronic device (3920), a screen reflecting the edit by the second user may be displayed on the second electronic device (3920). At this time, a screen reflecting the edit by the second user may also be displayed on the first electronic device (3910). The display of the edit and the screen reflecting the edit in FIG. 39 may be understood with reference to the previously described embodiments.

[0235] Those skilled in the art will appreciate that the embodiments described herein may be applied interchangeably, within the scope of their applicability. For example, those skilled in the art will appreciate that at least some operations of one embodiment described herein may be omitted and applied, or at least some operations of one embodiment may be applied in conjunction.

[0236] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary skill in the technical field to which this document pertains from the description below.

[0237] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0238] According to one embodiment, an electronic device (101) may include a first display (414; 221), at least one processor (120), and a memory (130) storing instructions. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to select a first image based on a first user input selecting the first image. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to check first depth information for objects included in the first image. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify, based on the first depth information, a first object and a background object among the objects included in the first image. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display, based on the first depth information, a second object generated by converting the first object into a three-dimensional object, and a background image corresponding to the background object. The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display a first mark indicating that the second object is a target object based on the first object being identified as an object to which three-dimensional editing is applied.

[0239] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to verify the first depth information for the objects included in the first image based on a first artificial intelligence algorithm. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to verify, based on a second artificial intelligence algorithm, that the first object is an object to which the three-dimensional editing is applied.

[0240] In one embodiment, the first display (414; 221) may include a first sub-display (414; 221; 221a) corresponding to the user's right eye, and a second sub-display (414; 221; 221b) corresponding to the user's left eye. An image displayed on the first display (414; 221) may include a first sub-image displayed on the first sub-display (414; 221; 221a) and a second sub-image displayed on the second sub-display (414; 221; 221b). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display the second object and the background image at a first view point based on the first depth information, and then to identify a second user input that causes a change in view point. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify second depth information associated with a second view point based on the first artificial intelligence algorithm, based on the second user input. The above instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display a third object corresponding to the second object and the background image from the second view point based on the second depth information.

[0241] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display a fourth object reflecting a change in the first property of the third object, and the background image, based on a third user input for the third object.

[0242] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display a preview corresponding to the first image while displaying the third object and the background image. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display a preview in which an attribute of an object corresponding to the fourth object among objects included in the preview has been changed, based on a change in the first attribute.

[0243] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to generate a second image including the background object and a fifth object replacing the first object, based on the end of editing. The fifth object may reflect a change in the first property. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to stop displaying the fourth object, the background image, and the preview, and control the first display (414; 221) to display the second image.

[0244] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to store the first depth information in the memory (130) based on determining the second depth information. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the first display (414; 221) to display the second object and the background image at the first view point based on the first depth information stored in the memory (130) based on a change from the second view point to the first view point.

[0245] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to verify the first depth information by verifying the first depth information based on the first artificial intelligence algorithm stored in the memory (130).

[0246] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to transmit information about the first image to a server (108; 400) and to receive the first depth information from the server (108; 400), thereby verifying the first depth information. The first depth information received from the server (108; 400) may be verified by the server (108; 400) based on the first artificial intelligence algorithm of the server (108; 400).

[0247] In one embodiment, the second image may be an image corresponding to the user's field of view (FOV) at the time of confirming the end of the editing.

[0248] According to one embodiment, the first display (414; 221) may be disposed on a first side of the electronic device (101) facing the face of the user when the electronic device (101) is worn on the face of the user. The electronic device (101) may include a second display (414; 230) disposed on a second side of the electronic device (101) opposite the first side. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the second display (414; 230) to display an object corresponding to the second object while displaying the second object on the first display (414; 221). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the second display (414; 230) to display an object corresponding to the third object while displaying the third object on the first display (414; 221). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to control the second display (414; 230) to display an object corresponding to the fourth object while displaying the fourth object on the first display (414; 221).

[0249] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify, based on the first depth information, an object among the objects included in the first image that satisfies a specified criterion as the first object. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to identify, based on the first depth information, an object among the objects included in the first image that does not satisfy the specified criterion as the background object.

[0250] According to one embodiment, a method of operating an electronic device (101) may include an operation of selecting a first image based on a first user input of selecting the first image. The method may include an operation of checking first depth information on objects included in the first image. The method may include an operation of checking a first object and a background object among the objects included in the first image based on the first depth information. The method may include an operation of displaying a second object generated by converting the first object into a three-dimensional object based on the first depth information, and a background image corresponding to the background object. The method may include an operation of displaying a first mark indicating that the second object is a target object based on the first object being checked as an object to which three-dimensional editing is applied.

[0251] According to one embodiment, in the method, the operation of checking the first depth information may include an operation of checking the first depth information for the objects included in the first image based on a first artificial intelligence algorithm. The method may include an operation of checking, based on a second artificial intelligence algorithm, that the first object is an object to which the 3D editing is applied.

[0252] According to one embodiment, the method may include an operation of controlling the first display (414; 221) to display the second object and the background image at a first view point based on the first depth information, and then confirming a second user input that causes a change in the view point. The method may include an operation of confirming second depth information related to the second view point based on the first artificial intelligence algorithm, based on the second user input. The method may include an operation of displaying a third object corresponding to the second object and the background image at the second view point based on the second depth information.

[0253] According to one embodiment, the method may include displaying a fourth object reflecting a change in a first property of the third object based on a third user input for the third object, and a method of displaying the background image.

[0254] According to one embodiment, the method may include an operation of displaying a preview corresponding to the first image while displaying the third object and the background image. The method may include an operation of displaying a preview in which an attribute of an object corresponding to the fourth object among the objects included in the preview has been changed, based on a change in the first attribute.

[0255] In one embodiment, the method may include generating a second image, based on the end of editing, that includes the background object and a fifth object that replaces the first object. The fifth object may reflect a change in the first property. The method may include stopping display of the fourth object, the background image, and the preview, and displaying the second image.

[0256] According to one embodiment, the method may include an operation of storing the first depth information in a memory (130) of the electronic device (101) based on verifying the second depth information. The method may include an operation of displaying the second object and the background image at the first view point based on the first depth information stored in the memory (130) based on a change from the second view point to the first view point.

[0257] According to one embodiment, the operation of confirming the first depth information may include an operation of confirming the first depth information by confirming the first depth information based on the first artificial intelligence algorithm stored in the memory (130).

[0258] According to one embodiment, the operation of confirming the first depth information may include an operation of confirming the first depth information by transmitting information about the first image to a server (108; 400) and receiving the first depth information from the server (108; 400). The first depth information received from the server (108; 400) may be confirmed by the server (108; 400) based on the first artificial intelligence algorithm of the server (108; 400).

[0259] According to one embodiment, the second image may be an image corresponding to the user's field of view (FOV) at the time of confirming the end of the editing.

[0260] According to one embodiment, the method may include controlling a second display (414; 230) of the electronic device (101) to display an object corresponding to the second object while displaying the second object on the first display (414; 221). The method may include controlling the second display (414; 230) to display an object corresponding to the third object while displaying the third object on the first display (414; 221). The method may include controlling the second display (414; 230) to display an object corresponding to the fourth object while displaying the fourth object on the first display (414; 221).

[0261] According to one embodiment, the method may include an operation of identifying, based on the first depth information, an object among the objects included in the first image that satisfies a specified criterion as the first object. The method may include an operation of identifying, based on the first depth information, an object among the objects included in the first image that does not satisfy the specified criterion as the background object.

[0262] According to one embodiment, a storage medium storing computer-readable instructions may cause the instructions, when executed by at least one processor (120) of an electronic device (101), to cause the electronic device (101) to perform at least one operation. The at least one operation may include an operation of selecting a first image based on a first user input selecting the first image. The at least one operation may include an operation of checking first depth information about objects included in the first image. The at least one operation may include an operation of checking a first object and a background object among the objects included in the first image based on the first depth information. The at least one operation may include an operation of displaying a second object generated by converting the first object into a three-dimensional object based on the first depth information, and a background image corresponding to the background object. The at least one action may include an action of displaying a first mark indicating that the second object is a target object based on the first object being identified as an object to which 3D editing is applied.

[0263] According to one embodiment, in the storage medium, the operation of checking the first depth information may include an operation of checking the first depth information for the objects included in the first image based on a first artificial intelligence algorithm. The at least one operation may include an operation of checking, based on a second artificial intelligence algorithm, that the first object is an object to which the 3D editing is applied.

[0264] According to one embodiment, in the storage medium, the at least one operation may include an operation of controlling the first display (414; 221) to display the second object and the background image at a first view point based on the first depth information, and then confirming a second user input that causes a change in the view point. The at least one operation may include an operation of confirming second depth information related to the second view point based on the first artificial intelligence algorithm, based on the second user input. The at least one operation may include an operation of displaying a third object corresponding to the second object and the background image at the second view point based on the second depth information.

[0265] According to one embodiment, in the storage medium, the at least one operation may include displaying a fourth object reflecting a change in a first property of the third object based on a third user input for the third object, and a method of displaying the background image.

[0266] According to one embodiment, in the storage medium, the at least one operation may include an operation of displaying a preview corresponding to the first image while displaying the third object and the background image. The at least one operation may include an operation of displaying the preview in which an attribute of an object corresponding to the fourth object among the objects included in the preview has been changed, based on a change in the first attribute.

[0267] According to one embodiment, in the storage medium, the at least one operation may include generating a second image including the background object and a fifth object replacing the first object, based on the end of editing. The fifth object may reflect a change in the first property. The at least one operation may include stopping display of the fourth object, the background image, and the preview, and displaying the second image.

[0268] According to one embodiment, in the storage medium, the at least one operation may include an operation of storing the first depth information in a memory (130) of the electronic device (101) based on verifying the second depth information. The at least one operation may include an operation of displaying the second object and the background image at the first view point based on the first depth information stored in the memory (130) based on a change from the second view point to the first view point.

[0269] According to one embodiment, in the storage medium, the operation of confirming the first depth information may include an operation of confirming the first depth information by confirming the first depth information based on the first artificial intelligence algorithm stored in the memory (130).

[0270] According to one embodiment, in the storage medium, the operation of confirming the first depth information may include an operation of confirming the first depth information by transmitting information about the first image to a server (108; 400) and receiving the first depth information from the server (108; 400). The first depth information received from the server (108; 400) may be confirmed by the server (108; 400) based on the first artificial intelligence algorithm of the server (108; 400).

[0271] According to one embodiment, in the storage medium, the second image may be an image corresponding to the user's field of view (FOV) at the time of confirming the end of the editing.

[0272] According to one embodiment, in the storage medium, the at least one operation may include controlling the second display (414; 230) of the electronic device (101) to display an object corresponding to the second object while the second object is displayed on the first display (414; 221). The at least one operation may include controlling the second display (414; 230) to display an object corresponding to the third object while the third object is displayed on the first display (414; 221). The at least one operation may include controlling the second display (414; 230) to display an object corresponding to the fourth object while the fourth object is displayed on the first display (414; 221).

[0273] According to one embodiment, in the storage medium, the at least one operation may include an operation of identifying, based on the first depth information, an object among the objects included in the first image that satisfies a specified criterion as the first object. The at least one operation may include an operation of identifying, based on the first depth information, an object among the objects included in the first image that does not satisfy the specified criterion as the background object.

[0274] According to one embodiment, the electronic device (101) can provide a user with an experience of entering an image, experiencing the environment, and editing the image. The electronic device (101) can enter an editing space where a target object included in a two-dimensional image can be edited, display a screen so that the user can directly view the object and environment created based on generative artificial intelligence in real time, and generate an image reflecting the edited properties of the object.

[0275] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0276] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0277] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0278] Various embodiments of the present document may be implemented as software (e.g., a program) including one or more instructions stored on a storage medium that can be read by a machine (e.g., an electronic device). For example, a processor (e.g., a controller) of the machine may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0279] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0280] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), First display (414; 221); at least one processor (120); and Includes a memory (130) for storing instructions, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on a first user input selecting a first image, the first image is selected, Check the first depth information for the objects included in the first image above, Based on the first depth information, among the objects included in the first image, the first object and the background object are identified, Based on the first depth information, the first display (414; 221) is controlled to display a second object generated by converting the first object into a three-dimensional object, and a background image corresponding to the background object. Based on the first object being identified as an object to which three-dimensional editing is applied, causing the first display (414; 221) to be controlled to display a first mark indicating that the second object is a target object. Electronic device (101).

2. In paragraph 1, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the first artificial intelligence algorithm, the first depth information for the objects included in the first image is verified, Based on the second artificial intelligence algorithm, causing the first object to be confirmed as an object to which the three-dimensional editing is applied. Electronic device (101).

3. In paragraph 1 or 2, The first display (414; 221) includes a first sub-display (414; 221; 221a) corresponding to the user's right eye, and a second sub-display (414; 221; 221b) corresponding to the user's left eye. The image displayed on the first display (414; 221) includes a first sub-image displayed on the first sub-display (414; 221; 221a) and a second sub-image displayed on the second sub-display (414; 221; 221b). The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: After controlling the first display (414; 221) to display the second object and the background image at a first view point based on the first depth information, a second user input causing a change in the view point is confirmed, Based on the second user input, the second depth information related to the second view point is checked based on the first artificial intelligence algorithm, Based on the second depth information, causing the first display (414; 221) to be controlled to display a third object corresponding to the second object and the background image from the second view point. Electronic device (101).

4. In any one of paragraphs 1 to 3, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the second user input for the third object, causing the first display (414; 221) to be controlled to display a fourth object reflecting a change in the first property of the third object, and the background image. Electronic device (101).

5. In any one of paragraphs 1 to 4, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: While displaying the third object and the background image, controlling the first display (414; 221) to display a preview corresponding to the first image; Based on the change of the first property, causing the first display (414; 221) to be controlled to display the preview in which the property of an object corresponding to the fourth object among the objects included in the preview has been changed. Electronic device (101).

6. In any one of paragraphs 1 to 5, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the end of the editing, a second image is generated including the background object and a fifth object replacing the first object, wherein the fifth object reflects the change in the first property, Causing the first display (414; 221) to stop displaying the fourth object, the background image, and the preview, and to display the second image; Electronic device (101).

7. In any one of paragraphs 1 to 6, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the verification of the above second depth information, the above first depth information is stored in the memory (130), Based on the change from the second view point to the first view point, causing the first display (414; 221) to be controlled to display the second object and the background image at the first view point based on the first depth information stored in the memory (130). Electronic device (101).

8. In any one of paragraphs 1 to 7, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: By confirming the first depth information based on the first artificial intelligence algorithm included in the electronic device (101), causing the first depth information to be confirmed, Electronic device (101).

9. In any one of paragraphs 1 to 8, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: By transmitting information about the first image to the server (108; 400) and receiving the first depth information from the server (108; 400), the first depth information is caused to be verified, Here, the first depth information received from the server (108; 400) is confirmed by the server (108; 400) based on the first artificial intelligence algorithm included in the server (108; 400). Electronic device (101).

10. In any one of paragraphs 1 to 9, The above second image is an image corresponding to the FOV (field of view) at the time of confirming the end of the above editing. Electronic device (101).

11. In any one of paragraphs 1 to 10, The first display (414; 221) is arranged on a first side of the electronic device (101) facing the face of the user when the electronic device (101) is worn on the face of the user, The electronic device (101) further includes a second display (414; 230) arranged on a second side of the electronic device (101) opposite to the first side, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: While displaying the second object on the first display (414; 221), controlling the second display (414; 230) to display an object corresponding to the second object; While displaying the third object on the first display (414; 221), controlling the second display (414; 230) to display an object corresponding to the third object; While displaying the fourth object on the first display (414; 221), causing the second display (414; 230) to be controlled to display an object corresponding to the fourth object. Electronic device (101).

12. In any one of paragraphs 1 to 11, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Based on the first depth information, among the objects included in the first image, an object satisfying a specified criterion is identified as the first object, Based on the first depth information, causing an object included in the first image to be identified as the background object if the object does not satisfy the specified criterion. Electronic device (101).

13. In the operating method of an electronic device (101), An action of selecting a first image based on a first user input selecting a first image, An operation for checking first depth information for objects included in the first image, An operation of identifying a first object and a background object among the objects included in the first image based on the first depth information, An operation of generating a second object by converting the first object into a three-dimensional object based on the first depth information, and displaying a background image corresponding to the background object; An action including displaying a first mark indicating that the second object is a target object based on the first object being identified as an object to which three-dimensional editing is applied. method.

14. In paragraph 13, The operation of checking the first depth information includes an operation of checking the first depth information for the objects included in the first image based on the first artificial intelligence algorithm, The above method, An operation including confirming that the first object is an object to which the 3D editing is applied, based on a second artificial intelligence algorithm. method.

15. In a storage medium storing computer-readable instructions, the instructions, when executed by at least one processor (120) of an electronic device (101), cause the electronic device (101) to perform at least one operation, At least one of the above actions: An action of selecting a first image based on a first user input selecting a first image, An operation for checking first depth information for objects included in the first image, An operation of identifying a first object and a background object among the objects included in the first image based on the first depth information, An operation of generating a second object by converting the first object into a three-dimensional object based on the first depth information, and displaying a background image corresponding to the background object; An action including displaying a first mark indicating that the second object is a target object based on the first object being identified as an object to which three-dimensional editing is applied. Storage medium.

Images