Electronic device supporting content conversion and operation method therefor

Abstract

The present disclosure provides a method of an electronic device. The method may comprise: an operation of generating a first attribute region in which attribute information used for conversion of content is set; an operation of converting first content into second content through an artificial intelligence (AI) model associated with the attribute information using first prompt data included in the attribute information, on the basis of identifying that the first content is moved to the first attribute region; and an operation of storing the second content in the first attribute region.

Description

Electronic device and operation method supporting content conversion

[0001] The present disclosure relates to an electronic device and a method of operation that supports content conversion.

[0002] Artificial intelligence (AI) technology (e.g., generative AI) can support content creation by generating content (e.g., images, text, videos) based on prompts entered by the user. Content management technology (e.g., folder management technology) can help manage content systematically by classifying and organizing it.

[0003] Since these two technologies operate independently of each other, there is a relative lack of functionality that links the two to manage content while simultaneously enabling the natural use of content generated by AI technology.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] According to one embodiment of the present disclosure, an electronic device comprises at least one processor including a processing circuit; and a memory including at least one storage medium for storing instructions, wherein the instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to perform at least one operation. The at least one operation may include an operation of creating an attribute area in which attribute information used for content conversion is set. The at least one operation may include an operation of converting the first content into a second content through an artificial intelligence (AI) model associated with the attribute information using prompt data included in the attribute information, based on identifying that the first content is moved to the attribute area. The at least one operation may include an operation of storing the second content within the attribute area.

[0006] According to one embodiment, a method of operation of an electronic device may be provided. The method of operation of the electronic device may include at least one operation. The at least one operation may include an operation of creating an attribute area in which attribute information used for content conversion is set. The at least one operation may include an operation of converting the first content into a second content through an artificial intelligence (AI) model associated with the attribute information using prompt data included in the attribute information, based on identifying that the first content is moved to the attribute area. The at least one operation may include an operation of storing the second content within the attribute area.

[0007] According to one embodiment, a storage medium may be provided for storing at least one instruction readable by a computer. The at least one instruction may cause the electronic device to perform at least one operation when executed by at least a part of at least one processor of the electronic device. The at least one operation may include an operation of creating an attribute area in which attribute information used for content conversion is set. The at least one operation may include an operation of converting the first content into a second content through an artificial intelligence (AI) model associated with the attribute information using prompt data included in the attribute information, based on identifying that the first content is moved to the attribute area. The at least one operation may include an operation of storing the second content within the attribute area.

[0008] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0009] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.

[0010] FIG. 2a illustrates an example of a perspective view of a wearable device according to one embodiment of the present disclosure.

[0011] FIG. 2b illustrates an example of one or more hardware components disposed within a wearable device according to one embodiment of the present disclosure.

[0012] FIGS. 3a and 3b illustrate an example of the appearance of a wearable device according to one embodiment of the present disclosure.

[0013] FIG. 4 illustrates an example of a block diagram of a wearable device according to one embodiment of the present disclosure.

[0014] FIG. 5 is a drawing for illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.

[0015] FIG. 6 is a diagram illustrating a content processing operation based on an attribute area according to one embodiment of the present disclosure.

[0016] FIG. 7 is a flowchart illustrating the operation of an electronic device converting content based on an attribute area according to one embodiment of the present disclosure.

[0017] FIG. 8 is a drawing illustrating content converted based on an attribute area according to one embodiment of the present disclosure.

[0018] FIG. 9 is a drawing illustrating content converted based on an attribute area according to one embodiment of the present disclosure.

[0019] FIG. 10 is a drawing for explaining the operation of creating an attribute area based on prior content according to one embodiment of the present disclosure.

[0020] FIG. 11 is a drawing illustrating a user interface provided to generate an attribute area based on prior content according to one embodiment of the present disclosure.

[0021] FIG. 12 is a flowchart illustrating the operation of creating an attribute area based on previous content according to one embodiment of the present disclosure.

[0022] FIG. 13 is a diagram illustrating the operation of creating an attribute area based on a user interface according to one embodiment of the present disclosure.

[0023] FIG. 14 is a flowchart illustrating the operation of creating an attribute area based on a user interface according to one embodiment of the present disclosure.

[0024] FIG. 15 is a diagram illustrating the operation of generating an attribute region based on an AI model according to one embodiment of the present disclosure.

[0025] FIG. 16 is a flowchart illustrating the operation of generating an attribute region based on an AI model according to one embodiment of the present disclosure.

[0026] FIG. 17 is a diagram illustrating the operation of an electronic device creating a hierarchical attribute region according to one embodiment of the present disclosure.

[0027] FIG. 18 is a drawing illustrating a hierarchical attribute region according to one embodiment of the present disclosure.

[0028] FIG. 19 is a flowchart illustrating the operation of an electronic device creating a hierarchical attribute region according to one embodiment of the present disclosure.

[0029] FIG. 20 is a flowchart illustrating a content conversion operation through compatibility determination by an electronic device according to one embodiment of the present disclosure.

[0030] FIGS. 21a and FIGS. 21b are drawings for explaining the operation of an electronic device applying attribute information when moving content, according to one embodiment of the present disclosure.

[0031] FIG. 21c is a drawing illustrating content transformed according to the movement of content out of an attribute area, according to one embodiment of the present disclosure.

[0032] FIGS. 22a and FIGS. 22b are drawings for explaining the operation of an electronic device applying attribute information when moving content, according to one embodiment of the present disclosure.

[0033] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0034] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.

[0035] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0036] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0037] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0038] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0039] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0040] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0041] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0042] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0043] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0044] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0045] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0046] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0047] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0048] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0049] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0050] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0051] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a communication module (192) (e.g., cellular communication module, short-range communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0052] The communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0053] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0054] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0055] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface) and exchange signals (e.g., commands or data) with each other.

[0056] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0057] The number of processors (120) may be one or more. For example, the processor (120) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0058] The processor (120) can control the operations of the electronic device (101) by executing instructions stored in the memory (130). For example, the processor (120) may correspond to a plurality of processors that divide and collectively perform a plurality of operations among the processors.

[0059] FIG. 2a illustrates an example of a perspective view of a wearable device according to one embodiment of the present disclosure.

[0060] FIG. 2b illustrates an example of one or more hardware components disposed within a wearable device according to one embodiment of the present disclosure.

[0061] According to one embodiment, the wearable device (103) may have the form of glasses that are wearable on a part of a user's body (e.g., head). The wearable device (103) of FIGS. 2a and 2b may be an example of the electronic device (101) of FIG. 1. The wearable device (103) may include a head-mounted display (HMD). For example, the housing of the wearable device (103) may include a flexible material such as rubber and / or silicone that has a shape that adheres to a part of the user's head (e.g., a part of the face covering both eyes). For example, the housing of the wearable device (103) may include one or more straps that can be twined around the user's head and / or one or more temples that are attachable to the ears of the head.

[0062] Referring to FIG. 2a, a wearable device (103) according to one embodiment may include at least one display (250) and a frame (200) supporting at least one display (250).

[0063] According to one embodiment, the wearable device (103) may be worn on a part of the user's body. The wearable device (103) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the wearable device (103). For example, the wearable device (103) may display a virtual reality image provided by at least one optical device (282, 284) of FIG. 2b on at least one display (250) in response to a specified gesture of the user obtained through a motion recognition camera (or motion tracking camera) (260-2, 260-3) of FIG. 2b.

[0064] According to one embodiment, at least one display (250) can provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at locations corresponding to the user's left eye and right eye, respectively.

[0065] Referring to FIG. 2b, at least one display (250) may provide visual information transmitted from external light to a user through a lens included in at least one display (250) and other visual information distinct from said visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (250) may include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area may be formed on the second surface (232) of at least one display (250). When a user wears the wearable device (103), external light may be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). For example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided by at least one optical device (282, 284) on a real image transmitted through external light in a display area formed on a second surface (232).

[0066] According to one embodiment, at least one display (250) may include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits it to a user. At least one waveguide (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano pattern may be formed on the exterior or at least a portion of the interior of at least one waveguide (233, 234). The nano pattern may be formed based on a polygonal and / or curved grating structure. Light incident on one end of at least one waveguide (233, 234) may be propagated to the other end of at least one waveguide (233, 234) by the nano pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be placed within a wearable device (103) to guide a screen displayed by at least one display (250) to the user's eye. For example, the screen may be transmitted to the user's eye based on total internal reflection (TIR) ​​occurring within at least one waveguide (233, 234).

[0067] According to one embodiment, a wearable device (103) can analyze an object included in a real-world image collected through a shooting camera (260-4), combine a virtual object corresponding to an object among the analyzed objects that is the target of augmented reality provision, and display it on at least one display (250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real-world image. The wearable device (103) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (103) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using a multi-camera and / or time-of-flight (ToF). A user wearing the wearable device (103) can view the image displayed on at least one display (250).

[0068] According to one embodiment, the frame (200) may be formed as a physical structure that allows the wearable device (103) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that when the user wears the wearable device (103), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) so that they are positioned corresponding to the user's left and right eyes.

[0069] Referring to FIG. 2a, the frame (200) may include an area (220) in which at least a portion of the frame contacts a part of the user's body when the user wears the wearable device (103). For example, the area (220) of the frame (200) in contact with a part of the user's body may include an area in contact with a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (103) contacts. According to one embodiment, the frame (200) may include a nose pad (210) that contacts a part of the user's body. When the wearable device (103) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that contact a different part of the user's body distinct from the part of the user's body.

[0070] For example, the frame (200) may include a first rim (201) covering at least a portion of a first display (250-1), a second rim (202) covering at least a portion of a second display (250-2), a bridge (203) positioned between the first rim (201) and the second rim (202), a first pad (211) positioned along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) positioned along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) extending from the first rim (201) and fixed to a portion of the wearer's ear, and a second temple (205) extending from the second rim (202) and fixed to a portion of the ear opposite to the first. The first pad (211) and the second pad (212) may come into contact with a part of the user's nose, and the first temple (204) and the second temple (205) may come into contact with a part of the user's face and a part of the ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through a first hinge unit (206) positioned between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through a second hinge unit (207) positioned between the second rim (202) and the second temple (205). According to one embodiment, a wearable device (103) can identify an external object touching the frame (200) (e.g., a user's fingertip) and / or a gesture performed by said external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of the surface of the frame (200).

[0071] According to one embodiment, the wearable device (103) may include hardware that performs various functions (e.g., hardware to be described later based on the block diagram of FIG. 4). For example, the hardware may include a battery module (270), an antenna module (275), at least one optical device (282, 284), speakers (e.g., speakers (255-1, 255-2)), a microphone (e.g., microphones (265-1, 265-2, 265-3)), a light-emitting module (not shown), and / or a PCB (printed circuit board) (290) (e.g., a printed circuit board). The various hardware may be placed within a frame (200).

[0072] According to one embodiment, a microphone (e.g., microphones (265-1, 265-2, 265-3)) of a wearable device (103) is positioned on at least a portion of a frame (200) to acquire a sound signal. A first microphone (265-1) positioned on a bridge (203), a second microphone (265-2) positioned on a second rim (202), and a third microphone (265-3) positioned on a first rim (201) are shown in FIG. 2b, but the number and position of the microphones (265) are not limited to the embodiment of FIG. 2b. If there are two or more microphones (265) included in the wearable device (103), the wearable device (103) can identify the direction of the sound signal by using a plurality of microphones positioned on different portions of the frame (200).

[0073] According to one embodiment, at least one optical device (282, 284) may project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) may be a projector. At least one optical device (282, 284) may be disposed adjacent to at least one display (250) or included within at least one display (250) as part of at least one display (250). According to one embodiment, a wearable device (103) may include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) positioned at the edge of a first display (250-1) and a second optical device (284) positioned at the edge of a second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) positioned on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) positioned on the second display (250-2).

[0074] According to one embodiment, the camera (260) may include a shooting camera (260-4), an eye tracking camera (ET CAM) (260-1), and / or a motion recognition camera (260-2, 206-3). The shooting camera (260-4), the eye tracking camera (260-1), and the motion recognition camera (260-2, 260-3) may be positioned at different locations on the frame (200) and may perform different functions. The eye tracking camera (260-1) may output data indicating the position of the eyes or the gaze of a user wearing the wearable device (103). For example, the wearable device (103) may detect the gaze from an image containing the user's pupils obtained through the eye tracking camera (260-1). A wearable device (103) can identify an object focused by a user (e.g., a real object, and / or a virtual object) by using the user's gaze obtained through an eye-tracking camera (260-1). Upon identifying the focused object, the wearable device (103) can perform a function for interaction between the user and the focused object (e.g., gaze interaction). The wearable device (103) can represent a portion corresponding to the eyes of an avatar representing the user in a virtual space by using the user's gaze obtained through the eye-tracking camera (260-1). The wearable device (103) can render an image (or screen) displayed on at least one display (250) based on the position of the user's eyes. For example, the visual quality of a first area related to the gaze within the image and the visual quality of a second area distinguished from the first area (e.g., resolution, brightness, saturation, grayscale, or PPI (pixels per inch)) may differ from each other.The wearable device (103) can acquire an image (or screen) having a visual quality of a first area that matches the user's gaze and a visual quality of a second area by using foveated rendering. For example, if the wearable device (103) supports an iris recognition function, user authentication can be performed based on iris information acquired using an eye-tracking camera (260-1). An example in which the eye-tracking camera (260-1) is positioned toward both of the user's eyes is shown in FIG. 2b, but the embodiment is not limited thereto, and the eye-tracking camera (260-1) may be positioned solely toward the user's left eye or right eye.

[0075] According to one embodiment, the camera (260-4) can capture a real image or background to be matched with a virtual image in order to implement augmented reality or mixed reality content. The camera (260-4) can be used to acquire high-resolution images based on HR (high resolution) or PV (photo video). The camera (260-4) can capture an image of a specific object located at the position viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information regarding a real image or background including the image of the specific object acquired using the camera (260-4) and a virtual image provided through at least one optical device (282, 284) are superimposed. The wearable device (103) can compensate for depth information (e.g., the distance between the wearable device (103) and an external object acquired through a depth sensor) using the image acquired through the camera (260-4). The wearable device (103) can perform object recognition through an image acquired using a shooting camera (260-4). The wearable device (103) can perform a function of focusing on an object (or subject) within an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the shooting camera (260-4). The wearable device (103) can perform a pass-through function to superimpose an image acquired through the shooting camera (260-4) onto at least a portion of the screen while displaying a screen representing a virtual space on at least one display (250). The shooting camera (260-4) may be referred to as a high resolution (HR) camera or a photo-video (PV) camera.The shooting camera (260-4) may provide an autofocus (AF) function and an optical image stabilization (OIS) function. The shooting camera (260-4) may include a global shutter (GS) camera and / or a rolling shutter (RS) camera. In one embodiment, the shooting camera (260-4) may be placed on a bridge (203) positioned between the first rim (201) and the second rim (202).

[0076] According to one embodiment, the eye tracking camera (260-1) can achieve more realistic augmented reality by tracking the gaze of a user wearing the wearable device (103), thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the user looks straight ahead, the wearable device (103) can naturally display environmental information related to the user's front at the location where the user is situated on at least one display (250). The eye tracking camera (260-1) may be configured to capture an image of the user's pupil to determine the user's gaze. For example, the eye tracking camera (260-1) may receive a gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the eye tracking camera (260-1) may be positioned at locations corresponding to the user's left and right eyes. For example, the eye-tracking camera (260-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (103) is located.

[0077] According to one embodiment, a motion recognition camera (260-2, 260-3) can provide a specific event to a screen provided on at least one display (250) by recognizing the movement of the user's entire body or part thereof, such as the user's torso, hands, or face. The motion recognition camera (260-2, 260-3) can recognize the user's gesture, acquire a signal corresponding to the gesture, and provide a display corresponding to the signal to at least one display (250). A processor can identify the signal corresponding to the gesture and, based on the identification, perform a designated function. The motion recognition camera (260-2, 260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for a 6-degrees-of-freedom pose (6 DOF pose). A processor can use the motion recognition camera (260-2, 260-3) to perform a gesture recognition function and / or an object tracking function. In one embodiment, a motion recognition camera (260-2, 260-3) may be positioned on the first rim (201) and / or the second rim (202). The motion recognition camera (260-2, 260-3) may include a global shutter (GS) camera (e.g., a global shutter (GS) camera) used for head tracking, hand tracking, and / or spatial recognition based on one of a 3-degree-of-freedom pose or a 6-degree-of-freedom pose. The GS camera may include two or more stereo cameras to track fine movements. As an example, the GS camera may be included in an eye-tracking camera (260-1) for tracking the user's gaze.

[0078] According to one embodiment, the camera (260) included in the wearable device (103) is not limited to the eye-tracking camera (260-1) and motion recognition camera (260-2, 260-3) described above. For example, the wearable device (103) can identify an external object included within the FoV by using a camera positioned toward the user's FoV. The identification of the external object by the wearable device (103) can be performed based on a sensor for identifying the distance between the wearable device (103) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (260) positioned toward the FoV may support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (103) may include a camera (260) (e.g., a face tracking camera) positioned toward the face to acquire an image including the face of a user wearing the wearable device (103).

[0079] According to one embodiment, the battery module (270) can supply power to the electronic components of the wearable device (103). In one embodiment, the battery module (270) may be placed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may each be placed in the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be placed at the end of the first temple (204) and / or the second temple (205).

[0080] According to one embodiment, the antenna module (275) can transmit a signal or power to the outside of the wearable device (103) or receive a signal or power from the outside. In one embodiment, the antenna module (275) may be placed within the first temple (204) and / or the second temple (205). For example, the antenna module (275) may be placed close to one side of the first temple (204) and / or the second temple (205).

[0081] According to one embodiment, the speaker (255) can output an acoustic signal to the outside of the wearable device (103). The acoustic output module may be referred to as the speaker. In one embodiment, the speaker (255) may be placed within a first temple (204) and / or a second temple (205) to be placed adjacent to the ear of a user wearing the wearable device (103). For example, the speaker (255) may include a second speaker (255-2) placed adjacent to the user's left ear by being placed within the first temple (204), and a first speaker (255-1) placed adjacent to the user's right ear by being placed within the second temple (205).

[0082] Referring to FIG. 2b, according to one embodiment, a wearable device (103) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of a first temple (204) or a second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. On the PCB (290), one or more hardware components included in the wearable device (103) (e.g., hardware components illustrated by different blocks in FIG. 4) may be disposed. The wearable device (103) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0083] According to one embodiment, the wearable device (103) may include at least one of a gyroscope sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the wearable device (103) and / or the posture of a body part (e.g., head) of a user wearing the wearable device (103). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyroscope sensor may measure the angular velocity of each of the designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyroscope sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (103) can identify a user's motion and / or gesture performed to execute or stop a specific function of the wearable device (103) based on an IMU.

[0084] FIGS. 3a and 3b illustrate an example of the appearance of a wearable device according to one embodiment of the present disclosure.

[0085] The wearable device (103) of FIGS. 3a and 3b may be an example of the electronic device (101) of FIG. 1. According to one embodiment, an example of the appearance of a first surface (310) of the housing of the wearable device (103) is shown in FIG. 3a, and an example of the appearance of a second surface (320) opposite to the first surface (310) may be shown in FIG. 3b.

[0086] Referring to FIG. 3a, according to one embodiment, a first surface (310) of a wearable device (103) may have a shape that is attachable to a part of a user's body (e.g., the user's face). Although not illustrated, the wearable device (103) may further include a strap for fixing to a part of a user's body and / or one or more temples (e.g., a first temple (204) and / or a second temple (205) of FIG. 2a and FIG. 2b). A first display (250-1) for outputting an image to the left eye among the user's two eyes and a second display (250-2) for outputting an image to the right eye among the two eyes may be disposed on the first surface (310). The wearable device (103) may further include rubber or silicone packing formed on the first surface (310) to prevent interference by light different from light emitted from the first display (250-1) and the second display (250-2) (e.g., ambient light).

[0087] According to one embodiment, the wearable device (103) may include cameras (260-1) for photographing and / or tracking both eyes of a user adjacent to each of the first display (250-1) and the second display (250-2). The cameras (260-1) may be referenced to the eye-tracking camera (260-1) of FIG. 2B. According to one embodiment, the wearable device (103) may include cameras (260-5, 260-6) for photographing and / or recognizing the user's face. The cameras (260-5, 260-6) may be referenced to face tracking (FT) cameras. The wearable device (103) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (260-5, 260-6). For example, the wearable device (103) can change the texture and / or shape of a part of an avatar (e.g., a part of an avatar representing a human face) by using information obtained by cameras (260-5, 260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the wearable device (103).

[0088] Referring to FIG. 3b, on a second surface (320) opposite to the first surface (310) of FIG. 3a, a camera (e.g., cameras (260-7, 260-8, 260-9, 260-10, 260-11, 260-12)), and / or a sensor (e.g., a depth sensor (330)) may be placed to acquire information related to the external environment of the wearable device (103). For example, cameras (260-7, 260-8, 260-9, 260-10) may be placed on the second surface (320) to recognize external objects. The cameras (260-7, 260-8, 260-9, 260-10) may be referenced to the motion recognition cameras (260-2, 260-3) of FIG. 2b.

[0089] For example, using cameras (260-11, 260-12), the wearable device (103) can acquire images and / or videos to be transmitted to each of the user's two eyes. Camera (260-11) may be placed on the second surface (320) of the wearable device (103) to acquire an image to be displayed through a second display (250-2) corresponding to the right eye among the two eyes. Camera (260-12) may be placed on the second surface (320) of the wearable device (103) to acquire an image to be displayed through a first display (250-1) corresponding to the left eye among the two eyes. As an example, the wearable device (103) can acquire a single screen using multiple images acquired through the cameras (260-11, 260-12). The cameras (260-11, 260-12) can be referenced to the shooting camera (260-4) of FIG. 2b.

[0090] According to one embodiment, the wearable device (103) may include a depth sensor (330) disposed on a second surface (320) to identify the distance between the wearable device (103) and an external object. Using the depth sensor (330), the wearable device (103) may obtain spatial information (e.g., a depth map) for at least a portion of the field of view (FoV) of a user wearing the wearable device (103). Although not illustrated, a microphone may be disposed on the second surface (320) of the wearable device (103) to obtain sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0091] FIG. 4 illustrates an example of a block diagram of a wearable device according to one embodiment of the present disclosure.

[0092] Referring to FIG. 4, a wearable device (103) according to one embodiment may include at least one of a processor (410), memory (415), display (420), camera (425), sensor (430), or communication circuit (435). The processor (410), memory (415), display (420), camera (425), sensor (430), and communication circuit (435) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (402). The type and / or number of hardware components included in the wearable device (103) are not limited to those shown in FIG. 4. For example, the wearable device (103) may include only some of the hardware components shown in FIG. 4. The elements within the memory described below (e.g., layers and / or modules) may be in a logically separated state. The elements within the memory (415) may be included in a hardware component distinct from the memory (415). An operation performed by the processor (410) using each of the elements within the memory (415) is one embodiment, and the processor (410) may perform a different operation different from the above operation through at least one of the elements within the memory (415).

[0093] A processor (410) of a wearable device (103) according to one embodiment may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (410) may be one or more. For example, the processor (410) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0094] A memory (415) of a wearable device (103) according to one embodiment may include a hardware component for storing data and / or instructions that are input and / or output to a processor (410). The memory (415) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). Volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). Non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, and embedded multi-media card (eMMC).

[0095] In one embodiment, a display (420) of a wearable device (103) can output visualized information to a user of the wearable device (103). For example, the display (420) can be controlled by a processor (410) including a circuit such as a GPU (graphic processing unit) to output visualized information to a user. The display (420) may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LED may include an organic LED (OLED).

[0096] In one embodiment, the camera (425) of the wearable device (103) may include one or more light sensors (e.g., a CCD (charged coupled device) sensor, a CMOS (complementary metal oxide semiconductor) sensor) that generate an electrical signal indicating the color and / or brightness of light. The plurality of light sensors included in the camera (425) may be arranged in the form of a two-dimensional grid (2 dimensional array). The camera (425) may acquire the electrical signals of each of the plurality of light sensors substantially simultaneously to generate two-dimensional frame data corresponding to the light reaching the light sensors of the two-dimensional grid. For example, photo data captured using the camera (425) may mean one (a) two-dimensional frame data acquired from the camera (425). For example, video data captured using the camera (425) may mean a sequence of multiple two-dimensional frame data acquired from the camera (425) along a frame rate. The camera (425) may further include a flash light for outputting light in the direction in which the camera (425) receives light.

[0097] According to one embodiment, the wearable device (103) may include a plurality of cameras arranged facing different directions as an example of a camera (425). Among the plurality of cameras, the first camera may be referred to as a motion recognition camera (e.g., the motion recognition camera of FIG. 2b (260-2, 260-3) or the cameras of FIG. 3b (260-7, 260-8, 260-9, 260-10)), the second camera may be referred to as an eye-tracking camera (e.g., the eye-tracking camera of FIG. 2b (260-1) or the camera of FIG. 3a (260-1)), and the third camera may be referred to as a shooting camera (e.g., the shooting camera of FIG. 2b (260-4) or the cameras of FIG. 3b (260-11, 260-12)). The wearable device (103) can identify the position, shape, and / or gesture of the hand using an image acquired using a first camera. The wearable device (103) can identify the direction of gaze of the user wearing the wearable device (103) using an image acquired using a second camera. For example, the direction in which the first camera is facing and the direction in which the second camera is facing may be opposite.

[0098] In one embodiment, a recognition camera (e.g., a first camera (260-2, 260-3)) may be used for 3DoF and 6DoF head tracking, hand detection and tracking, and spatial recognition. The first camera (260-2, 260-3) may be utilized for SLAM for 6DoF and for performing spatial recognition functions through depth imaging. Additionally, it may be utilized for performing user gesture recognition and object tracking functions.

[0099] In one embodiment, a gaze tracking camera (e.g., a second camera (260-1)) may be used to track the position and direction of the user's eyes. The wearable device (103) can render a 3D image displayed on a VST (video see through) according to the position of the eyes obtained through the second camera (260-1). The wearable device (103) can perform foveated rendering by using the second camera (260-1) to render only the display area corresponding to the user's gaze, that is, the user's gaze, in high resolution. Based on the iris information obtained by the second camera (260-1), the wearable device (103) can perform user authentication based on iris recognition and perform functions such as account login or payment.

[0100] In one embodiment, a camera for capturing images (e.g., a third camera (260-4)) may be used to preview the real world (the scene being captured) for video see-through (VST) operation. The camera for capturing images may be used to acquire depth information and may be used for object recognition through a 2D image obtained by capturing the screen.

[0101] According to one embodiment, a sensor (430) of a wearable device (103) can generate electrical information that can be processed by a processor (410) and / or memory (415) of the wearable device (103) from non-electronic information associated with the wearable device (103). The information may be referred to as sensor data. The sensor (430) may include a global positioning system (GPS) sensor for detecting the geographic location of the wearable device (103), an image sensor, an illuminance sensor and / or a time-of-flight (ToF) sensor, and an inertial measurement unit (IMU) for detecting physical motion of the wearable device (103).

[0102] In one embodiment, the communication circuit (435) of the wearable device (103) may include hardware components to support the transmission and / or reception of electrical signals between the wearable device (103) and an external electronic device. The communication circuit (435) may include, for example, at least one of a modem, an antenna, and an optic / electronic converter. The communication circuit (435) may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, LAN (local area network), WAN (wide area network), WiFi (wireless fidelity), Bluetooth, BLE (Bluetooth low energy), ZigBee, LTE (long term evolution), 5G NR (new radio) and / or 6G.

[0103] According to one embodiment, within the memory (415) of the wearable device (103), one or more instructions (or commands) representing operations and / or operations to be performed on data by the processor (410) of the wearable device (103) may be stored. A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the wearable device (103) and / or the processor (410) may perform at least one of the operations of FIG. 6 or FIG. 7 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. In the following, the statement that an application is installed in the wearable device (103) may mean that one or more instructions provided in the form of an application are stored in memory (415), and that the one or more applications are stored in an executable format (e.g., a file having an extension specified by the operating system of the wearable device (103)) by the processor (410). For example, the application may include a program and / or library related to a service provided to the user.

[0104] Referring to FIG. 4, programs installed on a wearable device (103) may be classified into any one of different layers based on the target, including an application layer (440), a framework layer (460), and / or a hardware abstraction layer (HAL) (490). For example, within the hardware abstraction layer (490), programs (e.g., modules, or drivers) designed to target the hardware of the wearable device (103) (e.g., a display (420), a camera (420), and / or a sensor (430)) may be classified. The framework layer (460) may be referred to as an XR framework layer in that it contains one or more programs for providing XR (extended reality) services. For example, FIG. 4 illustrates the layers separated within memory (415), but the layers may be logically separated. However, it is not limited thereto. According to an embodiment, the layers may be stored in a designated area within memory (415).

[0105] For example, within the framework layer (460), programs designed to target at least one of the hardware abstraction layer (490) and / or the application layer (440) (e.g., location tracker (481), spatial recognizer (482), gesture tracker (483), and / or eye tracker (484), face tracker (485)) may be classified. Programs classified into the framework layer (460) may provide an application programming interface (API) that is executable based on other programs.

[0106] For example, within the application layer (440), programs designed to target a user controlling a wearable device (103) may be classified. Examples of programs classified into the application layer (440) include an XR (extended reality) system UI (user interface) and / or an XR application (442), but embodiments are not limited thereto. For example, programs classified into the application layer (440) (e.g., software applications) may call an API (application programming interface) to cause the execution of functions supported by programs classified into the framework layer (460).

[0107] For example, the wearable device (103) may display one or more visual objects on the display (420) to perform interaction with a user for using a virtual space based on the execution of the XR system UI (441). A visual object may mean an object that can be deployed on the screen for the transmission of information and / or interaction, such as text, images, icons, videos, buttons, checkboxes, radio buttons, text boxes, sliders, and / or tables. A visual object may be referred to as a visual guide, a virtual object, a visual element, a UI element, a view object, and / or a view element. The wearable device (103) may provide the user with a service to control functions available in the virtual space based on the execution of the XR system UI (441).

[0108] Referring to FIG. 4, a lightweight renderer and / or XR plugin may be included within the XR system UI (441). For example, the XR system UI (441) may cause the execution of functions supported by the lightweight renderer and / or XR plugin included within the application layer (440).

[0109] For example, a wearable device (103) may acquire resources (e.g., APIs, system processes and / or libraries) used to define, create, and / or execute a rendering pipeline that is partially modified, based on the execution of a lightweight renderer. The lightweight renderer may be referred to as a lightweight render pipeline in terms of defining a rendering pipeline that is partially modified. The lightweight renderer may include a renderer built prior to the execution of a software application (e.g., a pre-built renderer). For example, the wearable device (103) may acquire resources (e.g., APIs, system processes and / or libraries) used to define, create, and / or execute the entire rendering pipeline based on the execution of an XR plugin. The XR plugin may be referred to as an open XR native client in terms of defining (or setting) the entire rendering pipeline.

[0110] For example, the wearable device (103) may display a screen representing at least a portion of a virtual space on the display (420) based on the execution of the XR application (442). The XR plugin included in the XR application (442) may be referenced in the XR plugin of the XR system UI (441). Descriptions of the XR plugin that overlap with descriptions of the XR plugin may be omitted. The wearable device (103) may cause the execution of a screen composition layer (461) based on the execution of the XR application (442).

[0111] According to one embodiment, the wearable device (103) can integrate various spatial elements into a virtual environment based on the execution of a spatialization layer (450). If the spatialization layer (450) is not an immersive application or object with 3D information, it can convert and display the application or object with binocular parallax through a space flinger (451). The space flinger (451) can display the object or application by taking depth information into account and may include a renderer for this purpose. According to one embodiment, the wearable device (103) can provide a virtual space service based on the execution of a screen composition layer (461). For example, the screen composition layer (461) may include a platform (e.g., an Android platform) to support the virtual space service. The wearable device (103) can display on the display the posture of a virtual object representing the user’s posture rendered using data obtained through the sensor (430) based on the execution of the screen composition layer (461). The screen composition layer (461) may be referred to as a composition presentation manager (CPM).

[0112] For example, the screen composition layer (461) may include a runtime service (462). In one example, the runtime service (462) may be referred to as an OpenXR runtime module. A wearable device (103) may be used to provide at least one of a user’s pose prediction function, frame timing function, and / or spatial input function through the wearable device (103) based on the execution of the runtime service (462). In one example, the wearable device (103) may be used to perform rendering for a virtual space service for the user based on the execution of the runtime service (462). For example, an application (e.g., Unity or OpenXR native application) may be implemented based on the execution of the runtime service (462).

[0113] For example, the screen composition layer (461) may include a pass-through library (463). The wearable device (103) may display another screen representing real space acquired through a camera (425) superimposed on at least a portion of the screen while displaying a screen representing virtual space on the display (420) based on the execution of the pass-through library (463).

[0114] For example, the screen composition layer (461) may include a renderer. The wearable device (101) can render a screen to be displayed on a display by compositing virtual layers (or virtual nodes) rendered based on sensor data (e.g., sensing data obtained through a camera (425) or sensor (430)) and pass-through layers (or pass-through nodes) obtained through a pass-through library (463) through the screen composition layer (461) using the renderer. The virtual layers may be referred to as virtual nodes and / or virtual surfaces. The wearable device (101) can render each of the virtual layers or render all of the virtual layers through the screen composition layer (461).

[0115] For example, the screen composition layer (461) may include a compositor (464). The compositor (464) can provide an XR environment to the user by compositing a virtual node rendered based on recognition / tracking data obtained through the input manager (465) with a pass-through node obtained through the pass-through library (463). The compositor (464) may include a renderer.

[0116] For example, the screen configuration layer (461) may include an input manager (465). Based on the execution of the input manager (465), the wearable device (103) may execute one or more programs included in the recognition service layer (480) to identify acquired data (e.g., sensor data). The wearable device (103) may use the acquired data to initiate the execution of at least one of the functions of the wearable device (103).

[0117] For example, the perception abstract layer (470) may be used for data exchange between the screen composition layer (461) and the perception service layer (480). In terms of being used for data exchange between the screen composition layer (461) and the perception service layer (480), the perception abstract layer (470) may be referred to as an interface. As an example, the perception abstract layer (470) may be referred to as OpenPX and / or PPAL (perception platform abstract layer). The perception abstract layer (470) may be used for a perception client and a perception service.

[0118] According to one embodiment, the recognition service layer (480) may include one or more programs for processing data obtained from a sensor (430) (or a camera (425)). The one or more programs may include at least one of a location tracker (481), a spatial recognizer (482), a gesture tracker (483), an eye tracker (484), and / or a face tracker (485). The type and / or number of the one or more programs included in the recognition service layer (480) are not limited to those shown in FIG. 4.

[0119] For example, the wearable device (103) can identify the posture of the wearable device (103) using the sensor (430) based on the operation of the position tracker (481). The wearable device (103) can identify the 6 degrees of freedom pose (6 DOF pose) of the wearable device (103) using data acquired using the camera (425) and the IMU based on the operation of the position tracker (481). The position tracker (481) may be referred to as a head tracking (HeT) module.

[0120] For example, the wearable device (103) may be used to construct the surrounding environment of the wearable device (103) (or the user of the wearable device (103)) into a three-dimensional virtual space based on the execution of the space recognizer (482). The wearable device (103) may reconstruct the surrounding environment of the wearable device (103) in three dimensions using data acquired through the camera (425) based on the execution of the space recognizer (482). The wearable device (103) may identify at least one of a plane, an incline, or a staircase based on the surrounding environment of the wearable device (103) reconstructed in three dimensions based on the execution of the space recognizer (482). The space recognizer (482) may be referred to as a scene understanding (SU) module.

[0121] For example, the wearable device (103) may be used to identify (or recognize) the pose and / or gesture of the user's hand of the wearable device (103) based on the execution of the gesture tracker (483). For example, the wearable device (103) may identify the pose and / or gesture of the user's hand using data acquired from the sensor (430) based on the execution of the gesture tracker (483). For example, the wearable device (103) may identify the pose and / or gesture of the user's hand based on data (or images) acquired using the camera (425) based on the execution of the gesture tracker (473). The gesture tracker (473) may be referred to as a hand tracking (HaT) module and / or a gesture tracking module.

[0122] For example, the wearable device (103) can identify (or track) the movement of the user's eyes of the wearable device (103) based on the execution of the eye tracker (484). For example, the wearable device (103) can identify the movement of the user's eyes using data obtained from at least one sensor based on the execution of the eye tracker (484). For example, the wearable device (103) can identify the movement of the user's eyes based on data obtained using a camera (425) (e.g., the eye tracking camera (260-1) of FIG. 2a and FIG. 2b) and / or an IR LED (infrared light emitting diode) based on the execution of the eye tracker (484). The eye tracker (484) may be referred to as an eye tracking (ET) module and / or a gaze tracking module.

[0123] For example, the recognition service layer (480) of the wearable device (103) may further include a face tracker (485) for tracking the user's face. For example, the wearable device (103) may identify (or track) the movement of the user's face and / or the user's facial expression based on the execution of the face tracker (485). The wearable device (103) may estimate the user's facial expression based on the movement of the user's face based on the execution of the face tracker (485). For example, the wearable device (103) may identify the movement of the user's face and / or the user's facial expression based on data (e.g., an image) acquired using a camera based on the execution of the face tracker (485).

[0124] FIG. 5 is a drawing for illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.

[0125] According to one embodiment, a user query / response interface (510) may receive input (e.g., user input or data acquired or generated by an electronic device (e.g., electronic device (101) of FIG. 1). Data acquired or generated by an electronic device may include, for example, image or video data generated using a processor (e.g., processor (120) of FIG. 1), values ​​received through a sensor (e.g., sensor module (176) of FIG. 1) or sensor hub (e.g., external illumination, angle of the electronic device, temperature of a display (e.g., display module (160) of FIG. 1) or electronic device, display size or expansion / reduction information, captured images from an image sensor). User input may be in the form of natural language, touch coordinates or stylus coordinates acquired through a touch panel or digitizer included in the display, images and / or videos, but is not limited thereto. Additionally, context information may be transmitted along with the transmission of user input. Context information may include various additional information at the time of user input. For example, additional information may include information about the application currently being used by the user or the user's location information. Additionally, user input may be in a mixed form of the aforementioned natural language, images, sounds, and context information. Furthermore, user input may be in a non-natural language form, such as selecting a menu. The user query / response interface (510) may output to the user the results of the generative artificial intelligence system (500) and / or the results of analyzing the input. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user. The user query / response interface (510) may output to the user the results of the generative artificial intelligence system (500). The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user.

[0126] According to one embodiment, the AI ​​framework (540) receives user input and can coordinate and control each component necessary to perform the user's intent based on the user's query.

[0127] According to one embodiment, user input received from a user query / response interface (510) may be transmitted to a prompt design component (541). The prompt design component (541) may be used to generate prompts suitable for inputting user input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (541) may be an AI component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (541) may generate prompts by accessing a knowledge component containing user preference data, a prompt library, and prompt examples based on user input, and transmit the generated prompts to the LLM or LMM.

[0128] According to one embodiment, the API / Plug-in management component (542) can perform the role of communicating with external information when there is a request for additional information when transmitting user input as input to a generative model. The API / Plug-in management component (542) establishes a channel to communicate with the outside of the AI ​​Interface via the API, and can enable access to various data sources (e.g., knowledge repository (520)) through the established channel. Additionally, the API / Plug-in management component (542) can request the application / service component (530) via the API to perform an action that ultimately executes the user input, rather than an intermediate result, in the case where the application or service needs to perform such action. The information obtained from the outside can be used to generate a prompt in the prompt design component (541) along with the user input, or it can be transmitted as input to the generative model.

[0129] According to one embodiment, an output modification component (or refiner component) (543) can fine-tune the output of a generative model. For example, the output modification component (543) can verify whether the content generated through the LLM and / or LMM is irrelevant, contains biased content, or contains harmful content. The output modification component (543) can determine the extent to which the output matches what the user wants and, if additional processing is required, proceed with that process. Additionally, the output modification component (543) can configure and provide hints to the user to avoid unwanted output.

[0130] According to one embodiment, a generative AI model (560) may generally refer to an artificial intelligence neural network that generates new forms of data based on user input information. The generative AI model (560) may include a model that generates images and / or a model that generates language. Models that generate images include, but are not limited to, GANs (generative adversarial networks) and VAEs (variational auto encoders), and examples include diffusion-based generative models that use VAEs and Transformer structures. Models that generate language are models trained to output the most statistically appropriate output value based on input values, and examples include models such as CHAT-GPT 3 and CHAT-GPT 4. There are also LMMs (large multimodal models) that can recognize various forms of data input, such as text, images, and voice, and generate new data corresponding to them.

[0131] According to one embodiment of the present disclosure, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a to 4) may support content management and / or conversion based on an attribute area in which attribute information (e.g., a prompt) used for content conversion is set.

[0132] According to one embodiment, an electronic device (101; 103) can automatically convert and save content based on attribute information set in an attribute area by simply moving content (e.g., a file) to an attribute area. Through this, automated conversion and management of content can be achieved without separate additional commands.

[0133] In the present disclosure, movement into (or into) the attribute area of ​​the content and movement out of the attribute area of ​​the content may be interpreted as a broad concept encompassing all state changes in which the attributes or permissions assigned to the content are changed based on a specific logical boundary, as well as changes in the physical or geographical location of the content.

[0134] According to one embodiment, moving content into an attribute area may include various events in which a logical association is formed between the content and the attribute area. For example, in a file system environment, moving content into an attribute area may include actions such as copying or moving content into a specific directory or folder of the file system, or creating or writing new content within that folder. For example, in a virtual or graphic environment, moving content into an attribute area may include actions such as an object entering a specific coordinate range defined within the virtual space, or being placed on or colliding with a specific graphic layer. For example, in a cloud or network system environment, moving content into an attribute area may include actions such as uploading data to a remote repository, synchronization, or logical linking to a specific group / container and assigning access rights.

[0135] According to one embodiment, moving content out of the attribute area may refer to any state change in which the logical association between the content and the attribute area is dissociated or the content is removed from the functional influence of the area. For example, in a file system environment, moving content out of the attribute area may include changing the file's storage path, disabling attribute matching through renaming, or deleting the content from the folder. For example, in a virtual or graphical environment, moving content out of the attribute area may include moving outside a set virtual boundary, deactivating an object, or excluding a rendering segment within that space. For example, in a cloud or network system environment, moving content out of the attribute area may include unlinking from cloud resources, removing assigned attribute tags, or releasing cloud container occupancy rights.

[0136] According to one embodiment, the electronic device (101;103) can flexibly set attribute regions for automatic content conversion. For example, the electronic device (101;103) can subdivide or expand attributes by setting hierarchical attribute regions. By providing scalability through the support of such a flexible attribute structure, it is possible to respond to various content management and conversion scenarios.

[0137] According to one embodiment, the electronic device (101; 103) can ensure compatibility and stability for the proposed function. For example, the electronic device (101; 103) can evaluate compatibility when creating an attribute area (e.g., a hierarchical attribute area), when changing an attribute area during use, and / or when moving content to an attribute area, and provide restriction, notification, and / or tagging functions for incompatible content. Through this, the stability of data management is maintained, and processing flexibility can be provided by allowing the content to be processed with various options when moving content.

[0138] According to one embodiment, the electronic device (101; 103) can apply the proposed function not only to a file system but also to various systems such as an AR / VR environment and a cloud-based system. For example, the electronic device (101; 103) can create and utilize an attribute area in which attribute information is set in a file system, a virtual environment, or a cloud environment. Through this, support for various content environments is possible.

[0139] According to one embodiment, the electronic device (101; 103) can support content management and conversion through an intuitive UI and an automated process. This allows for the efficient integration of content management and conversion functions and improves the user experience.

[0140] FIG. 6 is a diagram illustrating a content processing operation based on an attribute area according to one embodiment of the present disclosure.

[0141] Referring to FIG. 6, according to one embodiment, in operation 601, an electronic device (e.g., the electronic device (101) of FIG. 1, the server (108) of FIG. 1, or the wearable device (103) of FIG. 2a through 4) may obtain a content move request through a user interface (610). For example, the electronic device may receive user input corresponding to the content move request through the user interface (610) and obtain a content move request based on the user input. The content move request may include, for example, a request to move content (e.g., a file) to an attribute area. The content move request or the user input corresponding to the content move request may be based, for example, drag and drop input, copy and paste input, or share input. Through these intuitive input actions, the content can be easily moved to an attribute area and automatically converted without additional commands or complex settings.

[0142] According to one embodiment, in operation 602, the electronic device may move content into an attribute area (620) in response to a content movement request obtained through a user interface (610). The type of content may be, for example, an image (e.g., a still image or a dynamic image), text, 3D objects, and / or other data (e.g., various digital content such as audio files, metadata, etc.), but is not limited thereto. Text may include, for example, documents, data files, and / or multilingual content, but is not limited thereto. 3D objects may include, for example, stereoscopic content used in a virtual environment, but are not limited thereto. A still image may be two-dimensional (2D) content, such as a photograph or a drawing. A dynamic image may be video content, such as a video. Video may include, for example, video content in a format optimized for a specific platform.

[0143] According to one embodiment, the attribute area (620) may be a space (e.g., systemic space) where content can be stored or moved. For example, the attribute area (620) may be a space or area corresponding to a folder or directory within a file system. A folder within a file system may be a space (e.g., logical space) where digital files can be stored. For example, the attribute area (620) may be a space or area corresponding to the graphic space of an extended reality environment or system. The graphic space of an extended reality environment may be a space where visual content defined in a three-dimensional (3D) and / or four-dimensional (4D) form can be stored. An extended reality environment may include, for example, a virtual reality (VR) environment, an augmented reality (AR) environment, or a mixed reality (MR) environment. For example, the attribute area (620) may be a space or area corresponding to a cloud environment or a storage space (e.g., storage) of a system. Storage space in a cloud environment may be a space capable of storing content on a network. In the present disclosure, the attribute area (620) may be referred to as an attribute space, an attribute storage, or other expressions having an equivalent meaning.

[0144] According to one embodiment, the attribute area (620) may be configured with attribute information used for content conversion. According to one embodiment, the attribute information (e.g., a prompt) may be configured by a user (e.g., user input) when the attribute area (620) is created. The attribute information may be automatically applied to the content for content conversion when the content is moved to the attribute area (620). Through this, the content moved to the attribute area (620) may be automatically converted based on the attribute information without any separate additional commands or complex settings.

[0145] According to one embodiment, the attribute information may include at least one piece of information used for transforming the content moved to the attribute area (620). For example, the attribute information may include prompt data, AI model data, and / or additional metadata. The additional metadata is an optional component and may be included in the attribute information as needed. According to one embodiment, the transformation of the content may be for obtaining content that is at least partially different from the input content based on the attribute information and the input content. For example, the transformation of the content may be to generate new content (e.g., generative content) that is different from the input content using an AI model (e.g., generative AI model (560) of FIG. 5) based on the input content (e.g., original content), or to change at least some configuration or settings of the input content, but is not limited thereto. For example, various processing for obtaining content that is at least partially different from the input content based on the attribute information and the input content may be understood as the transformation of the content.

[0146] According to one embodiment, prompt data may include input values ​​(e.g., prompts) used by an AI model (630) (e.g., the generative AI model (560) of FIG. 5) for transforming content moved to an attribute area (620). For example, if the AI ​​model (630) is a text-based model (e.g., GPT, Stable Diffusion), the prompt data may include natural language inputs (e.g., natural language inputs such as "transform into watercolor style") that the text-based model uses as input values ​​for transforming content. For example, if the AI ​​model (630) is a style transformation model (e.g., StyleGAN, DeepDream), the prompt data may include images and / or specific style parameters that the style transformation model uses as input values ​​for transforming content. For example, if the AI ​​model (630) is a speech synthesis model (e.g., TTS, Voice Cloning), the prompt data may include voice samples and / or tone / emphasis setting values ​​that the speech synthesis model uses as input values ​​for transforming content.

[0147] According to one embodiment, AI model data may include information regarding the type and / or settings (e.g., context window settings, fine-tuning settings, embedding model usage settings, token limit settings) of an AI model (630) used for transforming content moved to an attribute area (620). The type of AI model (630) may be, for example, a text generation model (e.g., GPT), an image generation model (e.g., DALL-E, Stable Diffusion), an audio generation model (e.g., VALL-E), a video generation model (e.g., Sora), a code generation model (e.g., Copilot), or a 3D model generation model (e.g., DreamFusion), but is not limited thereto. According to one embodiment, the AI ​​model (630) to which attribute information (e.g., prompt data) is applied may be identified based on the AI ​​model data. In this way, when the attribute information includes AI model data along with the prompt data, rather than simply including only prompt data, when moving content to the attribute area (620), the electronic device can automatically identify and call an appropriate AI model (630) based on the AI ​​model data. Through this, the automatic conversion of the content can be performed smoothly.

[0148] According to one embodiment, additional metadata may include additional setting values ​​required by the AI ​​model (630). For example, additional metadata may include setting values ​​such as resolution, style intensity, and voice tone.

[0149] According to one embodiment, an electronic device may set attribute information in an attribute area (620) based on content obtained prior to the creation of the attribute area through an AI model (e.g., the AI ​​model (630) of FIG. 6). For example, the electronic device may create an attribute area (620) based on previously converted content and set attribute information (e.g., prompt data) included in said content in the attribute area (620). An example of setting an attribute area (620) based on such previous content through the AI ​​model (630) is described below with reference to FIGS. 10 through 12.

[0150] According to one embodiment, the electronic device may select an AI model associated with an attribute area (620) based on user input and obtain attribute information to be set in the attribute area (620) based on user input. For example, the electronic device may create an empty folder or a new attribute area (620) using a system (e.g., OS) based on user input and set the attribute area (620) by directly specifying a specific prompt associated with a specific AI model (e.g., generative AI). An example of setting the attribute area (620) based on such user input (or user interface) is described below with reference to FIGS. 13 and 14.

[0151] According to one embodiment, an electronic device may select one of a plurality of attribute information included in a list of attribute information provided by an AI model, and set an attribute area (620) based on the selected attribute information. For example, the electronic device may select predefined attribute information from an application associated with an AI model (e.g., generative AI) or make an attribute area (620) to which newly created generative attribute information is applied available for use within the application or in the system. An example of setting an attribute area (620) based on such an AI model is described below with reference to FIGS. 15 and 16.

[0152] According to one embodiment, the electronic device may obtain attribute information set in the attribute area (620) based on identifying that content has been moved into the attribute area (620). Based on the attribute information, the electronic device may obtain an AI model (630) used for the conversion of the content and / or a prompt to be input to the AI ​​model (630).

[0153] According to one embodiment, the electronic device can automatically convert (e.g., generate) content through the AI ​​model (630) using prompt data. For example, in operation 603, the electronic device may transmit a content conversion request to the AI ​​model (630) that includes attribute information and / or data of the content to be converted. In response to the receipt of the content conversion request, the AI ​​model (630) may receive the prompt data and content included in the attribute information as input data and output the converted content (e.g., generated content) as output data. In operation 604, the content converted by the AI ​​model (630) may be transmitted to the attribute area (620) and stored within the attribute area (620).

[0154] According to one embodiment, in operation 605, the electronic device may provide a content conversion result notification through a user interface (610) based on the converted content being stored in an attribute area (620). In operation 606, the user may check the content conversion through the content conversion result notification provided through the user interface (610). Thus, the user may check the content conversion process and / or status through the user interface (610).

[0155] According to one embodiment, the user interface (610), the attribute area (620), and / or the AI ​​model (630) may be included in the same or different electronic devices. For example, the user interface (610), the attribute area (620), and the AI ​​model (630) may be included in the same electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a through 4). For example, the user interface (610) and the attribute area (620) may be included in the electronic device (e.g., the electronic device (101) of FIG. 1), and the AI ​​model may be included in the server (e.g., the server (108) of FIG. 1). For example, the user interface (610) may be included in the first electronic device (e.g., the electronic device (101) of FIG. 1), and the attribute area (620) and AI model (630) may be included in the second electronic device (e.g., the wearable device (103) of FIG. 2a through 4).

[0156] FIG. 7 is a flowchart illustrating the operation of an electronic device converting content based on an attribute area according to one embodiment of the present disclosure.

[0157] FIG. 8 is a drawing illustrating content converted based on an attribute area according to one embodiment of the present disclosure.

[0158] FIG. 9 is a drawing illustrating content converted based on an attribute area according to one embodiment of the present disclosure.

[0159] In the embodiment of FIG. 7, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0160] According to one embodiment, in operation 710, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a through 4) may create an attribute area (e.g., the attribute area (620) of FIG. 6) in which attribute information used for transforming content is set. According to one embodiment, the attribute information may include prompt data, AI model data, and / or additional metadata. For a description of the attribute area and attribute information, refer to the description of FIG. 6.

[0161] According to one embodiment, an electronic device (101; 103) can set attribute information in an attribute area based on content obtained prior to the creation of the attribute area through an AI model (e.g., the AI ​​model (630) of FIG. 6). An example of setting an attribute area based on such prior content is described below with reference to FIGS. 10 to 12.

[0162] According to one embodiment, an electronic device (101; 103) can select an AI model associated with an attribute area based on user input and obtain attribute information to be set in the attribute area based on user input. An example of setting an attribute area based on such user input (or user interface) is described below with reference to FIGS. 13 and 14.

[0163] According to one embodiment, an electronic device (101; 103) may select one attribute information among a plurality of attribute information included in a list of attribute information provided by an AI model, and set an attribute area based on the selected attribute information. An example of setting an attribute area based on such an AI model is described below with reference to FIGS. 15 and 16.

[0164] According to one embodiment, in operation 720, the electronic device (101; 103) can convert the first content (e.g., original content) into a second content using the AI ​​model associated with the attribute information (e.g., the AI ​​model (630) of FIG. 6) by using prompt data included in the attribute information, based on identifying that the first content (e.g., original content) has been moved to an attribute area. Thus, based on the attribute information set in the attribute area, the content moved to the attribute area can be automatically converted without separate additional commands or complex settings.

[0165] According to one embodiment, the movement of the first content to the attribute area can be performed based on inputs such as drag & drop input, copy & paste input, and share input. Through such intuitive inputs, content requiring conversion can be easily moved to the attribute area.

[0166] According to one embodiment, an electronic device (101;103) can identify an AI model to be used for the conversion of a first content based on AI model data included in attribute information. For example, the electronic device (101;103) can identify an AI model to be used for the conversion of the first content by using information regarding the type and / or settings of the AI ​​model included in the AI ​​model data. Thus, when the attribute information includes AI model data together with prompt data, rather than simply including prompt data, the electronic device (101;103) can automatically identify and call an appropriate AI model based on the AI ​​model data when moving content to an attribute area.

[0167] According to one embodiment, the electronic device (101;103) may perform an operation to determine whether compatibility is satisfied for the first content before converting the first content into the second content. For example, the operation to determine whether compatibility is satisfied for the first content may include: an operation for the electronic device (101;103) to identify whether compatibility is satisfied for the first content in response to identifying that the first content is moved to an attribute area; an operation to convert the first content into the second content using an AI model with prompt data if compatibility is satisfied; and / or an operation to perform at least one processing on the first content without conversion to the second content according to a setting associated with the attribute area if compatibility is not satisfied. Through this, appropriate processing can be performed on incompatible content and compatible content. An example of a content conversion operation through the determination of whether compatibility is satisfied is described below with reference to FIG. 20.

[0168] According to one embodiment, in operation 730, the electronic device (101; 103) may store the second content in an attribute area. According to one embodiment, the second content may be stored in the attribute area together with the first content based on the movement method of the first content. For example, if the first content is moved into the attribute area according to the first movement method (e.g., if the first content is moved into the attribute area as original content, such as by drag & drop input), the second content may be stored in the attribute area together with the first content. Alternatively, if the first content is moved into the attribute area according to the second movement method (e.g., if the first content is moved into the attribute area as a copy of the original content, such as by copy & paste input), the original content of the first content may be stored outside the attribute area. Data of the first content stored in this way may be used to restore the original content according to the settings when the second content is moved out of the attribute area. An example of content processing when the second content is moved out of the attribute area is described below with reference to FIGS. 21a to 22b.

[0169] Hereinafter, with reference to FIGS. 8 and 9, content converted based on an attribute area is described by example. In the embodiment of FIG. 8, it is assumed that the attribute area is set to a folder within a file system (e.g., an AI folder), and in the embodiment of FIG. 9, it is assumed that the attribute area is set to a graphic space of a virtual reality system (e.g., a 3D space).

[0170] Referring to FIG. 8, a first attribute area (800) can be created as exemplified in the first part (810) (e.g., the first screen). According to one embodiment, the first attribute area (800) may be an AI folder created within a file system. The creation of the first attribute area (800) can be performed, for example, through operation 610 of FIG. 6.

[0171] According to one embodiment, the first attribute area (800) may be set with first attribute information including first prompt data. According to one embodiment, the first attribute information (e.g., first prompt data) of the first attribute area (800) may be set based on content (801) that has already been converted through an AI model associated with the first attribute area (800). For example, the first prompt data of the first attribute area (800) may include a prompt associated with content (801) that has already been generated through an AI model (e.g., a prompt extracted from the content (801)). The content (801) used to set the first attribute information of the first attribute area (800) may be stored within the first attribute area (800) after the first attribute area (800) is created based on the content (801), as exemplified in the second part (820) (e.g., the second screen). For example, the first prompt data may include a prompt for conversion into caricature-style content. For example, the first prompt data may include prompts such as "characterization, emphasis features, pen, white background".

[0172] According to one embodiment, as illustrated in the second part (820) (e.g., second screen) and the third part (830) (e.g., third screen), at least one first content (e.g., photo images (811 to 814)) moved to the first attribute area (800) can be converted into at least one second content (e.g., caricature images (821 to 824)) through an AI model using first prompt data. For example, if the first prompt data includes prompts such as "characterization, emphasis features, pen, white background," as illustrated in FIG. 8, the first content, a photo image (811), can be converted through an AI model into a second content, a caricature image (821), which is expressed in a style that emphasizes the features of a person ("smith") within the photo image (811) and is drawn with a pen, on a white background. As exemplified in FIG. 8, the remaining images can be converted in the same way. The conversion of the content can be performed, for example, through operation 620 of FIG. 6.

[0173] According to one embodiment, as exemplified in the third part (830), at least one converted second content may be stored in the first attribute area (800). The storage of the converted content may be performed, for example, through operation 630 of FIG. 6.

[0174] Meanwhile, as illustrated in FIG. 8, when multiple first contents are moved together (e.g., simultaneously, at once, in bulk) to the first attribute area (800), the multiple first contents can be converted together using first prompt data having the same attribute. Therefore, by simply moving multiple first contents together, multiple second contents having the same attribute can be generated together and grouped and stored within the first attribute area (800).

[0175] Referring to FIG. 9, a second attribute area (900) may be set within the first screen (910) as exemplified in the first screen (910). According to one embodiment, the second attribute area (900) may be a three-dimensional space set within a virtual reality environment provided by a wearable device (e.g., the wearable device (103) of FIG. 2a through 4). The creation of the second attribute area (900) may be performed, for example, through operation 610 of FIG. 6. According to one embodiment, the first screen (910) may include, but is not limited to, a UI (901) (e.g., a menu bar including a home button) providing at least one menu for controlling the first screen (910) and / or a UI (902) for providing content (e.g., a window where content is displayed), along with a display indicating the second attribute area (900) (e.g., a display indicating the location of the second attribute area (900)).

[0176] According to one embodiment, the second attribute area (900) may be set with second attribute information including second prompt data. For example, the second prompt data may include a prompt for conversion to 3D avatar style content. For example, the second prompt data may include a prompt such as "create 3D avatar".

[0177] According to one embodiment, as illustrated in the second screen (920) and the third screen (930), at least one first content (e.g., a photographic image (911)) moved to the second attribute area (900) can be converted into at least one second content (e.g., a 3D avatar image (921)) through an AI model using second prompt data included in the second attribute information. For example, if the second prompt data includes a prompt such as "create 3D avatar," the first content, the photographic image (911), can be converted into the second content, the 3D avatar image (921), through 3D image processing via the AI ​​model. The conversion of the content can be performed, for example, through operation 620 of FIG. 6.

[0178] According to one embodiment, at least one converted second content may be stored in a second attribute area (900). The storage of the converted content may be performed, for example, through operation 630 of FIG. 6.

[0179] FIG. 10 is a drawing for explaining the operation of creating an attribute area based on prior content according to one embodiment of the present disclosure.

[0180] FIG. 11 is a drawing illustrating a user interface provided to generate an attribute area based on prior content according to one embodiment of the present disclosure.

[0181] FIG. 12 is a flowchart illustrating the operation of creating an attribute area based on previous content according to one embodiment of the present disclosure.

[0182] The embodiments of FIGS. 10 and 11 may be, for example, examples of operation 710 of FIG. 7.

[0183] Referring to FIGS. 10 and 11, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIGS. 2a through 4) can generate an attribute region (1020, 1120) based on at least one prior content (e.g., the content (801) of FIG. 8). The prior content may be content obtained prior to generating the attribute region through an AI model (1010) (e.g., previously converted or generated content). For example, as illustrated in FIGS. 10 and 11, the prior content may be a second content (e.g., generated content A) (C2) generated from a first content (e.g., original content O) (C1) based on prompt data (e.g., prompt A) (P1) corresponding to the conversion attribute (1110) of the AI ​​model (1010) through an AI model (e.g., generative AI model) (1010). In the following, for the convenience of explanation, the second content (C2) is used as an example of the previous content.

[0184] According to one embodiment, the electronic device (101;103) may provide a user interface that provides a function (e.g., a menu option) for creating an attribute area (1020, 1120) associated with the second content (C2) after the second content (C2) is created. For example, as illustrated in FIG. 11, the electronic device (101;103) may display a user interface (e.g., a graphic element corresponding to a menu option) (1130) through a display that includes at least one edit item (1131, 1132) and / or an attribute area creation item (e.g., an AI folder creation item) (1133) for the second content.

[0185] According to one embodiment, at least one edit item (1131, 1132) may include a first edit item (1131) used to copy the second content (C2) and / or a second edit item (1132) used to cut the second content (C2). The first edit item (1131) and the second edit item (1132) may be composed of selectable items (e.g., select buttons). The electronic device (101; 103) may copy or cut the second content (C2) in response to receiving an input (e.g., user input) selecting the first edit item (1131) or the second edit item (1132).

[0186] According to one embodiment, an attribute area creation item (e.g., an AI folder creation item) (1133) may be a selectable item (e.g., a selection button) used to create an attribute area (e.g., an AI folder) (1020, 1120) associated with a second content (C2). An electronic device (101; 103) may perform an operation to create an attribute area (1020, 1120) in response to receiving an input (e.g., user input) selecting the attribute area creation item (1133). According to one embodiment, the operation to create an attribute area (1020, 1120) may include an operation to acquire (e.g., extract) attribute information (e.g., prompt data) used to convert the first content (C1) into the second content (C2) and / or an operation to set the acquired attribute information in the attribute area (1020, 1120) (e.g., apply the extracted prompt data to the AI ​​folder). Through this operation, an attribute area (1020, 1120) with attribute information set can be created.

[0187] According to one embodiment, attribute information (e.g., prompt data) may be extracted from a first content (C1), a second content (C2) and / or an AI model (1010). For example, as illustrated in FIG. 11, when the first content (C1) is converted into a second content (C2) that is expressed in a style such as a pen-drawn caricature on a white background, emphasizing the features of a person within the first content (C1) through the AI ​​model (1010), the electronic device (101; 103) may extract prompts such as "characterization, emphasis features, pen, white background" as prompt data from the second content (C2) and / or the AI ​​model (1010). The extracted prompt data may be set (or applied) to an attribute area (e.g., AI folder) (1020, 1120), as illustrated in FIG. 11.

[0188] According to one embodiment, an electronic device (101; 103) can store a second content (C2) used to create the attribute area (1020, 1120) within the attribute area (1020, 1120) after the attribute area (e.g., AI folder) (1020, 1120) is created.

[0189] Hereinafter, with reference to FIG. 12, the overall flow of the operation to create an attribute area based on previous content is described by example. In the embodiment of FIG. 12, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0190] Referring to FIG. 12, in operation 1210, the electronic device (101; 103) may obtain a request (hereinafter, an attribute area creation request) to create an attribute area (1020, 1120) associated with previous content (e.g., second content) (C2). The attribute area creation request may be obtained in response to receiving an input (e.g., user input) selecting an attribute area creation item (1133) provided through a user interface (1130) associated with previous content (C2), for example.

[0191] In operation 1220, the electronic device (101; 103) can identify whether it is possible to obtain (e.g., extract) attribute information (e.g., prompt data (P1)) associated with previous content (C2). The attribute information associated with previous content (C2) may include, for example, attribute information used to obtain previous content (C2) through an AI model (1010). If it is possible to obtain attribute information associated with previous content (C2), operation 1230 may be performed. If it is not possible to obtain attribute information associated with previous content (C2), operation 1240 may be performed.

[0192] In operation 1230, the electronic device (101; 103) can acquire (e.g., extract) attribute information associated with previous content (C2). In operation 1231, the electronic device (101; 103) can connect the acquired attribute information to an associated AI model (1010). The operation of connecting the acquired attribute information to the AI ​​model (1010) may include, for example, the operation of adding the aforementioned AI model data to the attribute information. The associated AI model (101) may be, for example, an AI model used to acquire previous content (C2). Through this operation 1231, the creation of an attribute area (1020, 1120) in which attribute information is set may be completed. The created attribute area (1020, 1120) may be activated. The electronic device (101; 103) may notify the result of the creation and / or activation of the attribute area (1020, 1120).

[0193] In operation 1240, the electronic device (101; 103) can identify whether input of attribute information (e.g., direct input or manual input) is possible. If input of attribute information is possible, operation 1241 may be performed. If input of attribute information is not possible, operation 1242 may be performed.

[0194] In operation 1241, the electronic device (101; 103) may acquire attribute information based on the input of attribute information (e.g., user input creating attribute information). In response to the acquisition of attribute information, the electronic device may perform operation 1231 to link the acquired attribute information with an associated AI model (1010). In this way, if the attribute information cannot be automatically extracted from previous content (C2), the attribute information may be manually created by the user. In operation 1242, the electronic device (101; 103) may provide a notification indicating that the creation of an attribute area is not supported (notification of non-support for creation of attribute area).

[0195] FIG. 13 is a diagram illustrating the operation of creating an attribute area based on a user interface according to one embodiment of the present disclosure.

[0196] FIG. 14 is a flowchart illustrating the operation of creating an attribute area based on a user interface according to one embodiment of the present disclosure.

[0197] The embodiments of FIGS. 13 to 14 may be, for example, examples of operation 710 of FIG. 7.

[0198] In the embodiment of FIG. 14, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0199] Referring to FIGS. 13 and 14, in operation 1410, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIGS. 2a through 4) may create an empty area. According to one embodiment, the electronic device (101; 103) may create an empty area by creating a folder and / or space at a specified path. According to one embodiment, the electronic device (101; 103) may create an empty area based on an area creation request. According to one embodiment, the area creation request may be obtained based on user input received through a user interface (1310) (e.g., an operating system or an application interface). The operation of creating an empty area may include an operation of setting a storage location for the empty area.

[0200] In operation 1420, the electronic device (101; 103) may receive a request to create an attribute area. The request to create an attribute area may be, for example, a request to convert an empty area into an attribute area (1320). According to one embodiment, the request to create an attribute area may be received based on user input received through a user interface (1310) (e.g., an operating system or an application interface). In response to the receipt of the request to create an attribute area, the electronic device (101; 103) may create an attribute area (1320) or convert an empty area into an attribute area (1320).

[0201] In operation 1430, the electronic device (101;103) can select an AI model (e.g., a generative AI model) (1330) associated with an attribute area (1320). According to one embodiment, after obtaining an attribute area generation request, the electronic device (101;103) can select an AI model (1330) associated with the attribute area (1320) based on user input.

[0202] In operation 1440, the electronic device (101; 103) can obtain attribute information (e.g., prompt data (P1)) to be set in the attribute area (1320). According to one embodiment, the electronic device (101; 103) can obtain attribute information based on user input creating attribute information. As illustrated in FIG. 13, attribute information can be created by a user and applied to the attribute area (1320) and / or a generative AI model (1330).

[0203] In operation 1450, the electronic device (101; 103) can connect the acquired attribute information to the AI ​​model (1330). The operation of connecting the acquired attribute information to the AI ​​model (1330) may include, for example, the operation of adding the aforementioned AI model data to the attribute information. Through operation 1450, the creation of an attribute area (1320) in which attribute information is set may be completed. The created attribute area may be activated. The electronic device (101; 103) may notify the result of the creation and / or activation of the attribute area (1320).

[0204] FIG. 15 is a diagram illustrating the operation of generating an attribute region based on an AI model according to one embodiment of the present disclosure.

[0205] FIG. 16 is a flowchart illustrating the operation of generating an attribute region based on an AI model according to one embodiment of the present disclosure.

[0206] The embodiments of FIGS. 15 to 16 may be, for example, an example of operation 710 of FIG. 7.

[0207] In the embodiment of FIG. 16, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0208] Referring to FIGS. 15 and 16, in operation 1610, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIGS. 2a through 4) can select attribute information (e.g., prompt data (P1)) from a list of attribute information provided by an AI model (e.g., a generative AI model) (1520). According to one embodiment, the electronic device (101; 103) can select attribute information from a list of attribute information provided by the AI ​​model (1520) based on user input received through a user interface (1510).

[0209] In operation 1620, the electronic device (101; 103) can create an attribute region (1530) based on selected attribute information. For example, the electronic device (101; 103) can create an attribute region (1530) with attribute information set by setting the selected attribute information for the attribute region (1530). As illustrated in FIG. 15, the attribute information can be provided by a generative AI model (1520) and applied to the attribute region (1530).

[0210] In operation 1630, the electronic device (101;103) can set the location where the created attribute area (1530) is to be stored. Additionally, the electronic device (101;103) may perform additional detailed settings for the created attribute area (1530) (e.g., settings for handling content when moving out of the attribute area (1530)). Through operation 1630, the creation of the attribute area (1530) with attribute information set can be completed. The created attribute area (1530) can be activated. The electronic device (101;103) can notify the result of the creation and / or activation of the attribute area (1530).

[0211] FIG. 17 is a diagram illustrating the operation of an electronic device creating a hierarchical attribute region according to one embodiment of the present disclosure.

[0212] FIG. 18 is a drawing illustrating a hierarchical attribute region according to one embodiment of the present disclosure.

[0213] FIG. 19 is a flowchart illustrating the operation of an electronic device creating a hierarchical attribute region according to one embodiment of the present disclosure.

[0214] In the embodiment of FIG. 19, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0215] According to one embodiment, the hierarchical structure of attribute regions (or hierarchical attribute regions) can be defined by the relationship between a parent attribute region and a child attribute region. Attribute information in a parent attribute region may always be applied preferentially over attribute information in a child attribute region. For example, attribute information in a parent attribute region (e.g., prompt) may have a higher priority than attribute information in a child attribute region (e.g., prompt). For example, attribute information in a parent attribute region (e.g., prompt) may be applied at a higher rate than attribute information in a child attribute region (e.g., prompt) during content transformation. According to one embodiment, processing actions associated with a child attribute region (e.g., transformation processing actions for content moved to a child attribute region) may be performed based, for example, on a parent attribute region (e.g., attribute information in a parent attribute region). Therefore, when creating a hierarchical attribute region, it is necessary to determine whether compatibility and / or priority between the parent and child attribute regions are satisfied. If compatibility and / or priority between upper and lower attribute areas are not satisfied, a warning needs to be provided to the user, and modifications or adjustments need to be made to at least some parts of the upper and lower attribute areas to ensure compatibility and priority are satisfied. Through the hierarchical attribute areas set in the manner described above, granular content can be generated by expanding additional attribute information, and random content can be generated due to the overlap of various effects.

[0216] Referring to FIGS. 17 through 19, in operation 1910, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIGS. 2a through 4) may enter a first attribute area (1710, 1810). The first attribute area (1710, 1810) may be an already created attribute area. For example, the first attribute area (1710, 1810) may be a top-level attribute area. The attribute information of the first attribute area (1710, 1810) may be set to prompt A (e.g., cartoon style).

[0217] In operation 1920, the electronic device (101; 103) may obtain a request (hereinafter, a request to create a sub-attribute area) for creating a second attribute area (1720, 1730, 1740) which is a sub-attribute area of ​​the first attribute area (1710).

[0218] In operation 1930, the electronic device (101; 103) can set attribute information (e.g., prompt data) in the second attribute area (1720 to 1740, 1820 to 1830). For example, as illustrated in FIGS. 17 and 18, the electronic device (101; 103) can set the prompts of the attribute area (1720, 1820) and the attribute area (1730, 1830), which are sub-attribute areas immediately following the first attribute area (1710), to prompt B (e.g., Oriental painting style) and prompt C (e.g., American comic style), respectively. For example, as illustrated in FIGS. 17 and 18, the electronic device (101; 103) can set the prompt of the sub-attribute area (1740, 1840) of the attribute area (1730, 1830), which is a sub-attribute area of ​​the first attribute area (1710), to prompt D (e.g., graffiti style).

[0219] In operation 1940, the electronic device (101; 103) can identify whether there is no conflict of compatibility and / or priority between the attribute information of the first attribute region (1710, 1810) and the attribute information of the second attribute region (1720 to 1740, 1820 to 1840). If there is no conflict of compatibility and priority, operation 1950 may be performed. If there is a conflict of compatibility or priority, operation 1960 may be performed.

[0220] In operation 1950, the electronic device (101; 103) completes the creation of the second attribute region (1720 to 1740, 1820 to 1840), which is a lower attribute region, and can establish a hierarchical structure between the upper attribute region and the lower attribute region.

[0221] According to one embodiment, when a hierarchical structure between an upper attribute area and a lower attribute area is established, the electronic device (101;103) can obtain attribute information for converting the content based on the location where the content has been moved (e.g., attribute area). For example, when the original content (C0) is moved to an attribute area (1710, 1810) which is the top attribute area, the electronic device (101;103) can obtain a prompt A (e.g., cartoon style) as a prompt to be applied for content conversion and generate a first content (C1) to which the prompt A is applied. For example, when the original content (C0) is moved to the attribute area (1720, 1820) or attribute area (1730, 1830), which is the sub-attribute area immediately following the attribute area (1710, 1810), the electronic device (101; 103) obtains a first combination prompt (prompt A+B) (e.g., cartoon style + Oriental painting style) in which prompt A and prompt B are combined, or a second combination prompt (prompt A+B) (e.g., cartoon style + American comic style) in which prompt A and prompt C are combined, as the prompt to be applied for content conversion, and can generate a second content (C2) in which the first combination prompt is applied, or a third content (C3) in which the second combination prompt is applied, respectively. For example, when the original content (C0) is moved to an attribute area (1740, 1840) which is a sub-attribute area of ​​an attribute area (1730, 1830), the electronic device (101; 103) obtains a third combination prompt (prompt A+B+C) (e.g., cartoon style + American comic style + graffiti style) which is a combination of prompt A, prompt C and prompt D, as a prompt to be applied for content conversion, and can generate a fourth content (C4) to which the third combination prompt is applied. According to one embodiment, when combination attribute information (e.g., combination prompt) is obtained by combining attribute information of a higher attribute area and attribute information of a lower attribute area, information regarding priority may be included or applied to the combination attribute information.Through this, attribute information from the upper attribute area can be applied with a higher priority than attribute information from the lower attribute area when transforming content.

[0222] According to one embodiment, after the hierarchical structure between the upper attribute area and the lower attribute area is determined, at least one of the upper attribute area and the lower attribute area may be changed. For example, after the hierarchical attribute area is established, at least a portion of the attribute information of the upper attribute area may be changed or attribute information may be added. In this case, the change and / or addition of the attribute information of the upper attribute area may be reflected in the attribute information of the lower attribute area. For example, when the attribute information of the upper attribute area is deleted, the attribute information of the lower attribute area may also be deleted immediately. For example, after the hierarchical attribute area is established, at least a portion of the attribute information of the lower attribute area may be changed or attribute information may be added. Such change and / or addition of the lower attribute area may be possible within the scope of maintaining the basic attributes of the attribute information of the upper attribute area.

[0223] In operation 1960, the electronic device (101;103) may warn of a conflict of compatibility and / or priority and provide a notification of the reason for the conflict. After operation 1960 is performed, the electronic device (101;103) may perform operation 1930 again.

[0224] FIG. 20 is a flowchart illustrating a content conversion operation through compatibility determination by an electronic device according to one embodiment of the present disclosure.

[0225] The embodiment of FIG. 20 may be an example of the embodiment of FIG. 7. In the embodiment of FIG. 20, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0226] Referring to FIG. 20, in operation 2010, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a through 4) can identify that the first content moves into an attribute area. In operation 2020, based on identifying that the first content moves into an attribute area, the electronic device (101; 103) can obtain format information of the first content and attribute information of the attribute area.

[0227] In operation 2030, the electronic device (101; 103) can identify whether the format information (e.g., file format) of the first content satisfies compatibility with the attribute information of the attribute area. If compatibility is satisfied, operation 2040 may be performed. If compatibility is not satisfied, operation 2050 may be performed.

[0228] In operation 2040, the electronic device (101; 103) can convert the first content into the second content based on the attribute information and using an AI model associated with the attribute information based on the attribute information, based on the compatibility being satisfied. In operation 2041, the electronic device (101; 103) can store the second content in an attribute area.

[0229] In operation 2050, the electronic device (101;103) may perform at least one processing operation on the first content according to the setting of the attribute area and / or system policy. Through this, appropriate processing of the content that does not satisfy compatibility may be performed. For example, the electronic device (101;103) may perform an operation to restrict movement to the attribute area of ​​the first content and / or an operation to provide a warning indicating that movement is not possible in response to the identification that compatibility is not satisfied. For example, the electronic device (101;103) may perform an operation to allow movement to the attribute area of ​​the first content but to maintain the first content without converting it into the second content in response to the identification that compatibility is not satisfied. For example, the electronic device (101;103) may perform an operation to allow movement to the attribute area of ​​the first content and attempt to convert the first content into the second content in response to the identification that compatibility is not satisfied. If the conversion fails despite an attempt at conversion, the electronic device (101;103) may be treated as a conversion failure state. In this case, the electronic device (101;103) may provide information indicating the conversion failure.

[0230] According to one embodiment, the electronic device (101; 103) may provide a notification indicating the status and / or result of the content conversion. The original content, the first content, may always be managed in a restoreable state regardless of the content conversion.

[0231] Through the aforementioned operation, content conversion and compatibility are managed simultaneously, thereby providing a stable and flexible content creation environment.

[0232] FIGS. 21a and FIGS. 21b are drawings for explaining the operation of an electronic device applying attribute information when moving content, according to one embodiment of the present disclosure.

[0233] FIG. 21c is a drawing illustrating content transformed according to the movement of content out of an attribute area, according to one embodiment of the present disclosure.

[0234] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a through 4) can convert the first content (e.g., original content) (C0) into a second content (C1) based on attribute information (e.g., attribute A, prompt A) set in the first attribute area (2110) based on identifying that the first content (e.g., original content) (C0) is moved into the first attribute area (2110). The second content (C1) thus converted can be stored within the first attribute area (2110).

[0235] According to one embodiment, the electronic device (101;103) can perform processing on a second content (C1) that is moved out of a first attribute area (2110) according to a movement setting for an attribute area. The movement setting for the attribute area can be pre-set through a user interface.

[0236] According to one embodiment, as illustrated in FIG. 21a, an electronic device (101; 103) can restore a first content (C0) from a second content (C1) based on identifying that the second content (C1) has been moved out of a first attribute area (2110). For example, the electronic device (101; 103) can restore a first content (C0) from a second content (C1) using data of the first content (C0) stored within the first attribute area (2110) or the first content (C0) stored outside the first attribute area (2110), based on identifying that the second content (C1) has been moved out of a first attribute area (2210). Through this, the content moved out of the attribute area can be restored to its original state. For example, as illustrated in FIG. 21c, when one of the second contents (Ce1) to which the caricature attribute is applied and which is used in an app or system by creating an attribute area based on a predefined attribute within a generative AI model, is moved out of the first attribute area (2110), it can be converted into the first content (Ce0) corresponding to the original photo image.

[0237] According to one embodiment, as illustrated in FIG. 21b, an electronic device (101; 103) restores the second content (C1) to the first content (C0) while the second content (C1) is moved from the first attribute area (2110) to the second attribute area (2120), restores the first content (C0) from the second content (C1) based on identifying that the restored first content (C0) is moved to the second attribute area (2120), and creates an attribute area based on a predefined attribute within the restored first generative AI model based on attribute information set in the second attribute area (2120) (e.g., attribute B, prompt B), and can convert the content (C0) into a third content (C2). Through this, when moving the attribute area, the second content (C1) with attribute A applied can be converted into the original content, the first content (C0), and then converted into the third content (C2) with attribute B applied.

[0238] FIGS. 22a and FIGS. 22b are drawings for explaining the operation of an electronic device applying attribute information when moving content, according to one embodiment of the present disclosure.

[0239] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a through 4) can convert the first content (e.g., original content) (C0) into a second content (C1) based on attribute information (e.g., attribute A, prompt A) set in the first attribute area (2210) based on identifying that the first content (e.g., original content) (C0) is moved into the first attribute area (2210). The second content (C1) thus converted can be stored within the first attribute area (2210).

[0240] According to one embodiment, the electronic device (101;103) can perform processing on a second content (C1) that is moved out of a first attribute area (2210) according to a movement setting for an attribute area. The movement setting for the attribute area can be pre-set through a user interface.

[0241] According to one embodiment, as illustrated in FIG. 22a, the electronic device (101; 103) can retain the second content (C1) even though it identifies that the second content (C1) has been moved out of the first attribute area (2210). This allows the content moved out of the attribute area to be retained in a converted state.

[0242] According to one embodiment, as illustrated in FIG. 22b, an electronic device (101; 103) maintains the second content (C1) without restoring it to the first content (C0) while the second content (C1) is moved from the first attribute area (2210) to the second attribute area (2220), and can convert the second content (C1) into a third content (C2) based on attribute information (e.g., attribute B, prompt B) set in the second attribute area (2220) based on identifying that the second content (C1) is moved to the second attribute area (2220). Through this, when moving the attribute area, the second content (C1) to which attribute A is applied can be converted into a third content (C2) to which attribute A and attribute B are applied, without being converted back to the original content, the first content (C0).

[0243] According to one embodiment of the present disclosure, an electronic device (e.g., the electronic device (101) of FIG. 1 or the wearable device (103) of FIG. 2a to 4) may support content management and conversion based on an attribute area in which attribute information (e.g., a prompt) used for content conversion is set.

[0244] According to one embodiment, an electronic device (101; 103) can automatically convert and save content based on attribute information set in an attribute area by simply moving content (e.g., a file) to an attribute area. Through this, automated conversion and management of content can be achieved without separate additional commands.

[0245] According to one embodiment, the electronic device (101;103) can flexibly set attribute regions. For example, the electronic device (101;103) can subdivide or expand attributes by setting hierarchical attribute regions. By providing scalability through the support of such a flexible attribute structure, it is possible to respond to various content management and conversion scenarios.

[0246] According to one embodiment, the electronic device (101; 103) can ensure compatibility and stability for the proposed function. For example, the electronic device (101; 103) can evaluate compatibility when creating an attribute area (e.g., a hierarchical attribute area), when changing an attribute area during use, and / or when moving content to an attribute area, and provide restriction, notification, and / or tagging functions for incompatible content. Through this, the stability of data management is maintained, and processing flexibility can be provided by allowing the content to be processed with various options when moving content.

[0247] According to one embodiment, the electronic device (101; 103) can apply the proposed function not only to a file system but also to various systems such as an AR / VR environment and a cloud-based system. For example, the electronic device (101; 103) can create and utilize an attribute area in which attribute information is set in a file system, a virtual environment, or a cloud environment. Through this, support for various content environments is possible.

[0248] According to one embodiment, the electronic device (101; 103) can support content management and conversion through an intuitive UI and an automated process. This allows for the efficient integration of content management and conversion functions and improves the user experience.

[0249] According to one embodiment of the present disclosure, an electronic device may include at least one processor comprising a processing circuit; and a memory comprising at least one storage medium for storing instructions.

[0250] According to one embodiment, an electronic device may create a first attribute area in which attribute information used for converting content is set. Based on identifying that the first content is moved to the first attribute area, the electronic device may convert the first content into a second content through an artificial intelligence (AI) model associated with the attribute information using first prompt data included in the attribute information. The electronic device may store the second content within the first attribute area.

[0251] According to one embodiment, the attribute information includes the AI ​​model data, and the AI ​​model data may include information on at least one of the type or attribute of the AI ​​model. An electronic device can identify the AI ​​model using the AI ​​model data.

[0252] According to one embodiment, the electronic device may generate a second attribute region which is a sub-attribute region of the first attribute region, and, based on identifying that the first content is moved to the second attribute region, convert the first content into a third content through the AI ​​model using the first prompt data and the second prompt data of the second attribute region. The prompt data may have a higher priority than the second prompt data.

[0253] According to one embodiment, the electronic device can set the attribute information in the first attribute area based on content obtained before the first attribute area is generated through the AI ​​model.

[0254] According to one embodiment, the electronic device can select an AI model associated with the first attribute region based on user input and obtain attribute information to be set in the first attribute region based on user input.

[0255] According to one embodiment, the electronic device can select attribute information among a plurality of attribute information included in a list of attribute information provided in the AI ​​model, and set the first attribute area based on the selected attribute information.

[0256] According to one embodiment, the operation of converting the first content into the second content may include: an operation of identifying whether compatibility for the first content is satisfied in response to identifying that the first content is moved to the first attribute area; an operation of converting the first content into the second content through the AI ​​model using the prompt data if the compatibility for the first content is satisfied; and an operation of performing at least one processing on the first content without converting it into the second content according to a setting associated with the attribute area if the compatibility for the first content is not satisfied.

[0257] According to one embodiment, the storing operation may include storing the first content together with the second content within the first attribute area based on the movement method of the first content.

[0258] According to one embodiment, the electronic device may cause the second content to be restored to the first content based on identifying that the second content has been moved out of the first attribute area.

[0259] According to one embodiment, based on identifying that the second content is moved to a third attribute area different from the first attribute area, the electronic device can convert the second content into a fourth content through an AI model associated with the third attribute information using the first prompt data and the third prompt data included in the third attribute information set in the third attribute area.

[0260] According to one embodiment, the first attribute area may correspond to a folder in a file system, a graphic space in a virtual environment, or a storage space in a cloud system.

[0261] The embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" each may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0262] The term “module” as used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0263] One embodiment of the present document may be implemented as software (e.g., program (140) of FIG. 1) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) of FIG. 1 or external memory (138) of FIG. 1) that is readable by a machine (e.g., electronic device (101) of FIG. 1). For example, a processor (e.g., processor (120) of FIG. 1) of the machine (e.g., electronic device (101) of FIG. 1) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0264] According to one embodiment, the method according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0265] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, At least one processor including a processing circuit; and The electronic device comprises a memory including at least one storage medium for storing instructions, wherein the instructions, when executed individually or collectively by the at least one processor, cause: Create a first attribute area in which attribute information used for content transformation is set, and Based on identifying that the first content is moved to the first attribute area, the first content is converted into second content through an artificial intelligence (AI) model associated with the attribute information using the first prompt data included in the attribute information, and An electronic device that causes the above-mentioned second content to be stored within the above-mentioned first attribute area.

2. In Paragraph 1, The above attribute information includes the AI ​​model data, and the AI ​​model data includes information on at least one of the type or attribute of the AI ​​model. An electronic device in which the above instructions, when executed individually or collectively by the at least one processor, cause the electronic device to identify the AI ​​model using the AI ​​model data.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: A second attribute area, which is a sub-attribute area of ​​the first attribute area, is created, and An electronic device that, based on identifying that the first content is moved to the second attribute area, causes the first content to be converted into third content through the AI ​​model using the first prompt data and the second prompt data of the second attribute area, wherein the first prompt data has a higher priority than the second prompt data.

4. In any one of paragraphs 1 through 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the attribute information to be set in the first attribute area based on content obtained prior to the creation of the first attribute area through the AI ​​model.

5. In any one of paragraphs 1 through 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Select the attribute information from among the multiple attribute information included in the list of attribute information provided by the above AI model, and An electronic device that causes the first attribute area to be set based on the above-mentioned selected attribute information.

6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: In response to identifying that the first content is moved to the attribute area, identifying whether compatibility for the first content is satisfied, and If the compatibility with the first content is satisfied, the first content is converted into the second content through the AI ​​model using the prompt data, and An electronic device that causes at least one processing of the first content to be performed without conversion to the second content according to a setting associated with the first attribute area when the compatibility with the first content is not satisfied.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the first content to be stored together with the second content within the first attribute area based on the movement method of the first content.

8. In any one of paragraphs 1 through 8, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the second content to be restored to the first content based on identifying that the second content has been moved out of the first attribute area.

9. In any one of paragraphs 1 through 8, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the second content to be converted into a fourth content through an AI model associated with the third attribute information, using the first prompt data and the third prompt data included in the third attribute information set in the third attribute area, based on identifying that the second content is moved to a third attribute area different from the first attribute area.

10. In any one of paragraphs 1 through 9, The above-mentioned first attribute area corresponds to a folder within a file system, corresponds to a graphic space in a virtual environment, or corresponds to a storage space within a cloud system, an electronic device.

11. In a method of an electronic device, An action of creating a first attribute area in which attribute information used for content transformation is set; Based on identifying that the first content is moved to the first attribute area, an operation of converting the first content into second content through an artificial intelligence (AI) model associated with the attribute information using first prompt data included in the attribute information; and A method comprising the operation of storing the second content within the first attribute area.

12. In Paragraph 11, The above attribute information includes the AI ​​model data, and the AI ​​model data includes information on at least one of the type or attribute of the AI ​​model. The above method includes an operation of identifying the AI ​​model using the AI ​​model data.

13. In Paragraph 11, The above method is: The operation of creating a second attribute area, which is a sub-attribute area of ​​the first attribute area; Based on identifying that the first content is moved to the second attribute area, the method includes an operation of converting the first content into third content through the AI ​​model using the first prompt data and the second prompt data of the second attribute area. A method in which the first prompt data has a higher priority than the second prompt data.

14. In any one of paragraphs 11 through 13, The above method is: A method comprising the operation of setting attribute information in the first attribute area based on content obtained prior to the creation of the first attribute area through the AI ​​model.

15. In any one of paragraphs 11 through 13, The above method is: The operation of selecting one attribute information among a plurality of attribute information included in the list of attribute information provided by the AI ​​model above; and A method comprising the operation of setting the first attribute area based on the selected attribute information.

Images