Electronic device for displaying change of virtual object and method thereof

Abstract

At least one processor of a wearable device according to an embodiment may display a virtual space on a display based on receiving an input for entering the virtual space. The at least one processor may display a first avatar having a first appearance and being a current representation of a user in the virtual space. The at least one processor may display a visual object of a second avatar in the virtual space with the first avatar, the second avatar having a second appearance different from the first appearance of the first avatar and being a previous representation of the user. For example, such meta-universe service may be provided over a 5th-Generation (5G) and / or 6th-Generation (6G) based network.

Description

Technical Field

[0001] The present disclosure relates to an electronic device for displaying modification of a virtual object and a method thereof. Background Art

[0002] In order to provide an enhanced user experience, electronic devices that provide augmented reality (AR) services that display information generated by a computer in association with external objects in the real world are being developed. The electronic device may be a wearable device worn by a user. For example, the electronic device may be AR glasses and / or a head mounted device (HMD). Summary of the invention

[0003] Technical Solution According to an embodiment, a wearable device may include a display, a processor, and a memory storing instructions. The instructions, when executed by the processor, may cause the wearable device to display the virtual space on the display based on receiving an input for entering the virtual space. The instructions, when executed by the processor, may cause the wearable device to display a first avatar that is a current representation of a user and has a first appearance within the virtual space. The instructions, when executed by the processor, may cause the wearable device to display the first avatar within the virtual space together with a visual object of a second avatar, the second avatar being a previous representation of the user and having a second appearance different from the first appearance of the first avatar.

[0004] According to an embodiment, a non-transitory computer-readable medium may be configured to store instructions. The instructions may be configured to, when executed by at least one processor of a wearable device, cause the at least one processor to display the virtual space on a display of the wearable device based on receiving an input for entering the virtual space. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display a first avatar that is a current representation of a user and has a first appearance within the virtual space. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display the first avatar within the virtual space together with a visual object of a second avatar, the second avatar being a previous representation of the user and having a second appearance different from the first appearance of the first avatar.

[0005] According to an embodiment, a method of a wearable device including a display, a memory, and a processor is provided. The method may include displaying the virtual space on the display based on receiving an input for entering the virtual space. The method may include displaying a first avatar that is a current representation of a user and has a first appearance within the virtual space. The method may include displaying the first avatar within the virtual space along with a visual object of a second avatar, the second avatar being a previous representation of the user and having a second appearance different from the first appearance of the first avatar.

[0006] According to an embodiment, a wearable device may include a display, a memory for storing instructions, and at least one processor for executing instructions. The at least one processor may be configured to receive information from an external electronic device associated with an avatar located in the virtual space based on an input indicating that a virtual space is to be entered. The at least one processor may be configured to display at least a portion of the virtual space including the avatar in a first appearance based on receiving the information. The at least one processor may be configured to display a visual object representing the avatar in a second appearance together with the avatar based on information further including the avatar in a second appearance displayed by the wearable device before receiving the input.

[0007] According to an embodiment, a non-transitory computer-readable medium may be configured to store instructions. The instructions may be configured to, when executed by at least one processor of a wearable device, cause the at least one processor to receive information from an external electronic device associated with an avatar located in the virtual space based on an input indicating that a virtual space is to be entered. The instructions may be configured to, when executed by at least one processor of a wearable device, cause the at least one processor to display at least a portion of the virtual space including the avatar of a first appearance based on receiving the information. The instructions may be configured to, when executed by at least one processor of a wearable device, cause the at least one processor to display a visual object representing the avatar of a second appearance together with the avatar based on information further including the avatar of a second appearance displayed by the wearable device before receiving the input.

[0008] According to an embodiment, a method of an electronic device may include identifying information of an avatar within the virtual space based on a request of a wearable device to enter the virtual space. The method may include sending information including the avatar of the first appearance and a history of the avatar being modified from the second appearance to the first appearance to the wearable device based on the information identifying the avatar of the first appearance and the avatar being different from the avatar of the second appearance displayed by the wearable device before the request. The method may include sending information including the avatar of the first appearance without the history to the wearable device based on the information identifying the avatar of the first appearance and the avatar being the same as the avatar of the second appearance.

[0009] According to an embodiment, the electronic device may include a display, a communication circuit system, and a processor. The processor may be configured to display a first visual object representing a user in the display based on information received from an external electronic device connected through the communication circuit system. The processor may be configured to identify a number of times the first visual object has been displayed by the display based on the information. The processor may be configured to display a second visual object representing the user before the first visual object in the display together with the first visual object based on identifying that the number of times is less than a preset number.

[0010] According to an embodiment, a method of an electronic device may include displaying a first visual object representing a user in a display of the electronic device based on information received from an external electronic device connected through a communication circuit system of the electronic device. The method may include identifying a number of times the first visual object has been displayed by the display based on the information. The method may include displaying a second visual object representing the user in the display together with the first visual object before the first visual object based on identifying that the number of times is less than a preset number.

[0011] According to an embodiment, an electronic device may include a display, a communication circuit system, and a processor. The processor may be configured to display a first visual object representing a second user and included in a virtual space to a first user of the electronic device through the display. The processor may be configured to obtain information indicating that a visual object has been viewed by the first user from an external electronic device through the communication circuit system. The processor may be configured to display the second visual object together with the first visual object displayed to the first user based on identifying a second visual object different from the first visual object from the information.

[0012] According to an embodiment, a method of an electronic device may include displaying a first visual object representing a second user and included in a virtual space to a first user of the electronic device. The method may include obtaining information indicating that a visual object has been viewed by the first user from an external electronic device. The method may include displaying the second visual object together with the first visual object displayed to the first user based on identifying a second visual object different from the first visual object from the information. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 An example of a user interface (UI) displayed by an electronic device based on information obtained from an external electronic device according to an embodiment is illustrated.

[0014] Figure 2 is a block diagram of an electronic device according to an embodiment.

[0015] Figure 3 An example of an operation in which an electronic device displays at least a portion of a virtual space according to an embodiment is shown.

[0016] Figure 4a , Figure 4b and Figure 4c An example of an operation in which an electronic device displays a visual object representing a virtual object according to an embodiment is shown.

[0017] Figure 5a and Figure 5b An example of an operation of the electronic device displaying a visual object based on a modification history of a virtual object according to an embodiment is shown.

[0018] Figure 6 An operation example of an electronic device recognizing an input with respect to a visual object corresponding to a virtual object according to an embodiment is shown.

[0019] Figure 7 An example of a signal flow chart between an electronic device and an external electronic device according to an embodiment is shown.

[0020] Figure 8 An example of a flow chart of an electronic device according to an embodiment is shown.

[0021] Fig. 9 An example of a flow chart of an electronic device according to an embodiment is shown.

[0022] Fig.10 This is an example diagram of a first embodiment environment for providing a metaverse service through a server.

[0023] Fig.11 is an exemplary diagram of a second embodiment environment for providing a Metaverse service through a direct connection between a user terminal and a second terminal. DETAILED DESCRIPTION

[0024] Hereinafter, various embodiments of this document will be described with reference to the accompanying drawings.

[0025] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or replacement forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one (kind) of A and B", "at least one (kind) of A or B", "A, B or C", "at least one (kind) of A, B and C" and "at least one (kind) of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with” another element (e.g., a second element), “coupled to” another element (e.g., a second element), “connected with” another element (e.g., a second element), or “connected to” another element (e.g., a second element), with or without the terms “operably” or “communicatively” being used, it means that the element may be coupled to the other element directly (e.g., by wire), wirelessly, or via a third element.

[0026] As used in conjunction with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuitry"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0027] Figure 1 An example of a user interface (UI) displayed by an electronic device based on information obtained from an external electronic device according to an embodiment is illustrated. Figure 1 is a diagram showing a plurality of electronic devices connected to each other based on a network. Figure 1, shows an exemplary situation where the first electronic device 101-1, the second electronic device 101-2, and the third electronic device 120 are connected to each other based on a wired network and / or a wireless network. Figure 2 Description included in Figure 1 Hardware components in multiple electronic devices.

[0028] Wired networks may include networks such as the Internet, a local area network (LAN), a wide area network (WAN), Ethernet, or a combination thereof. Wireless networks may include networks such as Long Term Evolution (LTE), 5G New Radio (New Radio), Wireless Fidelity (Wi-Fi), Zigbee, Near Field Communication (NFC), Bluetooth, Bluetooth Low Energy (BLE), or a combination thereof. Although Figure 1 The multiple electronic devices in FIG. 1 are shown as being directly connected, but the multiple electronic devices may be indirectly connected through one or more intermediate nodes (eg, routers and / or access points).

[0029] refer to Figure 1 , the first electronic device 101-1 and the second electronic device 101-2 may be terminals owned by users (e.g., user 110 including first user 110-1 and second user 110-2, respectively). For example, the terminal may include a personal computer (PC) such as a laptop computer and a desktop computer, a smart phone, a smart board, and / or a tablet PC. The terminal may include a smart accessory such as a smart watch and / or a head mounted device (HMD). Reference Figure 1 , an exemplary form of a first electronic device 101-1 and a second electronic device 101-2 having an HMD form factor is shown, but the embodiment is not limited thereto. Hereinafter, a terminal including the first electronic device 101-1 and the second electronic device 101-2 may be referred to as an electronic device 101. A user 110 of the electronic device 101 may be a subscriber to a service provided by a third electronic device 120.

[0030] refer to Figure 1 , the third electronic device 120 may include a server of a service provider. The server may include one or more PCs and / or workstations. In an embodiment, the service provider may operate a video conference and / or metaverse service as a service to enhance interconnectivity between subscribers. Hereinafter, from the perspective of being distinguished from the electronic device 101 as a user's terminal, the third electronic device 120 may be referred to as an external electronic device 120.

[0031] According to an embodiment, the electronic device 101 may provide a user experience to the user 110 of the electronic device 101 based on the virtual space 140. The electronic device 101 may communicate with the external electronic device 120 to obtain information about the virtual space 140. Although an embodiment in which the electronic device 101 visualizes at least a portion of the virtual space 140 based on the information is described, the embodiment is not limited thereto. For example, the electronic device 101 may output an audio signal related to the virtual space 140. For example, the electronic device 101 may output a vibration related to the virtual space 140.

[0032] refer to Figure 1 , the external electronic device 120 may use at least one virtual space (e.g., virtual space 140) to provide functions related to the immersive service platform. The external electronic device 120 may arrange one or more virtual objects formed along a coordinate system (e.g., a two-dimensional coordinate system or a three-dimensional coordinate system) formed by a plurality of axes (e.g., an x-axis, a y-axis, and / or a z-axis) in the virtual space 140. Figure 1 , shows a first virtual object 130-1 and a second virtual object 130-2 set in a virtual space 140 by an external electronic device 120. The external electronic device 120 may set an avatar representing a user 110 of the electronic device 101 in the virtual space 140 based on a signal received from the electronic device 101 (e.g., a signal for accessing the virtual space 140). The avatar may be referred to as a character (or role).

[0033] In an embodiment, an avatar may be generated by using information associated with a user. As a combination of three-dimensional graphic objects, the avatar may include a combination of a virtual object representing one or more clothing and a virtual object representing a body part (e.g., a part of the user, such as the user's upper body and / or the entire body). The avatar may be generated by receiving a user input for combining or modifying one or more virtual objects by the electronic device 101. The embodiment is not limited thereto, and the avatar may be generated by the electronic device 101 by receiving a photo representing the user's face and / or body part.

[0034] exist Figure 1In an embodiment of the present invention, the first virtual object 130-1 may be an avatar of a first user 110-1 representing a first electronic device 101-1, and the second virtual object 130-2 may be an avatar of a second user 110-2 representing a second electronic device 101-2. The position, size and / or shape of the avatar in the virtual space 140 may be modified by a signal sent by the electronic device 101 to the external electronic device 120. For example, the electronic device 101 may send a signal to the external electronic device 120 based on an input of the user 110 corresponding to the avatar. The input of the user 110 may include an input indicating the movement of the avatar in the virtual space 140. The virtual objects set in the virtual space 140 are not limited to the avatar, and the external electronic device 120 may set another virtual object different from the avatar in the virtual space 140 (for example, a terrain and / or a virtual object representing a building).

[0035] According to an embodiment, the electronic device 101 may display at least a portion of the virtual space 140 on the screen. Figure 1 , exemplarily showing a portion of the virtual space 140 displayed by the first electronic device 101-1 in the screen 150-1 of the first electronic device 101-1. The portion of the virtual space 140 displayed in the screen 150-1 of the first electronic device 101-1 may be at least a portion of the virtual space 140 included in the perspective of the first virtual object 130-1. The first virtual object 130-1 may be an avatar of the first user 110-1 representing the first electronic device 101-1. In the virtual space 140, since the second virtual object 130-2 is included in the perspective of the first virtual object 130-1, the second visual object 160-2 representing the second virtual object 130-2 may be displayed in the screen 150-1 of the first electronic device 101-1. Note that although the second visual object 160-2 represents the second virtual object 130-2, the second visual object 160-2 is distinctively marked in the screen 150-1 of the first electronic device 101-1. When the second virtual object 130 - 2 is a three-dimensional object based on a three-dimensional coordinate system, the second visual object 160 - 2 may be an image of the second virtual object 130 - 2 projected onto the perspective of the first virtual object 130 - 1 in the virtual space 140 .

[0036] refer to Figure 1, exemplarily showing a portion of a virtual space 140 displayed by a second electronic device 101-2 in a screen 150-2 of the second electronic device 101-2. In the virtual space 140, when a first virtual object 130-1 is included in the perspective of the second virtual object 130-2, the second electronic device 101-2 may display a first visual object 160-1 representing the first virtual object 130-1 in the screen 150-2. Note that although the first visual object 160-1 represents the first virtual object 130-1, the first visual object 160-1 is distinctively marked in the screen 150-2 of the second electronic device 101-2. As described above, the electronic device 101 including the first electronic device 101-1 and the second electronic device 101-2 may display a visual object included in the virtual space 140 and representing a user different from the user 110 of the electronic device 101 to the user 110 of the electronic device 101.

[0037] According to an embodiment, in a state where a visual object corresponding to a user different from the user 110 of the electronic device 101 is displayed, the electronic device 101 may display to the user 110 a history that a virtual object (e.g., an avatar) corresponding to the visual object has been modified. For example, in a screen 150-1 displaying a second visual object 160-2 representing a second virtual object 130-2, the first electronic device 101-1 may display a visual object 170 based on a history in which the second virtual object 130-2 has been modified. In an embodiment where the second virtual object 130-2 is an avatar corresponding to the second user 110-2, the first electronic device 101-1 may display in the visual object 170 a history that the avatar has been modified.

[0038] refer to Figure 1, a visual object 170 in the form of a bubble is shown, but the embodiment is not limited thereto. In the visual object 170, the first electronic device 101-1 may display a visual object 172, which represents another virtual object previously displayed to the first user 110-1 before the second virtual object 130-2 corresponding to the second visual object 160-2. For example, the visual object 172 may indicate another virtual object that has been displayed through the display of the first electronic device 101-1 as a representation of the second user 110-2 before the second virtual object 130-2 corresponding to the second visual object 160-2. In the visual object 170, the first electronic device 101-1 may display text guiding the moment (or timing) when the avatar corresponding to the second user 110-2 has been modified (for example, "Modification time: yyyy-mm-dd", representing year-month-day). In the visual object 170, the first electronic device 101-1 may display text (e.g., "Last meeting: virtual space") guiding the location where the first user 110-1 and the second user 110-2 interacted in the virtual space 140. In the visual object 170, the first electronic device 101-1 may display a visual object 174 in the shape of a button including preset text (e.g., "Check"). In response to an input indicating selection of the visual object 174, the first electronic device 101-1 may stop displaying the visual object 170.

[0039] For example, after communicating with the first user 110-1 based on the virtual space 140, the second user 110-2 may modify at least a portion of the second virtual object 130-2 corresponding to the second user 110-2. In a state where at least a portion of the second virtual object 130-2 (e.g., the second visual object 160-2) is displayed through the display of the first electronic device 101-1, the external electronic device 120 and / or the first electronic device 101-1 may identify whether the second user 110-2 has modified at least a portion of the second virtual object 130-2. In the case where the communication between the first user 110-1 and the second user 110-2 occurs in the virtual space 140 within a first moment and at least a portion of the second virtual object 130-2 has been modified within a second moment after the first moment, the first electronic device 101-1 may identify that at least a portion of the second virtual object 130-2 has been modified within a third moment after the second moment. The first electronic device 101 - 1 may display the visual object 172 that has been viewed by the first user 110 - 1 within the first moment and the second visual object 160 - 2 representing the second virtual object 130 - 2 within the third moment.

[0040] refer to Figure 1, the first electronic device 101-1 can visualize the history that the second virtual object 130-2 of the second user 110-2 has been modified in the virtual space 140 by displaying the second visual object 160-2 and the visual object 172. Because the first electronic device 101-1 visualizes the history that the second virtual object 130-2 has been modified, the first user 110-1 of the first electronic device 101-1 can more quickly identify the second visual object 160-2 corresponding to the second virtual object 130-2 corresponding to the second user 110-2 based on the history. Similar to the visual object 170, the reference Figure 3 , Figure 4a , Figure 4b , Figure 4c , Figure 5a and Figure 5b An example of a user interface (UI) that the first electronic device 101 - 1 displays to visualize a history that the second virtual object 130 - 2 has been modified is described.

[0041] As described above, according to an embodiment, in a state where a second visual object 160-2 representing a second virtual object 130-2 is displayed, the first electronic device 101-1 may identify a visual object 172 that has been browsed by the first user 110-1 of the first electronic device 101-1 as a representation of the second user 110-2 corresponding to the second virtual object 130-2. For example, the first electronic device 101-1 may obtain information indicating the visual object 172 from the external electronic device 120. Based on identifying a visual object 172 that is different from the second visual object 160-2 displayed by the display from the information, the first electronic device 101-1 may display the visual object 172 together with the second visual object 160-2. By displaying the second visual object 160-2 and the visual object 172, the first electronic device 101-1 may display to the first user 110-1 a representation of the second user 110-2 at another moment before the current moment and a representation of the second user 110-2 at the current moment (e.g., an avatar and / or video). Another time may be the last time the first user 110 - 1 communicated with the second user 110 - 2 through the first electronic device 101 - 1 .

[0042] In the following, reference Figure 2 , according to an embodiment, a structural example of hardware included in the electronic device 101 and the external electronic device 120 will be described.

[0043] Figure 2 is a block diagram of an electronic device 101 according to an embodiment. Figure 2 The electronic device 101 and the external electronic device 120 may include Figure 1 electronic device 101 and external electronic device 120.

[0044] refer to Figure 2 , the electronic device 101 may include at least one of a processor 210, a memory 220, a communication circuit 230, a display 240, and a sensor 250. The processor 210, the memory 220, the communication circuit 230, the display 240, and the sensor 250 may be electrically and / or operably coupled to each other through electronic components such as a communication bus 202. In the following, operably coupled hardware may mean that a direct connection or an indirect connection between hardware is established by wire or wirelessly to ensure that the first hardware in the hardware is controlled by the second hardware. Although shown based on different blocks, the embodiments are not limited thereto, and Figure 2 Part of the hardware shown in FIG. 1 (eg, processor 210, memory 220, and at least a portion of communication circuit 230) may be included in a single integrated circuit (eg, system on chip (SoC)). The type and / or number of hardware included in electronic device 101 is not limited to Figure 2 For example, the electronic device 101 may only include Figure 2 A portion of the hardware is shown.

[0045] refer to Figure 2 , exemplarily showing the appearance of the electronic device 101. The electronic device 101 may be wearable on a user (eg, Figure 1 The electronic device 101 may be in the shape of glasses 204-1 on the head of the user 110). The electronic device 101 may be in the shape of a mobile phone 204-2. The electronic device 101 may be in the shape of a laptop PC 204-3.

[0046] According to an embodiment, the processor 210 of the electronic device 101 may include a circuit for processing data based on one or more instructions. For example, the hardware components for processing data may include an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors 210 may be 1 or more. For example, the processor 210 may be in the structure of a multi-core processor such as a dual-core, quad-core, or hexa-core processor.

[0047] According to an embodiment, the memory 220 of the electronic device 101 may include hardware for storing data and / or instructions input to and / or output from the processor 210. For example, the memory 220 may include a volatile memory such as a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). For example, the volatile memory may include at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, or a pseudo SRAM (PSRAM). For example, the non-volatile memory may include at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, an optical disk, or an embedded multimedia card (eMMC).

[0048] According to an embodiment, one or more instructions (or commands) indicating calculations and / or operations to be performed on data by the processor 210 may be stored in the memory 220. A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a subroutine, and / or an application. For example, when a set of multiple instructions deployed in the form of an operating system, firmware, a driver, and / or an application is executed, the electronic device 101 and / or the processor 210 may perform Figure 7 , Figure 8 and Fig. 9 Hereinafter, the fact that an application is installed in the electronic device 101 may indicate that one or more instructions provided in the form of an application are stored in the memory 220 of the electronic device 101, and means that one or more applications are stored by the processor 210 of the electronic device 101 in an executable format (e.g., a file with an extension specified by the operating system of the electronic device 101).

[0049] According to an embodiment, the communication circuit 230 of the electronic device 101 may include hardware for supporting the transmission and / or reception of electrical signals between the electronic device 101 and the external electronic device 120. Although only one external electronic device 120 connected to the electronic device 101 through the communication circuit 230 is shown, the present embodiment is not limited thereto, for example, the electronic device 101 may communicate with multiple external electronic devices including the external electronic device 120. The communication circuit 230 may include, for example, at least one of a MODEM, an antenna, and an optical / electronic (O / E) converter. The communication circuit 230 may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (Wi-Fi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and 5G new radio (NR).

[0050] According to an embodiment, the display 240 of the electronic device 101 may output visual information (eg, Figure 3 , Figure 4a , Figure 4b , Figure 4c , Figure 5a , Figure 5b and / or Figure 6 At least one of the pictures of the display 240). For example, the display 240 may be controlled by a controller such as a graphics processing unit (GPU) to output visual information to the user. The display 240 may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP) and / or one or more light-emitting LEDs. The LED may include an organic LED (OLED).

[0051] According to an embodiment, the sensor 250 of the electronic device 101 may generate electrical information that may be processed by the processor 210 and / or the memory 220 from non-electronic information related to the electronic device 101. Figure 2 As examples of the sensor 250, an image sensor 252, an inertial measurement unit (IMU) 254, and / or a microphone 256 are shown. The present embodiment is not limited thereto. For example, according to the embodiment, the Figure 2 At least one of the sensors 250 shown. According to an embodiment, the sensor 250 may further include Figure 2 For example, the sensor 250 may further include a global positioning system (GPS) sensor for detecting the geographic location of the electronic device 101 .

[0052] According to an embodiment, the image sensor 252 of the electronic device 101 may include one or more optical sensors (e.g., a charge coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate an electrical signal indicating the color and / or brightness of light. The multiple optical sensors included in the image sensor 252 may be arranged in the form of a two-dimensional array. The image sensor 252 may generate two-dimensional frame data corresponding to the light reaching the optical sensor of the two-dimensional array by obtaining the electrical signal of each modified optical sensor substantially at the same time. For example, the photographic data captured by using the image sensor 252 may indicate an image obtained from the image sensor 252. For example, the video data captured by using the image sensor 252 may indicate a sequence of multiple images obtained according to a frame rate specified by the image sensor 252. In an embodiment in which the electronic device 101 includes the image sensor 252, the number of image sensors included in the electronic device 101 may be multiple. In an embodiment in which the electronic device 101 is in the form of glasses 204-1, the electronic device 101 may include a first image sensor arranged toward the eyes of a user wearing the glasses 204-1, and a second image sensor arranged toward the direction in which the head of the user is pointing (e.g., forward).

[0053] According to an embodiment, the IMU 254 of the electronic device 101 may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, or a combination thereof. The acceleration sensor may output an electrical signal indicating the acceleration of gravity and / or the acceleration of each of multiple axes (e.g., x-axis, y-axis, and z-axis) perpendicular to each other and based on a specified origin in the electronic device 101. According to an embodiment, the gyro sensor may output an electrical signal indicating the angular velocity of each of the multiple axes. According to an embodiment, the geomagnetic sensor may output an electrical signal indicating the magnitude of a magnetic field formed in the electronic device 101 along each of the multiple axes (e.g., x-axis, y-axis, and / or z-axis). For example, the acceleration sensor, the gyro sensor, and / or the geomagnetic sensor may repeatedly output sensor data including acceleration, angular velocity, and / or magnetic field magnitude of multiple axes based on a specified period (e.g., 1 millisecond).

[0054] According to an embodiment, the electronic device 101 may include a microphone 256 that outputs an electrical signal indicating atmospheric vibrations. For example, the electronic device 101 may output an audio signal including a user's voice using the microphone 256. The user's voice included in the audio signal may be converted into information in a format that can be recognized by the electronic device 101 based on a sound recognition model and / or a natural language understanding model. For example, the electronic device 101 may recognize the user's voice to perform one or more functions among a plurality of functions that may be provided by the electronic device 101.

[0055] Although not shown, the electronic device 101 according to an embodiment may include an output mechanism for outputting information in a form other than a visual form. For example, the electronic device 101 may include a speaker for outputting an acoustic signal. For example, the electronic device 101 may include a motor for providing tactile feedback based on vibration.

[0056] refer to Figure 2 , the external electronic device 120 may include at least one of a processor 210, a memory 220, and a communication circuit 230. In the external electronic device 120, the processor 210, the memory 220, and the communication circuit 230 may be electrically and / or operably coupled to each other through an electronic component such as a communication bus 202. In the electronic device 101 and the external electronic device 120, hardware (e.g., the processor 210, the memory 220, and / or the communication circuit 230) performing similar functions may be shown based on matching reference numerals. The description of the hardware included in each of the electronic device 101 and the external electronic device 120 may be omitted to reduce duplication of the description.

[0057] According to an embodiment, the external electronic device 120 may be configured to store data in a virtual space (eg, Figure 1 The external electronic device 120 may track and / or monitor the interactions between users occurring in the virtual space. In the virtual space provided by the external electronic device 120, the interactions between users may be performed by a corresponding user (e.g., Figure 1 The external electronic device 120 may store information for displaying an avatar of a user accessing the virtual space in the memory 220 of the external electronic device 120. The information for displaying the avatar may be referred to as account information and / or user information of the user corresponding to the avatar. The account information and / or user information may include information for authenticating the user corresponding to the avatar (e.g., identity authentication (ID), password, personal identification number (PIN), and / or biometric information).

[0058] In an embodiment, based on recognizing the interaction of the user in the virtual space, the external electronic device 120 may store the first state of the virtual object corresponding to the user at the first moment when the interaction occurs in the memory 220 of the external electronic device 120. The first state of the virtual object may indicate the external appearance of the virtual object at the first moment. Based on re-recognizing the interaction of the user after the first moment, the external electronic device 120 may compare the first state of the virtual object at the second moment when the interaction occurs again with the first state stored in the memory 220. The external electronic device 120 may send a signal including the difference between the first state and the second state to at least one electronic device 101 among the users. The electronic device 101 receiving the information may visualize the difference included in the signal in the display 240. For example, the electronic device 101 may display Figure 1 of visual objects 170.

[0059] According to an embodiment, the electronic device 101 may display a first visual object representing a user in the display 240 based on information received from the external electronic device 120. The user may include another user who interacts with the user of the electronic device 101 through a virtual space provided by the external electronic device 120. For example, the information obtained by the electronic device 101 from the external electronic device 120 may include an interaction history between a user corresponding to the first visual object and the user of the electronic device in the virtual space. The electronic device 101 may identify the number of times the first visual object is displayed through the display 240 based on the information received from the external electronic device 120. The electronic device 101 may identify from the information the number of times the user of the electronic device 101 has browsed the first visual object through the display 240.

[0060] In an embodiment, based on the number of times of recognition being lower than a preset number of times (e.g., 1 time), the electronic device 101 may display the second visual object representing the user before the first visual object together with the first visual object in the display 240. For example, when the first visual object is first displayed in the display 240 as a representation of the user corresponding to the first visual object, the electronic device 101 may display the second visual object in the display 240. For example, the second visual object may be a visual object displayed as a representation of the user corresponding to the first visual object by the display 240. The electronic device 101 may visualize the history of modifying the representation of the user corresponding to the first visual object by simultaneously displaying the first visual object and the second visual object.

[0061] As described above, according to an embodiment, in a state where a visual object representing another user connected to a user of the electronic device 101 through a virtual space provided by the external electronic device 120 is displayed, the electronic device 101 can identify whether the visual object is first displayed as a representation of the other user. When the visual object is first displayed as a representation of the other user, the electronic device 101 can display the other visual object displayed as a representation of the other user together with the visual object. For example, the electronic device 101 can display the current appearance of the other person displayed through the display 240 and the past appearance of the other person (for example, the other appearance displayed through the display 240) in parallel.

[0062] In the following, reference Figure 3 , an example in which the electronic device 101 simultaneously displays a UI of the current appearance and the past appearance of another person displayed through the display 240 will be described.

[0063] Figure 3 An example of an operation in which the electronic device 101 displays at least a portion of a virtual space according to an embodiment is shown. Figure 3 The electronic device 101 and the external electronic device 120 may be Figure 2 An example of an electronic device 101 and an external electronic device 120.

[0064] refer to Figure 3 , according to an embodiment, an example is shown in which the electronic device 101 displays visual objects 320, 330, 340, 345, 350, 355, 360, and 365 in the screen 310. When the electronic device 101 has glasses (e.g., Figure 2 When the electronic device 101 has the appearance of the glasses 204-1, the electronic device 101 can Figure 3 The screen 310 is projected onto the lens of the glasses. Because the screen 310 is projected onto the lens, the user can browse the screen 310 and the ambient light passing through the lens. The embodiment is not limited thereto, and the electronic device 101 may have a structure for blocking ambient light. The electronic device 101 having a structure for blocking ambient light can provide a user experience based on video perspective (VST) by displaying the screen 310 based on virtual reality (VR) or synthesizing the screen 310 including visual objects 320, 330, 340, 345, 350, 355, 360 and 365 on an image including ambient light.

[0065] According to an embodiment, the electronic device 101 may display a virtual space (eg, Figure 1The electronic device 101 may display a screen 310 including at least a portion of the virtual space based on recognizing an input indicating entry into the virtual space from the user 110. For example, the electronic device 101 may display the screen 310 in response to an input indicating entry into a conference room or a chat room provided by the external electronic device 120. The screen 310 may include at least a portion of the virtual space corresponding to the conference room or chat room associated with the input.

[0066] refer to Figure 3 , shows an example in which the electronic device 101 displays one or more visual objects (e.g., visual objects 320, 330, 340, 345, 350, 355, 360, and 365) included in at least a portion of the virtual space. The electronic device 101 may display the one or more visual objects based on information received from the external electronic device 120. When the electronic device 101 is connected to the external electronic device 120 based on the account information of the user 110, the electronic device 101 may receive from the external electronic device 120 information for displaying at least a portion of the virtual space included in the perspective of the avatar set in the virtual space by the account information. Figure 3 The visual objects 320, 330, 340, 345, 350, 355, 360, and 365 in the screen 310 may correspond to virtual objects included within the perspective of the avatar corresponding to the user 110 among a plurality of virtual objects set in the virtual space.

[0067] refer to Figure 3 , the electronic device 101 may display a visual object 320 representing at least a portion of an object (e.g., a table) set in a virtual space in the screen 310. The electronic device 101 may display the visual object 320 in the screen 310 based on at least a portion of the object shown through the perspective of the avatar in the virtual space corresponding to the user 110. The electronic device 101 may display visual objects 330, 340, 350, and 360 that are included within the perspective of the avatar in the virtual space corresponding to the user 110 and represent virtual objects of other users different from the user 110.

[0068] For example, the electronic device 101 may display visual objects 330, 340, and 360 corresponding to at least a portion of the avatars of other users in the screen 310. For example, the visual objects 330, 340, and 360 may correspond to at least a portion of the avatars of other users, which are shown from the perspective of the avatar corresponding to the user 110. The embodiment is not limited thereto, and the electronic device 101 may display the visual object 350 in the screen 310 based on a video received from the external electronic device 120. For example, the video may be received from the electronic device (e.g., Figure 1The camera of the second electronic device 101-2) is streamed.

[0069] According to an embodiment, the electronic device 101 may identify whether the representation of the user is modified based on the history indicating the user corresponding to each of the visual objects 330, 340, 350, and 360. For example, when the user corresponding to the visual object 330 first interacts with the user 110 of the electronic device 101 through the virtual space of the external electronic device 120, the electronic device 101 may not display the history that the avatar corresponding to the visual object 330 is modified in the screen 310. The external electronic device 120 and / or the electronic device 101 may store the visual object 330 and / or the avatar corresponding to the visual object 330 displayed in the screen 310 as a history of displaying the user corresponding to the visual object 330. For another example, when it is recognized that the visual object 330 and / or the avatar corresponding to the visual object 330 is displayed before the screen 310 is displayed, the electronic device 101 may not display the history that the avatar corresponding to the visual object 330 is modified in the screen 310.

[0070] refer to Figure 3 When the avatar corresponding to the visual object 340 is modified by the user corresponding to the visual object 340 and / or the avatar, the electronic device 101 may display a visual object 345 representing the avatar before being modified by the user together with the visual object 340. In the visual object 345, the electronic device 101 may display an image and / or video representing at least a portion of the avatar that the user 110 last viewed. The electronic device 101 may display information describing the moment when the avatar was last viewed by the user 110 together with the image and / or video within the visual object 345. The information may include a timestamp of the moment and / or a position where the avatar is set in the virtual space at that moment. Figure 4a , Figure 4b , Figure 4c and / or Figure 5a and Figure 5b An exemplary operation of displaying information in the visual object 345 by the electronic device 101 is described.

[0071] refer to Figure 3, when there is a history of an avatar corresponding to a user of another electronic device different from the electronic device 101 before the visual object 350 including a video streamed from the other electronic device, the electronic device 101 may display a visual object 355 including the avatar in the screen 310. For example, the electronic device 101 may reproduce at least a portion of the video of the current moment of the user corresponding to the visual object 350 in the screen 310 using the visual object 350, while the electronic device 101 displays at least a portion of the video of the past moment of the user corresponding to the visual object 355 (e.g., a thumbnail). In addition, when there is a history of a streaming video corresponding to the visual object 360 from the user's electronic device before the avatar corresponding to the visual object 360, the electronic device 101 may display a visual object 365 including at least a portion of the video on the screen 310. For example, the electronic device 101 may display at least a portion of the video of the past moment of the user corresponding to the visual object 360 in the screen 310 using the visual object 365.

[0072] refer to Figure 3 , shows an embodiment in which the electronic device 101 displays visual objects 345, 355, and 365 in the form of bubble boxes, but the embodiment is not limited thereto. The electronic device 101 may also display information of the user corresponding to the bubble box in the bubble box. The information may include, for example, data about the time of the last interaction with the user through the virtual space (e.g., a timestamp indicating the time and / or the location of the virtual space interacting with the user at that time). As shown on the screen 310, the reference Figure 5a and Figure 5b Describes an exemplary operation of the electronic device 101 displaying representations of a user at different moments (e.g., the current moment and the past moment) that are associated with each other (or linked to each other). For example, a first representation of a user at a first moment (e.g., the current moment) may be arranged in the screen 310 relative to a second representation of the user at a second moment (e.g., the past moment). Figure 4a , Figure 4b and Figure 4c Described is an operation of the electronic device 101 visualizing a modification history in a user's representation (eg, visual objects 330 , 340 , 350 , and 360 ) to be displayed through a virtual space before displaying a screen 310 including at least a portion of the virtual space.

[0073] refer to Figure 3, in the state of displaying the screen 310, the electronic device 101 can identify whether the user 110 has browsed one or more visual objects included in the screen 310. For example, the electronic device 101 can identify a visual object focused on the user 110 among the visual objects displayed on the screen 310 based on at least one of the direction of the user 110's eyes, the direction of the user 110's head, the direction of a preset body part (e.g., a hand) of the user 110, or the voice of the user 110. For example, the electronic device 101 can identify an input indicating that the visual object 340 and / or the visual object 345 is to be browsed by tracking the direction of the user 110's eyes. For example, the electronic device 101 can identify an input based on whether the direction of the user 110's eyes stops on the visual object 340 for more than a preset number of times and / or a preset duration on the visual object 340. For example, the electronic device 101 can identify an input indicating that the visual object 345 is selected (e.g., a finger pointing to the visual object 345). Reference will be made to Figure 6 An example of an operation in which the electronic device 101 recognizes an input is described.

[0074] In an embodiment, in response to an input indicating that visual object 340 and / or visual object 345 is to be browsed, electronic device 101 may stop displaying visual object 345. In response to the input, electronic device 101 may store the state of visual object 340 and / or the avatar corresponding to visual object 340 as an interaction history between user 110 and the user corresponding to visual object 340. Based on the input, electronic device 101 may send a signal to external electronic device 120 indicating that visual object 340 has been browsed by user 110 of electronic device 101. Based on the signal, external electronic device 120 may store the state of visual object 340 and / or the avatar corresponding to visual object 340 in the information including the interaction history.

[0075] As described above, according to an embodiment, the electronic device 101 may display a screen 310 including at least a portion of a virtual space provided by an external electronic device 120. In the screen 310, the electronic device 101 may display visual objects 330, 340, 350, and 360 indicating that different users interact with the user 110 of the electronic device 101 through the virtual space. Each of the visual objects 330, 340, 350, and 360 may be a representation of a user accessing the virtual space at the current moment (e.g., an avatar, a photo ID, and / or a video including the user). The electronic device 101 may visualize the history in which the user's representation has been modified. For example, the electronic device 101 may display in the screen 310 a visual object (e.g., visual objects 345, 355, and 365) that is different from the visual objects 330, 340, 350, and 360 and includes a representation of a user displayed by the electronic device 101 before the current moment.

[0076] In the following, reference Figure 4a , Figure 4b and Figure 4c and / or Figure 5a and Figure 5b , an example of an operation of the electronic device 101 to visualize a history in which a virtual object included in a virtual space is modified will be described.

[0077] Figure 4a , Figure 4b and Figure 4c An example of an operation in which the electronic device 101 displays a visual object representing a virtual object according to an embodiment is shown. Figure 4a , Figure 4b and Figure 4c The electronic devices 101 and 410 may include Figure 1 , Figure 2 and Figure 3 The electronic device 101 and the electronic device 410 may be terminals of the user 110. For example, the electronic device 101 and the electronic device 410 may communicate with the external electronic device 120 based on the account information of the user 110. Although the electronic device 101 is shown to have the appearance of glasses and the electronic device 410 has a mobile phone (e.g., Figure 2 The present invention is an example of an appearance of a mobile phone 204-2), but the embodiment is not limited thereto.

[0078] According to an embodiment, the electronic device 101 and / or the electronic device 410 may access a virtual space (eg, Figure 1 The external electronic device 120 may provide services (e.g., metaverse services and / or video conferencing services) for conversations of physically separated users based on the virtual space. For example, the external electronic device 120 may reserve a video conference for a plurality of users including the user 110 based on the virtual space. The reservation of the video conference may be generated by information received from at least one of the plurality of users. The external electronic device 120 may store information indicating the reserved video conference in a memory of the external electronic device 120 (e.g., Figure 2 The information may include information indicating the time at which the video conference will be initiated and / or the location in the virtual space at which the video conference will be generated.

[0079] In an embodiment, before the moment indicated by the information, the external electronic device 120 may send a message (e.g., a push notification) for guiding access to the virtual space based on the reservation of the electronic devices of multiple users indicated by the information. In terms of sending push notifications, the external electronic device 120 may be referred to as a push server. When it is recognized that the user 110 is wearing the electronic device 101, the external electronic device 120 may selectively send the message to the electronic device 101 among the electronic device 101 and the electronic device 410. The embodiment is not limited thereto, and the external electronic device 120 may send a message to at least one of the electronic device 101 and / or the electronic device 410 regardless of whether the user 110 is wearing the electronic device 101.

[0080] refer to Figure 4a , in response to a message received from an external electronic device 120, an example of a visual object 430 displayed by the electronic device 101 and / or the electronic device 410 is shown. The electronic device 101 may display a message through a display (e.g., Figure 2 The display 240 of the electronic device 101 displays the visual object 430 in the field of view (FoV) of the user 110 wearing the electronic device 101. The electronic device 410 may display the visual object 430 based on the message on the display 420. Figure 4a , electronic device 101 and / or electronic device 410 may display the time at which the virtual space-based video conference will be initiated and / or the assigned title of the video conference, such as text within visual object 430 (e.g., “10 minutes before entering VR improvement meeting”).

[0081] refer to Figure 4a In the visual object 430, the electronic device 101 and / or the electronic device 410 may display text (e.g., "Member Jessica has modified the persona. Click to check the modified persona before the meeting") to guide users who will participate in the video conference corresponding to the message to modify the representations of other users different from the user 110. In the visual object 430, the electronic device 101 and / or the electronic device 410 may display the nickname of the user whose avatar is modified ( Figure 4a Using text displayed by the electronic device 101 and / or the electronic device 410, the external electronic device 120 may guide the user 110 that the representation of at least one other user has been modified.

[0082] refer to Figure 4a, the electronic device 410 may display the visual object 440 in response to a gesture of touching and / or clicking the visual object 430 displayed in the display 420. The electronic device 101 may recognize an input indicating that the visual object 430 is selected based on the gaze of the user 110 wearing the electronic device 101 and / or the user's gesture. The electronic device 101 may display the visual object 440 to the user 110 in response to the input.

[0083] refer to Figure 4a , in a visual object 440 in the form of a bubble box, the electronic device 101 and / or the electronic device 410 may display a history of modifying the representation of one or more users. In the visual object 440, the electronic device 101 and / or the electronic device 410 may display text including the moment when the avatar of another user was modified (e.g., "Jessica changed her character on 2022-07-22"). In the visual object 440, the electronic device 101 and / or the electronic device 410 may display a history of modifying the avatar of another user distinguished from the user 110 by using visual objects 442 and 444. The visual objects 442 and 444 may be images that visualize at least a portion of the avatars of other users at different moments. The visual object 442 may correspond to the state of the avatar that the user 110 of the electronic device 101 last browsed, and the visual object 444 may correspond to the state of the avatar to be displayed through the video conference associated with the visual object 440. For example, visual object 442 may indicate an avatar displayed to user 110 through another video conference performed before the video conference, so that visual object 442 represents an avatar at a past time or a past state.

[0084] In an embodiment, the electronic device 101 and / or the electronic device 410 may display a history of the avatar being modified based on a contact list stored in the electronic device 101 and / or the electronic device 410. Figure 4b , shows an embodiment in which the electronic device 101 and / or the electronic device 410 displays a screen 450 including a contact list. In the screen 450, the electronic device 101 and / or the electronic device 410 may display items 451, 452, 453, and 454 corresponding to each of a plurality of users stored in the contact list. Each of the items 451, 452, 453, and 454 may include a name and / or a picture of a corresponding user. When a user included in the contact list has an avatar visualized by account information stored in the external electronic device 120, the electronic device 101 and / or the electronic device 410 may display an image of at least a portion of the avatar in the screen 450 including the contact list.

[0085] For example, electronic device 101 and / or electronic device 410 may display visual object 451-2 representing an avatar matching the user in item 451, as well as the name of the user corresponding to item 451 (e.g., "Jessica") and a photo 451-1 of the user. Similarly, electronic device 101 and / or electronic device 410 may display visual object 453-2 representing an avatar matching the user in item 453, as well as the name of the user corresponding to item 453 (e.g., "Jenny") and a photo 453-1 of the user. With reference to visual object 453-2 and / or visual object 451-2, electronic device 101 and / or electronic device 410 may display an image and / or video representing at least a portion of the avatar (e.g., a portion including the face of the avatar) in screen 450.

[0086] refer to Figure 4b , the electronic device 101 and / or the electronic device 410 may display an option for adding and / or searching the contact list in the screen 450 including the contact list. For example, the electronic device 101 and / or the electronic device 410 may display a visual object 455 in the form of a button for adding a user to the contact list in the screen 450. The electronic device 101 and / or the electronic device 410 may display a visual object 456 in the form of a button for searching for at least one user in the contact list in the screen 450. The electronic device 101 and / or the electronic device 410 may display a visual object 457 in the screen 450 for displaying options different from the visual objects 455 and 456.

[0087] refer to Figure 4b According to an embodiment, the electronic device 101 and / or the electronic device 410 may identify a history of modification of the avatar of a user included in the contact list based on information received from the external electronic device 120. The electronic device 101 and / or the electronic device 410 may display an indicator indicating that the avatar has been modified in the screen 450 based on the history. For example, when the avatar of the user corresponding to the item 451 is modified, the electronic device 101 and / or the electronic device 410 may display a visual object 451-3 for notifying that the avatar has been modified in the item 451 displayed in the screen 450. Although the visual object 451-3 having a star-shaped appearance is exemplarily shown, the embodiment is not limited thereto. The display of the visual object 451-3 may indicate that the representation of the user corresponding to the item 451 has been modified after the user 110 of the electronic device 101 and / or the electronic device 410 interacts with the user corresponding to the item 451. Reference Figure 4b , when the avatar of the user corresponding to the item 453 is not modified, the electronic device 101 and / or the electronic device 410 may stop displaying an indicator such as the visual object 451 - 3 in the item 453 .

[0088] refer to Figure 4b In response to an input indicating that item 451 including an indicator (such as visual object 451-3) is selected in the contact list, electronic device 101 and / or electronic device 410 may display visual object 460 for guiding the history of the avatar of the user corresponding to item 451 being modified. Visual object 460 may be displayed in the form of a pop-up window in display 420 of electronic device 410, or may be displayed to user 110 wearing electronic device 101. In visual object 460, electronic device 101 and / or electronic device 410 may display the history of the avatar of the user corresponding to visual object 460 being modified by using visual objects 462 and 464. Similar to Figure 4a The electronic device 101 and / or the electronic device 410 may use visual objects 462 and 464 to visualize the states of the avatars at different moments. For example, the visual object 464 corresponding to the visual object 451-2 in the screen 450 may represent the current state of the avatar. For example, the visual object 462 may represent the avatar that the user 110 browsed last time as the past state of the avatar.

[0089] According to an embodiment, the electronic device 101 and / or the electronic device 410 may display a pop-up window summarizing the history in which the avatars of users included in the contact list have been modified. Figure 4b , shows an example in which the electronic device 101 and / or the electronic device 410 displays the visual object 470 in the form of a pop-up window. In response to an input indicating a selection of a button (e.g., the visual object 458) for guiding the display of the visual object 470 within the screen 450, the electronic device 101 and / or the electronic device 410 may display the visual object 470. In the visual object 470, the electronic device 101 and / or the electronic device 410 may display a list of one or more avatars having different states browsed by the user 110 among the avatars of the users included in the contact list. Reference Figure 4b In the embodiment, in visual object 470, electronic device 101 and / or electronic device 410 may display visual objects 462 and 464 obtained by visualizing a history in which an avatar of a user corresponding to item 451 is modified. In visual object 470, electronic device 101 may display visual objects 472 and 474 for changing the modification history of an avatar of one user in visual object 470 to another modification history of an avatar of another user.

[0090] According to an embodiment, the electronic device 101 and / or the electronic device 410 may perform a function for sharing a history in which an avatar of a user included in the contact list is modified with another user different from the user 110. Figure 4cIn visual object 460, electronic device 101 and / or electronic device 410 may display a button (eg, visual object 466) for executing a function. In visual object 460, electronic device 101 and / or electronic device 410 may display a button for stopping a function. Figure 4c 460 in the display of the button (e.g., visual object 468). Although the description based on Figure 4b 460, but the electronic device 101 and / or the electronic device 410 may be Figure 4a Visual objects 440 and Figure 4b Buttons for executing functions are displayed in visual object 470.

[0091] refer to Figure 4c In response to an input indicating selection of visual object 466, electronic device 101 and / or electronic device 410 may display a pop-up window (e.g., visual object 480) for sharing a history in which an avatar associated with visual object 460 is modified. In visual object 480, electronic device 101 and / or electronic device 410 may display a list of at least one user who has browsed the avatar displayed through visual object 460. For example, among users stored in a contact list of electronic device 101 and / or electronic device 410, a user corresponding to each of item 481, item 482, and item 483 displayed in visual object 480 may be a user who has seen the avatar visualized through visual object 460 through an electronic device. For example, based on the history displayed through the electronic device of the user corresponding to each of item 481, item 482, and item 483, an avatar in a state associated with visual object 462 may display item 481, item 482, and item 483 in electronic device 101 and / or electronic device 410. The electronic device 101 and / or the electronic device 410 may recognize the history based on the information transmitted from the external electronic device 120 .

[0092] According to an embodiment, the electronic device 101 and / or the electronic device 410 may display check boxes 481-1, 482-1, and 483-1 for selecting each of the items 481, 482, and 483, respectively. Figure 4c, shows an exemplary state after recognizing an input indicating that check boxes 481-1 and 483-1 are selected from among check boxes 481-1, 482-1, and 483-1 from user 110. In visual object 480, electronic device 101 and / or electronic device 410 may display a button (e.g., visual object 484) for stopping display of visual object 480. In visual object 480, electronic device 101 and / or electronic device 410 may display a button (e.g., visual object 485) for sharing a history of modifications to an avatar associated with visual object 460 to at least one user selected by input within visual object 480. In response to indicating in Figure 4c When the input of visual object 485 is selected within the state shown, electronic device 101 and / or electronic device 410 can send information indicating history to the electronic devices of users of items 481 and 483 corresponding to check boxes 481-1 and 483-1, respectively, thereby allowing users corresponding to check boxes 481-1 and 483-1 to display visual object 462 of the avatar in the past state and display visual object 464 of the avatar in the current state.

[0093] As described above, according to an embodiment, the electronic device 101 and / or the electronic device 410 may visualize a history in which the representation of another user distinguished from the user 110 is modified based on information received from the external electronic device 120. For example, the electronic device 101 and / or the electronic device 410 may visualize a history in which the representation of another user distinguished from the user 110 is modified in a virtual space (e.g., Figure 1 The history of the avatar being modified in the virtual space 140). Figure 4a As described above, the moment of visualizing the history by the electronic device 101 and / or the electronic device 410 may include the moment before browsing the avatar through the virtual space provided by the external electronic device 120. Figure 4b and Figure 4c , the electronic device 101 and / or the electronic device 410 can visualize the history based on the contact list. In the state of visualizing the history, such as Figure 4b and Figure 4c , the electronic device 101 and / or the electronic device 410 may display visual objects representing the states of the avatars at different moments. The moments may include a first moment as the current moment and a second moment when the avatars were viewed before the current moment. Based on the visual objects, the electronic device 101 and / or the electronic device 410 may visualize the changes of the avatars between the moments.

[0094] In the following, reference Figure 5a and Figure 5bAccording to an embodiment, the electronic device 101 is visualized on a screen (eg, Figure 3 An operation example of a history in which a user (eg, another user distinguished from the user 110 of the electronic device 101) is represented and modified.

[0095] Figure 5a and Figure 5b An example of an operation in which the electronic device 101 displays a visual object based on a modification history of a virtual object according to an embodiment is shown. Figure 5a and Figure 5b The electronic device 101 and the external electronic device 120 may include Figure 1 , Figure 2 and Figure 3 and / or Figure 4a , Figure 4b and Figure 4c electronic device 101 and external electronic device 120.

[0096] refer to Figure 5a According to an embodiment, the electronic device 101 may display at least a portion of a virtual space in the screen 310 based on information transmitted from the external electronic device 120. The at least a portion of the virtual space displayed through the screen 310 may be a portion of a virtual space included in the perspective of the avatar of the user 110. The electronic device 101 may display a visual object 340 representing a virtual object in the screen 310. The electronic device 101 may display the visual object 340 in the screen 310 based on recognizing the virtual object within the perspective of the avatar of the user 110. The virtual object corresponding to the visual object 340 may be a representation (e.g., an avatar) of another user different from the user 110. Figure 5a and Figure 5b The visual object 340 may include Figure 3 of visual objects 340.

[0097] According to an embodiment, the electronic device 101 may visualize a history in which a virtual object corresponding to the visual object 340 is modified in the screen 310. For example, the electronic device 101 may display a history in which an avatar corresponding to the visual object 340 is modified together with the visual object 340. For example, the electronic device 101 may visualize a history in which a representation of a user (e.g., another user distinguished from the user 110) matching the visual object 340 is modified. Figure 5a , the electronic device 101 may display a visual object 510 including a history of modification of an avatar corresponding to the visual object 340 together with the visual object 340 in the screen 310. Although the visual object 510 in the form of a bubble frame is exemplarily shown, the embodiment is not limited thereto.

[0098] According to an embodiment, the electronic device 101 may display a visual object 510 for visualizing the history of the avatar corresponding to the visual object 340 based on whether an identifier (e.g., ID) uniquely assigned to the avatar is displayed within the screen 310. For example, when the identifier is displayed at a position adjacent to the visual object 340 in the screen 310, the user 110 browsing the screen 310 may recognize the counterpart corresponding to the visual object 340 based on the identifier. When the identifier is displayed together with the visual object 340, the electronic device 101 may not display the visual object 510 for visualizing the history of the avatar. In an embodiment, the electronic device 101 may not display the visual object 510, but instead display an indicator (e.g., a dot having a preset color such as red) indicating the modification of the avatar at a position adjacent to the visual object 340 in the screen 310.

[0099] According to an embodiment, the electronic device 101 may determine whether to display the visual object 510 for visualizing the history of the avatar based on the source of the avatar corresponding to the visual object 340. For example, if the avatar is generated by using the three-dimensional shape of the face of the user 110, the electronic device 101 may not display the visual object 510. For example, if the information associated with the avatar includes a preset parameter (or flag) indicating that the avatar is generated based on the shape of the face of the user 110, the electronic device 101 may stop displaying the visual object 510.

[0100] According to an embodiment, when information related to an avatar corresponding to the visual object 340 is stored in the electronic device 101, the electronic device 101 may display at least a portion of the information related to the avatar in the visual object 510. Figure 5a , the electronic device 101 may display the name of the user corresponding to the avatar (e.g., "Jessica"), the time when the avatar was modified (e.g., "Changed character on 2022-07-22"), and / or the user's personal information (e.g., an email address, such as "j_ca@s.com") as at least a portion of the information displayed in the visual object 510. The personal information displayed by the electronic device 101 within the visual object 510 may include personal information corresponding to the visual object 340 disclosed by the user. For example, the electronic device 101 may display any personal information in the visual object 510 based on Table 1.

[0101] [Table 1]

[0102] The values ​​of Table 1 may be set by the user of the avatar corresponding to the visual object 340. Referring to Table 1, the electronic device 101 may display at least a portion of the personal information (e.g., nickname, avatar modification history, interaction history in the virtual space, and email address) with a first preset value (e.g., "on") in the visual object 510. The electronic device 101 may stop displaying the personal information having a second preset value (e.g., "off") different from the first preset value among the user's personal information in the visual object 510. The embodiment is not limited thereto, and the external electronic device 120 may selectively send the personal information having the first preset value among the user's personal information to the electronic device 101. Similarly, the electronic device 101 may obtain from the user 110 a value for adjusting the range of personal information to be displayed together with the history of the user's avatar being modified.

[0103] Based on the personal information exemplarily listed in Table 1, the electronic device 101 can distinguish and display avatars corresponding to different users with matching names. The electronic device 101 can distinguish users by displaying a photo ID corresponding to the user and a visual object representing the avatar.

[0104] refer to Figure 5a , the electronic device 101 may display a button for visualizing a history of modifications to the avatar associated with the visual object 340 in the visual object 510. Figure 5a , as an example of a button, a visual object 515 having a preset text such as “Details” is exemplarily shown. In response to an input indicating that the visual object 515 is selected, the electronic device 101 may display a pop-up window (eg, visual object 520 ) for guiding the history of the avatar in the screen 310 .

[0105] refer to Figure 5a , the electronic device 101 may display visual objects 522 and 524 representing the states of the avatar at different moments in a manner associated with each other within the visual object 520. For example, the electronic device 101 may display the visual object 522 representing the state of the avatar at the moment when the user 110 browsed the avatar before the current moment. The electronic device 101 may display text for guiding the moment (in Figure 5a In the example of , "2022-04-02") and visual object 522. Electronic device 101 may display visual object 524 representing the state of the avatar at the current moment together with visual object 522. Electronic device 101 may use an arrow set between visual objects 522 and 524 (e.g., an arrow from visual object 522 to visual object 524) to visualize the order in which the avatar is modified.

[0106] In an embodiment, the avatar displayed by the electronic device 101 may have a combination form of virtual objects representing clothing (or clothes) (e.g., tops, bottoms, shoes, gloves and / or accessories, such as hats). The electronic device 101 may visualize the history of one or more clothing combined with the avatar corresponding to the visual object 340 being modified within the visual object 520. For example, the electronic device 101 may identify the history of one or more clothing combined with the avatar corresponding to the visual object 340 being modified based on information obtained from the external electronic device 120. The electronic device 101 may identify the history of one or more clothing combined with the avatar being modified by comparing the information used to display the visual objects 522 and 524. The electronic device 101 may visualize the history of one or more clothing being modified as well as the visual object 520. The embodiment is not limited thereto, and the electronic device 101 may modify at least a portion of the avatar by using a second photo different from the first photo after generating the avatar by using an image (or video) such as a first photo. For example, the electronic device 101 may modify at least a portion of the avatar by using a modification of the body (or clothing) of the specific user recognized by comparing the first photo and the second photo about the specific user. The electronic device 101 according to an embodiment may visualize a history in which at least a portion of the avatar is modified.

[0107] refer to Figure 5a , in an exemplary case where glasses and tops are newly combined to the avatar associated with visual object 340, an example of electronic device 101 displaying visual objects 530 and 535 for guiding the history of glasses and tops being combined is shown. Electronic device 101 may display visual objects 530 and 535 in the form of bubble boxes associated with visual object 524. In this case, electronic device 101 may highlight (e.g., flash) glasses and tops in visual object 524 independently of displaying visual objects 530 and 535. For example, electronic device 101 may highlight glasses and / or tops by repeatedly displaying a shape having a preset transparency and a preset color overlapping with glasses and / or tops.

[0108] refer to Figure 5a, in visual object 530, the electronic device 101 may display text guiding the name of the clothing (e.g., glasses) coupled to the avatar corresponding to visual object 524 and the time (e.g., 2022-07-01) when the clothing is coupled to the avatar. In visual object 530, the electronic device 101 may display a button for stopping displaying visual object 530 (e.g., visual object 531 including preset text such as "Check"). Similarly, in visual object 535, the electronic device 101 may display the name of the top coupled to the avatar (e.g., jacket) and the time (e.g., 2022-07-22) when the avatar's top is replaced. Based on an input indicating that visual object 536 is selected, the electronic device 101 may stop displaying visual object 535. Reference Figure 5a In the visual objects 530 and 535 of the screen 310, an exemplary case of the time when the avatar corresponding to the visual object 340 was last modified is July 22, 2022, showing the time of replacing the top. In this case, the electronic device 101 can display text indicating the time (e.g., July 22, 2022) in the visual object 510 of the screen 310.

[0109] In an embodiment, the electronic device 101 that displays an avatar based on a combination of multiple graphic objects can visualize the history of the avatar being modified based on whether more than a preset number of graphic objects have been changed, added and / or deleted at a second time after the first time the avatar was last displayed. Figure 5a , at a time between the moment when the clothing is attached to the avatar (e.g., 2022-07-01) and the moment when the avatar's top is replaced (e.g., 2022-07-22), since only one graphic object (e.g., clothing) is changed after the last time the avatar was viewed (e.g., 2022-04-02), the electronic device 101 may not display the visual object 510. For example, at a time after the moment when the avatar's top is replaced (e.g., 2022-07-22), since two graphic objects are changed after the last time the avatar was viewed (e.g., 2022-04-02), the electronic device 101 may display the visual object 510.

[0110] Although an exemplary operation is described in which electronic device 101 sequentially displays visual objects 510 and 520 based on visual object 515, the present embodiment is not limited thereto. For example, in a case where information related to an avatar corresponding to visual object 340 is not stored in electronic device 101 or information of a user corresponding to the avatar is not shared with user 110 of electronic device 101, electronic device 101 may display visual object 520 among visual objects 510 and 520. In this example, electronic device 101 may use visual object 520 to display visual object 522 representing the avatar last viewed by user 110 and visual object 340 representing the current state of the avatar. In this example, because user 110 has only viewed visual object 522, electronic device 101 may visualize the history of the avatar of visual object 522 being modified by displaying visual object 522 as well as visual object 340.

[0111] For example, based on identifying information of a user related to visual object 340 from the memory of electronic device 101 or identifying a history of sharing information with user 110, electronic device 101 may display visual object 510 among visual objects 510 and 520. The information may be stored in a contact list within electronic device 101. For example, based on identifying data indicating a user corresponding to visual object 340 within a contact list stored in the memory of electronic device 101, electronic device 101 may display visual object 510 including at least a portion of the data as well as visual object 340. At least one of visual objects 510 and 520 may be conditionally displayed based on a history that an avatar corresponding to visual object 340 has been modified.

[0112] According to an embodiment, within the screen 310 including at least a portion of the virtual space, the history of the visualized avatar being modified by the electronic device 101 is not limited to Figure 3 and / or Figure 5a Reference Figure 5b , in the screen 310, the electronic device 101 may display a visual object 540 representing an avatar in a virtual space provided by the external electronic device 120. In the time domain, the electronic device 101 may visualize a history in which the avatar is modified by sequentially modifying the form of the visual object 540.

[0113] refer to Figure 5b, in the time interval between time t1 and time t3, different states 540-1, 540-2, and 540-3 of the visual object 540 displayed by the electronic device 101 in the screen 310 are shown. The moment t1 may include the moment when the electronic device 101 starts to display the screen 310 in the display, or the moment after a preset time period from the moment. The moment t1 may be the moment when the input indicating the electronic device 101 to browse the visual object 540 is recognized. At the moment t1, the first state 540-1 of the visual object 540 displayed by the electronic device 101 in the screen 310 may correspond to a state of the avatar last browsed by the user 110 among the states of the avatar corresponding to the visual object 540. At the moment t3, the third state 540-3 of the visual object 540 displayed by the electronic device 101 in the screen 310 may correspond to the current state of the avatar among the states.

[0114] refer to Figure 5b At time t2, the second state 540-2 of the visual object 540 displayed by the electronic device 101 in the screen 310 may include an intermediate state (or intermediate form) between the first state 540-1 and the third state 540-3 of the visual object 540. Based on the intermediate state, in the time interval between time t1 and time t3, the electronic device 101 may display an animation in which the form of the visual object 540 changes from the first state 540-1 to the third state 540-3. The electronic device 101 may recognize one or more intermediate states of the visual object 540 including the second state 540-2 based on a visual effect such as morphing.

[0115] As described above, according to an embodiment, in screen 310 representing a portion of a virtual space, electronic device 101 may display at least one visual object (e.g., visual object 340) representing at least one virtual object included in the portion. In a state where visual object 340 representing an avatar of another user different from user 110 is displayed in screen 310, electronic device 101 may visualize a history of modifications to the avatar. The history visualized by electronic device 101 may be related to a difference between a first state of the avatar corresponding to visual object 340 and a second state of the avatar last displayed by the display of electronic device 101 before visual object 340. When the first state and the second state are different, electronic device 101 may display a visual object (e.g., visual object 340) representing the avatar in the second state in screen 310. Figure 5a Visual object 522 and / or Figure 5b Using the visual object representing the avatar in the second state, the electronic device 101 can visualize a history in which the state of the avatar is modified from the second state to the first state.

[0116] According to an embodiment, in screen 310, the electronic device 101 may store the state of the avatar corresponding to the visual object 340 as the state of the avatar last viewed by the user 110 in the electronic device 101 and / or the external electronic device 120 based on the input indicating that the visual object 340 is viewed. The electronic device 101 may recognize the input by comparing the portion of the screen 310 focused by the user 110 with the portion of the screen 310 displaying the visual object 340. Figure 6 According to an embodiment, an example of an operation in which the electronic device 101 recognizes a portion of the screen 310 focused by the user 110 will be described.

[0117] Figure 6 An example of an operation in which the electronic device 101 recognizes an input with respect to a visual object corresponding to the virtual object 340 according to an embodiment is shown. Figure 6 The electronic device 101 and the external electronic device 120 may include Figures 1 to 3 , Figures 4a to 4c and / or Figure 5a to Figure 5b electronic device 101 and external electronic device 120.

[0118] refer to Figure 6 According to an embodiment, the electronic device 101 displays a virtual space (eg, Figure 1 An exemplary state of at least a portion of a virtual space 140). Figure 6 , the electronic device 101 may display a visual object 340 representing an avatar of another user different from the user 110. When the first state of the avatar corresponding to the visual object 340 is different from the second state of the avatar that the user 110 last viewed or last displayed by the electronic device 101, the electronic device 101 may display a visual object 522 representing the avatar in the second state. Figure 6 , the electronic device 101 may display a visual object 520 having a bubble form including a visual object 522 together with the visual object 340. In the visual object 520, the electronic device 101 may visualize a history in which the appearance of the avatar is modified from the second state to the first state by displaying a visual object 524 representing the avatar in the first state.

[0119] exist Figure 6 In the exemplary state, according to an embodiment, the electronic device 101 can be configured to Figure 2 The electronic device 101 may identify information related to the user 110 based on the sensor 250. Figure 2The IMU 254 of the electronic device 101 identifies information indicating the movement of the head of the user 110 wearing the electronic device 101. Based on the information, the electronic device 101 can identify the direction 620 of the head of the user 110. Based on the direction 620 of the head, the electronic device 101 can identify the portion 610 of the screen 310 to which the direction 620 points.

[0120] For example, the electronic device 101 may be based on Figure 2 The image sensor 252 of the electronic device 101 recognizes information indicating the movement of the hand 640 (for example, a frame including the hand 640). The information related to the hand 640 can be obtained by an image sensor provided in the electronic device 101 toward another direction opposite to a direction toward the head of the user 110. Based on the information, the electronic device 101 can recognize the direction of at least one finger included in the hand 640. The electronic device 101 can recognize the portion 610 indicated by the at least one finger in the screen 310 based on the direction of the at least one finger.

[0121] For example, the electronic device 101 may be based on Figure 2 The image sensor 252 of the electronic device 101 identifies information indicating the gaze direction of the user. The information may include a frame 630 including the user's eyes. The frame 630 may be obtained by an image sensor disposed toward the eyes of the user 110 in the electronic device 101. Based on the information, the electronic device 101 may identify a portion 610 within the screen 310 to which the user's eyes are directed. Based on identifying the direction of the gaze toward a portion (such as portion 610) within the screen 310 in which the visual object 340 is displayed, the electronic device 101 may identify an input indicating that the visual object 340 is to be browsed. Based on identifying the input, the electronic device 101 may display a visual object (e.g., a bounding box) including at least a portion of the visual object 340 (e.g., the face of an avatar represented by the visual object 340). For example, the electronic device 101 may display the visual object in the form of a preset color (e.g., yellow).

[0122] For example, the electronic device 101 can use Figure 2 The electronic device 101 may recognize information indicating the user's voice 650 by the microphone 256 of the user's mobile phone. The information may include an audio signal output from the microphone 256. The information may include a result of performing speech-to-text (STT) on the audio signal (e.g., text indicating the voice). The electronic device 101 may recognize the name of the user (in the text indicating the voice) calling the visual object 340 based on the text included in the information. Figure 6 In the embodiment, the natural language sentence (for example, "Hi Jessica") of the visual object 340 is used to identify that the visual object 340 is browsed by the user 110.

[0123] As shown in the example, the electronic device 101 may recognize an input indicating that the visual object 340 is to be browsed based on the head direction 620, gaze direction, hand direction 640, and / or voice 650 of the user 110. For example, based on the direction 620 of the head of the user 110, the gaze direction, the hand direction 640, and / or the voice 650, the electronic device 101 may recognize whether the user 110 browses the visual object 340. Based on whether the user 110 browses the visual object 340, the electronic device 101 may stop displaying the visual object 520 including the history of the avatar related to the visual object 340. For example, based on recognizing the voice 650 including the name of the user corresponding to the avatar, the electronic device 101 may stop displaying the visual object 520. The embodiment is not limited thereto, and the electronic device 101 may stop displaying the visual object 520 in response to the input indicating that the visual object 520 is selected. The embodiment is not limited thereto, and the electronic device 101 may display the visual object 520 within the screen 310 in response to an input indicating browsing of the visual object 340 , while not displaying the visual object 520 indicating the history of the avatar corresponding to the visual object 340 .

[0124] For example, based on the duration and / or number of times that the gaze direction of the user 110 identified by the frame 630 stops in the visual object 340, the electronic device 101 can identify whether the user 110 browses the visual object 340. For example, it can be identified whether the duration and / or number of times that the gaze direction of the user 110 stops in the portion 610 exceeds a preset duration and / or a preset number of times. When the gaze of the user 110 stops in the portion 610 for more than a preset duration and / or enters the portion 610 for more than a preset number of times, the electronic device 101 can stop displaying the visual object 520. Based on the preset duration and / or the preset number of times, the electronic device 101 can more accurately identify whether the user 110 browses the visual object 340.

[0125] According to an embodiment, the electronic device 101 may transmit information indicating whether the user 110 browses the visual object 340 to the external electronic device 120. For example, the electronic device 101 may transmit the head direction 620, the hand direction 640, the voice 650, and / or the frame 630 to the external electronic device 120. For example, the electronic device 101 may transmit information about an input indicating browsing of the visual object 340 to the external electronic device 120.

[0126] In an embodiment, the external electronic device 120 may identify whether the visual object 340 is browsed by the user 110 based on the information sent from the electronic device 101. When the visual object 340 is browsed by the user 110, the external electronic device 120 may store information related to the visual object 340. The information may include data for displaying an avatar corresponding to the visual object 340. The information may include data indicating the state of the avatar corresponding to the visual object 340. The information may include data indicating one or more costumes attached to the avatar. The information may include a timestamp indicating the moment when the visual object 340 is browsed by the user 110 and / or the moment when the electronic device 101 displays the visual object 340 in the screen 310.

[0127] According to an embodiment, similar to the operation of storing information in the external electronic device 120, the electronic device 101 may store information indicating that the visual object 340 is browsed by the user 110 in the electronic device 101. For example, the electronic device 101 may store data indicating the state of the avatar corresponding to the visual object 340. For example, the electronic device 101 may store a timestamp indicating the moment for displaying the visual object 340 through the screen 310. The electronic device 101 may store data indicating one or more virtual objects corresponding to each of one or more costumes incorporated into the avatar. In response to an input indicating that the visual object 340 is to be browsed, the operation of the electronic device 101 stopping displaying the visual object 520 may be similar to the reference 1. Figure 5a The above operations are performed.

[0128] As described above, according to an embodiment, the electronic device 101 may display a visual object 340 representing another user distinguished from the user 110 by communicating with the external electronic device 120. The visual object 340 may include an image and / or video recorded by the electronic device of the other user. The visual object 340 may correspond to at least a portion of an avatar of the other user registered in the external electronic device 120. The electronic device 101 may display another visual object (e.g., visual object 522) representing another user before the visual object 340 displayed by the electronic device 101, as well as the visual object 340. By displaying the other visual object together with the visual object 340, the electronic device 101 may visualize to the user 110 the history of the modification of the virtual object (e.g., avatar, image, and / or video) representing the other user. Based on the other visual object displayed together with the visual object 340, the user 110 having a history of viewing the other visual object may more quickly recognize that the visual object 340 is a representation of another user corresponding to the other visual object.

[0129] In the following, reference Figure 7 , according to an embodiment, one or more signals exchanged by the electronic device 101 and the external electronic device 120 are described.

[0130] Figure 7 An example of a signal flow chart between the electronic device 101 and the external electronic device 120 according to an embodiment is shown. Figure 7 The electronic device 101 and the external electronic device 120 may include Figure 1 , Figure 2 , Figure 3 , Figure 4a , Figure 4b , Figure 4c , Figure 5a , Figure 5b and / or Figure 6 electronic device 101 and external electronic device 120. Figure 7 The operation of the electronic device 101 can be performed by Figure 2 The electronic device 101 and / or Figure 2 Executed by the processor 210 in the electronic device 101. Figure 7 The operation of the external electronic device 120 can be performed by Figure 2 The external electronic device 120 and / or Figure 2 The processor 210 in the external electronic device 120 executes.

[0131] refer to Figure 7 In operation 710, according to an embodiment, the external electronic device 120 may transmit information for displaying a virtual object. The external electronic device 120 may transmit information for displaying a virtual object via a communication circuit (eg, Figure 2 The communication circuit 230 in the external electronic device 120 sends information to one or more electronic devices (eg, Figure 2 The information may include information for visualizing a virtual space including one or more virtual objects (eg, Figure 1 The virtual object in operation 710 may indicate a user who has accessed another electronic device different from the electronic device 101 that receives the information in operation 710. For example, the virtual object in operation 710 may include an avatar of the user. For example, the virtual object in operation 710 may include an image and / or video streamed from another electronic device.

[0132] refer to Figure 7 In operation 720, according to an embodiment, the electronic device 101 may display a first visual object representing a virtual object. Based on the information received in operation 710, the electronic device 101 may display a first visual object representing a virtual object in operation 710. The first visual object may be related to the virtual object in the current state, such as Figure 1 The second visual object 160-2, Figure 3Visual objects 330, 340, 350 and 360, Figure 4a Visual objects 444, Figure 4b and Figure 4c Visual objects 464, Figure 5a Visual objects 340 and 524 and / or Figure 5b The visual object 540 is in the third state 540-3.

[0133] refer to Figure 7 , in operation 730, according to an embodiment, the electronic device 101 may identify a second state before the first state of the virtual object based on a history in which the state of the virtual object corresponding to the first visual object is modified. The electronic device 101 may identify the second state based on a history stored in the electronic device 101 and / or the external electronic device 120. For example, the electronic device 101 may identify a history of a user corresponding to the virtual object being displayed in a memory of the electronic device 101. For example, the electronic device 101 may request the external electronic device 120 for information indicating the history. According to an embodiment, in operation 735, based on the request for information, the external electronic device 120 may send information indicating the history displayed by the virtual object to the user of the electronic device. Based on the history, the electronic device 101 may identify the user of the electronic device 101 (for example, Figures 1 to 6 The second state of the virtual object that the user 110 has browsed.

[0134] refer to Figure 7 In operation 740, according to an embodiment, the electronic device 101 may display a second visual object representing the recognized virtual object in the second state and the first visual object. When the virtual object in the second state is different from the first state of the virtual object corresponding to the first visual object in operation 720, the electronic device 101 may perform operation 740 to display the first visual object and the second visual object together. The second visual object of operation 740 may include Figure 1 Visual objects 170, Figure 3 Visual objects 345, 355 and 365, Figure 4a Visual objects 442, Figure 4b and Figure 4c Visual objects 462, Figure 5a Visual objects 522, Figure 5b The visual object 540 of the first state 540-1 and Figure 6 522 of visual objects.

[0135] refer to Figure 7 In operation 750, according to an embodiment, the electronic device 101 may recognize an input indicating that the first visual object is to be browsed. Figure 6 As described, the electronic device 101 may be based on a user of the electronic device 101 (eg, Figure 6 The direction of a body part of the user 110 (e.g., the user's head, eyes, and / or hands) and / or the user's voice (e.g., Figure 6 Based on recognizing the input indicating that the first visual object is to be browsed, the electronic device 101 may store information indicating that the user of the electronic device 101 has browsed the virtual object in the first state. Figure 7 Based on recognizing the input, the electronic device 101 may send information related to the input to the external electronic device 120 .

[0136] refer to Figure 7 , in operation 760, according to an embodiment, the external electronic device 120 may store information indicating that the user of the electronic device has browsed the virtual object in the first state based on the input recognized by the electronic device. The external electronic device 120 may perform operation 760 based on identifying information related to the input of operation 750 from the electronic device 101. Based on operation 760, the external electronic device 120 may store information indicating the first state of the first visual object of operation 720 and / or the virtual object used to display the first visual object. The external electronic device 120 may store the information indicating the first state of the virtual object as the state of the virtual object last browsed by the user of the electronic device 101. For example, when the state of the virtual object is modified after operation 760, the external electronic device 120 may send the data of the virtual object in the modified state to the electronic device 101 together with the data of the virtual object in the first state.

[0137] Figure 8 An example of a flow chart of an electronic device according to an embodiment is shown. Figure 8 The electronic device may include Figure 1 , Figure 2 , Figure 3 , Figure 4a , Figure 4b , Figure 4c , Figure 5a , Figure 5b , Figure 6 and Figure 7 An electronic device 101. Figure 8 The operation of the electronic device can be Figure 2 The electronic device 101 and / or Figure 2 Executed by the processor 210 in the electronic device 101. Figure 8 At least one operation of the electronic device may be related to Figure 7 Related to at least one operation of the electronic device 101.

[0138] refer to Figure 8In operation 810, according to an embodiment, the electronic device may display a first visual object representing a virtual object in a first state. Figure 7 At operation 720, the electronic device may perform Figure 8 Operation 810. Based on the external electronic device (e.g., Figures 1 to 7 When the external electronic device 120 receives information related to the virtual object in the first state, the electronic device may display a first visual object representing the virtual object in the first state.

[0139] refer to Figure 8 In operation 820, according to an embodiment, the electronic device may identify information related to the number of times the virtual object in the first state has been viewed. The electronic device may identify the information of operation 820 in a state where a first visual object representing the virtual object in the first state is displayed based on operation 810. The information may be stored in an external electronic device in operation 810 and / or in the electronic device in operation 810. The information may include the state of the virtual object last viewed by the user of the electronic device. The information may include a history of the electronic device displaying the virtual object.

[0140] refer to Figure 8 In operation 830 according to an embodiment, the electronic device may determine whether the number of times the virtual object in the first state has been viewed is less than a preset number. The preset number may include a number, such as number 1, indicating whether the virtual object in the first state has been viewed for the first time by the user of the electronic device.

[0141] refer to Figure 8 When the number of times the virtual object in the first state is browsed is less than the preset number (830-Yes), the electronic device according to the embodiment may display the second visual object representing the virtual object before the first state and the first visual object based on operation 840. Figure 7 At operation 740, the electronic device may perform Figure 8 Operation 840. When the number of times the virtual object in the first state is browsed exceeds the preset number of times (830-No), the electronic device may bypass displaying the second visual object in operation 840. For example, when the number of times the virtual object in the first state is browsed exceeds the preset number of times (830-No), the electronic device may stop displaying the second visual object.

[0142] refer to Figure 8 In operation 850 according to an embodiment, the electronic device may determine whether an input indicating that the first visual object is to be browsed has been recognized. Figure 6 The input may be a sensor included in the electronic device (e.g., Figure 2 Sensor 250) recognition. Similar to Figure 7 At operation 750, the electronic device may perform Figure 8 The electronic device may continue to display the first visual object until an input indicating that the first visual object is to be browsed is recognized (850-No). When the electronic device displays the second visual object in operation 840, the electronic device may continue to display the second visual object and the first visual object until an input indicating that the first visual object is to be browsed is recognized (850-No).

[0143] refer to Figure 8 In a state where an input indicating that the first visual object is to be browsed is recognized (850-Yes), the electronic device may store information indicating that the first visual object has been browsed based on operation 860. Figure 7 At operation 750, the electronic device may perform Figure 8 Operations 850 and 860 of the present invention may be performed. For example, the information may include data for visualizing the virtual object in the first state in operation 810. The information may be stored in the electronic device or an external electronic device that provides the virtual object in the first state. When the state of the virtual object is modified to another state different from the first state after operation 860, the information stored in operation 860 may be used to indicate the virtual object in the first state and the virtual object in another state to the user of the electronic device.

[0144] Fig. 9 An example of a flow chart of an electronic device according to an embodiment is shown. Fig. 9 The electronic device may include Figure 1 , Figure 2 , Figure 3 , Figure 4a , Figure 4b , Figure 4c , Figure 5a , Figure 5b , Figure 6 and Figure 7 An electronic device 101. Fig. 9 The operation of the electronic device 101 can be performed by Figure 2 The electronic device 101 and / or Figure 2 Executed by the processor 210 in the electronic device 101. Fig. 9 At least one operation can be combined with Figure 7 At least one operation of the electronic device 101 and / or Figure 8 is related to at least one operation.

[0145] refer to Fig. 9 In operation 910, according to an embodiment, the electronic device may display a first visual object representing a virtual object. Figure 7 Operation 720 and / or Figure 8 At operation 810, the electronic device may perform Fig. 9 Operation 910.

[0146] refer to Fig. 9 In operation 920, according to an embodiment, the electronic device may receive a signal from an external electronic device (eg, Figures 1 to 7 The external electronic device 120) obtains an instruction from a user of the electronic device (eg, Figures 1 to 6 For example, the electronic device may request the external electronic device to send information about the state of the virtual object browsed by the user 110). Figure 7 For example, the electronic device may recognize information within a signal transmitted from an external electronic device to display the first visual object of operation 910. Based on operation 920, the electronic device may obtain information including a history of displaying virtual objects to a user of the electronic device.

[0147] refer to Fig. 9 In operation 930, according to an embodiment, the electronic device may identify whether the state of the virtual object indicated by the information in operation 920 is different from the first state of the virtual object used to display the first visual object. For example, the electronic device may identify whether the state of the virtual object displayed by the user of the electronic device is different from the first state. For example, when the virtual object is modified between a first moment when the first visual object is displayed based on operation 910 and a second moment when the virtual object is displayed before operation 910, the electronic device may identify that the first state of the virtual object in operation 910 is different from the state of the virtual object at the second moment.

[0148] When the first state of the virtual object used to display the first visual object is different from the second state of the virtual object indicated by the information in operation 920 (930-Yes), the electronic device may display the second visual object indicating the virtual object in the second state indicated by the information in operation 930 and the first visual object based on operation 940. Figure 7 Operation 740 and / or Figure 8 At operation 840, the electronic device may perform Fig. 9 When the first state and the second state match (930-Yes), the electronic device may bypass the execution of operation 940. In the state of bypassing the execution of operation 940, the electronic device may stop displaying the second visual object of operation 940.

[0149] refer to Fig. 9 In operation 950, according to an embodiment, the electronic device may identify whether an input indicating that the first visual object is to be browsed has been recognized. Figure 7 Operation 750 and / or Figure 8 At operation 850, the electronic device may perform Fig. 9Operation 950. Before recognizing the input in operation 950, the electronic device may keep displaying the first visual object.

[0150] In a state where an input indicating that the first visual object is to be browsed is recognized (950-Yes), the electronic device according to an embodiment may store information indicating that the first visual object has been browsed based on operation 960. Figure 8 At operation 860, the electronic device may perform Fig. 9 Operation 960.

[0151] Metaverse is a combination of the English words Meta (meaning "virtual" and "transcendent") and Universe (meaning "universe"), and refers to a three-dimensional virtual world where social, economic, and cultural activities take place like in the real world. Metaverse is a concept that is one step further than virtual reality, and is characterized by the use of avatars to enjoy not only games or virtual reality (VR, a cutting-edge technology that allows people to experience real life in a computerized virtual world), but also social and cultural activities like reality.

[0152] Such a metaverse service can be provided in at least two forms. The first form is to provide services to users through the use of a server, while the second form is to provide services through personal connections between users.

[0153] Fig.10 is an example diagram of a first embodiment environment 1001 providing a metaverse service through a server 1010 .

[0154] refer to Fig.10 , the first embodiment environment 1001 includes: a server 1010 providing a metaverse service; a network (e.g., a network formed by at least one intermediate node 1030 including an access point (AP) and / or a base station) connecting the server 1010 and each user terminal (e.g., a user terminal 1020 including a first terminal 1020-1 and a second terminal 1020-2); and a user terminal capable of using the service by accessing the server via the network. The server 1010 provides input and output for the metaverse service to the user.

[0155] In this case, the server 1010 provides a virtual space so that the user terminal 1020 can perform activities in the virtual space. In addition, the user terminal 1020 installs an S / W agent for accessing the virtual space provided by the server 1010 to display information provided by the server 1010 to the user or to send information that the user wants to display in the virtual space to the server.

[0156] The S / W agent may be provided directly through the server 1010 or downloaded from a public server, or may be embedded when the terminal is purchased.

[0157] Fig.11 is an example diagram of a second embodiment environment 1002 for providing a metaverse service through a direct connection between a user terminal and a second terminal (eg, a first terminal 1020 - 1 and a second terminal 1020 - 2 ).

[0158] refer to Fig.11 , the environment 1002 of the second embodiment includes a first terminal 1020-1 that provides a metaverse service, a network connecting each user terminal (e.g., a network formed by at least one intermediate node 1030), and a second terminal 1020-2 that allows a second user to use the service by connecting to the first terminal 1020-1 via the network to perform input / output for the metaverse service.

[0159] The second embodiment is characterized in that the first terminal 1020-1 executes the server in the first embodiment (for example, Fig.10 That is, it can be seen that the virtual reality environment can be configured only by connecting the device to the device.

[0160] In the first and second embodiments, the user terminal 1020 (or the user terminal 1020 including the first terminal 1020-1 and the second terminal 1020-2) can be made of various form factors and is characterized in that it includes an output device that provides images or / and sounds to the user and an input device for inputting information into the metaverse service. Examples of various form factors of the user terminal 1020 may include a smart phone (e.g., the second terminal 1020-2), an AR device (e.g., the first terminal 1020-1), a VR device, an MR device, a VST device, or a TV or projector capable of input / output, etc. Although the first and second embodiments are described for illustrative purposes, it should be understood that the environments 1001 and 1002 are not meant to be exclusive. In one or more embodiments, the user terminal can seamlessly switch between operations in the example environments 1001 and 1002. In one or more embodiments, the user terminal can operate in the example environments 1001 and 1002.

[0161] The network of one or more embodiments of the present invention (e.g., a network formed by at least one intermediate node 1030) includes all kinds of broadband networks (including 3G, 4G and 5G) and short-distance networks (e.g., a wired network or a wireless network directly connecting the first terminal 1020-1 and the second terminal 1020-2) (including Wi-Fi, BT, etc.).

[0162] Figure 10 to Figure 11 The user terminal 1020 may be Figures 1 to 7 The electronic device 101 and / or Figure 8 and Fig. 9 An example of an electronic device. Fig.10 The server 1010 may be Figures 1 to 7 The external electronic device 120 and / or Figure 8 and 9 Examples of external electronic devices.

[0163] As described above, according to an embodiment, in a state where at least a portion of a virtual space provided by an external electronic device is visualized, the electronic device may display a visual object representing another user who is connected to the user of the electronic device through the virtual space. In a state where a visual object in a first state is displayed, the electronic device may recognize a history in which a visual object in a second state different from the first state is displayed as a visual object representing another user. Based on the recognized history, the electronic device may display another visual object in the second state as well as the visual object in the first state.

[0164] A method of displaying to a user of an electronic device a modification history of a visual object representing another user distinguished from the user may be desired. Figures 1 to 7 The electronic device 101 may include a display (eg, Figure 2 display 240), communication circuitry (e.g., Figure 2 communication circuit 230) and a processor (e.g., Figure 2 The processor may be configured to receive information from an external electronic device (e.g., Figures 1 to 7 The external electronic device 120 receives the information, and displays a first visual object (eg, Figure 3 Visual objects 330, 340, 350, 360, Figure 4a Visual objects in 442, Figure 4b and Figure 4c Visual objects in 462, Figure 5a Visual object 524 and / or Figure 6 The processor may be configured to identify, based on the information, a number of times the first visual object has been displayed by the display. The processor may be configured to display, based on identifying that the number of times is less than a preset number, a second visual object (e.g., Figure 3 According to an embodiment, the electronic device may display a second visual object previously displayed as a representation of a user before the first visual object, and the first visual object representing the user.

[0165] For example, in a virtual space including a first visual object (eg, Figure 1In a virtual space 140 of the electronic device, the processor may be configured to obtain information including an interaction history between a user of the electronic device and a user corresponding to the first visual object.

[0166] For example, the processor may be configured to identify from the information a number of times a user of the electronic device has viewed the first visual object via the display.

[0167] For example, the processor may be configured to store another information associated with the first visual object based on the input indicating browsing of the first visual object and the time when the input was identified.

[0168] For example, the electronic device may also include a sensor (e.g., Figure 2 The processor may be configured to recognize input based on a gaze direction of a user of the electronic device identified by using data from the sensor.

[0169] For example, the processor may be configured to display a first visual object (eg, Figure 3 of visual objects 350).

[0170] For example, the processor may be configured to display a first visual object (eg, Figure 3 visual objects 330, 340 and 360).

[0171] For example, the electronic device may further include a memory (eg, Figure 2 The processor may be configured to: based on identifying data indicating a user corresponding to the first visual object in the contact list stored in the memory, stop displaying at least a portion of the second visual object; and display at least a portion of the data together with the first visual object.

[0172] For example, the processor may be configured to display an animated transition from the second visual object to the first visual object while displaying the second visual object and the first visual object.

[0173] As described above, according to an embodiment, the method of the electronic device may include displaying to a first user of the electronic device (eg, Fig. 9 Operation 910) represents a first visual object of a second user and included in a virtual space. The method may include obtaining (for example, Fig. 9 The method may include identifying a second visual object different from the first visual object from the information, displaying the second visual object and the first visual object displayed to the first user (e.g., Fig. 9 Operation 940).

[0174] For example, displaying the second visual object may include identifying (e.g., Fig. 9 Operation 930 ) Whether the visual object indicated by the information is different from the first visual object.

[0175] For example, displaying the second visual object may include transmitting a signal for modifying information stored in the external electronic device based on the first visual object in response to an input indicating browsing of the first visual object.

[0176] For example, displaying the second visual object may include identifying a gaze direction of the first user in a display of the electronic device based on data from a sensor of the electronic device. Displaying the second visual object may include identifying an input based on the identified direction.

[0177] For example, identifying the input may include obtaining a duration or a number of times the first visual object has been viewed based on the identified direction. Identifying the input may include identifying the input based on at least one of the duration or the number of times.

[0178] For example, displaying the second visual object may include displaying an intermediate form between the second visual object and the first visual object.

[0179] For example, the method of the electronic device may include displaying (eg, Figure 8 Operation 810) represents a first visual object of a user. The method may include identifying (for example, Figure 8 The method may include, based on identifying that the number of times is lower than a preset number of times, displaying (for example, Figure 8 Operation 840 ) represents a second visual object of the user before the first visual object and the first visual object.

[0180] For example, the identifying may include obtaining information including an interaction history between a user of the electronic device and a user corresponding to the first visual object in a virtual space including the first visual object.

[0181] For example, identifying may include identifying, from the information, a number of times a user of the electronic device has viewed the first visual object via the display.

[0182] For example, identifying may include storing further information associated with the first visual object based on an input indicating browsing of the first visual object and identifying a time at which the input was input.

[0183] For example, displaying the first visual object may include displaying the first visual object based on a video received from an external electronic device.

[0184] For example, identifying may include stopping displaying at least a portion of the second visual object and displaying at least a portion of the data along with the first visual object based on identifying data indicating a user corresponding to the first visual object in a contact list stored in a memory of the electronic device.

[0185] For example, displaying the second visual object may include displaying an animated transition from the second visual object to the first visual object.

[0186] As described above, according to an embodiment, an electronic device (eg, Figures 1 to 7 The electronic device 101 may include a display (eg, Figure 2 display 240), communication circuitry (e.g., Figure 2 communication circuit 230) and a processor (e.g., Figure 2 The processor may be configured to display the electronic device to a first user (eg, Figure 1 The first user 110-1) displays a representation of the second user (eg, Figure 1 The second user 110 - 2 ) and is included in the virtual space (eg, Figure 1 A first visual object (eg, Figure 1 The second visual object 160-2 in Figure 3 Visual objects 330, 340, 350, 360, Figure 4a Visual objects in 442, Figure 4b and Figure 4c Visual objects in 462, Figure 5a Visual object 524 and / or Figure 6 The processor may be configured to receive from an external electronic device (e.g., Figures 1 to 7 The processor may be configured to identify a second visual object different from the first visual object (e.g., Figure 1 Visual object 172 and / or Figure 3 The second visual object is displayed together with the first visual object displayed to the first user.

[0187] For example, the processor may be configured to identify whether the visual object indicated by the information is different from the first visual object by comparing the state of one or more virtual objects combined with the second user's avatar, wherein the state is obtained by the information.

[0188] For example, the processor may be configured to transmit, in response to an input indicating browsing of the first visual object, a signal for modifying information stored in the external electronic device based on the first visual object.

[0189] For example, the electronic device may include a sensor (e.g., Figure 2 The processor may be configured to identify a gaze direction of the first user in the display based on the data from the sensor. The processor may be configured to identify an input based on the identified direction.

[0190] For example, the processor may be configured to obtain a duration or a number of times the first visual object has been viewed based on the identified direction.The processor may be configured to identify the input based on at least one of the duration or the number of times.

[0191] For example, the processor may be configured to display an intermediate form between the second visual object and the first visual object.

[0192] As described above, according to an embodiment, a wearable device may include a display, a processor, and a memory storing instructions. The instructions, when executed by the processor, may cause the wearable device to display a virtual space on the display based on receiving an input for entering the virtual space. The instructions, when executed by the processor, may cause the wearable device to display a first avatar in the virtual space, the first avatar being a current representation of the user and having a first appearance. The instructions, when executed by the processor, may cause the wearable device to display a visual object of the first avatar and a second avatar in the virtual space, the second avatar being a previous representation of the user and having a second appearance different from the first appearance of the first avatar.

[0193] According to an embodiment, the wearable device may include a display, a memory for storing instructions, and at least one processor for executing the instructions. The at least one processor may be configured to receive information from an external electronic device associated with an avatar located in the virtual space based on an input indicating entry into the virtual space. The at least one processor may be configured to display at least a portion of the virtual space including an avatar of a first appearance based on the received information. The at least one processor may be configured to display a visual object with an avatar based on information further including an avatar of a second appearance displayed by the wearable device before receiving the input, the avatar representing the avatar of the second appearance.

[0194] For example, the at least one processor may be configured to display a visual object including text associated with a moment when the avatar changes from the second appearance to the first appearance.

[0195] For example, the at least one processor may be configured to, while displaying the avatar in a combined form with at least one virtual object representing clothing, display a visual object to visualize a history of clothing coupled to the avatar being modified.

[0196] For example, the at least one processor may be configured to, while displaying the avatar and the visual object, cease displaying the visual object based on identifying a gaze direction of the user toward the avatar or the visual object.

[0197] For example, the at least one processor may be configured to, while displaying the avatar and the visual object, cease displaying the visual object based on recognizing an audio signal associated with an identifier of the avatar.

[0198] For example, the at least one processor can be configured to display the avatar together with the indicator positioned in association with the avatar based on information further including the avatar of the second appearance displayed by the wearable device before receiving the input. The at least one processor can be configured to display the visual object and stop displaying the indicator based on another input about the indicator.

[0199] For example, the at least one processor may be configured to cease displaying the visual object while displaying the identifier of the avatar.

[0200] As described above, according to an embodiment, a non-transitory computer-readable medium may be configured to store instructions. The instructions may be configured to, when executed by at least one processor of a wearable device, cause the at least one processor to display a virtual space on a display of the wearable device based on receiving an input for entering the virtual space. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display a first avatar in the virtual space, the first avatar being a current representation of the user and having a first appearance. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display a visual object of the first avatar and a second avatar in the virtual space, the second avatar being a previous representation of the user and having a second appearance different from the first appearance of the first avatar.

[0201] According to an embodiment, a non-transitory computer-readable medium may be configured to store instructions. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to receive information from an external electronic device associated with an avatar located in the virtual space based on an input indicating that the virtual space is to be entered. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display at least a portion of the virtual space including an avatar of a first appearance based on the received information. The instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display a visual object with an avatar based on information further including an avatar of a second appearance displayed by the wearable device before receiving the input, the avatar representing the avatar of the second appearance.

[0202] For example, the instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to display a visual object including text associated with the moment when the avatar changes from the second appearance to the first appearance.

[0203] For example, the instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor, when displaying an avatar in a combined form having at least one virtual object representing clothing, to display a visual object to visualize a history of modifications to clothing incorporated into the avatar.

[0204] For example, the instructions can be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to stop displaying the visual object based on identifying a user's gaze direction toward the avatar or the visual object when displaying the avatar and the visual object.

[0205] For example, the instructions can be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to stop displaying the visual object while displaying the avatar and the visual object based on recognizing an audio signal associated with an identifier of the avatar.

[0206] For example, the instructions, when executed by at least one processor of the wearable device, may cause the at least one processor to display an avatar with an indicator positioned in association with the avatar based on information further including the avatar of the second appearance displayed by the wearable device prior to receiving the input. The instructions, when executed by at least one processor of the wearable device, may cause the at least one processor to display the visual object and cease displaying the indicator based on another input regarding the indicator.

[0207] For example, the instructions may be configured to, when executed by at least one processor of the wearable device, cause the at least one processor to cease displaying the visual object while displaying an identifier of the avatar.

[0208] As described above, according to an embodiment, a method of an electronic device may include information of identifying an avatar within a virtual space based on a request for a wearable device to enter the virtual space. The method may include: based on the information of identifying the avatar of the first appearance, based on identifying that the avatar of the first appearance is different from the avatar of the second appearance displayed by the wearable device before the request, sending information including the avatar of the first appearance and the modification history of the avatar from the second appearance to the first appearance to the wearable device. The method may include: based on the information of identifying the avatar of the first appearance, based on identifying that the avatar of the first appearance is the same as the avatar of the second appearance, sending information including the avatar of the first appearance without the history to the wearable device.

[0209] In an embodiment, a method of a wearable device including a display, a memory, and a processor is provided. The method may include displaying the virtual space on the display based on receiving an input for entering the virtual space. The method may include displaying a first avatar that is a current representation of a user and has a first appearance within the virtual space. The method may include displaying a visual object of the first avatar and a second avatar that is a previous representation of the user and has a second appearance different from the first appearance of the first avatar within the virtual space.

[0210] For example, sending the information having the history may include sending the information including text associated with the moment when the avatar changed from the second appearance to the first appearance.

[0211] For example, the identifying may include identifying information of an avatar having a combined form of at least one virtual object representing clothing, and wherein the information includes a moment when the at least one virtual object is combined to the avatar.

[0212] For example, the method may include determining whether to send information including history by comparing the time to a most recent time of an avatar displayed by the wearable device.

[0213] For example, the identification may include identifying information of an avatar different from another avatar representing a user logged into the wearable device based on the request.

[0214] For example, the method may include, in response to a signal from the wearable device indicating that input for viewing an avatar or visual object was received, storing information indicating that an avatar of a first appearance was viewed by a user of the wearable device.

[0215] The above-mentioned device can be implemented as a hardware component, a software component and / or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments can be implemented using one or more general-purpose computers or special-purpose computers (such as processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs), programmable logic units (PLUs), microprocessors, and any other device capable of executing and responding to instructions). The processing device can execute an operating system OS and one or more software applications executed on the operating system. In addition, the processing device can access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, although it can be described as using a processing device, it can be understood by those skilled in the art that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or a processor and a controller. In addition, other processing configurations such as parallel processors are also possible.

[0216] Software may include computer programs, codes, instructions, or a combination of one or more of them, and configures a processing device to operate as needed or command the processing device independently or in combination. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by or provide instructions or data to a processing device. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

[0217] The method according to the embodiment can be implemented in the form of program instructions, which can be executed by various computer devices and recorded in a computer-readable medium. In this case, the medium can continuously store computer executable programs or temporarily store programs for execution or downloading. In addition, the medium can be a variety of recording devices or storage devices in which a single or multiple hardware is combined, which is not limited to the medium directly connected to any computer system, and can be distributed on a network. Examples of media may include magnetic media such as hard disks, floppy disks and tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, ROMs, RAMs, flash memories, etc., to store program instructions. Examples of other media include application stores that distribute applications, sites that supply or distribute various software, and recording media or storage media managed by servers.

[0218] Although the embodiments have been described above based on limited embodiments and drawings, it is apparent to those skilled in the art that various modifications and variations may be made based on the above description. For example, even if the described techniques are performed in a different order than the described methods, and / or components such as the described systems, structures, devices, circuits, etc. are combined or combined in a different form than the described methods, or are replaced or substituted by other components or equivalents, appropriate results may be achieved.

[0219] Accordingly, other implementations, other embodiments, and equivalents of the claims are within the scope of the claims described later.

Claims

1. A wearable device, comprising: monitor; processor; a memory storing instructions that, when executed by the processor, cause the wearable device to: displaying the virtual space on the display based on receiving an input for entering the virtual space; displaying, within the virtual space, a first avatar that is a current representation of the user and has a first appearance; as well as The first avatar is displayed within the virtual space along with visual objects of a second avatar that is a previous representation of the user and has a second appearance that is different than the first appearance of the first avatar.

2. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: A visual object including text associated with a moment in time when the first avatar changes from the second appearance to the first appearance is displayed.

3. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: While displaying the first avatar in a combined form with at least one virtual object representing clothing, the visual object is displayed to visualize a history in which the clothing coupled to the first avatar is modified.

4. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: While displaying the first avatar and the visual object, based on identifying a gaze direction of a user toward the first avatar or the visual object, ceasing to display the visual object.

5. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: While displaying the first avatar and the visual object, based on recognizing an audio signal associated with an identifier of the first avatar, ceasing to display the visual object.

6. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: displaying the first avatar together with an indicator positioned in association with the first avatar based on the information further comprising the second avatar of the second appearance displayed by the wearable device prior to receiving the input; Based on another input regarding the indicator, the visual object is displayed and the indicator is ceased to be displayed.

7. The wearable device according to claim 1, wherein: The instructions, when executed by the processor, cause the wearable device to: Displaying the visual object is stopped while displaying the identifier of the first avatar.

8. A non-transitory computer-readable medium storing instructions, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: displaying the virtual space on a display of the wearable device based on receiving an input for entering the virtual space; displaying, within the virtual space, a first avatar that is a current representation of the user and has a first appearance; as well as The first avatar is displayed within the virtual space along with visual objects of a second avatar that is a previous representation of the user and has a second appearance that is different than the first appearance of the first avatar.

9. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: A visual object including text associated with a moment in time when the first avatar changes from the second appearance to the first appearance is displayed.

10. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: While displaying the first avatar in a combined form with at least one virtual object representing clothing, the visual object is displayed to visualize a history in which the clothing coupled to the first avatar is modified.

11. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: While displaying the first avatar and the visual object, based on identifying a gaze direction of a user toward the first avatar or the visual object, ceasing to display the visual object.

12. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: While displaying the first avatar and the visual object, based on recognizing an audio signal associated with an identifier of the first avatar, ceasing to display the visual object.

13. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: displaying the first avatar together with an indicator positioned in association with the first avatar based on the information further comprising the second avatar of the second appearance displayed by the wearable device prior to receiving the input; Based on another input regarding the indicator, the visual object is displayed and the indicator is ceased to be displayed.

14. The non-transitory computer readable medium of claim 8, wherein: The instructions are configured to, when executed by at least one processor of a wearable device, cause the at least one processor to: Displaying the visual object is stopped while displaying the identifier of the first avatar.

15. A method of an electronic device, the method comprising: Based on a request from the wearable device to enter the virtual space, identifying information of an avatar in the virtual space; Based on the information identifying the avatar of the first appearance: based on recognizing that the avatar of the first appearance is different from the avatar of the second appearance displayed by the wearable device before the request, sending to the wearable device information including the avatar of the first appearance and a history of the avatar being modified from the second appearance to the first appearance; as well as Based on recognizing that the avatar of the first appearance is the same as the avatar of the second appearance, information including the avatar of the first appearance without the history is sent to the wearable device.

Images