Electronic device and method for controlling avatar included in virtual environment, and non-transitory computer-readable storage medium

By employing electronic devices with processors and communication circuits to manage avatar representations based on resource status, the system ensures consistent and dynamic avatar synchronization across devices, addressing the inconsistency in user experiences in virtual environments.

WO2024248298A1PCT designated stage expired Publication Date: 2024-12-05SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/003718
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-06
Filing Date
2024-03-25
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Current systems for controlling avatars in virtual environments lack the ability to dynamically adjust avatar representations based on the resource status of connected electronic devices, leading to inconsistent user experiences across different devices.

Method used

The development of electronic devices and methods that utilize a processor, communication circuit, and display to receive signals for changing avatar parts, bypassing resource limitations by displaying visual objects indicating changes adjacent to the avatar, and transmitting status information between devices to synchronize avatar states across a network.

Benefits of technology

This approach enhances user experience by ensuring consistent and dynamic avatar representation across various electronic devices, improving interaction and immersion in virtual environments by adapting to the resource status of each device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024003718_05122024_PF_FP_ABST
    Figure KR2024003718_05122024_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device, according to one embodiment, may display, on a display, an avatar which represents a human body model based on the resource state of the electronic device, and corresponds to an external electronic device that is separate from the electronic device. The electronic device may receive, from the external electronic device and by using a communication circuit, a signal for changing a portion of the avatar. The electronic device may bypass changing the portion of the avatar according to the resource state of the electronic device, and display, adjacent to the avatar, a visual object indicating the changing of the portion of the avatar. The present document may relate to a metaverse service for enhancing interconnectivity between a real object and a virtual object. For example, the metaverse service may be provided through a fifth generation (5G) and / or sixth generation (6G)-based network.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device, method and non-transitory computer-readable storage medium for controlling an avatar contained within a virtual environment

[0001] The present disclosure relates to an electronic device, method, and non-transitory computer-readable storage medium for controlling an avatar contained within a virtual environment.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices can provide AR services to users using avatars that correspond to the user.

[0003] In one embodiment, an electronic device may include a display, a communication circuit, and a processor. The electronic device may display, on the display, an avatar representing a human body model based on a resource status of the electronic device and corresponding to an external electronic device distinct from the electronic device. The electronic device may receive, using the communication circuit, a signal for changing a portion of the avatar from the external electronic device. The electronic device may bypass changing a portion of the avatar based on the resource status of the electronic device and display a visual object representing the change of the portion of the avatar adjacent to the avatar.

[0004] In one embodiment, a method performed by an electronic device may include an operation of displaying, on a display, an avatar representing a human body model based on a resource status of the electronic device and corresponding to an external electronic device distinct from the electronic device. The method may include an operation of receiving, from the external electronic device, a signal for changing a portion of the avatar using a communication circuit. The method may include an operation of bypassing changing a portion of the avatar based on the resource status of the electronic device and displaying a visual object representing a change in a portion of the avatar adjacent to the avatar.

[0005] In one embodiment, a non-transitory computer-readable storage medium storing one or more programs may include instructions. The instructions, when executed by a processor of an electronic device, may cause the electronic device to, in response to receiving a plurality of signals from each of a plurality of external electronic devices indicating entry into a virtual environment, transmit, via a communication circuit, information about avatars corresponding to each of the plurality of external electronic devices using information corresponding to each of the plurality of external electronic devices. The instructions, when executed by the processor of the electronic device, may cause the electronic device to receive, using the communication circuit, first state information for changing a state of a first avatar representing a human body model based on a resource state of the first external electronic device, from a first external electronic device among the plurality of external electronic devices. The instructions, when executed by a processor of the electronic device, may cause the electronic device, based on receiving the first state information, to change the first state information to second state information representing another human body model based on a resource state of a second external electronic device and changing a state of a second avatar corresponding to the first avatar. The instructions, when executed by the processor of the electronic device, may cause the electronic device to transmit the second state information to the second external electronic device using the communication circuit.

[0006] FIG. 1 illustrates an example of a state in which an electronic device displays an avatar based on a resource status through a server, according to one embodiment.

[0007] FIG. 2 is a block diagram of an electronic device and a server connected to the electronic device according to one embodiment.

[0008] FIG. 3 illustrates an example of information of an avatar corresponding to a user according to one embodiment.

[0009] FIG. 4 illustrates an example of avatars according to resource status of an electronic device, according to one embodiment.

[0010] FIG. 5 illustrates an example of an operation of an electronic device and a server according to one embodiment to change the motion of an avatar.

[0011] FIGS. 6A and 6B illustrate an example of an operation for changing the state of an avatar by an electronic device according to one embodiment.

[0012] FIG. 7 illustrates an example of a plurality of avatars displayed using a plurality of electronic devices according to one embodiment.

[0013] FIG. 8 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment.

[0014] FIG. 9 illustrates an example of a flowchart illustrating the operation of a server according to one embodiment.

[0015] FIG. 10 illustrates an example of a signal flow diagram representing signals transmitted and received between an electronic device and a server according to one embodiment.

[0016] Figure 11 is an example diagram of a network environment in which metaverse services are provided through a server.

[0017] FIG. 12 is a block diagram of an electronic device within a network environment according to various embodiments.

[0018] Hereinafter, various embodiments of this document are described with reference to the attached drawings.

[0019] FIG. 1 illustrates an example of a state in which an electronic device displays an avatar based on a resource status via a server, according to one embodiment. Referring to FIG. 1 , an exemplary network environment including electronic devices (101-1, 101-2) and / or a server (110) is illustrated, according to one embodiment. The electronic devices (101-1, 101-2) and the server (110) may be connected to each other based on a wired network and / or a wireless network. The electronic devices (101-1, 101-2) may refer to electronic devices (101-1, 101-2) owned by users (105-1, 105-2). Electronic devices (101-1, 101-2) may include personal computers (PCs) such as laptops and desktops, smartphones, smartpads, tablet PCs, smartwatches, and smart accessories such as head-mounted devices (HMDs).

[0020] According to one embodiment, an electronic device (101-1, 101-2) may access a server (110) providing a metaverse service and receive information indicating the metaverse service. For example, the electronic device (101-1, 101-2) may use the information to display a screen (151; 152) indicating at least a portion of a virtual environment on the display. The electronic device (101-1, 101-2) and the user (105-1, 105-2) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality. The information may include the shape of an avatar distinguished based on the user's profile information and information about the virtual environment.

[0021] For example, the electronic devices (101-1, 101-2) may be classified according to the type of the electronic devices (101-1, 101-2). For example, the first electronic device (101-1) may be a terminal owned by the user (105-1). The second electronic device (101-2) may be a terminal owned by the user (105-2). The second electronic device (101-2) may include an HMD (head-mounted display) that can be worn on the head of the user (105-2). The second electronic device (101-2) may be referred to as a wearable device in terms of being wearable by the user. The electronic devices (101-1, 101-2) may be classified according to the resource status of the electronic devices (101-1, 101-2). The resource status will be described later with reference to FIG. 2.

[0022] According to one embodiment, the server (110) can place an avatar within a virtual space based on a two-dimensional coordinate system or a three-dimensional coordinate system. The avatar can be an object placed within the virtual space (e.g., a desk, a tree, and / or a building), or can include an object that can move within the virtual space (e.g., avatars (121-1, 121-3, 122-1, 122-3)). The avatar can include a portion of terrain formed within the virtual space. The virtual space can be formed for a metaverse service provided by the server (110).

[0023] For example, the electronic device (101-1, 101-2) can receive information representing the virtual space from the server (110). The electronic device (101) can display a screen (151, 152) on the display based on receiving the information.

[0024] For example, the screens (151, 152) may include avatars and / or avatars (121-1, 121-3, 122-1, 122-3) included in the virtual space. The screens (151, 152) may be referred to as screens (e.g., shared screens) for sharing at least one image (or video) between users (105-1, 105-2) of each of a plurality of electronic devices (101-1, 101-2) that have accessed the server (110). For example, at least one piece of information included in the screen (151) may be substantially similar to at least one piece of information included in the screen (152). For example, the server (110) may synchronize the screens (151) and (152). The server (110) can transmit information representing the synchronized screens (151, 152) to each of the electronic devices (101-1, 101-2).

[0025] According to one embodiment, the server (110) may identify the type of the electronic device (101-1, 101-2) that accessed the server (110) and / or the profile information (e.g., user ID (identification)) of the user (105-1, 105-2) corresponding to the electronic device (101). For example, the profile information may include information about the metaverse service used by the user (105-1, 105-2). The server (110) may transmit a signal indicating an avatar corresponding to each of the plurality of electronic devices (101-1, 101-2) according to the identified type and / or profile information. For example, the avatar (121-1) displayed on the first electronic device (101-1) and the avatar (121-2) displayed on the second electronic device (101-2) may be different. Avatar (121-1) and avatar (121-2) may refer to avatars corresponding to user (105-1). The profile information of user (105-1) corresponding to avatar (121-1) and avatar (121-2) may be substantially the same. The shapes of avatar (121-1) and avatar (121-2) may be different. The motions that avatar (121-1) and avatar (121-2) can perform may be different. A description of the shapes and motions that avatars can perform will be described below with reference to FIG. 4.

[0026] For example, when the server (110) receives a signal from the first electronic device (101-1) indicating that it is connected to a virtual environment, it can transmit information about an avatar (121-1) corresponding to the user (105-1) to the first electronic device (101-1). When the server (110) receives a signal from the second electronic device (101-2) indicating that it is connected to a virtual environment, it can transmit information about an avatar (122-2) corresponding to the user (105-2) to the second electronic device (101-2).

[0027] For example, when the server (110) transmits information about an avatar corresponding to a user (105-2) (e.g., an avatar corresponding to an avatar (122-2)) to a first electronic device (101-1), the server (110) may transmit information about the avatar (121-2) depending on the type of the first electronic device (101-1). When the server (110) transmits information about an avatar corresponding to a user (105-1) (e.g., an avatar corresponding to an avatar (121-1)) to a second electronic device (101-2), the server (110) may transmit information about the avatar (122-1) depending on the type of the second electronic device (101-2).

[0028] For example, a first electronic device (101-1) may display a screen (151) representing at least a portion of a virtual environment on a display using information representing a metaverse service received from a server (110). A second electronic device (101-2) may display a screen (152) representing at least a portion of a virtual environment on a display using other information representing a metaverse service received from a server (110). Information about the virtual environment included in the screens (151) and (152) may be substantially similar. Information about avatars included in the screens (151) and (152) may be different. For example, the shapes of avatars (121-1, 122-1) included in the screen (151) may be different from the shapes of avatars (121-2, 122-2) included in the screen (152). For example, the motions that the avatars (121-1, 122-1) included in the screen (151) can perform may be different from the motions that the avatars (121-2, 122-2) included in the screen (152) can perform. For example, when the avatars (121-1, 122-1) and the avatars (121-2, 122-2) perform the same motion (e.g., waving a hand), since the number of parts that make up the avatars (121-1, 122-1) included in the screen (151) is less than the number of parts that make up the avatars (121-2, 122-2) included in the screen (152), the expression methods in which each of the avatars (121-1, 122-1, 121-2, 122-2) performs the same motion may be partially different.

[0029] For example, the electronic device (101-1, 101-2) can receive input from the user (105) to control the avatar. The input can be obtained using an input device (e.g., a microphone, a keyboard, a mouse, a touchpad, a camera, and / or a controller) connected to the electronic device (101-1, 101-2). For example, the electronic device (101-1, 101-2) can obtain image data including a part of a body part (e.g., a face and / or an upper body) of the user (105-1, 105-2). The electronic device (101-1, 101-2) can identify a motion of the user (105-1, 105-2) included in the image data. The motion of the user (105-1, 105-2) may include the facial expression, gaze, and / or gesture of the user (105-1, 105-2). The electronic device (101-1, 101-2) may control the avatar based on the motion of the user (105-1, 105-2). For example, the electronic device (101) may change a portion of the avatar to correspond to the motion of the user (105-1, 105-2). For example, the electronic device (101-1, 101-2) may display a visual object (e.g., an emoji) on the display that corresponds to the motion of the user (105-1, 105-2). For example, the electronic device (101-1, 101-2) may transmit information for controlling an avatar to the server (110) based on the motion of the user (105-1, 105-2) identified. As an example, the first electronic device (101-1) may transmit information corresponding to an input received from the user (105-1) to the server (110). The input may refer to audio data (e.g., the user's voice) received using a microphone. For example, the first electronic device (101-1) may obtain audio data representing the voice of the user (105-1) using a microphone.The first electronic device (101-1) can obtain embedding data based on one or more dimensions based on embedding natural language contained in audio data based on the execution of a voice identifier. Using the embedding data, the first electronic device (101-1) can infer the meaning contained in the natural language. The first electronic device (101-1) can perform at least one function based on inferring the meaning contained in the natural language. The at least one function can include a function of the first electronic device (101-1) transmitting information for controlling an avatar to the server (110). The motion by which the electronic devices (101-1, 101-2) receive an input for controlling the avatar is not limited to the above-described embodiment.

[0030] For example, the server (110) may obtain control information of an avatar corresponding to a type of avatar based on the type of the avatar using information for controlling the avatar. Based on obtaining the control information of the avatar corresponding to the type, the server (110) may transmit information for controlling the avatar displayed on the first electronic device (101-1) to the first electronic device (101-1) and other information for controlling the avatar displayed on the second electronic device (101-2) to the second electronic device (101-2).

[0031] For example, the first electronic device (101-1) can display a visual object (163) on the display by bypassing changing a portion of the avatar (122-1). For example, the avatar (122-1) may not support a motion corresponding to the visual object (163). For example, the second electronic device (101-2) can change a portion of the avatar (122-2). The shape of the avatar (122-2) with the changed portion may correspond to the shape of the user based on the user's motion.

[0032] For example, the first electronic device (101-1) may receive text information (e.g., “Hello”) from the user (105-1). The first electronic device (101-1) may display a text object (161) corresponding to the text information on the display. For example, the avatar (121-1) may be an example of an avatar that cannot perform a motion corresponding to the text information.

[0033] For example, a first electronic device (101-1) may transmit a signal representing text information to a server (110). Based on receiving the signal, the server (110) may change the text information into information representing a motion that an avatar (121-2) can perform based on a type different from that of the avatar (121-1). The server (110) may transmit information representing a motion that the avatar (121-2) can perform to a second electronic device (101-2). Based on receiving the information representing a motion that the avatar (121-2) can perform, the second electronic device (101-2) may change at least a portion (e.g., a portion corresponding to an arm) of an avatar (121-2) based on a three-dimensional human body model. For example, the second electronic device (101-2) may control the avatar (121-2) based on a motion corresponding to text information (e.g., nice to meet you). However, this is not limited thereto. For example, the second electronic device (101-2) may output an audio signal (162) corresponding to text information through a speaker.

[0034] Referring to FIG. 1, although each of the electronic devices (101-1, 101-2) is illustrated as displaying different screens (151, 152), the present invention is not limited thereto. For example, the first electronic device (101-1) may display the screen (152) based on a metaverse platform (or service) provided from a server (110). In this case, profile information corresponding to the first user (105-1) may include information about the metaverse platform. The first electronic device (101-1) may provide a metaverse service in which the user (105-1) may use avatars having different functions.

[0035] As described above, the electronic device (101-1, 101-2) and / or the server (110) can identify the type of avatar to be displayed on the display based on the type (or resource status) of the electronic device (101-1, 101-2) and / or the user's profile information. For example, the motions that the avatar (121-1) and the avatar (121-2) corresponding to the same user (105-1) can perform may be different. For example, using the same text information (e.g., nice to meet you), the first electronic device (101-1) can display a text object (161) on the display, and the second electronic device (101-2) can change at least a part of the avatar (121-2). The server (110) may identify the type of avatar (121-1) corresponding to the first electronic device (101-1) based on receiving text information, and request the first electronic device (110-1) to display a text object corresponding to the text information. The server (110) may identify the type of avatar (121-2) corresponding to the second electronic device (101-2) based on receiving text information, and change the text information into control information corresponding to the type. The changed control information may be transmitted to the second electronic device (101-2). The second electronic device (101-2) may control the avatar (121-2) using the control information. The electronic device (101-1, 101-2) and / or the server (110) can support interaction between users (105-1, 105-2) who own different electronic devices (101-1, 101-2) by differently processing information for controlling an avatar depending on the type of the electronic device (101-1, 101-2).

[0036] FIG. 2 is a block diagram of an electronic device and a server connected to the electronic device according to one embodiment. The electronic device (101) of FIG. 2 may include at least one of the electronic devices (101-1, 101-2) of FIG. 1. The server (110) of FIG. 1 may include the server (110) of FIG. 1. Referring to FIG. 2, the electronic device (101) and the server (110) may be connected to each other based on a wired network and / or a wireless network. The wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), Ethernet, or a combination thereof. The wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. Although the electronic device (101) and the server (110) are shown as being directly connected, the electronic device (101) and the server (110) may be indirectly connected through an intermediate node within the network.

[0037] An electronic device (101) according to one embodiment may include at least one of a processor (210), a memory (220), a camera (230), a microphone (240), a communication circuit (250), a speaker (265), and a display (260). The processor (210), the memory (220), the camera (230), the microphone (240), the communication circuit (250), the speaker (265), and the display (260) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (202). Hereinafter, operably coupled hardware may mean that a direct connection or an indirect connection is established between the hardwares, either wired or wireless, so that a second hardware is controlled by a first hardware among the hardwares. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware of FIG. 2 (e.g., at least a portion of the processor (210), the memory (220), and the communication circuit (250)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of hardware included in the electronic device (101) is not limited to that illustrated in FIG. 2. For example, the electronic device (101) may include only some of the hardware illustrated in FIG. 2.

[0038] A processor (210) of an electronic device (101) according to one embodiment may include hardware for processing data based on one or more instructions. The hardware for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The processor (210) may have a single-core processor structure, or a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0039] The memory (220) of the electronic device (101) according to one embodiment may include a hardware component for storing data and / or instructions input and / or output to the processor (210) of the electronic device (101). The memory (220) may include, for example, a volatile memory such as a random-access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, a solid state drive (SSD), and an embedded multi media card (eMMC).

[0040] According to one embodiment, the camera (230) of the electronic device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The plurality of optical sensors included in the camera (230) may be arranged in the form of a two-dimensional array. The camera (230) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid and including a plurality of pixels arranged two-dimensionally. For example, photographic data captured using the camera (230) may mean one image acquired from the camera (230). For example, video data captured using the camera (230) may mean a sequence of a plurality of images acquired from the camera (230) according to a specified frame rate. An electronic device (101) according to one embodiment may further include a flashlight that is positioned so as to face the direction in which the camera (230) receives light and outputs light in the direction. The number of cameras (230) included in the electronic device (101) may be one or more. For example, the electronic device (101) may identify a motion (or motion) of a user using the camera (230). The electronic device (101) may transmit information indicating the identified motion of the user to the server (110).

[0041] According to one embodiment, a microphone (240) of an electronic device (101) may receive audio data (e.g., a user's voice). For example, the electronic device (101) may include one or more microphones. The microphone (240) may be disposed in a portion of a housing of the electronic device (101). The microphone (240) may be referred to as a feedback microphone on the side that is disposed adjacent to a speaker (not shown). The microphone (240) may be disposed in a portion of the housing that includes a sensor (not shown) of the electronic device (101). The microphone (240) may be referred to as a feedforward microphone on the side that is disposed toward the outside of the electronic device (101). However, the present invention is not limited thereto. The electronic device (101) may transmit information for controlling an avatar to the server (110) based on identifying audio data (e.g., a user's voice) using the microphone (240).

[0042] According to one embodiment, a display (260) of an electronic device (101) can output visualized information to a user. For example, the display (260) can be controlled by a processor (210) including a circuit such as a GPU (graphic processing unit) to output visualized information to the user. The display (260) can include a flat panel display (FPD) and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). The electronic device (101) can display a screen representing at least a portion of a virtual space using the display (260).

[0043] A communication circuit (250) of an electronic device (101) according to one embodiment may include hardware components for supporting transmission and / or reception of electrical signals between the electronic device (101) and a server (110). Although only the server (110) is illustrated as an electronic device connected to the electronic device (101) through the communication circuit (250), the embodiment is not limited thereto. The communication circuit (250) may include, for example, at least one of a modem (MODEM), an antenna, and an optical / electronic (O / E) converter. The communication circuit (250) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and 5G new radio (NR).

[0044] Referring to FIG. 2, in one embodiment, the server (110) may include at least one of a processor (210-1), a memory (220-1), and a communication circuit (250-1). Within the server (110), the processor (210-1), the memory (220-1), and the communication circuit (250-1) may be electrically and / or operatively coupled via a communication bus (202-1). The processor (210-1), the memory (220-1), and the communication circuit (250-1) included within the server (110) may include hardware components and / or circuits corresponding to the processor (210), the memory (220), and the communication circuit (250) of the electronic device (101). Hereinafter, in order to reduce repetition, the description of the processor (210-1), memory (220-1), and communication circuit (250-1) included in the server (110) may be omitted to the extent that they overlap with the processor (210), memory (220), and communication circuit (250) in the electronic device (101).

[0045] In one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (210) of the electronic device (101) may be stored in the memory (220). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. Referring to FIG. 2, the processor (210) of the electronic device (101) may execute a virtual environment output application (270) in the memory (220) to perform at least one of the operations of FIG. 8.

[0046] In one embodiment, one or more instructions representing operations and / or actions to be performed on data by the processor (210-1) of the server (110) may be stored within the memory (220-1) of the server (110). For example, the processor (210-1) of the server (110) may execute a virtual environment output application (280) within the memory (220-1) to perform at least one of the operations of FIG. 9. Hereinafter, the fact that an application is installed within an electronic device (e.g., the electronic device (101) and / or the server (110)) may mean that one or more instructions provided in the form of an application are stored within the memory of the electronic device, and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension specified by an operating system of the electronic device).

[0047] Referring to FIG. 2, one or more instructions included in a virtual space output application (270) of an electronic device (101) may be distinguished by a motion identifier (271) and / or a voice identifier (272). The virtual space output application (270) may be connected to the electronic device (101) via a communication circuit (250) and may be provided through another server (e.g., a third-party application store) that is distinct from the server (110).

[0048] In a state in which a virtual space output application (270) according to one embodiment is running, the processor (210) of the electronic device (101) may monitor interactions between a user of the electronic device (101) and other users. In the state, the processor (210) of the electronic device (101) may request, from the server (110), information representing at least a portion of a virtual space corresponding to the electronic device (101). Based on the information received from the server (110), the processor (210) of the electronic device (101) may display a screen representing at least a portion of the virtual space using the display (260). The screen may include an avatar based on the type of the electronic device (101).

[0049] For example, while the virtual space providing application (380) of the server (110) is running, the processor (210-1) of the server (110) may, in response to a request from the electronic device (101), transmit information corresponding to the electronic device (101) and / or the user of the electronic device (101) (e.g., information representing an avatar) to the electronic device (101).

[0050] According to one embodiment, the processor (210) of the electronic device (101) may identify a user motion (or user motion) based on image data acquired using the camera (230) based on the execution of the motion identifier (272). The user motion may be acquired based on identifying an expression, gaze, posture, and / or movement of the user appearing on the user's face. However, the present invention is not limited to the above-described embodiment. For example, the processor (210) of the electronic device (101) may identify the user's motion based on the user's voice acquired using the motion identifier (272). The processor (210) of the electronic device (101) may acquire information indicating whether to control an avatar included in a virtual space provided by the server (110) or to display a visual object based on the identified user's motion.

[0051] For example, the electronic device (101) can identify the state of the avatar corresponding to the motion of the user identified through the motion identifier (272) based on the execution of the state identifier (273). For example, the state of the avatar can mean information about the shape of the avatar and / or the motions that the avatar can perform. For example, the electronic device (101) can identify whether the avatar will perform a motion based on the motion of the user by using the shape of the avatar and / or the number of parts included in the avatar.

[0052] For example, the processor (210) of the electronic device (101) may transmit the information to the server (110). For example, the processor (210-1) of the server (110) may change at least a portion of the information based on identifying a motion that an avatar corresponding to the user can perform from the information. The processor (210-1) of the server (110) may transmit the information, of which at least a portion has been changed, to another electronic device. However, the present invention is not limited thereto.

[0053] According to one embodiment, the processor (210) of the electronic device (101) can identify audio data (e.g., data representing the user's voice) through the microphone (240) based on the execution of the voice identifier (272). For example, the processor (210) of the electronic device (101) can identify the user's motion using the audio data. For example, using the voice identifier (272), the processor (210) of the electronic device (101) can infer the user's intention appearing in the audio data. For example, the processor (210) of the electronic device (101) can identify the user's motion by processing the user's natural language included in at least a portion of the audio data based on the execution of the voice identifier (272). The processor (210) of the electronic device (101) can display a screen including text corresponding to the natural language using the display (260) by processing the user's natural language. For example, the processor (210) of the electronic device (101) can control an avatar displayed on the display (260) based on a motion corresponding to the natural language. For example, the processor (210) of the electronic device (101) can transmit information representing the motion of the identified user to the server (110). The processor (210) of the electronic device (101) can receive, from the server (110), information representing at least a portion of a virtual space including the movement of the avatar corresponding to the motion of the user.

[0054] Referring to FIG. 2, one or more instructions included in a virtual space providing application (280) of a server (110) may be divided into an avatar controller (281), an application manager (282), and / or an avatar converter (283). While the virtual space providing application (280) is running, the processor (210-1) of the server (110) may transmit information representing at least one virtual space to a plurality of external electronic devices, including the electronic device (101), connected to the server (110). For example, the information may vary depending on the plurality of external electronic devices. The information may include information for displaying at least a portion of the virtual space. The information may include information for displaying the virtual space and / or information representing a manner in which the virtual space is displayed through the plurality of external electronic devices. The information may include information of an avatar included in the virtual space. The information of the avatar may include an appearance and / or a motion of the avatar.

[0055] According to one embodiment, the processor (210-1) of the server (110) can control the avatar by using information representing the user's motion received from the electronic device (101) connected to the server (110) based on the execution of the avatar controller (281). The processor (210-1) of the server (110) can identify a motion (or motion) that the avatar can perform, which is mapped to the user's motion (or input) included in the information. The processor (210-1) of the server (110) can use avatar state information (291) to map the user's motion and the avatar's motion. The avatar state information (291) can include motion information for controlling the avatar within a virtual space provided by the server (110) and / or the shape of the avatar (e.g., an avatar based on a three-dimensional human body model). Avatar status information (291) may include information about the state in which the electronic device (101) and / or the server (110) is controlling the avatar based on the motion. The processor (210-1) of the server (110) may use the avatar status information (291) to identify the motion of the avatar mapped to the user motion. Based on the motion of the avatar, the processor (210-1) of the server (110) may control the avatar corresponding to the user. For example, when a signal for controlling the first avatar corresponding to the first profile information (292-1) is received, the processor (210-1) of the server (110) may change the first status information corresponding to the first avatar to second status information for controlling the matching second avatar.

[0056] For example, the processor (210-1) of the server (110) may use the user's profile information (292) to control an avatar corresponding to the user. The profile information (292) may include identification information of the user of the electronic device (101) logged in to the server (110), the resource status of the electronic device (101), and / or avatar information corresponding to the user. For example, the resource status of the electronic device (101) may include the status of the processor of the electronic device (101) (e.g., CPU clock, number of CPU cores, GPU clock, GPU memory capacity, etc.), communication reception status, memory capacity, the user's usage pattern (e.g., average memory capacity), hardware components of the electronic device (101), and / or information set by the user (e.g., the appearance of an avatar selected by the user). For example, the processor (210-1) of the server (110) can identify the type of avatar to be transmitted to the electronic device (101) based on the resource status of the electronic device (101) logged into the server (110). The type of avatar can be classified based on its appearance. The type of avatar can be classified based on whether it includes an upper body, an upper body and a lower body, the number of parts (e.g., joints) that make up the avatar, or the resolution of the avatar. The resource status can be updated based on a specified time. The type of avatar is described in more detail below with reference to FIG. 4.

[0057] For example, the processor (210-1) of the server (110) may receive information for controlling an avatar from the electronic device (101). The processor (210-1) of the server (110) may identify a motion of the avatar that is mapped to a user motion included in at least a portion of the information.

[0058] For example, the processor (210-1) of the server (110) can identify a first user input for controlling an avatar. Based on the identification of the first user input, the processor (210-1) of the server (110) can control the avatar within the virtual space. As an example, the processor (210-1) of the server (110) can identify profile information corresponding to another user, different from the user of the electronic device (101) that accessed the server (110). The server (110) can use the profile information corresponding to the other user to change at least a portion of the information for controlling the avatar using the avatar converter (283). The processor (210-1) of the server (110) can use the information, of which at least a portion has been changed, to control the avatar displayed on the electronic device of the other user. For example, the processor (210-1) of the server (110) may request the electronic device of another user to refrain from changing at least a portion of the avatar using the information of which at least a portion has been changed, and to display a visual object (e.g., an emoji) corresponding to the first user input in an adjacent portion of the avatar. However, this is not limited to the above-described embodiment.

[0059] According to one embodiment, the processor (210-1) of the server (110) may obtain information indicating interactions between users (or avatars corresponding to each of the users) of a plurality of electronic devices connected to the server (110) based on the execution of the application manager (282). The information indicating the interactions between the users may include information on an avatar controlled by the processor (210-1) of the server (110). The information indicating the interactions between the users may include user motion information indicating that the information refers to another user different from the user of the electronic device (101) received from the electronic device (101). The information indicating the interactions between the users may include interactions between an avatar corresponding to the user of the electronic device (101) received from the electronic device (101) and another avatar different from the avatar included in the virtual space (e.g., an avatar corresponding to another user, and / or a visual object).

[0060] For example, the processor (210-1) of the server (110) can identify each of a plurality of electronic devices logged into the virtual space based on the execution of the application manager (282). The processor (210-1) of the server (110) can transmit information representing an avatar corresponding to each of the plurality of electronic devices. For example, the processor (210-1) of the server (110) can transmit an avatar based on a three-dimensional human body model to the electronic device (101). As another example, the processor (210-1) of the server (110) can transmit information representing a two-dimensional avatar to the electronic device (101).

[0061] As described above, the electronic device (101) and / or the server (110) according to one embodiment can control an avatar corresponding to the user of the electronic device (101) included in a virtual space based on interactions between the user of the electronic device (101) and other users connected to the server (110). For example, the electronic device (101) can identify an input for controlling the avatar using an input device such as a touchpad (not shown), a camera (230), and / or a microphone (240). The electronic device (101) can transmit information representing the identified input to the server (110). Based on the transmitted information, the server (110) can control the avatar corresponding to the user within the virtual space. The server (110) can control the avatar using avatar status information (291), profile information (292), and / or information representing interactions between avatars included within the virtual space. The server (110) can transmit information representing at least a portion of a virtual space including the controlled avatar to the electronic device (101). The electronic device (101) can display a screen representing at least a portion of the virtual space included in the information on the display (260). Using the screen, the electronic device (101) can provide a user interface (UI) for controlling the avatar within the virtual space. Based on the screen of the electronic device (101), an augmented reality service can be provided to the user.

[0062] Below, with reference to Fig. 3, an example of avatars corresponding to profile information is described.

[0063] FIG. 3 illustrates an example of information about an avatar corresponding to a user according to one embodiment. The server (110) of FIG. 3 may be referenced to the server (110) of FIGS. 1 and 2.

[0064] Referring to FIG. 3, according to one embodiment, the server (110) may identify profile information (292) corresponding to each of a plurality of electronic devices. For example, the profile information may include a type of each of the plurality of electronic devices, a resource status, and / or identification information of a user who owns each of the plurality of electronic devices. For example, the server (110) may identify first user information (292-1) corresponding to a first user (105-1), second profile information (292-2) corresponding to a second user (105-2), and / or third profile information (292-3) corresponding to a third user (105-3). The first user (105-1), the second user (105-2), and the third user (105-3) may correspond to electronic devices, respectively, based on different resource statuses. For example, an electronic device corresponding to a first user (105-1) may be an example of an electronic device based on a first resource state. An electronic device corresponding to a second user (105-2) may be an example of an electronic device based on a second resource state. An electronic device corresponding to a third user (105-3) may be an example of an electronic device based on a third resource state. For example, an electronic device based on a third resource state may be a relatively high-end electronic device (e.g., a high-end electronic device) compared to an electronic device based on a first resource state. However, the present invention is not limited thereto.

[0065] For example, the server (110) can identify each of a plurality of electronic devices logged into the server (110) using the communication circuit (250-1). Based on the identification of each of the plurality of electronic devices, the server (110) can identify profile information (292) to obtain information of an avatar to be transmitted to each of the plurality of electronic devices. For example, the server (110) can identify information of an avatar (121-1) to be transmitted to an electronic device corresponding to a first user (105-1) using first profile information (292-1). Based on the identification of information of the avatar (121-1), the server (110) can transmit information of the avatar (121-1) to be transmitted to the electronic device corresponding to the first user (105-1). The avatar (121-1) can correspond to the first user (105-1). For example, the server (110) can identify information of an avatar (122-2) to be transmitted to an electronic device corresponding to a second user (105-2) using the second profile information (292-2). Based on the identification of the information of the avatar (122-2), the server (110) can transmit information of the avatar (122-2) to be transmitted to an electronic device corresponding to the second user (105-2). The avatar (122-2) can correspond to the second user (105-2). For example, the server (110) can identify information of an avatar (123-3) to be transmitted to an electronic device corresponding to a third user (105-3) using the third profile information (292-3). The server (110) can transmit information of the avatar (123-3) to be transmitted to an electronic device corresponding to a third user (105-3) based on identifying information of the avatar (123-3). The avatar (123-3) can correspond to the third user (105-3).

[0066] For example, depending on the resource status of each of the plurality of electronic devices, the shapes and executable motions of the avatars (121-1), (122-2), and (123-3) may be different. The shapes and executable motions of the avatars (121-1), (122-2), and (123-3) are described below with reference to FIG. 4.

[0067] For example, the server (110) may identify the second profile information (292-2) and / or the third profile information (292-3) in order to transmit the avatar (121-1) corresponding to the first user (105-1) to the electronic device corresponding to the second user (105-2) and / or the electronic device corresponding to the third user (105-3). For example, if the form of the avatar displayed by the electronic device corresponding to the second user (105-2) and / or the electronic device corresponding to the third user (105-3) is different from the form of the avatar displayed by the electronic device corresponding to the first user (105-1), the form of the avatar (121-1) corresponding to the first user (105-1) may be changed using the avatar converter (283). The changed form of the avatar (121-1) may be substantially similar to the form of the avatar (122-2) and / or the avatar (123-3). However, it is not limited to this.

[0068] For example, the server (110) may store the form of one or more avatars (121-1) in the profile information (292). The form of one or more avatars (121-1) may include a first form corresponding to the avatar (121-1), a second form corresponding to the avatar (122-2), and / or a third form corresponding to the avatar (123-3). The form of one or more avatars may be mapped to the resource status of each of the plurality of electronic devices.

[0069] For example, the server (110) may receive a signal representing an input (e.g., a smiling expression) for controlling an avatar from a third electronic device corresponding to a third user (105-3). As an example, the avatar (123-3) may be an example of an avatar capable of performing a designated motion corresponding to the input. Based on receiving the input, the third electronic device may change at least a portion (e.g., a portion corresponding to the face) of the avatar (123-3).

[0070] For example, the server (110) may identify information about an input for controlling an avatar included in the signal in order to transmit the signal to a second electronic device corresponding to a second user (105-2) and / or a first electronic device corresponding to a first user (105-1). Using the information, the server (110) may identify the shape of the avatar (121-1) corresponding to the first electronic device and the shape of the avatar (122-2) corresponding to the second electronic device. For example, if the server (110) cannot control the avatar (121-1) based on the shape of the avatar (121-1), the server (110) may use the avatar converter (283) to change the information into other information based on the shape of the avatar (121-1). The other information may include a visual object (e.g., a smiling emoji) corresponding to an input (e.g., a smiling expression) for controlling the avatar received from the third electronic device. The server (110) may transmit the changed other information to the first electronic device corresponding to the first user (105-1). The first electronic device may display the visual object on the display based on receiving the changed other information, but is not limited thereto.

[0071] For example, the server (110) may use an avatar converter (283) to change information about an input for controlling an avatar included in the signal into other information based on the shape of the avatar (122-2) corresponding to the second electronic device. For example, based on the shape of the avatar (122-2), the avatar (122-2) may be an example of an avatar that can perform a motion corresponding to an input for controlling the avatar received from the third electronic device. The motions that the avatar can perform may vary depending on the shape of the avatar and / or components included in the avatar.

[0072] According to one embodiment as described above, a server (110) or a plurality of electronic devices (e.g., electronic devices (101-1, 101-2) of FIG. 1) can provide an augmented reality service to a user.

[0073] Referring to FIG. 4 below, a description of one or more avatars based on the shape of the avatars according to one embodiment is provided below.

[0074] FIG. 4 illustrates examples of avatars according to resource status of an electronic device, according to one embodiment. The electronic device (101) of FIG. 4 and / or the server (110) of FIG. 4 may correspond to the electronic device (101) and / or the server (110) of FIGS. 1 to 3. The first avatar (401) may correspond to the avatars (121-1, 122-1) of FIG. 1. The second avatar (402) may correspond to the avatar (122-2) of FIG. 3. The third avatar (403) may correspond to the avatars (121-2, 122-2) of FIG. 1 and the avatar (123-3) of FIG. 3.

[0075] Referring to FIG. 4, one or more avatars (401, 402, 403) corresponding to an electronic device (101) (or a user (105) of the electronic device (101)) are illustrated according to one embodiment.

[0076] For example, the information for implementing each of one or more avatars (401, 402, 403) by the server (110) may be different. For example, the first avatar (401) may include a designated number (e.g., six) of parts (e.g., parts representing the head, left arm, right arm, left leg, right leg, and / or torso of the human body model) for representing the movement of the first avatar (401). The parts may be identified based on the human body model.

[0077] For example, the second avatar (402) may include a specified number (e.g., 15) of parts (e.g., parts representing the head, upper body, lower body, left upper arm, left lower arm, left hand, right upper arm, right lower arm, right hand, left thigh, left calf, left foot, right thigh, right calf, and / or right foot of the human body model) to represent the movement of the second avatar (402).

[0078] For example, the third avatar (403) can be acquired using data sets (403-1, 403-2, 403-3) for a three-dimensional human body model. For example, the data sets (403-1, 403-2, 403-3) can be acquired using multiple image sets representing the shape of an external object (e.g., a person). For example, the data sets (403-1, 403-2, 403-3) can include scan data of a three-dimensional human body model.

[0079] For example, data set (403-1) may include bone information included in a human body model. Data set (403-2) may include information representing joints of the human body model. As an example, data sets (403-1, 403-2) may be used to create a second avatar (402). Data set (403-3) may include detailed bone and / or joint information constituting the human body model. Since the third avatar (403) is obtained using all of the data sets (403-1, 403-2, 403-3) for the three-dimensional human body model, it may perform motions corresponding to the user's motions. For example, the electronic device (101) and / or the server (110) can express the user's facial expression using the third avatar (403) by obtaining the third avatar (403) using the data sets (403-1, 403-2, 403-3). For example, the electronic device (101) and / or the server (110) can control at least a part of the third avatar (403) based on the image data sets by using a neural network for learning the user's facial expression (or emotion). The image data sets can include a plurality of images representing the user's facial expression. The electronic device (101) and / or the server (110) can learn the user's facial expression through the neural network based on identifying the movement of the second body parts (e.g., eyes, eyebrows, nose, mouth, and / or ears) included in the first body part (e.g., face) included in each of the plurality of images. The electronic device (101) and / or the server (110) may control at least part of the third avatar (403) to express the user's facial expression through the learned neural network.

[0080] For example, the electronic device (101) and / or the server (110) may utilize a neural network to learn the movements of the avatars to change at least a portion of the avatars (401, 402, 403) based on a specified motion. The electronic device (101) and / or the server (110) may train the neural network to control the movements of the avatars using image data sets (e.g., motion capture data) representing the movements of an external object (e.g., a person).

[0081] For example, since the number and / or shape of parts constituting each of the avatars (401, 402, 403) are different, the motions that each of the avatars (401, 402, 403) can perform may be different. Each of the avatars (401, 402, 403) may be acquired based on different software (e.g., a physics engine or a rendering engine), but is not limited thereto. Within the virtual environment provided by the server (110), avatars (401, 402, 403) based on the same physics laws but based on different shapes may be included. For example, each of the avatars may be acquired based on different human body models.

[0082] For example, the electronic device (101) and / or the server (110) may identify executable motions of the avatars based on human body models representing each of the avatars (401, 402, 403). As an example, the executable motions of the avatars may be identified based on the number of joints included in the human body models of each of the avatars (401, 402, 403). As an example, the first avatar (401) may include a number of joints less than a specified threshold. As an example, the third avatar (403) may include a number of joints greater than a specified threshold. However, the present invention is not limited thereto.

[0083] For example, there may be more motions using the avatar (402) than motions using the avatar (401). There may be more executable motions of the avatar (403) than executable motions of the avatar (402). For example, since the avatar (403) is obtained using all of the data sets (403-1, 403-2, 403-3) for the 3D-based human body model, the server (110) or the electronic device (101) can express the user's facial expression using the avatar (403). For example, since the number of parts included in the third avatar (403) is relatively greater than the number of parts included in the first avatar (401), the server (110) and / or the electronic device (101) can obtain a visual object (e.g., an emoji) to represent the movement of the third avatar (403) using the first avatar (401).

[0084] For example, the server (110) may select at least one of one or more avatars (401, 402, 403) based on the resource status of the electronic device (101) identified using profile information (e.g., profile information (292) of FIG. 2). For example, the server (110) may map each of the motions that each of the one or more avatars (401, 402, 403) can perform. For example, when a user's expression that can be expressed using a third avatar (403) cannot be expressed using the first avatar (401), the server (110) may render a visual object (e.g., visual object (163) of FIG. 1) mapped to the user's expression based on the execution of the avatar converter.

[0085] For example, the electronic device (101) and / or the server (110) may provide a user interface for generating an avatar based on one or more avatars (401, 402, 403). For example, the electronic device (101) and / or the server (110) may receive, using the user interface, an input indicating selection of at least one of the one or more avatars (401, 402, 403). The electronic device (101) and / or the server (110) may generate an avatar based on the received input. The electronic device (101) and / or the server (110) may change a shape based on the avatar using the user interface. However, the present invention is not limited thereto.

[0086] As described above, the electronic device (101) and / or the server (110) may provide a service that enables interaction between avatars used by each of the plurality of electronic devices based on mapping each of the executable motions based on the form of each of one or more avatars (401, 402, 403).

[0087] FIG. 5 illustrates an example of an operation of an electronic device and a server according to one embodiment of the present invention to change the motion of an avatar. The electronic device (101) and / or the server (110) of FIG. 5 may be referenced to the electronic device (101) (or the electronic devices (101-1, 101-2)) and / or the server (110) of FIGS. 1 to 4. Referring to FIG. 5, an exemplary network environment (500) including a plurality of electronic devices (101-1, 101-2) and a server is illustrated.

[0088] According to one embodiment, in an environment (500), a server (110) may receive a signal from each of a plurality of electronic devices (101-1, 101-2) indicating access to a virtual environment. The server (110) may transmit information about avatars that can be displayed on each of the plurality of electronic devices (101-1, 101-2) to each of the plurality of electronic devices (101-1, 101-2) using profile information corresponding to each of the plurality of electronic devices (101-1, 101-2). For example, the server (110) may identify an avatar (121-1) based on the shape of a first avatar (401) of FIG. 4 using profile information corresponding to a first electronic device (101-1). The server (110) can identify an avatar (121-2) based on the form of the third avatar (403) of FIG. 4 using profile information corresponding to the second electronic device (101-2). For example, the second electronic device (101-2) may be an electronic device based on relatively higher specifications than the first electronic device (101-1). The avatars (121-1) and (121-2) may be avatars acquired using identification information of the same user (e.g., the user (105-1) of FIG. 1).

[0089] For example, the server (110) may transmit information about an avatar (121-1) to a first electronic device (101-1) and transmit information about an avatar (121-2) to a second electronic device (101-2). While the first electronic device (101-1) displays a screen (502) including an avatar (121-1) on the display, the second electronic device (101-2) may display a screen (501) including an avatar (121-2) on the display. The screens (501, 502) may include substantially similar information independently of the avatars (121-1, 121-2). The screens (501, 502) may be rendered based on substantially similar information independently of the avatars (121-1, 121-2).

[0090] For example, the second electronic device (101-2) can receive an input from the user to control the avatar (121-2). The input can vary based on the motions that the avatar (121-1) can perform. The input can be identified based on image data representing a body part (e.g., face) of the user acquired through a camera. The second electronic device (101-2) can control the avatar (121-2) based on the shape of the third avatar (403) of FIG. 4 based on identifying the body part (e.g., face) of the user included in the image data. For example, the second electronic device (101-2) can transmit information representing the input to the server (110), and the server (110) can control the avatar (121-2) based on the motions that the avatar can perform using the avatar controller based on the information received. The server (110) can transmit information indicating control of the avatar (121-2) (e.g., avatar status information (291) of FIG. 2) to the second electronic device (101-2). The second electronic device (101-2) can display the controlled avatar (121-2) on the display using the information. Using the information, the second electronic device (101-2) can change at least a portion of the avatar (121-2). Using the information, the second electronic device (101-2) can display the avatar (121-2) expressing a body part of the user. Based on displaying the avatar (121-2) expressing the body part of the user, the second electronic device (101-2) can display the avatar (121-2) expressing an emotion (510) (e.g., laughter) on the display.

[0091] For example, the server (110) can change the information for controlling the avatar (121-2) received from the second electronic device (101-2) (e.g., the avatar status information (291) of FIG. 2) into information for controlling the displayed avatar (121-1) of the first electronic device (101-1). The server (110) can identify the resource status of the first electronic device (101-1) using the profile information corresponding to the first electronic device (101-1). The server (110) can identify that the avatar (121-1) cannot be controlled using the information for controlling the avatar (121-2). The server (110) can change the motion to be performed by the avatar (121-2) included in the information for controlling the avatar (121-2) into a motion that the avatar (121-1) can perform. For example, since the server (110) (or the first electronic device (101-1)) cannot express the emotion (510) using the avatar (121-1), a visual object (520) corresponding to the emotion (510) can be identified.

[0092] For example, the server (110) can use the avatar converter to inform the status of the avatar (121-2) using the visual object (520). The server (110) can request the first electronic device (101-1) to display the visual object (520) in an area adjacent to the avatar (121-1). The first electronic device (101-1) can express the user's emotion (510) based on displaying the visual object (520) in an area adjacent to the avatar (121-1). However, the present invention is not limited thereto.

[0093] For example, a first electronic device (101-1) may receive an input for displaying a visual object (520). The first electronic device (101-1) may transmit a signal representing the input to a server (110). The server (110) may identify profile information matching a second electronic device (101-2) to which information corresponding to the signal will be transmitted. Based on the identification of the profile information, the server (110) may identify an avatar (121-2) corresponding to the second electronic device (101-2). Based on the identification of the avatar (121-2), the server (110) may identify a motion corresponding to the visual object (520) through an avatar converter. The server (110) can transmit information to the second electronic device (101-2) for controlling an avatar (121-2) to be displayed on the second electronic device (101-2) based on a motion corresponding to the visual object (520) using an avatar controller. The second electronic device (101-2) can control the avatar (121-2) to express an emotion (510) corresponding to the visual object (520) based on the received information. The second electronic device (101-2) can change at least a part of the avatar (121-2) (e.g., a part corresponding to the face) to control the avatar (121-2).

[0094] As described above, the electronic device (101) and / or the server (110) can perform communication between avatars that support different motions based on the shape of each avatar.

[0095] FIGS. 6A and 6B illustrate an example of an operation for changing the state of an avatar by an electronic device according to one embodiment. The electronic device (101) of FIGS. 6A and 6B may include the electronic device (101) of FIGS. 1 to 5 .

[0096] Referring to FIG. 6A, according to one embodiment, a first electronic device (101-1) may utilize an avatar (121-1) based on the shape of a first avatar (401). The first electronic device (101-1) may display a user interface (610) for indicating a user's motion on the display based on the shape of the avatar (121-1). The user interface (610) may include a plurality of icons (or visual objects) representing the user's motion (e.g., emotional expression). For example, each of the plurality of icons may correspond to a motion for changing at least a portion of an avatar (e.g., an avatar (121-3) corresponding to the shape of the third avatar (403) of FIG. 4).

[0097] For example, the first electronic device (101-1) may receive an input for at least one icon (611) among a plurality of icons. In response to receiving the input, the first electronic device (101-1) may display a visual object (e.g., the visual object (163) of FIG. 1) corresponding to the at least one icon (611) on the display. As an example, the first electronic device (101-1) may display the visual object on the display adjacent to the avatar (121-1). The first electronic device (101-1) may display the visual object on the display by bypassing changing at least a portion of the avatar (121-1) to indicate a motion corresponding to the at least one icon (611).

[0098] For example, the first electronic device (101-1) may display an avatar (e.g., the avatar (121-3) of FIG. 1) based on the shape of the third avatar (403) of FIG. 4 on the display. The avatar may be an example of an avatar configured to perform a motion corresponding to at least one icon (611). The first electronic device (101-1) may change at least a portion of the avatar based on the motion corresponding to the at least one icon (611).

[0099] For example, the first electronic device (101-1) may, based on receiving an input for at least one icon (611), transmit a signal representing the input to a server (e.g., server (110) of FIG. 1).

[0100] For example, in response to receiving the signal, the server may identify a motion mapped to the at least one icon (611). The server may identify, through status information of the avatar corresponding to the avatar (121-1), that the motion cannot be performed using the avatar (121-1) displayed on the first electronic device (101-1). The server may transmit a different signal, distinct from the signal, to the first electronic device (101-1) so as to display a visual object corresponding to the at least one icon (611).

[0101] For example, in response to receiving the signal, the server may identify a motion mapped to the at least one icon (611). The server may identify an avatar (121-3) corresponding to the avatar (121-1) displayed on another electronic device (e.g., a second electronic device (101-2)) distinct from the first electronic device (101-1). Based on the motion mapped to the at least one icon (611), the server may change the first state information corresponding to the avatar (121-1) to second state information corresponding to the avatar (121-3) in order to control the avatar (121-3) displayed on the other electronic device. For example, the server may transmit the second state information to the other electronic device. The second state information may include information for changing the state of the avatar (121-3). The server may use the second state information to transmit a signal to the other electronic device requesting control of the avatar (121-3) based on a motion mapped to at least one icon (611). For example, an avatar (121-3) in which at least a portion (e.g., a portion corresponding to the face) has been changed based on a motion mapped to at least one icon (611) may be referenced to the avatar (121-3) of FIG. 6B.

[0102] Referring to FIG. 6B, in state (620), the first electronic device (101-1) according to one embodiment can display an avatar (121-3) based on the third avatar (403) of FIG. 4 on the display. The first electronic device (101-1) can receive a user input for controlling the avatar (121-3). The input can be acquired through a camera. The input can be identified using an image acquired through the camera. The image can include an image representing a user motion (630).

[0103] For example, the first electronic device (101-1) can identify a user motion (630) using an image acquired through a camera, and can determine whether to control the avatar (121-3) based on a motion corresponding to the user motion (630). For example, in the case of the avatar (121-1) corresponding to the first avatar (401) of FIG. 4, since the motion corresponding to the user motion (630) cannot be performed, a visual object corresponding to the user motion (630) can be displayed on the display. For example, in the case of the avatar (121-3), since the motion corresponding to the user motion (630) can be performed, the first electronic device (101-1) can control the avatar (121-3) based on the motion (650).

[0104] For example, based on identifying a user motion (630), the first electronic device (101-1) can transmit a signal corresponding to the user motion (630) to the server. Based on receiving the signal, the server can identify a motion that can be performed using the avatar (121-3) through avatar state information corresponding to the avatar (121-3). Based on identifying the motion, the server can transmit a request signal to the first electronic device (101-1) requesting control of the avatar (121-3) using information about the motion. Based on receiving the request signal, the first electronic device (101-1) can change at least a portion (e.g., a portion corresponding to the face) of the avatar (121-3) displayed on the display based on the motion (650).

[0105] For example, the first electronic device (101-1) may train an avatar through a neural network to control the avatar based on a motion corresponding to a user motion (630). For example, the avatar may be trained through the neural network to change at least a portion of the avatar using an image data set representing the user motion (630). However, the present invention is not limited thereto.

[0106] As described above, the electronic device (101) and / or the server (110) according to one embodiment can control the avatar using the user interface (610) for controlling the avatar. The electronic device (101) and / or the server (110) according to one embodiment can control the avatar based on identifying a user motion (e.g., facial expression) shown in an image. At least one icon of a plurality of icons included in the user interface (610) and the user motion can be mapped. Based on the mapping of the at least one icon and the user motion, the electronic device (101) and / or the server (110) can provide a metaverse service that can perform interaction between a user using another electronic device that cannot identify a user motion and another user using another electronic device that can identify a user motion.

[0107] FIG. 7 illustrates an example of a plurality of avatars displayed using a plurality of electronic devices according to one embodiment. The plurality of electronic devices (710-1, 710-2) of FIG. 7 may be included in the electronic device (101) of FIGS. 1 to 6B. The avatar (121-1) of FIG. 7 may be referenced to the first avatar (401) of FIG. 4. The avatar (121-3) of FIG. 7 may be referenced to the third avatar (403) of FIG. 4. The displays (250-1, 250-2) may be referenced to the display (260) of FIG. 2.

[0108] Referring to FIG. 7, an exemplary network environment (700) between a plurality of electronic devices (710-1, 710-2) corresponding to a user (105-1) and a server is illustrated according to one embodiment.

[0109] For example, the server (110) can identify a first electronic device (710-1) and a second electronic device (710-2) corresponding to a user (105-1). The server (110) can receive a signal for logging into a metaverse service from each of the first electronic device (710-1) and the second electronic device (710-2). The server (110) can identify profile information corresponding to the first electronic device (710-1) and the second electronic device (710-2). The server (110) can identify the resource status of the first electronic device (710-1) and / or the resource status of the second electronic device (710-2). The first electronic device (710-1) may be an example of an electronic device based on relatively high specifications compared to the second electronic device (710-2), but is not limited thereto.

[0110] For example, the server (110) may transmit information about the avatar (121-3) to the first electronic device (710-1) and / or information about the avatar (121-1) to the second electronic device (710-2) based on the resource status of the first electronic device (710-1) and / or the resource status of the second electronic device (710-2).

[0111] For example, a first electronic device (710-1) may display an avatar (121-3) on a display (250-1). A second electronic device (710-2) may display an avatar (121-1) on a display (250-1). However, this is not limited thereto.

[0112] For example, while displaying an avatar (121-3) on the display of a first electronic device (710-1), the first electronic device (710-1) may receive an input from a user (105-1) to move the avatar to a second electronic device (710-2). The first electronic device (710-1) may transmit a signal representing the input to the server (110). The server (110) may identify profile information corresponding to the second electronic device (710-2) based on receiving the signal. If the second electronic device (710-2) cannot render the avatar (121-3) based on the resource status of the second electronic device (710-2), the server (110) may use an avatar converter to change the avatar (121-3) to the avatar (121-1). The server (110) can transmit information indicating a changed avatar (121-1) to the second electronic device (710-2). Based on receiving the information, the second electronic device (710-2) can display the avatar (121-1) corresponding to the avatar (121-3) on the display (250-2).

[0113] Referring to FIG. 7, an exemplary state (720) is illustrated indicating movement of the avatar (121-3) so that the avatar (121-3) displayed on the display (250-1) of the first electronic device (710-1) is displayed on at least a portion of the display (250-2) of the second electronic device (710-2). For example, a portion (720-1) may include a portion of the display (250-1) of the first electronic device (710-1). A portion (720-2) may include a portion of the display (250-2) of the second electronic device (710-2).

[0114] For example, in state (720), the first electronic device (710-1) and / or the server (110) may move the avatar (121-3, 121-1) from a portion of the display (250-1) of the first electronic device (710-1) to a portion of the display (250-2) of the second electronic device (710-2) based on an input of the user (105-1) for moving the avatar (121-3). As an example, the first electronic device (710-1) and / or the server (110) may move the avatar based on a relative positional relationship between the first electronic device (710-1) and the second electronic device (710-2). The server (110) may transmit information about an avatar (121-1) corresponding to the avatar (121-3) based on the resource status of the second electronic device (710-2) to display the avatar (121-3) on the display (250-2) of the second electronic device (710-2). The server (110) and / or the second electronic device (710-2) may use the avatar (121-1) to indicate that the avatar (121-3) displayed on the display of the first electronic device (710-1) has moved from the first electronic device (710-1) to the second electronic device (710-2).

[0115] According to one embodiment as described above, a plurality of electronic devices (710-1, 710-2) and / or a server (110) may provide an avatar based on a shape according to the resource status of the plurality of electronic devices (710-1, 710-2) to a user using the plurality of electronic devices (710-1, 710-2).

[0116] FIG. 8 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment. The electronic device (101) of FIG. 8 may include the electronic device (101) of FIGS. 1 to 7. At least one of the operations of FIG. 8 may be performed by the electronic device (101) of FIG. 2 and / or the processor (210) of FIG. 2. Each of the operations of FIG. 8 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.

[0117] Referring to FIG. 8, in operation 810, a processor according to one embodiment may display an avatar (e.g., avatar (122-1) of FIG. 1) on a display, the avatar representing a human body model based on a resource status of an electronic device and corresponding to an external electronic device distinct from the electronic device. Depending on the human body model based on the resource status of the electronic device, the shape of the avatar may vary. For example, the shape of the avatar may refer to the first avatar (401) of FIG. 4, the second avatar (402) of FIG. 4, and / or the third avatar (403) of FIG. 4.

[0118] Referring to FIG. 8, in operation 820, a processor according to an embodiment may receive a signal for changing a portion of an avatar from an external electronic device using a communication circuit. The external electronic device may include an electronic device based on a different resource state that is distinct from a resource state of the electronic device. Changing a portion of the avatar may include changing a state of the avatar. The processor may bypass the changing of a portion of the first avatar and display a visual object (e.g., a visual object (163) of FIG. 1) based on receiving the signal, which represents another human body model (e.g., data sets (403-1, 403-2, 403-3) of FIG. 4) based on the resource state of the external electronic device and represents a change of a portion of a second avatar (e.g., avatar (122-3) of FIG. 1) corresponding to the first avatar.

[0119] Referring to FIG. 8, at operation 830, a processor according to one embodiment may bypass changing a portion of an avatar based on a resource status of an electronic device and display a visual object indicating a change in a portion of the avatar adjacent to the avatar. The visual object indicating a change in a portion of the avatar (e.g., visual object (163) of FIG. 1) may be identified based on a user motion (e.g., user motion (630) of FIG. 6B). As an example, the processor may identify the user motion based on identifying an audio signal representing a user's voice through a microphone.

[0120] For example, the processor may display a user interface (e.g., user interface (610) of FIG. 6A) on the display for changing the state of an avatar. The user interface may include a plurality of icons for changing the state (or motion) of the avatar corresponding to a user motion. The processor may, based on identifying an input for at least one icon (e.g., at least one icon (611) of FIG. 6A) among the plurality of icons, display a visual object corresponding to the at least one icon on the display, bypassing controlling the avatar based on the motion corresponding to the at least one icon.

[0121] For example, the processor may display a user interface on the display for changing the shape of an avatar corresponding to a human body model based on the resource status of the electronic device. Using the user interface, the processor may change the first avatar displayed on the display to a second avatar, but this is not limited thereto.

[0122] FIG. 9 illustrates an example flowchart illustrating the operation of a server according to one embodiment. The server (110) of FIG. 9 may include the server (110) of FIG. 1 . At least one of the operations of FIG. 9 may be performed by the server (110) of FIG. 2 and / or the processor (210-1) of FIG. 2 . Each of the operations of FIG. 9 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.

[0123] Referring to FIG. 9, in operation 910, a processor according to an embodiment may, in response to receiving a plurality of signals indicating entry into a virtual environment from each of a plurality of external electronic devices, transmit information about an avatar corresponding to each of the plurality of external electronic devices to each of the plurality of external electronic devices via a communication circuit using information corresponding to each of the plurality of external electronic devices. The processor may identify an avatar based on a resource status of each of the plurality of external electronic devices based on identifying information (e.g., profile information (292) of FIG. 2) corresponding to each of the plurality of external electronic devices (e.g., the first electronic device (101-1) of FIG. 1, the second electronic device (101-2) of FIG. 1). The processor may transmit information about an avatar corresponding to each of the plurality of external electronic devices to each of the plurality of external electronic devices. Each of the plurality of external electronic devices may display a screen representing a virtual environment including an avatar corresponding to each of the plurality of external electronic devices on a display.

[0124] Referring to FIG. 9, in operation 920, a processor according to an embodiment may receive, from a first external electronic device among a plurality of external electronic devices, first state information for changing a state of a first avatar representing a human body model based on a resource state of the first external electronic device, using a communication circuit. For example, the first external electronic device (e.g., the first electronic device (101-1) of FIG. 1) may correspond to an avatar (e.g., the avatar (121-1) of FIG. 1) based on the resource state. The first external electronic device may display an avatar based on the shape of the first avatar on a display. The first external electronic device may receive an input for changing the state of the first avatar using a user interface (e.g., the user interface (610) of FIG. 6A) for changing the state of the avatar. The input for changing the state of the first avatar may correspond to the first state information. The input for changing the state of the first avatar may be an input indicating selection of at least one icon among a plurality of icons included in the user interface. The at least one icon may correspond to a state of the avatar.

[0125] Referring to FIG. 9, in operation 930, a processor according to an embodiment may, based on receiving first state information, change the first state information to second state information for representing another human body model based on a resource status of a second external electronic device and changing the state of a second avatar corresponding to the first avatar. The second external electronic device (e.g., the second electronic device (101-2) of FIG. 1) may, based on the resource status, correspond to a second avatar based on a different shape (e.g., the shape of the third avatar (403) of FIG. 4) than the first avatar.

[0126] For example, the processor may identify a second avatar displayed on the second external electronic device based on receiving first state information from the first external electronic device and using profile information corresponding to the second external electronic device. Based on identifying the second avatar, the processor may use an avatar converter to change the first state information into second state information for controlling the second avatar.

[0127] Referring to FIG. 9, at operation 940, a processor according to one embodiment may transmit second state information to a second external electronic device using a communication circuit. The second external electronic device may use the second state information to control an avatar based on a motion corresponding to the second state information.

[0128] FIG. 10 illustrates an example of a signal flow diagram representing signals transmitted and received between an electronic device and a server according to one embodiment. The first electronic device (101-1) of FIG. 10 may be referenced to the first electronic device (101-1) of FIG. 1. The second electronic device (101-2) of FIG. 10 may be referenced to the second electronic device (101-2) of FIG. 1. The server (110) of FIG. 10 may be referenced to the server (110) of FIG. 1.

[0129] Referring to FIG. 10, a server (110) according to one embodiment may receive a plurality of signals (1001, 1002) indicating entry into a virtual environment from each of a plurality of electronic devices (110-1, 110-2). Based on receiving the plurality of signals (1001, 1002), the server (110) may identify profile information corresponding to each of the plurality of electronic devices (110-1, 110-2). Based on identifying the profile information corresponding to each of the plurality of electronic devices (110-1, 110-2), the server (110) may identify a resource status of each of the plurality of electronic devices (110-1, 110-2). The server (110) can transmit signals (1003, 1004) representing information corresponding to at least one of the first avatars (401, 402, 403) of FIG. 4 to each of the plurality of electronic devices (110-1, 110-2) based on identifying the resource status of each of the plurality of electronic devices (110-1, 110-2) through a communication circuit (e.g., the communication circuit (250-1) of FIG. 2).

[0130] For example, the first electronic device (101-1) may display an avatar (121-1) based on the shape of the first avatar (401) of FIG. 4 on the display. The first electronic device (101-1) may receive an input for changing the state of the avatar in operation 1005. The first electronic device (101-1) may transmit a signal (1006) representing the input to the server (110). The signal (1006) may include first state information representing the state of the avatar displayed on the first electronic device (101-1). As an example, the server (110) may transmit a response signal (not shown) requesting the first electronic device (101-1) to display a visual object (e.g., the visual object (163) of FIG. 1) representing the state of the avatar in response to the signal.

[0131] For example, the server (110) may, based on receiving the signal (1006), identify a second avatar displayed on the second electronic device (101-2) and corresponding to the first avatar. The second avatar may be identified based on the resource status of the second electronic device (101-2). The second avatar may be an avatar configured to perform relatively more motions than the first avatar.

[0132] For example, the server (110) may change the first state information to the second state information in operation 1007. Based on the identification of the second avatar, the server (110) may change the first state information to the second state information for controlling the second avatar. The server (110) may transmit a signal (1008) indicating the second state information to the second electronic device (101-2).

[0133] For example, the second electronic device (101-2) may, based on receiving the signal (1008), use the second state information to change at least a portion of the second avatar displayed on the display.

[0134] The Metaverse is a portmanteau of the English word "meta," meaning "virtual" or "transcendence," and "universe," and refers to a three-dimensional virtual world where social, economic, and cultural activities, like those in the real world, take place. The Metaverse is a concept that is one step more advanced than virtual reality (VR, a cutting-edge technology that allows people to have realistic experiences in a computer-generated virtual world), and has the characteristic of allowing people to engage in social and cultural activities similar to those in the real world, rather than simply enjoying games or virtual reality using avatars. The Metaverse service can provide media content to enhance immersion in the virtual world based on augmented reality (AR), virtual reality environment (VR), mixed reality (MR), and / or extended reality (XR).

[0135] For example, media content provided by a metaverse service may include social interaction content, including avatar-based games, concerts, parties, and / or conferences. For example, the media content may include advertisements, user-created content, and / or information for economic activities such as the sale and / or shopping of products. Ownership of the user-created content may be proven by a blockchain-based non-fungible token (NFT). The metaverse service may support economic activities based on real-world currency and / or cryptocurrency. The metaverse service may provide virtual content linked to the real world, such as digital twins or life logging.

[0136] Figure 11 is an example diagram of a network environment (1101) that provides metaverse services through a server (1110).

[0137] Referring to FIG. 11, a network environment (1101) may include a server (1110), a user terminal (1120) (e.g., a first terminal (1120-1) and a second terminal (1120-2)), and a network connecting the server (1110) and the user terminal (1120). Within the network environment (1101), the server (1110) may provide a metaverse service to the user terminal (1120). The network may be formed by at least one intermediate node (1130) including an access point (AP) and / or a base station. The user terminal (1120) may connect to the server (1110) through the network and output a user interface (UI) related to the metaverse service to the user of the user terminal (1120). Based on the above UI, the user terminal (1120) can obtain information to be input into the metaverse service from the user, or output information related to the metaverse service (e.g., multimedia content) to the user.

[0138] At this time, the server (1110) provides a virtual space so that the user terminal (1120) can be active in the virtual space. In addition, the user terminal (1120) installs a software agent for accessing the virtual space provided by the server (1110) to express information provided by the server (1110) to the user or transmit information that the user wishes to express in the virtual space to the server. The software agent may be provided directly through the server (1110), downloaded from a public server, or embedded and provided when the terminal is purchased.

[0139] In one embodiment, the metaverse service may be provided to a user terminal (1120) and / or a user using a server (1110). The embodiment is not limited thereto, and the metaverse service may be provided through individual contact between users. For example, within a network environment (1101), the metaverse service may be provided independently from the server (1110) through a direct connection between a first terminal (1120-1) and a second terminal (1120-2). Referring to FIG. 11, within the network environment (1101), the first terminal (1120-1) and the second terminal (1120-2) may be connected to each other through a network formed by at least one intermediate node (1130). In one embodiment where the first terminal (1120-1) and the second terminal (1120-2) are directly connected, either of the user terminals of the first terminal (1120-1) and the second terminal (1120-2) may perform the role of the server (1110). For example, a metaverse environment may be configured solely through device-to-device connections (e.g., peer-to-peer (P2P) connections).

[0140] In one embodiment, the user terminal (1120) (or the user terminal (1120) including the first terminal (1120-1) and the second terminal (1120-2)) may be made in various form factors and is characterized by including an output device for providing images and / or sounds to the user and an input device for inputting information to the metaverse service. Examples of various form factors of the user terminal (1120) include a smartphone (e.g., the second terminal (1120-2)), an AR device (e.g., the first terminal (1120-1)), a VR device, an MR device, a VST (Video See Through) device, an OST (Optical See Through) device, a smart lens, a smart mirror, an input / output capable TV or projector.

[0141] The network of the present invention (e.g., a network formed by at least one intermediate node (1130)) includes various broadband networks including 3G, 4G, and 5G, and short-range networks including Wifi, BT, etc. (e.g., a wired network or wireless network directly connecting the first terminal (1120-1) and the second terminal (1120-2).

[0142] FIG. 12 is a block diagram of an electronic device (1201) within a network environment (1200) according to various embodiments. Referring to FIG. 12 , in the network environment (1200), the electronic device (1201) may communicate with the electronic device (1202) via a first network (1298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1204) or the server (1208) via a second network (1299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1201) may communicate with the electronic device (1204) via the server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), a memory (1230), an input module (1250), an audio output module (1255), a display module (1260), an audio module (1270), a sensor module (1276), an interface (1277), a connection terminal (1278), a haptic module (1279), a camera module (1280), a power management module (1288), a battery (1289), a communication module (1290), a subscriber identification module (1296), or an antenna module (1297). In some embodiments, the electronic device (1201) may omit at least one of these components (e.g., the connection terminal (1278)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into a single component (e.g., display module (1260)).

[0143] The processor (1220) may control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) by executing, for example, software (e.g., program (1240)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1220) may store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store result data in non-volatile memory (1234). According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1221). For example, when the electronic device (1201) includes the main processor (1221) and the auxiliary processor (1223), the auxiliary processor (1223) may be configured to use less power than the main processor (1221) or to be specialized for a given function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as a part thereof.

[0144] The auxiliary processor (1223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1260), a sensor module (1276), or a communication module (1290)) of the electronic device (1201), for example, on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1280) or a communication module (1290)). In one embodiment, the auxiliary processor (1223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0145] The memory (1230) can store various data used by at least one component (e.g., the processor (1220) or the sensor module (1276)) of the electronic device (1201). The data can include, for example, software (e.g., the program (1240)) and input data or output data for commands related thereto. The memory (1230) can include a volatile memory (1232) or a non-volatile memory (1234).

[0146] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).

[0147] The input module (1250) can receive commands or data to be used in a component of the electronic device (1201) (e.g., a processor (1220)) from an external source (e.g., a user) of the electronic device (1201). The input module (1250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0148] The audio output module (1255) can output audio signals to the outside of the electronic device (1201). The audio output module (1255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0149] The display module (1260) can visually provide information to an external party (e.g., a user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0150] The audio module (1270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250), output sound through the sound output module (1255), or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1201).

[0151] The sensor module (1276) can detect the operating status (e.g., power or temperature) of the electronic device (1201) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0152] The interface (1277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1201) with an external electronic device (e.g., the electronic device (1202)). In one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0153] The connection terminal (1278) may include a connector through which the electronic device (1201) may be physically connected to an external electronic device (e.g., the electronic device (1202)). In one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0154] The haptic module (1279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0155] The camera module (1280) can capture still images and videos. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0156] The power management module (1288) can manage the power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0157] A battery (1289) may power at least one component of the electronic device (1201). In one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0158] The communication module (1290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may operate independently from the processor (1220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1294) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1204) via a first network (1298) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1296) to verify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299).

[0159] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1292) can support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1292) can support various requirements specified in the electronic device (1201), an external electronic device (e.g., the electronic device (1204)), or a network system (e.g., the second network (1299)). According to one embodiment, the wireless communication module (1292) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0160] The antenna module (1297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1297) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1298) or the second network (1299), may be selected from the plurality of antennas by, for example, the communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1297).

[0161] According to various embodiments, the antenna module (1297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0162] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0163] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) via a server (1208) connected to a second network (1299). Each of the external electronic devices (1202 or 1204) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations executed in the electronic device (1201) may be executed in one or more of the external electronic devices (1202, 1204, or 1208). For example, when the electronic device (1201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1201) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1201) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0164] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0165] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0166] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0167] Various embodiments of the present document may be implemented as software (e.g., a program (1240)) including one or more instructions stored in a storage medium (e.g., an internal memory (1236) or an external memory (1238)) readable by a machine (e.g., an electronic device (1201)). For example, a processor (e.g., a processor (1220)) of the machine (e.g., an electronic device (1201)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0168] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0169] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0170] In an electronic device (101) according to one embodiment as described above, the electronic device may include a display (260), a communication circuit (250), at least one processor (210) including a processing circuit; and a memory (220) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, an avatar (122-1) representing a human body model based on a resource status of the electronic device and corresponding to an external electronic device distinct from the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, by using the communication circuit, a signal for changing a portion of the avatar from the external electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to bypass changing a portion of the avatar according to the resource state of the electronic device and to display a visual object (163) representing the change of the portion of the avatar, adjacent to the avatar.

[0171] For example, the avatar may be a first avatar (122-1). To display the visual object, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to bypass the change of a portion of the first avatar and display the visual object based on receiving the signal from the external electronic device, the signal representing another human body model based on a resource status of the external electronic device and representing a change of a portion of a second avatar (122-3) corresponding to the first avatar.

[0172] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change the human body model to the other human body model using a user interface for changing the human body model based on a resource state of the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the second avatar representing the other human body model on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change a portion of the displayed second avatar based on receiving, using the communication circuitry, the signal from the external electronic device indicating a change in the portion of the second avatar.

[0173] For example, to display the visual object, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify an executable motion of the avatar based on the human body model representing the avatar. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object representing the change of a portion of the avatar on the display based on identifying the executable motion of the avatar.

[0174] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify a performable motion of the avatar based on a number of joints included in the human body model of the avatar.

[0175] For example, to display the visual object, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object based on identifying a number of the joints that is less than a specified threshold.

[0176] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a third avatar (121-1) corresponding to the electronic device on the display based on the resource status of the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display another visual object corresponding to at least one icon of the third avatar on the display in response to receiving an input for at least one icon (611) of a plurality of icons for changing at least a portion of the third avatar.

[0177] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, in response to receiving the input for at least one icon among a plurality of icons for changing at least a portion of the third avatar, transmit another signal to the external electronic device using the communication circuit for changing at least a portion of a fourth avatar (121-3) displayed on the external electronic device according to a resource status of the external electronic device. The fourth avatar may correspond to the third avatar.

[0178] In a method performed by an electronic device (101) according to one embodiment as described above, the method may include an operation of displaying, on a display, an avatar (122-1) representing a human body model based on a resource status of the electronic device and corresponding to an external electronic device distinct from the electronic device. The method may include an operation of receiving, from the external electronic device, a signal for changing a portion of the avatar using a communication circuit (250). The method may include an operation of bypassing changing a portion of the avatar according to the resource status of the electronic device and displaying a visual object (163) representing a change in a portion of the avatar adjacent to the avatar.

[0179] For example, the avatar may be a first avatar (122-1). The operation of displaying the visual object may include an operation of displaying the visual object by bypassing the change in the part of the first avatar based on receiving the signal indicating another human body model based on the resource status of the external electronic device from the external electronic device and indicating a change in a part of the second avatar (122-3) corresponding to the first avatar.

[0180] For example, the method may include an operation of changing the human body model to another human body model using a user interface for changing the human body model based on a resource status of the electronic device. The method may include an operation of displaying the second avatar representing the other human body model on the display. The method may include an operation of changing a portion of the displayed second avatar based on receiving, from the external electronic device, the signal indicating a change in a portion of the second avatar using the communication circuit.

[0181] For example, the act of displaying the visual object may include an act of identifying an executable motion of the avatar based on the human body model representing the avatar. The act of displaying the visual object may include an act of displaying the visual object representing the change of a portion of the avatar on the display based on the identifying executable motion of the avatar.

[0182] For example, the method may include an operation of identifying a performable motion of the avatar based on a number of joints included in the human body model of the avatar.

[0183] For example, the act of displaying the visual object may include the act of displaying the visual object based on identifying a number of the joints that is less than a specified threshold.

[0184] For example, the method may include an operation of displaying a third avatar (121-1) corresponding to the electronic device on the display based on the resource status of the electronic device. The method may include an operation of displaying another visual object corresponding to at least one icon of the third avatar on the display in response to receiving an input for at least one icon (611) among a plurality of icons for changing at least a portion of the third avatar.

[0185] In a non-transitory computer-readable storage medium storing one or more programs according to one embodiment as described above, the one or more programs may include instructions. The instructions, when individually or collectively executed by at least one processor (210-1) of the electronic device (110), may cause the electronic device to, in response to receiving a plurality of signals indicating entry into a virtual environment from each of a plurality of external electronic devices (110-1; 110-2), transmit information about avatars corresponding to each of the plurality of external electronic devices through the communication circuit (250-1) using information (292) corresponding to each of the plurality of external electronic devices. The instructions, when individually or collectively executed by at least one processor, may cause the electronic device to receive, by using the communication circuit, first state information for changing the state of a first avatar (121-1) representing a human body model based on a resource state of the first external electronic device, from a first external electronic device (110-1) among the plurality of external electronic devices. The instructions, when individually or collectively executed by at least one processor, may cause the electronic device, based on having received the first state information, to change the first state information to second state information for changing the state of a second avatar (121-3) corresponding to the first avatar, representing another human body model based on a resource state of a second external electronic device (101-2). The instructions, when individually or collectively executed by at least one processor, may cause the electronic device to transmit, by using the communication circuit, the second state information to the second external electronic device.

[0186] For example, the first state information may be identified based on the first external electronic device receiving an input for at least one icon (611) among a plurality of icons displayed on the first external electronic device. The plurality of icons may represent states of the first avatar.

[0187] For example, the instructions, when individually or collectively executed by at least one processor, may cause the electronic device to, based on receiving the first state information, transmit a signal to the first external electronic device for displaying a visual object representing the first state information, and to transmit the second state information to the second external electronic device for modifying a portion of the second avatar.

[0188] For example, the instructions, when individually or collectively executed by at least one processor, may cause the electronic device to receive, using the communication circuit, a signal from the first external electronic device to change the human body model based on the resource state of the electronic device to the other human body model. The instructions, when individually or collectively executed by at least one processor, may cause the electronic device to transmit, based on receiving the signal, to the first external electronic device information about a third avatar (121-3) based on the other human body model and corresponding to the first avatar.

[0189] For example, the number of joints included in the other human body model may be greater than the number of joints included in the human body model.

[0190] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0191] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0192] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0193] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0194] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In an electronic device (101), display (260); Communication circuit (250); and At least one processor (210) comprising a processing circuit; and A memory (220) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor, the electronic device, An avatar (122-1) representing a human body model based on the resource status of the electronic device and corresponding to an external electronic device distinct from the electronic device is displayed on the display, Using the above communication circuit, a signal for changing a part of the avatar is received from the external electronic device, and Bypassing the changing of a part of said avatar according to the resource status of said electronic device, causing a visual object (163) indicating the change of a part of said avatar to be displayed adjacent to said avatar. Electronic devices.

2. In paragraph 1, The above avatar is the first avatar (122-1), The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on receiving the signal indicating another human body model based on the resource status of the external electronic device from the external electronic device and indicating a change of a part of the second avatar (122-3) corresponding to the first avatar, bypassing the change of the part of the first avatar, causing the visual object to be displayed. Electronic devices.

3. In either of paragraphs 1 and 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Using a user interface for changing the human body model based on the resource status of the electronic device, changing the human body model to another human body model, Displaying the second avatar representing the other human body model on the display, and Using the above communication circuit, causing a portion of the displayed second avatar to be changed based on receiving the signal from the external electronic device indicating a change in the portion of the second avatar. Electronic devices.

4. In any one of paragraphs 1 to 3, to display the visual object, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the human body model representing the avatar, an implementable motion of the avatar is identified, and Based on identifying the performable motion of said avatar, causing said visual object representing said change of a part of said avatar to be displayed on said display; Electronic devices.

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing to identify the executable motion of the avatar based on the number of joints included in the human body model of the avatar; Electronic devices.

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing the visual object to be displayed based on identifying the number of said joints that are less than a specified threshold; Electronic devices.

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the resource status of the electronic device, a third avatar (121-1) corresponding to the electronic device is displayed on the display, and In response to receiving an input for at least one icon (611) of a plurality of icons for changing at least a portion of the third avatar, causing another visual object corresponding to at least one icon of the third avatar to be displayed on the display. Electronic devices.

8. In any one of paragraphs 1 to 7, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: In response to receiving the input for at least one icon among a plurality of icons for changing at least a part of the third avatar, causing another signal to be transmitted to the external electronic device using the communication circuit for changing at least a part of the fourth avatar (121-3) displayed on the external electronic device according to the resource status of the external electronic device, and The above fourth avatar corresponds to the above third avatar. Electronic devices.

9. In a method performed by an electronic device (101), the method comprises: An action of displaying an avatar (122-1) on a display, which represents a human body model based on the resource status of the electronic device and corresponds to an external electronic device that is distinct from the electronic device; An operation of receiving a signal for changing a part of the avatar from the external electronic device using a communication circuit (250), and An operation of displaying a visual object (163) indicating a change of a part of the avatar, adjacent to the avatar, bypassing changing a part of the avatar according to the resource status of the electronic device. method.

10. In paragraph 9, The above avatar is the first avatar (122-1), The action of displaying the above visual object is: An operation of displaying the visual object based on receiving a signal from the external electronic device indicating another human body model based on a resource status of the external electronic device and indicating a change of a part of a second avatar (122-3) corresponding to the first avatar, bypassing the change of the part of the first avatar, method.

11. In any one of paragraphs 9 to 10, The above method, An action of changing the human body model to another human body model using a user interface for changing the human body model based on the resource status of the electronic device. An action of displaying the second avatar representing the other human body model on the display, and An operation of changing a portion of the displayed second avatar based on receiving a signal indicating a change of a portion of the second avatar from the external electronic device using the communication circuit, method.

12. In any one of paragraphs 9 to 11, the action of displaying the visual object is: An operation of identifying a motion that the avatar can perform based on the human body model representing the avatar, and An operation of displaying on the display a visual object representing the change of a part of the avatar based on identifying the performable motion of the avatar. method.

13. In any one of paragraphs 9 to 12, An operation for identifying a performable motion of the avatar based on the number of joints included in the human body model of the avatar, method.

14. In any one of paragraphs 9 to 13, the action of displaying the visual object is: An action of displaying said visual object, based on identifying a number of said joints that are less than a specified threshold, method.

15. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, The above instructions, when executed individually or collectively by at least one processor (210-1) of the electronic device (110), cause the electronic device to: In response to receiving a plurality of signals indicating entry into a virtual environment from each of a plurality of external electronic devices (110-1; 110-2), information about an avatar corresponding to each of the plurality of external electronic devices is transmitted to each of the plurality of external electronic devices through a communication circuit (250-1) using information (292) corresponding to each of the plurality of external electronic devices. Using the above communication circuit, first state information for changing the state of a first avatar (121-1) representing a human body model based on a resource state of the first external electronic device (110-1) among the plurality of external electronic devices is received, Based on receiving the first state information, the first state information is changed into second state information for changing the state of a second avatar (121-3) corresponding to the first avatar and representing another human body model based on the resource state of the second external electronic device (101-2), and Using the above communication circuit, causing the second state information to be transmitted to the second external electronic device, A non-transitory computer-readable storage medium.

Citation Information

Patent Citations

  • Avatar presenting method and computer readable medium processing the method

    KR100957858B1

  • Apparatus and method for real-time estimation of a three-dimensional position of object

    KR1020240065772A

  • Air cleaner with air sterilization function using electrostatic atomization

    KR1020240077743A

  • Low pass filter having miniaturization and improved attenuation characteristics

    KR102686325B1

  • Avatar displaying system, user terminal, and program

    US20170153863A1