Electronic device, method, and computer-readable medium for displaying avatar

Abstract

This electronic device may comprise a display, a memory for storing instructions, and at least one processor. The instructions, when executed by the at least one processor, may cause the electronic device to: display a first avatar object in a first virtual environment via the display; acquire at least one piece of first feature point data on the first avatar object; acquire, on the basis of at least one user input, at least one piece of essential feature point data for generating an avatar; acquire candidate attribute information including at least a portion of the at least one piece of first feature point data on the first avatar object and the at least one piece of essential feature point data; acquire at least one piece of second feature point data on the basis of a database for a second virtual environment and the candidate attribute information; and display a second avatar object, associated with the first avatar object, in the second virtual environment via the display on the basis of the at least one piece of second feature point data.

Description

Electronic device, method, and computer-readable medium for displaying an avatar

[0001] Embodiments of the present disclosure relate to electronic devices, methods, and computer-readable media for displaying avatars.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices can provide AR services to users by utilizing virtual objects corresponding to the user.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] In embodiments, an electronic device is provided. The electronic device may include a display, a memory storing instructions, and at least one processor. The instructions, when executed by the at least one processor, may cause the electronic device to display a first avatar object through the display in a first virtual environment, obtain at least one first feature data of the first avatar object, obtain at least one essential feature data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of the at least one first feature data of the first avatar object and the at least one essential feature data, obtain at least one second feature data based on a database for a second virtual environment and the candidate attribute information, and display a second avatar object associated with the first avatar object in the second virtual environment through the display based on the at least one second feature data.

[0005] In embodiments, an electronic device is provided. The electronic device may include a display, a memory storing instructions, and at least one processor. The instructions, when executed by the at least one processor, may cause the electronic device to obtain, from a first database for a first virtual environment, at least one first feature data associated with a first avatar object for the first virtual environment, obtain at least one essential feature data for generating an avatar based on at least one user input, obtain at least one candidate feature data including at least a portion of at least one first feature data of the first avatar object and the at least one essential feature data, obtain at least one second feature data from a database for a second virtual environment based on the at least one candidate feature data, and display, through the display, a second avatar object corresponding to the avatar object within the second virtual environment based on the at least one second feature data.

[0006] In embodiments, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium may include a memory including instructions. The instructions, when executed by at least one processor, may cause an electronic device to display a first avatar object through a display in a first virtual environment, obtain at least one essential feature data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of at least one first feature data of the first avatar object and the at least one essential feature data, obtain at least one second feature data based on a database for a second virtual environment and the candidate attribute information, and display a second avatar object associated with the first avatar object in the second virtual environment based on the at least one second feature data.

[0007] In embodiments, a non-transitory computer-readable recording medium is provided. The non-transitory computer-readable recording medium can store instructions. The above instructions, when executed by at least one processor, may cause the electronic device (101) to display a first avatar object (161) within a first virtual environment (151), obtain at least one first feature point data of the first avatar object (161), obtain at least one essential feature point data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of the at least one first feature point data of the first avatar object (161) and the at least one essential feature point data, obtain at least one second feature point data based on a database (660) for a second virtual environment (152) and the candidate attribute information, and display a second avatar object (162) associated with the first avatar object (161) within the second virtual environment (152) based on the at least one second feature point data.

[0008] Figures 1a and 1b illustrate examples of avatar objects in a virtual environment.

[0009] Figure 2a illustrates an example of a perspective view of a wearable device.

[0010] FIG. 2b illustrates an example of one or more hardware devices arranged within a wearable device.

[0011] Figures 2c and 2d illustrate an example of the appearance of a wearable device.

[0012] Figure 3 illustrates an example of a block diagram of an electronic device.

[0013] Figure 4 illustrates an example of a block diagram of an electronic device.

[0014] Figures 5a and 5b illustrate examples of feature point data for displaying an avatar object.

[0015] Figure 6 illustrates an example of a database for displaying avatar objects in a virtual environment.

[0016] Figure 7 illustrates an example of a comparison procedure between feature point data of candidate attribute information and a database.

[0017] Figure 8 illustrates the operation flow of a wearable device for creating an avatar object in a virtual environment.

[0018] Figure 9 illustrates the operation flow of a wearable device for creating an avatar object in a virtual environment.

[0019] Figures 10a, 10b, and 10c illustrate examples of user interfaces for creating avatar objects in a virtual environment.

[0020] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

[0021] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0022] In the following description, terms referring to signals (e.g., signal, information, message, signaling), terms referring to avatar objects (e.g., avatar, visual object, user object, user information, symbol), terms referring to feature points (e.g., feature point data, feature point information, feature point attribute, attribute information, attribute data, item, user data, feature part, feature point part), terms referring to values ​​(e.g., level, threshold, range, value, area), terms for operation states (e.g., step, operation, procedure), terms referring to network entities, terms referring to components of a device, etc. are examples for convenience of description. Therefore, the present disclosure is not limited to the terms described below, and other terms having equivalent technical meanings may be used.

[0023] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled, but this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." A condition described as "more than" may be replaced with "more than," a condition described as "less than" may be replaced with "less than," and a condition described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of elements from A (including A) to B (including B). hereinafter, "C" and / or "D" mean at least one of "C" or "D," that is, including {"C", "D", "C" and "D"}.

[0024] Figures 1a and 1b illustrate examples of avatar objects in a virtual environment. The virtual environment (e.g., a first virtual environment (151), a second virtual environment (152)) can be displayed by an electronic device (101). The avatar objects (e.g., a first avatar object (161), a second avatar object (162)) can be displayed by the electronic device in the virtual environment.

[0025] Referring to FIG. 1A, the electronic device (101) may include a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, or a home appliance. The electronic device (101) according to embodiments of the present disclosure is not limited to the examples described above. The electronic device (101) may display a virtual environment. For example, the electronic device (101) may display a screen (120) representing a virtual environment on a display (e.g., the display module (360) of FIG. 3, the display (420) of FIG. 4) viewed by a user (105). For example, the screen (120) may refer to a user interface (UI) displayed within at least a portion of the display. Within the screen (120), the electronic device (101) may display one or more visual objects (or one or more virtual objects). A visual object may refer to an object that can be deployed on a screen for transmitting and / or interacting with information, such as text, images, icons, videos, buttons, checkboxes, radio buttons, text boxes, sliders, and / or tables. A visual object may be referred to as a visual guide, a virtual object, a visual element, a UI element, a view object, and / or a view element. For example, the screen (120) may include a virtual object representing a user (105) (e.g., a first avatar object (161), a second avatar object (162)). The screen (120) may be referred to as a virtual environment image from the perspective of representing a virtual environment in which the virtual objects are located.

[0026] Various metaverse services can provide avatar objects that are appropriate for their virtual spaces. Since avatar objects are characters representing users in the virtual space, the metaverse services can provide editing functions for the avatar objects to allow them to have various appearances. Since avatars are rendered according to the conditions required by the virtual environment for each metaverse service (e.g., avatar size, body proportions, rendering cost, animation method), users can create avatars for the virtual environment of the metaverse service whenever they change metaverse services. If compatibility between virtual environments is not met when the metaverse service changes, users are required to create new avatars. Creating or editing new avatars each time the virtual space changes can be cumbersome for users. To alleviate the above-described problems, the present disclosure describes a technique for displaying an avatar object with an identical or similar appearance to an avatar object used in a previous virtual environment in a subsequent virtual environment, based on the avatar object used in the previous virtual environment. As the virtual environment changes, the electronic device (101) can provide the user with the effect of moving the avatar object of the user (105) to a new metaverse service by displaying an avatar object that is identical or similar to the avatar object of the previous virtual environment. For example, the electronic device (101) can provide a first virtual environment (151). The electronic device (101) can display a first avatar object (161) representing the user (105) in the first virtual environment (151). The electronic device (101) can provide a second virtual environment (152). The electronic device (101) can generate a second avatar object (162) representing the user (105) in the second virtual environment (152) based on the first avatar object (161).The electronic device (101) can display a second avatar object (162) representing the user (105) on the second virtual environment (152).

[0027] Referring to FIG. 1B, the electronic device (101) may include a wearable device. The electronic device (101) may display a virtual environment. For example, the electronic device (101) may include a head-mounted display (HMD) that is wearable on the head of the user (105). The electronic device (101) may include a camera (e.g., the camera 425 of FIG. 4) positioned toward the front of the user (105) when the electronic device (101) is worn by the user (105). The front of the user (105) may include the head of the user (105) and / or the direction in which the gaze of the user (105) is directed. The electronic device (101) may include a sensor for identifying the motion of the head of the user (105) and / or the electronic device (101) when the electronic device (101) is worn by the user (105). The electronic device (101) can identify the angle of the electronic device (101) based on the data of the sensor. In order to provide a user interface (UI) based on virtual reality (VR), augmented reality (AR), and / or mixed reality (MR) to a user (105) wearing the electronic device (101), the electronic device (101) can control a camera and / or a sensor. The UI can be related to a metaverse service and / or a notification service provided by the electronic device (101) and / or a server connected to the electronic device (101).

[0028] An electronic device (101) may perform functions related to augmented reality (AR) and / or mixed reality (MR). When a user (105) wears the electronic device (101), the electronic device (101) may include at least one lens positioned adjacent to the user's (105) eyes. Ambient light passing through the lens of the electronic device (101) may be combined (or mixed) with light emitted from a display (e.g., display (420) of FIG. 4) of the electronic device (101). A display area of ​​the display may be formed within the lens through which the ambient light passes. Since the electronic device (101) combines the ambient light and the light emitted from the display, the user (105) may see an image in which a real object recognized by the ambient light and a virtual object formed by the light emitted from the display are mixed.

[0029] An electronic device (101) may perform functions related to video see-through (VST) and / or virtual reality (VR). When a user (105) wears the electronic device (101), the electronic device (101) may include a housing that covers the eyes of the user (105). The electronic device (101), in the above state, may include a display disposed on a first side facing the eyes (e.g., the first side (291) of FIG. 2C). The electronic device (101) may include a camera (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12 of FIG. 2D) disposed on a second side opposite to the first side (e.g., the second side (292) of FIG. 2C). Using the camera, the electronic device (101) can acquire frame images containing ambient light. The electronic device (101) can output the frame images to a display disposed on the first surface, thereby allowing a user (105) to recognize the ambient light through the display. A display area of ​​the display disposed on the first surface can be formed by one or more pixels included in the display. The electronic device (101) can synthesize a virtual object within the frame images output through the display, so as to allow the user (105) to recognize the virtual object together with a real object recognized by the ambient light.

[0030] An electronic device (101) can provide a user experience based on mixed reality (MR) by using a virtual space. The electronic device (101) can recognize an external space (e.g., a real space) in which the electronic device (101) is included, and generate a virtual space mapped to the external space. The electronic device (101) recognizing the external space may include an operation of obtaining information about the size of the external space (e.g., the size of the external space defined by a side wall, a floor surface, and / or a ceiling surface). The electronic device (101) recognizing the external space may include an operation of identifying an external plane (e.g., a ceiling, and / or a floor) included in the external space. The electronic device (101) identifying the external space may include an operation of identifying a virtual object (e.g., a user interface (UI) for displaying at least one image) displayed within a display.

[0031] The electronic device (101) can provide an external object (or an existence object) recognized by ambient light and a visual object (or a virtual object) displayed by a display to the user (105). For example, the electronic device (101) can obtain an image (130) corresponding to the user's gaze obtained using a sensor. The image (130) can be obtained using a camera of the electronic device (101). For example, the image (130) can correspond to the field-of-view (FoV) of the user (105). For example, the image (130) can correspond to the field-of-view (FoV) of the camera of the electronic device (101). The image (130) can be referred to as an external image (130) in the sense that it represents at least a portion of the actual environment around the electronic device identified through the camera. For example, the image (130) may be referred to as a frame image from the perspective of corresponding to at least one of a plurality of frame images acquired through a camera. The image (130) may be used to track a body part (e.g., a hand) of a user (105). For example, the electronic device (101) may identify the posture of the body part of the user (105) based on a hand tracking (HaT) module (e.g., the hand tracking module (454) of FIG. 4). The hardware and / or software configuration included in the electronic device (101) will be described below with reference to FIG. 4.

[0032] An electronic device (101) according to one embodiment may display a screen (120) representing a virtual environment on a display. The description of the electronic device (101) in FIG. 1A may be applied to the electronic device (101) in FIG. 1B in the same or similar manner. As the virtual environment changes, the electronic device (101) may display an avatar object that is identical or similar to an avatar object of a previous virtual environment, thereby providing the user with the effect of transferring the avatar object of the user (105) to a new metaverse service. For example, the electronic device (101) may provide a first virtual environment (151). The electronic device (101) may display a first avatar object (161) representing the user (105) in the first virtual environment (151). The electronic device (101) may provide a second virtual environment (152). The electronic device (101) can generate a second avatar object (162) representing the user (105) in the second virtual environment (152) based on the first avatar object (161). The electronic device (101) can display the second avatar object (162) representing the user (105) on the second virtual environment (152).

[0033] FIG. 2A illustrates an example of a perspective view of a wearable device (e.g., an electronic device (101)). FIG. 2B illustrates an example of one or more hardware pieces arranged in a wearable device (e.g., an electronic device (101)). According to one embodiment, the wearable device (101) may have a form of glasses that are wearable on a body part (e.g., a head) of a user. The electronic device (101) of FIGS. 2A and 2B may be an example of the electronic device (101) of FIG. 1B. The electronic device (101) may include a head-mounted display (HMD). For example, the housing of the electronic device (101) may include a flexible material, such as rubber and / or silicone, that is configured to adhere closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the electronic device (101) may include one or more straps capable of being twined around the user's head, and / or one or more temples attachable to the ears of the head.

[0034] Referring to FIG. 2A, according to one embodiment, an electronic device (101) may include at least one display (250) and a frame (200) supporting at least one display (250).

[0035] According to one embodiment, the electronic device (101) can be worn on a part of a user's body. The electronic device (101) can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the electronic device (101). For example, the electronic device (101) can display a virtual reality image provided from at least one optical device (282, 284) of FIG. 2B on at least one display (250) in response to a user's designated gesture acquired through the motion recognition cameras (260-2, 260-3) of FIG. 2B.

[0036] According to one embodiment, at least one display (250) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0037] Referring to FIG. 2B, at least one display (250) can provide a user with visual information transmitted from external light and other visual information distinct from the visual information through a lens included in the at least one display (250). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (250) can include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area can be formed on the second surface (232) of the at least one display (250). When a user wears the electronic device (101), external light can be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (282, 284) on a real screen transmitted through external light, in a display area formed on the second surface (232).

[0038] In one embodiment, at least one display (250) may include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits the diffracted light to a user. The at least one waveguide (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (233, 234). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (233, 234) may be propagated to the other end of the at least one waveguide (233, 234) by the nano-pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be arranged within the electronic device (101) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the at least one waveguide (233, 234).

[0039] The electronic device (101) can analyze an object included in a real image collected through a shooting camera (260-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The electronic device (101) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the electronic device (101) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using the multi-camera and / or time-of-flight (ToF). A user wearing the electronic device (101) can view an image displayed on at least one display (250).

[0040] According to one embodiment, the frame (200) may be formed as a physical structure that allows the electronic device (101) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that, when the user wears the electronic device (101), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.

[0041] Referring to FIG. 2A, the frame (200) may include a region (220) that at least partially contacts a part of the user's body when the user wears the electronic device (101). For example, the region (220) of the frame (200) that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the electronic device (101) makes contact with. According to one embodiment, the frame (200) may include a nose pad (210) that contacts a part of the user's body. When the electronic device (101) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that contact a part of the user's body that is distinct from the part of the user's body.

[0042] For example, the frame (200) may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of the wearer's ear, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of the ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the electronic device (101) can identify an external object (e.g., a user's fingertip) touching the frame (200) and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (200).

[0043] According to one embodiment, the electronic device (101) may include hardwares that perform various functions (e.g., hardwares to be described later based on the block diagram of FIG. 4). For example, the hardwares may include a battery module (270), an antenna module (275), at least one optical device (282, 284), speakers (e.g., speakers 255-1, 255-2), a microphone (e.g., microphones 265-1, 265-2, 265-3), a light-emitting module (not shown), and / or a printed circuit board (PCB) (290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (200).

[0044] According to one embodiment, a microphone (e.g., microphones 265-1, 265-2, 265-3) of the electronic device (101) may be disposed on at least a portion of the frame (200) to acquire a sound signal. A first microphone (265-1) disposed on the bridge (203), a second microphone (265-2) disposed on the second rim (202), and a third microphone (265-3) disposed on the first rim (201) are illustrated in FIG. 2B, but the number and arrangement of the microphones (265) are not limited to the embodiment of FIG. 2B. When the number of microphones (265) included in the electronic device (101) is two or more, the electronic device (101) may identify a direction of a sound signal by using a plurality of microphones disposed on different portions of the frame (200).

[0045] According to one embodiment, at least one optical device (282, 284) may project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) may be a projector. At least one optical device (282, 284) may be disposed adjacent to at least one display (250) or may be included within at least one display (250) as a part of at least one display (250). According to one embodiment, the electronic device (101) may include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) disposed at an edge of a first display (250-1) and a second optical device (284) disposed at an edge of a second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) disposed on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) disposed on the second display (250-2).

[0046] In one embodiment, the camera (260) may include a recording camera (260-4), an eye tracking camera (ET CAM) (260-1), and / or a motion recognition camera (260-2, 260-3). The recording camera (260-4), the eye tracking camera (260-1), and the motion recognition cameras (260-2, 260-3) may be positioned at different locations on the frame (200) and may perform different functions. The eye tracking camera (260-1) may output data indicating the position or gaze of the eyes of a user wearing the electronic device (101). For example, the electronic device (101) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (260-1). The electronic device (101) can identify an object (e.g., a real object and / or a virtual object) focused on by the user using the user's gaze acquired through the gaze tracking camera (260-1). The electronic device (101) that has identified the focused object can execute a function (e.g., gaze interaction) for interaction between the user and the focused object. The electronic device (101) can express a part corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (260-1). The electronic device (101) can render an image (or screen) displayed on at least one display (250) based on the position of the user's eyes. For example, the visual quality of a first area related to the gaze within the image and the visual quality (e.g., resolution, brightness, saturation, grayscale, PPI) of a second area distinguished from the first area may be different from each other. The electronic device (101) can obtain an image having visual quality of a first area matching the user's gaze and visual quality of a second area using foveated rendering.For example, if the electronic device (101) supports an iris recognition function, user authentication can be performed based on iris information acquired using the gaze tracking camera (260-1). An example in which the gaze tracking camera (260-1) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (260-1) may be positioned solely toward the user's left eye, or toward both eyes.

[0047] In one embodiment, the capturing camera (260-4) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera (260-4) can be used to acquire a high-resolution image based on HR (high resolution) or PV (photo video). The capturing camera (260-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about an actual image or background including the image of the specific object acquired using the capturing camera (260-4) and a virtual image provided through at least one optical device (282, 284) are superimposed. The electronic device (101) can compensate for depth information (e.g., the distance between the electronic device (101) and an external object acquired through a depth sensor) using the image acquired through the capturing camera (260-4). The electronic device (101) can perform object recognition through an image acquired using the photographing camera (260-4). The electronic device (101) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the photographing camera (260-4). The electronic device (101) can perform a pass-through function to display an image acquired through the photographing camera (260-4) by overlapping at least a portion of a screen representing a virtual space on at least one display (250). In one embodiment, the photographing camera (260-4) can be disposed on a bridge (203) disposed between the first rim (201) and the second rim (202).

[0048] The gaze tracking camera (260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the electronic device (101) and matching the user's gaze with visual information provided to at least one display (250). For example, when the electronic device (101) looks straight ahead, the electronic device (101) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (260-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (260-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (260-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the electronic device (101) is positioned.

[0049] The motion recognition camera (260-2, 260-3) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (250). The motion recognition camera (260-2, 260-3) can recognize the user's motion (gesture recognition), obtain a signal corresponding to the motion, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the motion, and perform a designated function based on the identification. The motion recognition camera (260-2, 260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 dof pose). The processor can perform a gesture recognition function and / or an object tracking function using the motion recognition camera (260-2, 260-3). In one embodiment, the motion recognition cameras (260-2, 260-3) may be positioned on the first rim (201) and / or the second rim (202).

[0050] The camera (260) included in the electronic device (101) is not limited to the above-described gaze tracking camera (260-1) and motion recognition cameras (260-2, 260-3). For example, the electronic device (101) may identify an external object included in the FoV using a camera positioned toward the user's FoV. The electronic device (101) may identify an external object based on a sensor for identifying the distance between the electronic device (101) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (260) positioned toward the FoV may support an autofocus function and / or an optical image stabilization (OIS) function. For example, the electronic device (101) may include a camera (260) (e.g., a face tracking (FT) camera) positioned toward the face to acquire an image including the face of a user wearing the electronic device (101).

[0051] Although not shown, in one embodiment, the electronic device (101) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (260). The light source may include an LED having an infrared wavelength. The light source may be disposed in at least one of the frame (200) and the hinge units (206, 207).

[0052] According to one embodiment, the battery module (270) may supply power to electronic components of the electronic device (101). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).

[0053] The antenna module (275) can transmit signals or power to the outside of the electronic device (101), or receive signals or power from the outside. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and / or the second temple (205).

[0054] The speaker (255) can output an acoustic signal to the outside of the electronic device (101). The acoustic output module may be referred to as a speaker. In one embodiment, the speaker (255) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ear of a user wearing the electronic device (101). For example, the speaker (255) may include a second speaker (255-2) positioned within the first temple (204) and thus positioned adjacent to the user's left ear, and a first speaker (255-1) positioned within the second temple (205) and thus positioned adjacent to the user's right ear.

[0055] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the electronic device (101) to the user. For example, when the electronic device (101) requires charging, the electronic device (101) may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).

[0056] Referring to FIG. 2B, according to one embodiment, an electronic device (101) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the electronic device (101) (e.g., hardwares illustrated by different blocks in FIG. 4) may be disposed on the PCB (290). The electronic device (101) may include a flexible PCB (FPCB) for interconnecting the hardwares.

[0057] According to one embodiment, the electronic device (101) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the electronic device (101) and / or a posture of a body part (e.g., a head) of a user wearing the electronic device (101). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the electronic device (101) may identify a motion and / or gesture of the user performed to execute or stop a specific function of the electronic device (101) based on the IMU.

[0058] FIGS. 2C and 2D illustrate an example of an exterior appearance of an electronic device (e.g., electronic device (101)). The electronic device (101) of FIGS. 2C and 2D may be an example of the electronic device (101) of FIG. 1B. According to one embodiment, an example of an exterior appearance of a first side (291) of a housing of the electronic device (101) is illustrated in FIG. 2C, and an example of an exterior appearance of a second side (292) opposite to the first side (291) may be illustrated in FIG. 2D.

[0059] Referring to FIG. 2C, according to one embodiment, the first surface (291) of the electronic device (101) may have a form attachable on a body part of a user (e.g., the face of the user). Although not shown, the electronic device (101) may further include a strap for fixing on a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (250-1) for outputting an image to a left eye among the user's two eyes, and a second display (250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (291). The electronic device (101) is formed on the first surface (291) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light radiated from the first display (250-1) and the second display (250-2).

[0060] According to one embodiment, the electronic device (101) may include cameras (260-1) for photographing and / or tracking both eyes of the user adjacent to each of the first display (250-1) and the second display (250-2). The cameras (260-1) may be referred to as the gaze tracking camera (260-1) of FIG. 2B. According to one embodiment, the electronic device (101) may include cameras (260-5, 260-6) for photographing and / or recognizing the face of the user. The cameras (260-5, 260-6) may be referred to as FT cameras. The electronic device (101) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (260-5, 260-6). For example, the electronic device (101) may change the texture and / or shape of a portion of an avatar (e.g., a portion of an avatar representing a human face) using information obtained by cameras (260-5, 260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the electronic device (101).

[0061] Referring to FIG. 2d, a camera (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12)) and / or a sensor (e.g., a depth sensor 293) for obtaining information related to the external environment of the electronic device (101) may be disposed on a second surface (292) opposite to the first surface (291) of FIG. 2c. For example, the cameras (260-7, 260-8, 260-9, 260-10) may be disposed on the second surface (292) to recognize external objects. The cameras (260-7, 260-8, 260-9, 260-10) may be referred to as the motion recognition cameras (260-2, 260-3) of FIG. 2b.

[0062] For example, using cameras (260-11, 260-12), the electronic device (101) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (260-11) can be placed on the second surface (292) of the electronic device (101) to obtain an image to be displayed through the second display (250-2) corresponding to the right eye among the two eyes. The camera (260-12) can be placed on the second surface (292) of the electronic device (101) to obtain an image to be displayed through the first display (250-1) corresponding to the left eye among the two eyes. The cameras (260-11, 260-12) can be referred to as the shooting camera (260-4) of FIG. 2B.

[0063] According to one embodiment, the electronic device (101) may include a depth sensor (293) disposed on the second face (292) to identify a distance between the electronic device (101) and an external object. Using the depth sensor (293), the electronic device (101) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the electronic device (101). Although not illustrated, a microphone may be disposed on the second face (292) of the electronic device (101) to obtain sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0064] FIG. 3 illustrates an example of a block diagram of an electronic device (e.g., electronic device (101)).

[0065] Referring to FIG. 3, in a network environment (300), an electronic device (101) may communicate with an electronic device (302) via a first network (398) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (304) or a server (308) via a second network (399) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (304) via the server (308). According to one embodiment, the electronic device (101) may include a processor (320), a memory (330), an input module (350), an audio output module (355), a display module (360), an audio module (370), a sensor module (376), an interface (377), a connection terminal (378), a haptic module (379), a camera module (380), a power management module (388), a battery (389), a communication module (390), a subscriber identification module (396), or an antenna module (397). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (378)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (376), the camera module (380), or the antenna module (397)) may be integrated into one component (e.g., the display module (360)).

[0066] The processor (320) may, for example, execute software (e.g., a program (340)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (320) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (320) may store commands or data received from other components (e.g., a sensor module (376) or a communication module (390)) in a volatile memory (332), process the commands or data stored in the volatile memory (332), and store result data in a non-volatile memory (334). According to one embodiment, the processor (320) may include a main processor (321) (e.g., a central processing unit or an application processor) or a secondary processor (323) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (321) and a secondary processor (323), the secondary processor (323) may be configured to use less power than the main processor (321) or to be specialized for a specified function. The secondary processor (323) may be implemented separately from the main processor (321) or as a part thereof.

[0067] The auxiliary processor (323) may control at least a portion of functions or states associated with at least one component (e.g., a display module (360), a sensor module (376), or a communication module (390)) of the electronic device (101), for example, on behalf of the main processor (321) while the main processor (321) is in an inactive (e.g., sleep) state, or together with the main processor (321) while the main processor (321) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (323) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (380) or a communication module (390)). In one embodiment, the auxiliary processor (323) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (308)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0068] The memory (330) can store various data used by at least one component (e.g., processor (320) or sensor module (376)) of the electronic device (101). The data can include, for example, software (e.g., program (340)) and input data or output data for commands related thereto. The memory (330) can include volatile memory (332) or non-volatile memory (334).

[0069] The program (340) may be stored as software in the memory (330) and may include, for example, an operating system (342), middleware (344), or an application (346).

[0070] The input module (350) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (320)) from an external source (e.g., a user) of the electronic device (101). The input module (350) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0071] The audio output module (355) can output audio signals to the outside of the electronic device (101). The audio output module (355) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0072] The display module (360) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (360) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0073] The audio module (370) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (370) can acquire sound through the input module (350), output sound through the sound output module (355), or an external electronic device (e.g., electronic device (302)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0074] The sensor module (376) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (376) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0075] The interface (377) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (302)). In one embodiment, the interface (377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0076] The connection terminal (378) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., the electronic device (302)). According to one embodiment, the connection terminal (378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0077] The haptic module (379) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (379) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0078] The camera module (380) can capture still images and videos. According to one embodiment, the camera module (380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0079] The power management module (388) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (388) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0080] A battery (389) may power at least one component of the electronic device (101). In one embodiment, the battery (389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0081] The communication module (390) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (302), electronic device (304), or server (308)), and the performance of communication through the established communication channel. The communication module (390) may operate independently from the processor (320) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (390) may include a wireless communication module (392) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (394) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (304) via a first network (398) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (399) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (392) can verify or authenticate the electronic device (101) within a communication network such as the first network (398) or the second network (399) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (396).

[0082] The wireless communication module (392) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (392) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (392) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (392) may support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (304)), or a network system (e.g., the second network (399)). According to one embodiment, the wireless communication module (392) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0083] The antenna module (397) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (397) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (398) or the second network (399), may be selected from the plurality of antennas by, for example, the communication module (390). A signal or power may be transmitted or received between the communication module (390) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (397).

[0084] According to various embodiments, the antenna module (397) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0085] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0086] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (304) via a server (308) connected to a second network (399). Each of the external electronic devices (302 or 304) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (302, 304, or 308). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (304) may include an Internet of Things (IoT) device. The server (308) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (304) or the server (308) may be included in the second network (399).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0087] Fig. 4 illustrates an example of a block diagram of a wearable device (e.g., an electronic device (101)). The electronic device (101) of Fig. 4 may be an example of the electronic device (101) of Fig. 1A or Fig. 1B, or the electronic device (101) of Figs. 2A to 2D. The electronic device (101) of Fig. 4 may include a wearable device.

[0088] Referring to FIG. 4, an electronic device (101) according to one embodiment may include at least one of a processor (410), a memory (415), a display (420), a camera (425), a sensor (430), or a communication circuit (480). The processor (410), the memory (415), the display (420), the camera (425), the sensor (430), and the communication circuit (480) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (402). The type and / or number of hardware components included in the electronic device (101) is not limited to those illustrated in FIG. 4. For example, the electronic device (101) may include only some of the hardware components illustrated in FIG. 4. Elements (e.g., layers and / or modules) within the memory described below may be logically separated. However, it is not limited to this.

[0089] A processor (410) of an electronic device (101) according to one embodiment may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (410) may be one or more. For example, the processor (410) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0090] The memory (415) of the electronic device (101) according to one embodiment may include a hardware component for storing data and / or instructions input and / or output to the processor (410). The memory (415) may include, for example, a volatile memory such as a random-access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multi-media card (eMMC).

[0091] In one embodiment, the display (420) of the electronic device (101) can output visualized information to a user of the electronic device (101). For example, the display (420) can be controlled by a processor (410) including a circuit such as a graphic processing unit (GPU) to output visualized information to the user. The display (420) can include a flat panel display (FPD) and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs).

[0092] In one embodiment, the camera (425) of the electronic device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The plurality of optical sensors included in the camera (425) may be arranged in the form of a two-dimensional array. The camera (425) may acquire electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional array. For example, photographic data captured using the camera (425) may mean one (a) two-dimensional frame data acquired from the camera (425). For example, video data captured using the camera (425) may mean a sequence of a plurality of two-dimensional frame data acquired from the camera (425) according to a frame rate. The camera (425) may further include a flash light that is positioned toward the direction in which the camera (425) receives light and outputs light toward the direction.

[0093] According to one embodiment, the electronic device (101) may include a plurality of cameras (not shown) arranged in different directions, as an example of a camera (425). A first camera among the plurality of cameras may be referred to as a motion recognition camera, and a second camera may be referred to as an eye tracking camera. The electronic device (100) may identify a position, shape, and / or gesture of a hand using an image of the first camera (e.g., image (130) of FIG. 1B). The electronic device (101) may identify a direction of a user's gaze (e.g., user (105) of FIGS. 1A and 1B) using an image of the second camera (not shown). For example, the direction in which the first camera faces may be opposite to the direction in which the second camera faces.

[0094] According to one embodiment, a sensor (430) of an electronic device (101) may generate electrical information that may be processed by a processor (410) and / or a memory (415) of the electronic device (101) from non-electronic information related to the electronic device (101). The information may be referred to as sensor data. The sensor (430) may include a global positioning system (GPS) sensor, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor for detecting a geographic location of the electronic device (101), and an inertial measurement unit (IMU) for detecting a physical motion of the electronic device (101).

[0095] In one embodiment, the communication circuit (480) of the electronic device (101) may include hardware components for supporting transmission and / or reception of electrical signals between the electronic device (101) and an external electronic device (e.g., an external controller or server (405)). The communication circuit (480) may include, for example, at least one of a modem (MODEM), an antenna, and an optical / electronic (O / E) converter. The communication circuit (480) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G NR (new radio), and / or 6G.

[0096] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by a processor (410) of the electronic device (101) may be stored in the memory (415) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (410) may perform at least one of the operations of FIG. 8 or FIG. 9 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in a memory (415), and that the one or more applications are stored in a format executable by the processor (410) (e.g., a file having an extension specified by the operating system of the electronic device (101). As an example, an application may include a program and / or a library related to a service provided to a user.

[0097] Referring to FIG. 4, programs installed in the electronic device (101) may be classified into any one of different layers, including an application layer (440), a framework layer (450), and / or a hardware abstraction layer (HAL) (460), based on the target. For example, programs (e.g., modules or drivers) designed to target the hardware of the electronic device (101) (e.g., a display (420), a camera (420), and / or a sensor (430)) may be classified within the hardware abstraction layer (460). For example, although FIG. 4 illustrates the layers being divided within the memory (415), the layers may be logically divided. However, the present invention is not limited thereto. Depending on the embodiment, the layers may be stored in a designated area within the memory (415).

[0098] For example, within the framework layer (450), programs designed to target at least one of the hardware abstraction layer (460) and / or the application layer (440) (e.g., a position tracker (453-1), a space recognizer (453-2), a gesture tracker (453-3), an eye tracker (453-4), a controller tracker (453-5), a virtual space analyzer (455), and / or a renderer (454)) may be classified. Programs classified into the framework layer (450) may provide an executable API (application programming interface) based on other programs.

[0099] For example, within the application layer (440), programs designed to target a user controlling the electronic device (101) (e.g., the user (105) of FIGS. 1A and 1B) may be classified. As an example of programs classified into the application layer (440), the first software application (441) is exemplified, but the embodiment is not limited thereto. For example, programs (e.g., software applications) classified into the application layer (440) may call an API to cause the execution of functions supported by programs classified into the framework layer (450). For example, the electronic device (101) may display the screen (120) of FIGS. 1A and 1B representing a virtual environment on the display (420) based on the execution of the first software application (441).

[0100] According to one embodiment, the virtual environment manager (451) may be configured for a virtual environment service. For example, the virtual environment manager (451) may include a platform (e.g., an Android platform) for supporting the virtual environment service. The virtual environment manager (451) may display the posture of a virtual object (e.g., a first avatar object (161), a second avatar object (162)) representing the posture of a rendered user using data acquired through a sensor (430) on a display. The virtual environment manager (451) may be referred to as a composition presentation manager.

[0101] For example, the virtual environment manager (451) may include a runtime service (451-1). As an example, the runtime service (451-1) may be referred to as an OpenXR runtime module. The runtime service (451-1) may be used to provide at least one of a pose prediction function, a frame timing function, and / or a spatial input function to a user through the electronic device (101). As an example, the runtime service (451-1) may be used to perform rendering for a virtual environment service to the user. For example, an application (e.g., unity or an OpenXR native application) may be implemented based on the runtime module (451-1).

[0102] For example, the perception abstract layer (452) can be used for data exchange between the virtual environment manager (451) and the perception service layer (453). From the perspective of being used for data exchange between the virtual environment manager (451) and the perception service layer (453), the perception abstract layer (452) can be referred to as an interface. For example, the perception abstract layer (452) can be referenced as OpenPX. The perception abstract layer (452) can be used for a perception client and a perception service.

[0103] According to one embodiment, the recognition service layer (453) may include one or more programs for processing data acquired from a sensor (430) (or camera (425)). The one or more programs may include at least one of a position tracker (453-1), a spatial recognizer (453-2), a gesture tracker (453-3), a gaze tracker (453-4), and a controller tracker (453-5).

[0104] For example, the position tracker (453-1) can identify the pose of the electronic device (101) using at least one sensor of the electronic device (101). As an example, the position tracker (453-1) can identify the 6 degrees of freedom pose (6 DOF pose) of the electronic device (101) based on data acquired using a camera (e.g., camera (425) of FIG. 4) and an IMU. The position tracker (453-1) may be referred to as a head tracking (HeT) module.

[0105] For example, the space recognizer (453-2) may be used to construct a surrounding environment of the electronic device (101) (or a user of the electronic device (101)) into a three-dimensional virtual space. The space recognizer (453-2) may be used to reconstruct the surrounding environment of the electronic device (101) in three dimensions based on data acquired using a camera (e.g., the camera (425) of FIG. 4). The space recognizer (453-2) may identify at least one of a plane, a slope, and stairs based on the three-dimensionally reconstructed surrounding environment of the electronic device (101). The space recognizer (453-2) may be referred to as a scene understanding (SU) module.

[0106] For example, the gesture tracker (453-3) may be used to identify (or recognize) a pose and / or gesture of a hand of a user of the electronic device (101). As an example, the gesture tracker (453-3) may identify a pose and / or gesture of a hand of a user based on data acquired from at least one sensor. As an example, the gesture tracker (453-3) may identify a pose and / or gesture of a hand of a user based on data acquired using a camera (e.g., an image (130)). The gesture tracker (453-3) may be referred to as a hand tracking (HaT) module.

[0107] For example, the gaze tracker (453-4) may be used to identify (or track) eye movements of a user of the electronic device (101). For example, the gaze tracker (453-4) may identify eye movements of the user based on data acquired from at least one sensor. For example, the gaze tracker (453-4) may identify eye movements of the user based on data acquired using a camera (e.g., the gaze tracking camera (260-1) of FIGS. 2A and 2B) and / or an infrared light emitting diode (IR LED). The gaze tracker (453-4) may be referred to as an eye tracking (ET) module.

[0108] For example, the controller tracker (453-4) may be used to identify (or track) the movement of a controller (e.g., an external controller) connected to the electronic device (101). As an example, the controller tracker (453-4) may identify the movement of the controller based on receiving sensor data included in the controller through a communication circuit.

[0109] For example, the recognition service layer (453) of the electronic device (101) may further include a face tracking module (not shown) for tracking the user's face. For example, the face tracking module may be used to identify (or track) the user's facial movements and / or the user's facial expressions. The face tracking module may estimate the user's facial expressions based on the user's facial movements. As an example, the face tracking module may identify the user's facial movements and / or the user's facial expressions based on data (e.g., images) acquired using a camera.

[0110] For example, the electronic device (101) may obtain data representing the user's posture and / or movement from one or more programs included in the recognition service layer (453) based on the execution of the renderer (454), thereby rendering a screen including a virtual object representing the user's posture within a virtual environment. The electronic device (101) may render one or more images (e.g., virtual object animation) for changing the posture of the virtual object using the posture information (470) based on the execution of the renderer (454). The electronic device (101) may change the posture of the entire virtual object based on inverse kinematics by identifying the posture of at least a portion of the user. When changing a portion of the virtual object, the electronic device (101) may change the posture of the entire virtual object by inferring the position at which another portion of the virtual object will change based on position information within the virtual environment using the inverse kinematics.

[0111] For example, the electronic device (101) can identify virtual environment information based on the execution of the virtual environment analyzer (455). As an example, the virtual environment information can be received from the server (405) to the electronic device (101).

[0112] For example, the posture information (470) may include one or more images representing the posture of the virtual object. As an example, the electronic device (101) may receive the posture information (470) from the server (405). The electronic device (101) may use the posture information (470) to identify the posture of the virtual object corresponding to the user's posture, thereby controlling the posture of the virtual object displayed on the display to be changed.

[0113] Referring to FIG. 4, the electronic device (101) and the server (405) may be connected to each other based on a wired network and / or a wireless network. The wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), Ethernet, or a combination thereof. The wireless network may include a network such as long term evolution (LTE), 5G new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. Although the electronic device (101) and the server (405) are illustrated as being directly connected, the electronic device (101) and the server (405) may be indirectly connected via an intermediate node within the network. The server (405) may be referred to as an external electronic device in that it is located outside the electronic device (101).

[0114] Referring to FIG. 4, in one embodiment, the server (405) may include at least one of a processor (410-1), a memory (415-1), and a communication circuit (480-1). Within the server (405), the processor (410-1), the memory (415-1), and the communication circuit (480-1) may be electrically and / or operatively coupled via a communication bus. The processor (410-1), the memory (415-1), and the communication circuit (480-1) included within the server (405) may include hardware components and / or circuits corresponding to the processor (410), the memory (415), and the communication circuit (480) of the electronic device (101). Hereinafter, to reduce repetition, descriptions of hardware and / or software included within the server (405) may be omitted to the extent that they overlap with the electronic device (101).

[0115] According to one embodiment, the server (405) may transmit a screen representing a virtual environment (e.g., screen (120) of FIGS. 1A and 1B) to the electronic device (101) using a virtual environment plug-in (490). The server (405) may provide a virtual environment service to the electronic device (101) (or the user (105)) using the virtual environment plug-in (490). The server (405) may store a program including instructions for interaction with the electronic device (101) in the memory (415-1). As an example of the program, the first software application (441-1) is exemplified, but the embodiment is not limited thereto.

[0116] For example, the server (405) may receive data (e.g., sensor data) obtained from one or more programs included in the recognition service layer (453) of the electronic device (101) from the electronic device (101). The server (405) may use the received data to generate rendering data for changing the posture of a virtual object using the renderer (454-1). For example, the server (405) may generate rendering data for changing the posture of a virtual object to the electronic device (101) based on the execution of the first software application (441-1). The server (405) may transmit the rendering data to the electronic device (101) to display a screen including a virtual object whose posture has been changed using the rendering data on the display (420) of the electronic device (101). However, the present invention is not limited thereto.

[0117] FIGS. 5A and 5B illustrate examples of keypoint data for displaying an avatar object (e.g., a first avatar object (161) of FIGS. 1A and 1B , a second avatar object (162) of FIGS. 1A and 1B ). An electronic device (101) according to embodiments of the present disclosure may display another avatar object (e.g., a second avatar object (162) of FIGS. 1A and 1B ) related to an avatar object in another virtual environment (e.g., a second virtual environment (152) of FIGS. 1A and 1B ) based on an avatar object (e.g., a first avatar object (161) of FIGS. 1A and 1B ) used in a previous virtual environment (e.g., a first virtual environment (151) of FIGS. 1A and 1B ). To generate an avatar object in a new virtual environment, keypoints of the avatar object may be identified. A feature point refers to a visually derived characteristic part when displaying an avatar object. The electronic device (101) can extract the feature points of the avatar object through a 3D (3-dimensional) model or a rendered image of the avatar object. For example, the electronic device (101) can confirm the height, head size, or body proportions of the avatar object through 3D model data of the avatar object. For example, the electronic device (101) can confirm the type and color of the clothing worn, and other visually displayed features, through a rendered image of the avatar object. Hereinafter, an example of extracting the feature points of a first avatar object (161) of a first virtual environment (151) is described.

[0118] Referring to FIG. 5A, the electronic device (101) can obtain first attribute information (510) of the first avatar object (161). The first attribute information (510) can include feature point data used to display the first avatar object (161) in the first virtual environment (151). The electronic device (101) can extract feature points of the first avatar object (161). The first attribute information (510) can include information on feature points of the first avatar object (161) (hereinafter, feature point data). For example, the feature point data of the first avatar object (161) can include feature point data (511), feature point data (512), feature point data (513), feature point data (514), and feature point data (514). The feature point data (511) relates to the hairstyle of the first avatar object (161) and can indicate tied hair. Feature point data (512) relates to the hairstyle of the first avatar object (161), and may represent black hair. Feature point data (513) relates to the upper garment of the first avatar object (161), and may represent a sky blue shirt. Feature point data (514) relates to the lower garment of the first avatar object (161), and may represent jeans. Feature point data (515) relates to the upper garment of the first avatar object (161), and may represent a tie.

[0119] The electronic device (101) can generate candidate attribute information (520) for generating an avatar object in another virtual environment. The electronic device (101) can generate the candidate attribute information (520) based on the first attribute information (510). The candidate attribute information (520) can include at least a portion of the feature point data of the first avatar object (161) in the first attribute information (510). An example of adding, excluding, or editing feature points among the feature points of the first avatar object (161) is described in detail through FIG. 5B.

[0120] The electronic device (101) may receive a user input (591) for information on designated essential features (hereinafter, referred to as essential feature data). The electronic device (101) may include essential feature data (525) in the candidate attribute information (520) based on the user input (591). The essential feature data refers to features that are essential to be used to create an avatar object according to a designation of a user of the electronic device (101) (e.g., user (105)). According to one embodiment, the electronic device (101) may obtain at least one essential feature data (525) based on the user input (591). For example, the electronic device (101) may obtain the essential feature data (525) based on the user input (591). For example, the essential feature data (525) may relate to an accessory and may represent a wristwatch. For example, the electronic device (101) may receive a user input (591) for selecting a visual object representing a "wristwatch" from among a plurality of feature data. As another example, the electronic device (101) may receive a user input (591) representing the text "wristwatch." Based on the user input (591), required feature data (525) may be added to candidate attribute information (520). The candidate attribute information (520) may include required feature data (525).

[0121] Referring to FIG. 5B, the electronic device (101) can add, exclude, or edit feature data from among the feature data of the candidate attribute information (520). For example, the electronic device (101) can add, exclude, or edit feature data included in the first attribute information (510) in addition to the required feature data from among the candidate attribute information (520). According to one embodiment, the electronic device (101) can exclude at least one feature data from the candidate attribute information (520) based on a user input (593). For example, the user input (593) can be associated with the feature data (514). The electronic device (101) can receive a user input (593) for excluding the feature data (514) from the candidate attribute information (520).

[0122] According to one embodiment, the electronic device (101) may set a priority of at least one feature data based on a user input (593). When an avatar object is rendered in another virtual environment, it may be difficult to use all the feature data for the avatar object. In this case, based on the priority of the feature data, the electronic device (101) may identify feature data to be preferentially used for avatar generation. For example, the user input (595) may be associated with the feature data (512). When determining the hairstyle of an avatar object to be displayed in another virtual environment (e.g., the second virtual environment (152)), the electronic device (101) may preferentially use the 'black color' of the feature data (512) over the 'tied hair' of the feature data (511). For example, if there is no 'black ponytail' in the database of the second virtual environment (152), instead of searching for feature data associated with 'ponytail' in the database, feature data associated with 'black' can be searched preferentially.

[0123] FIG. 6 illustrates an example of a database for displaying avatar objects in a virtual environment. A database for displaying avatar objects in each virtual environment may be used. For example, a first database (610) may be used to display a first avatar object (161) in a first virtual environment (151) of FIGS. 1A and 1B . For example, a second database (660) may be used to display a second avatar object (162) in a second virtual environment (152) of FIGS. 1A and 1B . Hereinafter, the present disclosure describes a situation in which an electronic device (101) includes and directly uses a database (610) and a database (660), but embodiments of the present disclosure are not limited thereto. The database (610) and the database (660) may be included in an external device (e.g., a server (405)) connected to the electronic device (101). The electronic device (101) may obtain feature point data from the corresponding database through the external device. For example, the electronic device (101) may transmit a signal to request feature point data to the server (405) and receive the feature point data as a response from the server (405). The database may be included within a program for a virtual environment or stored on an external server.

[0124] Referring to FIG. 6, the first database (610) for the first virtual environment (151) may include multiple feature point data. The description of the first database (610) may be applied to the second database (660) in the same or similar manner.

[0125] The first database (610) may include feature point data related to a first category (620). The first category (620) may represent a 'hairstyle' of an avatar object (e.g., the first avatar object (161)). The feature point data related to the first category (620) may include feature point data (621), feature point data (623), and feature point data (625). Each feature point data may be composed of a combination of one or more feature point data. For example, the feature point data (621) may be composed of feature point data (622a) representing 'no bangs' as a hairstyle, feature point data (622b) representing 'braided hair', and feature point data (622c) representing 'long hair'. For example, feature point data (623) may be composed of feature point data (624a) representing 'bangs' as a hairstyle, feature point data (624b) representing 'tied hair', and feature point data (624c) representing 'shoulder length'. For example, feature point data (625) may be composed of feature point data (626a) representing 'upturned' as a hairstyle, feature point data (626b) representing '10 cm', and feature point data (626c) representing 'forehead visible'.

[0126] The first database (610) may include feature point data related to a second category (630). The second category (630) may represent the 'top' of an avatar object (e.g., the first avatar object (161)). The feature point data related to the second category (630) may include feature point data (631), feature point data (633), and feature point data (635). Each feature point data may be composed of a combination of one or more feature point data. For example, the feature point data (631) may be composed of feature point data (632a) representing 'long sleeves' as the top, feature point data (632b) representing 'sweater', feature point data (632c) representing 'pink', and feature point data (632d) representing 'fried egg'. For example, feature point data (633) may be composed of feature point data (634a) representing 'long sleeves' as an upper garment, feature point data (634b) representing 'sweater', feature point data (634c) representing 'stripes', and feature point data (634d) representing 'black'. For example, feature point data (635) may be composed of feature point data (636a) representing 'sky blue shirt' as an upper garment, feature point data (636b) representing 'tie', and feature point data (636c) representing 'cardigan'.

[0127] As illustrated in the example in FIG. 6, the first database (610) can classify feature point data for creating an avatar object according to categories. The first database (610) can store feature point data such that each feature point is composed of a combination of one or more feature points. By utilizing the database for the feature point data of the avatar object, the electronic device (101) can more quickly and accurately extract feature points in the corresponding virtual environment. The electronic device (101) can compare the extracted feature point data with feature point data in the database for another virtual environment. By checking the number of matching or similar feature point data based on the database, the similarity between avatar objects of the two virtual environments can be more accurately confirmed. Hereinafter, an example of comparing feature point data based on the database is described with reference to FIG. 7.

[0128] FIG. 7 illustrates an example of a comparison procedure between feature point data of candidate attribute information (e.g., candidate attribute information (520)) and a database (e.g., a second database (660)).

[0129] Referring to FIG. 7, the electronic device (101) can obtain candidate attribute information (520). The candidate attribute information (520) can include feature point data (511), feature point data (512), feature point data (513), feature point data (515), and required feature point data (525). The electronic device (101) can use a second database (660) that manages a set of feature point data for the second virtual environment (152) to create a second avatar object (162) in the second virtual environment (152). According to one embodiment, the electronic device (101) can identify whether the feature point data (e.g., feature point data (511), feature point data (512), feature point data (513), feature point data (515), and required feature point data (525)) of the candidate attribute information (520) are included in the second database (660) for the second virtual environment (152). For example, based on whether the feature point data of the candidate attribute information (520) is included in the second database (660) for the second virtual environment (152), the electronic device (101) can generate the second avatar object (162) based on the feature point data. For example, if the feature point data of the candidate attribute information (520) is not included in the second database (660) for the second virtual environment (152), the electronic device (101) can identify similar feature point data in the second database (660) based on the feature point data. The above-described similar feature point data may not be entirely identical to the feature point data of the candidate attribute information (520), but may represent feature point data that is identical or similar to at least some of the feature point data of the candidate attribute information (520). As described above, regardless of whether or not the feature point data of the candidate attribute information (520) is included in the second database (660), the procedure for finding feature point data similar to the feature point data may be referred to as a search procedure.

[0130] For example, the electronic device (101) can perform a search procedure (711) of feature point data (511) based on the second database (660). The electronic device (101) can identify whether feature point data (511) of 'tied hair' is included in the second database (660). If the feature point data (511) of 'tied hair' is included in the second database (660), the electronic device (101) can generate a second avatar object (162) having a hairstyle of 'tied hair'. For example, the electronic device (101) can perform a search procedure (712) of feature point data (512) based on the second database (660). The electronic device (101) can identify whether feature point data (512) of 'black' as a hairstyle is included in the second database (660). The electronic device (101) can generate a second avatar object (162) having a 'black' hairstyle when the 'black' feature point data (512) is included in the second database (660).

[0131] For example, although feature point data (511) and feature point data (512) are illustrated as separate feature points, they can be managed as a single feature point data (731). Candidate attribute information (520) can include feature point data (731). The electronic device (101) can perform a search procedure (741) of the feature point data (731) based on the second database (660). The electronic device (101) can identify whether the feature point data of 'black tied hair' as a hairstyle is included in the second database (660). If the feature point data of 'black tied hair' is included in the second database (660), the electronic device (101) can generate a second avatar object (162) having the hairstyle of 'black tied hair'. If the feature point data for 'black tied hair' is not included in the second database (660), the electronic device (101) can identify whether the feature point data (512) corresponding to 'black' is included in the second database (660). As illustrated in FIG. 5B, based on the user input (595), the priority of the feature point data (512) corresponding to 'black' for the hairstyle may be higher than the priority of other feature point data for the hairstyle. The electronic device (101) can search the feature point data (512) corresponding to 'black' in the second database (660) with priority over the feature point data (511) corresponding to 'tied hair'.

[0132] For example, the electronic device (101) may perform a search procedure (713) of feature point data (513) based on the second database (660). The electronic device (101) may identify whether feature point data (513) of a 'sky blue shirt' as an upper garment is included in the second database (660). If the feature point data (513) of the 'sky blue shirt' is included in the second database (660), the electronic device (101) may generate a second avatar object (162) having a hairstyle of the 'sky blue shirt'. Although not illustrated in FIG. 7, the feature point data (513) as an upper garment may be composed of feature point data corresponding to 'sky blue' and feature point data corresponding to 'shirt'. If the second database (660) does not include feature point data for a 'sky blue shirt', the electronic device (101) can identify whether feature point data corresponding to 'sky blue' is included in the second database (660) or whether feature point data corresponding to a 'shirt' is included in the second database (660).

[0133] For example, the electronic device (101) can perform a search procedure (714) of feature point data (515) based on the second database (660). The electronic device (101) can identify whether the feature point data (515) of the 'tie' is included in the second database (660). If the feature point data (515) of the 'tie' is included in the second database (660), the electronic device (101) can create a second avatar object (162) having the 'tie' top.

[0134] For example, the electronic device (101) may perform a search procedure (715) of essential feature data (525) based on the second database (660). The essential feature data (525) indicates essential features to be used to create an avatar object according to a designation of a user of the electronic device (101) (e.g., the user (105)). The electronic device (101) may identify whether the essential feature data (525) of the 'wristwatch' is included in the second database (660). If the essential feature data (525) of the 'wristwatch' is included in the second database (660), the electronic device (101) may create a second avatar object (162) wearing the 'wristwatch'. According to one embodiment, the electronic device (101) may preferentially search the essential feature data (525) over other feature data of the candidate attribute information (520). For example, the candidate attribute information (520) may include feature data indicating a 'tattoo' in addition to the essential feature data (525) indicating a 'wristwatch'. The second database (660) may be storing feature data of an 'arm tattoo' and feature data of a 'wristwatch'. The electronic device (101) may generate a second avatar object (162) wearing a 'wristwatch' by preferentially searching for the essential feature data (525) over the feature data indicating a 'tattoo'. For example, the second avatar object (162) may have an appearance of wearing a 'wristwatch' without an 'arm tattoo'.

[0135] FIG. 8 illustrates an operation flow of an electronic device (e.g., an electronic device (101)) for generating an avatar object (e.g., a second avatar object (162)) in a virtual environment (e.g., a second virtual environment (152)). FIG. 8 illustrates an example of displaying a second avatar object (162) based on a previous avatar object (e.g., a first avatar object (161)) when transitioning from a previous virtual environment (e.g., the first virtual environment (151) of FIGS. 1A and 1B) to a second virtual environment (152).

[0136] Referring to FIG. 8, in operation (801), the electronic device (101) (e.g., the processor (410) of FIG. 4) may display a first avatar object (e.g., the first avatar object (161)) within a first virtual environment (e.g., the first virtual environment (151)). The electronic device (101) may display the first avatar object (161) within the first virtual environment (151) through a display (e.g., the display (420) of FIG. 4). According to one embodiment, the electronic device (101) may obtain at least one first feature data of the first avatar object (161). For example, the electronic device (101) may obtain at least one first feature data from a first database (610) for the first virtual environment (151). The electronic device (101) can obtain at least one first feature point data through metadata (e.g., skin color, hairstyle type, and / or clothing type) for the first avatar object (161). The feature points can be segmented, hierarchically managed, and managed through the first database (610). For example, the electronic device (101) can obtain at least one first feature point data based on a rendered image of the first avatar object (161). The electronic device (101) can extract at least one first feature point data by analyzing the image of the first avatar object (161). As a non-limiting example, one feature point data can represent a combination of multiple feature point data. For example, the feature point data for the hairstyle can represent a combination of feature point data representing 'long hair', feature point data representing 'black', and feature point data representing 'tied hair'.

[0137] In operation (803), the electronic device (101) (e.g., the processor (410) of FIG. 4) may obtain at least one essential feature data (e.g., essential feature data (525)) for avatar generation based on at least one user input (e.g., user input (591)). The essential feature data may indicate a feature that the user requires to be used for avatar generation. The user may designate the feature to the electronic device (101) through the user input.

[0138] In operation (805), the electronic device (101) (e.g., the processor (410) of FIG. 4) may obtain candidate attribute information (e.g., candidate attribute information (520)) including at least a portion of at least one first feature point data of a first avatar object and at least one required feature point data (e.g., required feature point data (525)). The candidate attribute information (520) may represent a set of features personalized by a user of the electronic device (101). The candidate attribute information (520) may include at least a portion of at least one first feature point data of the first avatar object (161). For example, the candidate attribute information (520) may include at least one first feature point data of the first avatar object (161). For example, one or more feature points may be excluded from the at least one first feature point data according to a user input. For example, based on user input, feature point data corresponding to 'jeans' of the first avatar object (161) may be excluded. For example, based on user input, one or more feature points among the at least one first feature point data may be modified. For example, based on user input, feature point data corresponding to 'red t-shirt' of the first avatar object (161) may be modified to 'orange t-shirt'.

[0139] The candidate attribute information (520) may further include additional feature point data according to user input. For example, the first avatar object (161) may have red hair. The user may want black hair. The electronic device (101) may, according to the user input, include feature point data corresponding to 'black hair' in the candidate attribute information (520). For example, the 'tattoo' feature point data of the first avatar object (161) may be covered by other feature point data (e.g., clothes) and not be displayed externally. If feature points for the first avatar object (161) are not sufficiently extracted, the electronic device (101) may add the corresponding feature point data to the candidate attribute information (520) according to the user input. For example, the electronic device (101) may, according to a user input indicating 'tattoo', include feature point data corresponding to 'tattoo' in the candidate attribute information (520).

[0140] Candidate attribute information (520) may include essential feature data. The essential feature data may be designated based on user input. For example, the electronic device (101) may obtain feature data corresponding to 'blue eyes' based on user input. If there is no feature data corresponding to 'blue eyes' among at least one first feature data of the first avatar object (161), the electronic device (101) may newly add feature data corresponding to 'blue eyes' to the candidate attribute information (520). If there is feature data corresponding to 'blue eyes' among at least one first feature data of the first avatar object (161), no separate additional operation may be performed. The candidate attribute information (520) may already include feature data corresponding to 'blue eyes'. If designated as an essential feature, it may have the highest priority. The electronic device (101) may set the feature data corresponding to 'blue eyes' to have the highest priority. Depending on the priority, essential feature data may be reflected with priority over other feature data during the search procedure of a database (e.g., the second database (660)) and when creating an avatar. The electronic device (101) may set priorities for other feature data in addition to the essential feature data. The electronic device (101) may set priorities for other feature data (e.g., feature data of the first avatar object (161)) in addition to the essential feature data among the feature data included in the candidate attribute information (520). Feature data with a high priority may be reflected with priority over other feature data during the search procedure of a database (e.g., the second database (660)) and when creating an avatar. For example, for the feature data of a 'red short-sleeved t-shirt', the priorities may be determined in the order of 'red', 'short-sleeved', and 't-shirt'.When the 'red short-sleeved T-shirt' is not available in the second virtual environment (152), the electronic device (101) can generate an avatar having feature data such as a 'red long-sleeved T-shirt' or a 'red striped T-shirt'.

[0141] In operation (807), the electronic device (101) (e.g., the processor (410) of FIG. 4) may acquire at least one second feature point data based on a database (e.g., the second database (660)) for the second virtual environment and candidate attribute information (520). The at least one second feature point data may be used to display a second avatar object (162) in the second virtual environment (152). According to one embodiment, the electronic device (101) may identify whether the feature point data of the candidate attribute information (520) is included in the second database (660) for the second virtual environment (152). For example, based on whether the feature point data of the candidate attribute information (520) is included in the second database (660) for the second virtual environment (152), the electronic device (101) may determine the feature point data as the second feature point data. The electronic device (101) may determine the feature point data as an element of at least one second feature point data for the second avatar object (162). For example, if the feature point data of the candidate attribute information (520) is not included in the second database (660) for the second virtual environment (152), the electronic device (101) may identify similar feature point data in the second database (660) based on the feature point data. The similar feature point data may not be entirely identical to the feature point data of the candidate attribute information (520), but may represent feature point data that is identical or similar to at least some of the feature point data of the feature point data of the candidate attribute information (520).

[0142] According to one embodiment, the electronic device (101) may identify relevant feature data. The relevant feature data may overlap at least partially with the feature data. For example, at least some of the feature data (e.g., multiple items of feature data) constituting the feature data of the candidate attribute information (520) may be identical to at least some of the feature data constituting the relevant feature data. The electronic device (101) may generate a second avatar object (162) based on the relevant feature data. According to one embodiment, the electronic device (101) may identify alternative feature data. The alternative feature data may be similar to at least some of the feature data (e.g., multiple items of feature data) constituting the feature data of the candidate attribute information (520). The alternative feature data may be less similar to the candidate attribute information (520) than the relevant feature data. The alternative feature data may be used to compensate for the absence of the relevant feature data. For example, the feature data may be 'sky blue shirt.' Among the multiple items (e.g., color or type) of the above feature data, the item regarding color may represent 'blue'. Feature data similar to 'sky blue' may include 'blue', 'navy blue', or 'purple'. Among the multiple items (e.g., color, type) of the above feature data, the item regarding type may represent 'shirt'. Feature data similar to 'shirt' may include 'shirt' or 't-shirt'. As an example, the alternative feature data may represent 'blue shirt'. A detailed description of the related feature data and the alternative feature data is described with reference to FIG. 9.

[0143] For example, let's assume the first database (610) illustrated in FIG. 6. The electronic device (101) can extract feature points of 'long hair', 'black', 'tied hair', and 'pigtails' as hairstyles of the first avatar object (161). The electronic device (101) can set the priority of 'tied hair' among the feature points to be the highest according to a user input. The priority can be used to acquire at least one second feature point data for the second avatar object (162) in the second virtual environment (152). For example, based on the second database (660), the electronic device (101) can identify feature point data sets for hairstyles.

[0144] 1) First feature data set: long hair, black, wavy

[0145] 2) Second feature data set: long hair, red color, headband, straight hair

[0146] 3) Third feature data set: short hair, black hair, and ponytail

[0147] The electronic device (101) can identify a feature point data set having feature point data of a 'tied hair'. The electronic device (101) can identify a third feature point data set among the plurality of feature point data sets. The electronic device (101) can determine the feature point data of the third feature point data set as at least one of the second feature point data.

[0148] In operation (809), the electronic device (101) (e.g., the processor (410) of FIG. 4) may display a second avatar object (e.g., a second avatar object (162)) associated with a first avatar object (e.g., the first avatar object (161)) within a second virtual environment (e.g., the second virtual environment (152)). The first avatar object (161) may represent a user of the electronic device (101) within the first virtual environment (151). The second avatar object (161) may represent the user of the electronic device (101) within the second virtual environment (151). The electronic device (101) may display the second avatar object (162) within the second virtual environment (152) via a display (e.g., the display (420) of FIG. 4). According to one embodiment, the electronic device (101) may generate a second avatar object (162) based on at least one second feature data acquired in operation (807). The electronic device (101) may generate the second avatar object (162) based on an appearance corresponding to the at least one second feature data. The electronic device (101) may render the generated second avatar object (162) through the display (420).

[0149] In FIG. 8, an example in which the electronic device (101) directly extracts feature points is described, but embodiments of the present disclosure are not limited thereto. For example, instead of the electronic device (101), another electronic device (e.g., a PC, a smartphone, or a tablet) being used by the user can extract feature points of an avatar object (e.g., a first avatar object (161), a second avatar object (162)). The other electronic device provides the extracted feature points to the electronic device (101), and the electronic device (101) can render an avatar object generated based on the feature points.

[0150] FIG. 9 illustrates an operation flow of an electronic device (e.g., an electronic device (101)) for generating an avatar object (e.g., a second avatar object (162)) in a virtual environment (e.g., a second virtual environment (152)). FIG. 9 illustrates an example of displaying a second avatar object (162) based on a previous avatar object (e.g., a first avatar object (161)) when transitioning from a previous virtual environment (e.g., the first virtual environment (151) of FIGS. 1A and 1B) to a second virtual environment (152). FIG. 9 illustrates detailed operations of the operation (807) of FIG. 8.

[0151] Referring to FIG. 9, in operation (901), the electronic device (101) (processor (410) of FIG. 4) can identify whether feature data of candidate attribute information (e.g., candidate attribute information (520)) is included in a database (e.g., second database (660)) for a second virtual environment (e.g., second virtual environment (152)). If the feature data of the candidate attribute information (520) is included in the second database (660) for the second virtual environment (152), the electronic device (101) can perform operation (909). If the feature data of the candidate attribute information (520) is not included in the second database (660) for the second virtual environment (152), the electronic device (101) can perform operation (903). Although it is not the above-mentioned feature point data of the candidate attribute information (520), the electronic device (101) can search for data similar to the above-mentioned feature point data of the candidate attribute information (520) in the second database (660) for the second virtual environment (152).

[0152] In operation (903), the electronic device (101) (processor (410) of FIG. 4) can identify whether related feature data corresponding to at least one item among a plurality of items (e.g., detailed feature data constituting the feature data) of the feature data of the candidate attribute information (e.g., candidate attribute information (520)) is included in a database (e.g., second database (660)) for a second virtual environment (e.g., second virtual environment (152)). If the related feature data includes the feature data of the candidate attribute information (520) in the second database (660), the electronic device (101) can perform operation (905). If the related feature data does not include the feature data of the candidate attribute information (520) in the second database (660), the electronic device (101) can perform operation (907).

[0153] In operation (905), the electronic device (101) (processor (410) of FIG. 4) may determine the relevant feature data as the second feature data. The electronic device (101) may display the second avatar object (162) based on the relevant feature data. For example, the feature data of the candidate attribute information (520) may indicate 'a blue t-shirt with a wristwatch'. The electronic device (101) may search the feature data of the candidate attribute information (520) in the second database (600). After identifying that the feature data of the candidate attribute information (520) is not in the second database (600), the electronic device (101) may identify a plurality of detailed feature data (hereinafter, items) of the feature data of the candidate attribute information (520). For example, the electronic device (101) may identify the item of 'blue', the item of 't-shirt', and the item of 'wristwatch'. The electronic device (101) can search for feature data representing 'blue' in the second database (600). The electronic device (101) can identify feature data representing 'blue short-sleeved T-shirt'. The electronic device (101) can search for feature data representing 't-shirt' in the second database (600). The electronic device (101) can identify feature data representing 'arm tattoo on black T-shirt'. The electronic device (101) can search for feature data representing 'wristwatch' in the second database (600). The electronic device (101) can identify feature data representing 'wristwatch on black dress shirt'. For example, among the above items, 'wristwatch' may have the highest priority. The electronic device (101) can determine feature data representing 'wristwatch on black dress shirt' as the second feature data.

[0154] In operation (907), the electronic device (101) (processor (410) of FIG. 4) may determine substitute feature data as second feature data. If the relevant feature data is not present in the second database (660), the electronic device (101) may identify substitute feature data to be preliminarily expressed. In one embodiment, the substitute feature data may be predefined feature data. For example, external features may be predefined as default values ​​for each virtual environment. The electronic device (101) may determine feature data corresponding to the default values ​​as the second feature data.

[0155] According to one embodiment, the substitute feature point data may be identified based on at least one first feature point data of the first avatar object (161). The electronic device (101) may identify feature point data identical or similar to the identified at least one feature point data from the database (660). To determine the similarity between feature point data, items of the feature point data may be used. Each item represents detailed feature point data constituting the feature point data. For example, when comparing the first feature point data and the second feature point data, the electronic device (101) may determine the number of identical items among the items of the first feature point data and the items of the second feature point data. The greater the number of identical items, the higher the similarity between the first feature point data and the second feature point data, the electronic device (101) may determine.

[0156] In one embodiment, the substitute feature point data may be determined based on a mapping table defining similarity. For example, in the feature point data of the candidate attribute information (520), the 'color' item for the hairstyle category may indicate red. In the database (660), a color related to 'red' may not exist among the 'color' items for the hairstyle category. The database (660) may include 'orange', 'purple', 'yellow', 'violet', or 'green' as the 'color' item for the hairstyle category. The mapping table may indicate a similarity level for other feature points based on the 'red' feature point data. For example, the similarity level for the 'orange' feature point data may be '7'. For example, the similarity level for the 'purple' feature point data may be '6'. For example, the similarity level for the 'yellow' feature point data may be '3'. For example, the similarity level for 'purple' feature data may be '5'. For example, the similarity level for 'green' feature data may be '2'. Based on the mapping table, the electronic device (101) may determine 'orange' as the alternative feature data.

[0157] In operation (909), the electronic device (101) (processor (410) of FIG. 4) may determine the feature point data of candidate attribute information (e.g., candidate attribute information (520)) as second feature point data. Since the feature point data of the candidate attribute information (520) is included in the second database (660), the electronic device (101) may display a second avatar object (162) on the second virtual environment (152) based on the feature point data.

[0158] Although not illustrated in FIGS. 8 and 9, according to one embodiment, instead of using fixed feature point data stored in the database (660), the electronic device (101) may display a second avatar object (162) on the second virtual environment (152) based on a custom costume creation function. For example, the electronic device (101) may create a custom costume based on feature point data of the first avatar object (161). For example, the electronic device (101) may create a custom costume of the second avatar object (162) based on a front image and a back image of the first avatar object (161). For example, the electronic device (101) may perform rendering of the front image and the back image of the first avatar object (161) to cover the outer shape of the second avatar object. For example, the electronic device (101) may create a custom costume based on feature point data of the candidate attribute information (520). The electronic device (101) can identify items of custom clothing corresponding to the feature point data of the candidate attribute information (520). If there is no item of custom clothing corresponding to the feature point data of the candidate attribute information (520) or if it is not identified, the electronic device (101) can identify an item related to at least a portion of the feature point data of the candidate attribute information (520) in the custom clothing in the same manner as the method of identifying the related feature point data or identifying the alternative feature point data. The electronic device (101) can display a second avatar object (162) on the second virtual environment (152) based on the identified items of custom clothing.

[0159] FIGS. 10A, 10B, and 10C illustrate examples of user interfaces for creating an avatar object (e.g., a second avatar object (162)) in a virtual environment (e.g., a second virtual environment (152)). FIGS. 10A, 10B, and 10C illustrate an electronic device (101) of a wearable device, but embodiments of the present disclosure are not limited thereto. The electronic device (101) may be a wearable device, as well as a smartphone, a laptop, a tablet, a PC, and / or other devices including displays.

[0160] Referring to FIG. 10A, the electronic device (101) can perform avatar creation in a first virtual environment (151). The electronic device (101) can extract at least one first feature point of a first avatar object (161) in the first virtual environment (151). For example, the electronic device (101) can extract data on the at least one first feature point (hereinafter, referred to as first feature point data) based on a first database (610). The electronic device (101) can generate candidate attribute information (e.g., candidate attribute information (520)) based on the first feature point data.

[0161] The electronic device (101) may display a user interface (1010) for adjusting feature points. For example, the user interface (1010) may include a first visual object (1011) for displaying a current avatar feature point list. In response to a user input for the first visual object (1011), the electronic device (101) may display feature point data of candidate attribute information (e.g., candidate attribute information (520)) to the user. For example, the user interface (1010) may include a second visual object (1013) for inputting required feature points. In response to a user input for the second visual object (1013), the electronic device (101) may display a window for manual input by the user or candidate feature point data selectable as required feature point data. The electronic device (101) may obtain required feature point data based on the user input for selection. For example, the user interface (1010) may include a third visual object (1015) for inputting exclusion features. In response to a user input for the third visual object (1015), the electronic device (101) may display feature point data of candidate attribute information (e.g., candidate attribute information (520)) to the user. Based on the user input for selection, the electronic device (101) may exclude exclusion feature point data from among the specific point data of the candidate attribute information (520).

[0162] The electronic device (101) can adjust feature data to be included in the candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can determine candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can obtain at least one second feature data based on the determined candidate attribute information and the second database (660). The electronic device (101) can create a second avatar object (162) based on the at least one second feature data. The electronic device (101) can upload the second avatar object (162) to the second virtual environment (152). For example, the electronic device (101) can upload the second avatar object (162) to a program (or server) for the second virtual environment (152).

[0163] In Fig. 10a, an example of creating a second avatar object (162) for a second virtual environment (152) in a first virtual environment (151) is described. The creation of the second avatar object (162) can also be performed in a second virtual environment (152) that is different from the first virtual environment (151).

[0164] Referring to FIG. 10B, the electronic device (101) can perform avatar creation in a second virtual environment (152). The electronic device (101) can extract at least one first feature point of a first avatar object (161) in the second virtual environment (152). For example, the electronic device (101) can extract data (hereinafter, first feature point data) for the at least one first feature point based on the first database (610). The electronic device (101) can generate candidate attribute information (e.g., candidate attribute information (520)) based on the first feature point data. The electronic device (101) can display a user interface (1010) for adjusting the feature point. For example, the user interface (1010) can include a first visual object (1011) for displaying a current avatar feature point list. For example, the user interface (1010) may include a second visual object (1013) for inputting required features. For example, the user interface (1010) may include a third visual object (1015) for inputting excluded features. For a description of the user interface (1010), reference may be made to FIG. 10B.

[0165] The electronic device (101) can adjust feature data to be included in the candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can determine candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can obtain at least one second feature data based on the determined candidate attribute information and the second database (660). The electronic device (101) can generate a second avatar object (162) based on the at least one second feature data. The electronic device (101) can display the second avatar object (162) on the second virtual environment (152), which is the current virtual space.

[0166] Referring to FIG. 10c, a user (105) of an electronic device (101) can create an avatar in a third virtual environment (1030). The third virtual environment (1030) may be a platform for creating an avatar. The third virtual environment (1030) may be different from the first virtual environment (151) and the second virtual environment (152).

[0167] The electronic device (101) can identify a virtual environment that serves as a reference for avatar creation based on user input. For example, the electronic device (101) can identify a first virtual environment (151). The electronic device (101) can extract at least one first feature point of the first avatar object (161) on a platform of the third virtual environment (1030). For example, the electronic device (101) can extract data (hereinafter, referred to as first feature point data) for the at least one first feature point based on the first database (610). The electronic device (101) can generate candidate attribute information (e.g., candidate attribute information (520)) based on the first feature point data. The electronic device (101) can display a user interface (1010) for adjusting the feature point. For example, the user interface (1010) can include a first visual object (1011) for displaying a current avatar feature point list. For example, the user interface (1010) may include a second visual object (1013) for inputting required features. For example, the user interface (1010) may include a third visual object (1015) for inputting excluded features. For a description of the user interface (1010), reference may be made to FIG. 10c.

[0168] The electronic device (101) can adjust feature data to be included in the candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can determine candidate attribute information based on at least one user input on the user interface (1010). The electronic device (101) can obtain at least one second feature data based on the determined candidate attribute information and the second database (660). The electronic device (101) can create a second avatar object (162) based on the at least one second feature data. The electronic device (101) can upload the second avatar object (162) to the second virtual environment (152). For example, the electronic device (101) can upload the second avatar object (162) to a program (or server) for the second virtual environment (152). After the third virtual environment (1030) is terminated, the electronic device (101) can execute a program for the second virtual environment (152) based on user input. When the program for the second virtual environment (152) is executed, the electronic device (101) can display the previously created second avatar object (162) together with the second virtual environment (152).

[0169] In embodiments, an electronic device (101) is provided. The electronic device (101) may include a display, a memory for storing instructions, and at least one processor. The instructions, when executed by the at least one processor, may cause the electronic device (101) to display a first avatar object (161) through the display within a first virtual environment (151), obtain at least one first feature point data of the first avatar object (161), obtain at least one essential feature point data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of the at least one first feature point data of the first avatar object (161) and the at least one essential feature point data, obtain at least one second feature point data based on a database (660) for a second virtual environment (152) and the candidate attribute information, and display a second avatar object (162) associated with the first avatar object (161) within the second virtual environment (152) through the display based on the at least one second feature point data.

[0170] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify whether the at least one first feature data includes first essential feature data among the at least one essential feature data, and if the at least one first feature data does not include the first essential feature data, obtain the candidate attribute information including the first essential feature data and the at least one first feature data.

[0171] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to receive a user input for designated feature data from among the at least one first feature data, and, based on the user input for the designated feature data, to set a priority of the designated feature data higher than a priority of other feature data within a type of the designated feature data.

[0172] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to display a plurality of feature point data sets corresponding to the type based on the database (660) for the second virtual environment (152) and the candidate attribute information, identify a feature point data set including the designated feature point data among the plurality of feature point data sets, and identify the at least one second feature point data based on the feature point data set.

[0173] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device (101) to receive a user input for excluded feature data among the at least one first feature data, and, based on the user input for the excluded feature data, obtain the candidate attribute information, wherein at least one feature data of the candidate attribute information may not include the excluded feature data.

[0174] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device (101) to display the first virtual environment (151) through the display before displaying the first avatar object (161), wherein the first avatar object (161) is displayed within the first virtual environment (151), wherein the at least one user input is obtained while the first virtual environment (151) is displayed through the display, and wherein the at least one second feature point data can be provided to the second database (660) for the second virtual environment (152).

[0175] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to display the second virtual environment (152) through the display. The at least one user input may be obtained while the second virtual environment (152) is displayed through the display.

[0176] In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a third virtual environment for avatar viewing via the display. The at least one user input may be obtained while the third virtual environment is displayed via the display.

[0177] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify whether the database (660) for the second virtual environment (152) includes feature point data of the candidate attribute information, and, if the database (660) for the second virtual environment (152) includes the feature point data of the candidate attribute information, determine the at least one second feature point data including the feature point data of the candidate attribute information.

[0178] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to, if the feature data of the candidate attribute information is not included in the database (660) for the second virtual environment (152), identify whether related feature data corresponding to at least one item among a plurality of items of feature data is included in the database (660) for the second virtual environment (152), and, if the related feature data corresponding to the at least one item is included in the database (660) for the second virtual environment (152), determine the at least one second feature data including the related feature data corresponding to the at least one item.

[0179] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify substitute feature data in the database (660) for the second virtual environment (152) if relevant feature data corresponding to the at least one item is not included in the database (660) for the second virtual environment (152). This may cause the electronic device (101) to determine at least one second feature data including the substitute feature data.

[0180] According to one embodiment, the alternative feature point data may be identified based on a priority for the at least one first feature point data from the database (660) for the second virtual environment (152).

[0181] According to one embodiment, the substitute feature point data may be identified as the feature point data having the highest similarity level with the feature point data of the candidate attribute information among a plurality of feature point data based on a mapping table for similarity levels. The plurality of feature point data may correspond to a category of the feature point data of the candidate attribute information and may be included in the database (660) for the second virtual environment (152).

[0182] According to one embodiment, the candidate attribute information may include at least a portion of the at least one first feature point data and the at least one essential feature point data.

[0183] According to one embodiment, the memory may include a database (610) for the first virtual environment (151) and a database (660) for the second virtual environment (152). The at least one first feature data of the first avatar object (161) may be extracted from the database (610) for the first virtual environment (151). The at least one second feature data of the second avatar object (162) may be extracted from the database (660) for the second virtual environment (152).

[0184] In embodiments, an electronic device (101) is provided. The electronic device (101) may include a display, a memory for storing instructions, and at least one processor. The instructions, when executed by the at least one processor, may cause the electronic device (101) to obtain, from a first database (610) for the first virtual environment (151), at least one first feature data associated with a first avatar object (161) for the first virtual environment (151), obtain at least one essential feature data for avatar generation based on at least one user input, obtain at least one candidate feature data including at least a portion of the at least one first feature data of the first avatar object (161) and the at least one essential feature data, obtain at least one second feature data from a second database (660) for a second virtual environment (152), and display, based on the at least one second feature data, a second avatar object (162) corresponding to the avatar object within the second virtual environment (152) through the display.

[0185] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify whether the second database (660) for the second virtual environment (152) includes feature point data of the candidate attribute information, and if the second database (660) for the second virtual environment (152) includes the feature point data of the candidate attribute information, determine the at least one second feature point data including the feature point data of the candidate attribute information, and if the second database (660) for the second virtual environment (152) does not include the feature point data of the candidate attribute information, extract the at least one second feature point data from the second database (660) for the second virtual environment (152) according to a predefined manner.

[0186] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify whether related feature data corresponding to at least one item among the plurality of items of feature data of the candidate attribute information is included in the second database (660) for the second virtual environment (152), and, if the related feature data corresponding to the at least one item is included in the second database (660) for the second virtual environment (152), determine the at least one second feature data including the related feature data corresponding to the at least one item.

[0187] According to one embodiment, the method comprises: identifying whether related feature data corresponding to at least one item among the plurality of items of feature data of the candidate attribute information is included in the database (660) for the second virtual environment (152); and, if the related feature data corresponding to the at least one item is not included in the second database (660) for the second virtual environment (152), causing the determination of at least one second feature data including substitute feature data, wherein the substitute feature data can be identified based on a priority with respect to the at least one first feature data from the second database (660) for the second virtual environment (152).

[0188] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device (101) to identify whether the at least one first feature data includes first essential feature data among the at least one essential feature data, and if the at least one first feature data does not include the first essential feature data, obtain the candidate attribute information including the first essential feature data and the at least one first feature data.

[0189] In embodiments, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium may include a memory including instructions. The above instructions, when executed by at least one processor, may cause the electronic device (101) to display a first avatar object (161) within a first virtual environment (151) through a display, obtain at least one first feature point data of the first avatar object (161), obtain at least one essential feature point data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of the at least one first feature point data of the first avatar object (161) and the at least one essential feature point data, obtain at least one second feature point data based on a second database (660) for a second virtual environment (152) and the candidate attribute information, and display a second avatar object (162) associated with the first avatar object (161) within the second virtual environment (152) through the display based on the at least one second feature point data.

[0190] In embodiments, a non-transitory computer-readable recording medium is provided. The non-transitory computer-readable recording medium can store instructions. The above instructions, when executed by at least one processor, may cause the electronic device (101) to display a first avatar object (161) within a first virtual environment (151), obtain at least one first feature point data of the first avatar object (161), obtain at least one essential feature point data for avatar generation based on at least one user input, obtain candidate attribute information including at least a portion of the at least one first feature point data of the first avatar object (161) and the at least one essential feature point data, obtain at least one second feature point data based on a database (660) for a second virtual environment (152) and the candidate attribute information, and display a second avatar object (162) associated with the first avatar object (161) within the second virtual environment (152) based on the at least one second feature point data.

[0191] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0192] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0193] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0194] Various embodiments of the present document may be implemented as software including one or more instructions stored on a machine-readable storage medium. For example, a processor of the machine may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0195] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0196] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; Memory for storing instructions; and comprising at least one processor, The above instructions, when executed by the at least one processor, cause the electronic device to: Displaying a first avatar object through the display within the first virtual environment, Obtaining at least one first feature point data of the first avatar object, Obtaining at least one essential feature data for avatar generation based on at least one user input, Obtain candidate attribute information including at least a portion of at least one first feature point data of the first avatar object and at least one essential feature point data, Based on the database for the second virtual environment and the candidate attribute information, at least one second feature point data is acquired, Causing a second avatar object associated with the first avatar object to be displayed through the display within the second virtual environment based on at least one of the second feature point data; Electronic devices.

2. In claim 1, the instructions, when executed by the at least one processor, cause the electronic device to: Identifying whether the database for the second virtual environment includes feature point data of the candidate attribute information, When the database for the second virtual environment includes the feature point data of the candidate attribute information, causing at least one second feature point data including the feature point data of the candidate attribute information to be determined, Electronic devices.

3. In claim 2, the instructions, when executed by the at least one processor, cause the electronic device to: If the feature point data of the candidate attribute information is not included in the database for the second virtual environment, identify whether related feature point data corresponding to at least one item among a plurality of items of the feature point data is included in the database for the second virtual environment, If the relevant feature data corresponding to the at least one item is included in the database for the second virtual environment, causing the at least one second feature data including the relevant feature data corresponding to the at least one item to be determined, Electronic devices.

4. In claim 3, the instructions, when executed by the at least one processor, cause the electronic device to: If the relevant feature data corresponding to at least one of the above items is not included in the database for the second virtual environment, identify alternative feature data in the database for the second virtual environment, causing at least one second feature point data to be determined that includes the above alternative feature point data; Electronic devices.

5. In claim 4, The above alternative feature point data is identified based on a priority for the at least one first feature point data from the database for the second virtual environment. Electronic devices.

6. In claim 4, The above alternative feature point data is identified as the feature point data having the highest similarity level with the feature point data of the candidate attribute information among multiple feature point data based on a mapping table for similarity levels, The above plurality of feature point data correspond to the category of the feature point data of the candidate attribute information and are included in the database for the second virtual environment. Electronic devices.

7. In claim 4, The above candidate attribute information includes at least a portion of the at least one first feature point data and the at least one essential feature point data. Electronic devices.

8. In claim 4, The above memory includes a database for the first virtual environment and a database for the second virtual environment, At least one first feature point data of the first avatar object is extracted from the database for the first virtual environment, The at least one second feature point data of the second avatar object is extracted from the database for the second virtual environment. Electronic devices.

9. In claim 1, the instructions, when executed by the at least one processor, cause the electronic device to: Identifying whether the at least one first feature point data includes the first essential feature point data among the at least one essential feature point data, If the at least one first feature point data does not include the first essential feature point data, causing the candidate attribute information including the first essential feature point data and the at least one first feature point data to be acquired. Electronic devices.

10. In claim 1, the instructions, when executed by the at least one processor, cause the electronic device to: Receiving user input for a designated feature point data among at least one of the first feature point data, Based on the user input for the above-mentioned designated feature point data, causing the priority of the above-mentioned designated feature point data to be set higher than the priority of other feature point data within the type of the above-mentioned designated feature point data. Electronic devices.

11. In claim 10, the instructions, when executed by the at least one processor, cause the electronic device to: Based on the database for the second virtual environment and the candidate attribute information, a plurality of feature point data sets corresponding to the type are displayed, Identifying a feature point data set including the specified feature point data among the above multiple feature point data sets, Based on the above feature point data set, causing at least one second feature point data to be identified, Electronic devices.

12. In claim 1, the instructions, when executed by the at least one processor, cause the electronic device to: Receiving user input for exclusion feature data among at least one of the first feature data, Based on the user input for the above-mentioned excluded feature data, the candidate attribute information is obtained, At least one feature point data of the above candidate attribute information does not include the excluded feature point data, Electronic devices.

13. In claim 1, the instructions, when executed by the at least one processor, cause the electronic device to: Causing said first virtual environment to be displayed through said display before displaying said first avatar object; The above first avatar object is displayed within the first virtual environment, wherein said at least one user input is obtained while said first virtual environment is displayed via said display; The at least one second feature point data is provided to the second database for the second virtual environment. Electronic devices.

14. In claim 1, The above instructions, when executed by the at least one processor, cause the electronic device to: causing the second virtual environment to be displayed through the display; wherein said at least one user input is obtained while said second virtual environment is displayed via said display; Electronic devices.

15. In claim 1, The above instructions, when executed by the at least one processor, cause the electronic device to: Causing a third virtual environment for avatar viewing to be displayed through the above display, wherein said at least one user input is obtained while said third virtual environment is displayed via said display; Electronic devices.

Images