Wearable device and method for displaying avatar, and computer-readable storage medium

Abstract

At least one processor including a processing circuit of a wearable device, according to one embodiment, can individually and / or collectively cause the wearable device to: receive information indicating the position of an avatar of another user entering a virtual space; check, in response to the reception, whether the position is located in a first part of the virtual space being displayed through a display; and, on the basis of determining that the position is located outside the first part, display, through the display, an executable object for changing a part of the virtual space displayed through the display to a second part of the virtual space that includes the position. The present disclosure can be generally related to a metaverse service for enhancing interconnectivity between a real object and a virtual object. For example, the metaverse service can be provided through a network based on fifth generation (5G) and / or sixth generation (6G).

Description

Wearable device, method, and computer-readable storage medium for displaying an avatar

[0001] The present disclosure relates to a wearable device, a method, and a computer-readable storage medium for displaying an avatar.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide extended reality (XR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices can provide XR services to users by utilizing virtual objects that correspond to the user.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] A wearable device according to one embodiment may include at least one communication circuit, at least one display configured to be aligned with an eye of a user wearing the wearable device, a memory storing instructions, and at least one processor including a processing circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the wearable device to receive, using the at least one communication circuit, information from a server, while providing a virtual space within the wearable device in conjunction with a server, the virtual space being configured to change a view in accordance with movement of the wearable device, indicating a location of an avatar of another user entering the virtual space. The instructions, when individually and / or collectively executed by the at least one processor, may cause the wearable device, in response to the receiving, to determine whether the location is located within a first part of the virtual space being displayed on the at least one display. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display, via the at least one display, an executable object for changing a part of the virtual space displayed via the at least one display to a second part of the virtual space that includes the place, within an area on the first part of the virtual space representing the place, based on determining that the place is located outside the first part of the virtual space.The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display the avatar, via the at least one display, within the first part of the virtual space based on determining that the location is located within the first part of the virtual space.

[0005] In one embodiment, a method of a wearable device comprising at least one communication circuit and at least one display configured to be aligned with an eye of a user wearing the wearable device, the method may include an operation of receiving, from a server, using the at least one communication circuit, information indicating a location of an avatar of another user entering the virtual space while providing a virtual space within the wearable device in conjunction with a server, the virtual space configured to change a view according to a movement of the wearable device. The method may include an operation of determining, in response to the reception, whether the location is located within a first part of the virtual space displayed on the at least one display. The method may include an operation of displaying, through the at least one display, within an area on the first part of the virtual space representing the location, an executable object for changing a part of the virtual space displayed through the at least one display to a second part of the virtual space including the location, based on a determination that the location is located outside the first part of the virtual space. The method may include an action of displaying the avatar through the at least one display within the first part of the virtual space, based on determining that the location is located within the first part of the virtual space.

[0006] A non-transitory computer-readable storage medium storing one or more programs according to one embodiment, wherein the one or more programs, when individually and / or collectively executed by at least one processor of a wearable device comprising at least one communication circuit and at least one display configured to be aligned with an eye of a user wearing the wearable device, cause the wearable device to receive, using the at least one communication circuit, information from a server, while providing a virtual space within the wearable device in conjunction with a server, the virtual space being configured to change a view in accordance with movement of the wearable device, information indicating a location of an avatar of another user entering the virtual space. The one or more programs, when executed by the wearable device, cause the wearable device to, in response to the reception, determine whether the location is located within a first part of the virtual space being displayed on the at least one display. The one or more programs, when executed by the wearable device, may cause the wearable device to display, through the at least one display, an executable object for changing a part of the virtual space displayed through the at least one display to a second part of the virtual space including the place, within an area on the first part of the virtual space representing the place, based on determining that the place is located outside the first part of the virtual space. The one or more programs, when executed by the wearable device, may cause the wearable device to display, through the at least one display, within the first part of the virtual space, the avatar, based on determining that the place is located within the first part of the virtual space.

[0007] The above-described and other aspects, features, and advantages of some embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0008] FIG. 1 is a diagram illustrating an exemplary network environment in which metaverse services are provided through a server according to various embodiments;

[0009] FIG. 2A is a perspective view illustrating an exemplary wearable device according to various embodiments;

[0010] FIG. 2B is a perspective view illustrating an exemplary configuration including one or more hardware components arranged within a wearable device according to various embodiments;

[0011] FIGS. 3A and 3B are front and rear perspective views illustrating an example of an exterior appearance of a wearable device according to various embodiments;

[0012] FIG. 4 is a block diagram illustrating an exemplary configuration of a wearable device according to various embodiments;

[0013] FIG. 5 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments;

[0014] FIG. 6 is a diagram illustrating an exemplary operation of a wearable device providing the location of an avatar according to various embodiments;

[0015] FIG. 7 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments;

[0016] FIG. 8 is a diagram illustrating an example of a screen displayed by a wearable device in response to an input for an executable object according to various embodiments;

[0017] FIG. 9 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments;

[0018] FIG. 10 is a flowchart illustrating an exemplary operation of a wearable device according to various embodiments to identify an avatar corresponding to a registered user account;

[0019] FIG. 11 is a diagram illustrating an exemplary operation of a wearable device displaying an avatar based on a registered user account according to various embodiments;

[0020] FIG. 12 is a diagram illustrating an example of an interface for interacting with an avatar displayed on a wearable device according to various embodiments;

[0021] FIGS. 13A and 13B are diagrams illustrating exemplary operations of a wearable device according to various embodiments to change the positions of areas corresponding to avatars based on inputs for selecting a plurality of avatars;

[0022] FIG. 14 is a diagram illustrating an exemplary operation of a wearable device according to various embodiments to display areas corresponding to multiple avatars;

[0023] FIG. 15 is a diagram illustrating an exemplary operation for a wearable device according to various embodiments to stop displaying an area corresponding to an avatar.

[0024] Electronic devices according to various embodiments may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, home appliances, or other similar devices. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0025] The various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the various embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In the present disclosure, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among the phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0026] The term "module" used in various embodiments of the present disclosure may include a unit implemented by hardware, software, or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0027] Various embodiments of the present disclosure may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., an internal memory or an external memory) readable by a machine (e.g., a wearable device (101)). For example, a processor (e.g., a processor (410), see FIG. 4) of a machine (e.g., a wearable device (101), see FIGS. 2A, 2B, 3A, and 3B) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. A 'non-transitory' storage medium is a tangible device, may not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0028] According to one embodiment, the method according to various embodiments disclosed in the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0029] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0030] The Metaverse is a portmanteau of the English word "meta," meaning "virtual" or "transcendence," and "universe," and refers to a three-dimensional virtual world where social, economic, and cultural activities similar to those in the real world take place. The Metaverse is a concept that is one step more advanced than virtual reality (VR, a cutting-edge technology that allows people to have realistic experiences in a computer-generated virtual world), and has the characteristic of allowing people to engage in social and cultural activities similar to those in the real world, rather than simply enjoying games or virtual reality using avatars. The Metaverse service can provide media content to enhance immersion in the virtual world based on augmented reality (AR), virtual reality environment (VR), mixed reality (MR), and / or extended reality (XR).

[0031] For example, media content provided by a metaverse service may include social interaction content, including avatar-based games, concerts, parties, and / or conferences. For example, the media content may include advertisements, user-created content, and / or information for economic activities such as the sale and / or shopping of products. Ownership of the user-created content may be proven by a blockchain-based non-fungible token (NFT). The metaverse service may support economic activities based on real-world currency and / or cryptocurrency. The metaverse service may provide virtual content linked to the real world, such as digital twins or life logging.

[0032] FIG. 1 is a diagram illustrating an exemplary network environment (150) that provides metaverse services through a server (110) according to various embodiments.

[0033] Referring to FIG. 1, a network environment (150) may include a server (110), a user terminal (120) (e.g., a first terminal (120-1) and a second terminal (120-2)), and a network connecting the server (110) and the user terminal (120). Within the network environment (150), the server (110) may provide a metaverse service to the user terminal (120). The network may be formed by at least one intermediate node (130) including an access point (AP) and / or a base station. The user terminal (120) may connect to the server (110) through the network and output a user interface (UI) related to the metaverse service to the user of the user terminal (120). Based on the UI, the user terminal (120) may obtain information to be input into the metaverse service from the user, or output information (e.g., multimedia content) related to the metaverse service to the user.

[0034] At this time, the server (110) provides a virtual space so that the user terminal (120) can be active in the virtual space. In addition, the user terminal (120) installs a software agent for accessing the virtual space provided by the server (110) to express information provided by the server (110) to the user or transmit information that the user wishes to express in the virtual space to the server. The software agent may be provided directly through the server (110), downloaded from a public server, or embedded and provided when the terminal is purchased.

[0035] In one embodiment, the metaverse service may be provided to a user terminal (120) and / or a user using a server (110). The present disclosure is not limited thereto, and the metaverse service may be provided through individual contact between users. For example, within a network environment (150), the metaverse service may be provided independently from the server (110) through a direct connection between a first terminal (120-1) and a second terminal (120-2). Referring to FIG. 1, within the network environment (150), the first terminal (120-1) and the second terminal (120-2) may be connected to each other through a network formed by at least one intermediate node (130). In one embodiment where the first terminal (120-1) and the second terminal (120-2) are directly connected, either the first terminal (120-1) or the second terminal (120-2) may perform the role of the server (110). For example, a metaverse environment can be constructed solely by connecting devices (e.g., peer-to-peer (P2P) connections).

[0036] In one embodiment, the user terminal (120) (or the user terminal (120) including the first terminal (120-1) and the second terminal (120-2)) may include various form factors and may be characterized by including an output device for providing images and / or sounds to the user and an input device for inputting information to a metaverse service. Examples of various form factors of the user terminal (120) include a smartphone (e.g., the second terminal (120-2)), an AR device (e.g., the first terminal (120-1)), a VR device, an MR device, a VST (Video See Through) device, an OST (Optical See Through) device, a smart lens, a smart mirror, an input / output capable TV or projector.

[0037] The network of the present disclosure (e.g., a network formed by at least one intermediate node (130)) includes various broadband networks including 3G, 4G, and 5G, and short-range networks including Wifi, BT, etc. (e.g., a wired network or wireless network directly connecting the first terminal (120-1) and the second terminal (120-2).

[0038] FIG. 2A is a perspective view illustrating an exemplary wearable device according to various embodiments. FIG. 2B is a perspective view illustrating an exemplary configuration of an exemplary wearable device including various hardware components according to various embodiments. According to one embodiment, a wearable device (101) may have a form of glasses that can be worn on a body part (e.g., head) of a user. The wearable device (101) of FIGS. 2A and 2B may be an example of the user terminal (120) of FIG. 1. The wearable device (101) may include a head-mounted display (HMD). For example, the housing of the wearable device (101) may include a flexible material such as rubber and / or silicone that is in a form that adheres closely to a portion of the user's head (e.g., a portion of the face that surrounds both eyes). For example, the housing of the wearable device (101) may include one or more straps capable of being twined around the user's head, and / or one or more temples attachable to the ears of the head.

[0039] Referring to FIG. 2A, according to one embodiment, a wearable device (101) may include at least one display (250) and a frame (200) supporting at least one display (250).

[0040] According to one embodiment, a wearable device (101) can be worn on a part of a user's body. The wearable device (101) can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (101). For example, the wearable device (101) can display a virtual reality image provided from at least one optical device (282, 284) of FIG. 2B on at least one display (250) in response to a user's designated gesture acquired through a motion recognition camera (or motion tracking camera) (260-2, 260-3) of FIG. 2B.

[0041] According to one embodiment, at least one display (250) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0042] Referring to FIG. 2B, at least one display (250) can provide visual information transmitted from external light to the user through a lens included in the at least one display (250), and other visual information distinct from the visual information. The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (250) can include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area can be formed on the second surface (232) of the at least one display (250). When a user wears the wearable device (101), external light can be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (282, 284) on a real screen transmitted through external light, in a display area formed on the second surface (232).

[0043] In one embodiment, at least one display (250) may include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits the diffracted light to a user. The at least one waveguide (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (233, 234). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (233, 234) may be propagated to the other end of the at least one waveguide (233, 234) by the nano-pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be arranged within the wearable device (101) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the at least one waveguide (233, 234).

[0044] The wearable device (101) can analyze an object included in a real image collected through a shooting camera (260-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (101) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (101) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using a multi-camera and / or time-of-flight (ToF). A user wearing the wearable device (101) can view an image displayed on at least one display (250).

[0045] According to one embodiment, the frame (200) may be formed as a physical structure that allows the wearable device (101) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that, when the user wears the wearable device (101), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.

[0046] Referring to FIG. 2A, the frame (200) may include a region (220) that is in contact with at least a portion of a user's body when the user wears the wearable device (101). For example, the region (220) of the frame (200) that is in contact with a portion of the user's body may include a region that is in contact with a portion of the user's nose, a portion of the user's ear, and a portion of the side of the user's face that the wearable device (101) makes contact with. According to one embodiment, the frame (200) may include a nose pad (210) that is in contact with a portion of the user's body. When the wearable device (101) is worn by the user, the nose pad (210) may be in contact with a portion of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that are in contact with another portion of the user's body that is distinct from the portion of the user's body.

[0047] For example, the frame (200) may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of the wearer's ear, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of the ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (101) can identify an external object (e.g., a user's fingertip) touching the frame (200) and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (200).

[0048] According to one embodiment, the wearable device (101) may include hardwares that perform various functions (e.g., hardwares that will be described in more detail later based on the block diagram of FIG. 4). For example, the hardwares may include a battery module (270) (e.g., including at least one battery), an antenna module (275) (e.g., including at least one antenna), at least one optical device (282, 284), speakers (e.g., speakers 255-1, 255-2), microphones (e.g., microphones 265-1, 265-2, 265-3), a light-emitting module (not shown), and / or a printed circuit board (PCB) (290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (200).

[0049] According to one embodiment, the microphones (e.g., microphones 265-1, 265-2, 265-3) of the wearable device (101) may be disposed on at least a portion of the frame (200) to acquire sound signals. A first microphone (265-1) disposed on the bridge (203), a second microphone (265-2) disposed on the second rim (202), and a third microphone (265-3) disposed on the first rim (201) are illustrated in FIG. 2B, but the number and arrangement of the microphones (265) are not limited to the embodiment of FIG. 2B. When the number of microphones (265) included in the wearable device (101) is two or more, the wearable device (101) may identify the direction of the sound signal by using a plurality of microphones disposed on different portions of the frame (200).

[0050] According to one embodiment, at least one optical device (282, 284) may project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) may be a projector. At least one optical device (282, 284) may be disposed adjacent to at least one display (250) or may be included within at least one display (250) as a part of at least one display (250). According to one embodiment, the wearable device (101) may include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) disposed at an edge of a first display (250-1) and a second optical device (284) disposed at an edge of a second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) disposed on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) disposed on the second display (250-2).

[0051] In one embodiment, the camera (260) may include a recording camera (260-4), an eye tracking camera (ET CAM) (260-1), and / or a motion recognition camera (260-2, 260-3). The recording camera (260-4), the eye tracking camera (260-1), and the motion recognition cameras (260-2, 260-3) may be positioned at different locations on the frame (200) and may perform different functions. The eye tracking camera (260-1) may output data indicating the position or gaze of the eyes of a user wearing the wearable device (101). For example, the wearable device (101) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (260-1). The wearable device (101) can identify an object (e.g., a real object and / or a virtual object) focused on by the user using the user's gaze acquired through the gaze tracking camera (260-1). The wearable device (101) that has identified the focused object can execute a function (e.g., gaze interaction) for interaction between the user and the focused object. The wearable device (101) can express a part corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (260-1). The wearable device (101) can render an image (or screen) displayed on at least one display (250) based on the position of the user's eyes. For example, the visual quality of a first area related to the gaze within the image and the visual quality (e.g., resolution, brightness, saturation, grayscale, or PPI (pixels per inch)) of a second area distinguished from the first area may be different from each other.The wearable device (101) can obtain an image (or screen) having a visual quality of a first area matching the user's gaze and a visual quality of a second area using foveated rendering. For example, if the wearable device (101) supports an iris recognition function, user authentication can be performed based on iris information obtained using a gaze tracking camera (260-1). Although an example in which the gaze tracking camera (260-1) is positioned toward both eyes of the user is illustrated in FIG. 2B, the present disclosure is not limited thereto, and the gaze tracking camera (260-1) can be positioned solely toward the user's left eye or right eye.

[0052] In one embodiment, the capturing camera (260-4) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera (260-4) can be used to acquire a high-resolution image based on HR (high resolution) or PV (photo video). The capturing camera (260-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about an actual image or background including the image of the specific object acquired using the capturing camera (260-4) and a virtual image provided through at least one optical device (282, 284) are superimposed. The wearable device (101) can compensate for depth information (e.g., the distance between the wearable device (101) and an external object acquired through a depth sensor) using the image acquired through the capturing camera (260-4). The wearable device (101) can perform object recognition through an image acquired using a photographing camera (260-4). The wearable device (101) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the photographing camera (260-4). The wearable device (101) can perform a pass-through function to display an image acquired through the photographing camera (260-4) by overlapping at least a portion of a screen representing a virtual space on at least one display (250). The photographing camera (260-4) may be referred to as a high resolution (HR) camera or a photo video (PV) camera.The camera (260-4) may provide an auto focus (AF) function and an optical image stabilization (OIS) function. The camera (260-4) may include a global shutter (GS) camera and / or a rolling shutter (RS) camera. In one embodiment, the camera (260-4) may be positioned on a bridge (203) positioned between the first rim (201) and the second rim (202).

[0053] The gaze tracking camera (260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing a wearable device (101), thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (101) looks straight ahead, the wearable device (101) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (260-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (260-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (260-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (101) is positioned.

[0054] The gesture recognition camera (260-2, 260-3) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (250). The gesture recognition camera (260-2, 260-3) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the gesture, and perform a designated function based on the identification. The gesture recognition camera (260-2, 260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 DOF pose). The processor can perform a gesture recognition function and / or an object tracking function using the gesture recognition camera (260-2, 260-3). In one embodiment, the motion recognition cameras (260-2, 260-3) may be positioned on the first limb (201) and / or the second limb (202). The motion recognition cameras (260-2, 260-3) may include a global shutter (GS) camera (e.g., a global shutter (GS) camera) used for head tracking, hand tracking, and / or spatial recognition based on one of a three-degree-of-freedom pose or a six-degree-of-freedom pose. The GS camera may include two or more stereo cameras to track fine movements. As an example, the GS camera may be included in an eye tracking camera (260-1) for tracking a user's gaze.

[0055] The camera (260) included in the wearable device (101) is not limited to the above-described gaze tracking camera (260-1) and motion recognition cameras (260-2, 260-3). For example, the wearable device (101) can identify an external object included in the user's field of view (FoV) using a camera positioned toward the FoV. The wearable device (101) can identify an external object based on a sensor for identifying the distance between the wearable device (101) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (260) positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (101) may include a camera (260) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (101).

[0056] Although not shown, in one embodiment, the wearable device (101) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (260). The light source may include an LED having an infrared wavelength. The light source may be disposed on at least one of the frame (200) and the hinge units (206, 207).

[0057] According to one embodiment, the battery module (270) may include at least one battery and may supply power to electronic components of the wearable device (101). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).

[0058] The antenna module (275) may include an antenna and may transmit signals or power to the outside of the wearable device (101) or receive signals or power from the outside. In one embodiment, the antenna module (275) may be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) may be positioned close to one surface of the first temple (204) and / or the second temple (205).

[0059] The speaker (255) can output an acoustic signal to the outside of the wearable device (101). The acoustic output module may be referred to as a speaker. In one embodiment, the speaker (255) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ear of a user wearing the wearable device (101). For example, the speaker (255) may include a second speaker (255-2) positioned within the first temple (204) and thus positioned adjacent to the user's left ear, and a first speaker (255-1) positioned within the second temple (205) and thus positioned adjacent to the user's right ear.

[0060] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the wearable device (101) to the user. For example, when the wearable device (101) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).

[0061] Referring to FIG. 2B, according to one embodiment, a wearable device (101) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the wearable device (101) (e.g., hardwares illustrated by different blocks in FIG. 4) may be disposed on the PCB (290). The wearable device (101) may include a flexible PCB (FPCB) for interconnecting the hardwares.

[0062] According to one embodiment, a wearable device (101) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (101) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (101). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (101) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (101) based on the IMU.

[0063] Figures 3a and 3b are front and rear perspective views of exemplary wearable devices according to various embodiments. The wearable device (101) of Figures 3a and 3b may be an example of the wearable device (101) of Figure 1. An example of the appearance of a first side (310) of a housing of the wearable device (101) according to one embodiment is illustrated in Figure 3a, and an example of the appearance of a second side (320) opposite to the first side (310) may be illustrated in Figure 3b.

[0064] Referring to FIG. 3A, according to one embodiment, a first surface (310) of a wearable device (101) may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (101) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (250-1) for outputting an image to a left eye among the user's two eyes, and a second display (250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (101) may further include a rubber or silicone packing formed on the first surface (310) to prevent and / or reduce interference by light (e.g., ambient light) different from the light radiated from the first display (250-1) and the second display (250-2).

[0065] According to one embodiment, the wearable device (101) may include cameras (260-1) for photographing and / or tracking both eyes of the user adjacent to each of the first display (250-1) and the second display (250-2). The cameras (260-1) may be referred to as the gaze tracking camera (260-1) of FIG. 2B. According to one embodiment, the wearable device (101) may include cameras (260-5, 260-6) for photographing and / or recognizing the face of the user. The cameras (260-5, 260-6) may be referred to as FT cameras. The wearable device (101) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (260-5, 260-6). For example, the wearable device (101) may change the texture and / or shape of a portion of an avatar (e.g., a portion of an avatar expressing a human face) using information obtained by cameras (260-5, 260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the wearable device (101).

[0066] Referring to FIG. 3B, a camera (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12)) and / or a sensor (e.g., a depth sensor (330)) for obtaining information related to the external environment of the wearable device (101) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3A. For example, the cameras (260-7, 260-8, 260-9, 260-10) may be disposed on the second surface (320) to recognize external objects. Cameras (260-7, 260-8, 260-9, 260-10) may be referenced to the motion recognition cameras (260-2, 260-3) of FIG. 2B.

[0067] For example, using cameras (260-11, 260-12), the wearable device (101) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (260-11) can be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the second display (250-2) corresponding to the right eye among the two eyes. The camera (260-12) can be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the first display (250-1) corresponding to the left eye among the two eyes. As an example, the wearable device (101) can obtain a single screen using a plurality of images obtained through the cameras (260-11, 260-12). Cameras (260-11, 260-12) may be referred to as the shooting camera (260-4) of FIG. 2b.

[0068] According to one embodiment, the wearable device (101) may include a depth sensor (330) disposed on the second face (320) to identify a distance between the wearable device (101) and an external object. Using the depth sensor (330), the wearable device (101) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (101). Although not shown, a microphone may be disposed on the second face (320) of the wearable device (101) to obtain a sound output from an external object. The number of microphones may be one or more according to various embodiments.

[0069] Hereinafter, with reference to FIG. 4, a description will be given in more detail of exemplary hardware and / or software used by a wearable device (101) according to one embodiment to obtain information about an avatar corresponding to a user of the wearable device and other users.

[0070] FIG. 4 is a block diagram illustrating an exemplary configuration of a wearable device according to various embodiments. The wearable device (101) of FIG. 4 may include the user terminal (120) of FIG. 1 and the wearable devices (101) of FIGS. 2A to 3B . In one embodiment, the wearable device (101) may be referred to as a terminal (or user terminal) in terms of being owned by a user. The terminal may include, for example, a personal computer (PC) such as a laptop or desktop. The terminal may include, for example, a smartphone, a smartpad, and / or a tablet PC. The terminal may include a smart accessory such as a smartwatch and / or a head-mounted device (HMD).

[0071] A wearable device (101) according to one embodiment may include a head-mounted display (HMD) that can be worn on a user's head. There may be one or more (or multiple) wearable devices (101). A wearable device (101) according to one embodiment may include a camera positioned toward the front of the user when the device is worn by the user. The front of the user may include a direction toward the user's head and / or the user's gaze. A wearable device (101) according to one embodiment may include a sensor for identifying the motion of the user's head and / or the wearable device (101) when the device is worn by the user. The wearable device (101) may identify the posture of the wearable device (101) based on data from the sensor. In order to provide a user interface (UI) based on virtual reality (VR), augmented reality (AR), and / or mixed reality (MR) to a user wearing a wearable device (101), the wearable device (101) may control a camera and / or a sensor. The UI may be related to a metaverse service and / or a notification service provided by the wearable device (101) and / or a server connected to the wearable device (101).

[0072] According to one embodiment, a wearable device (101) may perform functions related to augmented reality (AR) and / or mixed reality (MR). While a user wears the wearable device (101), the wearable device (101) may include at least one lens positioned adjacent to the user's eyes. Ambient light passing through the lens of the wearable device (101) may be combined (or mixed) with light emitted from a display (420) of the wearable device (101). A display area of ​​the display may be formed within the lens through which the ambient light passes. Since the wearable device (101) combines the ambient light and the light emitted from the display, the user may see an image that is a mixture of a real object recognized by the ambient light and a virtual object formed by the light emitted from the display.

[0073] According to one embodiment, a wearable device (101) may perform functions related to video see-through (VST) and / or virtual reality (VR). When a user wears the wearable device (101), the wearable device (101) may include a housing that covers the user's eyes. In the state, the wearable device (101) may include a display disposed on a first side facing the eyes (e.g., the first side (310) of FIG. 3A). The wearable device (101) may include a camera (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12 of FIG. 3B) disposed on a second side opposite to the first side (e.g., the second side (320) of FIG. 3A). Using the camera, the wearable device (101) can acquire frame images containing ambient light. The wearable device (101) can output the frame images to a display disposed on the first surface, thereby allowing a user to recognize the ambient light through the display. A display area of ​​the display disposed on the first surface can be formed by one or more pixels included in the display. The wearable device (101) can synthesize a virtual object within the frame images output through the display, so as to allow a user to recognize the virtual object together with a real object recognized by the ambient light.

[0074] According to one embodiment, a wearable device (101) can provide a user experience based on mixed reality (MR) by utilizing a virtual space. The wearable device (101) can recognize an external space (e.g., a real space) in which the wearable device (101) is included, and generate a virtual space mapped to the external space. The spatial recognition performed by the wearable device (101) can include SLAM and / or spatial mapping (e.g., scene understanding).

[0075] Referring to FIG. 4, according to one embodiment, a wearable device (101) may include at least one of a processor (410) (e.g., including a processing circuit), a memory (415), a camera (425), a display (420), a sensor (430), and a communication circuit (435). The processor (410), the memory (415), the camera (425), the display (420), the sensor (430), and the communication circuit (435) may be electrically and / or operably coupled with each other by an electronic component, such as a communication bus (402). Hereinafter, operably coupling of hardware components may refer to a direct connection, or an indirect connection, established by wire or wirelessly between the hardware components such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the present disclosure is not limited thereto, and some of the hardware components illustrated in FIG. 4 (e.g., at least a portion of the processor (410), the memory (415), and the communication circuit (435)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of hardware components included in the wearable device (101) is not limited to those illustrated in FIG. 4. For example, the wearable device (101) may include only some of the hardware components illustrated in FIG. 4. Elements within the memory described below (e.g., layers and / or modules) may be logically separated. Elements within the memory may be included within a hardware component that is distinct from the memory.The operation performed by the processor (410) using each element in the memory is one embodiment, and the processor (410) may perform a different operation from the above operation using at least one element among the elements in the memory.

[0076] A processor (410) of a wearable device (101) according to one embodiment may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (410) may be one or more. For example, the processor (410) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core. The processor (410) according to one embodiment of the present disclosure may include various processing circuits and / or multiple processors. For example, as used herein, including in the claims, the term “processor” may include various processing circuits, including at least one processor, and one or more of the at least one processor may be configured to individually and / or collectively perform the various functions described herein in a distributed manner. As used herein, when "a processor," "at least one processor," and "one or more processors" are described as being configured to perform several functions, these expressions also cover, for example, but not limited to, situations where a processor performs some of the described functions and other processor(s) perform the remainder of the described functions, and situations where a single processor performs all of the described functions. Additionally, the at least one processor may comprise a combination of processors that perform the various described / described functions, e.g., in a distributed manner. The at least one processor may execute program instructions to achieve or perform the various functions.

[0077] The memory (415) of the wearable device (101) according to one embodiment may include a hardware component for storing data and / or instructions input to and / or output from the processor (410). The memory (415) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, and embedded multi media card (eMMC).

[0078] In one embodiment, the display (420) of the wearable device (101) can output visualized information to the user of the wearable device (101). For example, the display (420) can visualize information provided from a processor (410) including a circuit such as a graphic processing unit (GPU). The display (420) can include a flexible display, a flat panel display (FPD), and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs).

[0079] In one embodiment, the camera (425) of the wearable device (101) may include optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The optical sensors included in the camera (425) may be arranged in the form of a two-dimensional array. The camera (425) may acquire electrical signals from each of the plurality of optical sensors substantially simultaneously to generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional array. For example, photographic data captured using the camera (425) may refer to, for example, one (a) two-dimensional frame data acquired from the camera (425). For example, video data captured using the camera (425) may refer to, for example, a sequence of a plurality of two-dimensional frame data acquired from the camera (425) according to a frame rate. The camera (425) may further include a flash light that is positioned toward the direction in which the camera (425) receives light and outputs light toward the direction.

[0080] According to one embodiment, the wearable device (101) may include a plurality of cameras, for example, cameras (425), arranged in different directions. A first camera among the plurality of cameras may be referred to as a motion recognition camera (e.g., motion recognition cameras 260-2 and 260-3 of FIG. 2B ), and a second camera may be referred to as a gaze tracking camera (e.g., gaze tracking camera 260-1 of FIG. 2B ). The wearable device (101) may identify a position, shape, and / or gesture of a hand using an image acquired using the first camera. The wearable device (101) may identify a direction of a gaze of a user wearing the wearable device (101) using an image acquired using the second camera. For example, the direction in which the first camera faces may be opposite to the direction in which the second camera faces.

[0081] According to one embodiment, a sensor (430) of a wearable device (101) may generate electrical information that may be processed by a processor (410) and / or a memory (415) of the wearable device (101) from non-electronic information related to the wearable device (101). The information may be referred to as sensor data. The sensor (430) may include a global positioning system (GPS) sensor, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor for detecting a geographic location of the wearable device (101), and an inertial measurement unit (IMU) for detecting a physical motion of the wearable device (101).

[0082] In one embodiment, the communication circuit (435) of the wearable device (101) may include hardware components for supporting transmission and / or reception of electrical signals between the wearable device (101) and an external electronic device. The communication circuit (435) may include, for example, at least one of a modem (MODEM), an antenna, and an optical / electronic (O / E) converter. The communication circuit (435) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G NR (new radio), and / or 6G.

[0083] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by a processor (410) of the wearable device (101) may be stored in the memory (415) of the wearable device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the wearable device (101) and / or the processor (410) may perform at least one of the operations of FIGS. 5, 7, 9, and 10 when a set of a plurality of instructions distributed in the form of an operating system, firmware, driver, and / or application is executed. Hereinafter, the fact that an application is installed in a wearable device (101) may refer to, for example, one or more instructions provided in the form of an application being stored in a memory (415), and the one or more applications being stored in a format executable by a processor (410) (e.g., a file having an extension specified by an operating system of the wearable device (101)). As an example, an application may include a program and / or a library related to a service provided to a user.

[0084] Referring to FIG. 4, programs installed in the wearable device (101) may be included in any one of different layers, including an application layer (440), a framework layer (450), and / or a hardware abstraction layer (HAL) (480), based on the target. For example, programs (e.g., modules or drivers) designed to target the hardware of the wearable device (101) (e.g., the display (420), the camera (425), and / or the sensor (430)) may be classified within the hardware abstraction layer (480). The framework layer (450) may be referred to as an XR framework layer in that it includes one or more programs for providing an XR (extended reality) service. For example, FIG. 4 illustrates layers within the memory (415) as being divided, but the layers may be logically divided. However, the present disclosure is not limited thereto. Depending on the embodiment, the layers may be stored in a designated area within the memory (415).

[0085] For example, within the framework layer (450), programs designed to target at least one of the hardware abstraction layer (480) and / or the application layer (440) (e.g., a position tracker (471), a space recognizer (472), a gesture tracker (473), and / or an eye tracker (474), a face tracker (475)) may be included. The programs included in the framework layer (450) may provide an executable API (application programming interface) based on other programs.

[0086] For example, a program designed to target a user controlling a wearable device (101) may be included within the application layer (440). Examples of programs included in the application layer (440) include an extended reality (XR) system user interface (UI) and / or an XR application (442), but the present disclosure is not limited thereto. For example, programs (e.g., software applications) classified as the application layer (440) may call an application programming interface (API) to cause execution of functions supported by programs classified as the framework layer (450).

[0087] For example, the wearable device (101) may display one or more visual objects on the display (420) for performing interaction with a user for using a virtual space based on the execution of the XR system UI (441). A visual object may refer to an object that can be deployed within a screen for transmitting and / or interacting with information, such as, for example, text, an image, an icon, a video, a button, a checkbox, a radio button, a text box, a slider, and / or a table. A visual object may be referred to as a visual guide, a virtual object, a visual element, a UI element, a view object, and / or a view element. The wearable device (101) may provide a service for controlling functions available within a virtual space to the user based on the execution of the XR system UI (441).

[0088] Referring to FIG. 4, although a lightweight renderer (443) and / or an XR plug-in (444) are illustrated as being included within the XR system UI (441), the present disclosure is not limited thereto. For example, the XR system UI (441) may cause execution of functions supported by the lightweight renderer (443) and / or the XR plug-in (444) included within the application layer (440).

[0089] For example, the wearable device (101) may acquire resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute a rendering pipeline that allows partial changes based on the execution of a lightweight renderer (443). The lightweight renderer (443) may be referred to as a lightweight render pipeline in terms of defining a rendering pipeline that allows partial changes. The lightweight renderer (443) may include a renderer built prior to the execution of a software application (e.g., a prebuilt renderer). For example, the wearable device (101) may acquire resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute an entire rendering pipeline based on the execution of an XR plug-in (444). The XR plugin (444) may be referred to as an open XR native client from the perspective of defining (or configuring) the entire rendering pipeline.

[0090] For example, the wearable device (101) may display a screen representing at least a portion of a virtual space on the display (420) based on the execution of the XR application (442). The XR plug-in (444-1) included in the XR application (442) may be referenced by the XR plug-in (444) of the XR system UI (441). Descriptions of the XR plug-in (444-1) that overlap with the description of the XR plug-in (444) may be omitted. The wearable device (101) may cause the execution of the screen composition manager (451) based on the execution of the XR application (442).

[0091] According to one embodiment, the wearable device (101) may provide a virtual space service based on the execution of the screen composition manager (451). For example, the screen composition manager (451) may include a platform (e.g., an Android platform) for supporting the virtual space service. The wearable device (101) may display the posture of a virtual object representing the user's posture rendered using data acquired through a sensor (430) on the display based on the execution of the screen composition manager (451). The screen composition manager (451) may be referred to as a composition presentation manager (CPM).

[0092] For example, the screen composition manager (451) may include a runtime service (452). As an example, the runtime service (452) may be referred to as an OpenXR runtime module. The wearable device (101) may be used to provide at least one of a pose prediction function, a frame timing function, and / or a spatial input function to a user through the wearable device (101) based on the execution of the runtime service (452). As an example, the wearable device (101) may be used to perform rendering for a virtual space service to a user based on the execution of the runtime service (452). For example, an application (e.g., unity or an OpenXR native application) may be implemented based on the execution of the runtime service (452).

[0093] For example, the screen composition manager (451) may include a renderer. The wearable device (101) may render a screen to be displayed on the display by compositing pass-through layers (or pass-through nodes) obtained through virtual layers (or virtual nodes) rendered based on sensor data (e.g., sensing data obtained through a camera (425) or a sensor (430)) through the screen composition manager (451) using the renderer. The virtual layers may be referred to as virtual nodes and / or virtual surfaces. The wearable device (101) may render each of the virtual layers or all of the virtual layers through the screen composition manager (451).

[0094] For example, the perception abstract layer (460) can be used for data exchange between the screen configuration manager (451) and the perception service layer (470). From the perspective of being used for data exchange between the screen configuration manager (451) and the perception service layer (470), the perception abstract layer (460) can be referred to as an interface. For example, the perception abstract layer (460) can be referred to as OpenPX and / or PPAL (perception platform abstract layer). The perception abstract layer (460) can be used for a perception client and a perception service.

[0095] According to one embodiment, the recognition service layer (470) may include one or more programs for processing data acquired from a sensor (430) (or a camera (425)). The one or more programs may include at least one of a position tracker (471), a space recognizer (472), a gesture tracker (473), an eye tracker (474), and / or a face tracker (475). The type and / or number of the one or more programs included in the recognition service layer (470) are not limited to those illustrated in FIG. 4.

[0096] For example, the wearable device (101) can identify the pose of the wearable device (101) using the sensor (430) based on the execution of the position tracker (471). The wearable device (101) can identify the 6 degrees of freedom pose (6 DOF pose) of the wearable device (101) using data acquired using the camera (425) and the IMU based on the execution of the position tracker (471). The position tracker (471) may be referred to as a head tracking (HeT) module.

[0097] For example, the wearable device (101) may be used to construct a three-dimensional virtual space surrounding the wearable device (101) (or a user of the wearable device (101)) based on the execution of the space recognizer (472). The wearable device (101) may reconstruct the three-dimensional surroundings of the wearable device (101) using data acquired using the camera (425) based on the execution of the space recognizer (472). The wearable device (101) may identify at least one of a plane, a slope, or stairs based on the three-dimensionally reconstructed surroundings of the wearable device (101) based on the execution of the space recognizer (472). The space recognizer (472) may be referred to as a scene understanding (SU) module.

[0098] For example, the wearable device (101) may be used to identify (or recognize) a pose and / or gesture of a hand of a user of the wearable device (101) based on the execution of the gesture tracker (473). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user using data acquired from a sensor (430) based on the execution of the gesture tracker (473). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user based on data (or images) acquired using a camera (425) based on the execution of the gesture tracker (473). The gesture tracker (473) may be referred to as a hand tracking (HaT) module and / or a gesture tracking module.

[0099] For example, the wearable device (101) can identify (or track) eye movements of a user of the wearable device (101) based on the execution of the gaze tracker (474). As an example, the wearable device (101) can identify eye movements of the user using data acquired from at least one sensor based on the execution of the gaze tracker (474). As an example, the wearable device (101) can identify eye movements of the user based on data acquired using a camera (425) (e.g., the gaze tracking camera (260-1) of FIGS. 2A and 2B) and / or an infrared light emitting diode (IR LED) based on the execution of the gaze tracker (474). The gaze tracker (474) may be referred to as an eye tracking (ET) module and / or a gaze tracking module.

[0100] For example, the recognition service layer (470) of the wearable device (101) may further include a face tracker (475) for tracking the user's face. For example, the wearable device (101) may identify (or track) the movement of the user's face and / or the user's expression based on the execution of the face tracker (475). The wearable device (101) may estimate the user's expression based on the movement of the user's face based on the execution of the face tracker (475). As an example, the wearable device (101) may identify the movement of the user's face and / or the user's expression based on data (e.g., an image) acquired using a camera based on the execution of the face tracker (475).

[0101] Referring to FIG. 4, the wearable device (101) can establish a connection with the server (401) based on a wired network and / or a wireless network. The wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), Ethernet, or a combination thereof. The wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. Although the wearable device (101) and the server (401) are illustrated as being directly connected, the wearable device (101) and the server (401) may be indirectly connected via an intermediate node within the network (e.g., the intermediate node (130) of FIG. 1). The server (401) may be referred to as an external electronic device from the perspective of being located outside the wearable device (101).

[0102] A server (401) according to one embodiment may include at least one of a processor (410-1) (e.g., including a processing circuit), a memory (415-1), and / or a communication circuit (435-1). The processor (410-1), the memory (415-1), and the communication circuit (435-1) may be electrically and / or operably coupled with each other by an electronic component, such as a communication bus (402-1). The type and / or number of hardware components included in the server (401) is not limited to those illustrated in FIG. 4. For example, the server (401) may include only some of the hardware components illustrated in FIG. 4. The processor (410-1), memory (415-1), and communication circuit (435-1) included in the server (401) may include hardware components and / or circuits corresponding to the processor (410), memory (415), display (420), and communication circuit (435) of the wearable device (101). Hereinafter, in order to reduce repetition, the description of the hardware and / or software included in the server (401) may be omitted to the extent that it overlaps with the wearable device (101).

[0103] According to one embodiment, the server (401) may be an example of a server that provides an XR service to which a wearable device (101) has logged in. The server (401) may transmit information related to a virtual space to which the wearable device (101) has logged in to the wearable device (101) through the communication circuit (435-1). The server (401) may receive a movement of the wearable device (101) from the wearable device (101) and transmit information to the wearable device (101) for rendering a portion of the virtual space corresponding to the received movement. The server (401) may transmit information related to another external electronic device that is distinct from the wearable device (101) to the wearable device (101). The information related to the other external electronic device may include information indicating a location of an avatar of another user that is distinct from the user of the wearable device (101) entering the virtual space.

[0104] As described above, the wearable device (101) according to one embodiment may obtain information about an avatar of another user entering the virtual space from the server (401) while displaying at least a portion of the virtual space on the display (420). The wearable device (101) may display an avatar of another user that is not included in the at least a portion of the virtual space on at least a portion of the display (420). In order to display the avatar of the other user on at least a portion of the virtual space, the wearable device (101) may identify a positional relationship between the avatar of the user of the wearable device (101) and the avatar of the other user. The wearable device may display the avatar of the other user on at least a portion of the display (420) corresponding to the positional relationship. Based on displaying the avatar of the other user on at least a portion of the display, the wearable device (101) may provide a notification to the user indicating the avatar of the other user entering the virtual space.

[0105] FIG. 5 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments. FIG. 6 is a diagram illustrating exemplary operations of a wearable device providing the location of an avatar according to various embodiments. The wearable device of FIG. 5 and the wearable device (101) of FIG. 6 may include the wearable device (101) of FIG. 4. At least one of the operations of FIG. 5 may be performed by the wearable device (101) of FIG. 4. At least one of the operations of FIG. 5 may be controlled by the processor (410) of FIG. 4. Each of the operations of FIG. 5 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.

[0106] Referring to FIG. 5, in operation 510, a wearable device according to one embodiment may provide a virtual space configured to change a view (or an image representing a view) displayed on a display according to movement of the wearable device, in conjunction with an external electronic device (e.g., a server (401) of FIG. 4), within the wearable device, while receiving, from the external electronic device, information indicating a location where an avatar of another user entering the virtual space is located, using at least one communication circuit. For example, the movement of the wearable device may be obtained based on information indicating a movement of a user's head (e.g., head tracking information) obtained using a position tracker (e.g., a position tracker (471) of FIG. 4).

[0107] For example, a wearable device can log in (or enter) into a virtual space provided by an external electronic device using an avatar corresponding to a user account of a user of the wearable device. While logged in to the virtual space, the wearable device can display a portion of the virtual space on the display based on the movement of the avatar that changes according to the movement of the wearable device. The wearable device can control the movement of the avatar according to the movement of the wearable device to change the view of the virtual space shown (or displayed) to the user. The wearable device can display a screen representing the view of the virtual space that changes according to the movement of the wearable device by linking with an external electronic device (e.g., the server (410) of FIG. 4) on the display. For example, the wearable device (101) can obtain user head tracking information that tracks the posture, direction, and / or position of the user's head according to the movement of the wearable device (101). The wearable device (101) can change the direction of the avatar (or the posture of the avatar) using the acquired head tracking information, thereby changing the view of the virtual space shown (or displayed) to the user.

[0108] Referring to FIG. 6, a wearable device (101) according to one embodiment can log in to a virtual space (610) using an avatar (601) corresponding to a user (105). The wearable device (101) can enter the virtual space (610) based on the execution of the XR application (442) of FIG. 4. The virtual space (610) can be referred to as a Copresence space accessible to a plurality of users (or electronic devices corresponding to users) using a metaverse service provided by a server (e.g., the server (410) of FIG. 4).

[0109] For example, the wearable device (101) can display a part of a virtual space corresponding to a direction (640) of a viewpoint according to the movement of the wearable device obtained through a sensor (e.g., a sensor (430) of FIG. 4) on a display (e.g., a display (420) of FIG. 4). The part of the virtual space can be referenced to a field of view (FoV) (615) of the wearable device corresponding to the direction (640) of the viewpoint. The part of the virtual space can be shown to a user wearing the wearable device (101) and can represent a location of the virtual space corresponding to the direction (640) of the viewpoint. The direction (640) of the viewpoint can be changed by the movement of the avatar (601) corresponding to the movement of the wearable device (101). The direction of the view point (640) may indicate the direction between the position (601-1) of the avatar (601) in the virtual space (610) and the FoV (615) for displaying the part of the virtual space (610).

[0110] Referring to FIG. 5, in operation 520, a wearable device according to one embodiment can identify whether the location of another user's avatar is located outside a first part of a virtual space being displayed through a display.

[0111] Referring to FIG. 6, a wearable device (101) according to one embodiment can obtain a screen based on a FoV (615) corresponding to a direction (640) of a viewpoint for displaying a first part from an external electronic device (e.g., a server (401) of FIG. 4). The wearable device (101) can display the screen on a display. The screen can represent a location (e.g., a first part of the virtual space (610)) located from a location (601-1) where an avatar (601-1) is located in a virtual space (610) toward the direction (640) of the viewpoint.

[0112] For example, while the wearable device (101) displays the screen, the wearable device (101) may receive, from the external electronic device, information indicating the location of an avatar (602, 603) of another user (e.g., another user distinct from the user of the wearable device (101)) entering the virtual space (610) using a communication circuit. The wearable device (101) may use the information indicating the location of the avatar (602, 603) of the other user to identify a relative location relationship between the location of the avatar (601) and the locations of the avatars (602, 603) of the other user. Based on the identification of the relative location relationship, the wearable device (101) may identify whether the location of the avatar (602, 603) of the other user is located within the first part corresponding to the screen. The wearable device (101) can indicate the position of another user's avatar (602, 603) into the virtual space (610) depending on whether the position of the other user's avatar (602, 603) is located within the first part.

[0113] Referring to FIG. 5, when the location of the avatar of another user is located outside the first part of the virtual space (operation 520 - Yes), in operation 530, the wearable device according to one embodiment may, in response to information indicating a location located outside the first part of the virtual space being displayed through the display, display an executable object for changing to a second part of the virtual space within an area on the first part. The location may include a location of the avatar of the other user that is distinct from the user of the wearable device within the virtual space. The second part may correspond to a FoV based on a direction toward the location of the avatar of the other user from an avatar corresponding to the wearable device.

[0114] Referring to FIG. 6, a wearable device (101) according to one embodiment can identify the position of an avatar (603) corresponding to another user distinct from the user of the wearable device (101) while displaying a screen (619) representing a first part of a virtual space (610) on the display. The wearable device (101) can receive information about the connection (or position) of the avatar (603) and the location (or location (603-1)) of the avatar (603) within the virtual space (610) from an external electronic device (e.g., the server (401) of FIG. 4). Based on the identification of the location (603-1) of the avatar (603) located outside the first part, the wearable device (101) can display an executable object (631) for changing to a second part different from the first part within an area (630) of the display. The location (603-1) of the avatar (603) can be located within the second part.

[0115] For example, the wearable device (101) can identify a location within a virtual space (610) formed based on a three-dimensional coordinate axis (650). The wearable device (101) can identify a location on a reference plane (650-1) (e.g., an xy plane) formed based on the three-dimensional coordinate axis (650). The reference plane (650-1) may refer to a plane for supporting at least one object within the virtual space (610), based on a physics engine used to define the virtual space (610), among, for example, three planes (e.g., an xy plane, a yz plane, and a zx plane) formed based on the three-dimensional coordinate axis (650). The physics engine may include a program used to implement a physical system (or physical phenomenon) that can occur in a real space distinct from the virtual space (610) within the virtual reality.

[0116] For example, the wearable device (101) can identify a positional relationship between an avatar (601) and another avatar (603) on a reference plane (650-1). The wearable device (101) can identify a position (603-1) of an avatar (603) based on the position (601-1) of the avatar (601). The direction (640) of the viewpoint can correspond to one axis (e.g., the x-axis) of the three-dimensional coordinate axes (650). The wearable device (101) can identify a relative positional relationship between the position (601-1) of the avatar (601) and the position (603-1) of the avatar (603) based on the direction (640) of the viewpoint. The wearable device (101) can identify a direction (608) from a position (601-1) on a reference plane (650-1) toward a position (603-1). The wearable device (101) can obtain an angle between the direction (640) of the viewpoint and the direction (608). For example, the wearable device (101) can obtain an angle (609) between another direction (e.g., +y direction) perpendicular to the direction (640) (e.g., +x direction) and the direction (608) based on a three-dimensional coordinate axis (650) formed based on the position (601-1) of the avatar (601). The operation of the wearable device (101) obtaining a relative positional relationship between the position of the avatar (601) and the position of the avatar (603) is not limited to the above-described embodiment.

[0117] According to one embodiment, a wearable device (101) may display an executable object (631) representing an avatar (603) that has entered a virtual space (610) within an area (630) based on identifying a location (603-1) of an avatar (603) located outside the first part while displaying a screen (619) representing a first part on the display. The executable object (631) may be displayed by overlapping at least a portion of the screen (619). As an example, the executable object (631) may be translucent. At least a portion of the screen (619) may be visible to the user by transmitting at least a portion of the translucent executable object (631). However, the present disclosure is not limited thereto.

[0118] For example, the wearable device (101) can determine the location of the area (630). The wearable device (101) can determine the location of the area (630) to be displayed on the display based on the angle (609) identified with respect to the location (601-1) of the avatar (601). The wearable device (101) can determine the location of the area (630) to be displayed on the display based on a two-dimensional coordinate axis (651) corresponding to the reference plane (650-1). The wearable device (101) can map the center point within the FoV (615) to the location (601-1) of the avatar (601). The wearable device (101) can determine the position of the area (630) by using the two-dimensional coordinate axis (651) formed based on the center point and the angle (609) representing the relative positional relationship between the avatar (601) and the avatar (603). For example, the wearable device (101) can display the area (630) on at least a portion of the display corresponding to the angle (609) from the center point. By displaying at least a portion of the avatar (603) on the display using the angle (609), the wearable device (101) can map information representing a position within the screen (619) formed based on the two-dimensional coordinate axis (651) and a position within the virtual space (610) defined based on the three-dimensional coordinate axis (650).

[0119] According to one embodiment, a wearable device (101) can display an executable object (631) within a first part of a virtual space (610) through an area (630) of a display. The area (630) can include a screen representing an FoV based on a direction (608). The area (630) can be used to display a second part of the virtual space (610) positioned from a location (601-1) within the virtual space (610) toward the direction (608). The wearable device (101) can display a screen representing the second part (e.g., an executable object (631)) within the area (630). The second part can include a location (603-1) of an avatar (603) identified by the wearable device (101). The second part can be distinguished from the first part viewed by the avatar (601). The above screen may include a view for entering a virtual space. The above screen may include a screen to be displayed on the display when the wearable device (101) controls the avatar (601) and the viewpoint of the avatar (601) faces the direction (608).

[0120] Referring to FIG. 5, if the location of another user's avatar is located within the first part of the virtual space (operation 520-No), in operation 540, the wearable device according to one embodiment may display the avatar within the first part of the virtual space through a display in response to information indicating the location within the first part of the virtual space.

[0121] Referring to FIG. 6, a wearable device (101) according to one embodiment can receive information indicating the position of an avatar (602) from an external electronic device (e.g., server (401) of FIG. 4). Based on the information received, the wearable device (101) can identify the location (602-1) of the avatar (602). Based on the information received, the wearable device (101) can identify the relative location relationship between the location (601-1) and the location (602-1). The wearable device (101) can identify the direction (607) from the location (601-1) toward the location (602-1). Based on the direction (607) identified, the wearable device (101) can identify a location in a virtual space (610) where the avatar (602) is located. The wearable device (101) can identify that the location within the virtual space (610) is located within the first part corresponding to the FoV (615). By identifying the avatar (602) located within the FoV (615), the wearable device (101) can display a screen (619) representing the FoV (615) including the avatar (602) on the display instead of displaying an executable object corresponding to the avatar (602). While displaying the screen (619), the wearable device (101) does not need to provide the position of the avatar (602) to the user through the executable object (631) because the avatar (602) that entered the virtual space (610) is included within the FoV (615) corresponding to the screen (619), and thus can refrain from displaying the executable object corresponding to the avatar (602). In other words, the wearable device (101) may display the avatar (602) (or the screen (619) including the avatar (602)) located within the first part of the virtual space (610) (e.g., a part of the virtual space corresponding to the screen (619)) through the display in response to confirmation that the location (602-1) of the avatar (602) (or the place including the location) is located within the first part of the virtual space (610).

[0122] As described above, the wearable device (101) according to one embodiment can identify the positions (602-1, 603-1) of other avatars (602, 603) that have entered the virtual space (610) based on the position (601-1) of the avatar (601) within the virtual space (610). The wearable device (101) can identify the positions (602-1, 603-1) while displaying a screen (619) representing a first part within the virtual space (610) based on a direction (640) corresponding to the viewpoint of the avatar (601). The wearable device (101) can identify the avatar (602) located within the FoV (615) and the avatar (603) located outside the FoV (615) based on the positions (602-1, 603-1). Since the wearable device (101) can display the avatar (602) through the screen (619), it may not display an executable object corresponding to the avatar (602). Since the wearable device (101) cannot display the avatar (603) through the screen (619), the wearable device (101) may display an executable object (631) to indicate the position of the avatar (603) on an area (630) of the display defined using an angle (609) identified based on the positional relationship between the avatar (601) and the avatar (603). While displaying a screen representing a portion of the virtual space (610), the wearable device (101) may notify the user that other avatars have entered the virtual space, independently of the positions of the other avatars logged into the virtual space.

[0123] FIG. 7 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments. FIG. 8 is a diagram illustrating exemplary screens displayed by a wearable device in response to an input for an executable object according to various embodiments. The wearable device of FIG. 7 and the wearable device (101) of FIG. 8 may include the wearable device (101) of FIG. 4. At least one of the operations of FIG. 7 may be performed by the wearable device (101) of FIG. 4. At least one of the operations of FIG. 7 may be controlled by the processor (410) of FIG. 4. Each of the operations of FIG. 7 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel. At least one of the operations of FIG. 7 may be related to at least one of the operations of FIG. 5.

[0124] Referring to FIG. 7, a wearable device according to one embodiment may receive an input regarding an executable object displayed within an area on a first part of a virtual space in operation 710. After performing operation 530 of FIG. 5, the wearable device may perform operation 710.

[0125] Referring to FIG. 8, in a state (800), a wearable device (101) according to one embodiment can display a screen (620) on the display. The screen (620) can be included in the screen (619) of FIG. 6. While displaying the screen (620) based on the FoV (615) of an avatar (e.g., avatar (601) of FIG. 6) corresponding to a user (105), the wearable device (101) can receive information indicating a connection of an avatar (603) corresponding to another user from an external electronic device (e.g., server (401) of FIG. 4). The information can include information indicating a location of the avatar (603) within a virtual space (e.g., virtual space (610) of FIG. 6). The wearable device (101) can obtain the relative position of the avatar (603) based on the position (e.g., position (601-1) of FIG. 6) of the corresponding avatar (e.g., avatar (601) of FIG. 6) of the user (105) based on the identification of the position of the avatar (603). In response to confirming that the position of the avatar (603) is located outside the first part of the virtual space corresponding to the FoV (615), the wearable device (101) can display an executable object (631) within the area (630). The wearable device (101) can identify the angle (609) based on the relative position of the avatar (603) based on the position (e.g., position (601-1) of FIG. 6) of the corresponding avatar (e.g., avatar (601) of FIG. 6) of the user (105) based on the obtained position. The wearable device (101) can determine the location of the area (630) based on the angle (609) with respect to the center point (650-1) of the FoV (615) (or the display area of ​​the display). The wearable device (101) can display an executable object (631) within the area (630) on the screen (620) representing a first part of the virtual space corresponding to the FoV (615). By displaying the executable object (631), the wearable device (101) can notify the user of the connection of the avatar (603).For example, independently of displaying an executable object (631), the wearable device (101) may output a notification sound indicating the connection of an avatar (603) through a speaker.

[0126] In one embodiment, a wearable device (101) may receive an input (805) regarding an executable object (631) displayed within an area (630). In response to the display of the executable object (631), the wearable device (101) may activate a timer. The wearable device (101) may receive the input (805) while the timer is activated. For example, the wearable device (101) may detect the expiration of the timer before the input (805) is received. In response to the detection, the wearable device (101) may stop displaying the executable object (631). The wearable device (101) may stop displaying the executable object (631) by causing the executable object (631) to gradually disappear. However, the present disclosure is not limited thereto.

[0127] For example, the wearable device (101) may change the view of the virtual space shown to the user (105) based on receiving an input (805) for an executable object (631). The wearable device may change the posture of the avatar (e.g., the avatar (601) of FIG. 6) corresponding to the user (105) based on receiving the input, even though the wearable device does not receive a movement of the wearable device (101) for controlling the avatar (e.g., the avatar (601) of FIG. 6) corresponding to the user (105). The wearable device (101) may change the posture of the avatar (e.g., the avatar (601) of FIG. 6) corresponding to the user (105) in the virtual space so that the avatar (603) corresponding to the user (105) looks at the avatar (603) based on receiving the input. The wearable device (101) can change the posture of the avatar (e.g., the avatar (601) of FIG. 6) corresponding to the user (105) so that the direction (e.g., the direction (608) of FIG. 6) from the position of the avatar (603) to the position of the avatar (603) matches the direction (e.g., the direction (640) of FIG. 6) of the view point of the avatar corresponding to the user (105). The wearable device (101) can control the entire avatar (e.g., the avatar (601) of FIG. 6) corresponding to the user (105) to change the posture of the avatar, or can control a part of the avatar (e.g., a part corresponding to the head) to change the posture of the avatar. The wearable device (101) can enter the state (810) by changing the posture of the avatar.

[0128] Referring to FIG. 7, in operation 720, a wearable device according to one embodiment can change a part of a virtual space displayed through a display from a first part of the virtual space to a second part of the virtual space. A first part of the virtual space may correspond to an FoV (615) of an avatar (e.g., an avatar (601) of FIG. 6) corresponding to a user (e.g., a user (105) of FIG. 1) of a wearable device (e.g., a wearable device (101) of FIG. 1). A second part of the virtual space may include a location of another avatar (603) not included in the first part. The wearable device may change a part of the virtual space from the first part to the second part in response to an input for an executable object. For example, the wearable device may control the avatar in response to an input for an executable object, thereby changing the FoV of the avatar. The wearable device may change a part of the virtual space displayed on the display from the first part to the second part based on changing the FoV of the avatar.

[0129] Referring to FIG. 8, a wearable device (101) according to one embodiment may enter a state (810) in response to an input (805) from a state (800). The wearable device (101) may gradually expand the size of an executable object (631) displayed within an area (630) to converge to the size of a FoV (615). The wearable device (101) may display a screen (820) on the display based on the gradually expanding size of the executable object (631). For example, the wearable device (101) may control an avatar in response to the input (805) such that a direction of a viewpoint of the avatar (e.g., direction (640) of FIG. 6) matches another direction (e.g., direction (608) of FIG. 6) from a location of the avatar to a location of another avatar (603). The wearable device (101) can display a screen corresponding to the FoV (e.g., FoV (615) of FIG. 6) that changes according to the movement of the avatar's viewpoint based on controlling the avatar.

[0130] According to one embodiment, a wearable device (101) may display another executable object (831) to resume display of a first part (e.g., a portion of a virtual space corresponding to a screen (620)) within a screen (820) (e.g., a screen corresponding to a second part of the virtual space) displayed according to an input (805). The wearable device (101) may display another executable object (831) within an area (630). The location of the area (630) in the state (810) may be the same as the location of the area (630) in the state (800), but the present disclosure is not limited thereto. For example, the location of the area (630) in the state (810) may be opposite to the location of the area (630) in the state (800).

[0131] For example, another executable object (831) may include a thumbnail image of a first part of the virtual space. The thumbnail image of the first part of the virtual space may include a screen (620) displayed on the display when the input (805) is received. Another executable object (831) may, in response to displaying the screen (820), include a screen representing the first part of the virtual space corresponding to the direction of the view point of the avatar at the time of receiving the input (805) (e.g., direction (640) of FIG. 6). The screen may include information about the first part of the virtual space in real time in conjunction with the timing of displaying the screen (820). Another executable object (831) may be displayed within an area (630) on the screen (820) representing the location of the first part of the virtual space (e.g., a screen corresponding to the second part of the virtual space). The wearable device (101) may activate a timer having a specified duration in response to the display of another executable object (831). For example, the wearable device (101) may identify an input (815) for another executable object (831) as indicating a cancellation of an action for the input (805). The duration of the timer for displaying the other executable object (831) for receiving the input (815) indicating a cancellation may be shorter than the duration of the timer for displaying the executable object (631).

[0132] For example, the wearable device (101) may receive an input (815) while a timer is activated in response to the display of another executable object (831). As an example, the wearable device (101) may stop displaying the other executable object (831) based on detecting the expiration of the timer prior to receiving the input (815). The wearable device (101) may stop displaying the other executable object (831) based on causing the other executable object (831) to gradually disappear by reducing the size of the other executable object (831).

[0133] In one embodiment, a wearable device (101) may enter a state (800) in response to an input (815) for another executable object (831). In response to the input (815), the wearable device (101) may control an avatar (e.g., avatar (601) of FIG. 6) corresponding to the user (105) to change its posture to that of the avatar before receiving the input (805). Based on controlling the avatar, the wearable device (101) may display a screen (620) representing a first part of a virtual space on the display.

[0134] As described above, the wearable device (101) according to one embodiment can determine an area (630) including an executable object (631) to be displayed on the display based on the relative positional relationship between the avatar (e.g., the avatar (601) of FIG. 6) of the user (105) in the virtual space and the avatar (603) of another user. The wearable device (101) can guide the user to a location where the avatar (603) corresponding to the executable object (631) has logged into the virtual space using the location of the area (630). In response to an input (805) for the executable object (631), the wearable device (101) can display a screen (820) indicating a location where the avatar (603) is located on the display. In response to the display of the screen (820), the wearable device (101) can display another executable object (831) on the area (630) of the screen (820). The wearable device (101) can display an executable object (831) corresponding to the screen (620) displayed before identifying the input (805) on the area (630). In response to the input (815) for the executable object (831), the wearable device (101) can resume displaying the screen (620). The wearable device (101) can use the executable objects (631, 831) displayed within the area (630) to cause the user to more easily change the viewpoint of the avatar.

[0135] FIG. 9 is a flowchart illustrating exemplary operations of a wearable device according to various embodiments. At least one of the operations of FIG. 9 may be performed by the wearable device (101) of FIG. 4. At least one of the operations of FIG. 9 may be controlled by the processor (410) of FIG. 4. Each of the operations of FIG. 9 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel. At least one of the operations of FIG. 9 may be related to at least one of the operations of FIG. 5.

[0136] Referring to FIG. 9, in operation 910, a wearable device according to an embodiment may determine information regarding a relative positional relationship between a viewpoint and a location for displaying a first part of a virtual space. The wearable device may receive, from a server, a location where an avatar corresponding to a user is positioned within the virtual space. The wearable device may identify the first part of the virtual space using an FoV based on a direction of an avatar's viewpoint according to the avatar's posture. Based on the identification of the first part of the virtual space, the wearable device may display a screen representing the first part on a display. While displaying the screen on the display, the wearable device may receive, from a server, information related to another avatar logged into the virtual space. The wearable device may receive the information including the location of the other avatar within the virtual space. The wearable device may identify a location including the location of the other avatar. The above location may represent at least a portion of a second part of the virtual space to be included in the FoV of the avatar based on a direction (e.g., direction (640) in FIG. 6) from a position of the avatar corresponding to the user toward a position of the other avatar. The wearable device may obtain an angle (e.g., angle (609) in FIG. 6) with respect to a specified axis (e.g., y-axis in FIG. 6) based on a direction from a position of the avatar corresponding to the user toward a position of the other avatar on a reference plane (e.g., reference plane (650-1) in FIG. 6). The angle may refer to, for example, a relative positional relationship between a position of the avatar corresponding to the user and a position of the other avatar.

[0137] Referring to FIG. 9, in operation 920, a wearable device according to an embodiment may determine an area for displaying an executable object based on information about a relative positional relationship. For example, the wearable device may determine the location of an area to be displayed on a screen formed based on a two-dimensional space using an angle obtained using a virtual space formed based on a three-dimensional space. The area may be used to display an executable object. The size and / or location of the area may be adjusted by a user input. The size and / or location of the area may change depending on the locations of objects within the virtual space. The executable object may include an image representing a location and / or location information about the location. The wearable device may guide the user to the location of another avatar within the virtual space by displaying the location of the area based on the relative positional relationship.

[0138] FIG. 10 is a flowchart illustrating an exemplary operation of a wearable device identifying an avatar corresponding to a registered user account according to various embodiments. FIG. 11 is a diagram illustrating an exemplary operation of a wearable device displaying an avatar based on a registered user account according to various embodiments. The wearable devices of FIGS. 10 and 11 may include the wearable device (101) of FIG. 4. At least one of the operations of FIG. 10 may be performed by the wearable device (101) of FIG. 4. At least one of the operations of FIG. 10 may be controlled by the processor (410) of FIG. 4. Each of the operations of FIG. 10 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel. At least one of the operations of FIG. 10 may be related to at least one of the operations of FIG. 5.

[0139] Referring to FIG. 10, in operation 1010, a wearable device according to one embodiment may receive information including data regarding a user account of another user. The wearable device may receive information including data regarding the user account of another user from a server (e.g., server (401) of FIG. 4) when an avatar corresponding to another user accesses a virtual space. The information may include information indicating the location of the avatar within the virtual space.

[0140] Referring to FIG. 10, in operation 1020, a wearable device according to an embodiment may check whether a user account of another user is registered in a list set for a virtual space. The list set for the virtual space may include information indicating a user account of another user. The list may include information about an avatar corresponding to the user account of another user. The list may be obtained when a user of the wearable device registers a user account of another user. The wearable device may use the list to determine whether to provide the user with information indicating the position of an avatar corresponding to the user account of another user.

[0141] Referring to FIG. 11, in a state (1100), a wearable device (101) according to one embodiment may display a screen (620) representing a first part of a virtual space on a display through a FoV (615) based on a direction (e.g., direction (640) of FIG. 6) of a viewpoint of an avatar (e.g., avatar (601) of FIG. 6). While displaying the screen (620), the wearable device (101) may receive information representing logins of avatars (603, 1135) corresponding to multiple user accounts of multiple users from a server (e.g., server (401) of FIG. 4). Based on receiving the information, the wearable device (101) may determine whether to provide the user with information representing the positions of the avatars (603, 1135).

[0142] For example, the wearable device (101) can use the list (1110) to determine whether to provide information indicating the positions of the avatars (603, 1135). The wearable device (101) can use the list (1110) to identify a registered user account among a plurality of users. For example, the wearable device (101) can use the visual object (1116) in the list (1110) to receive an input indicating a user account to be registered in the list (1110). However, the present disclosure is not limited thereto. The list (1110) can be used, according to an embodiment, to block the reception (or provision to the user after reception) of information related to an avatar corresponding to a user account.

[0143] Referring to FIG. 10, when a user account of another user registered in the list is identified (operation 1020 - example), in operation 1030, the wearable device (101) can display an executable object within an area on the first part based on the user account of another user registered in the list.

[0144] Referring to FIG. 11, a wearable device (101) according to one embodiment can identify an avatar (603) corresponding to a registered user account (1115). The wearable device (101) can identify a relative positional relationship between the avatar (603) for the registered user account (1115) and an avatar corresponding to the user (105) (e.g., the avatar (601) of FIG. 6). If the avatar (603) is included in a first part of a virtual space viewed by the avatar corresponding to the user (105), the wearable device (101) can display a screen including the avatar (603) on the display. If the avatar (603) is located outside the first part, the wearable device (101) can display an executable object representing a second part distinct from the first part in an area (630) of the screen. The above relative position relationship may include information about an angle (609) between an avatar (603) in the virtual space and an avatar corresponding to a user (105) from a specified axis (e.g., the y-axis of FIG. 6). The wearable device (101) may display an executable object (631) within an area (630) positioned according to the angle (609).

[0145] Referring to FIG. 10, if a user account of another user not registered in the list is identified (operation 1020-No), in operation 1040, displaying an executable object within the area on the first part may be avoided based on the user account of another user not registered in the list.

[0146] Referring to FIG. 11, the wearable device (101) may receive information from the server indicating that an avatar (1135) corresponding to a user account of another user not registered in the list (1110) has logged into the virtual space. In response to receiving the information, the wearable device may refrain from displaying an executable object (1131) to indicate an avatar (1135) corresponding to a user account not registered in the list (1110).

[0147] For example, the wearable device (101) can receive information about the location of the avatar (1135) within the virtual space. The wearable device (101) can obtain a relative positional relationship between the location of the avatar (1135) and the avatar corresponding to the user (105). For example, the relative positional relationship between the location of the avatar (1135) within the virtual space and the avatar corresponding to the user (105) (e.g., the avatar (601) of FIG. 6) can include information about an angle (1109). The wearable device (101) can determine the location of the executable object (1131) corresponding to the avatar (1135) within the screen (620) based on the angle (1109). The wearable device (101) may obtain an executable object (1131) representing a location (e.g., a third part of the virtual space) including the location of the avatar (1135) on the area (1130) if the location of the avatar (1135) is located outside the first part of the virtual space corresponding to the screen (620). If a user account corresponding to the avatar (1135) is not registered in the list (1110), the wearable device (101) may refrain from displaying the executable object (1131) within the area (1130) on the first part, despite the location being located outside the first part of the virtual space.

[0148] As described above, the wearable device (101) according to one embodiment can determine whether to display an executable object for indicating the position of an avatar corresponding to another user account, depending on whether the user account of the other user is registered in the list (1110). The wearable device (101) can provide a metaverse environment in which the user (105) can focus on the information he / she wants by using the list (1110) to provide information related to the avatar of another user that the user (105) wants or by blocking information related to the avatar of another user that the user (105) does not want.

[0149] FIG. 12 is a diagram illustrating an exemplary interface for interacting with an avatar displayed on a wearable device according to various embodiments. The wearable device (101) of FIG. 12 may include the wearable device (101) of FIG. 4.

[0150] Referring to FIG. 12, a wearable device (101) according to one embodiment may display an executable object (631) within an area (630) of the screen (620) together with the screen (620) in a state (1200). The state (1200) may be included in the state (800) of FIG. 8.

[0151] In one embodiment, a wearable device (101) may, in response to the display of an executable object (631), display an interaction interface (1205) in conjunction with the executable object (631) for interacting with an avatar (603) corresponding to the executable object (631) (or for communicating with another user corresponding to the avatar (603). The interaction interface (1205) may be positioned adjacent to the executable object (631) outside the executable object (631). For example, the interaction interface (1205) may be displayed within the executable object (631).

[0152] For example, the interaction interface (1205) may include an icon (1210) for changing the position of an avatar (e.g., avatar (601) of FIG. 6) corresponding to the user (105), an icon (1220) for chatting with the avatar (603) (or another user corresponding to the avatar (603)), and / or an icon (1230) for changing the movement of the avatar corresponding to the user (105).

[0153] For example, in response to an input to an icon (1210), the wearable device (101) may control the avatar corresponding to the user (105) to move from a location of the avatar corresponding to the user (105) (e.g., location (601-1) of FIG. 6) to a location adjacent to the avatar (603). The wearable device (101) may change the location of the avatar corresponding to the user (105) to a location adjacent to the avatar (603). By changing the location of the avatar to a location adjacent to the avatar (603), the wearable device (101) may provide a visual effect such as an instantaneous movement of the avatar. The operation of the wearable device (101) changing the location of the avatar corresponding to the user (105) is not limited to the above-described embodiment.

[0154] For example, the wearable device (101) may, in response to an input to a visual object (1220), display a user interface for chatting with an avatar (603) (or another user corresponding to the avatar (603)) by overlaying it on the screen (620).

[0155] For example, the wearable device (101) may control an avatar (e.g., avatar (601) of FIG. 6) corresponding to the user (105) based on a movement indicating an emotion (or reaction) in response to an input to the icon (1230). The movement indicating an emotion may include a movement indicating an interaction between avatars, such as a movement of the avatar greeting, or a movement of the avatar looking at another avatar (e.g., avatar (603)).

[0156] As described above, the wearable device (101) according to one embodiment can display an interaction interface (1205) on the display for performing interaction (or communication) with an avatar (603) corresponding to another user, together with an executable object for changing the direction of the avatar's viewpoint. Using the interaction interface (1205), the wearable device (101) can provide a metaverse service that can more easily perform interaction with an avatar that has entered a virtual space.

[0157] FIGS. 13A and 13B are diagrams illustrating exemplary operations of a wearable device according to various embodiments to change the positions of areas corresponding to avatars based on inputs for selecting multiple avatars.

[0158] The wearable device (101) of FIGS. 13a and 13b may include the wearable device (101) of FIG. 4.

[0159] Referring to FIG. 13A, in a state (1300), a wearable device (101) according to one embodiment may display a screen (620) representing a first part of a virtual space on a display based on a posture of an avatar (e.g., an avatar (601) of FIG. 6). The wearable device (101) may display the first part of the virtual space on the display based on the FoV (615). While displaying the screen (620), the wearable device (101) may receive information representing the positions of avatars (603, 1135) of other users from an external electronic device (e.g., a server (401)). The information may include information representing the positions of the avatars (603, 1135) within the virtual space.

[0160] For example, the wearable device (101) may use the information to determine whether to display executable objects (631, 1131) corresponding to avatars (603, 1135) within areas (630, 1130) of the first part of the virtual space. The wearable device (101) may display the executable objects (631, 1131) on the display based on identifying the location (or place) of the avatars (603, 1135) located outside the first part of the virtual space.

[0161] For example, the wearable device (101) can identify inputs for executable objects (631, 1131). When the wearable device (101) identifies input (815) for one executable object (631), it can change the posture of the avatar corresponding to the user (105) to look at the avatar (603) corresponding to the executable object (631).

[0162] For example, the wearable device (101) can identify inputs (815, 1136) for all executable objects (631, 1131) within a specified time period. In response to identifying inputs (815, 1136) within the specified time period, the wearable device (101) can change the location at which the executable objects (631, 1131) are displayed.

[0163] Referring to FIG. 13B, the wearable device (101) may, in response to identifying inputs (815, 1136) within a specified time, display a screen (1310) on the display in a state (1301). The screen (1310) may include executable objects (631, 1131). In response to identifying inputs (815, 1136), the wearable device (101) may change the size and / or position of areas for displaying the executable objects (631, 1131). The size of the areas (1320, 1330) for displaying the executable objects (631, 1131) may be relatively larger than the size of the areas (630, 1130) for displaying the executable objects (631, 1131) in the state (1300). The wearable device (101) may, in response to inputs (815, 1136), display executable objects (631, 1131) instead of the first part of the virtual space based on the FoV (615) so that the user (105) can more easily identify the executable objects (631, 1131), although the present disclosure is not limited thereto.

[0164] Referring to FIG. 13B, the wearable device (101) may, in response to identifying inputs (815, 1136) within a specified time, change the positions of areas (e.g., areas (630, 1130) of FIG. 13A) for displaying executable objects (631, 1131) in a state (1302). Since the wearable device (101) displays the executable objects (631, 1131) based on the relative positional relationship of the avatars (603, 1135) corresponding to each of the areas, it may obscure at least a portion of the first part of the virtual space within the FoV (615). The wearable device (101) may change the positions of the areas to secure a field of view for at least a portion of the first part of the virtual space displayed within the FoV (615). The wearable device (101) can arrange the positions of the regions (630, 1130) adjacent to one edge (615-1) of the FoV (615). By arranging the regions (630, 1130) adjacent to one edge (615-1), the wearable device (101) can change the positions at which executable objects (631, 1131) are displayed. By arranging the regions (630, 1130) adjacent to one edge (615-1), the wearable device (101) can cause the user (105) to more easily manage the executable objects (631, 1131). The wearable device (101) can arrange the executable object adjacent to another edge (615-2) that is distinct from (or perpendicular to) the one edge (615-1). An example of a screen in which a wearable device (101) places an executable object adjacent to another edge (615-2) may be represented as a state (1303).

[0165] As described above, the wearable device (101) according to one embodiment can display a plurality of executable objects (631, 1131) on the display based on the relative positional relationship of avatars (603, 1135) corresponding to each of the plurality of executable objects. The wearable device (101) can change the positions of the executable objects (631, 1131) in response to identifying inputs (815, 1136) for the executable objects (631, 1131) within a specified time. By changing the positions of the executable objects (631, 1131) within the FoV (615), the wearable device (101) can secure visibility of a first part of a virtual space displayed within the FoV (615).

[0166] FIG. 14 is a diagram illustrating an exemplary operation of a wearable device according to various embodiments to display areas corresponding to multiple avatars. The wearable device (101) of FIG. 14 may include the wearable device (101) of FIG. 4.

[0167] Referring to FIG. 14, in a state (1400), a wearable device (101) according to one embodiment may display a screen (620) including areas (1411, 1412, 1413) for displaying a plurality of executable objects on the display. The wearable device (101) may receive information indicating login of avatars (1421, 1422, 1423) to be positioned outside a part of the virtual space from an external electronic device (e.g., a server (401)) while an avatar corresponding to a user (105) (e.g., avatar (601) of FIG. 6) is positioned toward a part of the virtual space based on the FoV (615).

[0168] For example, in response to receiving information, the wearable device (101) may obtain a relative positional relationship between each of the avatars (1421, 1422, 1423) and an avatar corresponding to the user (105). Based on the obtained relative positional relationship, the wearable device may identify an angle (1415). Based on the angle, the wearable device (101) may determine the positions of areas (1411, 1412, 1413) for displaying executable objects corresponding to the avatars (1421, 1422, 1423) on at least a portion of the screen (620).

[0169] For example, the wearable device (101) can identify avatars (1421, 1422, 1423) included in a designated location based on the acquired relative positional relationship. The wearable device (101) can display executable objects corresponding to the avatars (1421, 1422, 1423) included in the designated location by overlapping at least a portion of the areas (1411, 1412, 1413) and positioning them within the FoV (615). For example, the angle (1415) for the at least partially overlapping areas (1411, 1412, 1413) can represent an average angle between each of the avatars (1421, 1422, 1423) and an avatar corresponding to the user (105). The wearable device (101) can determine the location of another region (1410) including regions (1411, 1412, 1413) based on the angle (1415). By determining the location of the other region (1410) corresponding to the average angle, the wearable device (101) can change the location of the regions (1411, 1412, 1413) within the other region (1410).

[0170] For example, the wearable device (101) may place at least a portion of the areas (1411, 1412, 1413) within the FoV (615) based on a specified order. For example, the wearable device (101) may determine the order for overlapping the areas (1411, 1412, 1413) based on the order in which they entered the virtual space.

[0171] For example, the wearable device (101) can change the specified order. The wearable device (101) can change the specified order in response to an input for each of the executable objects included in the regions (1411, 1412, 1413). For example, if the wearable device (101) identifies an input for the region (1411), it can change the specified order so as to place the region (1411) relatively higher than the other regions (1412, 1413). However, the present disclosure is not limited thereto.

[0172] As described above, the wearable device (101) according to one embodiment can receive information from an external electronic device indicating that avatars (1421, 1422, 1423) corresponding to a plurality of users enter at least a part of a virtual space within a specified time (or simultaneously). In response to receiving the information, the wearable device (101) can identify the locations of the avatars (1421, 1422, 1423). If the locations of the avatars (1421, 1422, 1423) are included within a specified range and the specified range is outside the FoV (615), the wearable device (101) can display executable objects corresponding to the avatars (1421, 1422, 1423). The wearable device can arrange regions (1411, 1412, 1413) for displaying executable objects within a specified range so as to overlap at least a portion of the regions (1411, 1412, 1413). By arranging at least a portion of the regions (1411, 1412, 1413) so as to overlap, the wearable device (101) can secure visibility of at least a portion of the virtual space displayed within the FoV (615) and visibility of executable objects.

[0173] Below, with reference to FIG. 15, an example of an operation for stopping the display of an executable object is described in more detail.

[0174] FIG. 15 is a diagram illustrating exemplary operations for a wearable device according to various embodiments to stop displaying an area corresponding to an avatar. Referring to FIG. 15, a state (1500) is illustrated in which a wearable device (101) according to one embodiment displays a screen (620) including a plurality of executable objects (1131, 631, 1521). The wearable device (101) of FIG. 15 may include the wearable device (101) of FIG. 4.

[0175] According to one embodiment, a wearable device (101) may receive information related to other avatars entering the virtual space from an external electronic device while displaying a screen (620) (e.g., a screen representing a first part of a virtual space included in a viewpoint of an avatar corresponding to a user (105)) on the display. The wearable device may use the information to identify the other avatars located outside the first part of the virtual space. The wearable device (101) may obtain executable objects (1131, 631, 1521) for performing interactions with the other avatars based on a relative positional relationship between each of the positions of the other avatars and an avatar corresponding to the user (105) (e.g., an avatar (601) of FIG. 6). The wearable device (101) can determine areas (1130, 630, 1520) on the first part (or FoV (615)) of the virtual space for displaying executable objects (1131, 631, 1521) based on the relative positional relationship of each of the other avatars.

[0176] For example, the wearable device (101) may at least temporarily suspend the display of executable objects (1131, 631, 1521) included in each of the determined areas (1130, 630, 1520). The wearable device (101) may at least temporarily suspend the display of executable objects (1131, 631, 1521) to secure visibility of the first part of the virtual space. As an example, at least one executable object (1131) among the executable objects (1131, 631, 1521) may be translucent.

[0177] In one embodiment, a wearable device (101) may activate a timer in response to displaying an executable object (1131). The wearable device (101) may detect the expiration of the activated timer. In response to the detection, the wearable device (101) may stop displaying the executable object (1131). The wearable device (101) may stop displaying the executable object (1131) by causing the executable object (1131) to gradually disappear.

[0178] According to one embodiment, a wearable device (101) may display a visual object (1550) overlapping an area (630) for stopping display of an executable object (631) among executable objects (1131, 631, 1521). For example, the wearable device (101) may stop displaying an executable object (631) in response to an input to the visual object (1550).

[0179] According to one embodiment, a wearable device (101) may obtain an input (1510) to stop displaying an executable object (1521) among executable objects (1131, 631, 1521). For example, the wearable device (101) may identify an input (1510) having a direction from the executable object (1521) toward at least one edge (615-3) among the edges of the FoV (615) adjacent to the executable object (1521). In response to the input (1510), the wearable device (101) may cause the executable object (1521) to gradually move toward the at least one edge (615-3), thereby stopping displaying the executable object (1521). The operation of the wearable device (101) to stop displaying the executable object is not limited to the above-described embodiment.

[0180] A wearable device according to one embodiment may provide a user with a notification indicating the login of another avatar by obtaining information indicating the login of another avatar located in a second part of a virtual space distinct from a first part of the virtual space corresponding to the viewpoint of an avatar logged into the virtual space. A method for the wearable device to efficiently provide the notification to the user may be required.

[0181] A wearable device according to one embodiment as described above may include at least one communication circuit, at least one display configured to be aligned with an eye of a user wearing the wearable device, a memory storing instructions, and at least one processor including a processing circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the wearable device to receive, using the at least one communication circuit, information from a server, while providing a virtual space configured to change a view in accordance with a movement of the wearable device, indicating a location of an avatar of another user entering the virtual space. The instructions, when individually and / or collectively executed by the at least one processor, may cause the wearable device, in response to the reception, to determine whether the location is located within a first part of the virtual space being displayed on the at least one display. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display, via the at least one display, an executable object configured to change a part of the virtual space displayed via the at least one display to a second part of the virtual space that includes the place, based on determining that the place is located outside the first part of the virtual space.The instructions, when executed by at least one processor, may individually and / or collectively cause the wearable device to display the avatar, via the at least one display, within the first part of the virtual space based on determining that the location is located within the first part of the virtual space.

[0182] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display the executable object as an overlay at a location on the at least one display relative to a location of the avatar on a reference plane of the virtual space, based on determining that the location is located outside the first part of the virtual space.

[0183] For example, the executable object may include a view of the avatar entering the virtual space.

[0184] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device, in response to the information indicating the location located outside the first part of the virtual space being displayed through the at least one display, to determine information about a relative positional relationship between a view point for the display of the first part of the virtual space and the location. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to determine the area for the display of the executable object according to the information about the relative positional relationship.

[0185] For example, the information about the relative positional relationship may be configured to include data about an angle between a first direction and a second direction. The first direction may be a direction between a position of the user's avatar on a reference plane of the virtual space and a viewpoint for displaying the first part of the virtual space. The second direction may be a direction between the position and a position of the avatar of the other user on the reference plane.

[0186] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to receive an input regarding the executable object displayed within the region on the first part of the virtual space. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device, in response to the input, to change the part of the virtual space displayed via the at least one display from the first part of the virtual space to the second part of the virtual space.

[0187] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display, via the at least one display, another executable object configured to resume display of the first part of the virtual space, within the second part of the virtual space displayed in response to the input.

[0188] For example, the other executable object may include a thumbnail image of the first part of the virtual space.

[0189] For example, the other executable object may be displayed within an area on the second part of the virtual space that represents a location of the first part of the virtual space.

[0190] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to receive another input for the other executable object displayed within the second part of the virtual space via the at least one display. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to resume displaying the first part of the virtual space in response to the another input.

[0191] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to activate a timer in response to the presentation of the executable object. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to receive the input while the timer is activated.

[0192] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to detect expiration of the timer before the input is received. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device, in response to the detection, to cease displaying the executable object within the area on the first part of the virtual space.

[0193] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to stop displaying the executable object by causing the executable object to disappear.

[0194] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display, via the at least one display, an interaction interface for communication with the other user within the first part of the virtual space, in association with the executable object.

[0195] For example, the interaction interface may be adjacent to the executable object outside the executable object.

[0196] For example, the interaction interface may be displayed within the executable object.

[0197] For example, the executable object may be translucent.

[0198] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to receive the information further including data about a user account of the other user. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to determine whether the user account of the other user is registered in a list configured for the virtual space. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to display the executable object within the area on the first part based on the user account of the other user registered in the list. The instructions, when individually and / or collectively executed by at least one processor, may cause the wearable device to refrain from displaying the executable object within the area on the first part, despite the location being outside the first part of the virtual space being displayed via the at least one display, based on the user account of the other user not registered in the list.

[0199] In a method of a wearable device comprising at least one communication circuit and at least one display configured to be aligned with an eye of a user wearing the wearable device according to one embodiment of the present invention, the method may include receiving, from a server, using the at least one communication circuit, information indicating a location of an avatar of another user entering the virtual space while providing a virtual space configured to change a view according to a movement of the wearable device within the wearable device in conjunction with a server. The method may include, in response to the reception, determining whether the location is located within a first part of the virtual space displayed on the at least one display. The method may include, based on determining that the location is located outside the first part of the virtual space, displaying, through the at least one display, within an area on the first part of the virtual space representing the location, an executable object configured to change a part of the virtual space displayed through the at least one display to a second part of the virtual space including the location. The method may include an action of displaying the avatar through the at least one display within the first part of the virtual space, based on determining that the location is located within the first part of the virtual space.

[0200] In a non-transitory computer-readable storage medium storing one or more programs according to one embodiment as described above, the one or more programs, when individually and / or collectively executed by at least one processor including processing circuitry of a wearable device including at least one communication circuit and at least one display configured to be aligned with an eye of a user wearing the wearable device, cause the wearable device to receive, using the at least one communication circuit, information from a server, while providing a virtual space within the wearable device in conjunction with a server, the virtual space being configured to change a view in accordance with movement of the wearable device, indicating a location of an avatar of another user entering the virtual space. The one or more programs, when executed by the wearable device, cause the wearable device to, in response to the reception, determine whether the location is located within a first part of the virtual space being displayed on the at least one display. The one or more programs, when executed by the wearable device, may cause the wearable device to display, through the at least one display, an executable object configured to change a part of the virtual space displayed through the at least one display to a second part of the virtual space that includes the place, within an area on the first part of the virtual space representing the place, based on determining that the place is located outside the first part of the virtual space.The one or more programs, when executed by the wearable device, may cause the wearable device to display the avatar, through the at least one display, within the first part of the virtual space, based on determining that the location is located within the first part of the virtual space.

[0201] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0202] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in various embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0203] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0204] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0205] While the present disclosure has been illustrated and described with reference to various embodiments, it is to be understood that the various exemplary embodiments are intended to be illustrative and not limiting. Those skilled in the art will further recognize that various changes in form and detail may be made without departing from the full scope of the present disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiment(s) described herein may be used in combination with any other embodiment(s) described herein.

Claims

1. In wearable devices, At least one communications circuit; At least one display configured to be aligned with respect to the eyes of a user wearing the wearable device; A memory comprising one or more storage media storing instructions; and comprising at least one processor including a processing circuit; The above instructions, when individually and / or collectively executed by at least one processor, cause the wearable device to: While providing a virtual space configured to change its view according to the movement of the wearable device in conjunction with a server, information indicating the location of an avatar of another user entering the virtual space is received from the server using at least one communication circuit, In response to said receiving, determining whether said location is located within a first part of said virtual space being displayed on said at least one display; Based on the determination that the location is located outside the first part of the virtual space, an executable object configured to change the part of the virtual space displayed through the at least one display to a second part of the virtual space including the location is displayed, through the at least one display, within an area on the first part of the virtual space representing the location, and Causing the avatar to be displayed through the at least one display within the first part of the virtual space, based on the determination that the location is located within the first part of the virtual space. Wearable devices.

2. In claim 1, the instructions, when individually and / or collectively executed by at least one processor, cause the wearable device to: Causing the executable object to be displayed as an overlay at a location on the at least one display relative to a location of the avatar on a reference plane of the virtual space, based on the determination that the location is located outside the first part of the virtual space. Wearable devices.

3. In claim 1, the executable object is: including a view of the avatar entering the virtual space; Wearable devices.

4. In claim 1, the instructions, when individually and / or collectively executed by at least one processor, cause the wearable device to: In response to the information indicating the location located outside the first part of the virtual space being displayed through the at least one display, determining information about the relative positional relationship between the location and a view point for the display of the first part of the virtual space, and causing, based on the above information about the above relative positional relationship, to determine the area for the above display of the above executable object; Wearable devices.

5. In claim 4, the information about the relative positional relationship is, Contains data on the angle between the first and second directions, The above first direction is, The direction between the position (601-1) of the user's avatar on the reference plane (650-1) of the virtual space and the view point for displaying the first part of the virtual space, The second direction above is, The direction between the above location and the location (603-1) of the other user's avatar on the above reference plane, Wearable devices.

6. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Receiving input for the executable object displayed within the area on the first part of the virtual space, In response to said input, causing said part of said virtual space displayed through said at least one display to be changed from said first part of said virtual space to said second part of said virtual space, Wearable devices.

7. In claim 6, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing another executable object configured to resume display of said first part of said virtual space, to be displayed, through said at least one display, within said second part of said virtual space displayed according to said input; Wearable devices.

8. In claim 7, the other executable object is, Including a thumbnail image of the first part of the virtual space, Wearable devices.

9. In claim 7, the other executable object is, configured to be displayed within an area on the second part of the virtual space, which represents the location of the first part of the virtual space; Wearable devices.

10. In claim 7, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: receiving another input for said other executable object displayed within said second part of said virtual space via said at least one display; and In response to said other input, causing the display of said first part of said virtual space to resume, Wearable devices.

11. In claim 6, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: In response to the indication of the above executable object, activate a timer, and While the above timer is active, causing the above input to be received, Wearable devices.

12. In claim 11, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Detecting expiration of said timer before said input is received, and In response to said detection, causing said executable object to be stopped from being displayed within said area on said first part of said virtual space. Wearable devices.

13. In claim 12, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: causing said executable object to disappear, thereby causing said executable object to stop being displayed, Wearable devices.

14. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the wearable device to: Causing an interaction interface (1205) for communication with another user within the first part of the virtual space to be displayed through at least one display in conjunction with the executable object, Wearable devices.

15. In claim 14, the interaction interface comprises: adjacent to said executable object outside said executable object, Wearable devices.

Images