Wearable device and method for changing background objects based on size or number of foreground objects

Abstract

According to one embodiment, a processor of a wearable device may display, on a display, a foreground object superimposed on a background object having a first brightness. Based on identifying that the size of at least a portion of the display occupied by the foreground object has increased, the processor may change the brightness of the background object to a second brightness lower than the first brightness. This document may relate to meta-universe services for enhancing interconnectivity between real and virtual objects. For example, meta-universe services may be provided over a 5th-Generation (5G) and / or 6th-Generation (6G) based network.

Description

Technical Field

[0001] The present disclosure relates to a wearable device and a method for changing a background object based on the size or number of foreground objects. Background Art

[0002] To provide an enhanced user experience, electronic devices that provide augmented reality (AR) services are being developed, which combine computer-generated information with external objects in the real world. The electronic device may be a wearable device that can be worn by a user. For example, the electronic device may be AR glasses and / or a head-mounted device (HMD). Summary of the Invention

[0003] [Technical Solution] According to an embodiment, a wearable device may include a display, a memory for storing instructions, and a processor. When the instructions are executed by the processor, the wearable device may display a foreground object overlapping on a background object having a first brightness on the display. When the instructions are executed by the processor, the wearable device may change the brightness of the background object to a second brightness less than the first brightness based on identifying that the size of the foreground object has expanded to be greater than a reference size range.

[0004] According to an embodiment, a wearable device may include a display, a memory storing instructions, and a processor. When the instructions are executed by the processor, the wearable device may display a foreground object overlapping on a background object having a first brightness on the display. When the instructions are executed by the processor, the wearable device may change the brightness of the background object from the first brightness to a second brightness less than the first brightness based on identifying that the size of at least a part of the display occupied by the foreground object has increased.

[0005] According to an embodiment, a method of a wearable device may include: displaying a foreground object overlapping on a background object having a first brightness on a display of the wearable device. The method may include: changing the brightness of the background object to a second brightness less than the first brightness based on identifying that the size of the foreground object has expanded to be greater than a reference size range.

[0006] According to an embodiment, a wearable device may include a display, a memory storing instructions, and a processor. When executed by the processor, the instructions may cause the wearable device to display a background object having a first brightness and one or more foreground objects superimposed on the background object on the display. When executed by the processor, the instructions may cause the wearable device to identify the number of foreground objects based on at least one application executed by the processor while displaying the background object at the first brightness associated with the number of one or more foreground objects. When executed by the processor, the instructions may cause the wearable device to change the brightness of the background object to a second brightness less than the first brightness based on identifying an increase in the number of one or more foreground objects.

[0007] According to an embodiment, a method of a wearable device may include: displaying a background object having a first brightness and one or more foreground objects superimposed on the background object on a display of the wearable device. The method may include: identifying the number of foreground objects based on at least one application executed by a processor of the wearable device while displaying the background object at the first brightness associated with the number of one or more foreground objects. The method may include: changing the brightness of the background object to a second brightness less than the first brightness based on identifying an increase in the number of one or more foreground objects.

[0008] In an embodiment, a non-transitory computer-readable storage medium storing instructions is provided. When executed by a processor of a wearable device including a display, the instructions may cause the wearable device to superimposedly display a foreground object on a background object having a first brightness on the display. When executed by the processor, the instructions may cause the wearable device to change the brightness of the background object from the first brightness to a second brightness less than the first brightness based on identifying that the size of at least a portion of the display occupied by the foreground object has increased. Description of the Drawings

[0009] Figure 1 An exemplary state of a wearable device superimposedly displaying a foreground object on a background object according to an embodiment is shown.

[0010] Figure 2 An example of a block diagram of a wearable device according to an embodiment is shown.

[0011] Figure 3a An example of a perspective view of a wearable device according to an embodiment is shown.

[0012] Figure 3b An example of one or more hardware components provided in a wearable device according to an embodiment is shown.

[0013] Figures 4a to 4b An example of the exterior of a wearable device according to an embodiment is shown.

[0014] Figure 5a and Figure 5b and Figure 5c and Figure 5d illustrate examples of operations of a wearable device for changing a background object according to an embodiment.

[0015] Figure 6 illustrate examples of operations of a wearable device for changing at least a part of a background object based on the position and / or size of a foreground object according to an embodiment.

[0016] Figure 7 illustrate an example of a flowchart of a wearable device according to an embodiment.

[0017] Figure 8 illustrate an example diagram of a network environment associated with a metaverse service. DETAILED DESCRIPTION

[0018] Hereinafter, various embodiments of this document will be described with reference to the accompanying drawings.

[0019] The various embodiments of this document and the terms used herein are not intended to limit the technology described in this document to specific embodiments, and should be understood to include various modifications, equivalent forms, or alternatives of the corresponding embodiments. Regarding the description of the drawings, reference numerals may be used for similar components. Singular expressions may include plural expressions unless clearly differently indicated in the context. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Expressions such as "first", "second", "the first", or "the second" may modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another without limiting the corresponding components. When (e.g., the first) component is referred to as being "connected (functionally or communicatively)" or "accessing" another (e.g., the second) component, the component may be directly connected to the other component or may be connected through another component (e.g., the third component).

[0020] The term "module" used in this document may include a unit configured with hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be a component configured as an overall configuration for performing one or more functions or its smallest unit or part. For example, a module may be configured with an application-specific integrated circuit (ASIC).

[0021] Figure 1FIG. 0 illustrates an exemplary state in which a wearable device 101 according to an embodiment overlays a foreground object on a background object 130. In an embodiment, the wearable device 101 may include a head-mounted display (HMD) wearable on the head of a user 110. Although the exterior of the illustrated wearable device 101 has the form of glasses, the embodiment is not limited thereto. Reference will be made to Figures 3a to 3b and / or Figures 4a to 4b to describe an example of the structure of the wearable device 101 wearable on the head of the user 110. Reference will be made to Figure 2 to exemplarily describe one or more hardware components included in the wearable device 101.

[0022] According to an embodiment, the wearable device 101 may perform functions related to video see-through (VST) and / or virtual reality (VR). Referring to Figure 1 , in a state where the user 110 wears the wearable device 101, the wearable device 101 may include a housing covering the eyes of the user 110. The wearable device 101 may include a display disposed on a first surface of the housing facing the eyes in this state. The wearable device 101 may include a camera disposed on a second surface opposite to the first surface. Using the camera, the wearable device 101 may obtain a frame including ambient light. The wearable device 101 may output the frame within the display disposed on the first surface such that the user 110 can identify the ambient light through the display. The display area of the display disposed on the first surface may be formed by one or more pixels included in the display. The wearable device 101 may enable the user 110 to identify a virtual object and a real object identified through ambient light by synthesizing the virtual object in the frame output through the display.

[0023] According to an embodiment, the wearable device 101 may perform functions related to augmented reality (AR) and / or mixed reality (MR). In Figure 1 the embodiment, in a state where the user 110 wears the wearable device 101, the wearable device 101 may include at least one lens disposed adjacent to the eyes of the user 110. The wearable device 101 may combine the ambient light passing through the lens with the light emitted from the display of the wearable device 101. The display area of the display may be formed within the lens through which the ambient light passes. Since the wearable device 101 combines the ambient light with the light emitted from the display, the user 110 may see an image that mixes a real object identified through the ambient light and a virtual object formed by the light emitted from the display.

[0024] According to an embodiment, the wearable device 101 may provide a user experience related to AR, MR, VR, and / or VST to the user 110 based on the virtual space 120. The wearable device 101 may selectively output a portion of the virtual space 120 based on the movement of the wearable device 101 moved by the user 110 wearing the wearable device 101. For example, the origin O' of the virtual space 120 may match the point O of the wearable device 101, and the direction D1 of the wearable device 101 may match the direction D1' of the virtual space 120. The wearable device 101 may change the point O' and / or the direction D1' within the virtual space 120 based on the movement of the wearable device 101. Based on the change of the point O' and / or the direction D1', the wearable device 101 may change a portion of the virtual space 120 displayed by the display of the wearable device 101. In the following, the perspective of the virtual space 120 may represent a portion of the virtual space 120 displayed by the wearable device 101. The viewing angle may be formed in the virtual space 120 in the form of a cone and / or a quadrangular pyramid having the point O′ as a vertex and extending toward the direction D1 ′.

[0025] According to an embodiment, the wearable device 101 may display a background object 130. The background object 130 may be displayed to the user 110 to present features of the wearable device 101 (e.g., features that provide a VR experience to the user). In an embodiment, the background object 130 may be referred to as an interactive wallpaper and / or space paper. The background object 130 may include a virtual object and / or a group of one or more virtual objects set in the virtual space 120. Using the background object 130, the wearable device 101 may provide a user experience related to a virtual world surrounding the user 110 to the user 110 wearing the wearable device 101. The wearable device 101 may change at least a portion of the background object 130 based on the movement of the user 110. The wearable device 101 may arrange the background object 130 in the virtual space 120 based on the execution of an application (e.g., system software included in an operating system). Hereinafter, an application for visualization of the background object 130 executed by the wearable device 101 may be referred to as a background application (or background process) and / or a launcher application.

[0026] refer to Figure 1 , according to an embodiment, exemplary states 191, 192, 193, and 194 are exemplarily shown in which the wearable device 101 displays at least a portion of the virtual space 120 to the user 110. Figure 2Describe one or more programs executed by the wearable device 101 to display at least a portion of the virtual space 120. In state 191, the wearable device 101 may display virtual objects 131 and 132 included in the background object 130. In an embodiment where the wearable device 101 generates the background object 130 using weather information (e.g., weather information identified by the global positioning system (GPS) coordinates of the wearable device 101), the wearable device 101 may display the virtual objects 131 and 132 for presenting the weather information to the user 110. Although the virtual objects 131 and 132 are exemplarily shown in the form of clouds and the sun, the embodiment is not limited thereto. For example, the wearable device 101 may display the background object 130 including colors and / or virtual objects corresponding to different time intervals (e.g., time intervals respectively matching morning, afternoon, day, and / or night).

[0027] Reference Figure 1 , different states 192, 193, and 194 in which the wearable device 101 displays one or more foreground objects together with the background object 130 are exemplarily shown. Referring to state 191 and states 192, 193, and 194, the wearable device 101 may change the background object 130 based on displaying at least one foreground object on the background object 130. For example, the wearable device 101 may change at least one property (e.g., brightness, chromaticity, particle density, particle velocity, and / or vignetting effect) for displaying the background object 130. Based on the at least one property, reference will be made to Figure 5a Describe an exemplary structure of the background object 130 displayed by the wearable device 101. When the wearable device 101 changes at least one property related to the background object 130, the wearable device 101 may not change or may maintain the property for displaying at least one foreground object. For example, the wearable device 101 may selectively change the background object 130 based on displaying at least one foreground object. Based on selectively changing the background object 130, the wearable device 101 may emphasize at least one foreground object.

[0028] In an embodiment, the foreground object displayed by the wearable device 101 may include a screen (e.g., such as an active window) and / or a widget (or gadget) provided by an application running on the wearable device 101. The wearable device 101 may identify at least one foreground object to be set in the virtual space 120 based on the running of the application. For example, the wearable device 101 may add a first foreground object 141 in the form of a window to the virtual space 120 based on the running of the application. In Figure 1In state 192, the wearable device 101 may display a first foreground object 141 overlapping a background object 130 to the user 110 based on a perspective of a virtual space 120 formed to face the first foreground object 141.

[0029] According to an embodiment, the wearable device 101 may change the brightness of the background object 130 based on the size and / or number of one or more foreground objects superimposed on the background object 130 in the display. Referring to Figure 1 states 191 and 192, the wearable device 101 may change the brightness of the background object 130 from a first brightness (e.g., 100%) in state 191 to a second brightness (e.g., 80%) less than the first brightness based on the display of the first foreground object 131. The second brightness may be related to the size of the first foreground object 131 (or the degree to which the background object 130 is covered) displayed through the display. The second brightness may be set independently of the attributes used by the wearable device 101 to display the first foreground object 141. For example, when switching from Figure 1 state 191 to state 192, the wearable device 101 may display the first foreground object 141 at another brightness different from the second brightness while changing the brightness of the background object 130 from the first brightness to the second brightness.

[0030] Referring to Figure 1 states 192 and 193, according to an embodiment, the wearable device 101 may change the brightness of the background object 130 based on the number of foreground objects displayed through the display. For example, the brightness of the background object 130 may be inversely proportional to the number of foreground objects. In Figure 1 state 192 in which the first foreground object 141 is displayed, the wearable device 101 may switch to state 193 in response to an event for displaying a second foreground object 142 distinguishable from the first foreground object 141. Although it is illustrated that in exemplary state 193 the wearable device 101 displays the second foreground object 142 as a widget in the form of a table based on the operation of a specified program such as a table application, the embodiment is not limited thereto.

[0031] Referring to Figure 1, when switching from state 192 to state 193, the wearable device 101 can recognize that the number of foreground objects superimposed on the background object 130 has increased. For example, when the state 192 of displaying one foreground object (e.g., the first foreground object 141) switches to the state 193 of displaying two foreground objects (e.g., the first foreground object 141 and the second foreground object 142), the wearable device 101 can adjust the brightness of the background object 130 based on the change in the number of foreground objects. In an embodiment, the wearable device 101 can use the number of foreground objects to change the brightness of the background object 130. For example, the brightness of the background object 130 can be inversely proportional to the number of foreground objects. When switching from the state 192 of displaying the background object 130 to the state 193, the wearable device 101 can change the brightness of the background object 130 from the second brightness to a third brightness less than the second brightness. The third brightness can be a preset brightness that matches the number of foreground objects (e.g., two) displayed by the wearable device 101 in state 193. Reference will be made to Figure 5a , Figure 5b , Figure 5c and Figure 5d to describe examples of operations of the wearable device 101 according to an embodiment to change the brightness of the background object 130 based on a change in the number of foreground objects included in the display.

[0032] Reference Figure 1 to states 192 and 194, according to an embodiment, the wearable device 101 can change the brightness of the background object 130 based on the size of the foreground objects displayed through the display. For example, the brightness of the background object 130 can be inversely proportional to the size of one or more foreground objects displayed through the display. In Figure 1 the state 192 of displaying the first foreground object 141 of the first size, the wearable device 101 can switch to the state 194 in response to an event for increasing the size of the first foreground object 141. In state 194, the wearable device 101 can display the first foreground object 141 having a second size greater than the first size.

[0033] Reference Figure 1, when switching from state 192 to state 194, the wearable device 101 can recognize that the size of the first foreground object 141 has increased. When switching from state 192 to state 194, the wearable device 101 can adjust the brightness of the first foreground object 141 based on the change in the size of the first foreground object 141. In an embodiment, the wearable device 101 can change the brightness of the background object 130 based on the size of the foreground object. The brightness of the background object 130 can be inversely proportional to the range occupied by one or more foreground objects in the display and / or inversely proportional to the ratio of the range. When switching from state 192 where the background object 130 is displayed to state 193, the wearable device 101 can change the brightness of the background object 130 from a second brightness to a fourth brightness less than the second brightness. The fourth brightness can be set independently of the third brightness of state 193. The fourth brightness can be a preset brightness that matches the size of the first foreground object 141 displayed by the wearable device 101 in state 194. Reference will be made to Figure 6 Describe an example of an operation in which the wearable device 101 changes the brightness of the background object 130 based on a change in the size of a foreground object included in the display according to an embodiment.

[0034] According to an embodiment, the wearable device 101 can play an audio signal based on the operation of an application (e.g., a background application) for displaying the background object 130. When playing the first audio signal corresponding to the background object 130, the wearable device 101 can change an attribute (e.g., volume, pitch, and / or sound speed) related to the first audio signal based on recognizing a second audio signal corresponding to at least one foreground object. The wearable device 101 can reduce the volume of the first audio signal to enable the user 110 to focus on the second audio signal. The wearable device 101 reducing the volume of the first audio signal can be performed while maintaining the volume of the second audio signal. For example, as the number of foreground objects displayed to the user 110 increases (e.g., sequential switching of states 191, 192, and 193), the wearable device 101 can gradually reduce the volume of the first audio signal. For example, as the size of the foreground objects displayed to the user 110 increases (e.g., sequential switching of states 191, 192, and 194), the wearable device 101 can gradually reduce the volume of the first audio signal.

[0035] Although the case where the number and / or size of the foreground objects increase since state 191 where only the background object 130 is displayed is described exemplarily, the embodiment is not limited thereto. According to an embodiment, the wearable device 101 can increase the brightness of the background object 130 and / or the volume of the audio signal corresponding to the background object 130 based on a decrease in the number and / or size of the foreground objects.

[0036] As described above, according to an embodiment, the wearable device 101 may change the attributes for displaying the background object 130 to keep the user 110 focused on at least one foreground object (e.g., the first foreground object 141 and / or the second foreground object 142). The wearable device 101 may change the attributes, such as states 192 and 194, based on the enlargement and / or reduction of the first foreground object 141. The wearable device 101 may change the attributes, such as states 192 and 193, based on the change in the number of foreground objects displayed through the display. The attributes for displaying the background object 130 may include attributes collectively applied to at least one virtual object classified as the background object 130, such as brightness and / or chromaticity. The attributes may include attributes for controlling the number and / or movement of the virtual objects included in the background object 130, such as particle density and / or particle velocity. When outputting an audio signal corresponding to the background object 130 (e.g., an audio signal synchronized with the background object 130), the wearable device 101 may adjust the attributes for playing the audio signal similarly to changing the attributes for displaying the background object 130. The attributes for playing the audio signal may include volume, pitch, and / or sound speed. For example, the wearable device 101 may change at least one attribute related to the background object 130 based on the movement of the user 110 acting on the wearable device 101 (e.g., the movement for controlling and / or changing the foreground object).

[0037] Hereinafter, reference will be made to Figure 2 Examples of one or more hardware included in the wearable device 101 according to an embodiment and / or software applications run by the wearable device 101 will be described.

[0038] Figure 2 An example of a block diagram of the wearable device 101 according to an embodiment is shown. Figure 2 The wearable device 101 may include Figure 1 The wearable device 101.

[0039] According to an embodiment, the wearable device 101 may include at least one of a processor 210, a memory 215, a display 220, a camera 225, a sensor 230, a speaker 240, or a communication circuit 245. The processor 210, the memory 215, the display 220, the camera 225, the sensor 230, the speaker 240, and the communication circuit 245 may be electronically and / or operably coupled to each other through an electronic component such as a communication bus 202. Hereinafter, operably coupled hardware may mean that a direct connection or an indirect connection between the hardware is established through a wired or wireless manner, such that the second hardware among the hardware is controlled by the first hardware. Although shown based on different blocks, the embodiment is not limited thereto, and Figure 2Part of the hardware (eg, processor 210, memory 215, and communication circuit 245) of the wearable device 101 may be included in a single integrated circuit, such as a system on a chip (SoC). The type and / or number of hardware included in the wearable device 101 is not limited to Figure 2 For example, the wearable device 101 may only include Figure 2 Some of the hardware components shown.

[0040] In an embodiment, the processor 210 of the wearable device 101 may include hardware for processing data based on one or more instructions. For example, the hardware for processing data may include an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The processor 210 may have a structure of a single-core processor, or may have a structure of a multi-core processor such as a dual-core, quad-core, or hexa-core processor.

[0041] In an embodiment, the memory 215 of the wearable device 101 may include a hardware component for storing data and / or instructions input and / or output to the processor 210 of the wearable device 101. For example, the memory 215 may include a volatile memory such as a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). For example, the volatile memory may include at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). For example, the non-volatile memory may include at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, an optical disk, a solid state drive (SSD), and an embedded multimedia card (eMMC).

[0042] In an embodiment, the display 220 of the wearable device 101 can display information to the user (e.g., Figure 1 The user 110) outputs visualization information (e.g., Figure 1 , Figure 5a , Figure 5b , Figure 5c , Figure 5d and Figure 6 For example, the display 220 may be controlled by the processor 210 including a circuit such as a graphics processing unit (GPU), and output visual information to the user. The display 220 may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LED may include an organic LED (OLED). Figure 2The display 220 may include at least one display 350, which will be described later with reference to Figures 3a to 3b and / or Figures 4a to 4b as follows.

[0043] In an embodiment, the camera 225 of the wearable device 101 may include one or more optical sensors (e.g., a charge-coupled device (CCD) sensor, a complementary metal-oxide semiconductor (CMOS) sensor) that generate an electrical signal indicating the color and / or brightness of light. The plurality of optical sensors included in the camera 225 may be arranged in a two-dimensional array. The camera 225 may substantially simultaneously obtain the electrical signals of each of the plurality of optical sensors and generate two-dimensional frame data corresponding to the light reaching the optical sensors arranged in a two-dimensional array. For example, the photo data captured using the camera 225 may refer to the two-dimensional frame data obtained from the camera 225. For example, the video data captured using the camera 225 may refer to a sequence of a plurality of two-dimensional frame data obtained from the camera 225 according to a frame rate. The camera 225 may be set to face the direction from which the camera 225 receives light, and may further include a flash for outputting light toward that direction. Although the camera 225 is shown as a single block, the number of cameras 225 included in the wearable device 101 is not limited to this embodiment. The wearable device 101 may include one or more cameras, such as one or more cameras 340, which will be described later with reference to Figures 3a to 3b and / or Figures 4a to 4b as follows.

[0044] According to an embodiment, the sensor 230 of the wearable device 101 may generate electronic information that can be processed by the processor 210 and / or the memory 215 of the wearable device 101 based on non-electronic information related to the wearable device 101. This information may be referred to as sensor data. The sensor 230 may include a global positioning system (GPS) sensor for detecting the geographical location of the wearable device 101, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor, and an inertial measurement unit (IMU) for detecting the physical movement of the wearable device 101.

[0045] In an embodiment, the speaker 240 of the wearable device 101 may be controlled by the processor 210 to output an audio signal. When outputting a plurality of audio signals through the speaker 240, the processor 210 may mix the plurality of audio signals by using an attribute corresponding to each of the plurality of audio signals. The processor (210) may manage the attributes corresponding to the audio signals based on a sound path. The attributes may include a volume as a parameter for controlling the amplitude of the audio signal, a tone for controlling the frequency of the audio signal, and / or a sound speed for controlling the speed at which the audio signal is played. Although shown as a single block, the wearable device 101 may include a plurality of speakers.

[0046] In an embodiment, the communication circuit 245 of the wearable device 101 may include hardware components for supporting the transmission and / or reception of electrical signals between the wearable device 101 and one or more external electronic devices. For example, the communication circuit 245 may include at least one of a modem, an antenna, and an optical / electrical (O / E) converter. The communication circuit 245 may support the transmission and / or reception of electrical signals based on various types of protocols such as Ethernet, local area network (LAN), wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G new radio (NR), and / or 6G.

[0047] Although not shown, according to an embodiment, the wearable device 101 may include an output device for outputting information in a form other than a visual form. For example, the wearable device 101 may include a motor for providing haptic feedback based on vibration.

[0048] Reference Figure 2 In an embodiment of, in the memory 215 of the wearable device 101, one or more instructions (or commands) indicating calculations and / or operations to be performed on data by the processor 210 of the wearable device 101 may be stored. A set of one or more instructions may be referred to as a program, firmware, operating system, process, routine, subroutine, and / or application. Hereinafter, installing an application in an electronic device (e.g., the wearable device 101) may mean that one or more instructions provided in the form of an application are stored in the memory 215, and one or more applications are stored in a format executable by a processor of the electronic device (e.g., a file having a preset extension of the operating system of the wearable device 101).

[0049] Reference Figure 2 Referring to, programs installed in the wearable device 101 may be classified into any one of different layers including an application layer 260, an architecture layer 270, and / or a hardware abstraction layer (HAL) 250 based on a target. For example, a program (e.g., a driver) designed for hardware of the wearable device 101 (e.g., a display 220, a camera 225, a sensor 230, and / or a speaker 240) may be classified into the hardware abstraction layer 250. For example, a program (e.g., a gaze tracker 271, a pose tracker 272, a motion tracker 273, an external space identifier 274, and / or a virtual space manager 275) designed for at least one of the hardware abstraction layer 250 and / or the application layer 260 may be classified into the architecture layer 270. Programs classified into the architecture layer 270 may provide an application programming interface (API) executable based on another program.

[0050] Reference Figure 2, a program designed to control a user of the wearable device 101 (e.g., Figure 1 user 110) can be classified into the application layer 260. For example, the programs classified into the application layer 260 may include at least one of a clock application 261 for outputting information about time (e.g., current time and / or alarm), a gallery application 262 for viewing media content stored in the memory 215, a phone application 263 for call connection, and / or a word processing application 264 for viewing and / or editing documents. The embodiments are not limited thereto. For example, a program classified as the application layer 260 can cause a function supported by a program classified as the architecture layer 270 to be executed by calling an API.

[0051] Reference Figure 2 , the wearable device 101 can process information related to the gaze of the user wearing the wearable device 101 based on the operation of the gaze tracker 271 in the architecture layer 270. For example, the wearable device 101 can obtain an image including the user's eyes from the camera 225. Based on the position and / or direction of the pupil included in the image, the wearable device 101 can identify the direction of the user's gaze.

[0052] Reference Figure 2 , the wearable device 101 can identify the movement of a specified body part including the hand based on the operation of the pose tracker 272 in the architecture layer 270. For example, the wearable device 101 can obtain a frame including the body part from the camera 225. Based on the movement and / or posture of the specified body part indicated by the frame, the wearable device 101 can identify the pose executed by the specified body part.

[0053] Reference Figure 2 , the wearable device 101 can identify the movement of the wearable device 101 based on the operation of the motion tracker 273 in the architecture layer 270. In a state where the wearable device 101 is worn by the user, the movement of the wearable device 101 can be related to the movement of the user's head. For example, the wearable device 101 can identify the direction of the wearable device 101 that substantially matches the direction of the head, such as Figure 1 direction D1. The wearable device 101 can identify the movement of the wearable device 101 based on the sensor data of the sensors 230 including the IMU.

[0054] Reference Figure 2 , the wearable device 101 can obtain information about the external space including or adjacent to the wearable device 101 based on the operation of the external space identifier 274 in the architecture layer 270. The wearable device 101 can use the camera 225 and / or the sensors 230 to obtain this information. Reference Figure 2, in a state where the external space identifier 274 is operating, the wearable device 101 can identify a virtual space mapped to the external space based on the information obtained through the external space identifier 274. Based on the operation of the external space identifier 274, the wearable device 101 can identify the position and / or orientation of the wearable device 101 within the external space. For example, based on the operation of the external space identifier 274 and / or the motion tracker 273, the wearable device 101 can perform Simultaneous Localization and Mapping (SLAM) to identify the external space and the position of the wearable device 101 within the external space.

[0055] According to an embodiment, the wearable device 101 can display the virtual space to be displayed through the display 220 based on the operation of the virtual space manager 275 (e.g., Figure 1 the virtual space 120). In a state where the virtual space manager 275 is operating, the wearable device 101 can set background objects in the virtual space (e.g., Figure 1 the background object 130). In a state where the virtual space manager 275 is operating, the wearable device 101 can set foreground objects provided by applications classified into the application layer 260 in the virtual space (e.g., Figure 1 the first foreground object 141 and / or the second foreground object 142).

[0056] In an embodiment, based on the operation of the virtual space manager 275, the wearable device 101 can render at least a part of the virtual space on the display 220. Based on the rendering, the wearable device 101 can display the background objects and / or foreground objects set in the virtual space. The wearable device 101 can select a perspective in the virtual space based on the orientation of the wearable device 101 identified according to the motion tracker 273. Based on the selected perspective, the wearable device 101 can perform rendering on at least a part of the virtual space. For example, the wearable device 101 can render at least a part of the background object included in the perspective based on at least one attribute corresponding to the background object. The at least one attribute can include brightness, chromaticity, particle density, and / or particle velocity. The wearable device 101 can adaptively change at least one attribute for rendering the background object based on the number and / or size of the foreground objects displayed through the display 220. The wearable device 101 can synchronize at least one attribute for rendering the background object with at least one attribute for controlling the speaker 240 and corresponding to the background object.

[0057] For example, based on the operation of the virtual space manager 275, the wearable device 101 may display a foreground object overlapping a background object with a first brightness on the display 220. Based on the operation of a process corresponding to the background object, the wearable device 101 may output an audio signal with a first volume through the speaker 240. The first brightness and the first volume may be included in a data set selected based on the size and / or number of the foreground object. An example of the specified data set will be described with reference to Tables 1 and 2 to be described below. According to an embodiment, based on recognizing that the size of the foreground object extends to be greater than the reference size range, the wearable device 101 may change the brightness of the background object to a second brightness less than the first brightness. Based on the extension of the size of the foreground object, the wearable device 101 may reduce the volume of the audio signal corresponding to the background object to a second volume lower than the first volume. Similarly, based on recognizing that the size of the foreground object decreases to be less than the reference size range, the wearable device 101 may change the brightness of the background object to a third brightness greater than the first brightness. Based on the reduction of the size of the foreground object, the wearable device 101 may change the volume of the audio signal corresponding to the background object to a third volume greater than the first volume. The reference size range may be related to the data set including the first brightness and the first volume. For example, each of the specified data sets may include a condition for applying the attributes included in the data set to the background object. The condition may be related to the size and / or number of the foreground object displayed through the display 220.

[0058] Similar to the operation of changing the brightness of the background object based on the change in the size of the foreground object, the wearable device 101 may change the brightness of the background object based on the number of foreground objects displayed through the display 220. For example, in a state where a background object with a first brightness and an audio signal with a first volume corresponding to the background object are output, the wearable device 101 may display one or more foreground objects overlapping the background object. The first brightness and / or the first volume may be set by a data set corresponding to the number of foreground objects displayed by the display 220 in this state. The wearable device 101 may recognize the number of one or more foreground objects based on at least one application. Based on recognizing that the number of one or more foreground objects increases, the wearable device 101 may change the brightness of the background object to a second brightness less than the first brightness. Based on the increase in the number of one or more foreground objects, the wearable device 101 may reduce the volume of the audio signal corresponding to the background object to a second volume lower than the first volume. Based on recognizing that the number of one or more foreground objects decreases, the wearable device 101 may change the brightness of the background object to a third brightness greater than the first brightness. Based on the decrease in the number of one or more foreground objects, the wearable device 101 may increase the volume of the audio signal corresponding to the background object to a third volume greater than the first volume.

[0059] As described above, according to an embodiment, the wearable device 101 may add and / or remove at least one foreground object in a virtual space based on at least one application run by the processor 210. While at least a part of the virtual space is displayed on the display 220 based on the orientation of the wearable device 101 tracked by the motion tracker 273, the wearable device 101 may change the at least a part displayed on the display 220. The change of at least a part of the virtual space by the wearable device 101 may be related to a parallel movement and / or a rotational movement of a perspective formed in the virtual space. The wearable device 101 may display an image of a background object surrounding at least one foreground object on the display 220 by using the background object included in the virtual space together with the at least one foreground object. The wearable device 101 may change an attribute for rendering the background object based on the size and / or number of at least one foreground object displayed through the display 220. For example, the attribute may be changed to emphasize at least one foreground object included in the display 220. For example, in order to emphasize at least one foreground object, the wearable device 101 may maintain an attribute (e.g., brightness) for rendering at least one foreground object regardless of changing an attribute for rendering the background object.

[0060] Hereinafter, Figures 3a to 3b and / or Figures 4a to 4b will be used to describe an example of a form factor of the wearable device 101 according to an embodiment.

[0061] Figure 3a An example of a perspective view of a wearable device according to an embodiment is shown. Figure 3b An example of one or more hardware components provided in the wearable device 300 according to an embodiment is shown. Figure 1 and Figure 2 The wearable device 101 of Figures 3a to 3b may include Figure 3a The wearable device 300 of

[0062] As shown, according to an embodiment, the wearable device 300 may include at least one display 350 and a frame supporting the at least one display 350. Figure 3b According to an embodiment, the wearable device 300 may be wearable on a part of a user's body. The wearable device 300 may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) combining augmented reality and virtual reality to a user wearing the wearable device 300. For example, the wearable device 300 may output a virtual reality image through at least one display 350 in response to a preset pose of the user obtained by the motion recognition camera 340-2 of

[0063] According to an embodiment, at least one display 350 in the wearable device 300 may provide visual information to a user. The at least one display 350 may include Figure 2 the display 220. For example, the at least one display 350 may include a transparent or translucent lens. The at least one display 350 may include a first display 350-1 and / or a second display 350-2 spaced apart from the first display 350-1. For example, the first display 350-1 and the second display 350-2 may be disposed at positions corresponding to the left and right eyes of the user, respectively.

[0064] Referring to Figure 3b , the at least one display 350 may form a display area on the lens to provide visual information included in the ambient light passing through the lens and other visual information different from the visual information to the user wearing the wearable device 300. The lens may be formed based on at least one of a fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by the at least one display 350 may be formed on the second surface 332 of the first surface 331 and the second surface 332 of the lens. When the user wears the wearable device 300, the ambient light may be transmitted to the user by being incident on the first surface 331 and penetrating the second surface 332. As another example, the at least one display 350 may display a virtual reality image to be combined with the real picture transmitted through the ambient light. The virtual reality image output from the at least one display 350 may be transmitted to the user's eyes through one or more hardware components (e.g., optical devices 382 and 384 and / or at least one waveguide 333 and 334) included in the wearable device 300.

[0065] According to an embodiment, the wearable device 300 may include waveguides 333 and 334 that transmit light transmitted from at least one display 350 and relayed by at least one optical device 382 and 384 through diffraction to a user. The waveguides 333 and 334 may be formed based on at least one of glass, plastic, or polymer. Nano-patterns may be formed on at least a part of the outside or inside of the waveguides 333 and 334. The nano-patterns may be formed based on a grating structure having a polygonal or curved shape. Light incident on one end of the waveguides 333 and 334 may propagate through the nano-patterns to the other end of the waveguides 333 and 334. The waveguides 333 and 334 may include at least one of at least one diffractive element (e.g., diffractive optical element (DOE), holographic optical element (HOE)) and a reflective element (e.g., a mirror). For example, the waveguides 333 and 334 may be disposed in the wearable device 300 to guide a screen displayed by at least one display 350 to a user's eyes. For example, the screen may be transmitted to the user's eyes through total internal reflection (TIR) generated in the waveguides 333 and 334.

[0066] According to an embodiment, the wearable device 300 may analyze an object included in a real image collected by the camera 340-1, combine it with a virtual object corresponding to the object among the analyzed objects that becomes an object for providing augmented reality, and display it on at least one display 350. The virtual object may include at least one of text and an image of various information associated with the object included in the real image. The wearable device 300 may analyze an object based on multiple cameras such as a stereo camera. Regarding object analysis, the wearable device 300 may perform time of flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multiple cameras. A user wearing the wearable device 300 may view an image displayed on at least one display 350.

[0067] According to an embodiment, the frame may be constructed by a physical structure through which the wearable device 300 can be worn on a user's body. According to an embodiment, the frame may be constructed such that when the user wears the wearable device 300, the first display 350-1 and the second display 350-2 may be positioned to correspond to the user's left eye and right eye. The frame may support at least one display 350. For example, the frame may support the first display 350-1 and the second display 350-2 to be positioned at positions corresponding to the user's left eye and right eye.

[0068] Reference Figure 3a, According to an embodiment, the frame may include an area 320 that at least partially contacts a part of the user's body when the user wears the wearable device 300. For example, the area 320 of the frame that contacts a part of the user's body may include an area that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that is in contact with the wearable device 300. According to an embodiment, the frame may include a nose pad 310 that contacts a part of the user's body. When the user wears the wearable device 300, the nose pad 310 may contact a part of the user's nose. The frame may include a first temple 304 and a second temple 305 that contact another part of the user's body that is different from the part of the user's body.

[0069] , According to an embodiment, the frame may include a first spectacle frame 301 that surrounds at least a part of the first display 350-1, a second spectacle frame 302 that surrounds at least a part of the second display 350-2, a bridge 303 disposed between the first spectacle frame 301 and the second spectacle frame 302, a first nose pad 311 disposed along a part of the edge of the first spectacle frame 301 from one end of the bridge 303, a second nose pad 312 disposed along a part of the edge of the second spectacle frame 302 from the other end of the bridge 303, a first temple 304 extending from the first spectacle frame 301 and fixed to a part of the wearer's ear, and a second temple 305 extending from the second spectacle frame 302 and fixed to a part of the ear opposite to that ear. The first nose pad 311 and the second nose pad 312 may contact a part of the user's nose, and the first temple 304 and the second temple 305 may contact a part of the user's face and a part of the user's ear. The temples 304 and 305 may be rotatably connected to the spectacle frames through Figure 3b hinge units 306 and 307. The first temple 304 may be rotatably connected to the first spectacle frame 301 relative to the first spectacle frame 301 through a first hinge unit 306 disposed between the first spectacle frame 301 and the first temple 304. The second temple 305 may be rotatably connected to the second spectacle frame 302 relative to the second spectacle frame 302 through a second hinge unit 307 disposed between the second spectacle frame 302 and the second temple 305. According to an embodiment, the wearable device 300 may identify an external object (e.g., the user's fingertip) that touches the frame and / or a gesture performed by the external object by using touch sensors, grip sensors, and / or proximity sensors formed on at least a part of the surface of the frame.

[0070] , According to an embodiment, the wearable device 300 may include hardware that performs various functions (e.g., as described above based on Figure 2(hardware described by the block diagram). For example, the hardware may include a battery module 370, an antenna module 375, optical devices 382 and 384, speakers 392-1 and 392-2, microphones 394-1, 394-2, and 394-3, a depth sensor module (not shown), and / or a printed circuit board 390. Various hardware may be disposed in the frame.

[0071] According to an embodiment, the microphones 394-1, 394-2, and 394-3 of the wearable device 300 may obtain sound signals by being disposed on at least a part of the frame. In Figure 3b FIG. 5, a first microphone 394-1 disposed on the nose pad 310, a second microphone 394-2 disposed on the second spectacle frame 302, and a third microphone 394-3 disposed on the first spectacle frame 301 are shown, but the number and arrangement of the microphones 394 are not limited to Figure 3b the embodiments shown. In a case where the number of microphones 394 included in the wearable device 300 is two or more, the wearable device 300 may identify the direction of a sound signal by using a plurality of microphones disposed on different parts of the frame.

[0072] According to an embodiment, the optical devices 382 and 384 may transmit a virtual object transmitted from at least one display 350 to the waveguides 333 and 334. For example, the optical devices 382 and 384 may be projectors. The optical devices 382 and 384 may be disposed adjacent to at least one display 350, or may be included as a part of at least one display 350 in at least one display 350. The first optical device 382 may correspond to the first display 350-1, and the second optical device 384 may correspond to the second display 350-2. The first optical device 382 may transmit the light output from the first display 350-1 to the first waveguide 333, and the second optical device 384 may transmit the light output from the second display 350-2 to the second waveguide 334.

[0073] In an embodiment, the camera 340 may include an eye-tracking camera (ET CAM) 340-1, a motion recognition camera 340-2, and / or a shooting camera 340-3. The shooting camera 340-3, the eye-tracking camera 340-1, and the motion recognition camera 340-2 may be disposed at different positions on the frame and may perform different functions. The shooting camera 340-3, the eye-tracking camera 340-1, and the motion recognition camera 340-2 may be Figure 2 examples of the camera 225. The eye-tracking camera 340-1 may output data indicating the gaze of a user wearing the wearable device 300. For example, the wearable device 300 may detect the gaze based on an image including the user's pupil obtained by the eye-tracking camera 340-1. In Figure 3bAn example is shown in which the eye tracking camera 340-1 is set to face the user's right eye, but the embodiment is not limited thereto, and the eye tracking camera 340-1 can be set to face the user's left eye alone or can be set to face both eyes.

[0074] In an embodiment, the capture camera 340-3 can capture a real image or background to be matched with a virtual image in order to implement augmented reality or mixed reality content. The capture camera can capture an image of a specific object existing at the position where the user is viewing, and can provide the image to at least one display 350. The at least one display 350 can display an image in which the virtual image provided through the optical devices 382 and 384 overlaps with information about the real image or background including the image of the specific object obtained by using the capture camera. In an embodiment, the capture camera can be disposed on the bridge 303 between the first spectacle frame 301 and the second spectacle frame 302.

[0075] In an embodiment, the eye tracking camera 340-1 can achieve more realistic augmented reality by tracking the gaze of the user wearing the wearable device 300 and matching the user's gaze with the visual information provided on at least one display 350. For example, when the user looks forward, the wearable device 300 can naturally display on at least one display 350 environmental information associated with in front of the user at the position where the user is located. The eye tracking camera 340-1 can be configured to capture an image of the user's pupil in order to determine the user's gaze. For example, the eye tracking camera 340-1 can receive gaze detection light reflected from the user's pupil, and can track the user's gaze based on the position and movement of the received gaze detection light. In an embodiment, the eye tracking camera 340-1 can be set at positions corresponding to the user's left and right eyes. For example, the eye tracking camera 340-1 can be set in the first spectacle frame 301 and / or the second spectacle frame 302 to face the direction where the user wearing the wearable device 300 is located.

[0076] The motion recognition camera 340-2 can provide a specific event to the screen provided on at least one display 350 by recognizing the movement of the whole or part of the user's body, such as the user's torso, hand or face. The motion recognition camera 340-2 can obtain a signal corresponding to the motion by recognizing the user's posture, and can provide a display corresponding to the signal to at least one display 350. The processor can recognize the signal corresponding to the operation, and can execute a preset function based on the recognition. In an embodiment, the motion recognition camera 340-2 can be set on the first spectacle frame 301 and / or the second spectacle frame 302.

[0077] According to an embodiment, the camera 340 included in the wearable device 300 is not limited to the above-described eye tracking camera 340-1 and motion recognition camera 340-2. For example, the wearable device 300 may identify an external object included in the FoV by using a capture camera 340-3 set with an FoV facing the user. The wearable device 300 may perform the identification of the external object based on sensors (such as a depth sensor and / or a time-of-flight (ToF) sensor) for identifying the distance between the wearable device 300 and the external object. The camera 340 set with the FoV may support an autofocus function and / or an optical image stabilization (OIS) function. For example, in order to obtain an image including the face of the user wearing the wearable device 300, the wearable device 300 may include a camera 340 (e.g., a face tracking (FT) camera) set with the face.

[0078] Although not shown, according to an embodiment, the wearable device 300 may further include a light source (e.g., an LED) that emits light toward an object (e.g., the user's eye, face, and / or an external object in the FoV) captured by using the camera 340. The light source may include an LED having an infrared wavelength. The light source may be disposed on at least one of the frame and the hinge units 306 and 307.

[0079] According to an embodiment, the battery module 370 may supply power to the electronic components of the wearable device 300. In an embodiment, the battery module 370 may be disposed in the first temple 304 and / or the second temple 305. For example, the battery module 370 may be a plurality of battery modules 370. The plurality of battery modules 370 may be respectively disposed on each of the first temple 304 and the second temple 305. In an embodiment, the battery module 370 may be disposed at an end of the first temple 304 and / or the second temple 305.

[0080] In an embodiment, the antenna module 375 may transmit a signal or power to the outside of the wearable device 300, or may receive a signal or power from the outside. The antenna module 375 may be electrically connected to and / or operably connected to a communication circuit (e.g., Figure 2 the communication circuit 245) in the wearable device 300. In an embodiment, the antenna module 375 may be disposed in the first temple 304 and / or the second temple 305. For example, the antenna module 375 may be disposed close to one surface of the first temple 304 and / or the second temple 305.

[0081] The speakers 392-1 and 392-2 can output sound signals to the outside of the wearable device 300. The sound output module can be referred to as a speaker. In an embodiment, the speakers 392-1 and 392-2 can be disposed in the first temple 304 and / or the second temple 305 so as to be disposed adjacent to the ears of the user wearing the wearable device 300. For example, the wearable device 300 can include a second speaker 392-2 disposed in the first temple 304 and adjacent to the user's left ear, and a first speaker 392-1 disposed in the second temple 305 and adjacent to the user's right ear.

[0082] The light-emitting module (not shown) can include at least one light-emitting element. The light-emitting module can emit light of a color corresponding to a specific state, or can emit light through an operation corresponding to a specific state, so as to visually provide information about a specific state of the wearable device 300 to the user. For example, when the wearable device 300 needs to be charged, it can emit red light repeatedly at a specified time. In an embodiment, the light-emitting module can be disposed on the first spectacle frame 301 and / or the second spectacle frame 302.

[0083] Reference Figure 3b , according to an embodiment, the wearable device 300 can include a printed circuit board (PCB) 390. The PCB 390 can be included in at least one of the first temple 304 or the second temple 305. The PCB 390 can include an interposer disposed between at least two sub-PCBs. On the PCB 390, one or more hardwares included in the wearable device 300 (for example, the hardwares shown by the blocks described above with reference to Figure 2 can be disposed. The wearable device 300 can include a flexible printed circuit board (FPCB) for interconnecting the hardwares.

[0084] According to an embodiment, the wearable device 300 can include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the wearable device 300 and / or the posture of the body part (for example, the head) of the user wearing the wearable device 300. Each of the gravity sensor and the acceleration sensor can measure the gravitational acceleration and / or the acceleration based on preset three-dimensional axes (for example, the x-axis, the y-axis, and the z-axis) perpendicular to each other. The gyro sensor can measure the angular velocity of each preset three-dimensional axis (for example, the x-axis, the y-axis, and the z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor can be referred to as an inertial measurement unit (IMU). According to an embodiment, the wearable device 300 can identify the movement and / or posture of the user performed to run or stop a specific function of the wearable device 300 based on the IMU.

[0085] Figures 4a to 4bShows an example of the exterior of a wearable device 400 according to an embodiment. Figure 1 and Figure 2 The wearable device 101 may include Figure 4a and Figure 4b The wearable device 400. According to an embodiment, an example of the exterior of the first surface 410 of the housing of the wearable device 400 may be shown in Figure 4a and an example of the exterior of the second surface 420 opposite to the first surface 410 may be shown in Figure 4b .

[0086] Referring to Figure 4a , according to an embodiment, the first surface 410 of the wearable device 400 may have a shape that can be attached to a body part of a user (e.g., the user's face). Although not shown, the wearable device 400 may further include a strap for fixing to a body part of the user and / or one or more temple arms (e.g., Figures 3a to 3b the first temple arm 304 and / or the second temple arm 305). A first display 350-1 for outputting an image to the left eye of the two eyes of the user and a second display 350-2 for outputting an image to the right eye of the two eyes of the user may be provided on the first surface 410. The wearable device 400 may further include a rubber or silicon filler formed on the first surface 410 for preventing or reducing interference of light different from the light emitted from the first display 350-1 and the second display 350-2 (e.g., ambient light).

[0087] According to an embodiment, the wearable device 400 may include cameras 440-3 and 440-4 for photographing and / or tracking the two eyes of the user adjacent to the first display 350-1 and the second display 350-2 respectively. The cameras 440-3 and 440-4 may be referred to as ET cameras. According to an embodiment, the wearable device 400 may include cameras 440-1 and 440-2 for photographing and / or recognizing the face of the user. The cameras 440-1 and 440-2 may be referred to as FT cameras.

[0088] Referring to Figure 4b , cameras (e.g., cameras 440-5, 440-6, 440-7, 440-8, 440-9 and 440-10) and / or sensors (e.g., depth sensor 430) for obtaining information associated with the external environment of the wearable device 400 may be provided on the Figure 4aOn the second surface 420 opposite the first surface 410. For example, cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10 may be disposed on the second surface 420 to identify external objects different from the wearable device 400. For example, by using cameras 440-9 and 440-10, the wearable device 400 may obtain images and / or videos to be transmitted to each of the user's two eyes. Camera 440-9 may be disposed on the second surface 420 of the wearable device 400 to obtain frames to be displayed through the second display 350-2 corresponding to the right eye among the two eyes. Camera 440-10 may be disposed on the second surface 420 of the wearable device 400 to obtain images to be displayed through the first display 350-1 corresponding to the left eye among the two eyes.

[0089] According to an embodiment, the wearable device 400 may include a depth sensor 430 disposed on the second surface 420 to identify the distance between the wearable device 400 and an external object. By using the depth sensor 430, the wearable device 400 may obtain spatial information (e.g., a depth map) of at least a part of the FoV of the user wearing the wearable device 400.

[0090] Although not shown, a microphone for obtaining sound output from an external object may be disposed on the second surface 420 of the wearable device 400. According to an embodiment, the number of microphones may be one or more.

[0091] As described above, according to an embodiment, the wearable device 400 may have a form factor for being worn on the user's head. In a state of being worn on the head, the wearable device 400 may provide a user experience based on AR and / or MR. The wearable device 400 may display background objects by using the first display 350-1 and the second display 350-2. The wearable device 400 may display at least one foreground object provided from at least one application together with the background objects. When the at least one foreground object is displayed overlapping the background objects, the wearable device 400 may change the attributes for displaying the background objects based on the size and / or number of the at least one foreground object.

[0092] Hereinafter, a wearable device 300 including Figures 3a to 3b and / or Figures 4a to 4b a wearable device 400 including Figures 1 to 2 a wearable device 101, for example

[0093] Figure 5a , Figure 5b ,Figure 5c and Figure 5d illustrates an example of the operation of the wearable device 101 according to an embodiment to change the background object. Figure 1 and Figure 2 The wearable device 101 may include Figure 5a , Figure 5b , Figure 5c and Figure 5d The wearable device 101. For example, with reference to Figure 5a , Figure 5b , Figure 5c and Figure 5d The operation of the wearable device 101 described can be executed by Figure 2 The wearable device 101 and / or the processor 210.

[0094] With reference to Figure 5a , it illustrates an exemplary state 501 of the background object displayed by the wearable device 101 according to an embodiment on a display (e.g., Figure 2 The display 220 and / or with reference to Figures 3a to 4b At least one display 350 described). The background object may be Figure 1 An example of the background object 130. In the state where the user 110 wears the wearable device 101, the wearable device 101 may display at least a part of the background object in the display area 510 formed by the display. For example, the wearable device 101 may display a virtual object 530 representing a rigid body as the background object. The wearable device 101 may provide a sense of distance to the user 110 relative to the virtual object 530 using the depth value based on the z-axis shown in Figure 5a And / or binocular parallax. For example, the wearable device 101 may adjust the positions of the virtual object 530 visible to each of the two eyes of the user to have a deviation based on binocular parallax. The virtual object displayed as the background object by the wearable device 101 is not limited to the virtual object 530 having a form such as a rigid body. For example, the wearable device 101 may display virtual objects representing a natural environment such as clouds and / or the sun as the background object, such as Figure 1 The virtual objects 131 and 132.

[0095] With reference to Figure 5a , according to an embodiment, the wearable device 101 may display particles 520 as the background object. Based on the movement of the particles 520, the wearable device 101 may play for the user 110 related to a virtual space including the background object (e.g., Figure 1Dynamic animations related to the virtual space 120). The particles 520 may move in the display area 510 along a specified direction (e.g., the -y direction). The embodiment is not limited thereto, and the particles 520 may move in the display area 510 along a direction related to the movement of the user 110 wearing the wearable device 101. The particles 520 may be set in the virtual space based on a background application that is run for displaying the background object. The particles 520 may have a shape for representing weather information (e.g., snowflakes, raindrops, and / or fallen leaves). The particles 520 may have a shape for representing a light source.

[0096] According to an embodiment, the wearable device 101 may perform rendering on at least a part of the background object based on a perspective that matches the display area 510 in the virtual space. The wearable device 101 may identify at least one attribute assigned to the background object for rendering. The at least one attribute may include the brightness of the background object. The at least one attribute may include at least one parameter related to the visibility of the background object, such as chroma, brightness, and / or transparency. The at least one attribute as a parameter for rendering the particles 520 may include particle density, particle velocity, particle resolution, and / or particle type. According to an embodiment, the wearable device 101 may change the at least one attribute based on the range of the background object exposed to the user 110 through the display area 510 and / or the size of the foreground object overlapping with the background object in the display area 510. Based on the changed at least one attribute, the wearable device 101 may perform rendering on the background object. For example, the wearable device 101 may change the background object based on the change in the number and / or size of the foreground objects included in the display area 510.

[0097] In an embodiment, the attributes used by the wearable device 101 for rendering the background object may be grouped into different data sets, as shown in Table 1.

[0098] [Table 1]

[0099] Referring to Table 1, the first data set may indicate a state in which the background object and / or the audio signal corresponding to the background object are completely output (e.g., Figure 5a state 501 and / or Figure 1Attributes corresponding to the background object and / or audio signal in the state 191). For example, the first data set in Table 1 may include a state (e.g., an idle state) where the wearable device 101 does not display any foreground objects in the display area 510, such as state 501. According to an embodiment, the wearable device 101 may select any one of the specified data sets in Table 1 based on the number and / or size of one or more foreground objects included in the display area 510. The wearable device 101 may adjust the brightness of the background object or play an audio signal corresponding to the background object based on the selected data set.

[0100] According to an embodiment, the wearable device 101 may select a data set to be applied as the background object among the data sets in Table 1 based on the number of foreground objects included in the display. For example, when the number of foreground objects is one, the wearable device 101 may select the second data set in Table 1. For example, when the number of foreground objects is two, the wearable device 101 may select the third data set in Table 1. For example, when the number of foreground objects is greater than three, the wearable device 101 may select the fourth data set in Table 1. Based on the selected data set, the wearable device 101 may perform rendering on the background object. When playing an audio signal corresponding to the background object, the wearable device 101 may change the attributes related to the audio signal based on the selected data signal.

[0101] Reference Figure 5b , according to an embodiment, shows an exemplary state 502 where the wearable device 101 displays the weather widget 540 as a foreground object that at least partially overlaps the background object. For example, the wearable device 101 may add a virtual object corresponding to the weather widget 540 to the virtual space based on the operation of an application (e.g., a weather application). According to an embodiment, the wearable device 101 may recognize that the weather widget 540 is additionally displayed when switching from state 501 to state 502. In state 502 where one foreground object (such as the weather widget 540) is displayed, the wearable device 101 may display the background object based on the second data set in Table 1. For example, the wearable device 101 may adjust the brightness of the background object to 80% and adjust the moving speed of the particle 520 to 50%. For example, when switching from state 501 to state 502, the wearable device 101 may reduce the brightness of the background object and the moving speed of the particle 520. Similarly, when changing from state 502 to state 501 based on the stop and / or termination of the application corresponding to the weather widget 540, the wearable device 101 may increase the brightness of the background object and the moving speed of the particle 520.

[0102] According to an embodiment, the wearable device 101 may manage audio signals of different applications and / or processes based on different sound paths. A sound path may be a unit for classifying audio data of an application running on a processor (e.g., Figure 2 the processor 210) of the wearable device 101 toward a speaker (e.g., Figure 2 the speaker 240) of the wearable device 101. The wearable device 101 may manage the playback of audio data by using attributes assigned to each sound path. The attributes may include at least one of volume, pitch, and / or sound speed in Table 1.

[0103] Refer to Figure 5b , in the state 502 of displaying a foreground object (e.g., the weather widget 540), the wearable device 101 according to an embodiment may control a sound path corresponding to a background object based on the attributes included in the second data set of Table 1. Controlling the sound path by the wearable device 101 may include operations of controlling a speaker and / or changing an attribute based on the attribute corresponding to the sound path. For example, when an audio signal is provided from an application corresponding to the weather widget 540 and the audio signal does not stop the playback of another audio signal, the wearable device 101 may change the volume of the audio signal corresponding to the background object to 50% based on the second data set of Table 1. For example, when an audio signal is provided from an application corresponding to the weather widget 540 and the audio signal is set to stop the playback of another audio signal, the wearable device 101 may change the volume of the audio signal corresponding to the background object to 0% based on the second data set of Table 1. Changing the volume of the audio signal corresponding to the background object by the wearable device 101 may be performed in response to an input for selecting the foreground object included in the display area 510.

[0104] Refer to Figure 5c , according to an embodiment, an exemplary state 503 of the wearable device 101 displaying two foreground objects (e.g., the weather widget 540 and the message window 550) is shown. In the state 503, the wearable device 101 may display the message window 550 on the display area 510 based on the operation of the message application. In the message window 550, the wearable device 101 may visualize information related to the message application. The message window 550 may be set in a virtual space toward a point (e.g., Figure 1 the point O') matching the wearable device 101. For example, the direction of the normal line of the message window 550 in the virtual space may point to the point matching the wearable device 101.

[0105] As Figure 5cAs shown, in state 503 where two foreground objects are displayed, the wearable device 101 can perform rendering on the background object based on the third data set in Table 1. For example, the wearable device 101 can adjust the brightness of the background object to 40% and adjust the chroma of the background object to 50%. The wearable device 101 can stop displaying the particles 520 displayed in states 501 and 502 by adjusting the particle density to 0%. By at least temporarily stopping the rendering of the particles 520, the wearable device 101 can use the resources of the wearable device 101 occupied for rendering the particles 520 to perform functions related to the foreground object. For example, the wearable device 101 can reduce the degree of resources of the wearable device 101 occupied for the background object in proportion to the number of foreground objects.

[0106] According to an embodiment, in state 503, the wearable device 101 can apply a vignetting effect with a size of 80% to the background object based on the third data set in Table 1. Based on the vignetting effect, the brightness of a part of the background object surrounding the foreground object included in the display area 510 can be darker than the brightness of another part of the background object spaced apart from the foreground object. Based on the vignetting effect, the wearable device 101 can make the brightness of the part of the background object relatively closer to the foreground object darker than other parts. Reference will be made to Figure 6 Describe the operation of partially changing the brightness of the background object based on the vignetting effect.

[0107] In Figure 5c state 503, the wearable device 101 can change the attributes of the audio signal corresponding to the background object based on the third data set in Table 1. For example, in a state where mixing of multiple audio signals is allowed, the wearable device 101 can change the volume of the audio signal corresponding to the background object to 5%. In this example, the wearable device 101 can change the pitch of the audio signal corresponding to the background object to 5%. In this example, the wearable device 101 can change the sound speed of the audio signal corresponding to the background object to 25%. For example, when the speaker of the wearable device 101 is exclusively used based on at least one of the running foreground objects in state 503, the wearable device 101 can change the volume of the audio signal corresponding to the background object to 0%.

[0108] Reference Figure 5d , shows state 504 where the wearable device 101 runs an application that occupies the entire display area 510 according to an embodiment. For example, the wearable device 101 can display a foreground object that covers the entire background object based on the running of a game application. For example, the wearable device 101 can replace the virtual space including the background object with another virtual space provided by the game application based on the running of the game application.

[0109] According to an embodiment, in state 504 where the foreground object is displayed over the entire display area 510, the wearable device 101 may change at least one attribute assigned to the background object based on the fourth data set in Table 1. The wearable device 101 may change the brightness and / or chromaticity of the background object to 0%. The wearable device 101 may change the density and / or velocity of the particles included in the background object to 0%. For example, the wearable device 101 may completely stop rendering the background object. The wearable device 101 may change the volume, pitch, and / or sound speed of the audio signal corresponding to the background object to 0% based on the fourth data set. For example, in state 504, the wearable device 101 may stop playing the audio signal corresponding to the background object.

[0110] In Figures 5b to 5d states 502, 503, and 504, the wearable device 101 may maintain the attributes for rendering the foreground object while rendering the background object based on different data sets in Table 1. The wearable device 101 may maintain the brightness of the foreground object while changing the brightness of the background object among states 502, 503, and 504. Since the brightness of the foreground object is maintained and the brightness of the background object is selectively darkened, the wearable device 101 may emphasize at least one foreground object (e.g., weather widget 540 and / or message window 550) included in the display area 510 in states 502, 503, and 504.

[0111] As described above, according to an embodiment, the wearable device 101 may select any one of the specified data sets in Table 1 based on the number of foreground objects included in the display area 510, and perform rendering on the background object displayed outside the foreground object based on the selected data set. For example, to emphasize the foreground object, the wearable device 101 may change the attributes for rendering the background object. When switching from state 501 to state 504, the wearable device 101 may gradually reduce the brightness and / or chromaticity of the background object based on an increase in the number of foreground objects included in the display area 510, thereby improving the visibility of the foreground object. In addition to improving the visibility of the foreground object, the wearable device 101 may gradually reduce the volume of the audio signal corresponding to the background object, thereby emphasizing another audio signal that matches the foreground object.

[0112] Although the operation of the wearable device 101 performing rendering on the background object based on Table 1 has been described, the embodiment is not limited thereto. For example, the wearable device 101 may select any one of the data sets in Table 2 based on the number and / or size of the foreground objects included in the display area 510, and perform rendering on the background object based on the selected data set.

[0113] [Table 2]

[0114] Referring to Table 2, the wearable device 101 can perform rendering on the background object based on the a - dataset of Table 2 when the wearable device 101 is in a state where it does not display any foreground object in the display area 510, such as an idle state (e.g., Figure 5a state 501 and / or Figure 1 state 191). In the idle state, when a foreground object is added (e.g., Figure 5b state 502), the wearable device 101 can perform rendering on the background object based on the b - dataset of Table 2. When the dataset applied to the background object is switched from the a - dataset to the b - dataset of Table 2, the wearable device 101 can reduce the brightness of the background object from 100% to 40%.

[0115] According to an embodiment, the wearable device 101 can reduce the volume of the audio signal corresponding to the background object based on whether the foreground object playing the audio signal is the focus. For example, in Figure 5b state 502, the wearable device 101 that performs rendering on the background object based on the b - dataset of Table 2 can recognize an input for selecting and / or focusing on the weather widget 540. Based on recognizing the audio signal corresponding to the weather widget 540, the wearable device 101 can reduce the volume of the audio signal corresponding to the background object from 50% of the b - dataset to 25%.

[0116] In an embodiment where any one of the datasets in Table 2 is applied, the wearable device 101 can change the dataset such that the brightness of the background object decreases as the number and / or size of the foreground objects increases. When switching from state 502 where the background object is rendered using the b - dataset to state 503 where the message window 550 is additionally running, the wearable device 101 can switch from the b - dataset of Table 2 to select the c - dataset. Based on rendering the background object using the selected c - dataset, the wearable device 101 can reduce the brightness of the background object from 40% to 20%. When the number of foreground objects increases or the size of the foreground objects in the display area 510 increases after Figure 5b state 503, the wearable device 101 can reduce the brightness of the background object to be less than that of the c - dataset. The embodiment is not limited to this, and the wearable device 101 can reduce the chromaticity, particle density, and / or particle velocity of the background object, or increase the vignetting effect. Figure 5c

[0117] Figure 5d In an embodiment where any one of the datasets in Table 2 is applied, in the case where the background object is completely covered (e.g., Figure 5dIn the state 504), the wearable device 101 can at least temporarily stop rendering the background object based on the d-th data set in Table 2. Although operations where the number and / or size of the foreground object increase have been described, the embodiments are not limited thereto. For example, when the number and / or size of the foreground object decrease, the wearable device 101 can select any one of the data sets in Table 2, thereby gradually increasing the brightness and / or chromaticity of the background object.

[0118] In an embodiment, the wearable device 101 can change the attributes used to render the background object based on the size of the foreground object in the display area 510. Hereinafter, examples of operations of the wearable device 101 changing a set (e.g., a data set) of attributes applied to the rendering of the background object based on the size of one or more foreground objects will be described. Figure 6 Examples of operations of the wearable device 101 changing a set (e.g., a data set) of attributes applied to the rendering of the background object based on the size of one or more foreground objects will be described.

[0119] Figure 6 An example of an operation of the wearable device 101 changing at least a part of the background object based on the position and / or size of the foreground object 610 according to an embodiment is shown. Figure 1 and Figure 2 The wearable device 101 can include Figure 6 The wearable device 101. Referring to Figure 6 The operations of the wearable device 101 described can be performed by Figure 2 The wearable device 101 and / or the processor 210.

[0120] Referring to Figure 6 , different states 601 and 602 of the foreground object 610 displayed by the wearable device 101 according to an embodiment are shown. The foreground object 610 can include a window and / or a widget provided by an application running on the wearable device 101. The wearable device 101 can arrange the foreground object 610 together with the background object 130 in the virtual space 120. Figure 6 The states 601 and 602 can be exemplary states where the wearable device 101 displays a part of the virtual space 120 based on perspectives facing different directions D1' and D2'. The directions D1' and D2' can be related to the movement of the user 110 (e.g., the movement of the head of the user 110 wearing the wearable device 101) recognized by a sensor of the wearable device 101 (e.g., Figure 2 The sensor 230).

[0121] According to an embodiment, the wearable device 101 may select a data set to be applied to the background object from the data sets in Table 1 to Table 2 based on the size of one or more foreground objects included in the display area. For example, when the ratio between the size of one or more foreground objects and the size of the display area is less than a first specified ratio, the wearable device 101 may perform rendering on the background object based on the first data set in Table 1. For example, when the ratio is greater than or equal to the first specified ratio and less than a second specified ratio greater than the first specified ratio, the wearable device 101 may perform rendering on the background object based on the second data set in Table 1. For example, when the ratio is greater than or equal to the second specified ratio and less than a third specified ratio greater than the second specified ratio, the wearable device 101 may perform rendering on the background object based on the third data set in Table 1. For example, when the ratio is greater than or equal to the third specified ratio, the wearable device 101 may perform rendering on the background object based on the fourth data set in Table 1. The above first specified ratio to fourth specified ratio may be referred to as threshold ratios. According to the above first specified ratio to fourth specified ratio, the ratio of the size of the foreground object occupying the display area may be divided into different size ranges. The size range may be formed between the first specified ratio and the fourth specified ratio.

[0122] In Figure 6 state 601, the wearable device 101 may select a set of attributes for rendering the background object from the specified data sets in Table 1 and Table 2 based on the ratio of the foreground object 610 occupying the display area. The wearable device 101 may reduce the brightness of the background object to be less than the brightness of the foreground object 610 while maintaining the brightness of the foreground object 610. Since the brightness of the background object is reduced, the wearable device 101 may emphasize the display of the foreground object 610. When outputting an audio signal provided by the background object, the wearable device 101 may reduce the volume of the audio signal in proportion to the ratio of the foreground object 610 occupying the display area. When the foreground object 610 is in focus, the wearable device 101 may additionally reduce the volume of the audio signal corresponding to the background object.

[0123] According to an embodiment, the wearable device 101 may change the brightness of the background object based on a change in the size of the displayed foreground object 610. For example, in response to a change in the viewing angle caused by the movement detected by the wearable device 101, or an input for changing the size and / or number of the foreground object 610, the wearable device 101 may identify a change in the size of the displayed foreground object 610. For example, the wearable device 101 may identify that the size of the background object covered by the foreground object 610 has changed. Based on the change in the size of the displayed foreground object 610, the wearable device 101 may change the brightness of the background object. For example, the wearable device 101 may change the brightness of the background object such that the brightness of the background object is inversely proportional to the size. The embodiment is not limited thereto, and the wearable device 101 may change the chromaticity, particle density, and / or particle velocity of the background object based on the change in the size.

[0124] Reference Figure 6 , in the state 601 of displaying the foreground object 610 based on the viewing angle formed along the direction D1', the wearable device 101 may identify the movement in which the wearable device 101 has rotated by an angle Q. The movement may be generated by the user 110 wearing the wearable device 101. Based on the movement, the wearable device 101 may form a viewing angle along the direction D2' that differs from the direction D1' by the angle Q in the virtual space 120. Based on the viewing angle formed along the direction D2', the wearable device 101 may perform rendering on at least a part of the virtual space 120 in the display area.

[0125] Reference Figure 6 , according to an embodiment, a state 602 in which the wearable device 101 performs rendering on at least a part of the virtual space 120 based on the viewing angle formed along the direction D2' is shown. In the state 602, the wearable device 101 may change the brightness of the background object based on a change in the size of the foreground object 610 included in the display area. For example, the wearable device 101 may select any one of the data sets in the data sets from Table 1 to Table 2 based on the changed size and the ratio of the display area.

[0126] According to an embodiment, based on the distance between each different part of the background object and the foreground object 610, the wearable device 101 may change the brightness of each part differently. Referring to the state 602, the wearable device 101 may reduce the brightness of the first section L1 of the background object spaced apart from the foreground object 610 to be less than the brightness of the second section L2 spaced apart from the foreground object 610 farther than the first section L1. The wearable device 101 may apply a vignetting effect around the foreground object 610 by adjusting the brightness of different parts of the background object to be inversely proportional to the distance spaced apart from the foreground object 610.

[0127] As described above, the wearable device 101 according to an embodiment may change the brightness of a background object observed around a foreground object 610 based on the size of the foreground object 610 observed through a display area. The wearable device 101 may enhance the visibility of the foreground object 610 by making a part of the background object adjacent to the foreground object 610 darker than other parts of the background object.

[0128] Hereinafter, the operation of the wearable device 101 according to an embodiment will be described based on Figure 7 a flowchart.

[0129] Figure 7 An example of a flowchart of a wearable device according to an embodiment is shown. Figure 1 and Figure 2 the wearable device 101 may include Figure 7 a wearable device. Figure 7 The operation may be performed by Figure 2 the wearable device 101 and / or the processor 210.

[0130] Referring to Figure 7 , in operation 710, the wearable device according to an embodiment may overlappedly display one or more foreground objects on a background object (e.g., Figure 1 the background object 130). The wearable device may display the background object and one or more foreground objects based on a viewing angle formed in a virtual space (e.g., Figure 1 the virtual space 120). The wearable device may select at least one property (e.g., brightness, chromaticity, lightness, particle density, and / or particle velocity) related to the rendering of the background object based on the size and / or number of one or more foreground objects displayed on a display (e.g., Figure 2 the display 220).

[0131] Referring to Figure 7 , in operation 720, the wearable device according to an embodiment may identify whether the size and / or number of one or more foreground objects changes. Before the size and / or number of one or more foreground objects changes (720 - No), the wearable device may maintain the display of the background object and one or more foreground objects based on operation 710. For example, the wearable device may maintain the brightness of the background object.

[0132] In a state where the size and / or number of one or more foreground objects is / are changed (720 - Yes), the wearable device may, by performing operation 730, change at least one property for outputting a background object based on the size and / or number of the one or more foreground objects. The wearable device may change a property to be applied to the rendering of the background object among the specified data sets (e.g., the specified data sets in Table 1 and / or Table 2) based on the changed size and / or the changed number. The wearable device may change the property for rendering the background object of operation 710 based on operation 730.

[0133] Reference Figure 7 , in operation 740, the wearable device according to an embodiment may display at least a part of the background object based on the changed property. According to an embodiment, the wearable device may change the brightness and / or chromaticity of the background object based on the property selected by the change in the size and / or number of one or more foreground objects. When playing an audio signal corresponding to the background object, the wearable device may change the volume, pitch, and / or sound speed of the audio signal based on the selected property.

[0134] As described above, the wearable device according to an embodiment may change at least one property (e.g., brightness, chromaticity, particle density, particle velocity, volume, pitch, and / or sound speed) for outputting a background object based on the relationship between the background object included in the display and the foreground object overlapping the background object. For example, the wearable device may select any one set among the specified property sets (e.g., the data sets in Table 1 and / or Table 2) based on the size and / or number of one or more foreground objects overlapping the background object, and change the background object displayed on the display based on the selected set. For example, in order to emphasize the foreground object, the wearable device may reduce the brightness of the background object as the size and / or number of the foreground object increases.

[0135] According to an embodiment, a wearable device may change at least one property (e.g., brightness, chromaticity, particle density, particle velocity, volume, pitch, and / or sound velocity) for outputting a background object based on the position of the background object included in a display (e.g., the center position of the background object, the corner position of the background object, and / or the vertex position of the background object) and the position of a foreground object (e.g., the center position of the foreground object, the corner position of the foreground object, and / or the vertex position of the foreground object). For example, the wearable device may reduce the brightness of the background object based on identifying that the distance between the center position of the background object included in the display and the center position of the foreground object is less than a specified distance. The embodiment is not limited thereto, and the position of the background object may be included in or stored in information (e.g., a file) for rendering the background object. The position of the foreground object may be included in or stored in information (e.g., a file) for running an application and / or program for displaying the foreground object that is run by the wearable device.

[0136] The operation of the wearable device described above with reference to Figures 1 to 7 may be related to a metaverse service provided via a network. Hereinafter, an example of a metaverse service provided to a user based on the wearable device will be described with reference to Figure 8 an embodiment.

[0137] Metaverse is a compound word of the English word "Meta" meaning "virtual" and "beyond" and the English word "Universe" meaning "universe", and refers to a three-dimensional virtual world where social, economic, and cultural activities occur like in the real world. The metaverse is a concept that has advanced further than virtual reality (VR, a cutting-edge technology that enables people to experience real-life experiences in a virtual world created by a computer), and is characterized by using avatars to enjoy not only games or virtual reality but also social and cultural activities like in the real world. The metaverse service may provide media content for enhancing immersion in the virtual world based on augmented reality (AR), virtual reality environment (VR), mixed reality (MR), and / or extended reality (XR).

[0138] For example, the media content provided by the metaverse service may include social interaction content, which includes avatar-based games, concerts, parties, and / or meetings. For example, the media content may include information for economic activities, such as advertisements, user-created content, and / or sales and / or shopping of products. The ownership of user-created content may be proven by blockchain-based non-fungible tokens (NFTs). The metaverse service may support economic activities based on real currency and / or cryptocurrency. Through the metaverse service, virtual content associated with the real world, such as digital twins or life logging, may be provided.

[0139] Figure 8 This is an example diagram of a network environment that provides a metaverse service through a server.

[0140] Reference Figure 8 , the network environment 801 may include a server 810, user terminals 820 (e.g., a first terminal 820-1 and a second terminal 820-2), and a network connecting the server 810 and the user terminals 820. In the network environment 801, the server 810 may provide a metaverse service to the user terminals 820. The network may be formed by at least one intermediate node 830 including an access point (AP) and / or a base station. The user terminals 820 may access the server 810 through the network and output a user interface (UI) associated with the metaverse service to the users of the user terminals 820. Based on the UI, the user terminals 820 may obtain information to be input into the metaverse service from the users or output information (e.g., multimedia content) associated with the metaverse service to the users.

[0141] In this case, the server 810 provides a virtual space such that the user terminals 820 may perform activities in the virtual space. Additionally, the user terminals 820 may present the information provided by the server 810 to the users by installing an S / W agent to access the virtual space provided by the server 810, or send the information that the users want to present in the virtual space to the server. The S / W agent may be provided directly by the server 810, downloaded from a public server, or embedded and provided when purchasing the terminal.

[0142] In an embodiment, the metaverse service may be provided to the user terminals 820 and / or users by using the server 810. The embodiment is not limited thereto, and the metaverse service may be provided through individual connections between users. For example, in the network environment 801, the metaverse service may be provided independently of the server 810 through a direct connection between the first terminal 820-1 and the second terminal 820-2. Reference Figure 8 , in the network environment 801, the first terminal 820-1 and the second terminal 820-2 may be connected to each other through a network formed by at least one intermediate node 830. In an embodiment where the first terminal 820-1 and the second terminal 820-2 are directly connected, either the first terminal 820-1 or the second terminal 820-2 may perform the role of the server 810. For example, the metaverse environment may be configured only in a device-to-device connection (e.g., a peer-to-peer (P2P) connection).

[0143] In an embodiment, the user terminal 820 (or the user terminal 820 including the first terminal 820-1 and the second terminal 820-2) can be made in various form factors and is characterized by including an output device for providing an image and / or sound to the user and an input device for inputting information into the metaverse service. Exemplary user terminals 820 in various form factors can include a smart phone (e.g., the second terminal 820-2), an AR device (e.g., the first terminal 820-1), a VR device, an MR device, a video see-through (VST) device, an optical see-through (OST) device, a smart lens, a smart mirror, a TV or a projector capable of input and output.

[0144] The network (e.g., the network formed by at least one intermediate node 830) includes all various broadband networks (including 3G, 4G, and 5G) and short-distance networks (e.g., a wired or wireless network that directly connects the first terminal 820-1 and the second terminal 820-2) (including Wi-Fi and BT).

[0145] In an embodiment, Figure 8 the user terminal 820 may include Figures 1 to 7 the wearable device 101.

[0146] In an embodiment, in a state where a background object and a foreground object overlapping the background object are displayed on a display of a wearable device, a method for emphasizing the foreground object may be required. As described above, according to an embodiment, the wearable device (e.g., Figures 1 to 2 the wearable device 101) may include a display (e.g., Figure 2 the display 220), a memory for storing instructions (e.g., Figure 2 the memory 215), and a processor (e.g., Figure 2 the processor 210). When the instructions are executed by the processor, the wearable device may overlappedly display a foreground object on a background object having a first brightness (e.g., Figure 1 the background object 130) on the display. When the instructions are executed by the processor, the wearable device may change the brightness of the background object to a second brightness less than the first brightness based on recognizing that the size of the foreground object extends to be greater than a reference size range. According to an embodiment, the wearable device may emphasize one or more foreground objects by changing an attribute (e.g., the brightness of the background object) for displaying the background object based on the size and / or number of one or more foreground objects included in the display.

[0147] According to an embodiment, a wearable device may include a display, a memory storing instructions, and a processor. When executed by the processor, the instructions may cause the wearable device to display a foreground object overlapping a background object having a first brightness on the display. When executed by the processor, the instructions may cause the wearable device to change the brightness of the background object from the first brightness to a second brightness less than the first brightness based on recognizing that at least a portion of the display occupied by the foreground object has increased in size.

[0148] For example, the wearable device may include a speaker (e.g., Figure 2 speaker 240). When executed by the processor, the instructions may cause the wearable device to output an audio signal having a first volume corresponding to a reference size range through the speaker based on the operation of a process corresponding to the background object.

[0149] For example, when executed by the processor, the instructions may cause the wearable device to display the background object on the display by running a process different from the process run to display the foreground object, and output an audio signal having a first volume corresponding to a reference size range through the speaker.

[0150] For example, when executed by the processor, the instructions may cause the wearable device to change the first volume of the audio signal to a second volume less than the first volume based on recognizing that the size of the foreground object has expanded to be greater than the reference size range. When executed by the processor, the instructions may cause the wearable device to change the first volume of the audio signal to a third volume greater than the first volume based on recognizing that the size of the foreground object has decreased to be less than the reference size range.

[0151] For example, when executed by the processor, the instructions may cause the wearable device, in a state of outputting an audio signal as a first audio signal, in response to an input for focusing on the foreground object, to change the first volume of the first audio signal to a second volume lower than the first volume based on recognizing a second audio signal corresponding to the foreground object.

[0152] For example, when executed by the processor, the instructions may cause the wearable device to receive an input for focusing on the foreground object when displaying the foreground object as a widget run by the processor to provide a second audio signal.

[0153] For example, the wearable device may include a sensor (e.g., Figure 2 sensor 230). When executed by the processor, the instructions may cause the wearable device to move the foreground object on the display based on recognizing the movement of the wearable device using data from the sensor. When executed by the processor, the instructions may cause the wearable device to change the brightness of the background object by comparing the reference size range with the size of the moved foreground object displayed on the display.

[0154] For example, when executed by a processor, an instruction may cause a wearable device to display a second portion of a background object that is separated from a first portion adjacent to a foreground object at a luminance greater than the first luminance while the first portion of the background object adjacent to the foreground object is displayed at a first luminance.

[0155] For example, when executed by a processor, an instruction may cause a wearable device, while displaying a foreground object as a first foreground object, to reduce the luminance of a background object from a first luminance to a second luminance based on identifying a second foreground object that is separated from the first foreground object.

[0156] For example, when executed by a processor, an instruction may cause a wearable device to maintain the luminance of a foreground object while changing the luminance of a background object.

[0157] For example, when executed by a processor, an instruction may cause a wearable device, while changing the luminance of a background object to a second luminance less than the first luminance, to reduce at least one of the density or velocity of a plurality of particles (e.g., Figure 5a , Figure 5b , Figure 5c and Figure 5d particles 520) included in the background object.

[0158] For example, when executed by a processor, an instruction may cause a wearable device, while displaying a background object using a first chromaticity, to change the chromaticity of the background object to a second chromaticity less than the first chromaticity based on identifying that the size of a foreground object extends beyond a reference size range.

[0159] For example, when executed by a processor, an instruction may cause a wearable device to change the luminance of a background object to a third luminance greater than the first luminance based on identifying that the size of a foreground object has decreased to less than a reference size range.

[0160] As described above, according to an embodiment, a method for a wearable device may include displaying a background object having a first luminance and one or more foreground objects superimposed on the background object on a display of the wearable device. The method may include: while displaying the background object at a first luminance associated with the number of one or more foreground objects, identifying the number of foreground objects based on at least one application run by a processor of the wearable device. The method may include changing the luminance of the background object to a second luminance less than the first luminance based on identifying an increase in the number of one or more foreground objects.

[0161] For example, the display may include displaying the background object using a first luminance selected from a plurality of preset luminances based on the size of one or more foreground objects displayed through the display.

[0162] For example, changing the brightness of the background object to a second brightness may include maintaining the brightness of one or more foreground objects while changing the brightness of the background object.

[0163] For example, changing the brightness of the background object to a second brightness may include reducing the volume of the audio signal output corresponding to the background object to a second volume that is lower than a first volume matching the first brightness.

[0164] For example, the reduction may include reducing the volume to a third volume that is lower than the second volume based on identifying a second audio signal different from the first audio signal corresponding to the background object from one or more foreground objects.

[0165] For example, the method may include changing the brightness of the background object to a third brightness greater than the first brightness based on identifying a decrease in the number of one or more foreground objects.

[0166] As described above, according to an embodiment, a method for a wearable device may include overlappingly displaying a foreground object on a background object having a first brightness on a display of the wearable device. The method may include changing the brightness of the background object to a second brightness less than the first brightness based on identifying that the size of the foreground object has expanded beyond a reference size range.

[0167] For example, the display may include outputting, via a speaker of the wearable device, an audio signal at a first volume corresponding to the reference size range based on the running of a process corresponding to the background object.

[0168] For example, the method may include changing the first volume of the audio signal to a second volume less than the first volume based on identifying that the size of the foreground object has expanded beyond a reference size range. The method may include changing the first volume of the audio signal to a third volume greater than the first volume based on identifying that the size of the foreground object has decreased below the reference size range.

[0169] For example, the method may include, in a state of outputting an audio signal as a first audio signal, in response to an input for focusing on the foreground object, changing the first volume of the first audio signal to a second volume lower than the first volume based on identifying a second audio signal corresponding to the foreground object.

[0170] For example, the method may include moving the foreground object in the display based on identifying the movement of the wearable device using data from a sensor of the wearable device. The method may include changing the brightness of the background object by comparing the reference size range with the size at which the moved foreground object is displayed in the display.

[0171] For example, the method may include: while displaying a first portion of a background object adjacent to a foreground object at a first luminance, displaying a second portion of the background object that is separated from the first portion at a luminance greater than the first luminance.

[0172] For example, the method may include while displaying a foreground object as a first foreground object, reducing the luminance of the background object from a first luminance to a second luminance based on identifying a second foreground object that is separated from the first foreground object.

[0173] For example, the method may include while changing the luminance of the background object, maintaining the luminance of the foreground object.

[0174] For example, the method may include: while changing the luminance of the background object to a second luminance that is less than the first luminance, reducing at least one of the density or velocity of a plurality of particles included in the background object.

[0175] For example, the method may include while displaying the background object using a first chromaticity, changing the chromaticity of the background object to a second chromaticity that is less than the first chromaticity based on identifying that the size of the foreground object extends to be greater than a reference size range.

[0176] For example, the method may include changing the luminance of the background object to a third luminance that is greater than the first luminance based on identifying that the size of the foreground object decreases to be less than a reference size range.

[0177] As described above, according to an embodiment, a wearable device may include a display, a memory storing instructions, and a processor. The instructions, when executed by the processor, may cause the wearable device to display a background object having a first luminance and one or more foreground objects superimposed on the background object on the display. The instructions, when executed by the processor, may cause the wearable device to identify the number of foreground objects based on at least one application run by the processor while displaying the background object at a first luminance associated with the number of one or more foreground objects. The instructions, when executed by the processor, may cause the wearable device to change the luminance of the background object to a second luminance that is less than the first luminance based on identifying that the number of one or more foreground objects increases. The instructions, when executed by the processor, may cause the wearable device to change the luminance of the background object to a third luminance that is greater than the first luminance based on identifying that the number of one or more foreground objects decreases.

[0178] For example, the instructions, when executed by the processor, may cause the wearable device to display the background object using a first luminance selected from a plurality of preset luminances based on the size of one or more foreground objects displayed through the display.

[0179] For example, when executed by a processor, an instruction can cause a wearable device to maintain the brightness of one or more foreground objects while changing the brightness of a background object.

[0180] For example, when executed by a processor, an instruction can cause a wearable device to reduce the volume of an audio signal output corresponding to a background object to a second volume that is lower than a first volume matching a first brightness.

[0181] For example, when executed by a processor, an instruction can cause a wearable device to reduce the volume to a third volume that is lower than the second volume based on identifying a second audio signal different from a first audio signal corresponding to a background object from one or more foreground objects.

[0182] For example, when executed by a processor, an instruction can cause a wearable device to change the brightness of a background object to a third brightness greater than the first brightness based on identifying a decrease in the number of one or more foreground objects.

[0183] As described above, according to an embodiment, there is provided a non-transitory computer-readable storage medium storing instructions. When executed by a processor of a wearable device including a display, the instructions can cause the wearable device to overlappedly display a foreground object on a background object having a first brightness on the display. When executed by the processor, the instructions can cause the wearable device to change the brightness of the background object from the first brightness to a second brightness less than the first brightness based on identifying that the size of at least a part of the display occupied by the foreground object has increased.

[0184] The above-described device can be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments can be implemented by using one or more general-purpose computers or dedicated computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device can execute an operating system (OS) and one or more software applications running on the operating system. Additionally, the processing device can access, store, manipulate, process, and generate data in response to the running of the software. For ease of understanding, there is a description of a case where one processing device is used, but those of ordinary skill in the relevant technical field can understand that the processing device can include multiple processing elements and / or multiple types of processing elements. For example, the processing device can include multiple processors or one processor and one controller. Additionally, another processing configuration such as a parallel processor is also possible.

[0185] Software may include a computer program, code, instructions, or a combination of one or more of them, and may configure a processing device to operate as needed, or may command the processing device independently or jointly. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by or to provide commands or data to the processing device. The software may be distributed over network-connected computer systems and stored or run in a distributed manner. The software and data may be stored in one or more computer-readable recording media.

[0186] The method according to an embodiment may be implemented in the form of program commands executable by various computer devices and recorded on a computer-readable medium. In this case, the medium may continuously store programs executable by a computer, or may temporarily store programs for running or downloading. Additionally, the medium may be various recording or storage devices in the form of a single hardware or a combination of several hardwares, but is not limited to a medium directly connected to a certain computer system and may be distributed over a network. Examples of the medium may include magnetic media (such as hard disks, floppy disks, and magnetic tapes), optical recording media (such as CD-ROMs and DVDs), magneto-optical media (such as floppy disks), and media configured to store program instructions (including ROM, RAM, flash memory, etc.). Additionally, examples of other media may include recording media or storage media managed by an application store that distributes applications, a site that supplies or distributes various software, a server, etc.

[0187] As described above, although the embodiments have been described with limited examples and drawings, those of ordinary skill in the relevant technical field can make various modifications and transformations based on the above description. For example, even if the described technology is executed in an order different from the described method, and / or the components of the described system, structure, device, circuit, etc. are coupled or combined in a form different from the described method, or are replaced or substituted by other components or equivalent forms, appropriate results can still be achieved.

[0188] Therefore, other embodiments, other implementations, and those equivalent to the scope of the claims are within the scope of the claims described hereinafter.

Claims

1. A wearable device, the wearable device comprising: A display; A memory that stores instructions; And A processor, wherein the instructions, when executed by the processor, cause the wearable device to: On the display, overlappingly display a foreground object on a background object having a first brightness; And Based on identifying that at least a portion of the display occupied by the foreground object has increased in size, change the brightness of the background object from the first brightness to a second brightness less than the first brightness.

2. The wearable device according to claim 1, the wearable device further includes a speaker, wherein, The instructions, when executed by the processor, cause the wearable device to: Display the background object in the display by running a process different from the process run to display the foreground object, and output an audio signal at a first volume through the speaker, the first volume corresponding to the reference size range.

3. The wearable device according to claim 2, wherein, The instructions, when executed by the processor, cause the wearable device to: Based on identifying that the size of the foreground object has expanded to be greater than the reference size range, change the first volume of the audio signal to a second volume less than the first volume; And Based on identifying that the size of the foreground object has decreased to be less than the reference size range, change the first volume of the audio signal to a third volume greater than the first volume.

4. The wearable device according to claim 2, wherein The instructions, when executed by the processor, cause the wearable device to: In a state of outputting the audio signal as a first audio signal, in response to an input for focusing on the foreground object, based on identifying a second audio signal corresponding to the foreground object, change the first volume of the first audio signal to a second volume lower than the first volume.

5. The wearable device according to claim 4, wherein, The instructions, when executed by the processor, cause the wearable device to: When displaying the foreground object as a widget run by the processor to provide the second audio signal, receive the input for focusing on the foreground object.

6. The wearable device according to claim 1, the wearable device further comprising a sensor, Among them, The instructions, when executed by the processor, cause the wearable device to: Based on identifying the movement of the wearable device using the data of the sensor, move the foreground object in the display; And Change the brightness of the background object by comparing the reference size range with the size of the moved foreground object displayed in the display.

7. The wearable device according to claim 1, wherein, The instructions, when executed by the processor, cause the wearable device to: In a state of displaying a first portion of the background object adjacent to the foreground object at the first brightness, display a second portion of the background object separated from the first portion at a brightness greater than the first brightness.

8. The wearable device according to claim 1, wherein, The instructions, when executed by the processor, cause the wearable device to: In a state of displaying the foreground object as a first foreground object, based on identifying a second foreground object separated from the first foreground object, reduce the brightness of the background object from the first brightness to the second brightness.

9. The wearable device according to claim 1, wherein The instructions, when executed by the processor, cause the wearable device to: While changing the brightness of the background object, maintain the brightness of the foreground object.

10. The wearable device according to claim 1, wherein, When executed by the processor, the instruction causes the wearable device to: While changing the brightness of the background object to the second brightness that is less than the first brightness, reduce at least one of the density or velocity of a plurality of particles included in the background object.

11. The wearable device according to claim 1, wherein, When executed by the processor, the instruction causes the wearable device to: While displaying the background object using a first chromaticity, change the chromaticity of the background object to a second chromaticity that is less than the first chromaticity based on identifying that the size of the foreground object has expanded to be greater than the reference size range.

12. The wearable device according to claim 1, wherein, When executed by the processor, the instruction causes the wearable device to: Based on identifying that the size of the foreground object has decreased to be less than the reference size range, change the brightness of the background object to a third brightness that is greater than the first brightness.

13. A method for a wearable device, the method comprising: Display a background object having a first brightness and one or more foreground objects superimposed on the background object on a display of the wearable device; While displaying the background object with the first brightness associated with the number of the one or more foreground objects, identify the number of the foreground objects based on at least one application run by a processor of the wearable device; And Based on identifying that the number of the one or more foreground objects has increased, change the brightness of the background object to a second brightness that is less than the first brightness.

14. The method according to claim 13, wherein, The display includes: Based on the size of the one or more foreground objects displayed through the display, display the background object using the first brightness selected from a plurality of preset brightnesses.

15. A non-transitory computer-readable storage medium storing instructions, wherein, When executed by a processor of a wearable device including a display, the instruction causes the wearable device to: On the display, superimposedly display a foreground object on a background object having a first brightness; And Based on identifying that the size of at least a part of the display occupied by the foreground object has increased, change the brightness of the background object from the first brightness to a second brightness that is less than the first brightness.

Images