Wearable device for adjusting communication link for receiving media content on basis of size of media content in display, and method for same
The wearable device optimizes communication links by adjusting parameters based on media content size and display mode, addressing inefficiencies in resource use and power consumption, thereby improving user experience and battery life in AR applications.
Patent Information
- Application Number
- PCT/KR2024/008237
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-29
- Filing Date
- 2024-06-14
- Publication Date
- 2025-01-30
Smart Images

Figure KR2024008237_30012025_PF_FP_ABST
Abstract
Description
Wearable device and method for adjusting a communication link for receiving media content based on the size of the media content within the display
[0001] Embodiments of the present disclosure relate to a wearable device and method for adjusting a communication link for receiving media content based on the size of the media content within a display.
[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices may be wearable devices worn by the user. For example, these electronic devices may be AR glasses and / or head-mounted devices (HMDs).
[0003] According to an embodiment, a wearable device may include a display, a communication circuit, a memory for storing instructions, and at least one processor for executing the instructions. The at least one processor may be configured to, in response to receiving information for displaying a virtual object through a communication link established by the communication circuit between the wearable device and an external electronic device, obtain a location of the virtual object with respect to the display based on the information. The at least one processor may be configured to display at least a portion of the virtual object on the display based on the obtained location. The at least one processor may be configured to change at least one parameter related to control of the communication circuit to adjust an amount of the information received through the communication link based on a size of the at least a portion of the virtual object displayed on the display.
[0004] In one embodiment, a method of a wearable device may include, in response to receiving information for displaying a virtual object through a communication link established by a communication circuit of the wearable device and an external electronic device, obtaining a location of the virtual object with respect to a display of the wearable device based on the information. The method may include, based on the obtained location, displaying at least a portion of the virtual object on the display. The method may include, based on a size of the at least a portion of the virtual object displayed on the display, changing at least one parameter related to control of the communication circuit to adjust an amount of the information received through the communication link.
[0005] In one embodiment, a wearable device may include a display, a communication circuit, a memory for storing instructions, and at least one processor for executing the instructions. The at least one processor may be configured to receive information for displaying a plurality of virtual objects through a communication link established by the communication circuit between the wearable device and an external electronic device. The at least one processor may be configured to display, on the display, at least a portion of a first virtual object associated with a point on the display specified by the information and a second virtual object associated with a point in an external space specified by the information. The at least one processor may be configured to change at least one parameter related to control of the communication circuit such that an amount of the information received through the communication link corresponds to a size of at least a portion of the second virtual object displayed on the display.
[0006] In one embodiment, a method of a wearable device may include receiving information for displaying a plurality of virtual objects through a communication link established by a communication circuit of the wearable device between the wearable device and an external electronic device. The method may include displaying, on a display of the wearable device, at least a portion of a first virtual object associated with a point on the display specified by the information and a second virtual object associated with a point in an external space specified by the information. The method may include changing at least one parameter related to control of the communication circuit such that an amount of the information received through the communication link corresponds to a size of at least a portion of the second virtual object displayed on the display.
[0007] FIG. 1 is a drawing for explaining an example of a screen displayed through a display of a wearable device according to one embodiment.
[0008] FIG. 2 illustrates an example block diagram of a wearable device according to one embodiment.
[0009] FIG. 3 illustrates an example of a flowchart of a wearable device according to one embodiment.
[0010] FIG. 4 illustrates exemplary screens displayed based on motion identified by a wearable device.
[0011] FIG. 5 illustrates an example of a flowchart of a wearable device according to one embodiment.
[0012] FIG. 6 illustrates an example of a flowchart of a wearable device according to one embodiment.
[0013] FIG. 7 illustrates an example of a flowchart of a wearable device according to one embodiment.
[0014] FIGS. 8A and 8B illustrate exemplary screens displayed by a wearable device based on the status of an external electronic device.
[0015] FIG. 9 illustrates an example of a flowchart of a wearable device according to one embodiment.
[0016] FIG. 10A illustrates an example of a perspective view of a wearable device according to one embodiment.
[0017] FIG. 10b illustrates an example of one or more hardware elements disposed within a wearable device, according to one embodiment.
[0018] FIGS. 11A and 11B illustrate an example of an appearance of a wearable device according to one embodiment.
[0019] Hereinafter, various embodiments of this document are described with reference to the attached drawings.
[0020] The various embodiments of this document and the terminology used therein are not intended to limit the technology described in this document to a specific embodiment, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar components. The singular expression may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Expressions such as "first", "second", "first", or "second" may modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another, but do not limit the corresponding components. When it is said that a component (e.g., a first component) is “(functionally or communicatively) connected” or “connected” to another component (e.g., a second component), the component may be directly connected to the other component, or may be connected via another component (e.g., a third component).
[0021] The term "module" as used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimal unit or portion thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).
[0022] FIG. 1 is a diagram illustrating an example of a screen (130) displayed through a display of a wearable device (101) according to one embodiment. The wearable device (101) may include a head-mounted display (HMD) that is wearable on the head of a user (110). The wearable device (101) may be referred to as a head-mounted device (HMD), a headgear electronic device, a glasses-type electronic device, a video see-through (VST) device, an extended reality (XR) device, a virtual reality (VR) device, and / or an augmented reality (AR) device. Although the external appearance of the wearable device (101) in the form of glasses is illustrated, the embodiment is not limited thereto. An example of a hardware configuration included in the wearable device (101) is exemplarily described with reference to FIG. 2. An example of the structure of a wearable device (101) that can be worn on the head of a user (110) is described with reference to FIGS. 10A, 10B, 11A, and / or 11B. The wearable device (101) may be referred to as an electronic device. For example, the electronic device may be combined with an accessory to be attached to the head of a user to form an HMD.
[0023] According to one embodiment, the wearable device (101) can perform functions related to augmented reality (AR), virtual reality (VR), and / or mixed reality (MR). For example, when a user (110) wears the wearable device (101), the wearable device (101) can include at least one lens positioned adjacent to the eyes of the user (110). The wearable device (101) can combine light emitted from a display of the wearable device (101) with ambient light passing through the lens. The display area of the display can be formed within the lens through which the ambient light passes. Since the wearable device (101) combines the ambient light and the light emitted from the display, the user (110) can see an image that is a mixture of a real object recognized by the ambient light and a virtual object formed by the light emitted from the display. The augmented reality, mixed reality, and / or virtual reality described above may be referred to as extended reality (XR).
[0024] In one embodiment, a wearable device (101) may perform functions related to video see-through (VST) and / or virtual reality (VR). For example, when a user (110) wears the wearable device (101), the wearable device (101) may include a housing that covers the eyes of the user (110). The wearable device (101), in this state, may include a display disposed on a first side of the housing facing the eyes. The wearable device (101) may include a camera disposed on a second side opposite the first side. Using the camera, the wearable device (101) may acquire images and / or videos representing ambient light. The wearable device (101) can output the image and / or video within the display disposed on the first surface, thereby allowing the user (110) to recognize the ambient light through the display. The displaying area (or active area) of the display disposed on the first surface can be formed by one or more pixels included in the display. The wearable device (101) can synthesize a virtual object into the image and / or video output through the display, thereby allowing the user (110) to recognize the virtual object together with a real object recognized by the ambient light.
[0025] According to one embodiment, the wearable device (101) may calculate an amount of information required for displaying media content including images and / or videos provided from an external electronic device (120) connected via a network, and may control a connection between the wearable device (101) and the external electronic device (120) based on the calculated amount. Hereinafter, the amount of information may refer to an amount of information required to output the media content for a specified period of time (e.g., about 1 second). The amount may be stored and / or represented as a numeric value having a unit for counting the number of bits (e.g., byte, kilobyte, megabyte). For example, when a wireless connection is established between the wearable device (101) and the external electronic device (120), the wearable device (101) may control a communication circuit activated for the wireless connection. Controlling the communication circuit by the wearable device (101) may include an operation of changing at least one parameter related to the wireless connection based on the amount of information.
[0026] Referring to FIG. 1, an exemplary state in which a wearable device (101) and an external electronic device (120) are connected to each other is illustrated. Examples of the external electronic device (120) include a laptop (120-1), a smartphone (120-2) (or a mobile phone), a smartphone (120-3) including a deformable housing and / or a flexible display (e.g., a foldable mobile phone), and / or a television (120-4), but the embodiment is not limited thereto. Referring to FIG. 1, in a state in which the wearable device (101) is wirelessly connected to a laptop (120-1), which is an example of the external electronic device (120), the wearable device (101) can receive media content from the laptop (120-1).
[0027] For example, media content received from an external electronic device (120), such as a laptop (120-1), may include text, images such as photographs, video, graphical objects requiring 3D rendering, audio, or any combination thereof. For example, the media content may include a combination of text, images, and / or video organized based on hypertext marked-up language (HTML) (or extended marked-up language (XML)), such as a web page. For example, the media content may include video streamed from the laptop (120-1). The video may represent and / or display a screen (e.g., an activity and / or a window) provided by a software application running on the laptop (120-1).
[0028] Referring to FIG. 1, an exemplary screen (130) displayed by a wearable device (101) while connected to an external electronic device (120), such as a laptop (120-1), is illustrated. While worn by a user (110), the wearable device (101) can output light representing the screen (130) to both eyes of the user (110). The wearable device (101) can display at least one media content provided from the laptop (120-1) within the screen (130). The media content displayed within the screen (130) can be referred to as a virtual object, in terms of an object different from a real object. A communication link can be established between the wearable device (101) and the laptop (120-1) for transmitting and / or receiving the at least one media content. The above communication link may include a wireless connection at the physical layer for wirelessly transmitting a signal from the laptop (120-1) to the wearable device (101). In one embodiment, the wearable device (101) may adaptively change the communication link based on the size of media content displayed through the screen (130) to efficiently move wireless communication resources. An example of a hardware configuration included in the wearable device (101) that changes the communication link is described with reference to FIG. 2.
[0029] In one embodiment, while the user (110) wears the wearable device (101), the wearable device (101) may monitor the motion of the wearable device (101) and / or the user (110) to provide a user experience based on AR, VR, and / or VST. Based on the motion, the wearable device (101) may change the properties (e.g., location, size, or included information) of at least one media content displayed on the screen (130). For example, the wearable device (101) may move the media content in a direction opposite to the direction in which the head of the user (110) wearing the wearable device (101) rotates, thereby providing a user experience as if the media content is fixed at a specific point. For example, the wearable device (101) can provide a user experience such as the media content following the user's head by moving the media content in a direction that matches the direction in which the head of the user (110) wearing the wearable device (101) rotates. When the wearable device (101) receives media content from an external electronic device (120), such as a laptop (120-1), the wearable device (101) can identify a mode for moving the media content based on the motion using information set by the external electronic device (120).
[0030] In one embodiment, the mode of moving media content within the screen (130) may be divided into a body-locked mode and a world-locked mode, depending on the method of determining the location of the media content by the wearable device (101). The media content in the body-locked mode may be displayed at a location related to the wearable device (101) and / or the user (110) (e.g., a location anchored to a body part of the wearable device (101) and / or the user (110). The media content in the world-locked mode may be displayed at a fixed location independently of the motion. The wearable device (101) may change the amount of information received from the external electronic device (120) for displaying the media content based on the mode of the media content selected from the body-locked mode or the world-locked mode. The operation of the wearable device (101) that changes the amount of the above information is described with reference to Fig. 3. The operation of the wearable device (101) that displays media contents of each of the body-lock mode and the world-lock mode is described with reference to Fig. 4.
[0031] Within the exemplary state of FIG. 1, the wearable device (101) may display a screen (130) including a visual object (140) corresponding to a laptop (120-1) based on a VST. Based on the visual object (140), a user (110) wearing the wearable device (101) may recognize a laptop (120-1) positioned in front of the user (110). The wearable device (101) may display virtual objects (152, 154, 156) within the screen (130) based on information received from the laptop (120-1). The virtual objects (152, 154, 156) may be referred to as media contents received from the laptop (120-1).
[0032] In one embodiment, each of the virtual objects (152, 154, 156) may include screens provided by different software applications executed by the laptop (120-1) (e.g., executed based on multi-tasking). When each of the virtual objects (152, 154, 156) includes screens provided by the software applications, the virtual objects (152, 154, 156) may have the size of a display included in an external electronic device (120), such as the laptop (120-1). The wearable device (101) may display the virtual objects (152, 154, 156) at points within the screen (130) associated with a visual object (140) corresponding to the laptop (120-1), based on information received from the laptop (120-1). For example, points within the screen (130) where virtual objects (152, 154, 156) are displayed may be determined and / or calculated based on a world-locked mode based on points within the laptop (120-1). Based on the virtual objects (152, 154, 156) displayed at points within the screen (130) associated with visual objects (140), the wearable device (101) may provide the user (110) with a user experience similar to viewing auxiliary displays linked to the laptop (120-1).
[0033] While displaying virtual objects (152, 154, 156) based on a world-lock mode based on a point of a laptop (120-1), the positions of the virtual objects (152, 154, 156) and / or the visual object (140) corresponding to the laptop (120-1) within the screen (130) may change depending on the motion of the user (110) wearing the wearable device (101). For example, if the user (110) looks in a direction opposite to the laptop (120-1), the visual object (140) within the screen (130) may disappear. In the above example, since the virtual objects (152, 154, 156) are displayed at points within the screen (130) associated with the visual object (140), the virtual objects (152, 154, 156) may disappear or be partially displayed within the screen (130). In one embodiment of displaying the virtual objects (152, 154, 156) based on information received from the laptop (120-1), the wearable device (101) may reduce the amount of information while the virtual objects (152, 154, 156) disappear within the screen (130). The embodiment is not limited thereto, and the wearable device (101) may adaptively change the amount of information based on the size (or area) of the virtual objects (152, 154, 156) displayed within the screen (130).
[0034] As described above, in order to save computing resources of the wearable device (101) and / or communication resources between the laptop (120-1) and the wearable device (101) occupied for displaying the virtual objects (152, 154, 156) while the virtual objects (152, 154, 156) disappear from the screen (130), the wearable device (101) may reduce the amount of information received from the laptop (120-1) for displaying the virtual objects (152, 154, 156). Based on the saving of the computing resources and / or the communication resources, the power consumed by the wearable device (101) may be reduced. Since the power consumed by the wearable device (101) is reduced, the period during which the wearable device (101) can be activated based on the battery may be increased. Based on the reduction of the above computing resources and / or the above communication resources, the heat generated from the wearable device (101) can be reduced. Since the heat generated from the wearable device (101) is reduced while the user (110) wears the wearable device (101), the discomfort of the user (110) due to the heat can be reduced.
[0035] Hereinafter, with reference to FIG. 2, an exemplary hardware configuration of the wearable device (101) described with reference to FIG. 1 is described.
[0036] FIG. 2 illustrates an example block diagram of a wearable device (101) according to one embodiment. The wearable device (101) described with reference to FIG. 1 may include at least one of the hardware components of the wearable device (101) distinguished by different blocks in FIG. 2.
[0037] Referring to FIG. 2, a wearable device (101) according to one embodiment may include at least one of a processor (210), a memory (215), a display (220), a camera (225), a sensor (230), and a communication circuit (235). The processor (210), the memory (215), the display (220), the camera (225), the sensor (230), and / or the communication circuit (235) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (202). The type and / or number of hardware components included in the wearable device (101) is not limited to those illustrated in FIG. 2. For example, the wearable device (101) may include only some of the hardware components illustrated in FIG. 2.
[0038] According to one embodiment, the processor (210) of the wearable device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). In one embodiment, the wearable device (101) may include one or more processors. The processor (210) may have a multi-core processor structure, such as a dual core, a quad core, a hexa core, and / or an octa core.
[0039] The memory (215) of the wearable device (101) according to one embodiment may include a hardware component for storing data and / or instructions input to and / or output from the processor (210). The memory (215) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, and embedded multi media card (eMMC). In one embodiment, the memory (215) may be referred to as storage.
[0040] In one embodiment, the display (220) of the wearable device (101) can output visualized information (e.g., the screen (130) of FIG. 1) to a user of the wearable device (101) (e.g., the user (110) of FIG. 1). For example, the display (220) can be configured to visualize information provided from a processor (210) including a circuit such as a graphic processing unit (GPU). The display (220) can include a flexible display, a flat panel display (FPD), and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). Embodiments are not limited thereto, and for example, if the wearable device (101) includes a lens for transmitting external light (or ambient light), the display (220) may include a projector (or projection assembly) for projecting light onto the lens. In one embodiment, the display (220) may be referred to as a display panel and / or a display module.
[0041] In one embodiment, the camera (225) of the wearable device (101) may include optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The camera (225) may be referred to as an image sensor and may be included in the sensor (230) of FIG. 2. The plurality of optical sensors included in the camera (225) may be arranged in the form of a two-dimensional grid. The camera (225) may acquire electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional grid. For example, photographic data captured using the camera (225) may mean one (a) two-dimensional frame data acquired from the camera (225). For example, video data captured using a camera (225) may mean a sequence of a plurality of two-dimensional frame data acquired from the camera (225) according to a frame rate. The camera (225) may further include a flash light that is positioned toward the direction in which the camera (225) receives light and outputs light toward the direction.
[0042] According to one embodiment, the wearable device (101) may include a plurality of cameras, for example, cameras (225), arranged facing different directions. Referring to FIG. 2, the camera (225) included in the wearable device (101) may include a gaze tracking camera (225-1) and / or an outward camera (225-2). The gaze tracking camera (225-1) may be arranged toward at least one of the two eyes of a user wearing the wearable device (101). The processor (210) may identify the direction of the user's gaze using images and / or videos acquired from the gaze tracking camera (225-1). The gaze tracking camera (225-1) may include an infrared (IR) sensor. The gaze tracking camera (225-1) may be referred to as an eye sensor, a gaze tracker, and / or an eye tracker.
[0043] Referring to FIG. 2, the external camera (225-2) may be positioned to face the front of a user wearing the wearable device (101) (e.g., in a direction in which both eyes may face). Using images and / or videos acquired from the external camera (225-2), the processor (210) may identify an external object (e.g., the external electronic device (120) of FIG. 1). The embodiment is not limited thereto, and the processor (210) may identify a position, shape, and / or gesture (e.g., a hand gesture) of a hand based on images and / or videos acquired from the external camera (225-2).
[0044] According to one embodiment, a sensor (230) of a wearable device (101) may generate electrical information from non-electronic information related to the wearable device (101), which may be processed and / or stored by a processor (210) and / or a memory (215) of the wearable device (101). The information may be referred to as sensor data. The sensor (230) may include a global positioning system (GPS) sensor, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor for detecting a geographic location of the wearable device (101), an inertial measurement unit (IMU) (e.g., an acceleration sensor, a geomagnetic sensor, a gravity sensor, or any combination thereof) for detecting a physical motion of the wearable device (101).
[0045] An IMU for detecting motion of a wearable device (101) may include an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a combination thereof. The acceleration sensor may output an electrical signal representing gravitational acceleration and / or acceleration along each of a plurality of axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other and based on the origin of the wearable device (101). In one embodiment, the gyro sensor may output an electrical signal representing an angular velocity of each of the plurality of axes. In one embodiment, the geomagnetic sensor may output an electrical signal representing a magnitude of a magnetic field formed in the wearable device (101) along each of the plurality of axes (e.g., x-axis, y-axis, and / or z-axis). For example, an acceleration sensor, a gyro sensor, and / or a geomagnetic sensor may repeatedly output sensor data including accelerations, angular velocities, and / or magnitudes of magnetic fields of said plurality of axes based on a specified period (e.g., about 1 millisecond).
[0046] In one embodiment, the communication circuit (235) of the wearable device (101) may include circuitry for supporting transmission and / or reception of information between the wearable device (101) and an external electronic device. The communication circuit (235) may include, for example, at least one of a modem, an antenna, and an optical / electronic (O / E) converter. The communication circuit (235) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G new radio (NR), 6G and / or above-6G. In one embodiment, the communication circuit (235) may be referred to as a communication processor and / or a communication module.
[0047] In one embodiment, the wearable device (101) may include a communication circuit (235) for WLAN, such as WiFi. The state of the communication circuit (235) may be controlled between a sleep state and / or an active state (or wake-up state) defined by the WiFi. Within the sleep state, a power signal having a specified voltage and / or power below a specified power may be provided to the communication circuit (235). Within the active state, a power signal having a specified voltage and / or power above the specified power may be provided to the communication circuit (235). While a communication link is established between the wearable device (101) and an external electronic device (120), when the state of the communication circuit (235) switches from the active state to the sleep state, the wearable device (101) may transmit a signal to the external electronic device (120) to notify the switching of the state of the communication circuit (235). The signal may include information related to power management of the communication circuit (235). When the state of the communication circuit (235) switches from a sleep state to an active state, the wearable device (101) can transmit a signal to an external electronic device (120) to notify the switching of the state of the communication circuit (235).
[0048] According to one embodiment, one or more instructions (or commands) representing data to be processed, calculations to be performed, and / or operations to be performed by the processor (210) of the wearable device (101) may be stored in the memory (215) of the wearable device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or a software application (hereinafter, “application”). For example, the wearable device (101) and / or the processor (210) may perform at least one of the operations of FIGS. 3, 5 to 7, and / or 9 when a set of a plurality of instructions distributed in the form of an operating system, firmware, driver, and / or application is executed. Hereinafter, the fact that an application is installed in a wearable device (101) may mean that one or more instructions provided in the form of an application are stored in a memory (215), and that the one or more applications are stored in a format executable by the processor (210) (e.g., a file having an extension specified by the operating system of the wearable device (101)). For example, an application may include a program and / or a library related to a service provided to a user.
[0049] Referring to FIG. 2, programs installed in the wearable device (101) may be classified into any one of different layers, including an application layer (240), a framework layer (250), and / or a hardware abstraction layer (HAL) (280), based on the target. For example, programs (e.g., modules or drivers) designed to target the hardware of the wearable device (101) (e.g., the display (220), the camera (225), and / or the sensor (230)) may be classified within the hardware abstraction layer (280). The framework layer (250) may be referred to as an XR framework layer in terms of including one or more programs for providing an XR (extended reality) service. For example, the layers illustrated in FIG. 2 may be logically (or for convenience of explanation) separated and may not mean that the address space of the memory (215) is separated by the layers.
[0050] For example, within the framework layer (250), programs designed to target at least one of the hardware abstraction layer (280) and / or the application layer (240) (e.g., a position tracker (271), a space recognizer (272), a gesture tracker (273), an eye-gaze tracker (274), and / or a face tracker (275)) may be classified. Programs classified within the framework layer (250) may provide an executable API (application programming interface) based on other programs.
[0051] For example, within the application layer (240), programs designed to target users of the wearable device (101) may be classified. As examples of programs classified into the application layer (240), an extended reality (XR) system user interface (UI) (241) and / or an XR application (242) are exemplified, but the embodiment is not limited thereto. For example, programs (e.g., software applications) classified into the application layer (240) may call an application programming interface (API) to cause execution of functions supported by programs classified into the framework layer (250).
[0052] For example, the wearable device (101) may display one or more visual objects on the display (220) for performing interaction with a user for using a virtual space based on the execution of the XR system UI (241). A visual object may refer to an object that can be deployed within a screen for transmitting and / or interacting with information, such as text, an image, an icon, a video, a button, a checkbox, a radio button, a text box, a slider, and / or a table. A visual object may be referred to as a visual guide, a virtual object, a visual element, a UI element, a view object, and / or a view element. The wearable device (101) may provide the user with functions available within the virtual space based on the execution of the XR system UI (241).
[0053] Referring to FIG. 2, a lightweight renderer (243) and / or an XR plug-in (244) are illustrated to be included within the XR system UI (241), but are not limited thereto. For example, based on the XR system UI (241), the processor (210) may execute a lightweight renderer (243) and / or an XR plug-in (244) within the framework layer (250).
[0054] For example, the wearable device (101) may obtain resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute a rendering pipeline that allows partial changes based on the execution of a lightweight renderer (243). The lightweight renderer (243) may be referred to as a lightweight render pipeline in terms of defining a rendering pipeline that allows partial changes. The lightweight renderer (243) may include a renderer built prior to the execution of a software application (e.g., a prebuilt renderer). For example, the wearable device (101) may obtain resources (e.g., APIs, system processes, and / or libraries) used to define, create, and / or execute an entire rendering pipeline based on the execution of an XR plug-in (244). The XR plugin (244) can be referred to as an open XR native client from the perspective of defining (or setting up) the entire rendering pipeline.
[0055] For example, the wearable device (101) may display a screen representing at least a portion of a virtual space on the display (220) based on the execution of the XR application (242). The XR plug-in (244-1) included in the XR application (242) may include instructions that support functions similar to those of the XR plug-in (244) of the XR system UI (241). Descriptions of the XR plug-in (244-1) that overlap with those of the XR plug-in (244) may be omitted. The wearable device (101) may cause the execution of the virtual space manager (251) based on the execution of the XR application (242).
[0056] According to one embodiment, the wearable device (101) may provide a virtual space service based on the execution of the virtual space manager (251). For example, the virtual space manager (251) may include a platform for supporting the virtual space service. The wearable device (101) may identify a virtual space formed based on the user's location indicated by data acquired through the sensor (230) based on the execution of the virtual space manager (251), and may display at least a portion of the virtual space on the display (220). The virtual space manager (251) may be referred to as a composition presentation manager (CPM).
[0057] For example, the virtual space manager (251) may include a runtime service (252). As an example, the runtime service (252) may be referred to as an OpenXR runtime module (or an OpenXR runtime program). The wearable device (101) may execute at least one of a user's pose prediction function, a frame timing function, and / or a spatial input function based on the execution of the runtime service (252). As an example, the wearable device (101) may perform rendering for a virtual space service to the user based on the execution of the runtime service (252). For example, a function related to a virtual space, executable by the application layer (240), may be supported based on the execution of the runtime service (252).
[0058] For example, the virtual space manager (251) may include a pass-through manager (253). Based on the execution of the pass-through manager (253), the wearable device (101) may display a screen representing a virtual space on the display (220), while superimposing another screen representing an actual space obtained through the camera (225) on at least a portion of the screen.
[0059] For example, the virtual space manager (251) may include an input manager (254). The wearable device (101) may identify data (e.g., sensor data) obtained by executing one or more programs included in the recognition service layer (270) based on the execution of the input manager (254). The wearable device (101) may use the obtained data to identify user input related to the wearable device (101). The user input may be related to a motion (e.g., hand gesture), gaze, and / or speech of the user identified by the sensor (230).
[0060] For example, the perception abstract layer (260) can be used for data exchange between the virtual space manager (251) and the perception service layer (270). From the perspective of being used for data exchange between the virtual space manager (251) and the perception service layer (270), the perception abstract layer (260) can be referred to as an interface. For example, the perception abstract layer (260) can be referenced as OpenPX. The perception abstract layer (260) can be used for a perception client and a perception service.
[0061] According to one embodiment, the recognition service layer (270) may include one or more programs for processing data acquired from a sensor (230) (or a camera (225)). The one or more programs may include at least one of a position tracker (271), a space recognizer (272), a gesture tracker (273), an eye tracker (274), and / or a face tracker (273). The type and / or number of the one or more programs included in the recognition service layer (270) are not limited to those illustrated in FIG. 2.
[0062] For example, the wearable device (101) can identify the pose of the wearable device (101) using the sensor (230) based on the execution of the position tracker (271). The wearable device (101) can identify the 6 degrees of freedom pose (6 dof pose) of the wearable device (101) using data acquired using the camera (225) and the sensor (230) (e.g., IMU) based on the execution of the position tracker (271). The position tracker (271) may be referred to as a head tracking (HeT) module (or head tracking program).
[0063] For example, the wearable device (101) may be used to construct a three-dimensional virtual space around the wearable device (101) (or a user of the wearable device (101)) based on the execution of the space recognizer (272). The wearable device (101) may reconstruct the three-dimensional surroundings of the wearable device (101) using data acquired using the camera (225) based on the execution of the space recognizer (272). The wearable device (101) may identify at least one of a plane, a slope, and stairs based on the three-dimensionally reconstructed surroundings of the wearable device (101) based on the execution of the space recognizer (272). The space recognizer (272) may be referred to as a scene understanding (SU) module (or a scene understanding program).
[0064] For example, the wearable device (101) may identify (or recognize) a pose and / or gesture of a hand of a user of the wearable device (101) based on the execution of the gesture tracker (273). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user using data acquired from a sensor (230) based on the execution of the gesture tracker (273). As an example, the wearable device (101) may identify a pose and / or gesture of a hand of a user based on data (or images) acquired using a camera (225) based on the execution of the gesture tracker (273). The gesture tracker (273) may be referred to as a hand tracking (HaT) module (or hand tracking program) and / or a gesture tracking module.
[0065] For example, the wearable device (101) can identify (or track) eye movements of a user of the wearable device (101) based on the execution of the gaze tracker (274). As an example, the wearable device (101) can identify eye movements of the user using data acquired from at least one sensor based on the execution of the gaze tracker (274). As an example, the wearable device (101) can identify eye movements of the user based on data acquired using a camera (e.g., an gaze tracking camera (225-1)) and / or an infrared light emitting diode (IR LED) based on the execution of the gaze tracker (274). The gaze tracker (274) may be referred to as an eye tracking (ET) module (or eye tracking program), and / or a gaze tracking module.
[0066] For example, the recognition service layer (270) of the wearable device (101) may further include a face tracker (275) for tracking the user's face. For example, the wearable device (103) may identify (or track) the movement of the user's face and / or the user's expression based on the execution of the face tracker (275). The wearable device (101) may estimate the user's expression based on the movement of the user's face based on the execution of the face tracker (275). As an example, the wearable device (101) may identify the movement of the user's face and / or the user's expression based on data (e.g., an image) acquired using the camera (225) based on the execution of the face tracker (275).
[0067] In one embodiment, the wearable device (101) can be connected to an external electronic device (120) (e.g., a laptop (120-1), smartphones (120-2, 120-3), and / or a TV (120-4)) via a communication circuit (235). The wearable device (101) and the external electronic device (120) can be directly connected based on a wireless communication protocol such as Wi-Fi (e.g., Wi-Fi client, Wi-Fi Direct, WiFi-Aware) and / or SoftAP (software enabled access point). When a wearable device (101) and an external electronic device (120) are connected based on a Wi-Fi client and / or a SoftAP, a specific external electronic device such as a smartphone (120-2) may be set as a SoftAP, and the wearable device (101) may communicate with the smartphone (120-2) and / or other external electronic devices connected via the smartphone (120-2). The embodiment is not limited thereto, and the wearable device (101) and the external electronic device (120) may be indirectly connected based on an AP (access point) (or router). Between the wearable device (101) and the external electronic device (120) indirectly connected via the AP, a communication link for exchanging media content may be established based on a TDLS (tunneled direct link setup), or the media content may be exchanged or relayed.
[0068] In order to establish a communication link between the wearable device (101) and the external electronic device (120), the processor (210) of the wearable device (101) may control the communication circuit (235). For example, in a state of establishing a communication link based on a wireless local area network (WLAN) such as WiFi, the wearable device (101) may establish the communication link using a multi link operation (MLO). In addition, the wearable device (101) may calculate the number of NSSs (number of spatial streams), the bandwidth (or maximum bandwidth) of the communication link, and / or the number of links to be used for establishing a communication link with the external electronic device (120). The wearable device (101) may control the communication circuit (235) based on at least one parameter indicating the number of NSSs, the bandwidth, and / or the number of links, to establish a communication link for communicating with the external electronic device (120). The embodiment is not limited thereto, and the wearable device (101) may establish a communication link between the wearable device (101) and an external electronic device (120) based on a logical connection such as a session, a socket, and / or a port.
[0069] In one embodiment, the processor (210) may receive information for displaying a virtual object through a communication link established by the communication circuit (235) between the wearable device (101) and the external electronic device (120). The virtual object may correspond to at least a portion of a visualizable portion of media content included in the information. In response to receiving the information, the processor (210) may obtain a location of the virtual object with respect to the display (220) based on the information. The location may be calculated or determined differently depending on a mode for calculating the point of the virtual object (e.g., world-lock mode and / or body-lock mode).
[0070] For example, when information for displaying a virtual object in world-lock mode is received, the processor (210) may determine a reference point (e.g., GPS coordinates and / or a reference external object to which the virtual object is to be anchored) included in the information as a point at which the virtual object is to be displayed. The reference point at which the virtual object in world-lock mode is to be displayed may include a building and / or terrain located away from the wearable device (101), and / or an object that can move independently of the motion of the wearable device (101).
[0071] For example, when information for displaying a virtual object in body-lock mode is received, the processor (210) may determine a point at which the virtual object is to be displayed based on at least one of a reference point included in the information and / or a current point of the wearable device (101) identified by a sensor (230) (e.g., an IMU and / or a GPS sensor). The reference point may include a point that can move in conjunction with the motion of the wearable device (101) (e.g., a specific body part of the user (110), such as the hand of the user (110) wearing the wearable device (101). For example, when the reference point of the virtual object is set in front of the right eye of the user (110) wearing the wearable device (101), the wearable device (101) may determine a point at which the virtual object is to be displayed based on the current point of the wearable device (101). For example, if the reference point of the virtual object is set to the left wrist of the user (110) wearing the wearable device (101), the wearable device (101) can determine whether to display the virtual object and the point of the virtual object based on whether the left wrist is recognized through the external camera (225-2).
[0072] The processor (210) may display at least a portion of the virtual object on the display (220) based on the position of the virtual object obtained by information received from the external electronic device (120). The operation of displaying at least a portion of the virtual object may be referred to as rendering of the virtual object. The position and / or area of the virtual object displayed on the display (220) may be determined based on the relationship between the position of the virtual object and the viewpoint and / or view angle displayed through the display (220). For example, when information for displaying a virtual object based on a world-locked mode is received, the processor (210) may display the virtual object based on whether a point set as the position of the virtual object is included within the field-of-view (FoV) of the display (220) and / or the user (110) wearing the wearable device (101). For example, when information for displaying a virtual object based on a body-lock mode is received, the processor (210) can display the virtual object based on the positional relationship between the display (220) and the virtual object.
[0073] Based on the location of the virtual object (e.g., the location and / or vertex of the virtual object represented by 3D coordinate values), the processor (210) can calculate the size (or area) of at least a portion of the virtual object displayed on the display (220). The size of at least a portion of the virtual object displayed on the display (220) can be related to the number of pixels emitted on the display (220) to display the virtual object. For example, the processor (210) can calculate a ratio between the overall size of the virtual object and the size of at least a portion of the virtual object displayed on the display (220). Based on the size, the area, and / or the ratio, the processor (210) can perform an operation to adjust the amount of information received via the communication link. Hereinafter, the amount of information can mean the size of data required to display the virtual object on the display (220) for a specified period of time (e.g., about 1 second). According to one embodiment, the processor (210) of the wearable device (101) may change at least one parameter related to the control of the communication circuit (235) based on the amount of the information. The at least one parameter may be related to at least one of the number of NSSs, bandwidth, or number of links when a WiFi-based communication link is established.
[0074] In one embodiment, a processor (210) that displays a virtual object based on information received via a communication link may determine and / or calculate an amount of information required to display the virtual object based on a size of at least a portion of the virtual object displayed on a display (220). The amount of information may be related to a speed (e.g., a data rate and / or throughput) at which information is received via the communication link. The processor (210) may determine at least one parameter related to control of the communication circuit (235) based on a data rate corresponding to the calculated amount of information.
[0075] When displaying a virtual object in body-lock mode, since the virtual object is placed at a point associated with the wearable device (101) and / or the user (110) wearing the wearable device (101), the virtual object can have a fixed position on the display (220) independently of the motion of the wearable device (101) and / or the user (110). For example, the processor (210) can display the virtual object on the display (220) based on a substantially fixed size. When displaying a virtual object in world-lock mode, since the virtual object is placed at a fixed point in external space, the position of the virtual object with respect to the display (220) can be changed by the motion of the wearable device (101) and / or the user (110). For example, the virtual object can be moved outside the periphery of the display (220). The processor (210) may display a virtual object having a variable size on the display (220) based on the positional relationship between the point set for displaying the virtual object and the wearable device (101). The overall size of the virtual object may have the size of a display included in an external electronic device (120) connected to the wearable device (101) via a communication circuit (235). Since the position of the virtual object with respect to the display (220) changes by the motion of the wearable device (101) and / or the user (110), the size of the virtual object displayed on the display (220) may be reduced to less than the overall size depending on the motion.
[0076] In one embodiment, the processor (210) may display, on the display (220), at least a portion of a virtual object associated with a point in external space specified by information received from an external electronic device (120). The virtual object may be fixed to the point and / or may float on the display (220) based on a world-locked mode. While displaying at least a portion of the virtual object, the processor (210) may change at least one parameter for controlling the communication circuit (235) based on a size of at least a portion of the virtual object displayed on the display (220). The at least one parameter may be changed to optimize an amount of information received via a communication link and used for displaying the virtual object. For example, when the size of the virtual object within the display (220) is reduced, the processor (210) can change at least one parameter for controlling the communication circuit (235) to reduce communication resources occupied by the data rate, the number of NSSs, the bandwidth, and / or the number of links of the communication link. For example, when the size of the virtual object within the display (220) is increased, the processor (210) can change at least one parameter for controlling the communication circuit (235) to increase communication resources occupied by the data rate, the number of NSSs, the bandwidth, and / or the number of links of the communication link.
[0077] In one embodiment, the processor (210) may receive information from the external electronic device (120) via a communication link to display all of a first virtual object set to be displayed in a body-lock mode and a second virtual object set to be displayed in a world-lock mode. Based on the information, the wearable device (101) may display the first virtual object at a fixed point on the display (220). Based on the information, the wearable device (101) may display at least a portion of the second virtual object on the display (220) based on a positional relationship between a point linked to the second virtual object and an FoV visible (or displayed) through the display (220). In the example, the wearable device (101) may calculate a first amount of information required to display a first virtual object having a fixed size on the display (220), and a second amount of information required to display at least a portion of the second virtual object displayed on the display (220). The wearable device (101) may change at least one parameter for controlling the communication circuit (235) based on the sum of the first quantity and the second quantity. For example, the wearable device (101) may change the at least one parameter to receive the information at a data rate based on the sum via the communication link. The data rate may be determined to receive the information within a delay time required for displaying the first virtual object and / or the second virtual object.
[0078] As described above, the virtual object displayed on the display (220) by the processor (210) of the wearable device (101) may be displayed at a point determined based on the body-lock mode and / or the world-lock mode. When the virtual object is displayed based on the world-lock mode, the size, resolution, and / or the ratio between the overall size of the virtual object displayed on the display (220) and the size of a portion of the virtual object within the FoV visible through the display (220) may be changed by the motion of the wearable device (101). In one embodiment, the processor (210) may change the size, shape, and / or position of the virtual object displayed on the display (220) based on motion identified using a sensor (230) (e.g., an IMU). For example, when the distance between the wearable device (101) and the point decreases, the processor (210) may increase the size and / or resolution of the virtual object displayed on the display (220). For example, when the distance between the wearable device (101) and the point increases, the processor (210) may decrease the size and / or resolution of the virtual object displayed on the display (220).
[0079] In one embodiment, the processor (210) may perform operations to adjust the amount of information received via the communication link. For example, the processor (210) may control the communication circuit (235) to change parameters associated with the communication link (e.g., bandwidth, number of NSSs, and / or number of links distinguished by frequencies). Based on the changes in the parameters, the processor (210) may cause the communication link to have an appropriate data rate to correspond to the amount of information required to display a virtual object on the display (220).
[0080] The operations performed by the processor (210) to adjust the amount of information received through the communication link are not limited to the operations described above, which are performed to change at least one parameter for controlling the communication circuit (235). For example, the processor (210) may communicate with an external electronic device (120) for providing a virtual object and inform the external electronic device (120) of the amount of information required to display the virtual object on the display (220). For example, the processor (210) may inform the external electronic device (120) of the size, ratio, and / or resolution of the virtual object displayed on the display (220) through the communication circuit (235). For example, the processor (210) may request the external electronic device (120) to transmit only information for displaying a portion of the virtual object displayed on the display (220).
[0081] For example, if a virtual object being displayed based on the world-lock mode moves outside the edge of the display (220), the processor (210) may request the external electronic device (120) to stop transmitting information for displaying the virtual object. After the request, the processor (210) may change the state of the communication circuit (235) that was activated to communicate with the external electronic device (120) to a sleep state. If the reception of information and / or media content included in the information is stopped by the request, the processor (210) may reset at least one parameter for controlling the communication circuit (235) and change the state of the communication circuit (235) to the sleep state.
[0082] Hereinafter, with reference to FIG. 3, exemplary operations of the wearable device (101) and / or processor (210) described with reference to FIG. 1 and / or FIG. 2 are described.
[0083] FIG. 3 illustrates an example of a flowchart of a wearable device according to one embodiment. The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) may perform at least one of the operations described with reference to FIG. 3.
[0084] Referring to FIG. 3, while multiple operations are depicted as being performed sequentially, the embodiment is not limited thereto. For example, at least two of the operations in FIG. 3 may be performed substantially simultaneously. For example, the operations in FIG. 3 may be performed in a different order than the order depicted in FIG. 3.
[0085] Referring to FIG. 3, in operation (310), according to one embodiment, a processor of a wearable device may receive information for displaying one or more media contents from an external electronic device (e.g., the external electronic device (120) of FIG. 1) via a communication link. The processor may control a communication circuit (e.g., the communication circuit (235) of FIG. 2) to establish a communication link between the wearable device and the external electronic device. Through the communication link, the processor may receive information for displaying one or more media contents from the external electronic device. The information may include a type of one or more media contents (e.g., text, image, video, audio, or a combination thereof).
[0086] Referring to FIG. 3, in operation (320), according to one embodiment, the processor of the wearable device may identify media content in body-lock mode and / or media content in world-lock mode based on received information. For example, the information received based on operation (310) may include a mode (e.g., body-lock mode and / or world-lock mode) for setting points at which one or more media contents are to be displayed. If the processor cannot identify a mode for displaying one or more media contents through the information, the processor may determine a mode for displaying one or more media contents based on a setting value input by a user (e.g., a user (110) wearing the wearable device (101) of FIG. 1) and / or a type of external electronic device.
[0087] In one embodiment, when information for displaying one or more media contents is received based on operation (310), the processor of the wearable device may classify the plurality of media contents into either a body-lock mode or a world-lock mode. The processor that has identified at least one virtual object classified into the body-lock mode may identify, based on the information received based on operation (310), a fixed point on a display (e.g., display (220) of FIG. 2) where the at least one virtual object is to be displayed. The processor that has identified at least one virtual object classified into the world-lock mode may identify, based on the information received based on operation (310), a reference point where the at least one virtual object is to be displayed within an external space including the wearable device.
[0088] Within a state in which one or more media contents included in the information are to be displayed based on the operation (320), the processor may display the one or more media contents based on the identified mode. For example, the processor may display a first virtual object at a fixed point on the display based on a body-lock mode, and may display a second virtual object based on a world-lock mode on the display as an overlay at the specific point based on whether the display and / or the wearable device is facing a specific point in external space.
[0089] Referring to FIG. 3, in operation (330), according to one embodiment, a processor of a wearable device may obtain an amount of information required for displaying media content in a body-lock mode. The processor may obtain and / or calculate the amount of information required for displaying media content in a body-lock mode based on a frame rate of the media content and / or a size of a frame of the media content. The frame rate may have a unit such as, for example, frames per second (fps). The size of the frame may be identified based on a width, height, and / or capacity of the frame. The capacity may have a unit of, for example, bytes. The media content in a body-lock mode may be continuously displayed at a fixed point on the display while receiving information for displaying one or more media contents based on operation (310).
[0090] Based on the operation (330), the processor may calculate a size, ratio (e.g., a ratio between the overall size of the media content and the size of at least a portion of the media content displayed on the display), and / or resolution of the media content displayed on the display based on the body-lock mode. Since the media content displayed based on the body-lock mode is continuously displayed at a fixed point on the display, the calculated size, ratio, and / or resolution may remain constant until the media content disappears from the display. The embodiment is not limited thereto.
[0091] Referring to FIG. 3, in operation (340), a processor of a wearable device according to one embodiment may obtain an amount of information required for displaying media content in a world-locked mode. The processor may obtain and / or calculate the amount of information required for displaying media content in a world-locked mode based on a location of the media content within a FoV displayed through a display. In a case where the processor provides a user experience related to VR, the FoV displayed through the display may correspond to at least a portion of a virtual space for VR. In the case, the processor may calculate at least a portion of the virtual space displayed through the display and / or a size of the at least portion based on a location of the media content within the virtual space.
[0092] Based on the operation (340), the processor can identify the size, ratio (e.g., the ratio between the overall size of the virtual object and the size of a portion of the virtual object displayed on the display), and / or resolution of the virtual object displayed on the display. The processor can calculate the size and / or ratio based on a margin and / or padding surrounding the FoV corresponding to the display. For example, the ratio calculated by the processor can correspond to a ratio between the size of the virtual object and the size of a portion of the virtual object included in an area including the margin.
[0093] Referring to FIG. 3, within operation (350), according to one embodiment, a processor of a wearable device may determine a data rate for a communication link based on the amount of information acquired. The data rate and / or throughput may be calculated to maintain the display of one or more media contents while minimizing power consumption (or current consumption) of the wearable device. For example, while a WiFi-based communication link is established, the processor may calculate, obtain, and / or identify the data rate based on Equation 1.
[0094]
[0095] Referring to mathematical expression 1, the data rate of a communication link may be related to a relatively smaller parameter among the signal-to-noise ratio (SNR) of a subcarrier included in the communication link and MaxBitsPerSc. MaxBitsPerSc in mathematical expression 1 may be the maximum value of the number of bits that can be transmitted through each of the subcarriers included in the communication link. The maximum value may be related to the sum of the amounts of information of operations (330) and (340). For example, MaxBitsPerSc may be determined and / or set based on a modulation and coding scheme (MCS) level. NSS in mathematical expression 1 may be the number of spatial streams. NSS in mathematical expression 1 may be related to the number of antennas used for the communication link. N in mathematical expression 1 tone , may be the number of subcarriers. The number of subcarriers may be related to the bandwidth. DSYM of mathematical expression 1 DUR , may be a symbol duration. Referring to Equation 1, the processor can calculate the data rate for each combination of SNR, NSS, and / or bandwidth.
[0096] Referring to FIG. 3, in operation (360), a processor of a wearable device according to an embodiment may change at least one parameter related to control of a communication circuit based on a determined data rate. The data rate of operation (360) may be determined based on Equation 1. The processor may control the communication circuit to receive information for displaying one or more media contents in operation (310) based on a throughput that satisfies the data rate of operation (360). The processor may change the at least one parameter related to control of the communication circuit to change a state and / or mode (e.g., a communication mode) of the communication circuit. For example, the processor may optimize the data rate by changing the at least one parameter based on operation (360) from a state in which information for displaying one or more media contents is received based on a maximum value of the data rate.
[0097] In one embodiment, the processor may obtain and / or identify a throughput of each of the communication links (or bandwidths) by performing a calculation based on Equation 2 using the data rates of each of the communication links (or bandwidths) identified based on Equation 1.
[0098]
[0099] AirFraction in Equation 2 BW Silver may be a period of time (e.g., airtime) during which the link and / or bandwidth (BW) may be occupied. The processor may estimate the period based on a ratio between the CCA busy time and the Radio on time for each bandwidth. For example, the processor may estimate a period of time during which a link of a particular bandwidth is empty (e.g., not occupied by any adjacent electronic device) based on the ratio. DataRate in Equation 2 NSS,BWThe data rate may be calculated from Equation 1 based on a combination of NSS and bandwidth. Referring to Equation 2, the processor may calculate the throughput based on the multiplication of the period and the data rate. Each of the terms included in Equations 1 and 2 may be referred to as a parameter related to the control of the communication circuit.
[0100] The processor may compare the throughput obtained based on Equation 2 with the sum of the amounts of information obtained based on operations (330, 340). The processor may identify at least one combination of NSS and bandwidth that makes the throughput of Equation 2 greater than the sum. If the throughputs corresponding to a plurality of combinations are greater than the sum, the processor may identify a combination that minimizes current consumption of the communication circuit among the combinations. If all of the throughputs corresponding to the plurality of combinations are less than the sum, the processor may increase the number of communication links. Based on one or more parameters included in the identified combination (e.g., at least one of the terms of Equation 1 and / or Equation 2, such as NSS and bandwidth (or link)), the processor may control the communication circuit. For example, the communication circuit may be controlled to form a communication link having an NSS and / or bandwidth included in the identified combination.
[0101] Although an embodiment of a wearable device controlling a communication circuit based on mathematical expressions 1 and / or 2 related to WiFi has been described, the embodiment is not limited thereto. In one embodiment, a processor of the wearable device may establish a number of communication links based on a data rate of operation (350) based on a multi-link operation (MLO) method while performing a WiFi-based association. The MLO method may be performed by the wearable device based on the WiFi 7 standard. The processor may establish a communication link based on multiple input multiple output (MIMO) using the number of NSSs included in the combination identified based on mathematical expressions 1 and 2, and may determine a maximum available bandwidth for the communication link. In one embodiment, a processor of a wearable device may establish one or more logical connections (e.g., logical connections distinguished by sessions and / or sockets) distinguished by port numbers to receive information for displaying one or more media contents based on a data rate of operation (350). At least one parameter of operation (360) may include the number of logical connections required to receive information based on the data rate.
[0102] As described above, in one embodiment, the processor of the wearable device may calculate a data rate and / or throughput required to receive the first information and the second information based on an amount of first information required for displaying media content in a body-lock mode and an amount of second information required for displaying media content in a world-lock mode on the display. The amount of second information may be related to a size and / or resolution of the media content on the display. The processor may control the communication circuit based on at least one parameter that minimizes current consumption of the communication circuit and / or the wearable device while satisfying the data rate.
[0103] For example, assume that the maximum number of simultaneously available links (or bandwidths) is 2, the maximum number of available NSSs is 2, and the maximum available bandwidths are 20 MHz for the first link and 160 MHz for the second link. Within the above assumptions, if only the first link among the two links is used, the NSS of the communication link is 1, and the minimum bandwidth (20 MHz) is used, the power consumption of the communication circuit can be minimized. Within the above assumptions, if both the first link and the second link are used, the NSS of each communication link is 2, and the maximum bandwidths (20 MHz and 160 MHz) of each link are used, the power consumption of the communication circuit can be maximized. The processor can obtain a data rate (e.g., a data rate calculated based on Equation 1) and / or a throughput (e.g., a throughput calculated based on Equation 2) for each of the combinations of the number of links, the number of NSSs, and the bandwidth described above. By comparing the sum of the amounts of information of the operations (330, 340), the data rate, and / or the throughput, the processor can identify a combination among the combinations that guarantees reception of information equivalent to the sum while minimizing the power consumption. The processor can establish a communication link corresponding to the combination by controlling a communication circuit based on the number of links, the number of NSSs, and / or the bandwidth included in the identified combination. Through the communication link, the processor can receive information equivalent to the sum while minimizing the power consumption.
[0104] Hereinafter, with reference to FIG. 4, exemplary operations of a wearable device displaying media content in body-lock mode of operation (330) and / or media content in world-lock mode of operation (340) are described.
[0105] FIG. 4 illustrates exemplary screens (401, 402) displayed based on motions identified by a wearable device (101). The wearable device (101) of FIGS. 1 and 2, and / or the processor (210) of FIG. 2, may perform the operations described with reference to FIG. 4.
[0106] Referring to FIG. 4, an exemplary state of a wearable device (101) that is communicatively connected to an external electronic device (120), such as a smartphone (e.g., smartphone (120-2) of FIG. 2), is illustrated. Within the exemplary state of FIG. 4, the wearable device (101) may receive information for displaying a plurality of media contents through a communication link (440) between the wearable device (101) and the external electronic device (120), which is established by a communication circuit of the wearable device (101) (e.g., communication circuit (235) of FIG. 2). The wearable device (101) that has received the information may display virtual objects (420, 430) corresponding to each of the media contents included in the information within a first screen (401). For example, the virtual object (420) may include an execution screen of a software application (e.g., a web browser) executed by the smartphone (120-2). For example, the virtual object (430) may include a visual object (e.g., a toast and / or a notification object) corresponding to a push notification (or push message) received via the smartphone (120-2).
[0107] Referring to FIG. 4, the wearable device (101) can determine and / or calculate points of virtual objects (420, 430) in a virtual space (410) based on either a body-lock mode or a world-lock mode. For example, reference locations of each of the virtual objects (420, 430) set by information received from an external electronic device (120), such as a smartphone (120-2), can be identified. From the information, the wearable device (101) that has identified a virtual object (420) based on the world-lock mode can identify a point (s1) in an external space (or a virtual space (410) linked with the external space) associated with the virtual object (420). From the above information, the wearable device (101) that has identified a virtual object (430) based on the body-lock mode can identify a point on the display associated with the virtual object (430).
[0108] According to one embodiment, the wearable device (101) can identify the motion and / or direction of the wearable device (101) based on a sensor (e.g., sensor (230) of FIG. 2). While the wearable device (101) is facing a direction (D1), the wearable device (101) can display a screen (401) based on a direction (V1) within a virtual space (410) corresponding to the direction (D1). The screen (401) can include a portion of the virtual space (410) viewed along the direction (V1) from a point (P) within the virtual space (410) corresponding to the wearable device (101). When a virtual object (420) placed at a point (s1) in a virtual space (410) based on a world-lock mode is included in a part of the virtual space (410) viewed from the point (P) along a direction (V1), the virtual object (420) may be displayed in a screen (401) displayed by a wearable device (101). While the wearable device (101) manages a virtual space (410) associated (interlocked) or linked (coupled, connected) with an external space based on simultaneous localization and mapping (SLAM), the point (s1) may be associated with a specific point of the external space. Referring to FIG. 4, a virtual object (420) having a two-dimensional plane shape representing an execution screen of a web browser executed by a smartphone (120-2) is illustrated as an example, but the embodiment is not limited thereto.
[0109] Within a state of displaying a screen (401), the wearable device (101) can display a virtual object (430-1) at a point (s2) within the screen (401) based on a body-lock mode. The virtual object (430-1) displayed within the screen (401) can correspond to a virtual object (430) based on a body-lock mode. While displaying the screen (401), the wearable device (101) can display a virtual object (430-1) at a point (s2) based on a body-lock mode, which is indicated by information transmitted from an external electronic device (120), such as a smartphone (120-1).
[0110] In one embodiment, a wearable device (101) that displays media contents (e.g., virtual objects (420, 430)) provided from an external electronic device (120), such as a smartphone (120-2), can identify user input related to the media contents. The user input can be identified, for example, based on a gaze, hand gesture, speech, or a combination thereof of a user (110) wearing the wearable device (101). The wearable device (101) that has identified the user input can transmit information related to the user input to the smartphone (120-2) via a communication link (440). Based on the transmission of the information, the wearable device (101) can cause the smartphone (120-2) to identify and / or react to the user input. The smartphone (120-2) can execute a function corresponding to the user input based on the information transmitted from the wearable device (101).
[0111] For example, a wearable device (101) that identifies a user input for a virtual object (420) including an execution screen of a web browser executed by a smartphone (120-2) may request the smartphone (120-2) to execute a function of the web browser related to the user input. In response to the request, the smartphone (120-2) may transmit a result of executing the function (or the execution screen including the result) to the wearable device (101), thereby causing the wearable device (101) to display the result within the screen (401).
[0112] For example, a wearable device (101) that identifies a user input for a virtual object (430-1) within a screen (401) that includes a push message for notifying the receipt of a text message may transmit information related to the user input to a smartphone (120-2). The smartphone (120-2) that receives the information may execute a software application (e.g., a messenger application) corresponding to the push message based on the user input. The smartphone (120-2) may transmit information for displaying an execution screen of the messenger application to the wearable device (101) via a communication link (440). Based on the information, the wearable device (101) may additionally display a virtual object corresponding to the execution screen of the messenger application within the screen (401).
[0113] According to one embodiment, a wearable device (101) can identify a motion of a user (110) wearing the wearable device (101) based on a sensor. In the exemplary case of FIG. 4, as the user (110) rotates his / her head clockwise, the direction of the head may change from direction (D1) to direction (D2). The wearable device (101) can identify the rotation of the head based on the sensor, such as an IMU. Within a virtual space (410) associated with an external space, the wearable device (101) that has identified the rotation can identify a portion of the virtual space (410) viewed from a point (P) along a direction (V2) within the virtual space (410) corresponding to the direction (D2) of the head changed by the rotation. The screen (402) of FIG. 4 may be a screen displayed on a display of the wearable device (101) that has identified the rotation. The screen (402) may include a portion of the virtual space (410) viewed from a point (P) in the virtual space (410) along a direction (V2).
[0114] While the direction of the user's (110) head changes from direction (D1) to direction (D2), the screen displayed through the display may be gradually changed from screen (401) to screen (402). A virtual object (420) placed at a point (s1) in a virtual space (410) based on a world-lock mode may be moved toward the left edge of the display while the direction of the head changes from direction (D1) to direction (D2). Within the screen (402) corresponding to a part of the virtual space (410) viewed along the direction (V2), a part of the virtual object (420) may be placed outside the left edge of the screen (402) (or display). A virtual object (430) placed within a virtual space (410) based on a body-lock mode can be gradually moved within the virtual space (410) so as to be fixed to a specific point (e.g., the upper right corner of the screen) on the display while the direction of the head changes from direction (D1) to direction (D2). Within a screen (402) corresponding to a portion of the virtual space (410) viewed along the direction (V2), the wearable device (101) can display a virtual object (430-2) moved to a point (s3) within the virtual space (410).
[0115] Referring to FIG. 4, while the direction of the user's (110) head changes from direction (D1) to direction (D2), a virtual object (420) placed at a point (s1) based on the world-lock mode may not move within the virtual space (410). While the direction of the user's (110) head changes from direction (D1) to direction (D2), a point within the virtual space (410) of a virtual object (430) based on the body-lock mode may move from point (s2) to point (s3). Referring to screens (401, 402) displayed while the direction of the user's (110) head changes from direction (D1) to direction (D2), the wearable device (101) may provide the user (110) with a user experience as if the virtual object (430) is fixed to the upper right edge of the display (or FoV of the user (110)).
[0116] According to one embodiment, the wearable device (101) can adaptively change the amount of information received via the communication link (440) based on the operation described with reference to FIG. 3. For example, the wearable device (101) can change at least one parameter related to the control of the communication circuit so that the amount of information received via the communication link (440) corresponds to the size of at least a portion of a virtual object displayed on the display (e.g., a virtual object (420) based on a world-lock mode).
[0117] For example, at a first timing for displaying a screen (401), the wearable device (101) may receive information for displaying the entire virtual object (420) and the virtual object (430-1) from the smartphone (120-2) to display the screen (401) including the entire virtual object (420) and the virtual object (430-1). At the first timing, the data rate (or processing rate) of the communication link (440) may be determined based on the amount of information required to display the entire virtual object (420) and the virtual object (430-1).
[0118] For example, while the direction of the user's (110) head changes from direction (D1) to direction (D2), the first part (420-1) of the virtual object (420) may disappear from the display because the first part (420-1) of the virtual object (420) moves beyond the left edge on the display. At the second timing of displaying the screen (402), the wearable device (101) may receive information from the smartphone (120-2) to display the second part (420-2) of the virtual object (420) and the virtual object (430-2) in order to display the screen (402) including the second part (420-2) of the virtual object (420) and the virtual object (430-2) that are different from the first part (420-1). For example, a wearable device (101) may request information for displaying a screen (402) including a second part (420-2) of a virtual object (420) and a virtual object (430-2) from a smartphone (120-2).
[0119] At the second timing, the wearable device (101) may control the communication circuit so that the data rate (or processing rate) of the communication link (440) corresponds to the amount of information required to display the second portion (420-2) and the virtual object (430-2) of the virtual object (420). For example, since information for displaying the first portion (420-1) of the virtual object (420) is not transmitted via the communication link (440), the data rate and / or processing rate of the communication link (440) at the second timing may be lower than the data rate and / or processing rate of the communication link (440) at the first timing. For example, the power consumption of the communication circuit for forming the communication link (440) at the first timing may be higher than the power consumption of the communication circuit for forming the communication link (440) at the second timing. For example, the NSS for forming a communication link (440) at the first timing may be greater than the NSS for forming a communication link (440) at the second timing. For example, the number of antennas activated for forming a communication link (440) at the first timing may be greater than the number of antennas activated for forming a communication link (440) at the second timing. For example, the number of communication links (440) at the first timing may be greater than the number of communication links for forming a communication link (440) at the second timing. For example, the bandwidth for forming a communication link (440) at the first timing may have a higher frequency than the bandwidth for forming a communication link (440) at the second timing.
[0120] After the second timing of displaying the second part (420-2) of the virtual object (420), if the user (110) continuously rotates his / her head, the second part (420-2) of the virtual object (420) may move beyond the left edge. For example, the entire virtual object (420) may disappear from the display. When the entire virtual object (420) disappears, or when all virtual objects (420, 430) disappear from the display, the wearable device (101) may release the communication link established to receive media content in a world-locked mode such as the screen (420), or change the communication circuit to a sleep state.
[0121] As described above, while receiving information for displaying media content such as virtual objects (420, 430) from an external electronic device (120), such as a smartphone (120-2), the wearable device (101) can adaptively adjust the communication link (440) for receiving the information based on the amount of the information. Based on the adaptive adjustment of the communication link (440), the wearable device (101) can reduce the power consumption of the communication circuit activated for the communication link (440). For example, while displaying a virtual object (420) based on a world-lock mode on the display, the wearable device (101) can adjust the communication link (440) based on the size of a portion of the virtual object (420) displayed within the display, which changes based on a motion identified by the wearable device (101).
[0122] FIG. 5 illustrates an example flowchart of a wearable device according to one embodiment. The wearable device (101) and / or the processor (210) of FIGS. 1 and 2 may perform at least one of the operations described with reference to FIG. 5 . The operations of the wearable device described with reference to FIG. 5 may be performed at least partially similarly to, and / or related to, the operations of FIG. 3 .
[0123] Referring to FIG. 5, while multiple operations are depicted as being performed sequentially, the embodiment is not limited thereto. For example, at least two of the operations of FIG. 5 may be performed substantially simultaneously. For example, the operations of FIG. 5 may be performed in a different order than the order depicted in FIG. 5.
[0124] Referring to FIG. 5 , in operation (510), according to one embodiment, a processor of a wearable device may receive information for displaying one or more media contents from an external electronic device via a communication link. Operation (510) of FIG. 5 may be performed similarly to operation (310) of FIG. 3 .
[0125] Referring to FIG. 5, in operation (520), a processor of a wearable device according to an embodiment may identify media content in a body-lock mode based on received information. The media content of operation (520) may include the virtual object (430) of FIG. 4. The processor may identify whether the media content corresponds to a body-lock mode or a world-lock mode based on flags and / or properties associated with the media content included in the information for displaying one or more media contents based on operation (310). Having identified the media content in the body-lock mode, the processor may identify a reference point at which the media content is to be displayed (or anchored) based on the information for displaying one or more media contents based on operation (310). The processor may display at least a portion of the media content on a display (e.g., display (220) of FIG. 2) based on operation (520).
[0126] Referring to FIG. 5, in operation (530), a processor of a wearable device according to an embodiment may obtain an amount of information required for displaying media content in a body-lock mode. Since the media content in the body-lock mode is displayed at a fixed point on the display, the amount of information required for displaying the media content may be maintained at a constant amount while the media content is displayed. The amount of information may be expressed in bytes and may be related to a frame rate for the media content and / or a size (or dimension) of the media content. Since the media content in the body-lock mode is displayed at a fixed point on the display, the size of the media content may be maintained at a constant size.
[0127] Referring to FIG. 5, within operation (540), a processor of a wearable device according to one embodiment may obtain a throughput based on at least one parameter related to the control of a communication circuit. The processor may calculate a data rate and / or throughput required to receive information based on the amount of operation (530), based on Equations 1 and / or 2.
[0128] Referring to FIG. 5, in operation (550), a processor of a wearable device according to an embodiment may determine at least one parameter based on an amount of information acquired. The at least one parameter of operation (550) may correspond to at least one of the terms of Equation 1 and / or Equation 2. The processor may identify, among combinations of parameters having a throughput greater than or equal to the throughput of operation (540), a combination that minimizes power consumption of a communication circuit (e.g., the communication circuit (235) of FIG. 2). By controlling the communication circuit based on the parameters included in the combination, the processor may form a communication link having the throughput of operation (540) (i.e., a throughput required to receive information based on the amount of operation (530)).
[0129] Referring to FIG. 5, within operation (560), according to one embodiment, the processor of the wearable device may identify whether outputting media content has been stopped. While continuing to output the media content (560—No), the processor may perform at least one of operations (530, 540, 550, 560) of FIG. 5 to continue displaying the media content in the body-lock mode and maintain controlling the communication circuitry based on at least one parameter of operation (550). In one embodiment, the processor of the wearable device may bypass (or skip) or stop performing operations (530, 540, 550) if the media content in the body-lock mode has not changed. If outputting the media content has been stopped (560—Yes), the processor may perform operation (570). If information for displaying media content does not exist, the processor may perform operation (570).
[0130] In one embodiment, media content displayed at a point on a display based on a body-lock mode can be removed from the display in response to user input related to the media content. For example, in response to an input indicating selection of a visual object (e.g., a close button) displayed with the media content, the processor can at least temporarily stop displaying the media content on the display.
[0131] Referring to FIG. 5, in operation (570), according to one embodiment, a processor of a wearable device may change the state of a communication link to a sleep state. The sleep state of operation (570) may include a state in which only a beacon signal and / or a management frame (e.g., an 802.11 management frame) for identifying the wearable device is transmitted. The sleep state of operation (570) may be performed to reduce power consumption of a communication circuit while maintaining a communication link established for receiving media content (e.g., the communication link of operation (310)).
[0132] Since the media content is displayed at a fixed point and / or fixed size on the display based on the body-lock mode, the amount of information of the operation (530) can remain constant while the media content is displayed. When the processor identifies media content associated with a fixed point on the wearable device, the processor can maintain at least one parameter for controlling the communication circuitry, since the amount of information required for displaying the media content remains constant.
[0133] FIG. 6 illustrates an example flowchart of a wearable device according to one embodiment. The wearable device (101) and / or the processor (210) of FIGS. 1 and 2 may perform at least one of the operations described with reference to FIG. 6. The operations of the wearable device described with reference to FIG. 6 may be performed at least partially similarly to, and / or related to, the operations of FIGS. 3 and / or 5.
[0134] Referring to FIG. 6, while multiple operations are depicted as being performed sequentially, the embodiment is not limited thereto. For example, at least two of the operations of FIG. 6 may be performed substantially simultaneously. For example, the operations of FIG. 6 may be performed based on a different order than the order depicted in FIG. 6.
[0135] Referring to FIG. 6, within operation (610), according to one embodiment, a processor of a wearable device may receive information for displaying one or more media contents from an external electronic device via a communication link. Operation (610) of FIG. 6 may be performed similarly to operation (310) of FIG. 3.
[0136] Referring to FIG. 6, in operation (620), a processor of a wearable device according to an embodiment may identify media content in a world-lock mode based on received information. The media content of operation (620) may include a virtual object (420) of FIG. 4. The processor may identify whether the media content corresponds to a body-lock mode or a world-lock mode based on flags and / or properties associated with the media content included in the information for displaying one or more media contents based on operation (310). Having identified the media content in a world-lock mode, the processor may identify a reference point in an external space associated with the media content based on the information for displaying one or more media contents based on operation (310). The processor may display at least a portion of the media content on a display (e.g., display (220) of FIG. 2) based on operation (620). Depending on the positional relationship between the above reference point and the wearable device, media content in world-lock mode may not be displayed on the display.
[0137] Referring to FIG. 6, in operation (625), a processor of a wearable device according to one embodiment may obtain an amount of information required for displaying media content in world-lock mode. Since the media content in world-lock mode moves on the display according to a positional relationship between the wearable device and a point associated with the media content, the amount of information required for displaying the media content may vary according to the positional relationship. The amount of information may, for example, be related to a size of at least a portion of the media content displayed on the display.
[0138] Referring to FIG. 6, in operation (630), a processor of a wearable device according to one embodiment may obtain a throughput based on at least one parameter related to the control of a communication circuit. The processor may calculate or obtain a data rate and / or throughput required to receive information based on the amount of information obtained in operation (625), based on Equation 1 and / or Equation 2.
[0139] Referring to FIG. 6, in operation (635), a processor of a wearable device according to an embodiment may determine at least one parameter based on the amount of information acquired. The at least one parameter based on operation (635) may correspond to at least one of the terms of Equation 1 and / or Equation 2. The processor may identify, among combinations of parameters having processing rates acquired in operation (630), a combination that minimizes the amount of current input to a communication circuit (e.g., communication circuit (235) of FIG. 2). The processor may control the communication circuit based on the parameters included in the combination. While the communication circuit is controlled based on the parameters, a communication link having a processing rate required for receiving information may be formed based on the amount of information acquired in operation (625).
[0140] Referring to FIG. 6, within operation (640), a processor of a wearable device according to one embodiment may determine whether outputting media content has been interrupted. While the media content is displayed on the display (640—No), the processor may perform operation (650). If outputting the media content has been interrupted (640—Yes), the processor may perform operation (645).
[0141] Referring to FIG. 6, in operation (645), according to one embodiment, the processor of the wearable device may change the state of the communication link to a sleep state. While receiving information from an external electronic device to display only media content in world-lock mode, if the display of the media content is interrupted, the processor may control the communication circuit similar to operation (570) of FIG. 5 to change at least one parameter to reduce the current consumption of the communication circuit while maintaining the communication link. After the state of the communication link has been changed to a sleep state, if the reference point where the media content in world-lock mode is displayed re-enters the display, the processor may change the communication link to an active state. Through the re-established communication link, the processor may receive information to resume the display of the media content.
[0142] Referring to FIG. 6, in operation (650), a processor of a wearable device according to one embodiment may identify a positional relationship between a FoV and media content displayed through a display. For example, the processor may identify a positional relationship between a portion of a virtual space (e.g., virtual space (410) of FIG. 4) corresponding to the FoV and a point where the media content is placed.
[0143] Referring to FIG. 6, within operation (655), a processor of a wearable device according to one embodiment may determine whether a distance between media content and the FoV exceeds a specified distance. Since the media content is likely to re-enter the display and / or the FoV if the media content is positioned adjacent to the display and / or the FoV even after the media content has moved out of the display and / or the FoV, the processor may maintain the communication link using the specified distance (or margin). For example, if the distance between the media content and the FoV is less than or equal to the specified distance (655—No), the processor may continue to receive information over the communication link based on operations (625, 630, 635, 640), and / or continue to control the communication circuitry based on at least one parameter. If the distance between the media content and the FoV exceeds the specified distance (655—Yes), the processor may perform operation (660).
[0144] Referring to FIG. 6, within operation (660), a processor of a wearable device according to one embodiment may change the state of a communication link to a sleep state. The processor may control the communication circuit similar to operation (570) of FIG. 5 and / or operation (645) of FIG. 6 to at least temporarily stop receiving information for displaying one or more media contents based on operation (310). The processor performing operation (660) may identify a location of the media contents relative to the display based on operation (650) of FIG. 6.
[0145] Referring to FIGS. 1 to 6 , the operation of a wearable device based on media content that can be visualized on a display has been described, but the embodiment is not limited thereto. In one embodiment, a processor may receive media content including only audio from an external electronic device via a communication link. For example, the processor may receive media content including audio that is set to be played only at a specific point based on a world-locked mode. The processor, having received the media content, may calculate a data rate required for outputting the audio based on a distance between the specific point and a point on the wearable device. Based on the calculated data rate, the processor may determine at least one of an amount of information received via the communication link, a throughput corresponding to the amount, and / or one or more parameters (e.g., terms of Equation 1 and / or Equation 2) for ensuring the throughput. Based on the determined one or more parameters, the processor may control a communication circuit. In one embodiment of the present invention, wherein the processor receives media content including audio that is set to play only at a specific point based on a world-lock mode, the processor may change the state of the communication link to a sleep state, similar to operations (660, 645) of FIG. 6, when the wearable device is moved beyond a specified distance from the specific point.
[0146] FIG. 7 illustrates an example of a flowchart of a wearable device according to one embodiment. The wearable device (101) and / or the processor (210) of FIGS. 1 and 2 may perform at least one of the operations described with reference to FIG. 7. The operations of the wearable device described with reference to FIG. 7 may be performed at least partially similarly to, and / or related to, the operations of FIGS. 3, 5, and / or 6.
[0147] Referring to FIG. 7, while multiple operations are depicted as being performed sequentially, the embodiment is not limited thereto. For example, at least two of the operations in FIG. 7 may be performed substantially simultaneously. For example, the operations in FIG. 7 may be performed in a different order than the order depicted in FIG. 7.
[0148] Referring to FIG. 7, in operation (710), according to one embodiment, a processor of a wearable device may receive information for displaying one or more media contents from an external electronic device via a communication link. Operation (710) of FIG. 7 may be performed similarly to operation (310) of FIG. 3.
[0149] Referring to FIG. 7, in operation (720), a processor of a wearable device according to an embodiment may obtain an amount of information required for displaying a first media content in a body-lock mode. Based on operation (310), the processor, which has received information for displaying all of the first media content in the body-lock mode and the second media content in the world-lock mode, may calculate an amount of information required for displaying the first media content based on operation (720). Operation (720) may be performed similarly to operation (530) of FIG. 5.
[0150] Referring to FIG. 7, within operation (725), according to one embodiment, a processor of a wearable device may obtain an amount of information required for displaying second media content based on the location of the second media content in world-locked mode with respect to the FoV. The processor may perform operation (725) of FIG. 7 similarly to operation (625) of FIG. 6.
[0151] Referring to FIG. 7, within operation (730), a processor of a wearable device according to one embodiment may obtain a throughput based on at least one parameter related to the control of a communication circuit. The processor may obtain a data rate and / or throughput required to receive information based on the sum of the amounts of information obtained based on operations (720, 725) based on mathematical expressions 1 and / or 2.
[0152] Referring to FIG. 7, in operation (735), a processor of a wearable device according to an embodiment may determine at least one parameter based on an amount of acquired information. The at least one parameter determined based on operation (735) may correspond to at least one of the terms of Equation 1 and / or Equation 2. The processor may identify, among combinations of parameters having a throughput of operation (730), a combination that minimizes current consumption and / or power consumption of a communication circuit (e.g., communication circuit (235) of FIG. 2). The processor may control the communication circuit based on the parameters included in the combination. While the communication circuit is controlled based on the parameters, a communication link having a throughput for receiving information based on a sum of amounts of information based on operations (720, 725) may be formed.
[0153] In one embodiment of displaying both first media content based on body-lock mode and second media content based on world-lock mode, as illustrated in FIG. 7, the wearable device may receive information for displaying each of the first media content and the second media content via different communication links. The processor may independently perform the operations of FIG. 7 for each of the communication links.
[0154] Referring to FIG. 7, within operation (740), a processor of a wearable device according to one embodiment may determine whether outputting the first media content has been interrupted. If outputting the first media content has been interrupted (740—Yes), the processor may perform operation (745). While outputting the first media content (740—No), the processor may perform operation (750).
[0155] Referring to FIG. 7, within operation (745), a processor of a wearable device according to one embodiment may adjust the amount of information received via a communication link by changing at least one parameter, the parameter changing based on the location of the second media content relative to the FoV. Because outputting the first media content has been stopped, within operation (745), the processor may receive information from an external electronic device to display only the second media content in a world-locked mode. Within operation (745), the processor may adaptively change parameters for controlling the communication circuitry based on the size, aspect ratio, and / or resolution of the second media content viewed via the display and / or FoV by performing at least one of the operations of FIG. 6. When receiving information for displaying each of the first media content and the second media content using different communication links, the processor may, based on operation (745), release one of the communication links corresponding to the first media content among the communication links and / or change it to a sleep state.
[0156] Referring to FIG. 7, within operation (750), a processor of a wearable device according to one embodiment may identify whether outputting of second media content has been interrupted. If outputting of the second media content has been interrupted (750 - Yes), the processor may perform operation (755). While outputting the second media content (750 - No), the processor may perform at least one of operations (720, 725, 730, 735, 740, 745, 750, 755) of FIG. 7.
[0157] Referring to FIG. 7, in operation (755), a processor of a wearable device according to an embodiment may display the first media content based on a communication link maintained based on an amount of information required for displaying the first media content. Since outputting the second media content has been stopped, in operation (755), the processor may receive information from an external electronic device to display only the first media content in a body-locked mode. In operation (755), the processor may perform at least one of the operations of FIG. 5 to set parameters for controlling the communication circuit based on a frame rate and / or a size of the first media content fixed to a specific point on the display. When receiving information for displaying each of the first media content and the second media content using different communication links, the processor may release one of the communication links corresponding to the second media content and / or change to a sleep state based on operation (755).
[0158] Referring to FIGS. 1 to 7 , exemplary operations of a wearable device for controlling a communication link and / or communication circuit based on the size and / or area of media content displayed on a display of the wearable device are described, but the embodiments are not limited thereto. Hereinafter, with reference to FIGS. 8A , 8B , and / or 9 , exemplary operations of a wearable device performed according to a deformation of an external electronic device while displaying media content received from the external electronic device based on mirroring are described.
[0159] FIGS. 8A and 8B illustrate exemplary screens displayed by a wearable device (101) based on the status of an external electronic device (120). The wearable device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIGS. 8A and / or 8B.
[0160] Referring to FIG. 8A, an exemplary state of a wearable device (101) in communication connection with an external electronic device, such as a smartphone (e.g., smartphone (120-3) of FIG. 2) including a foldable housing, is illustrated. The housing of the smartphone (120-3) may include a first housing assembly (or housing part) (811), a second housing assembly (812) rotatably coupled to the first housing assembly (811), and a hinge assembly (813) positioned between the first housing assembly (811) and the second housing assembly (812). The smartphone (120-3) may include a flexible display (815) extending from the first housing assembly (811) across the hinge assembly (813) to the second housing assembly (812). The smartphone (120-3) may include a cover display (814) positioned on one side (e.g., front side) of the first housing assembly (811) opposite to the other side (e.g., rear side) on which the flexible display (815) is positioned.
[0161] Referring to FIG. 8A, different states (801, 802) of the smartphone (120-3) are illustrated. State (801) may correspond to a state in which the smartphone (120-3) is folded along a folding axis formed along the hinge assembly (813). A state of the smartphone (120-3) in which the angle between the first housing assembly (811) and the second housing assembly (812) is substantially 0°, such as state (801), may be referred to as a folded state. In the folded state, the flexible display (815) may be occluded by the first housing assembly (811) and the second housing assembly (812). In state (802), the flexible display (815) of the smartphone (120-3) may have a fully unfolded form. A state of the smartphone (120-3) in which the angle between the first housing assembly (811) and the second housing assembly (812) is substantially 180°º, such as state (802), may be referred to as an unfolded state. The state of the smartphone (120-3) may include the folded state, the unfolded state, and an intermediate state between the unfolded state and the folded state (or a pre-stop state and / or a sub-fold state).
[0162] While communicating with the smartphone (120-3) of FIG. 8A, the wearable device (101) may receive media content including an execution screen of a software application executed by the smartphone (120-3). The smartphone (120-3) may provide the wearable device (101) with an execution screen based on the size of one of the displays selected based on the state of the smartphone (120-3) (e.g., states (801, 802)) among the flexible display (815) and the cover display (814). For example, within the state (801), the smartphone (120-3) may transmit information to the wearable device (101) for displaying an execution screen based on the size of the cover display (814). For example, within state (802), the smartphone (120-3) can transmit information to the wearable device (101) for displaying an execution screen based on the size of the flexible display (815).
[0163] Referring to FIG. 8A, while the user (110) wears the wearable device (101), the wearable device (101) may display the execution screen provided from the smartphone (120-3) within the screen (130). Within the state (801), the wearable device (101) may display at least a portion of a virtual object (820) including an execution screen based on the size of the cover display (814) within the screen (130). For example, the ratio between the width and height of the virtual object (820) (e.g., aspect ratio) may correspond to the ratio between the width and height of the cover display (814). The resolution of the execution screen displayed through the virtual object (820) may correspond to the resolution of the cover display (814). The virtual object (820) may be displayed at a point linked to a point of the smartphone (120-3) (e.g., world-lock mode) and / or may be displayed at a fixed point on the screen (130) (e.g., body-lock mode).
[0164] While displaying a virtual object (820) based on a state (801), a communication link may be formed between the wearable device (101) and the smartphone (120-3) to transmit information for displaying the virtual object (820). The communication link may be formed to transmit the information based on a data rate and / or processing rate based on the operations described with reference to FIGS. 1 to 7 . For example, the wearable device (101) may calculate an amount of information required for displaying the virtual object (820) based on the size, resolution, and / or frame rate of the virtual object (820) displayed within the screen (130). Based on the data rate and / or processing rate corresponding to the amount, the processor may obtain one or more parameters for controlling the communication circuit. The one or more parameters may include terms of Equation 1 and / or Equation 2.
[0165] According to one embodiment, the wearable device (101) may change at least one parameter related to the control of the communication circuit based on the deformation of the external electronic device (e.g., the smartphone (120-3) of FIG. 8A) while receiving media content to be displayed on the screen (130) from an external electronic device including a deformable housing. For example, the state of the smartphone (120-3) may be switched from a state (801) corresponding to a folded state to a state (802) corresponding to an unfolded state. The wearable device (101) may identify the deformation of the smartphone (120-3) while displaying at least a portion of a virtual object (820) provided from the smartphone (120-3). The wearable device (101) can identify a deformation of the smartphone (120-3) using images and / or videos of the smartphone (120-3) identified using a camera (e.g., camera (225) and / or external camera (225-2) of FIG. 2). The embodiment is not limited thereto, and the wearable device (101) can identify a deformation of the smartphone (120-3) based on a signal received from the smartphone (120-3).
[0166] Referring to FIG. 8A, the smartphone (120-3) that has switched from state (801) to state (802) can transmit information for displaying an execution screen based on the size of the flexible display (815) among the cover display (814) and the flexible display (815) to the wearable device (101). In one embodiment, the wearable device (101) can identify that the amount of information received from the smartphone (120-3) has increased as it switches to state (802). The wearable device (101) that has identified that the amount has increased can change at least one parameter for controlling the communication circuit to establish a communication link that satisfies a data rate and / or processing rate required to receive the increased amount of information, or can adjust a communication link that was established before switching to state (802).
[0167] Referring to FIG. 8A, the wearable device (101) can display a virtual object (822) including an execution screen provided from a smartphone (120-3) in a state (802) within a screen (130) and based on the size of the flexible display (815). An aspect ratio and / or resolution of the virtual object (822) can correspond to the aspect ratio and / or resolution of the flexible display (815). Since the size of the virtual object (822) displayed based on the smartphone (120-3) in the state (802) is larger than the size of the virtual object (820) displayed based on the smartphone (120-3) in the state (801), the processor can establish a communication link having a processing rate greater than the processing rate within the state (801).
[0168] Although the operation of a wearable device (101) based on a smartphone (120-3) including a foldable housing has been described, the embodiment is not limited thereto. Referring to FIG. 8B, an exemplary state of a wearable device (101) connected to a smartphone (120-5) including a slidable housing is illustrated. The smartphone (120-5) may be included in the external electronic device (120) of FIG. 1. The smartphone (120-5) may include a first housing assembly (or housing part) (831) and a second housing assembly (832) engaged with the first housing assembly (831) so as to slide into or out of the first housing assembly (831). The smartphone (120-5) may include a flexible display (833) extending from the front of the first housing assembly (831) to the front of the second housing assembly (832).
[0169] Referring to FIG. 8B, different states (803, 804) of the smartphone (120-5) are illustrated. In state (803), the second housing assembly (832) of the smartphone (120-5) can be completely slid into the first housing assembly (831). The state (803) in which the second housing assembly (832) is completely slid into the first housing assembly (831) may be referred to as a slide-in state and / or a rolled state. In state (803), the flexible display (833) can be at least partially rolled within the housing of the smartphone (120-5). In state (804), the second housing assembly (832) of the smartphone (120-5) can be completely slid out of the first housing assembly (831). The state (804) in which the second housing assembly (832) is completely slid out of the first housing assembly (831) may be referred to as a slide-out state and / or an unrolled state. In the state (804), the area of the flexible display (833) exposed to the outside may be larger than the area of the flexible display (833) exposed to the outside in the state (803). The states of the smartphone (120-5) may include a slide-in state, a slide-out state, and an intermediate state (or a free stop state) between the slide-in state and the slide-out state, respectively, corresponding to the states (803, 804).
[0170] While communicating with the smartphone (120-5) of FIG. 8B, the wearable device (101) may receive media content including an execution screen of a software application running on the smartphone (120-5). The smartphone (120-5) may provide the execution screen to the wearable device (101) based on at least one of the width, height, area, resolution, and / or aspect ratio of the externally exposed flexible display (833). For example, within the state (803), the wearable device (101) may display a virtual object (840) having a width (w1) and a height (h) within the screen (130) based on information received from the smartphone (120-3). The ratio between the width (w1) and the height (h) of the virtual object (840) may correspond to the ratio between the width and the height of the externally exposed flexible display (833) within the state (803). For example, within the state (804), the wearable device (101) may display a virtual object (842) having a width (w2) and a height (h) within the screen (130) based on information received from the smartphone (120-3). The ratio between the width (w2) and the height (h) of the virtual object (842) may correspond to the ratio between the width and the height of the flexible display (833) exposed externally within the state (804).
[0171] When switching from state (803) to state (804), the size of a virtual object displayed by the wearable device (101) and corresponding to the smartphone (120-5) may increase. During the switching from state (803) to state (804), the wearable device (101) may move the virtual object (842) (or the center point of the virtual object (842)) so that the virtual object (842) with the increased size does not move out of the screen (130) (or the FoV of the user (110) wearing the wearable device (101)).
[0172] In one embodiment, the wearable device (101) may identify an input for changing the size of a display (e.g., a flexible display (833)) of an external electronic device, such as a smartphone (120-5). The input may be identified by the smartphone (120-5) and / or based on images and / or videos acquired from a camera of the wearable device (101) (e.g., camera (225) and / or external camera (225-2) of FIG. 2 ). Within the exemplary state of FIG. 8B , the wearable device (101) that has identified a deformation of the smartphone (120-5) may identify a change in the size of a virtual object (e.g., virtual objects (840, 842)) provided from the smartphone (120-5). The wearable device (101) that has identified the change in the above size can obtain at least one parameter related to the control of the communication circuit based on the amount of information required to display the virtual object of the changed size. The wearable device (101) can obtain the at least one parameter based on the operations described above with reference to FIGS. 1 to 7.
[0173] In one embodiment, the mode of the virtual object displayed by the wearable device (101) and corresponding to the smartphone (120-5) may be selected from a body-lock mode or a world-lock mode depending on the shape of the smartphone (120-5). For example, the wearable device (101) that identifies a smartphone (120-5) in a slide-in state or a smartphone (120-3) in a folded state may display a virtual object (840) corresponding to the smartphone (120-5) or a virtual object (820) corresponding to the smartphone (120-3) based on the world-lock mode. For example, a wearable device (101) that identifies a smartphone (120-5) in a slide-out state or a smartphone (120-3) in an unfolded state may display a virtual object (840) corresponding to the smartphone (120-5) or a virtual object (820) corresponding to the smartphone (120-3) based on the body-lock mode. The mapping between the body-lock mode, the world-lock mode, and the states of external electronic devices (e.g., smartphones (120-3, 120-5)) is not limited to the above example, and the opposite mapping may also be possible.
[0174] FIG. 9 illustrates an example of a flowchart of a wearable device according to one embodiment. The wearable device (101) and / or the processor (210) of FIGS. 1 and 2 may perform at least one of the operations described with reference to FIG. 9. The operations of the wearable device described with reference to FIG. 9 may be performed at least partially similarly to, and / or related to, the operations of FIGS. 3, 5, 6, and / or 7.
[0175] Referring to FIG. 9, while multiple operations are depicted as being performed sequentially, the embodiment is not limited thereto. For example, at least two of the operations of FIG. 9 may be performed substantially simultaneously. For example, the operations of FIG. 9 may be performed in a different order than the order depicted in FIG. 9.
[0176] Referring to FIG. 9, within operation (910), according to one embodiment, a processor of a wearable device may receive information for displaying one or more media contents from an external electronic device via a communication link. Operation (910) of FIG. 9 may be performed similarly to operation (310) of FIG. 3.
[0177] Referring to FIG. 9 , in operation (920), a processor of a wearable device according to an embodiment may control a communication circuit (e.g., communication circuit (235) of FIG. 2 ) based on a size at which media content in world-locked mode is displayed within the FoV, based on the information received by operation (310). The FoV of operation (920) may be formed by a display of the wearable device (e.g., display (220) of FIG. 2 ) while the wearable device is worn by a user. The processor may perform operation (920) of FIG. 9 based on operations (340, 350, 360) of FIG. 3 , operations of FIG. 6 and / or FIG. 7 . The one or more media contents of operation (920) may have a width, a height, a resolution, and / or an aspect ratio that are relevant to a display of the external electronic device.
[0178] Referring to FIG. 9 , in operation (930), according to one embodiment, a processor of a wearable device may identify a change in a state (or form) of an external electronic device. For example, the processor may identify a change in the state of the external electronic device using a camera of the wearable device (e.g., camera (225) of FIG. 2 ). For example, the processor may identify a change in the state of the external electronic device based on a signal received from the external electronic device. The change in the state of the external electronic device in operation (930) may be caused by a deformation of a deformable housing and / or a flexible display (e.g., flexible display (815) of FIG. 8A and / or flexible display (833) of FIG. 8B ), as described with reference to FIG. 8A and / or FIG. 8B . A change in the state of the external electronic device in operation (930) may cause a change in the active area (or displaying area or displaying region) of the display included in the external electronic device.
[0179] Referring to FIG. 9 , in operation (940), a processor of a wearable device according to an embodiment may determine an amount of information required to display one or more media contents based on a state of an identified external electronic device. Based on the changed active area due to the changed state of operation (930), the external electronic device may change at least one of the width, height, resolution, and / or aspect ratio of one or more media contents transmitted to the wearable device. The processor, having identified a change in the state of the external electronic device, may calculate and / or determine an amount of information of operation (940) based on the size of the changed active area.
[0180] Referring to FIG. 9, in operation (950), a processor of a wearable device according to an embodiment may change at least one parameter related to control of a communication circuit based on the determined amount of information. For example, the processor may calculate a data rate and / or throughput related to the amount of information determined based on operation (940) based on Equation 1 and / or Equation 2. To establish a communication link supporting the calculated data rate and / or throughput, the processor may change at least one parameter related to control of the communication circuit. The at least one parameter may include at least one of the number of antennas to be used for the communication link, and the frequency and / or number of links to be occupied for the communication link.
[0181] Hereinafter, exemplary appearances of the wearable devices described with reference to FIGS. 1 to 9 are illustrated with reference to FIGS. 10A, 10B, 11A, and / or 11B. The wearable device (1000) of FIG. 10A and / or 10B and / or the wearable device (1100) of FIG. 11A and / or 11B may be an example of the wearable device (101) of FIG. 1.
[0182] FIG. 10A illustrates an example of a perspective view of a wearable device according to one embodiment. According to one embodiment, the wearable device (1000) may have the form of glasses that are wearable on a body part of a user (e.g., head). The wearable device (1000) may include a head-mounted display (HMD). For example, the housing of the wearable device (1000) may include a flexible material, such as rubber and / or silicone, that is configured to fit closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the wearable device (1000) may include one or more straps that can be twined around the user's head, and / or one or more temples that can be detachably attached to the ears of the head.
[0183] Referring to FIG. 10A, according to one embodiment, a wearable device (1000) may include at least one display (1050) and a frame (1000) supporting at least one display (1050).
[0184] According to one embodiment, a wearable device (1000) can be worn on a part of a user's body. The wearable device (1000) can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (1000). For example, the wearable device (1000) can display a virtual reality image provided from at least one optical device (1082, 1084) of FIG. 10b on at least one display (1050) in response to a user's designated gesture acquired through the motion recognition cameras (1060-2, 1060-3) of FIG. 10b.
[0185] According to one embodiment, at least one display (1050) may provide visual information to a user. For example, at least one display (1050) may include a transparent or translucent lens. At least one display (1050) may include a first display (1050-1) and / or a second display (1050-2) spaced apart from the first display (1050-1). For example, the first display (1050-1) and the second display (1050-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.
[0186] Referring to FIG. 10B, at least one display (1050) can provide a user with visual information transmitted from external light and other visual information distinct from the visual information through a lens included in the at least one display (1050). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, the at least one display (1050) can include a first surface (1031) and a second surface (1032) opposite the first surface (1031). A display area can be formed on the second surface (1032) of the at least one display (1050). When a user wears the wearable device (1000), external light can be transmitted to the user by being incident on the first surface (1031) and transmitted through the second surface (1032). As another example, at least one display (1050) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (1082, 1084) on a real screen transmitted through external light, in a display area formed on the second surface (1032).
[0187] In one embodiment, at least one display (1050) may include at least one waveguide (1033, 1034) that diffracts light emitted from at least one optical device (1082, 1084) and transmits the diffracted light to a user. The at least one waveguide (1033, 1034) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (1033, 1034). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (1033, 1034) may be propagated to the other end of the at least one waveguide (1033, 1034) by the nano-pattern. At least one waveguide (1033, 1034) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (1033, 1034) may be arranged within the wearable device (1000) to guide a screen displayed by at least one display (1050) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) occurring within the at least one waveguide (1033, 1034).
[0188] The wearable device (1000) can analyze an object included in a real image collected through a shooting camera (1060-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (1050). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (1000) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (1000) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using the multi-camera and / or time-of-flight (ToF). A user wearing the wearable device (1000) can view an image displayed on at least one display (1050).
[0189] According to one embodiment, the frame (1000) may be configured as a physical structure that allows the wearable device (1000) to be worn on the user's body. According to one embodiment, the frame (1000) may be configured so that, when the user wears the wearable device (1000), the first display (1050-1) and the second display (1050-2) can be positioned corresponding to the user's left and right eyes. The frame (1000) may support at least one display (1050). For example, the frame (1000) may support the first display (1050-1) and the second display (1050-2) to be positioned corresponding to the user's left and right eyes.
[0190] Referring to FIG. 10A, the frame (1000) may include a region (1020) that at least partially contacts a part of the user's body when the user wears the wearable device (1000). For example, the region (1020) of the frame (1000) that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (1000) makes contact with. According to one embodiment, the frame (1000) may include a nose pad (1010) that contacts a part of the user's body. When the wearable device (1000) is worn by the user, the nose pad (1010) may contact a part of the user's nose. The frame (1000) may include a first temple (1004) and a second temple (1005) that contact another part of the user's body that is distinct from the part of the user's body.
[0191] For example, the frame (1000) may include a first rim (1001) that surrounds at least a portion of the first display (1050-1), a second rim (1002) that surrounds at least a portion of the second display (1050-2), a bridge (1003) that is disposed between the first rim (1001) and the second rim (1002), a first pad (1011) that is disposed along a portion of the edge of the first rim (1001) from one end of the bridge (1003), a second pad (1012) that is disposed along a portion of the edge of the second rim (1002) from the other end of the bridge (1003), a first temple (1004) that extends from the first rim (1001) and is fixed to a portion of the ear of the wearer, and a second temple (1005) that extends from the second rim (1002) and is fixed to a portion of the ear opposite the ear. There are. The first pad (1011) and the second pad (1012) can be in contact with a part of the user's nose, and the first temple (1004) and the second temple (1005) can be in contact with a part of the user's face and a part of the user's ear. The temples (1004, 1005) can be rotatably connected to the rim through the hinge units (1006, 1007) of FIG. 10B. The first temple (1004) can be rotatably connected to the first rim (1001) through the first hinge unit (1006) disposed between the first rim (1001) and the first temple (1004). The second temple (1005) may be rotatably connected to the second rim (1002) via a second hinge unit (1007) disposed between the second rim (1002) and the second temple (1005). In one embodiment, the wearable device (1000) may use a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (1000) to identify an external object (e.g., a user's fingertip) touching the frame (1000) and / or a gesture performed by the external object.
[0192] According to one embodiment, the wearable device (1000) may include hardwares (e.g., hardwares described above based on the block diagram of FIG. 2) that perform various functions. For example, the hardwares may include a battery module (1070), an antenna module (1075), at least one optical device (1082, 1084), speakers (e.g., speakers 1055-1, 1055-2), a microphone (e.g., microphones 1065-1, 1065-2, 1065-3), a light-emitting module, and / or a printed circuit board (PCB) (1090) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (1000).
[0193] According to one embodiment, microphones (e.g., microphones 1065-1, 1065-2, 1065-3) of the wearable device (1000) may be disposed on at least a portion of the frame (1000) to acquire sound signals. A first microphone (1065-1) disposed on the bridge (1003), a second microphone (1065-2) disposed on the second rim (1002), and a third microphone (1065-3) disposed on the first rim (1001) are illustrated in FIG. 10B , but the number and arrangement of the microphones (1065) are not limited to the embodiment of FIG. 10B . When the number of microphones (1065) included in the wearable device (1000) is two or more, the wearable device (1000) can identify the direction of a sound signal by using a plurality of microphones placed on different parts of the frame (1000).
[0194] According to one embodiment, at least one optical device (1082, 1084) may project a virtual object onto at least one display (1050) to provide various image information to a user. For example, at least one optical device (1082, 1084) may be a projector. At least one optical device (1082, 1084) may be disposed adjacent to at least one display (1050) or may be included within at least one display (1050) as a part of at least one display (1050). According to one embodiment, the wearable device (1000) may include a first optical device (1082) corresponding to a first display (1050-1) and a second optical device (1084) corresponding to a second display (1050-2). For example, at least one optical device (1082, 1084) may include a first optical device (1082) disposed at an edge of a first display (1050-1) and a second optical device (1084) disposed at an edge of a second display (1050-2). The first optical device (1082) may transmit light to a first waveguide (1033) disposed on the first display (1050-1), and the second optical device (1084) may transmit light to a second waveguide (1034) disposed on the second display (1050-2).
[0195] In one embodiment, the camera (1060) may include a recording camera (1060-4), an eye tracking camera (ET CAM) (1060-1), and / or a motion recognition camera (1060-2, 1060-3). The recording camera (1060-4), the eye tracking camera (1060-1), and the motion recognition cameras (1060-2, 1060-3) may be positioned at different locations on the frame (1000) and may perform different functions. The eye tracking camera (1060-1) may output data indicating the position or gaze of the eyes of a user wearing the wearable device (1000). For example, the wearable device (1000) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (1060-1).
[0196] The wearable device (1000) can identify an object (e.g., a real object and / or a virtual object) focused on by the user using the user's gaze acquired through the gaze tracking camera (1060-1). The wearable device (1000) that has identified the focused object can execute a function (e.g., gaze interaction) for interaction between the user and the focused object. The wearable device (1000) can express a part corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (1060-1). The wearable device (1000) can render an image (or screen) displayed on at least one display (1050) based on the position of the user's eyes.
[0197] For example, the visual quality of a first region related to the gaze within an image and the visual quality (e.g., resolution, brightness, saturation, grayscale, PPI) of a second region distinct from the first region may be different from each other. The wearable device (1000) may obtain an image having the visual quality of the first region matching the gaze of the user and the visual quality of the second region using foveated rendering. For example, if the wearable device (1000) supports an iris recognition function, user authentication may be performed based on iris information obtained using the gaze tracking camera (1060-1). Although an example in which the gaze tracking camera (1060-1) is positioned toward the user's right eye is illustrated in FIG. 10B, the embodiment is not limited thereto, and the gaze tracking camera (1060-1) may be positioned solely toward the user's left eye, or toward both eyes.
[0198] In one embodiment, the capturing camera (1060-4) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera (1060-4) can be used to acquire a high-resolution image based on HR (high resolution) or PV (photo video). The capturing camera (1060-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (1050). The at least one display (1050) can display a single image in which information about an actual image or background including an image of the specific object acquired using the capturing camera (1060-4) and a virtual image provided through at least one optical device (1082, 1084) are superimposed. The wearable device (1000) can compensate for depth information (e.g., the distance between the wearable device (1000) and an external object acquired through a depth sensor) using an image acquired through the capture camera (1060-4). The wearable device (1000) can perform object recognition using an image acquired using the capture camera (1060-4). The wearable device (1000) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the capture camera (1060-4). The wearable device (1000) can perform a pass-through function to display an image acquired through the capture camera (1060-4) by overlapping at least a portion of a screen representing a virtual space on at least one display (1050) while displaying a screen. In one embodiment, the shooting camera (1060-4) may be positioned on a bridge (1003) positioned between the first rim (1001) and the second rim (1002).
[0199] The gaze tracking camera (1060-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (1000) and matching the user's gaze with visual information provided to at least one display (1050). For example, when the wearable device (1000) looks straight ahead, the wearable device (1000) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (1050). The gaze tracking camera (1060-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (1060-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (1060-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (1060-1) may be positioned within the first rim (1001) and / or the second rim (1002) to face the direction in which the user wearing the wearable device (1000) is positioned.
[0200] The gesture recognition camera (1060-2, 1060-3) can provide a specific event on a screen provided on at least one display (1050) by recognizing the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the user's body. The gesture recognition camera (1060-2, 1060-3) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (1050). The processor can identify the signal corresponding to the gesture, and perform a designated function based on the identification. The gesture recognition camera (1060-2, 1060-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 dof pose). The processor may perform gesture recognition and / or object tracking functions using the motion recognition cameras (1060-2, 1060-3). In one embodiment, the motion recognition cameras (1060-2, 1060-3) may be positioned on the first rim (1001) and / or the second rim (1002).
[0201] The camera (1060) included in the wearable device (1000) is not limited to the above-described gaze tracking camera (1060-1) and motion recognition cameras (1060-2, 1060-3). For example, the wearable device (1000) can identify an external object included in the FoV using a camera positioned toward the user's FoV. The wearable device (1000) can identify an external object based on a sensor for identifying the distance between the wearable device (1000) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (1060) positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (1000) may include a camera (1060) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (1000).
[0202] Although not shown, in one embodiment, the wearable device (1000) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (1060). The light source may include an LED having an infrared wavelength. The light source may be disposed on at least one of the frame (1000) and the hinge units (1006, 1007).
[0203] According to one embodiment, the battery module (1070) may supply power to electronic components of the wearable device (1000). In one embodiment, the battery module (1070) may be disposed within the first temple (1004) and / or the second temple (1005). For example, the battery module (1070) may be a plurality of battery modules (1070). The plurality of battery modules (1070) may be disposed within each of the first temple (1004) and the second temple (1005). In one embodiment, the battery module (1070) may be disposed at an end of the first temple (1004) and / or the second temple (1005).
[0204] The antenna module (1075) can transmit signals or power to the outside of the wearable device (1000), or receive signals or power from the outside. In one embodiment, the antenna module (1075) can be positioned within the first temple (1004) and / or the second temple (1005). For example, the antenna module (1075) can be positioned close to one surface of the first temple (1004) and / or the second temple (1005).
[0205] The speaker (1055) can output an audio signal to the outside of the wearable device (1000). The audio output module may be referred to as a speaker. In one embodiment, the speaker (1055) may be positioned within the first temple (1004) and / or the second temple (1005) so as to be positioned adjacent to the ear of a user wearing the wearable device (1000). For example, the speaker (1055) may include a second speaker (1055-2) positioned within the first temple (1004) and thus adjacent to the user's left ear, and a first speaker (1055-1) positioned within the second temple (1005) and thus adjacent to the user's right ear.
[0206] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the wearable device (1000) to the user. For example, when the wearable device (1000) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (1001) and / or the second rim (1002).
[0207] Referring to FIG. 10B, according to one embodiment, a wearable device (1000) may include a printed circuit board (PCB) (1090). The PCB (1090) may be included in at least one of the first temple (1004) or the second temple (1005). The PCB (1090) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the wearable device (1000) (e.g., hardwares illustrated by different blocks in FIG. 3) may be disposed on the PCB (1090). The wearable device (1000) may include a flexible PCB (FPCB) for interconnecting the hardwares.
[0208] According to one embodiment, a wearable device (1000) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (1000) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (1000). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (1000) may identify a user's motion and / or gesture performed to execute or stop a specific function of the wearable device (1000) based on the IMU.
[0209] Figures 11A and 11B illustrate an example of an exterior appearance of a wearable device according to one embodiment. The wearable device (1100) of Figures 11A and 11B may include at least a portion of the hardware of the wearable device (1000) described with reference to Figures 10A and / or 10B. An example of an exterior appearance of a first side (1110) of a housing of the wearable device (1100) according to one embodiment is illustrated in Figure 11A, and an example of an exterior appearance of a second side (1120) opposite to the first side (1110) may be illustrated in Figure 11B.
[0210] Referring to FIG. 11A, a first surface (1110) of a wearable device (1100) according to one embodiment may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (1100) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (1004) and / or the second temple (1005) of FIGS. 10A and 10B). A first display (1050-1) for outputting an image to a left eye among the user's two eyes, and a second display (1050-2) for outputting an image to a right eye among the two eyes, may be disposed on the first surface (1110). The wearable device (1100) may be formed on the first surface (1110) and may further include a rubber or silicone packing to prevent interference from light (e.g., ambient light) different from the light emitted from the first display (1050-1) and the second display (1050-2).
[0211] According to one embodiment, a wearable device (1100) may include cameras (1060-1) for photographing and / or tracking both eyes of a user adjacent to each of the first display (1050-1) and the second display (1050-2). The cameras (1060-1) may be referred to as the gaze tracking camera (1060-1) of FIG. 10B. According to one embodiment, a wearable device (1100) may include cameras (1060-5, 1060-6) for photographing and / or recognizing a face of a user. The cameras (1060-5, 1060-6) may be referred to as FT cameras. The wearable device (1100) can control an avatar representing the user in a virtual space based on the facial motion of the user identified using cameras (1060-5, 1060-6). For example, the wearable device (1100) can change the texture and / or shape of a portion of the avatar (e.g., a portion of the avatar representing a human face) using information obtained by cameras (1060-5, 1060-6) (e.g., FT cameras) and representing the facial expression of the user wearing the wearable device (1100).
[0212] Referring to FIG. 11B, a camera (e.g., cameras (1060-7, 1060-8, 1060-9, 1060-10, 1060-11, 1060-12)) and / or a sensor (e.g., a depth sensor (1130)) for obtaining information related to the external environment of the wearable device (1100) may be disposed on a second surface (1120) opposite to the first surface (1110) of FIG. 11A. For example, the cameras (1060-7, 1060-8, 1060-9, 1060-10) may be disposed on the second surface (1120) to recognize external objects. The cameras (1060-7, 1060-8, 1060-9, 1060-10) of FIG. 11b can correspond to the motion recognition cameras (1060-2, 1060-3) of FIG. 10b.
[0213] For example, using cameras (1060-11, 1060-12), the wearable device (1100) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (1060-11) can be placed on the second face (1120) of the wearable device (1100) to obtain an image to be displayed through the second display (1050-2) corresponding to the right eye among the two eyes. The camera (1060-12) can be placed on the second face (1120) of the wearable device (1100) to obtain an image to be displayed through the first display (1050-1) corresponding to the left eye among the two eyes. The cameras (1060-11, 1060-12) can correspond to the shooting camera (1060-4) of FIG. 10B.
[0214] According to one embodiment, the wearable device (1100) may include a depth sensor (1130) disposed on the second face (1120) to identify a distance between the wearable device (1100) and an external object. Using the depth sensor (1130), the wearable device (1100) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (1100). Although not illustrated, a microphone may be disposed on the second face (1120) of the wearable device (1100) to obtain a sound output from an external object. The number of microphones may be one or more, depending on the embodiment.
[0215] In one embodiment, a method may be required to adjust a communication link established with an external electronic device that provides media content displayed on a display based on a size of at least a portion of the media content displayed on the display. As described above, according to one embodiment, a wearable device (e.g., wearable device (101) of FIG. 1 ) may include a display (e.g., display (220) of FIG. 2 ), a communication circuit (e.g., communication circuit (235) of FIG. 2 ), a memory for storing instructions (e.g., memory (215) of FIG. 2 ), and at least one processor for executing the instructions (e.g., processor (210) of FIG. 2 ). The at least one processor may be configured to, in response to receiving information for displaying a virtual object (e.g., virtual objects (152, 154, 156) of FIG. 1, virtual objects (420, 430) of FIG. 4, virtual objects (820, 822) of FIG. 8A, virtual objects (840, 842) of FIG. 8B) through a communication link (e.g., communication link (440) of FIG. 2) established by the communication circuit, acquire a location of the virtual object with respect to the display based on the information. The at least one processor may be configured to display at least a portion of the virtual object on the display based on the acquired location. The at least one processor may be configured to change at least one parameter associated with control of the communication circuit to adjust an amount of the information received via the communication link based on a size of at least a portion of the virtual object displayed on the display.According to one embodiment, a wearable device can control a communication circuit to reduce power consumption of the communication circuit while maintaining an amount of information received through the communication circuit suitable for a virtual object displayed on a display based on the information.
[0216] For example, the at least one processor may be configured to change the parameter based on indicating at least a portion of the virtual object associated with a point in external space specified by the information.
[0217] For example, the at least one processor may be configured to receive, via the communication link, the information for displaying the virtual object, which is associated with the point in the external space where the external electronic device is placed and has a size of a display included in the external electronic device.
[0218] For example, the at least one processor may be configured to change the at least one parameter in response to an input for changing the size of the display of the external electronic device while displaying at least a portion of the virtual object, to increase the amount of information.
[0219] For example, the at least one processor may be configured to maintain the at least one parameter based on identifying the virtual object associated with a fixed point with respect to the wearable device based on the information.
[0220] For example, the at least one processor may be configured to determine the amount of information required to display the virtual object based on the size. The at least one processor may be configured to determine the at least one parameter based on a data rate corresponding to the determined amount.
[0221] For example, the at least one processor may be configured to control the communication circuitry supporting communication of a wireless local area network (WLAN) to change at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links based on the changed parameter.
[0222] For example, the at least one processor may be configured to change logical connections of the communication link established between the wearable device and the external electronic device, distinguished by a port number, based on the at least one parameter.
[0223] According to one embodiment of the present invention, a method of a wearable device as described above may include, in response to receiving information for displaying a virtual object through a communication link established by a communication circuit of the wearable device and an external electronic device, an operation of obtaining a location of the virtual object with respect to a display of the wearable device based on the information. The method may include an operation of displaying at least a portion of the virtual object on the display based on the obtained location. The method may include an operation of changing at least one parameter related to control of the communication circuit to adjust an amount of the information received through the communication link based on a size of the at least a portion of the virtual object displayed on the display.
[0224] For example, the changing action may include changing the parameter based on displaying at least a portion of the virtual object associated with a point in external space specified by the information.
[0225] For example, the method may include an operation of receiving, through the communication link, the information for displaying the virtual object, which is linked to the point in the external space where the external electronic device is placed and has the size of a display included in the external electronic device.
[0226] For example, the changing operation may include changing the at least one parameter in response to an input for changing the size of the display of the external electronic device while displaying at least a portion of the virtual object, to increase the amount of information.
[0227] For example, based on said information, the wearable device may include an operation of maintaining said at least one parameter based on identifying said virtual object associated with a fixed point.
[0228] For example, the changing operation may include an operation of determining the amount of information required to display the virtual object based on the size. The changing operation may include an operation of determining the at least one parameter based on a data rate corresponding to the determined amount.
[0229] For example, the changing operation may include controlling the communication circuit that supports communication of a wireless local area network (WLAN), and changing at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links based on the changed parameter.
[0230] For example, the changing operation may include changing logical connections of the communication link established between the wearable device and the external electronic device, distinguished by a port number, based on the at least one parameter.
[0231] According to one embodiment, a wearable device as described above may include a display, a communication circuit, a memory for storing instructions, and at least one processor for executing the instructions. The at least one processor may be configured to receive information for displaying a plurality of virtual objects through a communication link established by the communication circuit between the wearable device and an external electronic device. The at least one processor may be configured to display, on the display, at least a portion of a first virtual object associated with a point on the display specified by the information and a second virtual object associated with a point in an external space specified by the information. The at least one processor may be configured to change at least one parameter related to the control of the communication circuit such that an amount of the information received through the communication link corresponds to a size of at least a portion of the second virtual object displayed on the display.
[0232] For example, the at least one processor may be configured to identify the point on the display associated with the first virtual object and the point in the external space associated with the second virtual object, based on reference locations of each of the first virtual object and the second virtual object, set by the information.
[0233] For example, the at least one processor may be configured to control the communication circuitry supporting communication of a wireless local area network (WLAN) to change at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links based on the changed parameter.
[0234] For example, the at least one processor may be configured to determine the amount of information required to display the virtual object based on the size. The at least one processor may be configured to determine the at least one parameter based on a data rate corresponding to the determined amount.
[0235] According to one embodiment of the present invention, a method of a wearable device as described above may include an operation of receiving information for displaying a plurality of virtual objects through a communication link established by a communication circuit of the wearable device between the wearable device and an external electronic device. The method may include an operation of displaying, on a display of the wearable device, at least a portion of a first virtual object associated with a point on the display specified by the information and a second virtual object associated with a point in an external space specified by the information. The method may include an operation of changing at least one parameter related to control of the communication circuit such that an amount of the information received through the communication link corresponds to a size of at least a portion of the second virtual object displayed on the display.
[0236] For example, the displaying action may include an action of identifying the point on the display associated with the first virtual object and the point in the external space associated with the second virtual object, based on the reference positions of each of the first virtual object and the second virtual object set by the information.
[0237] For example, the changing operation may include controlling the communication circuit that supports communication of a wireless local area network (WLAN), and changing at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links based on the changed parameter.
[0238] For example, the changing operation may include an operation of determining the amount of information required to display the virtual object based on the size. The changing operation may include an operation of determining the at least one parameter based on a data rate corresponding to the determined amount.
[0239] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.
[0240] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.
[0241] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.
[0242] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
[0243] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.
Claims
1. In wearable devices, display; communication circuit; A memory comprising one or more storage media storing instructions; and comprising at least one processor including a processing circuit; The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: In response to receiving information for displaying a virtual object through a communication link between the wearable device and an external electronic device established by the communication circuit, obtaining a location of the virtual object with respect to the display based on the information; Based on the acquired location, displaying at least a portion of the virtual object on the display; and causing at least one parameter related to the control of the communication circuit to be changed, based on the size of at least a portion of the virtual object displayed on the display, to adjust the amount of information received via the communication link; Wearable devices.
2. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: causing said parameter to be changed based on indicating at least a portion of said virtual object associated with a point in external space, specified by said information; Wearable devices.
3. In claims 1 and 2, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Causing, through said communication link, to receive said information for displaying said virtual object, which is linked to said point in said external space where said external electronic device is placed, and has a size of a display included in said external electronic device. Wearable devices.
4. In claims 1 to 3, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: while displaying at least a portion of said virtual object, in response to an input for changing the size of said display of said external electronic device, causing said at least one parameter to be changed so as to increase the amount of said information; Wearable devices.
5. In claims 1 to 4, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Based on said information, causing said wearable device to maintain said at least one parameter based on identifying said virtual object associated with a fixed point, Wearable devices.
6. In claims 1 to 5, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Determine the amount of information required to display the virtual object based on the above size; causing said at least one parameter to be determined based on a data rate corresponding to the determined amount; Wearable devices.
7. In claims 1 to 6, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Controlling the communication circuit supporting communication of a wireless local area network (WLAN), causing at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links to be changed based on the changed parameter. Wearable devices.
8. In claims 1 to 7, the instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Causing logical connections of the communication link established between the wearable device and the external electronic device, distinguished by a port number, to be changed based on the at least one parameter; Wearable devices.
9. In the method of a wearable device, An operation of obtaining a location of the virtual object on a display of the wearable device based on the information, in response to receiving information for displaying the virtual object through a communication link between the wearable device and an external electronic device established by a communication circuit of the wearable device; An operation of displaying at least a portion of the virtual object on the display based on the acquired location; and An operation of changing at least one parameter related to the control of the communication circuit to adjust the amount of the information received through the communication link based on the size of at least a portion of the virtual object displayed on the display, method.
10. In claim 9, the changing operation is: An operation of changing said parameter based on indicating at least a portion of said virtual object associated with a point in external space, specified by said information. method.
11. In claims 9 to 10, Further comprising an action of receiving, through the communication link, the information for displaying the virtual object, which is linked to the point of the external space where the external electronic device is placed and has the size of a display included in the external electronic device. method.
12. In claims 9 to 11, the changing operation comprises: An operation for changing said at least one parameter in response to an input for changing said size of said display of said external electronic device, while displaying said at least a portion of said virtual object, to increase the amount of said information. method.
13. In claims 9 to 12, Based on said information, an operation of maintaining said at least one parameter, comprising identifying said virtual object associated with a fixed point with respect to said wearable device. method.
14. In claims 9 to 13, the changing operation comprises: An action of determining the amount of information required to display the virtual object based on the size; An operation of determining at least one parameter based on a data rate corresponding to the determined amount, method.
15. In claims 9 to 14, the changing operation comprises: An operation of controlling the communication circuit supporting communication of a wireless local area network (WLAN), and changing at least one of the number of antennas to be used for the communication link, the bandwidth of the communication link, or the number of the communication links based on the changed parameter. method.
Citation Information
Patent Citations
Heater for cooking device and manufacturing method thereof
KR1020220144516A
Adhesive composition and adhesive
KR1020230141557A
Optical memory module and optical computing system including the same
KR1020240178432A
Infiltration reinforced primer containing silica sol for alkali-restoring of concrete structure and preparation method of the same, and method of repairing neutralized concrete structures using the same
KR102596064B1
KR20230109478A